
TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAM
Key Points
- 1TurboVLA introduces a new V+L → A paradigm that replaces the compute-intensive, LLM-centric execution pathway with direct, lightweight vision-language interaction.
- 2By utilizing a compact 0.2B parameter model and non-autoregressive action decoding, the architecture achieves a high-performance 32 Hz inference rate while requiring less than 1 GB of VRAM.
- 3Extensive experiments demonstrate that TurboVLA maintains competitive manipulation success rates across LIBERO and real-world benchmarks, effectively lowering the hardware barrier for real-time robotic control.
TurboVLA is a novel Vision-Language-Action (VLA) model that challenges the prevailing LLM-centric paradigm by replacing the large language model (LLM) core with a direct, lightweight mapping. While existing VLA models (e.g., RT-2, OpenVLA) suffer from significant computational overhead due to the use of billions of parameters in their language-model bottlenecks, TurboVLA achieves high-performance real-time manipulation with only 0.2B parameters, sub-1GB VRAM usage, and a 32 Hz inference rate.
Core Methodology
TurboVLA moves away from the pathway, where visual observations are projected into a linguistic latent space and processed via an LLM. Instead, it architecture consists of three modular components:- Multimodal Feature Encoding: The model uses separate, lightweight encoders for visual observations and linguistic instructions. A visual encoder processes camera views to extract features , while a BERT-based text encoder processes task instructions into a token sequence . These are projected into a shared latent dimension . Robot states are also encoded separately via to assist in action decoding.
- Vision-Language Interaction Module: To establish correspondence without an LLM, TurboVLA employs a bidirectional cross-attention mechanism. It iterates through layers to refine features:
This process injects scene context into the instruction stream and conditions visual features on specific task semantics, effectively forming "action-ready" representations () that isolate relevant objects and spatial relations without requiring open-ended reasoning.
- Action Chunk Decoder: The fused multimodal features and the robot state are fed into an ACT-style transformer decoder. The decoder uses learnable action queries to produce a sequence of continuous action chunks in a single forward pass:
This non-autoregressive decoding approach bypasses the sequential token-generation overhead inherent in autoregressive VLA models, enabling high-frequency, responsive execution.