
Open-source transformer-based generalist robot policy with a diffusion action head, pretrained on 800k Open X-Embodiment trajectories; controllable via language or goal images.
🔬 Research✓ Public access⚖ Open sourceRobotics foundation modelVision-Language-Action model
Parameters
27M / 93M
parameters
Release date
20 May 2024
Access:DownloadDeployment:💻 Local☁ Cloud
Overview
Classification
Robotics foundation modelVision-Language-Action model
Applications
Access & deployment
Download
LocalCloud
Weights: Open source
Key parameters
🧩 Parameters: 27M / 93M
✓ Fine-tuning
📥 Input: text, image, robot state data, robot sensors
Robotics
Robot controlRobot manipulationMotion planningDexterous manipulation
Technical specification
Parameters
27M / 93M
parameters
License
MIT
Hardware requirements
Fine-tuning within a few hours on a single consumer GPU; inference ~13–17 iterations/s (Octo-Base / Octo-Small). Built on JAX.
Features:✓ Fine-tuning
Modalities
⬇ Input
textimagerobot_state_datarobot_sensors
⬆ Output
robot_actionsmotion_trajectoriesmanipulator_control
Capabilities and applications
Native model capabilities
Action conditioning
Controlling model generation via action signals (camera, robot pose, commands, speech) rather than text prompts alone.
Category: multimodal
Cross-embodiment transfer
The ability of a single model to control robots with different morphologies (humanoids, dual-arm rigs, mobile platforms) without training a separate model per platform. Intelligence is decoupled from embodiment, so the same policy runs on hardware with different kinematics and dynamics.
Category: robotics
Vision-language-action grounding
The ability of a VLA model to ground visual perception and a language instruction into a concrete physical robot action. The model understands the scene and intent, then generates an executable action sequence, closing the loop from observation to motion.
Category: robotics
Instruction following
Precisely following instructions contained in the prompt: response format, length, style, constraints (e.g. 'reply in six words'). GPT-5.1 significantly improved this capability compared to GPT-5.
Category: language
Robotics
Robot controlRobot manipulationMotion planningDexterous manipulation
Application domains
Benchmark results
2 benchmarks
Open X-Embodiment / WidowX (BridgeData) — zero-shot
success rate · zero-shot
0.50
📄 paper
Zero-shot result on the WidowX robot reported in the Octo paper.
Fine-tuning (średnia z 6 zadań)
success rate · finetuned
0.72
📄 paper
Average success rate after finetuning; +52% over the VC-1 baseline.
Technical architecture
Core Architecture
Model Form
Training Techniques