Robots Atlas>ROBOTS ATLAS
Octo

Octo

1.5
Open-source transformer-based generalist robot policy with a diffusion action head, pretrained on 800k Open X-Embodiment trajectories; controllable via language or goal images.
🔬 Research✓ Public access⚖ Open sourceRobotics foundation modelVision-Language-Action model
Parameters
27M / 93M
parameters
Release date
20 May 2024
Access:DownloadDeployment:💻 Local☁ Cloud

Overview

Octo is an open-source, widely applicable generalist robot policy developed by the Octo Model Team, a group of researchers from UC Berkeley, Stanford University, Carnegie Mellon University and Google DeepMind. The model is built on a transformer backbone with a diffusion action head (diffusion policy), letting it model multi-modal manipulator action distributions.

Octo was pretrained on 800k trajectories drawn from a mixture of 25 datasets in the Open X-Embodiment collection — the largest robot manipulation dataset to date. It can be instructed via natural-language commands or goal images, and its modular attention structure enables fast fine-tuning to new robots, sensors and action spaces within a few hours on standard consumer GPUs.

Two variants are available: Octo-Small (27M parameters) and Octo-Base (93M parameters). The code is released under the MIT license (JAX framework) and the weights are published on Hugging Face (rail-berkeley). Across experiments on 9 robotic platforms, Octo serves as a versatile policy initialization that can be effectively finetuned to new observation and action spaces.

Classification
Robotics foundation modelVision-Language-Action model
Access & deployment
Download
LocalCloud
Weights: Open source
Key parameters
🧩 Parameters: 27M / 93M
✓ Fine-tuning
📥 Input: text, image, robot state data, robot sensors
Robotics
Robot controlRobot manipulationMotion planningDexterous manipulation

Technical specification

Parameters
27M / 93M
parameters
License
MIT
Hardware requirements
Fine-tuning within a few hours on a single consumer GPU; inference ~13–17 iterations/s (Octo-Base / Octo-Small). Built on JAX.
Features:Fine-tuning
Modalities
⬇ Input
textimagerobot_state_datarobot_sensors
⬆ Output
robot_actionsmotion_trajectoriesmanipulator_control

Capabilities and applications

Native model capabilities
Action conditioning
Controlling model generation via action signals (camera, robot pose, commands, speech) rather than text prompts alone.
Category: multimodal
Cross-embodiment transfer
The ability of a single model to control robots with different morphologies (humanoids, dual-arm rigs, mobile platforms) without training a separate model per platform. Intelligence is decoupled from embodiment, so the same policy runs on hardware with different kinematics and dynamics.
Category: robotics
Vision-language-action grounding
The ability of a VLA model to ground visual perception and a language instruction into a concrete physical robot action. The model understands the scene and intent, then generates an executable action sequence, closing the loop from observation to motion.
Category: robotics
Instruction following
Precisely following instructions contained in the prompt: response format, length, style, constraints (e.g. 'reply in six words'). GPT-5.1 significantly improved this capability compared to GPT-5.
Category: language
Robotics
Robot controlRobot manipulationMotion planningDexterous manipulation

Benchmark results

2 benchmarks
Open X-Embodiment / WidowX (BridgeData) — zero-shot
success rate · zero-shot
0.50
📄 paper
Zero-shot result on the WidowX robot reported in the Octo paper.
Fine-tuning (średnia z 6 zadań)
success rate · finetuned
0.72
📄 paper
Average success rate after finetuning; +52% over the VC-1 baseline.