Perception · Perception & Vision Software
1.45.0·
Luxonis OS is a custom Linux distribution based on the Yocto Project, designed for the Robotics Vision Core 4 (RVC4) chip with its 6-core ARMv8 CPU. The OS is pre-installed on OAK4 cameras and can be updated to deliver new features.
Luxonis OS is the system layer that runs on the device itself, while DepthAI is the SDK/API (Python and C++) used to build perception pipelines. DepthAI v3 supports both the older OAK cameras (RVC2) and OAK4 (RVC4). Luxonis OS arrives with the RVC4 generation and makes OAK4 cameras fully standalone devices.
The OS image is distributed as a binary and can be updated over the air (OTA). Devices are managed with the oakctl tool (host side) and agentconfd (on the device). The recommended way to deploy applications is to run them in containers via oakctl. A Python 3 interpreter is available on the device.
ROS 2 applications can run directly onboard RVC4-based OAK4 devices. The system provides on-device perception: depth sensing, object tracking, feature detection and matching, and VIO/SLAM.
General-purpose or robotics-specialized operating system — Ubuntu, Ubuntu Core, ROS-aware distributions. Provides the platform for middleware, runtime, and robotic applications.
A Perception Stack encompasses the software layers that process data from cameras, LiDARs, IMUs, microphones, and other sensors in order to recognise the surrounding environment, perform localisation, detect and track objects, and interpret the scene. It is typically the first processing stage in an autonomous robot's data pipeline, feeding its outputs to planning and control stacks.
Luxonis OS runs only on RVC4-based OAK4 devices.
Up to 120 fps at 1280x800 on OV9282/OV9782 sensors; OV9282 binned mode up to 240 fps; 14th STM32 FSYNC channel.
Image Front End (IFE) sharing – up to five concurrent cameras.
From 1.18, SSH password access is disabled by default; oakctl works without a password.
First release in the 1.x line.
