A compact 0.8B multimodal Qwen model (Alibaba): hybrid Gated DeltaNet + sparse MoE, 24 layers, 262K context, text/image/video, thinking mode and tools. Apache 2.0.
Context window
262K
tokens
Parameters
0.8B
parameters
Release date
1 January 2026
Access:DownloadHostedDeployment:๐ป Localโ Cloud๐ฑ On-device
Overview
Access & deployment
DownloadHosted
LocalCloudOn-device
Weights: Open source
Key parameters
๐ Context: 262K
๐งฉ Parameters: 0.8B
โ Toolsย ยทย โ Fine-tuning
๐ฅ Input: text, image, video
Technical specification
Context window
262K
tokens
Parameters
0.8B
parameters
License
Apache 2.0
Hardware requirements
24 layers, hybrid Gated DeltaNet + sparse MoE; native 262,144-token context. Very lightweight, for efficient inference.
Features:โ Tool useโ Fine-tuning
Modalities
โฌ Input
textimagevideo
โฌ Output
textcode
Capabilities and applications
Native model capabilities
Multimodal understanding
Category: multimodal
Image understanding
Analysing and interpreting the content of images.
Category: vision
Video understanding
The model's ability to analyse and interpret video content โ recognising actions, motion, events and relationships between objects over time.
Category: video
Reasoning
The model's ability to reason logically and solve complex problems.
Category: reasoning
Tool use
The model's ability to call external functions, APIs and tools during a conversation: calculator, search engine, code editor, database. The model decides when and how to use a tool and interprets its result.
Category: planning
Long context
Support for large context windows โ tens to hundreds of thousands (or millions) of input tokens. Enables analysis of entire codebases, long documents, and many parallel conversations without losing earlier information. GPT-5.1 supports 400,000 tokens.
Category: language
Agentic capability
The model's ability to autonomously plan and execute multi-step tasks by sequentially using tools, maintaining context, and adapting to intermediate results.
Category: planning
Technical architecture
Core Architecture
