Active

Mar 27, 2024

APIOpen WeightsLocal RunCloud

DBRX Base

LLM

Base pretrained DBRX model without instruction tuning. 132B total parameters, 36B active (MoE 16 experts, top-4). Pretrained on 12T tokens, 32K context window.

Available on

Databricks Mosaic AI

Technical specification

Context window

Parameters

132B total / 36B active

Max output

License

Databricks Open Model License

Tools

Fine-tuning

Yes

Weights access

Open weights

Knowledge cutoff

Dec 2023

Last updated: May 4, 2026

Modalities

Input

Text

Output

Text

Code

Capabilities

Coding★

Coding

Reasoning★

Reasoning

Long context★

Reasoning

Multilingual★

Language

Architecture and technologies

Core Architecture

Form / Family

Applications

Sources

Blog1Repository2

DBRX — Databricks Blog

databricks.comBlog

DBRX Base on Hugging Face

huggingface.coRepository

DBRX GitHub repository

github.comRepository

DBRX BaseDBRX BaseDBRX Base

Technical specification

Modalities

Capabilities

Architecture and technologies

Core Architecture

Form / Family

Applications

Sources

Technical specification

Modalities

Capabilities

Architecture and technologies

Core Architecture

Form / Family

Applications

Sources

DBRX Base