StepFun’s trillion-parameter MoE language model (2024); 16K context window. Reportedly the first trillion-parameter MoE model from a Chinese company; ~5th on LiveBench.
Context window
16K
tokens
Parameters
~1 bln (bilionowy model MoE)
parameters
Release date
1 July 2024
Access:APIDeployment:☁ Cloud
Overview
Access & deployment
API
Cloud
Weights: Closed
Key parameters
📏 Context: 16K
🧩 Parameters: ~1 bln (bilionowy model MoE)
📥 Input: text
Technical specification
Context window
16K
tokens
Parameters
~1 bln (bilionowy model MoE)
parameters
License
Proprietary
Modalities
⬇ Input
text
⬆ Output
textcode
Capabilities and applications
Native model capabilities
Language modeling
Ability to predict subsequent tokens and generate coherent natural-language text based on the preceding context.
Category: language
Reasoning
The model's ability to reason logically and solve complex problems.
Category: reasoning
Multi-step reasoning
Carrying out multi-step chains of reasoning across long, complex tasks.
Category: reasoning
Coding
Generating, analysing and modifying code in many programming languages. Covers writing functions, debugging, refactoring, code review, and creating tests. Measured by benchmarks such as HumanEval and SWE-bench.
Category: coding
Multilingual
Competence in many natural languages (from a few to over a hundred): understanding, generation, translation, and code-switching within a single conversation. Frontier models support a wide range of languages with comparable quality.
Category: language
Instruction following
Precisely following instructions contained in the prompt: response format, length, style, constraints (e.g. 'reply in six words'). GPT-5.1 significantly improved this capability compared to GPT-5.
Category: language
Application domains
Technical architecture
Core Architecture
Model Form
Training Techniques
