Grok-2

Grok-2 is xAI's multimodal frontier language model announced on 13 August 2024 and rolled out to X Premium and Premium+ subscribers. In xAI's official August 2024 benchmarks it achieved GPQA 56.0%, MMLU 87.5%, MMLU-Pro 75.5%, MATH 76.1%, HumanEval 88.4%, MMMU 66.1%, MathVista 69.0%, and DocVQA 93.6%. An early version tested on the LMSYS Chatbot Arena under the codename "sus-column-r" outperformed Claude 3.5 Sonnet and GPT-4-Turbo on overall Elo at the time. The model integrates image generation through a Black Forest Labs FLUX.1 partnership. In August 2025 xAI released the Grok-2 weights on Hugging Face under the xAI Community License Agreement (source-available, with commercial-use restrictions) — the checkpoint is ~500 GB across 42 files and requires 8 GPUs with >40 GB each (TP=8, FP8 quantization). The exact parameter count has not been officially disclosed by xAI.