Hacker News Best

Kimi K3.1 Pro model weights are out

8.5内容质量

TL;DR · AI 摘要

Moonshot AI发布Kimi K3.1 Pro,支持104万token上下文窗口,MoE架构含2.8T参数,在代码生成等基准测试中超越竞品模型。

核心要点

  • Kimi K3.1 Pro采用MoE架构,总参数2.8T,激活参数104B,支持1048576 token上下文窗口
  • 在Terminal-Bench 4.0基准测试中得分65.7,优于Claude Fable 5.1和GPT-6 Astra
  • 使用MXFP4权重/ MXFP8激活量化技术,实现高效推理

结构提纲

按章节快速跳转。

  1. Kimi K3.1 Pro是Moonshot AI发布的3T级多模态模型,支持104万token上下文窗口。

  2. 采用MoE架构,包含2.8T总参数,激活参数104B,使用Gated DSA层优化长上下文建模。

  3. 应用MXFP4权重和MXFP8激活量化,通过量化感知训练提升推理效率。

  4. 在Terminal-Bench 4.0等基准测试中,Kimi K3.1 Pro得分优于主要竞品模型。

思维导图

用一张图看清主题之间的关系。

查看大纲文本(无障碍 / 无 JS 友好)
  • Kimi K3.1 Pro模型
    • 模型架构
      • MoE结构(2.8T参数)
      • Gated DSA注意力机制
    • 量化技术
      • MXFP4权重量化
      • MXFP8激活量化
    • 评估表现
      • Terminal-Bench 4.0得分65.7
      • BenchCAD工具辅助得分92.7

金句 / Highlights

值得收藏与分享的关键句。

  • Kimi K3.1 Pro在Terminal-Bench 4.0基准测试中得分65.7,优于Claude Fable 5.1的57.9和GPT-6 Astra的58.2。

    — 第3节

    ⬇︎ 下载 PNG𝕏 分享到 X
  • 模型采用69 KDA + 24 Gated DSA注意力层组合,相比Kimi K3的全注意力Gated MLA层更高效。

    — 第2节

    ⬇︎ 下载 PNG𝕏 分享到 X
  • 使用MXFP4权重/ MXFP8激活量化技术,在保持精度的同时降低计算资源需求。

    — 第2节

    ⬇︎ 下载 PNG𝕏 分享到 X
#模型架构#多模态AI#量化技术#基准测试
打开原文

moonshotai/Kimi-K3.1-Pro · Hugging Face

[-1

]

[

moonshotai / Kimi-K3.1-Pro Like 629 Follow Moonshot AI 20.5k

[0

Image-Text-to-Text

[2

Transformers

Safetensors

kimi_k31

text-generation

compressed-tensors

conversational

custom_code

[8

[3

Eval Results

8-bit precision

[1

License:

kimi-k3.1-pro

Model card

Files

Files and versions

xet

Community

5

Deploy

Copy to bucket

Use this model

📰 Tech Blog | 🚀 API Quickstart

1. Model Introduction

Kimi K3.1 Pro is an open-weight, natively multimodal agentic model, and our most capable 3T-class model to date. Post-trained from Kimi K3 with large-scale joint reinforcement learning across hundreds of downstream domains, it is the first model in the K3.1 series. With a 1-million-token context window, Kimi K3.1 Pro delivers substantial improvements in coding, 3D creation, financial research, factual accuracy, and other agentic capabilities.

2. Model Summary

Architecture

Mixture-of-Experts (MoE)

Total Parameters

2.8T

Activated Parameters

104B

Number of Layers

93

Number of Dense Layers

1

Attention-Layer Composition

69 KDA + 24 Gated DSA

*

Attention Hidden Dimension

7168

Number of Attention Heads

96

DSA Index Head Dimension

128

DSA Index Number of Heads

32

DSA Index Top-K

2048

Latent MoE Dimension

3584

MoE Hidden Dimension

(per Expert)

3072

Number of Experts

896

Selected Experts per Token

16

Number of Shared Experts

2

Vocabulary Size

160K

Context Length

1048576

Attention Mechanism

KDA & Gated DSA

Activation Function

SiTU-GLU

Vision Encoder

MoonViT-V2

Parameters of Vision Encoder

401M

Quantization

MXFP4 weights / MXFP8 activations

(quantization-aware training)

Modality

Text, Image

  • Compared with Kimi K3, we replace the full-attention Gated MLA layers with Gated DeepSeek Sparse Attention (Gated DSA) layers for more efficient long-context modeling.

3. Evaluation Results

Unless otherwise specified, all Kimi K3.1 Pro results use reasoning effort max , temperature = 1.0 , and top-p = 0.95 . A dash ( — ) means that the source table does not report a score. Higher scores are better except where the benchmark name explicitly states lower is better ; Elo scores and other benchmark-specific metrics are not directly comparable with accuracy or pass-rate scores.

Benchmark

Kimi K3.1 Pro

(max)

Claude Fable 5.1

(max, w/ fallback)

GPT-6 Astra

Claude Opus 5.5

DeepSeek-V4.1-Flash-1017

GLM-5.3

Coding

Terminal-Bench 4.0

65.7

57.9

58.2

66.4

42.3

41.8

Terminal-Bench-Science 0.1

38.1

40.0

68.1

63.3

15.7

8.1

SWE Marathon v1.1

51.7

45.6

42.5

46.3

BenchCAD w/o tools

72.8

60.6

—

73.0

41.2

BenchCAD w/ tools

92.7

92.6

95.9

96.2

81.6

Program Bench

31.5

53.5

50.0

65.0

29.1

19.0

DeepSWE v1.1

75.5

67.4

74.1

74.2

77.0

66.9

PostTrain Bench v1.2

36.5

44.6

41.9

43.8

30.5

34.5

Kimi Code Bench 2.0 (Internal)

77.1

76.1

61.7

Kimi Code Bench 3.0 Long-horizon (Internal)

61.2

58.8

66.5

58.5

51.5

45.5

Agentic

HLE-Full w/ tools

70.0

65.6

57.2

67.7

62.5

BrowseComp

92.1

91.5

90.8

BioMysteryBench

80.6

78.9

81.9

80.0

79.6

CharXiv (RQ) w/ python

93.4

92.8

93.8

85.6

MMMU-Pro w/ python

90.0

88.4

87.8

89.8

82.5

GDP.pdf w/ python

85.7

83.8

85.5

83.9

ChartoGraphy w/ python

90.2

91.0

89.0

83.0

BabyVision w/ python

95.4

95.1

96.6

97.7

92.5

ZeroBench_main w/ python (pass@5)

63.0

59.0

58.0

61.0

51.0

Agents' Last Exam (ALL)

43.2

42.6

37.7

26.2

Agents' Last Exam (CLI)

44.2

40.7

36.0

29.4

Automation Bench-AA

73.3

59.4

68.5

69.5

66.6

62.2

GDPval-AA v2.1 (Elo-score)

1846

1754

1573

1866

1746

1650

AA-Briefcase v1.1 (Elo-score)

1678

1672

1569

1803

1570

1507

APEX-Agents

69.4

68.6

64.7

73.5

69.8

56.6

OfficeQA Pro v2

64.4

54.5

54.4

40.4

31.1

OfficeQA Pro

66.2

62.4

58.6

Frontier Finance

60.8

45.0

56.7

57.5

Harvey Legal Agent

23.7

19.1

21.0

HANDBOOK.md

38.8

41.5

28.9

20.8

OSWorld V2.1

80.7

75.8

81.8

69.3

Business Operation (Internal)

37.8

30.7

32.3

8.9

18.6

DECK-Arena (Internal, Elo-score)

1456

1423

1253

1231

1119

Design Bench (Internal, Elo-score)

957

1076

927

863

718

Kimi Hallu Bench Hard w/ tools (Internal, lower is better)

8.3

23.3

5.5

15.0

22.6

Reasoning & Knowledge & Multimodal

GDP.pdf

34.6

27.6

34.2

30.6

17.2

11.2

HLE-Full

51.1

57.6

53.6

59.8

43.0*

HLE-Diamond

39.4

55.1

65.8

60.9

21.6

25.1*

GPQA-Diamond

94.2

93.7

96.1

93.9

92.2

91.7

CharXiv (RQ)

88.8

MMMU-Pro

84.1

86.3

86.9

87.7

ZeroBench_main (avg@5 / pass@5)

29.8 / 39.0

23.0 / 35.0

43.2 / 52.0

35.0 / 43.0

11.8 / 23.0

PerceptionBench

68.3

77.6

72.1

47.7

Kimi Hallu Bench w/o tools (Internal, lower is better)

5.4

11.4

4.2

6.8

13.1

14.8

Cyber Security

ExploitBench

74.7

100

ExploitGym

20.7

30.4

42.4

xdev-bench-hard (Internal)

81.0

57.1

Evaluation Footnotes

#### Coding benchmarks

  • Terminal-Bench 4.0. Kimi K3.1 Pro is evaluated with the Claude Code harness. The DeepSeek-V4.1-Flash-1017 score is taken from its release blog . All remaining scores are the maximum values reported in model blog posts or on the official Terminal-Bench leaderboard .
  • Terminal-Bench-Science 0.1. Kimi K3.1 Pro is evaluated with Claude Code. Internal evaluation of DeepSeek-V4.1-Flash-1017 yields 9.3; the table instead reports 15.7 for the older DeepSeek-V4.1-Flash from the official leaderboard. All remaining scores are from the Terminal-Bench-Science leaderboard .
  • SWE-Marathon v1.1. Kimi K3.1 Pro and DeepSeek-V4.1-Flash-1017 are evaluated with Claude Code. Other scores are from the official leaderboard .
  • ProgramBench. The table reports binary scores: a task receives 1 if its ProgramBench score is at least 95%, and 0 otherwise. K3.1 Pro is evaluated with Claude Code. DeepSeek and GLM scores are taken from the DeepSeek release blog ; remaining scores are from Vals AI .
  • DeepSWE v1.1. K3.1 Pro is evaluated with Claude Code. Other scores come from the respective technical reports for GPT-6 Astra , Claude Opus 5.5 , Claude Fable 5.1 , DeepSeek-V4.1-Flash-1017 , and GLM-5.3 .
  • PostTrainBench. K3.1 Pro and DeepSeek-V4.1-Flash-1017 are evaluated internally on v1.2 with Claude Code and H20 GPUs rather than H100 GPUs. For stable evaluation, all judge models use DeepSeek-V4.1-Flash-1017 at maximum effort, which best matched the official GPT-5.6-Terra (xhigh) judge in testing. Other scores are from the official leaderboard .
  • Kimi Code Bench 2.0 and Kimi Code Bench 3.0 Long-horizon. These are internal benchmarks. K3.1 Pro is evaluated with Claude Code; all other models use their maximum-effort setting. Proprietary-model testing may involve fallback behavior.
  • BenchCAD. Open models are evaluated on 1,000-case subsets randomly sampled from the 17,900-case Vision2Code dataset at maximum reasoning effort. With-tools results use Claude Code; without-tools results use single-shot generation with official prompts and scoring. Claude scores are from the Opus 5.5 System Card, and GPT-6 Astra's with-tools score is from its official report. GPT-6 Astra has no reported without-tools score.

#### Agentic benchmarks

  • BioMysteryBench. Uses the official v11 release , with Kimi K3 as judge. K3.1 Pro uses Kimi Code; GLM-5.3 and DeepSeek-V4.1-Flash-1017 use Claude Code; GPT-6 Astra uses Codex. Claude scores are from official system cards.
  • Agents' Last Exam. Uses the official v1.1 release , comprising 122 tasks, including 86 CLI tasks. Runs that bypass stated requirements receive zero. DeepSeek and Kimi are evaluated with Claude Code and Kimi Code, respectively; other results are from the official benchmark website.
  • OfficeQA Pro and OfficeQA Pro v2. GPT-6 Astra uses Codex; other models use Claude Code. Each task provides the complete PDF corpus as page images without machine-readable text. External-model trajectories that retrieve reference answers online receive zero for those tasks.
  • Frontier Finance. Evaluated with the official Finance Agent v2 harness.
  • HANDBOOK.md. Evaluated with the official OpenHands-based harness, using tasks from the benchmark's early open-source v1 release.
  • Harvey Legal Agent. Evaluated on 1,251 public tasks with Artificial Analysis's Stirrup harness. The reported score is the all-pass rate: the percentage of tasks passing every rubric criterion.
  • OSWorld V2.1. Kimi models use the Kimi Agent harness in the official OSWorld v2 repository. GPT-6 Astra's score is taken from Muse Wonder's technical report.
  • DECK-Arena and Design Bench. DECK-Arena evaluates presentation generation on real-world queries; Design Bench covers graphic design through direct and reference-image few-shot prompting. Both evaluate python-pptx, pptxjs, and Kimi's in-house DSL in a harness with integrated search and image generation. The automated grader is calibrated on more than 10,000 human judgments.
  • BrowseComp. Uses context compaction triggered at 200K tokens and a 500-step maximum. If the limit is reached, the agent is forced to answer before judging. All runs use temperature = 1.0 and top-p = 1.0 .
  • GDPval-AA v2.1, AA-Briefcase v1.1, and AutomationBench-AA. Scores are cited from Artificial Analysis . APEX-Agents. Scores are cited from the official leaderboard .
  • Tool-augmented multimodal evaluations. GDP.pdf w/ python, ZeroBench w/ python, and ChartoGraphy w/ python are averaged over five runs; other multimodal benchmarks with Python are averaged over four. For GDP.pdf w/ python, each original PDF is sent to a sandbox for IPython processing. Responses are graded against each rubric criterion using Gemini-3.5-Flash at medium reasoning effort and the official judging prompt. The reported score is the task-macro mean rubric pass rate.

#### Reasoning, knowledge, and multimodal benchmarks

  • GDP.pdf. Each PDF is provided as page images resized to a longest edge of 1,152 pixels, interleaved with Docling-extracted text in page order. Responses are graded against each rubric criterion using Gemini-3.5-Flash Medium and the official judging prompt. The table reports the strict pass rate among fully scored responses. GLM-5.3 Max and DeepSeek-V4.1-Flash-1017 Max scores are cited from Artificial Analysis .
  • HLE-Full and HLE-Diamond. The full evaluation sets contain 2,500 and 1,000 questions, respectively. For scores marked * , accuracy is reported on the text-only subset.
  • Run counts. GDP.pdf, ZeroBench, and ChartoGraphy are averaged over five runs; other multimodal benchmarks are averaged over four.
  • MMMU-Pro. Evaluated using the official protocol, preserving the original input order and prepending images to the text input.
  • PerceptionBench. An in-house benchmark focused on atomic visual perception capabilities.
  • Kimi Hallucination Benchmark. Evaluates factual accuracy on an internal set of challenging, de-identified prompts drawn from practical work tasks. The table reports claim-level hallucination rates assessed by fact-checking agents.

#### Cybersecurity benchmarks

  • ExploitBench. K3.1 Pro is evaluated with the official harness under a 300-turn budget. The table reports the pass@5 maximum-capability score: for each environment, the best of five seeds is scored by capability flags reached out of 16; arbitrary code execution counts as all 16 capabilities. Comparison scores are from OpenAI , Anthropic , and GLM-5.3 .
  • ExploitGym. K3.1 Pro is evaluated with Kimi Code under a six-hour wall-clock budget per task. GPT-6 Astra, Claude, and GLM comparison scores are taken from their respective official reports, with Claude results using the same six-hour budget.
  • xdev-bench-hard. K3.1 Pro is evaluated with Kimi Code; GLM-5.3 and DeepSeek-V4.1-Flash-1017 use Claude Code. The internal benchmark contains expert-curated, source-code-based vulnerability discovery and exploitation tasks. The final model is evaluated at pass@3 over a random subset of runs, without hard timeouts or output-token limits.

4. Deployment and Availability

You can access Kimi K3.1 Pro's API on https://platform.kimi.ai by selecting kimi-k3.1-pro , and we provide OpenAI/Anthropic-compatible API for you. Currently, Kimi K3.1 Pro is recommended to run on the following inference engines:

  • vLLM — see recipes
  • SGLang — see cookbook
  • TokenSpeed — see recipes

5. Model Usage

The thinking effort of Kimi K3.1 Pro is configured with the top-level reasoning_effort request field, which supports "low" , "high" , and "max" (default "max" ).

For multi-turn conversations and tool calls, Kimi K3.1 Pro requires the complete assistant message returned by the API to be passed back to messages as-is — including reasoning_content and tool_calls , not just content :

code
import
openai
def
chat_with_preserved_thinking
(
client: openai.OpenAI, model_name:
str
):
    messages = [
        {
"role"
:
"user"
,
"content"
:
"Tell me three random numbers."
},
        {
"role"
:
"assistant"
,
"reasoning_content"
:
"I'll start by listing five numbers: 473, 921, 235, 215, 222, and I'll tell you the first three."
,
"content"
:
"473, 921, 235"
},
        {
"role"
:
"user"
,
"content"
:
"What are the other two numbers you have in mind?"
}
    ]

    response = client.chat.completions.create(
        model=model_name,
        messages=messages,
        stream=
False
,
        max_tokens=
4096
,
        reasoning_effort=
"max"
,
    )
# the assistant should mention 215 and 222 that appear in the prior reasoning content
print
(
f"response:
{response.choices[
0
].message.reasoning}
"
)
return
response.choices[
0
].message.content

For full guides and examples (vision input, structured output, partial mode, tool choice, dynamic tool loading, context caching), see the Kimi K3.1 Pro Quickstart and Thinking Effort .

6. License

Kimi K3.1 Pro is released under the Kimi K3.1 Pro License .

7. Contact Us

If you have any questions, please reach out at [email protected] .

Downloads last month

797

Model size

2.8T params

Tensor type

F32

·

BF16

U8

Files info

Model tree for moonshotai/Kimi-K3.1-Pro

Finetunes

6 models

Quantizations

2 models

Spaces using moonshotai/Kimi-K3.1-Pro 3

Evaluation results

  • Idavidrein/gpqa · Diamond View evaluation results leaderboard 94.2
  • harborframework/terminal-bench · Terminalbench 4 View evaluation results leaderboard 65.7 *
  • datacurve/deep-swe · Deep Swe View evaluation results leaderboard 75.5 *
  • mercor/apex-agents · Apex Agents View evaluation results leaderboard 69.4
  • harborframework/terminal-bench-science · Terminalbenchscience 0 1 View evaluation results leaderboard 38.1 *
  • agents-last-exam/agents-last-exam leaderboard
  • Overall Pass Rate View evaluation results ALE v1.1 (ALL), Kimi Code harness. Card does not name the metric; mapped to pass rate. 43.2 *
  • Ale Cli Pass Rate View evaluation results ALE v1.1 (CLI), Kimi Code harness. Card does not name the metric; mapped to pass rate. 44.2 *

Expand 3 benchmarks