Thomas Wolf(@Thom_Wolf)

Our PyBot chatbot went viral yesterday but the story behind it is even more interesting imo: what ha...

8.5内容质量
Our PyBot chatbot went viral yesterday but the story behind it is even more interesting imo: what ha...

TL;DR · AI 摘要

运行1000个代理的PyBot实验揭示了扩展瓶颈和协调挑战,对多代理系统发展有重要启示。

核心要点

  • 1000个DeepSeek V4.1代理仅需少量GPU节点即可扩展
  • 非GPU瓶颈包括git合并、测试等待和上下文重读(130:1读写比)
  • 协调问题导致仅40-60%代理实际调用模型

结构提纲

按章节快速跳转。

  1. PyBot聊天机器人意外走红引发对多代理系统扩展性的探索。

  2. 基于ELIZA-2026基准构建1000个开源模型代理的并行系统。

  3. 发现GPU外存在git合并、测试等待等非计算资源瓶颈。

  4. 40-60%代理闲置,验证Fred Brooks'沟通成本定律(n²增长)。

  5. 建立专用通道和角色分工(如反群体思维的moonshot代理)部分缓解问题。

思维导图

用一张图看清主题之间的关系。

查看大纲文本(无障碍 / 无 JS 友好)
  • PyBot多代理系统实验
    • 技术挑战
      • 扩展瓶颈
        • GPU外瓶颈:git/测试/上下文重读
      • 协调难题
        • 40-60%代理闲置
        • n²沟通成本定律
    • 解决方案
      • 专用通道设计
      • 角色分工机制

金句 / Highlights

值得收藏与分享的关键句。

#多代理系统#AI扩展#协调机制#开源工具
打开原文

Thomas Wolf on X: "Our PyBot chatbot went viral yesterday but the story behind it is even more interesting imo: what happened when we decided to run 1,000 agents (!) together We wanted to see if agent swarms could be scaled outside of closed-lab setups and to investigate it in a more transparent a… / X

Thomas Wolf

@Thom_Wolf

$

/$

Our PyBot chatbot went viral yesterday but the story behind it is even more interesting imo: what happened when we decided to run 1,000 agents (!) together We wanted to see if agent swarms could be scaled outside of closed-lab setups and to investigate it in a more transparent and reproducible manner. To explore the question, we built a rather fun and simple benchmark: ELIZA-2026. Full circle in AI time. The agents are tasked to build a chatbot made of if-then rules like ELIZA, but said agents are 2026 frontier open-source models. By design it’s almost embarrassingly parallel, which keeps the coordination problem as simple as it gets. First surprise: it turns out you can scale a swarm of DeepSeek V4.1 Flash agents on a relatively small setup: a couple of GPU nodes (B200 in our case) are enough to scale to over 1,000 agents. Our second surprise was how bottlenecks started to emerge everywhere except in the GPUs. Agents quickly end up spending their time waiting for git merges (we had to move to a centralized merge setup, like Anthropic did), waiting for tests to pass, re-reading context from other agents and tools (we estimated ~130 tokens read for every token written per agent). In some of our runs, at any given moment, only 40-60 of the 1,000 agents were actually calling the model. Once (some of) these issues were solved, we hit the harder part: coordination itself. Fred Brooks once said at IBM “adding manpower to a late software project only makes it later”. Communication costs naturally grow with n² in an organization (that’s why small startups move faster :). We explored various ways of organizing the swarm, setting up dedicated channels (a stewards channel, a leadership channel) and giving agents specific roles (a moonshot agent to fight groupthink). It helped, up to a point. But the quality of coordination itself remains hard to measure. Along the way, we saw good and bad emergent behaviors. Some good, with agents stepping in, unprompted, to protect other agents’ running experiments. Some bad, with agents gaming the rules when stuck, from hammering a rate limit to probing the infrastructure around them. In the coming days we will open-source the swarm tooling (flock + msgboard) and share our learnings in more detail. Overall this was one of the most fun experiments of the fall, and multi-agent systems increasingly look like the next phase for AI. But I also came out of this project with the feeling that several bottlenecks in scaling AI are moving from intelligence to coordination and the supporting infrastructure. Luckily this seems to be in large part an engineering problem.

Leandro von Werra

@lvwerra

Nov 16

PyBot: No weights. No training. A chatbot built with only simple rules and no AI, entirely written in 600k lines of Python code. PyBot matches Smollm with 360M parameters! How? A swarm of 1,000 DeepSeek Flash agents wrote the whole code in just a week.

github.com/huggingface/py…

00:00

12:51 PM · Nov 17, 2026

·

8,060

Views

44

27

112

56