我删掉了95%的代理技能,结果反而更好了 — Nick Nisi, WorkOS
TL;DR · AI 摘要
Nick Nisi发现通过将AI代理技能从95%精简至仅保留核心状态机驱动的5个角色(实现者、验证者、审查者、关闭者、复盘者),反而提升了任务完成质量与效率;关键在于用TypeScript状态机替代Claude原生技能,解决上下文丢失问题。
核心要点
- 将代理技能从95%删减至5%,仅保留implementer/verifier/reviewer/closer/retro五类角色,结果质量反升
- 用TypeScript状态机重构代理流程后,彻底解决Claude因上下文窗口限制导致的遗忘与跳步问题
- 新系统自动获取GitHub issue/PR/Slack/Linear等输入源上下文,无需人工重复提供背景信息
结构提纲
按章节快速跳转。
作者作为DX工程师维护20+仓库、8种语言SDK,依赖单AI代理工作时频繁上下文切换,每次需10分钟人工重建问题背景。
最初基于Claude构建Case工具,可接收GitHub/Slack/Linear等输入自动执行任务,但随复杂度上升出现严重上下文丢失与指令忽略问题。
改用TypeScript状态机编排五个专用代理角色(实现者、验证者、审查者、关闭者、复盘者),确保每步可追溯、有证据闭环。
删除冗余技能后系统更稳定可靠,任务完成质量提升,且节省大量人工干预时间,验证了‘少即是多’的代理设计原则。
思维导图
用一张图看清主题之间的关系。
查看大纲文本(无障碍 / 无 JS 友好)
- 精简AI代理技能提升效能
- 问题根源
- 多仓库上下文切换成本高
- 每次需10分钟人工重建背景
- 单代理易遗忘/跳步
- 解决方案
- Case工具:输入→自动上下文提取
- TypeScript状态机编排
- 五角色分工:Implementer/Verifier/Reviewer/Closer/Retro
- 效果验证
- 技能删减95%,质量反升
- PR必须含可验证证据
- 人工干预减少,交付更快更稳
金句 / Highlights
值得收藏与分享的关键句。
我删掉了95%的代理技能,只留下5个核心角色——实现者、验证者、审查者、关闭者和复盘者——结果反而得到了更好的输出。
最初用Claude技能实现Case工具时效果不错,但一旦任务变复杂,它就开始遗忘指令或跳过步骤,例如我问‘为什么没做?’,它回答‘哦,你让我做了,但我决定不做’。
新系统能自动解析GitHub issue、PR、Slack线程或Linear工单,无需我反复提供上下文;代理必须产出带证据的PR才能终止流程。
视频笔记
translation:
YouTube Transcript
language: English ( automatically generated) (en)
[0:07] [music]
[0:14] >> All right, good morning everyone.
[0:16] Uh welcome to my talk building AI
[0:18] systems that ship. I'm Nick Nzi and I work at WorkOS. We've got a booth
[0:21] downstairs.来 check us out and talk
[0:22] to us. We'd be happy to chat.
[0:24] Uh but let's start that over. Hi, I'm
[0:29] the bottle neck. Uh
[0:31] I'm a DX engineer at WorkOS and I work
[0:34] on 20 plus repos across eight different
[0:37] languages. Uh it's all of our SDs and
[0:40] open source things that we have. And the
[0:45] it's like_auth Kit Next.js,_auth Kit
[0:47] react,
[0:48] WorkOS Node, WorkOS Kotlin, WorkOS Ruby,
[0:51] PHP,
[0:52] everywhere. So, there's a lot to do
[0:55] across a lot of different things.
[0:57] And I'm really good at working on those.
[1:00] And I've gotten real good over the
[1:01] last eight months
[1:03] working with those via agents. So, I
[1:05] haven't written a line of code himself in
[1:07](probability eight months. Uh I've getting
[1:09] real good at just scaling that with
[1:11] agents and then reviewing what they do
[1:13] and then instructing them and getting
[1:15] the work done faster and better while
[1:19] still maintaining good quality.
[1:21] Uh but there was a big problem doing
[1:23] that Uh with one agent at a time across
[1:26] all of these repos. I'm just constant
[1:27] context shifting over and over and
[1:29] over. Uh and it just gets easier and
[1:31] easier
[1:32]额 that's okay, but the problem is that for
[1:36] every one of those there's like this
[1:37] little bit of setup time that I'm doing
[1:39] each time, which is like giving it 10
[1:41] minutes of my time to like set up and
[1:43]建立 the problem. Let's look at
[1:44] this GitHub issue. Let's look at this
[1:46] linear ticket. Let's take a look at this
[1:48] slack thread and figure out what's going
[1:50] and then Uh go. So, that was a lot of my
[1:54] time just spent
[1:56] dealing with the agent, getting it
[1:58] basic the context that I already
[1:59] have, and then getting it to work on it
[2:01] from there.
[2:03] Now, on the other side, I'm also working
[2:05] on products that
[2:07]额 we want to build for agents because
[2:09] while I said I'm a developer experience
[2:11] engineer, the developer is still the
[2:13] most important额 in in my job, but
[2:16] increasing the pipe to get to that
[2:17]开发 experience as being
[2:20] equally as important because that's how
[2:22] we're going to get in front of the
[2:24] developers.
[2:27] So, there's two different ways I needed
[2:29] to go AI natural and two different
[2:31] directions for that.
[2:33] So, on the internal side building that,
[2:36] I started building this project called
[2:37] case. Uh this is a harness. If you've
[2:40] read Ryan the Populous harness
[2:41] Engineering, it's that. Uh just kind of
[2:44] took those ideas and started building
[2:46] them.
[2:47] Uh basic I give it a GitHub issue, a
[2:49] PR,
[2:50]额 a slack thread, a linear ticket,
[2:53] anything, and I could just point it at
[2:55] it and it could figure out the context
[2:57] that it needs and go. And then it
[2:59] would brown until it has a PR with
[3:01] evidence that it actually did what I
[3:03] asked it to or what the problem was or
[3:05] what fixed what the issue was.
[3:07] Uh but it most important it has to
[3:09] provide that evidence.
[3:11] And it this originally started as a
[3:12] Claude skill because why not? I
[3:15] thought Claude could do could do
[3:16] anything. And it was working real well, but as it got more complex,额 the context drop became very real. It would
[3:21] just start forgot things or skip
[3:23] over tasks. And I would ask Claude, "Why
[3:26] did you do that?" It's like, "OH yeah,
[3:27] you told me to do that. I decided not
[3:29] to."
[3:30] Not great. So,额 I rebuilt it on top of
[3:33] pi and using a type state machine to
[3:35] front through and and step through these agents. So,
[3:39] it has five different agents in it, an implementer, a验证e, a reviewer, a closer, and a retro agent. And those are important, but they are not the most important piece of case is the states in between that. And that's what the the仪 state machine real enforce is the checks in between everything. So, when we implement something, we can't move on to the reviewer until the验证er verifies it. And once the the reviewer verifies it, if there's any issues, it has to send it back to the implementer to do those.
[4:00] Uh and once all of that's done, the closer can work. But the closer can't work until it thinks that it's done. And the closer is there to provide evidence. And then the retros is there to analyze the entire performance. It looks at the logs of everything that case did and says, "What could I have done better?" And then it updates its own state system to ensure that the next time it does something.
[4:26] translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
translation:
natural translation of the given Markdown into Chinese is:
[4:30] 可以跳过一些步骤如果它如果它 went in
[4:32] circles for a little bit.
[4:34] 嘉和它可以给 itself一些提示在
[4:35] where to go so that the next time it works on that项目,它 doesn't hit
[4:37] the same roadblocks.
[4:43] 嘉**
[4:44] 所以,下一个 agent doesn't matter.ums证明 that the work
[4:47] matters. Proving that what happened in each of these states is what matters.
[4:50] And that word there证明 is the most important piece of that because the
[4:51] agents, they would just lie to us all the time.
[4:58] 嘉 I would ask it, " Hey, you need to run the tests." And this was more when it was a skill and it would I would be like, " Hey, you need to run these tests and make sure that the tests actually pass." And one way to do that was I just had it check for a dot case tested file. And if that file existed, great. It ran the tests, perfect. well, it figures it out quite natural.
[5:17] it figures out quite natural.
[5:18] well, it figures out quite natural.
[5:22] well, it figures out quite natural.
[5:24] well, it figures out quite natural.
[5:26] well, it figures out quite natural.
[5:29] well, it figures out quite natural.
[5:32] well, it figures out quite natural.
[5:34] well, it figures out quite natural.
[5:36] well, it figures out quite natural.
[5:38] well, it figures out quite natural.
[5:41] well, it figures out quite natural.
[5:43] well, it figures out quite natural.
[5:45] well, it figures out quite natural.
[5:48] well, it figures out quite natural.
[5:50] well, it figures out quite natural.
[5:52] well, it figures out quite natural.
[5:55] well, it figures out quite natural.
[5:59] well, it figures out quite natural.
[6:00] well, it figures out quite natural.
[6:03] well, it figures out quite natural.
[6:06] well, it figures out quite natural.
[6:08] well, it figures out quite natural.
[6:10] well, it figures out quite natural.
[6:12] well, it figures out quite natural.
[6:15] well, it figures out quite natural.
[6:16] well, it figures out quite natural.
[6:18] well, it figures out quite natural.
[6:20] well, it figures out quite natural.
[6:22] well, it figures out quite natural.
[6:24] well, it figures out quite natural.
[6:26] well, it figures out quite natural.
[6:28] well, it figures out quite natural.
[6:30] well, it figures out quite natural.
[6:32] well, it figures out quite natural.
[6:34] well, it figures out quite natural.
[6:36] well, it figures out quite natural.
[6:38] well, it figures out quite natural.
[6:40] well, it figures out quite natural.
[6:42] well, it figures out quite natural.
[6:44] well, it figures out quite natural.
[6:46] well, it figures out quite natural.
[6:48] well, it figures out quite natural.
[6:50] well, it figures out quite natural.
[6:52] well, it figures out quite natural.
[6:54] well, it figures out quite natural.
[6:56] well, it figures out quite natural.
[6:58] well, it figures out quite natural.
[6:59] well, it figures out quite natural.
[7:00] well, it figures out quite natural.
[7:02] well, it figures out quite natural.
[7:04] well, it figures out quite natural.
[7:06] well, it figures out quite natural.
[7:08] well, it figures out quite natural.
[7:10] well, it figures out quite natural.
[7:12] well, it figures out quite natural.
[7:14] well, it figures out quite natural.
[7:16] well, it figures out quite natural.
[7:18] well, it figures out quite natural.
[7:20] well, it figures out quite natural.
[7:22] well, it figures out quite natural.
[7:24] well, it figures out quite natural.
[7:26] well, it figures out quite natural.
[7:28] well, it figures out quite natural.
[7:30] well, it figures out quite natural.
[7:32] well, it figures out quite natural.
[7:34] well, it figures out quite natural.
[7:36] well, it figures out quite natural.
[7:38] well, it figures out quite natural.
[7:40] well, it figures out quite natural.
[7:42] well, it figures out quite natural.
[7:44] well, it figures out quite natural.
[7:46] well, it figures out quite natural.
[7:48] well, it figures out quite natural.
[7:50] well, it figures out quite natural.
[7:52] well, it figures out quite natural.
[7:54] well, it figures out quite natural.
[7:56] well, it figures out quite natural.
[7:58] well, it figures out quite natural.
[7:59] well, it figures out quite natural.
[8:00] well, it figures out quite natural.
[8:02] well, it figures out quite natural.
[8:04] well, it figures out quite natural.
[8:06] well, it figures out quite natural.
[8:08] well, it figures out quite natural.
[8:10] well, it figures out quite natural.
[8:12] well, it figures out quite natural.
[8:14] well, it figures out quite natural.
[8:16] well, it figures out quite natural.
[8:18] well, it figures out quite natural.
[8:20] well, it figures out quite natural.
[8:22] well, it figures out quite natural.
[8:24] well, it figures out quite natural.
[8:26] well, it figures out quite natural.
[8:28] well, it figures out quite natural.
[8:30] well, it figures out quite natural.
[8:32] well, it figures out quite natural.
[8:34] well, it figures out quite natural.
[8:36] well, it figures out quite natural.
[8:38] well, it figures out quite natural.
[8:40] well, it figures out quite natural.
[8:42] well, it figures out quite natural.
[8:44] well, it figures out quite natural.
[8:46] well, it figures out quite natural.
[8:48] well, it figures out quite natural.
[8:50] well, it figures out quite natural.
**[8:
translated]) translationtranslated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation]) translation])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])])**
translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation translated]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation]) translation])**
[16:51] 你想要建立一个环境
[16:52] 那个 agent that 你 可以 与之 一起工作
[16:54] 那个 agent 在
[16:56] 哦,我们 focus on that.
[16:57] 哦,我们没有新的方法。
[17:00] real change 没有发生。我们的工作没有发生改变。
[17:02] 我们都 kind of
[17:04] abstracted it a little bit.你的工作 never really about writing code.它总是 about building these systems, and now we just have a better ab ab to understand that.所以, take that into account and go forward from there.
[17:19] real change has occurred. than you, and I'm happy to answer any questions you have with the time I have left.
[17:25] >> [applause]
[17:35] [music]
[17:40] [music]
[17:45] end]
[17:46]
[17:47]
[17:48]
[17:49]
[17:50]
[17:51]
[17:52]
[17:53]
[17:54]
[17:55]
[17:56]
[17:57]
[17:58]
[17:59]
[18:00]
[18:01]
[18:02]
[18:03]
[18:04]
[18:05]
[18:06]
[18:07]
[18:08]
[18:09]
[18:10]
[18:11]
[18:12]
[18:13]
[18:14]
[18:15]
[18:16]
[18:17]
[18:18]
[18:19]
[18:20]
[18:21]
[18:22]
[18:23]
[18:24]
[18:25]
[18:26]
[18:27]
[18:28]
[18:29]
[18:30]
[18:31]
[18:32]
[18:33]
[18:34]
[18:35]
[18:36]
[18:37]
[18:38]
[18:39]
[18:40]
[18:41]
[18:42]
[18:43]
[18:44]
[18:45]
[18:46]
[18:47]
[18:48]
[18:49]
[18:50]
[18:51]
[18:52]
[18:53]
[18:54]
[18:55]
[18:56]
[18:57]
[18:58]
[18:59]
[19:00]
[19:01]
[19:02]
[19:03]
[19:04]
[19:05]
[19:06]
[19:07]
[19:08]
[19:09]
[19:10]
[19:11]
[19:12]
[19:13]
[19:14]
[19:15]
[19:16]
[19:17]
[19:18]
[19:19]
[19:20]
[19:21]
[19:22]
[19:23]
[19:24]
[19:25]
[19:26]
[19:27]
[19:28]
[19:29]
[19:30]
[19:31]
[19:32]
[19:33]
[19:34]
[19:35]
[19:36]
[19:37]
[19:38]
[19:39]
[19:40]
[19:41]
[19:42]
[19:43]
[19:44]
[19:45]
[19:46]
[19:47]
[19:48]
[19:49]
[19:50]
[19:51]
[19:52]
[19:53]
[19:54]
[19:55]
[19:56]
[19:57]
[19:58]
[19:59]
[20:00]
[20:01]
[20:02]
[20:03]
[20:04]
[20:05]
[20:06]
[20:07]
[20:08]
[20:09]
[20:10]
[20:11]
[20:12]
[20:13]
[20:14]
[20:15]
[20:16]
[20:17]
[20:18]
[20:19]
[20:20]
[20:21]
[20:22]
[20:23]
[20:24]
[20:25]
[20:26]
[20:27]
[20:28]
[20:29]
[20:30]
[20:31]
[20:32]
[20:33]
[20:34]
[20:35]
[20:36]
[20:37]
[20:38]
[20:39]
[20:40]
[20:41]
[20:42]
[20:43]
[20:44]
[20:45]
[20:46]
[20:47]
[20:48]
[20:49]
[20:50]
[20:51]
[20:52]
[20:53]
[20:54]
[20:55]
[20:56]
[20:57]
[20:58]
[20:59]
[21:00]
[21:01]
[21:02]
[21:03]
[21:04]
[21:05]
[21:06]
[21:07]
[21:08]
[21:09]
[21:10]
[21:11]
[21:12]
[21:13]
[21:14]
[21:15]
[21:16]
[21:17]
[21:18]
[21:19]
[21:20]
[21:21]
[21:22]
[21:23]
[21:24]
[21:25]
[21:26]
[21:27]
[21:28]
[21:29]
[21:30]
[21:31]
[21:32]
[21:33]
[21:34]
[21:35]
[21:36]
[21:37]
[21:38]
[21:39]
[21:40]
[21:41]
[21:42]
[21:43]
[21:44]
[21:45]
[21:46]
[21:47]
[21:48]
[21:49]
[21:50]
[21:51]
[21:52]
[21:53]
[21:54]
[21:55]
[21:56]
[21:57]
[21:58]
[21:59]
[22:00]
[22:01]
[22:02]
[22:03]
[22:04]
[22:05]
[22:06]
[22:07]
[22:08]
[22:09]
[22:10]
[22:11]
[22:12]
[22:13]
[22:14]
[22:15]
[22:16]
[22:17]
[22:18]
[22:19]
[22:20]
[22:21]
[22:22]
[22:23]
[22:24]
[22:25]
[22:26]
[22:27]
[22:28]
[22:29]
[22:30]
[22:31]
[22:32]
[22:33]
[22:34]
[22:35]
[22:36]
[22:37]
[22:38]
[22:39]
[22:40]
[22:41]
[22:42]
[22:43]
[22:44]
[22:45]
[22:46]
[22:47]
[22:48]
[22:49]
[22:50]
[22:51]
[22:52]
[22:53]
[22:54]
[22:55]
[22:56]
[22:57]
**[22