Lenny's Newsletter

🎙️ How I AI: Grok vs. Dot vs. Muse vs. Duet + How Figma’s PMs actually use AI every day

8.5内容质量
🎙️ How I AI: Grok vs. Dot vs. Muse vs. Duet + How Figma’s PMs actually use AI every day

TL;DR · AI 摘要

Grok Bot在工作场景中表现最佳,Muse在个人任务中领先,Claude Duet因速度慢和频繁请求权限被批评。

核心要点

  • Grok Bot在工作场景任务中得分为93%,适合专业工作流。
  • Muse生成短视频和家庭报纸的速度远超其他工具。
  • Claude Duet在九项任务中平均耗时最长,且请求权限次数是其他工具的四倍。

结构提纲

按章节快速跳转。

  1. 介绍AI代理工具的比较测试及Figma产品经理的使用场景。

  2. 通过九项实际任务(如Slack回复、视频编辑、Figma设计等)评估四个AI代理的性能。

  3. Grok Bot在工作场景中表现最佳,Muse在个人任务中速度最快。

  4. Claude Duet因速度慢和频繁请求权限被指出问题,Dot在个人上下文理解上有优势。

  5. Figma产品经理更信任Grok Bot生成设计稿,而编码任务仍倾向Claude或Codex。

  6. 工具选择需根据场景需求,工作流推荐Grok Bot,个人任务推荐Muse。

思维导图

用一张图看清主题之间的关系。

查看大纲文本(无障碍 / 无 JS 友好)
  • AI代理工具比较
    • Grok Bot
      • 工作场景优势
      • Figma设计原创性
    • Muse
      • 个人任务速度
      • 短视频生成
    • Claude Duet
      • 权限请求频繁
      • 速度最慢

金句 / Highlights

值得收藏与分享的关键句。

#AI代理#Figma#技术比较#产品评估
打开原文

🎙️ How I AI: Grok vs. Dot vs. Muse vs. Duet: which one crushes the competition? + How Figma’s PMs actually use AI every day

How I AI

Translate

🎙️ How I AI: Grok vs. Dot vs. Muse vs. Duet + How Figma’s PMs actually use AI every day

Your weekly listens from How I AI, part of the Lenny’s Podcast Network

Lenny Rachitsky

Nov 02, 2026

Grok vs. Dot vs. Muse vs. Claude Duet: which one crushes the competition?

Listen now on YouTube • Spotify • Apple Podcasts

Brought to you by: WorkOS —Make your app enterprise-ready, with SSO, SCIM, RBAC, and more Firecrawl —Give your AI agents web data and beyond

In this solo episode, Claire puts Grok Bot, Dot, Meta’s Muse, and Claude Duet through nine real-world tasks to find out which personal agents are actually worth using. She tests them on everything from Slack replies, inbox triage, and coding to video editing, Figma thumbnails, family projects, and shopping. The results point to a clear split.

#### Biggest takeaways:

  • Grok Bot is the strongest all-around personal agent in this benchmark, especially for work. It scored 93% overall and won the Figma, inbox triage, and shopping tasks. For someone choosing one agent for professional workflows, Claire recommends starting here.
  • Muse is the best agent for personal life. It created the strongest short-form video and family newspaper with almost no prompting and answered a physics question too quickly to time. That speed has led Claire to move more quick Q&A conversations from ChatGPT to Muse.
  • Speed is central to the product experience. Muse finished first on four of the nine tasks, while Claude Duet was consistently the slowest. When an agent disappears for several minutes, users lose context and stop wanting to use it.
  • Claude Duet asks for permission too often. It requested approval four times during the benchmark, compared with once for every other agent. That caution may be well-intentioned, but it makes Duet feel like something the user must supervise rather than trust.
  • An agent is only as capable as the tools it can access. A Codex audit found that Claire’s agents did not have equivalent connectors and skills. Muse lacked Slack and GitHub, which prevented it from completing several work tasks, highlighting the importance of equal setups for a fair comparison.
  • Grok Bot is the agent Claire trusts most with Figma. Dot and Claude Duet mostly filled existing templates, while Grok Bot proposed fresh headlines and layouts that looked like real YouTube thumbnails. It has consistently outperformed the others across Claire’s Figma tests.
  • Claude Duet and Dot still showed the strongest coding judgment. Dot came closest to the intended Sentry fix, while Duet found a second bug and avoided duplicating work Dot had already completed. Claire would still choose Claude or Codex for serious coding, just not through Duet’s personal-agent interface.
  • Dot showed the strongest personal context in one important moment. It was the only agent that asked whether Claire’s Lovable talk was paid and remote, which felt like genuine chief-of-staff judgment. Its poor performance on creative tasks, however, kept it well behind Grok Bot and Muse overall.
  • The useful takeaway is that different agents belong in different parts of life. Claire’s current split is Grok Bot for work and Muse for personal tasks. Choosing agents by job is more effective than expecting one product to handle everything well.

#### Blog and detailed workflow walkthroughs from this episode:

Grok vs. Dot vs. Muse vs. Claude Duet: Nine Tasks, Four Agents, No Universal Winner: https://www.chatprd.ai/how-i-ai/grok-vs-dot-vs-muse-vs-claude-duet-nine-tasks-four-agents-no-universal-winner ↳ Generate Novel YouTube Thumbnail Ideas with Grok and Figma: https://www.chatprd.ai/how-i-ai/workflows/generate-novel-youtube-thumbnail-ideas-with-grok-and-figma ↳ How to Create a Branded Product Launch Video with Claude Duet: https://www.chatprd.ai/how-i-ai/workflows/how-to-create-a-branded-product-launch-video-with-claude-duet ↳ Create a Personalized Family Newspaper with Meta’s Muse: https://www.chatprd.ai/how-i-ai/workflows/create-a-personalized-family-newspaper-with-meta-s-muse

How Figma’s PMs actually use AI every day | Ezra Mechaber (PM, Figma)

Brought to you by: Optimizely —Your AI agent orchestration platform for marketing and digital teams Jira Product Discovery —Prioritize with insights, build with confidence

Ezra Mechaber is a growth product manager at Figma and one of the creators of PM OS, a shared repository of 31 AI skills used across the company’s product organization. In this episode, he demonstrates how Figma’s PMs use it to manage Slack, gather organizational context, create artifacts, and run more thorough bug bashes with Codex. He also walks through AutoXP, an AI growth PM that runs experiments with a single human checkpoint, and a real-time Jev assistant that improves writing as he types.

  • The best place to start with AI is the work PMs routinely skip. Ezra designed PM OS around tasks that fall through the cracks, such as involving support before a launch or documenting meetings. His goal is to establish a minimum acceptable standard for every PM workflow.
  • Context-gathering skills are the foundation of useful AI at work. At a company with roughly 2,000 employees, even identifying the right collaborators can be difficult. One PM OS skill maps a team and automatically adds the relevant designer, engineering manager, and team leaders as reviewers.
  • A simple “what’s up” skill can make Slack manageable. Ezra runs it about six times a day to gather relevant threads, projects, open decisions, and people awaiting a response. He archives roughly 10 channels daily because the skill preserves what actually matters.
  • A basic Git repository can support an entire PM organization. PM OS consists of an AGENTS.md file, reusable skills, and a few command hooks. An automatic version check keeps 60 to 70 PMs aligned, while private subrepositories give each person room to customize.
  • Successful AI adoption starts with familiar tools, then evolves with users. PM OS began as a terminal interface in Claude Code before gaining a local web interface that was easier to read. Ezra now works primarily in Codex, partly because browser use has become reliable enough for his workflow.
  • Agents can be more diligent bug bashers than humans. Ezra gives his agent a test account and a FigJam board full of scenarios, then has it document its findings. It has caught edge cases ranging from a text box filled with 1,000 emojis to grammar that changed based on a team’s name.
  • In growth, wasted traffic is the biggest sin. AutoXP uses three agents to identify funnel drop-off, propose new copy, and prepare the implementation. A human reviews the experiment once before launch, after which the system analyzes results and begins the next iteration automatically.
  • Fast, inexpensive models can provide feedback that feels continuous. Ezra’s Jev prototype reviews writing whenever the user pauses, flags placeholders and unsupported claims, and finds relevant interview quotes from a research library. The speed makes it feel less like running an AI task and more like working beside an attentive editor.
  • When an AI conversation goes bad, starting over often beats arguing with it. Ezra treats poor output as a sign of unclear instructions or contaminated context. He opens a fresh conversation, restates the goal, and approaches the model with high expectations: “Buddy, I know you can cook.”

Inside Figma’s PM OS: 31 AI Skills, Better Bug Bashes, and an Automated Growth Loop: https://www.chatprd.ai/how-i-ai/inside-figma-s-pm-os-31-ai-skills-better-bug-bashes-and-an-automated-growth-loop ↳ Automate Software Bug Bashing with a Browser Agent: https://www.chatprd.ai/how-i-ai/workflows/automate-software-bug-bashing-with-a-browser-agent ↳ Build an Automated Growth Experiment Loop with Multiple AI Agents: https://www.chatprd.ai/how-i-ai/workflows/build-an-automated-growth-experiment-loop-with-multiple-ai-agents ↳ Build a Personal PM Operating System with a Shared Knowledge Repo: https://www.chatprd.ai/how-i-ai/workflows/build-a-personal-pm-operating-system-with-a-shared-knowledge-repo

If you’re enjoying these episodes, reply and let me know what you’d love to learn more about: AI workflows, hiring, growth, product strategy—anything.

Catch you next week, Lenny

P.S. Want every new episode delivered the moment it drops? Hit “Follow” on your favorite podcast app.

Previous