PLAYBOOK / AI AGENTS

AI Agent Frameworks Compared

Whether to build your own agent at all, and which framework to pick if you do.

12-page guide · 7 min read · free

Whether to build your own agent at all, and which framework to pick if you do.

Last verified: 21 September 2026 · 20 minute read · For people deciding whether to build

Do you need a framework?
Do you need a framework?

Who this guide is for

People wondering whether to build their own AI agent rather than use one of the ready-made ones in this library.

Most readers don't need this guide, and that's the most useful thing in it. If you want an assistant for your own business, use Hermes, NanoClaw or Claude Code. Frameworks are for people building a product that other people will use.

By the end you'll know: whether you need a framework at all, the nine that matter, how to install each one, and the problems that actually kill agents in production, which no framework solves for you.


In one sentence

An agent framework is a code library that handles the plumbing of building an AI agent (memory, tools, retries, handing work between agents) so a developer can focus on what the agent should do.


The analogy that makes it click

The rest of this library is about hiring an assistant. This guide is about building a staffing agency.

A ready-made agent is a car you drive. A framework is a garage full of parts and tools for building cars. If you just need to get to work, you don't want the garage. If you're going to sell cars, you do.


Do you need one?

Your situation What to use
An assistant for your own work a ready-made agent. Skip frameworks
A simple agent inside your product, one or two tools a light SDK from a model company
Complex multi-step workflows with branching and memory a full framework
A team of agents coordinating a multi-agent framework

And the most useful sentence in the community research, from someone running about 30 agents for paying customers for six months (57 votes):

"LangChain, CrewAI, AutoGen, OpenAI Agents SDK. Pick whichever one your team already knows. It doesn't matter as much as you think."

Another (12 votes) titled their post "Picking an AI agent framework is the least important decision in your agent stack."


The nine that matter

Star counts and install commands verified against each project's own repository and documentation on 21 September 2026.

Framework Stars Language Licence In one line
CrewAI 58,856★ Python MIT teams of role-playing agents working together
LangGraph 42,074★ Python MIT workflows as graphs, with branching, memory and checkpoints
Agno 42,277★ Python Apache 2.0 build, run and manage agent platforms
OpenAI Agents SDK 29,609★ Python MIT a light multi-agent SDK from OpenAI
Mastra 28,238★ TypeScript see repo the main option for JavaScript developers
Google ADK 21,585★ Python Apache 2.0 Google's toolkit for building, evaluating and deploying agents
Pydantic AI 20,090★ Python MIT agents in the style of the popular Pydantic library
Microsoft Agent Framework 13,685★ Python MIT Microsoft's enterprise framework, AutoGen's successor
Claude Agent SDK 8,144★ Python MIT the engine behind Claude Code, as a library

⚠️ One to avoid for new work: AutoGen

AutoGen still shows 61,094 stars, so it tops a lot of lists. But its own README says:

"AutoGen is now in maintenance mode. It will not receive new features or enhancements and is community managed going forward. New users should start with Microsoft Agent Framework."

Its last update was in April 2026. Star counts measure past popularity, not current health. Always check when a project was last updated.


Installing each one

The commands each project's own documentation gives.

# CrewAI
uv tool install crewai

# LangGraph
pip install -U langgraph

# Agno
uv add "agno[os,sqlite]" openai

# OpenAI Agents SDK
pip install openai-agents

# Mastra (JavaScript / TypeScript)
npm create mastra@latest

# Google ADK
pip install google-adk

# Pydantic AI
uv add pydantic-ai pydantic-ai-harness

# Microsoft Agent Framework
pip install agent-framework

# Claude Agent SDK
pip install claude-agent-sdk

uv is a fast modern Python package manager. If you don't have it, the project documentation explains how to install it in one line, or you can usually use pip instead.


Which one for which job

You want to build Start with Why
A team of agents with roles CrewAI role-based crews are its whole design
Complex workflows with branching and human approval steps LangGraph the standard for stateful, multi-step work
Something simple, quickly OpenAI Agents SDK, Pydantic AI, or Claude Agent SDK the lightest path to a working agent
In JavaScript or TypeScript Mastra the leading option in that language
On Google Cloud Google ADK built for it
In a Microsoft enterprise Microsoft Agent Framework long-term support, and AutoGen's successor
On Claude, with Claude Code's tools Claude Agent SDK the same engine Claude Code runs on

A comparison post (37 votes) that built the same agent in nine frameworks reached a similar conclusion: LangGraph for state and resilience, the light SDKs for speed of getting started, CrewAI and Google ADK for coordinating multiple agents. A reply fairly asked for the test code, which wasn't shared, so treat its detailed numbers as one team's impression rather than a benchmark.


⚠️ What actually kills agents

What actually kills agents
What actually kills agents

This is the section to read even if you skip the rest. From the operator running 30 production agents (57 votes), none of these are solved by picking a framework:

1 · The loop

"The agent gets stuck in a loop. It calls the same tool 200 times in 4 minutes because something downstream returned ambiguous data and the model decided to retry forever. Your bill goes from $3 a day to $400 in one afternoon."

Fix: a hard cap on retries and on spend, per agent, enforced outside the model.

2 · Lost state

"Your server reboots overnight for kernel patches. Every agent that was mid-task loses everything. Tomorrow morning the support agent has no memory of yesterday's tickets."

Fix: save state to a database as the agent works, so it can resume.

3 · No audit trail

"By the time you notice you've burned a grand. You can't even tell which agent did it because there's no audit trail."

Fix: log every tool call, with which agent made it and what it cost.

A fair counterpoint

Not everyone agreed. One reply (11 votes) called it "table stakes for an AI agent framework," meaning a good framework should handle these. Another (25 votes) put it simply: "Basic software engineering, right? Auditability, control, consistency. Testing the technology before letting it in the wild."

Both are right. Some frameworks help with these problems, but none of them solve them for you. You still have to switch the protections on and test them.

These are exactly the problems Paperclip was built around: per-agent budgets with hard stops, persistent state, and a full audit log.


Best practices

✅ Don't build if a ready-made agent does the job

✅ Pick the framework your team already knows

✅ Check when a project was last updated, not only its stars

✅ Hard caps on retries and spending, outside the model

✅ Save state as the agent works, so it survives a restart

✅ Log every tool call with the agent and the cost

✅ Test on real, messy data before real customers


Mistakes to avoid

❌ Mistake 1: building when you should be buying

If it's an assistant for your own work, you don't need a framework.

❌ Mistake 2: choosing on star count

AutoGen has more stars than most of this list and isn't getting new features.

❌ Mistake 3: spending weeks choosing

"I've burned weeks evaluating orchestrators, and at the end they all converge on the same patterns once you're past the tutorial stage." (5 votes)

❌ Mistake 4: shipping without spending limits

The $3-to-$400 afternoon is the most common production story in this research.

❌ Mistake 5: assuming the framework handles safety

It gives you the tools. You still have to use them.


If you run a marketing or SEO agency

Situation Recommendation
Automating your own agency work Don't build. Use Claude Code, Hermes or Paperclip
Building a tool you'll sell to clients CrewAI or LangGraph for Python; Mastra for JavaScript
A light assistant inside your own software a model company's SDK
A client asks you to "build them an AI agent" ask first whether a ready-made one would do. Usually it would

Verdict

Frameworks: 🔵 Trial them only if you're building a product

For most readers of this library, the right number of frameworks is zero. The ready-made agents in the other guides do the job with none of the engineering.

If you are building, pick the one your team already knows, check it's still actively maintained, and spend your effort on the three things that actually kill agents: loops, lost state and missing audit trails.

This week: if you think you need a framework, write down the one job the agent must do. Then check whether any of the ready-made agents in this library already does it. Usually one does.


Sources

Primary, checked 21 September 2026

Community reports, quoted with upvotes. Anecdotes, not measurements.


Part of The Agent Guides by Massive Impact. Illustrations generated in-house. No third-party screenshots or marks reproduced.

The rest of the guide is yours, free.

Enter your email to keep reading and get the PDF to keep.

No spam. One email unlocks every Massive Impact resource.

“What you did with the website, they did not have that level of architecture to it, and I think that just is helping it climb.”
Andre, Massive Impact client

Tip the first domino

One move can change everything.

Book a call and we will show you the smallest right move for your business. No pressure, no jargon.