Skip to content

table.md

Latest commit

 

History

History
64 lines (51 loc) · 7.94 KB

table.md

File metadata and controls

64 lines (51 loc) · 7.94 KB
Raw

Comparison Notes

LOC is tokei "Code" lines (excludes comments and blanks). Each row is measured strict framework-only: the measurement strips clearly non-framework code from the upstream package: platform/deployment layers, domain-specific modalities (voice, realtime), eval/optimizer suites, UI/CLI tools, A2A/declarative wire protocols, code-executor backends, and similar non-framework layers. Provider implementations stay in because they are part of what you import to use the library. Tests, examples, and docs are always excluded.

The README is the canonical rendered table. The raw README source comments keep the command beside each row. To reproduce locally, clone each upstream repo at the pinned commit and run the command shown below.

Measured 2026-06-22 for upstream libraries (pinned commits below). ThinHarness was measured from the current working tree on 2026-09-03.

LOC Commands

  • ThinHarness — tokei thinharness/ -t Python
  • Claude Agent SDK — tokei src/claude_agent_sdk/ -t Python --exclude testing at anthropics/claude-agent-sdk-python @ 315df97
  • smolagents — tokei src/smolagents/ -t Python --exclude cli.py --exclude gradio_ui.py --exclude vision_web_browser.py at huggingface/smolagents @ 526069c
  • deepagents — tokei libs/deepagents/deepagents/ -t Python at langchain-ai/deepagents @ eb9de75
  • AWS Strands — tokei strands-py/src/strands/ -t Python --exclude experimental --exclude vended_plugins --exclude multiagent/a2a at strands-agents/sdk-python @ a5a2cf9
  • Microsoft Agent Framework — tokei python/packages/core/agent_framework/ -t Python --exclude _evaluation.py --exclude a2a --exclude ag_ui --exclude chatkit --exclude declarative --exclude devui --exclude hyperlight --exclude lab --exclude orchestrations --exclude mem0 --exclude redis --exclude microsoft at microsoft/agent-framework @ 2999f74
  • Pydantic AI — tokei pydantic_ai_slim/pydantic_ai/ -t Python --exclude _a2a.py --exclude ag_ui.py --exclude ui --exclude durable_exec --exclude embeddings --exclude ext at pydantic/pydantic-ai @ 53e0641
  • Google ADK — tokei src/google/adk/ -t Python --exclude a2a --exclude apps --exclude cli --exclude cloud --exclude code_executors --exclude environment --exclude evaluation --exclude examples --exclude integrations --exclude optimization --exclude platform at google/adk-python @ 8c9fff8
  • OpenAI Agents SDK — tokei src/agents/ -t Python --exclude realtime --exclude voice --exclude extensions/experimental --exclude extensions/visualization.py at openai/openai-agents-python @ a9b7b7e
  • Agno — tokei libs/agno/agno/{agent,agents,approval,compression,factory,guardrails,hooks,memory,models,reasoning,registry,run,session,skills,team,tools,tracing,utils} -t Python at agno-agi/agno @ 16f33c1

Claude Agent SDK also shells out to the Claude Code CLI binary, which is 200k+ LOC. The table counts the Python SDK package and footnotes that relationship.

Notes on the Marks

Marks reflect shipped, documented, first-class capability judged on the public API — independent of whether a feature is gated experimental or lives in a directory excluded from the strict LOC count.

  • Tool retries — only Pydantic AI (ModelRetry) ships a documented, named primitive that lets a tool function signal "model passed bad args — please retry with this feedback," distinct from generic exception propagation. OpenAI Agents' ModelRetryAdvice / ModelRetrySettings are runner-managed retries for the model HTTP call (network/timeout/HTTP-status backoff), not a tool-feedback primitive. AWS Strands has hook-based retry via AfterToolCallEvent.retry=True, Google ADK has a ReflectAndRetryToolPlugin, and Agno has a RetryAgentRun exception that retries the whole agent run rather than a single tool — these are marked ⚠️. Claude Agent SDK, smolagents, deepagents, Microsoft Agent Framework, and OpenAI Agents SDK have no named primitive and are marked ❌.
  • Subagents — Pydantic AI documents an "agent delegation" pattern, where one agent is called inside another's tool function, but ships no class, decorator, or middleware for it in core (real subagent primitives live in external community packages), so it is marked ❌.
  • Structured output — every library now ships a built-in output-validation step, so the column is uniformly ✅. Claude Agent SDK (output_format / structured_output, validated and re-prompted in the CLI it shells out to) and deepagents (response_format on create_deep_agent) added theirs in 2026.
  • Skills — Pydantic AI and smolagents have no Markdown/frontmatter skills primitive in core, so they are marked ❌. OpenAI Agents SDK (sandbox Skills) and AWS Strands (top-level Skill / AgentSkills) added one in 2026.
  • Built-in FS tools — A ✅ means the project ships a model-facing filesystem toolkit with read/write/edit or search-style primitives. Google ADK (ReadFile / WriteFile / EditFile) and Microsoft Agent Framework (FileAccessProvider — read/write/delete/list/search) both ship one; both are gated experimental, but the mark reflects shipped capability regardless of maturity or LOC scope. OpenAI Agents SDK is marked ⚠️ because it ships only hosted apply_patch (create/update/delete) plus shell — not a full read/write/search toolkit (read and search come through bash, which doesn't count). Pydantic AI, smolagents, and AWS Strands ship no comparable toolkit in core, so they are marked ❌. Generic shell or code-exec tools do not count as full filesystem tools.
  • OTel tracing — AWS Strands, Microsoft Agent Framework, Pydantic AI, and Google ADK emit OpenTelemetry spans from their own code (✅). smolagents, OpenAI Agents SDK, and Agno are marked ⚠️ because they emit no spans from their own code: tracing comes from a separate external instrumentor (OpenInference, for smolagents and Agno) or a proprietary exporter with OTel reachable only via third-party processors (OpenAI). Claude Agent SDK is marked ⚠️ because the Python SDK itself ships no instrumentation beyond W3C traceparent propagation into the CLI subprocess, while the Claude Code CLI it shells out to has beta OTel support. deepagents leans on LangSmith rather than emitting OTel from its own code, so it is marked ❌.

What "Strict Framework-Only" Excludes

Carving principle: keep everything you'd import to use the library as an agent framework: agent loop, hooks, tools, structured output, skills, subagents, memory, session, tracing, provider/model implementations, and MCP. Strip what's clearly outside that scope: deployment layers, evals, UI/CLI tools, voice/realtime modalities, declarative wire protocols, and code-executor backends.

Per-library exclusions:

  • ThinHarness, deepagents — nothing stripped; already framework-only.
  • Claude Agent SDK — testing/ (user-facing test helpers).
  • smolagents — cli.py, gradio_ui.py, vision_web_browser.py (CLI + UI).
  • AWS Strands — experimental/, vended_plugins/, multiagent/a2a/ (experimental APIs, opt-in plugins, A2A wire protocol).
  • Microsoft Agent Framework — _evaluation.py, a2a/, ag_ui/, chatkit/, declarative/, devui/, hyperlight/, lab/, orchestrations/, mem0/, redis/, microsoft/ (evals, wire protocols, UI, runtime backends, storage backends, lab/experimental).
  • Pydantic AI — _a2a.py, ag_ui.py, ui/, durable_exec/, embeddings/, ext/ (A2A, UI, durable execution runtime, embedding models, ext).
  • Google ADK — a2a/, apps/, cli/, cloud/, code_executors/, environment/, evaluation/, examples/, integrations/, optimization/, platform/.
  • OpenAI Agents SDK — realtime/, voice/, extensions/experimental, extensions/visualization.py.
  • Agno — api/, client/, cloud/, db/, integrations/, knowledge/, learn/, os/, remote/, scheduler/, vectordb/, context/, culture/, plus boundary cases workflow/ and eval/. As shipped, Agno is 265,195 LOC.