Speaker Notes

The Future of MCP — David Soria Parra, Anthropic

The Model Context Protocol has rapidly scaled to over 100 million downloads, and future agent architectures will rely on progressive discovery, programmatic tool calling, and stateless transports for robust production deployment.

AI Engineer · 18:46 · YouTube ↗

Talk · solo speaker  Intermediate · concepts and agent architecture strategy

Highlights

3 clips · 5 min of 19 min
    • Avoid loading every available tool directly into the model context window
    • Implement tool search patterns so the model requests tools on demand
    • Significantly reduces context token usage for servers with massive toolsets
    • Allow models to write execution scripts in a REPL instead of chaining individual tool calls
    • Cuts down inference latency and token overhead by letting code handle orchestration
    • Use structured output to provide type information for reliable script composition
    • Streamable HTTP is difficult to scale for large hyperscalers in production
    • A proposed stateless transport protocol allows MCP servers to deploy like standard REST servers
    • Simplifies deployment to cloud run and Kubernetes environments

Questions this video answers

9 · every answer cites the moment it was said
01 What can an MCP server ship beyond basic tools? 2 sources · 0:25

An MCP server can ship entire interactive applications rendered on the client side or served over the protocol, providing a UI for humans while offering tools for models. This eliminates the need for hardcoded product UIs or complex client-side rendering frameworks.

02 How do MCP download volumes compare to other open source projects? 2 sources · 2:40

MCP has reached 110 million monthly downloads across thousands of frameworks, dependencies, and agent SDKs. This adoption rate is roughly twice as fast as React achieved in a comparable timeframe.

03 When should a developer use CLIs versus MCP for agent connectivity? 2 sources · 6:18

CLIs are ideal for local coding agents running in sandboxed code execution environments where commands can be automatically discovered. MCP should be chosen when you need rich semantics, UI rendering for long-running tasks, decoupled platform independence, or enterprise governance and authorization.

04 What is progressive discovery and how does it reduce context window usage? 2 sources · 8:33

Progressive discovery uses a tool search pattern to defer loading all tools into the context window until the model actually requires them. Instead of dumping every tool definition upfront, the model invokes a tool loading tool on demand, drastically lowering context consumption.

05 How does programmatic tool calling (code mode) improve agent orchestration? 2 sources · 9:52

Programmatic tool calling allows the model to write a script or run code in a sandbox instead of performing expensive, latency-sensitive single tool calls sequentially. Using structured output, the model can compose operations programmatically, reducing token usage and latency.

06 Why is one-to-one REST to MCP server conversion discouraged? 2 sources · 12:09

Direct mechanical conversions from REST APIs to MCP servers typically result in poor design and horrible usability for agents. Developers should instead design servers specifically for agent workflows or model orchestration rather than mirroring legacy endpoints.

07 What is the purpose of the upcoming stateless transport protocol proposal? 2 sources · 13:57

The current streamable HTTP transport is difficult to scale for large hyperscalers, so a proposed stateless transport will make MCP servers behave like standard stateless REST servers. This allows developers to easily deploy MCP servers to standard cloud infrastructure like Kubernetes or Cloud Run.

08 What improvements are coming to enterprise integration and discovery in the next spec? 2 sources · 15:34

The upcoming specification introduces cross-app access, allowing users to log in once via enterprise identity providers like Okta or Google without repetitive authentication. Additionally, server discovery will allow crawlers and agents to automatically find MCP servers on well-known URLs.

09 How will skills over MCP change how server authors distribute domain knowledge? 2 sources · 16:35

Skills over MCP allow server authors to bundle domain knowledge and usage instructions directly into large MCP servers alongside their tools. This enables continuous updates to agent skills without requiring external registries or complex plugin mechanisms.

Section-by-section summary

4 parts

MCP bridges agents and diverse data sources

The Model Context Protocol has grown rapidly to over 100 million monthly downloads, powering integrations from toy projects to major enterprise platforms. The protocol provides the necessary semantics and bidirectional capabilities for humans and agents to interact seamlessly. As the ecosystem shifts toward production agents, connectivity becomes paramount across multiple distinct paradigms.

Selecting the right tool for agent connectivity

Building agents for general knowledge work requires balancing multiple connectivity layers rather than relying on a single solution. Skills capture domain knowledge, CLIs excel for local sandboxed coding agents, and MCP provides rich semantics, UI applications, and enterprise governance. Successful production agents will seamlessly combine all three approaches depending on the specific use case.

Optimizing agent harnesses with progressive discovery

Agent clients must avoid dumping all available tools directly into the context window to prevent massive bloat and high latency. Implementing progressive discovery via tool search allows models to fetch tools only when needed. Furthermore, programmatic tool calling lets models write execution scripts in a REPL to compose multiple operations efficiently.

Upcoming protocol updates and stateless transports

Upcoming updates to MCP will introduce a stateless transport protocol to simplify cloud deployments on infrastructure like Kubernetes. Enterprise features like cross-app access will allow single sign-on integration with major identity providers. Additionally, new specifications will enable automatic server discovery and native skills over MCP.

0:00 / 18:46
k play/pause · f fullscreen · m mute
n next · p previous clip · t highlights/full
< > slower/faster · / search what was said
  • Model Context Protocol19× · first 0:22

    Open protocol bridging agents and diverse data sources.

  • Progressive discovery3× · first 8:11

    Pattern to defer loading tools into the context window until requested.

  • Programmatic tool calling3× · first 9:40

    Execution pattern where the model writes code to compose tool operations.

  • Structured output2× · first 10:58

    Protocol feature defining return value types for better composition.

  • Stateless transport1× · first 14:10

    Protocol update to treat MCP servers like standard stateless REST servers.

  • Fast MCP1× · first 15:04

    Popular Python SDK alternative for building servers.

  • Cross-app access1× · first 15:26

    Enterprise authentication feature for single sign-on across servers.

  • Skills over MCP3× · first 7:01

    Mechanism to ship domain knowledge alongside server tools.