Speaker Notes

Background agents

Agents that work asynchronously in CI or the cloud and come back with a PR.

10talks
80answers
5mainly about it
10new
DecJanFebMarAprMayJunJulAugSepOctNov

What your library answers 80

Should I run the agent inside the sandbox or out of it?

Running the agent inside the sandbox simplifies state management because everything is localized, but it creates serious security risks because secrets must live in the box where the unpredictable AI can exfiltrate them. An out-of-the-box architecture separates the brain from the machine, using a worker control plane to operate the sandbox via tool calls, which secures your secrets despite adding architectural complexity.

Thumbnail: Devin’s 80% Moment: Background Agents, 7x PRs, & End of Hand-Held Coding — Walden Yan & Cole Murray ▶ 12:09 Devin’s 80% Moment: Background Agents, 7x PRs, & End of Hand-Held Coding — Walden Yan & Cole Murray

How did Uber's approach to AI shift from early copilot days to recent agentic workflows?

Uber initially saw a modest 10 to 15 percent bump in diff velocity using synchronous tab completion and IDE chat in 2022 and 2023. Over the past year, the paradigm shifted to peer programming, where developers hand off asynchronous workloads to AI agents and act as tech leads directing these agents. This allows engineers to delegate toil like dead code cleanup and library migrations to focus on creative work.

Thumbnail: Uber: Leading engineering through an agentic shift - The Pragmatic Summit ▶ 3:59 Uber: Leading engineering through an agentic shift - The Pragmatic Summit

How does Claude Tag differ from standard chat integrations like Claude in Slack?

Claude Tag provides an extra degree of proactivity by autonomously initiating conversations, managing cross-channel memory, and executing long-running tasks. It can spin up its own sandboxes and ping you when a pull request is ready, shifting workflows from single-player sessions to asynchronous, multiplayer collaboration.

Thumbnail: Inside Anthropic: How Claude Tag Is Changing Agentic Work ▶ 4:02 Inside Anthropic: How Claude Tag Is Changing Agentic Work

How did reasoning models change coding capabilities in late 2024 and 2025?

Labs focused their reinforcement learning and reasoning efforts heavily on code generation throughout 2025. This culminated in November models crossing a reliability threshold where they execute instructions accurately almost all of the time. Instead of mostly working code requiring close attention, developers can now rely on agents to build complete applications reliably.

Thumbnail: An AI state of the union: We’ve passed the inflection point & dark factories are coming ▶ 4:08 An AI state of the union: We’ve passed the inflection point & dark factories are coming

How are AI coding agents changing developer workflows?

Coding agents have shifted from a peripheral feature to taking center stage across the software development lifecycle. Developers are increasingly leveraging these tools because coding provides an exceptionally valuable and practical use case for AI automation. As a result, agentic workflows are now appearing everywhere in modern tooling.

Thumbnail: Why AI Coding Agents Are Here To Stay | Patrick Debois ▶ 8:52 Why AI Coding Agents Are Here To Stay | Patrick Debois

How did the original Star Wars production pioneer automated technology?

The production team used a computer-controlled camera system called a DijkstraFlex to repeat exact camera movements. This allowed them to shoot models in layers and combine them into seamless shots without humans in the loop.

Thumbnail: The next era of AI coding ▶ 0:53 The next era of AI coding

How do I run AI agents without slowing down my local machine?

Offload heavy agent workloads to a remote Linux machine rather than your primary computer to avoid bottlenecks. You can set up a server on a separate Linux box that handles your codebases and code servers. This keeps your local laptop free for other tasks without performance drops.

Thumbnail: You're using AI agents wrong ▶ 5:09 You're using AI agents wrong

Why use full VMs instead of Docker containers for agent sandboxes?

Full VMs are necessary because Docker containers are not true security boundaries and running applications inside Docker introduces nested configuration issues. Full VMs support complex testing workflows, running full applications, and even nested virtualization for Android emulators. However, you can still use Docker for your infrastructure setup since developers are already familiar with it.

Thumbnail: Devin’s 80% Moment: Background Agents, 7x PRs, & End of Hand-Held Coding — Walden Yan & Cole Murray ▶ 17:35 Devin’s 80% Moment: Background Agents, 7x PRs, & End of Hand-Held Coding — Walden Yan & Cole Murray

What kind of tasks do developers primarily push into Uber's agentic system?

As soon as agentic workflows were made available, 70 percent of the workloads pushed by developers were toil tasks. This happened because the start and end states of tasks like library upgrades and migrations are straightforward, leading to much higher accuracy. Because of this success, tackling toil with AI became a top priority for the developer platform.

Thumbnail: Uber: Leading engineering through an agentic shift - The Pragmatic Summit ▶ 6:45 Uber: Leading engineering through an agentic shift - The Pragmatic Summit

How does the shift to chat-based agent environments change the developer workflow?

Developers move away from single-player IDE sessions toward asynchronous, multiplayer collaboration directly inside communication channels like Slack. Instead of stepping through every turn of the agent, developers define success criteria and let long-running agents execute complex tasks and ping teams for reviews.

Thumbnail: Inside Anthropic: How Claude Tag Is Changing Agentic Work ▶ 11:33 Inside Anthropic: How Claude Tag Is Changing Agentic Work

How do agents spin up their own development stacks?

Developers spawn the coding agent as the primary entry point rather than setting up a predefined environment first. The agent uses provided skills and scripts to boot the necessary local development stack and configure its own environment variables. This approach allows reasoning models to make intelligent choices rather than operating inside a rigid box.

Thumbnail: Extreme Harness Engineering: 1M LOC, 1B toks/day, 0% human code or review — Ryan Lopopolo, OpenAI ▶ 11:37 Extreme Harness Engineering: 1M LOC, 1B toks/day, 0% human code or review — Ryan Lopopolo, OpenAI

What is the difference between vibe coding and agentic engineering?

Vibe coding is a hands-off approach where you do not look at or understand the code, making it suitable for personal prototypes. In contrast, agentic engineering is a professional discipline for building production-ready software using autonomous coding agents that write, debug, and test code. This requires deep software experience to ensure the results are safe and deployable.

Thumbnail: An AI state of the union: We’ve passed the inflection point & dark factories are coming ▶ 8:57 An AI state of the union: We’ve passed the inflection point & dark factories are coming

Why do developer workflows with AI change every six months?

The rapid advancement of AI technology means that developers must constantly reinvent how they use these tools rather than relying on outdated habits. Sticking to simple code completions prevents teams from embracing new paradigms like agents and specifications. Every six months, a new set of tools unlocks entirely different ways of working.

Thumbnail: Why AI Coding Agents Are Here To Stay | Patrick Debois ▶ 11:50 Why AI Coding Agents Are Here To Stay | Patrick Debois

Why has writing software via formal programming languages traditionally been tedious?

Developers have had to translate high-level thoughts into verbose, step-by-step logic like conditional statements and loops. This manual translation takes huge amounts of time and makes simple features require tens of thousands of lines of code.

Thumbnail: The next era of AI coding ▶ 2:39 The next era of AI coding

How do I prevent losing motivation when testing unverified pull requests?

Burn more tokens by having AI models thoroughly audit the pull request before you set up an environment to test it yourself. This helps catch obvious failures and issues upfront, reducing the chance of hitting a demotivating broken state. Using Linux also helps by allowing you to run parallel tasks smoothly without system friction.

Thumbnail: You're using AI agents wrong ▶ 12:31 You're using AI agents wrong

How do background agents handle end-to-end application testing?

Testing is a complex problem-solving challenge rather than simple computer use because it requires orchestrating multiple services, managing correct code versions, and triggering specific features. Agents need full codebase context to understand how to run applications together, handle admin states, or use feature flags. In some cases, systems even require orchestrating different frontier models together to solve these end-to-end tasks.

Thumbnail: Devin’s 80% Moment: Background Agents, 7x PRs, & End of Hand-Held Coding — Walden Yan & Cole Murray ▶ 21:32 Devin’s 80% Moment: Background Agents, 7x PRs, & End of Hand-Held Coding — Walden Yan & Cole Murray

How does Uber's central Model Context Protocol gateway handle external and internal MCPs?

Uber built a central MCP gateway using a tiger team to proxy both external and internal MCPs from service infrastructure. It exposes these services consistently to engineers while managing authorization, telemetry, and logging. Additionally, they provide a registry and sandbox so developers can discover, test, and ensure new MCPs work as expected.

Thumbnail: Uber: Leading engineering through an agentic shift - The Pragmatic Summit ▶ 9:53 Uber: Leading engineering through an agentic shift - The Pragmatic Summit

What is the industry-wide trend regarding agent time horizons and capabilities?

Agent execution time horizons are on an exponential trajectory, doubling roughly every four months according to METR research. This increase in capability means agents can handle more multi-step tasks, verify their own work, and earn greater human trust.

Thumbnail: Inside Anthropic: How Claude Tag Is Changing Agentic Work ▶ 15:55 Inside Anthropic: How Claude Tag Is Changing Agentic Work

How do you prevent autonomous agents from getting stuck in review loops?

The authoring agent is explicitly instructed to evaluate review feedback and given the flexibility to either defer or push back. Without this permission, coding models tend to blindly follow all instructions and can fail to converge with automated PR reviewers. Providing a scoring framework helps the agent prioritize and handle feedback appropriately.

Thumbnail: Extreme Harness Engineering: 1M LOC, 1B toks/day, 0% human code or review — Ryan Lopopolo, OpenAI ▶ 15:28 Extreme Harness Engineering: 1M LOC, 1B toks/day, 0% human code or review — Ryan Lopopolo, OpenAI

How do dark factories handle software testing without engineers reviewing the code?

Teams implement the dark factory pattern by using a swarm of agent testers that simulate end users interacting with the system around the clock. To bypass rate limits on real third-party platforms, they use coding agents to build complete local API simulations of external tools. This enables robust, automated quality assurance without anyone directly reading the codebase.

Thumbnail: An AI state of the union: We’ve passed the inflection point & dark factories are coming ▶ 15:35 An AI state of the union: We’ve passed the inflection point & dark factories are coming

How do specifications replace traditional code generation?

Specifications are becoming more important than code because modifying a spec allows you to regenerate the entire codebase cleanly from it. They act like a guide that aligns both human teams and AI models on the desired behavior and structure. By feeding detailed requirements into the workflow, specifications directly drive the code generation process.

Thumbnail: Why AI Coding Agents Are Here To Stay | Patrick Debois ▶ 19:16 Why AI Coding Agents Are Here To Stay | Patrick Debois

Why is the true complexity of software often hidden from users and product managers?

Software is designed to serve users simply through buttons and straightforward interfaces, masking the tens of millions of lines of underlying code. Unlike physical structures like Gothic cathedrals, software does not wear its massive structural weight on its sleeve.

Thumbnail: The next era of AI coding ▶ 3:17 The next era of AI coding

How do I manage multiple open pull requests and background agent threads?

Use fast or cheap AI models to audit and prioritize your open pull requests and background threads automatically. You can also use thread features like settling or snoozing to clear out completed work or hide distractions from your sidebar. When an AI response is too complex, ask it to simplify the explanation to avoid cognitive fatigue.

Thumbnail: You're using AI agents wrong ▶ 16:26 You're using AI agents wrong