Agents that operate browsers, desktops and other UIs directly.
While AI coding tools can increase the volume of pull requests, unchecked AI code generation often amplifies codebase entropy and technical debt. Studies show that without clean codebases, teams spend more time reworking and refactoring code, leading to little net productivity gain.
▶ 2:49
Beyond Code Coverage: Functionality Testing with Playwright MCP — Marlene Mhangami, Microsoft
Raw compute demand makes it hard to scale model capabilities and distribute them affordably to everyone. Consequently, frontier labs must focus on pacing the frontier, treating safety and alignment standards as bottlenecks rather than just compute limits.
▶ 2:27
OpenAI President on What it Means to Cross Into The Age of AGI
Red-green TDD is a development workflow where you start by writing a failing test for a new feature request. In the green phase, you focus purely on speed to get the test to pass, followed by a dedicated refactoring phase to ensure code quality. When combined with AI, agents rapidly generate the failing tests and passing code, allowing developers to focus their time on refactoring.
▶ 5:18
Beyond Code Coverage: Functionality Testing with Playwright MCP — Marlene Mhangami, Microsoft
Advanced models can independently discover sophisticated security vulnerabilities, which will soon empower threat actors broadly. Defenders must urgently use these frontier capabilities during a temporary window to find flaws, patch systems, and move themselves up before attacks become widespread.
▶ 10:22
OpenAI President on What it Means to Cross Into The Age of AGI
Traditional unit tests frequently overindex on code coverage and implementation details rather than verifying overall system behavior. This causes tests to break during refactoring even when the underlying functionality remains correct, and AI-generated unit tests can sometimes be self-affirming without validating real behavior.
▶ 6:44
Beyond Code Coverage: Functionality Testing with Playwright MCP — Marlene Mhangami, Microsoft
Computer use allows models to interact directly with screen pixels, keyboards, and mice rather than relying on cobbled-together MCP servers and APIs. This enables agents to perform long-running, complex tasks across arbitrary software interfaces the way a human would.
▶ 21:52
OpenAI President on What it Means to Cross Into The Age of AGI
Playwright is an open-source testing framework built by Microsoft that automates end-to-end testing directly in the browser by simulating user interactions. It supports multiple programming languages like Python, TypeScript, and C#, and allows running tests in either headed or headless modes.
▶ 8:18
Beyond Code Coverage: Functionality Testing with Playwright MCP — Marlene Mhangami, Microsoft
OpenAI made a billion-dollar commitment to frontline defenders like hospitals and water service providers to provide discounted access to secure models. This helps under-resourced public and critical infrastructure sectors bridge historical cybersecurity debt.
▶ 36:10
OpenAI President on What it Means to Cross Into The Age of AGI
Developers can connect their coding agents to Playwright using the Playwright MCP server, command-line tools, or specialized Playwright agents. Using Playwright agents installs specific markdown files that provide a planner, generator, and healer to manage testing workflows.
▶ 10:17
Beyond Code Coverage: Functionality Testing with Playwright MCP — Marlene Mhangami, Microsoft
Labs must ruthlessly focus on their core mission, leading to painful decisions like cancelling high-profile projects such as Sora to consolidate engineering efforts. Leadership relies on fundamental execution principles, such as focusing on basic inputs rather than just end goals.
▶ 43:49
OpenAI President on What it Means to Cross Into The Age of AGI
Work IQ is a Microsoft development skill that allows developers to connect the M365 suite directly to their terminal environment. This enables developers to pull project requirements and information from tools like Outlook or PowerPoint straight into command-line interfaces like Copilot CLI.
▶ 12:37
Beyond Code Coverage: Functionality Testing with Playwright MCP — Marlene Mhangami, Microsoft
While traditional unit testing is typically triggered by adding a new method to a class, modern agentic workflows focus testing on overall behavior and feature requests. When a new feature request arrives from a product management team, it serves as the direct trigger for writing behavioral tests.
▶ 13:07
Beyond Code Coverage: Functionality Testing with Playwright MCP — Marlene Mhangami, Microsoft
Developers should capture screenshots of Playwright functionality tests and add them to pull requests to visually track changes. Additionally, running tests in headless mode and committing code before letting agents make changes ensures history and context are preserved.
▶ 16:28
Beyond Code Coverage: Functionality Testing with Playwright MCP — Marlene Mhangami, Microsoft
For complex applications with heavy state management, using specialized Playwright agents is recommended because they include built-in instructions tailored to handle state effectively. Alternatively, developers can choose to directly test APIs if an API is available instead of relying entirely on browser automation.
▶ 18:08
Beyond Code Coverage: Functionality Testing with Playwright MCP — Marlene Mhangami, Microsoft
No answer mentions that.