Speaker Notes

UX for AI

Interfaces for AI tools beyond the chat box.

5talks
46answers
0mainly about it
5new
DecJanFebMarAprMayJunJulAugSepOctNov

What your library answers 46

How do you approach video creation for non-video experts?

The platform lowers the barrier by mimicking a familiar PowerPoint-like interface instead of complex expert tools like Adobe Premiere. Users input a script and select an avatar, while an assisted creation agent parses existing documents to automatically draft the narrative and scene design. This shifts the user's role from scratch creator to editor of an initial draft.

Thumbnail: The $2B AI Startup Backed By Nvidia & Adobe | Synthesia ▶ 5:57 The $2B AI Startup Backed By Nvidia & Adobe | Synthesia

What use cases drive actual consumer utility for personal AI agents?

Daily administrative tasks and financial workflows drive real consumer utility rather than high-profile travel bookings. Consumers care about cost-saving workflows like reducing utility bills or filing reimbursements rather than minor efficiency gains. These invisible agents handle tedious chores seamlessly in the background without requiring active user management.

Thumbnail: We Tested the New Wave of Personal AI Agents ▶ 7:56 We Tested the New Wave of Personal AI Agents

Why did you choose a terminal interface for Claude Code?

The terminal interface started completely by accident because it was the cheapest and easiest way to get a prototype up and running without building a UI. The creator just wanted a simple way to test the API and bash tool use, but it quickly gained traction and stayed there.

Thumbnail: Inside Claude Code With Its Creator Boris Cherny ▶ 4:23 Inside Claude Code With Its Creator Boris Cherny

What are tool seeds and how do they work?

Tool seeds are compressed prompts capturing the dialogue used to build a custom tool with an AI. Instead of packaging and distributing traditional software binaries, you share the prompt, which instantly adapts to the recipient. This revives the Smalltalk tradition of building specialized tools on the fly.

Thumbnail: The Augmented Forest • Kent Beck• GOTO Copenhagen 2026 ▶ 6:30 The Augmented Forest • Kent Beck• GOTO Copenhagen 2026

Why build an editable intermediate layer instead of end-to-end pixel generation?

While generalized video generation models produce raw pixels directly from text, enterprise workflows require precise control over layout, text, and branding. The platform uses an intermediate representation combining avatar footage with an editable editor layer for shapes, lower thirds, and transitions. This trade-off ensures users can easily fix and customize outputs rather than endlessly re-prompting uneditable hype demos.

Thumbnail: The $2B AI Startup Backed By Nvidia & Adobe | Synthesia ▶ 15:22 The $2B AI Startup Backed By Nvidia & Adobe | Synthesia

How do voice interfaces compare to visual apps for agent interaction?

Voice interfaces provide a powerful hands-free surface when users are physically occupied, such as commuting or cooking. For example, full-duplex voice models can successfully handle tasks like inbox zero and calendar management during a bike ride. Meanwhile, other users may prefer visual application interfaces or ambient hardware based on personal preference.

Thumbnail: We Tested the New Wave of Personal AI Agents ▶ 17:55 We Tested the New Wave of Personal AI Agents

How should I manage my CLAUDE.md file when it gets too large?

Keep your instructions minimal and focused only on the absolute essentials like team PR workflows. If it expands to thousands of tokens and starts causing issues, you should simply delete it and start fresh. As models improve, you need fewer instructions to keep the model on track.

Thumbnail: Inside Claude Code With Its Creator Boris Cherny ▶ 10:05 Inside Claude Code With Its Creator Boris Cherny

How do AI coding tools act as an amplifier for team culture?

AI tools function purely as multipliers rather than neutral solutions, amplifying whatever is already happening in a team. If an organization operates under scarcity and burnout, the AI accelerates those negative traits. Conversely, a healthy, resource-rich environment uses the AI to explore variations and learn.

Thumbnail: The Augmented Forest • Kent Beck• GOTO Copenhagen 2026 ▶ 17:42 The Augmented Forest • Kent Beck• GOTO Copenhagen 2026

How do you balance creativity and controllability in video models?

AI video models balance two key dimensions: creativity, which allows imaginative, unpredictable outputs, and controllability, which ensures predictable, brand-consistent execution. The platform prioritizes controllability, reliability, and deterministic script adherence because corporate users require avatars to look identical and speak exact scripts every time. While creative models are useful for viral or artistic content, enterprise utility relies on dependable, easy-to-correct workflows.

Thumbnail: The $2B AI Startup Backed By Nvidia & Adobe | Synthesia ▶ 19:50 The $2B AI Startup Backed By Nvidia & Adobe | Synthesia

How do silent listener agents solve social friction in group chats?

Adding active AI agents to group chats often feels intrusive and diminishes social capital. Silent listener agents solve this by observing conversations quietly, taking notes, and independently pinging individuals in separate message threads only when action items arise. This approach keeps the agent invisible and avoids bothering the majority of the group.

Thumbnail: We Tested the New Wave of Personal AI Agents ▶ 20:17 We Tested the New Wave of Personal AI Agents

How do multi-agent swarms and uncorrelated context windows work?

Multi-agent swarms allow multiple agents to operate with fresh, uncorrelated context windows, acting as a form of test-time compute. An engineer can set up a spec and an Asana board, allowing independent agents to pick up tasks and build features over a weekend without intervention.

Thumbnail: Inside Claude Code With Its Creator Boris Cherny ▶ 22:07 Inside Claude Code With Its Creator Boris Cherny

What distinguishes the desert attractor from the forest attractor?

The desert assumes constant scarcity of time, skills, and stability, making practices like paying down technical debt seem illogical. The forest operates on the assumption that there will be enough resources, encouraging developers to create resources for the next round. While the desert leads to burnout and fragility, the forest sustains long-term progress.

Thumbnail: The Augmented Forest • Kent Beck• GOTO Copenhagen 2026 ▶ 14:34 The Augmented Forest • Kent Beck• GOTO Copenhagen 2026

How do you generate the editing layer on top of raw avatar footage?

The platform uses an LLM to select from pre-set PowerPoint-like templates based on the script's sentiment and content structure. It automatically populates designs with brand colors, fonts, and appropriate visual layouts for slides like product visions. Future research aims to teach models the true language of video by analyzing pacing, cuts, and transitions from large video datasets.

Thumbnail: The $2B AI Startup Backed By Nvidia & Adobe | Synthesia ▶ 22:56 The $2B AI Startup Backed By Nvidia & Adobe | Synthesia

Why are custom models required for the apply feature instead of relying solely on frontier models?

Frontier models are great at sketching out code plans, but they struggle with deterministic tasks like counting line numbers in large files. Cursor uses custom smaller models to reliably apply those sketches into precise code diffs.

Thumbnail: Cursor Team: Future of Programming with AI | Lex Fridman Podcast #447 ▶ 32:05 Cursor Team: Future of Programming with AI | Lex Fridman Podcast #447

Why is configurability and proactivity more defensible than fixed agent personalities?

Fixed personalities often make users uncomfortable, whereas general agents can easily save custom response styles to their memory files. True defensibility comes from high proactivity, where agents autonomously execute helpful tasks like checking into flights without constant hand-holding.

Thumbnail: We Tested the New Wave of Personal AI Agents ▶ 24:49 We Tested the New Wave of Personal AI Agents

What is plan mode actually doing under the hood?

Plan mode is a prompt instruction with a limited lifespan that prevents the model from writing code prematurely. It works by simply adding a sentence to the prompt telling Claude not to code yet, letting it map out tasks before execution.

Thumbnail: Inside Claude Code With Its Creator Boris Cherny ▶ 25:08 Inside Claude Code With Its Creator Boris Cherny

How does unrestrained AI code generation affect code optionality over time?

Pumping out features rapidly with AI burns through futures or optionality, making future modifications increasingly expensive. While traditional teams took years to reach an unchangeable state, AI tools can accelerate code to the same disastrous state in an afternoon. Preserving options requires intentional pauses to refactor and structure code for the next feature.

Thumbnail: The Augmented Forest • Kent Beck• GOTO Copenhagen 2026 ▶ 24:15 The Augmented Forest • Kent Beck• GOTO Copenhagen 2026

How did you secure early funding during the 2017 AI winter?

Raising money was nearly impossible, and the team faced rejection from roughly 80 to 100 investors who thought the idea was too crazy. Persistence paid off when a co-founder cold-emailed Mark Cuban, who replied within three minutes because he had previously experimented with the underlying research paper. Cuban invested a million dollars, proving that founders must find backers who share their unconventional long-term vision.

Thumbnail: The $2B AI Startup Backed By Nvidia & Adobe | Synthesia ▶ 37:58 The $2B AI Startup Backed By Nvidia & Adobe | Synthesia

How do speculative edits speed up code generation?

Instead of relying on a small model to predict draft tokens, speculative edits feed chunks of the original code back into the model as a strong prior. The model processes these chunks in parallel, streaming diffs much faster while allowing developers to review code early without loading screens.

Thumbnail: Cursor Team: Future of Programming with AI | Lex Fridman Podcast #447 ▶ 35:16 Cursor Team: Future of Programming with AI | Lex Fridman Podcast #447

How can narrow startups build viable businesses despite high costs?

Narrow startups can target hyper-specialized vertical markets with ambitious software where users are willing to pay high subscription fees like $200 to $300 a month. By serving a small number of people with extreme depth and proprietary knowledge, they can achieve high-margin run rates.

Thumbnail: We Tested the New Wave of Personal AI Agents ▶ 30:38 We Tested the New Wave of Personal AI Agents

How should I design developer tools for AI models?

You should focus on serving the latent demand of the model by observing how it naturally wants to interact with the world and use tools. Rather than boxing the model into rigid APIs, you should enable its desired workflows and build for the model capabilities expected six months in the future.

Thumbnail: Inside Claude Code With Its Creator Boris Cherny ▶ 31:22 Inside Claude Code With Its Creator Boris Cherny

Why do current AI coding tools leave developers feeling unfulfilled?

Current AI tools focus heavily on model efficiency and token optimization while completely ignoring foundational human needs like competence and struggle. By outsourcing the problem-solving grind to the genie, developers miss out on the struggle required to achieve genuine insight. This leaves engineers with a hollow feeling of accomplishment at the end of the day.

Thumbnail: The Augmented Forest • Kent Beck• GOTO Copenhagen 2026 ▶ 35:16 The Augmented Forest • Kent Beck• GOTO Copenhagen 2026

Why did you pivot from Hollywood dubbing to corporate talking heads?

The initial AI dubbing product served Hollywood studios and agencies as a vitamin rather than a painkiller, making the business dependent on external production cycles. By talking to hundreds of users, they discovered corporate workers wanted simple talking-head videos instead of Hollywood films. This corporate use case lowered the quality bar from real video to a PowerPoint presentation, unlocking scalable product-market fit.

Thumbnail: The $2B AI Startup Backed By Nvidia & Adobe | Synthesia ▶ 43:17 The $2B AI Startup Backed By Nvidia & Adobe | Synthesia

How does Cursor use JSX for prompt engineering?

Cursor uses a declarative prompt rendering system inspired by React and JSX to format and fit context into prompt windows. It assigns priorities, such as giving the exact line of the cursor the highest priority, and dynamically adjusts what gets included based on available space.

Thumbnail: Cursor Team: Future of Programming with AI | Lex Fridman Podcast #447 ▶ 45:39 Cursor Team: Future of Programming with AI | Lex Fridman Podcast #447

What are the economic challenges and pricing strategies for long-tail agent startups?

Running ambitious agents costs around $20 per user per day, making long-tail economics extremely challenging against free dominant tools. Startups are betting that browser use will become deflationary and exponentially cheaper, while exploring high-priced premium offerings that users eagerly pay for.

Thumbnail: We Tested the New Wave of Personal AI Agents ▶ 48:23 We Tested the New Wave of Personal AI Agents

What impact has Claude Code had on internal productivity at Anthropic?

Productivity measured by pull requests has grown significantly, with output per engineer increasing substantially since Claude Code was launched. Many engineers and creators now rely on it completely, uninstalling their traditional IDEs and writing 100% of their code through Claude Code.

Thumbnail: Inside Claude Code With Its Creator Boris Cherny ▶ 41:00 Inside Claude Code With Its Creator Boris Cherny

What features should human-centric developer tools prioritize instead?

Human-centric tools should aim to automate routine toil while actively preserving meaningful struggle and surfacing difficult choices for developers. They should encourage learning throughout the day and promote human-to-human connection rather than isolating programmers in separate silos. Ultimately, tools should serve human growth and satisfaction rather than model token metrics.

Thumbnail: The Augmented Forest • Kent Beck• GOTO Copenhagen 2026 ▶ 45:04 The Augmented Forest • Kent Beck• GOTO Copenhagen 2026