Speaker Notes

DeepSeek's New AI Is An Absolute Monster

The new DeepSeek model delivers a massive capability jump in just five weeks through self-feedback learning rather than architectural changes, offering high performance at low task costs.

Two Minute Papers · 5:41 · YouTube ↗

Talk · solo speaker  Beginner · concepts and model review

Highlights

2 clips · 3 min of 6 min
    • DeepSeek's API pricing is significantly lower than competing frontier models.
    • Comparing costs strictly by price per million tokens can be misleading due to token efficiency differences.
    • DeepSeek can require two to three times more tokens per task, making cost-per-task the more accurate metric.
    • The new version achieved a massive performance boost with zero architecture changes.
    • Rather than relying purely on external training data, the model learns by critiquing its own output.
    • Self-feedback allows the AI to iteratively test, catch errors, and fix its own generated code and simulations.

Questions this video answers

10 · every answer cites the moment it was said
01 How do token-based costs compare to actual task execution costs? 2 sources · 1:08

While token pricing looks extremely cheap on paper, different systems consume varying amounts of tokens for the same job. DeepSeek can take two to three times more tokens than Claude Opus for identical tasks, making task-based metrics a truer cost measure.

02 How much does it cost to run DeepSeek via the API? 2 sources · 0:47

You can run the model through the API for just a little over a dollar per million output tokens. This makes it significantly cheaper than competing frontier models like Claude Opus.

03 Can I run the new DeepSeek model locally? 2 sources · 1:45

You can download and own the weights for free forever, but running it yourself requires substantial hardware. Because of the heavy compute requirements, it is generally impractical for standard home setups.

04 How do open weights models compete with proprietary frontier models? 2 sources · 2:16

The release of expensive frontier models triggers a race to build alternatives that match their capabilities at a fraction of the cost. Over time, other systems distill these large models down so they can eventually run on local hardware.

05 Did the model architecture change in this new version? 2 sources · 2:38

The underlying architecture did not change at all for this release. Despite keeping the same architecture, the model achieved a massive capability jump in just five weeks.

06 How did they achieve performance gains without changing the architecture? 2 sources · 3:05

The capability jump comes from learning via self-feedback rather than relying solely on massive new training data. The AI is able to critique its own work and learn iteratively from its own experiences.

07 How does learning from self-feedback work for coding tasks? 2 sources · 3:35

The AI writes code for a game, plays it, and notices bugs like broken collision detection or missing acceleration. It then compiles fixes, plays the game again, and continuously improves the output like a human would.

08 What is the main challenge when an AI judges its own work? 2 sources · 4:28

It is very difficult to implement because the AI essentially judges and rewards itself. Determining whether it is actually performing well during this autonomous process is not always straightforward.

09 How fast are open weights alternatives catching up to proprietary systems? 2 sources · 0:19

Frontier AI models are improving at an incredible pace, and open weights alternatives are right behind them. Major capability leaps can happen in as little as five weeks.

10 What infrastructure is recommended for running and fine-tuning models? 2 sources · 5:05

Cloud GPU platforms provide the powerful hardware needed to reproduce research papers, run inference, or fine-tune models. They allow developers to test ideas and see results in minutes.

Section-by-section summary

4 parts

A surprisingly massive update in a short timeframe

Just five weeks after the previous release, DeepSeek launched a new iteration that delivers dramatically better software building and terminal operation capabilities.

Evaluating true costs using task-based metrics

While advertised as dramatically cheaper per million tokens, token efficiency differences mean cost-per-task provides a more realistic comparison against other frontier models.

Open weights democratize frontier-level capabilities

Releasing model weights enables the broader ecosystem to distill and optimize the technology so it can eventually run locally on consumer hardware.

Self-feedback loops drive capability leaps without new architectures

The massive performance increase stems from learning through self-critique, allowing the model to iteratively test and refine its own work like a human developer.

0:00 / 5:41
k play/pause · f fullscreen · m mute
n next · p previous clip · t highlights/full
< > slower/faster · / search what was said
  • DeepSeek4× · first 0:00

    A newly released AI system and model family offering high performance at low task costs.

  • Claude Opus2× · first 0:58

    A frontier AI model used as a performance and cost baseline for token comparisons.

  • Open weights1× · first 4:43

    Model weights that can be freely downloaded and owned by users.

  • Self-feedback1× · first 3:05

    A learning mechanism where an AI critiques its own work and learns from its experiences.

  • Lambda2× · first 5:05

    A cloud GPU provider used for running inference, fine-tuning, and reproducing AI research.

  • Nvidia GPUs1× · first 5:25

    Powerful hardware provided by cloud platforms to run experiments and train models.