The Attention Mechanism with Andrew Mayne

Andrew and Justin react to the industry calls to slow model development in the name of safety, the launch of Astra 6, and more.

The Attention Mechanism is now available in video! Check it out here.

Chapters

00:00 - Intro
01:32- Andrew's Reaction to Calls for Slowed Development
11:09 - Reacting to Various Online Takes
34:21 - Astra 6 is Out
41:54 - Navier–Stokes
49:55 - Anthropic's Risk Report
58:35 - Wrap-up
Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin discuss the follow-up reporting and investigations surrounding the Hugging Face hack, Nvidia's acquisition of Hugging Face, and the looming promise of some fresh models to kick off the fall.

The Attention Mechanism is now available in video! Check it out here.

Chapters

00:00 - Intro
01:30 - Hugging Face Report
21:08 - Hugging Face Acquired
26:24 - Cursor and OpenAI
31:08 - Fable 5.1 and Astra
51:22 - Wrap-up
Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin discuss Anthropic's text-based AI watermarks, the future of private companies in an AI world, and whether Google can keep up with the rest of its frontier rivals.

The Attention Mechanism is now available in video! Check it out here.

Chapters

00:00:00 - Intro
00:00:55 - Watermarks
00:20:45 - Dario's Private Company Thoughts
00:36:58 - Always-Listening Assistants and Google's Place in the Frontier Race
00:54:34 - RIP Atlas, One Last Time
00:58:25 - Wrap-up
Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin reconvene to talk about an ongoing series of recent upheavals at Google, asking whether the company's lack of focus on AI puts it at a disadvantage over its frontier rivals. They also discuss Sam Altman's trip to Washington and the discourse surrounding model hacking incidents.

The Attention Mechanism is now available in video! Check it out here.

Editor's note: Some minor crosstalk issues in this episode due to recording sync delays.

Chapters

00:00 - Intro
01:04 - Google Shakeup
21:13 - Mr. Altman Goes to Washington
37:24 - Dean Ball and Wrap-up
Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin discuss the Hugging Face breach, which saw an unreleased OpenAI model find its way into the company's systems during internal testing. They also discuss the launch of Opus 5, the ongoing progress made by Chinese models, and the crunch for compute as 10GW data center plans start to make some motion. Plus, a tribute to the late John C. Dvorak.

The Attention Mechanism is now available in video! Check it out here.

Chapters

00:00 - Intro
01:23 - Hugging Face
15:45 - Chinese Models
26:01 - Opus 5
36:11 - 10GW Data Centers
52:29 - RIP John C. Dvorak
Hosted on Acast. See acast.com/privacy for more information.