The Attention Mechanism with Andrew Mayne

Andrew and Justin examine Meta’s bid for frontier status, mathematicians’ divided response to OpenAI’s wave of new proofs, Anthropic’s growing momentum with Claude, and how Google’s AI push has obscured the search experience that once defined its brand.

The Attention Mechanism is now available in video! Check it out here.

Chapters

00:00 - Intro
00:54 - Meta
29:11 - Math
44:24 - State of the Race
59:12 - Wrap-up
Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin discuss their wishlist for OpenAI's upcoming Dev Day event, the delay of GPT-6.1, Meta's success with Muse, and more.

The Attention Mechanism is now available in video! Check it out here.

Chapters

00:00 - Intro and Dev Day
00:37 - GPT-6.1 Delayed
14:27- $500 Plans?
21:54 - Sora and Video Generation
28:32 - Open Source Potential
30:28 - Dev Day Wishlist
35:51 - Meta and Muse
44:48 - Wrap-up
Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin discuss the swirling rumors surrounding OpenAI's launch plans for this week ahead of Dev Day, a new committee designed to reveal Millennium Prize math problems being solved by ChatGPT, whether an IPO is coming in 2026, and whatever the heck Jev is.

The Attention Mechanism is now available in video! Check it out here.

Chapters

00:00:00 - Intro
00:00:58 - What's Jev?
00:03:24 - OpenAI Pre-Dev Day Rumors
00:23:09 - Millennium Prize Math Committee
00:38:44 - Are Hacking Incidents Overstated?
00:54:07 - IPO
00:59:58 - Wrap-up
Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin react to the industry calls to slow model development in the name of safety, the launch of Astra 6, and more.

The Attention Mechanism is now available in video! Check it out here.

Chapters

00:00 - Intro
01:32- Andrew's Reaction to Calls for Slowed Development
11:09 - Reacting to Various Online Takes
34:21 - Astra 6 is Out
41:54 - Navier–Stokes
49:55 - Anthropic's Risk Report
58:35 - Wrap-up
Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin discuss the follow-up reporting and investigations surrounding the Hugging Face hack, Nvidia's acquisition of Hugging Face, and the looming promise of some fresh models to kick off the fall.

The Attention Mechanism is now available in video! Check it out here.

Chapters

00:00 - Intro
01:30 - Hugging Face Report
21:08 - Hugging Face Acquired
26:24 - Cursor and OpenAI
31:08 - Fable 5.1 and Astra
51:22 - Wrap-up
Hosted on Acast. See acast.com/privacy for more information.