Skip to content

Transformers: The Discovery That Sparked the AI Revolution

Y Combinator Podcast

9m
Transcript

Original podcast

Where to listen

About this episode

Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer. In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.

Transcript

0:00
9:19

1,689 words · 1 speaker

Page updated · transcript and summary are machine-generated