Reiner Pope – The math behind how LLMs are trained and served
This podcast episode is a technical deep-dive lecture on the infrastructure and economics of AI inference, focusing on how model architecture, hardware constraints, and batching strategies determine latency, cost, and scalability. It lands by revealing the hidden engineering trade-offs be
Sign up to read the full summary
Free AI-powered recaps of every episode, delivered to your inbox.
Free forever for up to 3 podcasts. No credit card required.
Guest
Reiner Pope
narrative on Dwarkesh Podcast
Mentions
Books, people, and resources mentioned in this episode.
People
Companies
Research & Papers
Topics
Listen to This Episode
More from Dwarkesh Podcast
Reiner Pope – Chip design from the bottom up
Eric Jang – Building AlphaGo from scratch
Michael Nielsen – How science actually progresses
Alex Imas and Phil Trammell – What remains scarce after AGI?
David Reich – Why the Bronze Age was an inflection point in human evolution
Ada Palmer – Machiavelli is the most misunderstood thinker of all time
Related episodes
From other shows on similar topics.
Anjney Midha's Plan to Radically Lower the Price of Compute
Odd Lots
The Annual AI Slowdown Panic is Here
The AI Daily Brief: Artificial Intelligence News and Analysis
Ep 89: AI Research Legend’s Honest Assessment of Where We Are
Unsupervised Learning with Jacob Effron
Why AI Has No ROI with Paul Kedrosky
Better Offline
Anthropic's $30B Ramp, Mythos Doomsday, OpenClaw Ankled, Iran War Ceasefire, Israel's Influence
All-In with Chamath, Jason, Sacks & Friedberg
How to Actually Implement AI in Your Business Without Wasting Six Months
The Vault Unlocked
Get summaries like this every morning.
Free AI-powered recaps of Dwarkesh Podcast and your other favorite podcasts, delivered to your inbox.
Free forever for up to 3 podcasts. No credit card required.