992: Tokenmaxxing vs AI Hardware Bottlenecks
While “tokenmaxxing”, the social media trend of maximizing AI token consumption as a vanity metric, takes off online, the physical infrastructure behind AI is slamming into serious bottlenecks. In this Five-Minute Friday, Jon Krohn maps out the four overlapping supply-chain constraints choking AI compute: GPUs (with NVIDIA Blackwell sold out through mid-2026), high-bandwidth memory (quintupled demand since 2023, only three manufacturers worldwide), CPUs (agentic AI requires 12x more CPUs per GPU than chatbots), and electricity (Gartner projects power shortages will restrict 40% of AI data centres by 2027). Find out why the five biggest hyperscalers are on track to spend $725 billion on AI infrastructure in 2026, where the reasons for optimism lie, and why Jon says you should definitely not tokenmaxx. Additional materials: www.superdatascience.com/992 Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.
Podzilla Summary coming soon
Sign up to get notified when the full AI-powered summary is ready.
Free forever for up to 3 podcasts. No credit card required.
Listen to This Episode
More from Super Data Science: ML & AI Podcast with Jon Krohn
993: How to Build AI-First Organizations, with Jacob Miller and Jeremy Mumford
991: Pair Programming with AI in Your Python Notebook, with Dr. Trevor Manz
990: Inside Mythos: Anthropic's Locked-Down Frontier Model
989: Security for Mythos-Era Agentic Risks, with Rubrik’s Anneka Gupta and Cal Al-Dhubaib
Get summaries like this every morning.
Free AI-powered recaps of Super Data Science: ML & AI Podcast with Jon Krohn and your other favorite podcasts, delivered to your inbox.
Free forever for up to 3 podcasts. No credit card required.