
This episode is all about the specialized hardware that makes modern AI possible. We explain how GPUs became the workhorses of deep learning by offering massive parallelism for matrix math, and how companies like Google went further to build TPUs (Tensor Processing Units) optimized for neural network workloads. You’ll hear about the latest AI chips, from NVIDIA’s powerful GPUs driving large model training, to emerging AI accelerators like Graphcore’s IPU, Cerebras’s wafer-scale engine, and even AI on the edge (Apple’s neural engines, etc.). We discuss what each brings in terms of speed, memory, efficiency, and how they’re deployed, giving a peek into the data centers (and devices) where AI calculations run.
Podzilla Summary coming soon
Sign up to get notified when the full AI-powered summary is ready.
Free forever for up to 3 podcasts. No credit card required.

The Evaluation Crisis: We Do Not Know How Good Our Models Actually Are

Mixture of Experts at the Edge: Running 30B Parameter Models on Your Laptop

The Agent Interoperability Problem: Why Your AI Agents Can Not Talk to Each Other

KV Cache Compression: The Memory Wall Nobody Talks About
Free AI-powered recaps of The Practical AI Digest and your other favorite podcasts, delivered to your inbox.
Free forever for up to 3 podcasts. No credit card required.