
Free Daily Podcast Summary
by Mo Bhuiyan via NotebookLM
Distilling AI/ML theory into practical insights. One concept at a time. No jargon.
The most recent episodes — sign up to get AI-powered summaries of each one.
MMLU is saturated. Chatbot Arena is gameable. Public benchmarks leak into training data. The only eval that matters is the one you build yourself, on your data, for your task.
A 30B parameter model runs on a MacBook because only 3B parameters fire per token. Mixture of Experts splits memory cost from compute cost, and that changes everything about where AI can run.
90% of enterprises deploy AI agents. Only 23% scale them. The gap is interoperability. Three protocols, MCP, A2A, and ACP, are racing to build the connective tissue before the ecosystem fragments.
Your GPU is not compute-bound. It is memory-bound. The KV cache is eating half your inference budget, and two ICLR 2026 breakthroughs KVTC and TurboQuant are about to change the math entirely.
Models advertise million-token windows but accuracy degrades well before the limit. Three recent studies, the mechanisms behind the rot, and a practitioner playbook for what to do Monday.
Building an AI model is one thing: keeping a large language model running reliably in the real world is another. In this episode, we discuss LLMOps, the emerging set of practices and tools for deploying, monitoring, and maintaining large language models (LLMs) in production. We cover challenges unique to LLMs (like handling the huge model sizes, long context lengths, unpredictable outputs, and continuous updates with new data). You’ll learn about techniques for versioning and evaluating LLMs, setting up feedback loops (human or automated) to catch issues like drift or toxicity, and infrastructure like model hubs and the new Model Context Protocol (MCP) that connects LLMs with external tools and data. We tie it together with examples of how companies manage AI like GPT-4 as a service, ensuring it stays efficient, safe, and up-to-date post-deployment.
In this episode, we explore how AI is moving from the cloud to tiny devices. TinyML is the field of optimizing models and algorithms to run on microcontrollers, smartphones, and other edge devices with very limited compute and power. We discuss techniques like model compression, quantization, and architecture search that make models small and efficient enough to fit on a $5 microcontroller, bringing capabilities like wake-word detection, sensor analytics, or even vision tasks directly onto devices. You’ll hear about examples like MCUNet, an MIT system that achieved ImageNet-level vision recognition on a microcontroller, and why on-device AI can be beneficial (low latency, no internet needed, data privacy). We also cover real-world applications already using TinyML, from smart appliances to wearable health monitors.
This episode is all about the specialized hardware that makes modern AI possible. We explain how GPUs became the workhorses of deep learning by offering massive parallelism for matrix math, and how companies like Google went further to build TPUs (Tensor Processing Units) optimized for neural network workloads. You’ll hear about the latest AI chips, from NVIDIA’s powerful GPUs driving large model training, to emerging AI accelerators like Graphcore’s IPU, Cerebras’s wafer-scale engine, and even AI on the edge (Apple’s neural engines, etc.). We discuss what each brings in terms of speed, memory, efficiency, and how they’re deployed, giving a peek into the data centers (and devices) where AI calculations run.
Distilling AI/ML theory into practical insights. One concept at a time. No jargon.
AI-powered recaps with compact key takeaways, quotes, and insights.
Get key takeaways from The Practical AI Digest in a 5-minute read.
Stay current on your favorite podcasts without falling behind.
It's a free AI-powered email that summarizes new episodes of The Practical AI Digest as soon as they're published. You get the key takeaways, notable quotes, and links & mentions — all in a quick read.
When a new episode drops, our AI transcribes and analyzes it, then generates a personalized summary tailored to your interests and profession. It's delivered to your inbox every morning.
No. Podzilla is an independent service that summarizes publicly available podcast content. We're not affiliated with or endorsed by Mo Bhuiyan via NotebookLM.
Absolutely! The free plan covers up to 3 podcasts. Upgrade to Pro for 15, or Premium for 50. Browse our full catalog at /podcasts.
The Practical AI Digest publishes biweekly. Our AI generates a summary within hours of each new episode.
The Practical AI Digest covers topics including Technology. Our AI identifies the specific themes in each episode and highlights what matters most to you.
Free forever for up to 3 podcasts. No credit card required.
Free forever for up to 3 podcasts. No credit card required.