The Neon Show

The Big Problem with GPUs and How To Solve It | Randolph and Kandan, MantisGrid AI

September 15, 2026·42 min
Episode Description from the Publisher

We don't want the industry to fall apart, that's why we started this company. 6 months ago, everyone was talking about model deployment. Now everyone has moved on to agentic AI deployment and autonomous agent swarms. But all of this is running on an infrastructure that itself is not automated. And this underlying infrastructure has massive GPU cluster systems. If even one GPU fails the whole training workload fails. You can't have 100,000 employees managing 100,000 GPUs. But LLMs are not th...

Podzilla Summary coming soon

Sign up to get notified when the full AI-powered summary is ready.

Get Free Summaries →

Free forever for up to 3 podcasts. No credit card required.

Listen to This Episode

Get summaries like this every morning.

Free AI-powered recaps of The Neon Show and your other favorite podcasts, delivered to your inbox.

Get Free Summaries →

Free forever for up to 3 podcasts. No credit card required.