Generative AI 101

How to Evaluate an AI Model

November 4, 2026·12 min
Episode Description from the Publisher

One AI model can win gold at the International Mathematical Olympiad while another leading model can only read an analog clock about half the time, so what do those record-breaking benchmark scores actually tell you? In this episode, host Emily Laird explains AI evals: how researchers test these systems, why leaderboards go stale within months, and why an AI agent saying “task complete” doesn’t prove the task got done. She also looks at the gap between feeling faster with AI and actually being faster. Then she gives you a simple way to run your own evaluation, so you can decide whether a tool is reliable enough for the work you actually do.   🎯 JOIN THE AI WEEKLY MEETUPS https://www.uwstout.edu/ai-weekly-meetup   📩 EMAIL REMINDERS FOR THE MEETUPS https://app.e2ma.net/app2/audience/signup/2101263/1779703/   💬 CONNECT WITH EMILY LAIRD ON LINKEDIN http://www.linkedin.com/in/meet-emily-laird

Podzilla Summary coming soon

Sign up to get notified when the full AI-powered summary is ready.

Get Free Summaries →

Free forever for up to 3 podcasts. No credit card required.

Listen to This Episode

Get summaries like this every morning.

Free AI-powered recaps of Generative AI 101 and your other favorite podcasts, delivered to your inbox.

Get Free Summaries →

Free forever for up to 3 podcasts. No credit card required.