
One AI model can win gold at the International Mathematical Olympiad while another leading model can only read an analog clock about half the time, so what do those record-breaking benchmark scores actually tell you? In this episode, host Emily Laird explains AI evals: how researchers test these systems, why leaderboards go stale within months, and why an AI agent saying “task complete” doesn’t prove the task got done. She also looks at the gap between feeling faster with AI and actually being faster. Then she gives you a simple way to run your own evaluation, so you can decide whether a tool is reliable enough for the work you actually do. 🎯 JOIN THE AI WEEKLY MEETUPS https://www.uwstout.edu/ai-weekly-meetup 📩 EMAIL REMINDERS FOR THE MEETUPS https://app.e2ma.net/app2/audience/signup/2101263/1779703/ 💬 CONNECT WITH EMILY LAIRD ON LINKEDIN http://www.linkedin.com/in/meet-emily-laird
Podzilla Summary coming soon
Sign up to get notified when the full AI-powered summary is ready.
Free forever for up to 3 podcasts. No credit card required.
Free AI-powered recaps of Generative AI 101 and your other favorite podcasts, delivered to your inbox.
Free forever for up to 3 podcasts. No credit card required.