The Bed That Never Fits: When Testing Broke Education

When Frederick J. Kelly invented the multiple-choice test in 1914, he called it a narrow tool for measuring 'lower-order thinking'—basic comprehension only. He later became president of the University of Idaho and spent his career publicly arguing the format should be abandoned. We built an entire education system on something its creator called broken. Today we're talking about how the measurement became the curriculum, how Procrustes' bed got nailed to the classroom, and what happens when a metric eats everything else. 00:00:00 - Introduction and Kelly's ghost story 00:01:35 - Goodhart's Law: When measurements become targets 00:03:15 - The real cost: Students died during standardized tests 00:06:38 - The Magikarp principle: Systems optimize for the metric, not the goal 00:08:08 - Finland's different path: Education without the standardized test 00:09:42 - The cheating scandal: When fraud becomes the winning strategy 00:11:14 - Open-ended assessment: What learning looks like outside the bubble sheet 00:14:50 - AI amplifying the measurement crisis in real time --- Sources & further reading: • Donald T. Campbell — "Assessing the Impact of Planned Social Change" (1976): https://en.wikipedia.org/wiki/Campbell%27s_law • Center for Education Policy — "Choices, Changes, and Challenges: Curriculum and Instruction in the NCLB Era" (July 2007): https://www.edweek.org/policy-politics/survey-subjects-trimmed-to-boost-math-and-reading/2007/07 • Georgia Governor's Office of Student Achievement — Atlanta Public Schools Investigation (2011): https://www.npr.org/2019/02/16/695344751/former-teacher-blames-education-policymakers-for-atlanta-cheating-scandal • Les Perelman / BABEL Generator: https://techxplore.com/news/2014-04-automated-grading-skeptic-babel-expose-nonsense.html • Les Perelman: https://en.wikipedia.org/wiki/Les_Perelman • Robert Lowe / Revised Code of 1862 — Springer chapter, "A History of Payment by Results": https://link.springer.com/chapter/10.1007/978-3-030-37892-9_2 • IOE LibGuides — "The Revised Code" literacy resources: https://libguides.ioe.ac.uk/literacyattainment/revisedcode • Frederick Kelly / Kansas Silent Reading Test: https://caveon.com/resource/the-history-evolution-and-future-of-multiple-choice-tests/ • Princeton OTA — "Lessons From the Past: A History of Educational Testing" (1992): https://www.princeton.edu/~ota/disk1/1992/9236/923606.PDF • PhysOrg / The Conversation — "The hidden bias in college admissions tests" (2025): https://phys.org/news/2025-06-hidden-bias-college-admissions-standardized.html • AcceptanceRate.com — "Why Test-Optional Didn't Fix Racial Disparities" (2026): https://www.acceptancerate.com/article/sat-act-test-optional-racial-disparities/ • Seoul Economic Daily — "Korea Private Education Spending Surges 60%" (Jan 2026): https://en.sedaily.com/society/2026/01/05/korea-private-education-spending-surges-60-percent-in • Seoul Economic Daily — "South Korea's Private Tutoring Spending Falls 5.7%" (Mar 2026): https://en.sedaily.com/society/2026/03/12/south-koreas-private-tutoring-spending-falls-57-percent-to • Oppi Schools — "Finland's PISA Rankings Explained": https://oppischools.fi/learn/finnish-pisa-rankings-explained.html • SCMP — "How China imperial exam leaves historical footprint": https://www.scmp.com/news/people-culture/trending-china/article/3356050/how-china-imperial-exam-leaves-historical-footprint-and-impact-gaokao-modern-education • Harvard Law & Policy Review — "Exploring the Root Causes of Atlanta Public Schools' Cheating Scandal" (2011): https://journals.law.harvard.edu/lpr/2011/08/01/exploring-the-root-causes-of-atlanta-public-schools-cheating-scandal/ • ABC News — "Atlanta Cheating: 178 Teachers and Administrators Changed Answers" (2011): https://abcnews.com/US/atlanta-cheating-178-teachers-administrators-changed-answers-increase/story?id=14013113 • …and 2 more in the episode research notes This podcast episode was fully generated by AI — research, script, voices, and production. Built with Claude, Piper TTS, and automated pipeline tooling.