
Goodfire technical staff member Curt Tigges discusses research revealing that individual MLP neurons in modern language models are far more interpretable and functionally bounded than previously thought. Using an automated agent to test hypotheses across architectures like Qwen3.6-35B-A3B, Tigges explains how modern gated MLPs act as legible conjunctions and control signals capable of extensive dynamic sparsity without lasting benchmark loss. By showing that many internal representations can be directly enumerated, this work offers an alternative to complex external featurizers and provides practical avenues for behavior monitoring and persona steering. For full show notes, links, and references, read the episode page:https://www.cognitiverevolution.ai/the-neuron-basis-goodfire-s-curt-tigges-on-agentic-interp-monosemanticity-reverse-engineering/ Sponsors: Claude: Claude is the AI collaborator built for problem solvers, extending your thinking across coding, modeling, and strategic workflows. Get started and discover Claude Pro at https://claude.ai/tcr OutSystems: OutSystems is the leading agentic systems platform that enables enterprises to engineer, orchestrate, and govern AI applications on a single unified platform. Learn more and see how it works at https://outsystems.com/tcr Tasklet: Tasklet empowers your business with AI agents that connect to your tools and automate recurring workflows with no code required. Visit https://tasklet.ai and use code cog rev for $50 in free credits CHAPTERS: (00:00) About the Episode (05:55) Rethinking individual neuron interpretability (12:25) Understanding gated MLPs (22:57) Sparsity and ablation experiments (Part 1) (23:03) Sponsors: Claude | OutSystems (26:20) Sparsity and ablation experiments (Part 2) (Part 1) (39:07) Sponsor: Tasklet (40:44) Sparsity and ablation experiments (Part 2) (Part 2) (41:30) The neuron scientist agent (55:10) Monosemanticity versus circuit mechanics (01:09:37) Reverse engineering for alignment (01:20:24) Factual recall and experts (01:28:41) Designing interpretable architectures (01:36:16) Restoring reasoning performance (01:45:43) Future directions and wrap-up (01:51:34) Episode Outro (01:54:15) Outro PRODUCED BY: https://aipodcast.ing SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
Podzilla Summary coming soon
Sign up to get notified when the full AI-powered summary is ready.
Free forever for up to 3 podcasts. No credit card required.

Spend the Lead on Safety: Biden AI Advisors Ben Buchanan & Tantum Collins on the Fate of the World

AI, the Modern Enigma: Nathan's Keynote at IT Revolution's Enterprise AI Summit at Bletchley Park

Agents That Think Together: Cisco's Vijoy Pandey on Semantic Alignment, Scope, Accord & Concord

AI:AM: Is THIS the AI We Want? Alarming Acceleration, AI Election Bets, GPU Trading & AI-Native VC
Free AI-powered recaps of "The Cognitive Revolution" and your other favorite podcasts, delivered to your inbox.
Free forever for up to 3 podcasts. No credit card required.