AI Explained

Udio, the Mysterious GPT Update, and Infinite Attention

November 6, 2026·19 min
Episode Description from the Publisher

It’s been a strange 48 hours in the world of AI, with the ‘ChatGPT moment for Music’ from Udio, that has reminded millions of what AI is capable of, and papers from Google that show that models can give infinite attention to text but we also got befuddling updates from OpenAI that suggest that not all is smooth sailing. We’ll begin with the quirky new tool on Udio.com and how musicians are reacting to it, then cover the strange manner of the release of GPT-4-Turbo with Vision and quickly touch on Mixtral 8 x 22b and Command R+ before turning to a fascinating new ‘Infinite Context’ paper from Google. One of the authors worked on Gemini, but that may or may not be relevant…https://www.assemblyai.com/?utm_source=youtube&utm_medium=social&utm_campaign=universal1_philipAI Insiders: https://www.patreon.com/AIExplainedUdio Intro: https://www.udio.com/https://twitter.com/udiomusic/status/1778045322654003448‘The Site Is ****ing Down’ https://twitter.com/udiomusic/status/1778093021378089240Musicians React: https://www.reddit.com/r/Music/comments/1c0mjkg/udio_ai_music_generation_is_scary/Investors: https://www.udio.com/about-usWill.i.am: https://twitter.com/iamwill?lang=enhttps://suno.com/Mixtral 8 x 22B and Command R+ Benchmarked: https://huggingface.co/mistral-community/Mixtral-8x22B-v0.1/discussions/4?s=09LIveCodeBench Leaderboard: https://livecodebench.github.io/leaderboard.htmlMajorly Improved: https://twitter.com/OpenAI/status/1777772582680301665 MATH Benchmark: https://twitter.com/GanjinZero/status/1777926220132626753Function-calling Usable with Vision: https://twitter.com/OpenAIDevs/status/1777769463258988634GPT-4 Turbo Vision Benchmarked on GPQA: https://twitter.com/EpochAIResearch/status/1778463039932584205Hassabis Chafes: https://www.theinformation.com/articles/googles-demis-hassabis-chafes-under-new-ai-push?rc=sy0ihqRobot Football Simulation Paper: https://www.science.org/doi/10.1126/scirobotics.adi8022Video: https://www.youtube.com/watch?v=dOBfnOMuTz4Udio Origin Story: https://www.theinformation.com/articles/more-google-deepmind-staff-depart-to-launch-an-ai-startup?rc=sy0ihqLeave No Context Behind: https://arxiv.org/pdf/2404.07143.pdfManaal Faruqui: https://scholar.google.co.uk/citations?view_op=view_citation&hl=en&user=W-CxZCgAAAAJ&sortby=pubdate&citation_for_view=W-CxZCgAAAAJ:PoWvk5oyLR8CGemini 1.5: https://storage.googleapis.com/deepmind-media/gemini/gemini_v1_5_report.pdfLlama 3 Coming: https://www.theinformation.com/articles/meta-platforms-to-launch-small-versions-of-llama-3-next-week?rc=sy0ihqAI Insiders: https://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices

Podzilla Summary coming soon

Sign up to get notified when the full AI-powered summary is ready.

Get Free Summaries →

Free forever for up to 3 podcasts. No credit card required.

Listen to This Episode

Get summaries like this every morning.

Free AI-powered recaps of AI Explained and your other favorite podcasts, delivered to your inbox.

Get Free Summaries →

Free forever for up to 3 podcasts. No credit card required.