o1 Pro Mode – ChatGPT Pro Full Analysis (plus o1 paper highlights)

Oh boy. o1 pro mode out on the same night as o1 full. I read the 49 page paper, ran my own tests, spent my fuel allowance on Pro Mode and will give you all the highlights. Suffice to say the story is not as simple as it first appears. Weights and Biases’ Weave: wandb.me/ai_explainedPlus, GPT-4.5? MLE Bench, Simple Update, Image Analysis and much more AI Insiders: https://www.patreon.com/AIExplainedo1 System Card: https://cdn.openai.com/o1-system-card-20241205.pdfApollo Research: https://www.apolloresearch.ai/research/scheming-reasoning-evaluationsAltman Tweet: https://x.com/AnonCEOMakeItAi/status/1864763052622504344ChatGPT Pro: https://openai.com/index/introducing-chatgpt-pro/Tibor Blaho: https://x.com/btibor91/status/1864709670470066605Simple-bench.com Chapters:00:00 - Introduction00:27 - ChatGPT Pro is $20001:25 - OpenAI Benchmarks03:20 - o1 System Card, o1 and o1 Pro Mode vs o1-preview06:18 - Simple Bench surprising results on sample08:31 - Weight & Biases09:05 - Image Analysis Compared12:51 - More Benchmarks and SafetyThe 8 Most Controversial Terms in AI: https://imp.i384100.net/m57g3MNon-hype Newsletter: https://signaltonoise.beehiiv.com/Podcast: https://aiexplainedopodcast.buzzsprout.com/I use Descript to edit my videos: https://get.descript.com/ldgxfuj2bhnbMany people expense AI Insiders for work. Feel free to use the Template in the 'About Section' of my Patreon. https://www.patreon.com/AIExplained Learn more about your ad choices. Visit megaphone.fm/adchoices