Microsoft Promises a 'Whale' for GPT-5, Anthropic Delves Inside a Model’s Mind and Altman Stumbles

Microsoft promise ‘whale-size’ compute for a GPT-5-tier model, and say the end is not in sight for scaling the power of AI. Google ship models and a fascinating paper, while Anthropic unveil the inner workings of large language models. Meanwhile Sam Altman is forced to repeatedly apologize, Ilya Sutskever leaves, and GPT-4o is pushed back. My reflections on all of the above, and details you may have missed from each paper.

AI Insiders:   / aiexplained  

Kevin Scott Talk:    • Microsoft Build 2024: Day 1 #MSBuild  
Mark Chen Hint: https://x.com/GaryMarcus/status/17901...
Noam Comments:   / 1676971506969219072  
Anthropic Scaling Monosemanticity: https://transformer-circuits.pub/2024...
https://www.anthropic.com/news/mappin...
Ilya Leaves:   / 1790517455628198322  
Then Jan Leike: https://x.com/janleike/status/1791498...
And Logan Hints: https://x.com/OfficialLoganK/status/1...
Altman Apologizes: https://x.com/sama/status/17919368575...
https://www.forbes.com/sites/antoniop...
And Her Delayed: https://help.openai.com/en/articles/8...
Superalignment Starved: https://fortune.com/2024/05/21/openai...
https://openai.com/index/introducing-...
Gemini Updated Paper: https://storage.googleapis.com/deepmi...
And Prizes: https://x.com/JeffDean/status/1793026...
Google AI Studio: https://ai.google.dev/aistudio

Business GenAI Consulting: https://theinsiders.ai

Non-hype Newsletter: https://signaltonoise.beehiiv.com/

AI Insiders:   / aiexplained