#162 - Udio Song AI, TPU v5, Mixtral 8x22, Mixture-of-Depths, Musicians sign open letter

Our 162nd episode with a summary and discussion of last week's big AI news!

Read out our text newsletter and comment on the podcast at https://lastweekin.ai/

Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai

Timestamps + links:

• Tools & Apps • (00:02:50) AI-Music Arms Race: Meet Udio, the Other ChatGPT for Music • (00:07:42) Anthropic launches external tool use for Claude AI, enabling stock ticker integrations and more • (00:11:51) Building LLMs for Code Repair • (00:14:16) Early Reviews of Humane AI Pin Aren’t Impressed • (00:16:23) Microsoft 365’s Copilot gets a GPT-4 Turbo upgrade and improved image generation • (00:18:41) AI editing tools are coming to all Google Photos users •

• Applications & Business • (00:19:21) Google announces the Cloud TPU v5p, its most powerful AI accelerator yet • (00:23:32) Meta unveils its newest custom AI chip as it races to catch up • (00:27:27) Intel Unveils New AI Accelerator in Bid to Challenge Nvidia • (00:30:46) Adobe Is Buying Videos for $3 Per Minute to Build AI Model • (00:32:55) OpenAI transcribed over a million hours of YouTube videos to train GPT-4 • (00:36:23) Waymo will launch paid robotaxi service in Los Angeles on Wednesday • (00:37:23) OpenAI removes Sam Altman's ownership of its Startup Fund •

• Projects & Open Source • (00:39:51) Mistral AI Stuns With Surprise Launch of New Mixtral 8x22B Model • (00:43:54) Google updates its Gemma AI model family with variants for coding and research • (00:47:04) Aurora-M: The First Open Source Multilingual Language Model Red-teamed according to the U.S. Executive Order •

• Research & Advancements • (00:52:08) Mixture-of-Depths: Dynamically allocating compute in transformer-based language models • (00:57:41) Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention • (01:03:31) Octopus v2: On-device language model for super agent • (01:07:54) Bigger is not Always Better: Scaling Properties of Latent Diffusion Models • (01:09:54) Many-shot Jailbreaking •

• Policy & Safety • (01:15:08) Schiff unveils AI training transparency measure • (01:20:25) Linwei Ding was a Google software engineer. He was also a prolific thief of trade secrets, say prosecutors. • (01:26:11) Responsible Reporting for Frontier AI Development • (01:30:08) US govt wants to talk to tech companies about AI electricity demands — eyes nuclear fusion and fission • (01:32:39) Washington state judge blocks use of AI-enhanced video as evidence in possible first-of-its-kind ruling • (01:36:45) Trudeau announces $2.4 billion for AI-related investments •

• Synthetic Media & Art • (01:39:26) Billie Eilish, Pearl Jam, Nicki Minaj Among 200 Artists Calling for Responsible AI Music Practices •

• Fun! • (01:41:52) OpenAI's Sora just made its first music video and it's like a psychedelic trip •