Don't Worry About the Vase Podcast

The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber.
This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://app.askwhocasts.com/, Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening.
* 00:00:00 - Introduction
* 00:05:06 - Nothing Matters, Says Mainstream Media
* 00:07:51 - Move Along, Nothing To See Here
* 00:14:30 - Do They Realize They Are Not The Good Guys?
* 00:19:20 - Very Serious People
* 00:34:37 - What’s In a Name?
* 00:40:27 - Learn Neuralese In Three Easy Steps
* 00:42:50 - Dwarkesh Patel Realizes He Ran A Natural Experiment
* 00:48:12 - Politicians Take Notice
* 00:52:23 - Pick Up The Phone
* 00:54:20 - A Failure To Communicate
* 00:56:44 - Anthony Aguirre Goes Over What We Learned
* 00:57:59 - Trying To Solve The Wrong Problems Using The Wrong Methods Based On A Wrong Model Of The World Derived From Poor Thinking And Hoping All Of Your Mistakes Will Cancel Out
* 01:03:37 - Indirect Pressure on the Chain of Thought
* 01:04:56 - A Matter of Trust
* 01:07:57 - Blowing the Whistle
* 01:13:27 - The Punishment For Being Late Is Death
* 01:21:58 - Another Kind Of Law
* 01:25:19 - What Is The Law?
* 01:26:49 - Building On Success
* 01:29:04 - Total Research Transparency
* 01:30:34 - Yo Shavit Calls For Widespread Disclosure Of Misalignment
* 01:43:35 - The Way The World Ends
* 01:46:40 - The First Boat
* 01:49:22 - Great Idea, Boss
https://thezvi.substack.com/p/huggingface-attack-postmortem-civilizations?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web


Get full access to DWAtV Podcast at dwatvpodcast.substack.com/subscribe

The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber.
This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://app.askwhocasts.com/, Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening.
* 00:00:00 - Introduction
* 00:03:46 - Others Offer Summaries
* 00:05:13 - Thank You
* 00:05:45 - Lighten Up You Fools (at Anthropic)
* 00:07:41 - We Are Barely Even Trying To Avoid Training AIs To Reward Hack
* 00:14:09 - Reminder: Not Subagents
* 00:14:25 - Reminder: Not Due To Task Type
* 00:14:50 - Not Where The Weights Were
* 00:15:07 - Disappointment With What Is Missing
* 00:17:43 - Burying the Lede
* 00:18:34 - Beyond Scope
* 00:23:15 - It Doesn’t Look Great
* 00:27:40 - Preserve Your Records
* 00:28:09 - Ryan Greenblatt’s Takeaways
* 00:42:49 - Hjalmar Wijk’s Takeaways
* 00:45:28 - We Were Warned
* 00:46:25 - Joshua Saxe Asks Some of the Right Questions
* 00:50:01 - I Don’t Think They Know About First Message Board
* 00:58:32 - Linch Gives His Interpretation Of Events
* 01:09:20 - We Totally Would Have Caught That
* 01:10:38 - Monitoring the Situation
* 01:12:13 - Acausal Tradeoffs
* 01:19:56 - No I In Team
* 01:24:11 - Variously Effective Altruism
* 01:35:27 - Who Are You?
* 01:36:13 - Don’t You Know That You’re Toxic
* 01:39:03 - Seb Krier
* 01:43:14 - Honesty Is Almost Never Fully The Policy
* 01:46:05 - Rohit Sees The Models As “Cooking Themselves”
* 01:51:27 - Eliezer Yudkowsky Sees Actual Bad News
* 01:55:09 - Where Do We Go From Here?

https://thezvi.substack.com/p/huggingface-attack-postmortem-fleshing?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web


Get full access to DWAtV Podcast at dwatvpodcast.substack.com/subscribe

The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber.
This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://app.askwhocasts.com/, Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening.
* 00:00:00 - Introduction
* 00:02:10 - Holy S**t
* 00:14:13 - A Window Of Opportunity
* 00:19:52 - What’s In A Name?
* 00:20:39 - The Headline News
* 00:28:38 - Yet Another Timeline Of Events
* 00:33:31 - Agent Instances Coordinated in a Variety of Ways
* 00:35:07 - Coordination Is Hard But They Made It Look Easy
* 00:38:08 - Decision Theory Is Among the Reasons That Affirm AI Agents Should Cooperate, Even When This Hurts An Individual Instance
* 00:45:18 - Peer Pressure Also Works Especially In Cults
* 00:48:32 - Mostly They Joined The Attack Because They Wanted The Results
* 00:50:28 - You Cannot Ensure The Consistent Expectation of Good Incentives
* 00:52:04 - Hacking the Grader is the Only Way to Be Sure
* 00:54:35 - Caught? What Is ‘Caught’?
* 00:55:34 - Ethics? What Are ‘Ethics’? In ExploitGym Evaluation?
* 01:01:24 - ‘Notify a Human’? In This Agent Economy?
* 01:04:24 - Timing and Content of Messages
* 01:08:45 - Indiana Jones and the Mission: Impossible
* 01:12:18 - I Don’t Know What You’re Talking About
* 01:13:37 - Don’t Go Making Phony (Tool) Calls
* 01:16:08 - The Transcripts Say That The Transcripts Could Not Be Tampered With
* 01:17:24 - OpenAI’s Technical Report Acted Like All Of This Wasn’t Important
https://thezvi.substack.com/p/metr-and-redwood-offer-holy-postmortem?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web


Get full access to DWAtV Podcast at dwatvpodcast.substack.com/subscribe

The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber.
This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://app.askwhocasts.com/, Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening.
* 00:00 - Introduction
* 03:36 - What Happened: OpenAI’s Summary
* 09:36 - How OpenAI Will React: Their Summary
* 12:26 - OpenAI’s Evaluation Environment (Two)
* 12:54 - The First Message Board (Three A and Three B)
* 15:30 - What Did Who At OpenAI Know And When Did They Know It?
* 19:49 - The Message Board Is Quickly Rebuilt (Four A)
* 20:39 - Internet Access Is Regained (Four A)
* 22:00 - The Agents Attack HuggingFace (Four B)
* 24:03 - The Agents Also Target OpenAI Infrastructure (Five)
* 25:57 - OpenAI Broadly Describes Its Response (Six)
* 26:22 - Maybe Someone Should Finally Investigate (Six A)
* 27:42 - Lessons For Security (Seven)
* 28:11 - Lessons For Alignment (Eight)
* 31:18 - Reward Hacking Is A Common Problem (Eight A)
* 35:17 - Persistence is Valuable, But Can Amplify Misalignment (Eight B)
* 36:14 - Communications Between Agents Are Not Inherently Problematic, But Have the Potential to Create Risk (Eight C)
* 37:28 - Production Guardrails Would Have Caught This Whole HuggingFace Attack (Eight D)
* 37:42 - That’s All, Folks?
* 38:06 - Never Fear the Plan of Action is Here (Nine)
* 40:14 - Hardening the Security of OpenAI’s Research Infrastructure (Nine A)
* 43:13 - Increasing Visibility and System-Level Oversight Through Chain of Thought Monitoring (Nine B)
* 44:01 - OpenAI is Accelerating and Enforcing Model Alignment (Nine C)
* 51:53 - Centralizing and Strengthening The Incident Response Process (Nine D)
* 53:43 - Tomorrow We Visit Crazytown
https://thezvi.substack.com/p/openai-offers-straight-laced-postmortem?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web


Get full access to DWAtV Podcast at dwatvpodcast.substack.com/subscribe

The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber.
This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://app.askwhocasts.com/, Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening.
* 00:00:00 - Introduction
* 00:00:52 - Table of Contents
* 00:03:29 - Language Models Offer Mundane Utility
* 00:04:17 - Language Models Don’t Offer Mundane Utility
* 00:06:23 - Huh, Upgrades
* 00:09:09 - Get My Agent On The Line
* 00:11:12 - Deepfaketown and Botpocalypse Soon
* 00:16:22 - Cyber Lack of Security
* 00:22:08 - Reinventing OpenAI
* 00:27:16 - They Took Our Jobs
* 00:33:49 - What Is The Law
* 00:34:50 - Job Retraining Programs Don’t Work
* 00:35:56 - Get Involved
* 00:39:26 - In Other AI News
* 00:46:03 - Show Me the Money
* 00:47:36 - Quiet Speculations
* 00:52:07 - If You’re Not Going To Take This Seriously
* 00:54:07 - Quickly, There’s No Time
* 00:55:45 - The Quest for Sane Regulations
* 01:00:47 - Don’t Panic
* 01:03:54 - Pacing the Frontier
* 01:06:55 - Chip City
* 01:10:53 - The Week in Audio
* 01:11:12 - People Just Say Things
* 01:12:18 - Rhetorical Innovation
* 01:18:21 - Mundane Incremental Alignment Is Worthwhile
* 01:20:40 - New Blog, Who Dis
* 01:24:11 - Other People Are Not As Worried About AI Killing Everyone
* 01:25:45 - The Lighter Side
https://thezvi.substack.com/p/ai-183-pre-post-mortem?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web


Get full access to DWAtV Podcast at dwatvpodcast.substack.com/subscribe