What's your P(doom)?
retained text
I've been thinking a lot about the future ahead. Is utopia coming, or catastrophe? I think the probability of doom (in the next 10 years) depends on four assumptions, each conditional on the previous: 1. RSI will happen 2. RSI creates ASI 3. ASI is impossible to align 4. ASI is impossible to control 5. Doom. Here's my guesses on the probability of each. Please note: these are just *guesses*! Don't take it too seriously. And discuss below if you think otherwise. 1. **RSI** = **80% chance**. OpenAI already claims it's underway. 2. **ASI** = **40% chance**. Might not be possible for many reasons: wrong architecture, limited compute, an intelligence ceiling, etc. 3. **ASI impossible to align** = **95% chance**. ASI means smarter than humans. So how can we understand how to align it? 4. **ASI impossible to control** = **55% chance**. We can control misaligned ASI by shutting off its power, or bombing all the data centers if really needed. So we can always control it somehow. Maybe. My P(doom) = 0.80 × 0.40 × 0.95 × 0.55 = 0.1672 What's yours?
document fetched 2026-10-21 00:20 · canonical https://reddit.com/r/ChatGPT/comments/1xaf7oa/whats_your_pdoom