Humanity isn't ready for the coming intelligence explosion

While the acceptable risk of a nuclear meltdown is one in a million, AI experts estimate the risk of an AI-caused catastrophe at 10-50%, a warning voiced by the founders of major AI labs themselves.

Humanity isn’t ready for the coming intelligence explosion

We must find a way to steward AI, then to live side by side with it, writes Will Marshall

SOCIETY DICTATES that the acceptable risk of catastrophic meltdown for a nuclear power plant is roughly one in a million. Experts in artificial intelligence estimate the risk of an AI-caused catastrophic event at 10-50%. Strikingly, this concern is being openly voiced by the very people who have the strongest incentives to project confidence rather than alarm: the founders of the largest AI laboratories.

Source: Hacker News

More in this category

dev-tools

I Could've Rickrolled the FIFA World Cup. All I Needed Was My ID

A security researcher discovered a critical vulnerability in FIFA's systems that allowed anyone with a registered agent account to access live World Cup streaming controls, match statistics, and commentator dashboards.

dev-tools

John Carmack on Fabrice Bellard

Legendary game developer John Carmack expresses his deep admiration for Fabrice Bellard, the quiet French engineer behind the core software powering the modern internet.

dev-tools

The time the x86 emulator team found code so bad they fixed it during emulation

An emulator developer shares a story from the days of Windows x86-32 emulation, where a compiler's terrible loop unrolling forced the emulator team to write a custom optimizer to fix the code on the fly.

dev-tools

A backdoor in a LinkedIn job offer

A developer shares how a seemingly innocent job offer on LinkedIn led to a malicious GitHub repository designed to execute arbitrary code via a fake test suite during 'npm install'.

dev-tools

Iroh 1.0

After more than four years of open development, the Iroh networking protocol has officially released version 1.0, establishing a stable foundation for key-based internet connectivity.

dev-tools

Hetzner Price Adjustment

Hetzner has announced a major price adjustment for its dedicated servers and cloud instances starting June 15, 2026. The changes will affect new orders, cloud rescales, and include limited-edition hardware offerings.

EXPLORE TOPICS