Vitalik Buterin Warns AIs Biggest Risk Is Not What Most People Think

Vitalik Buterin says AIs main risk is lost human control and supports clear triggers for possible development limits.

Ethereum co-founder Vitalik Buterin has addressed the growing dispute over advanced artificial intelligence. His concerns go beyond job losses, misinformation, and changes across global markets.

Instead, Buterin focused on the possible loss of human control over powerful machines. That risk could grow if AI systems become better than people at nearly every task.

The debate includes supporters of strict limits and critics who favor open development. However, both groups rely on very different forecasts about future AI progress.

Buterin remains uncertain about which forecast will prove correct. Therefore, he supports measures that could remain useful under several possible outcomes.

Superintelligence Could Weaken Human Control

The AI 2040 plan assumes superintelligence could emerge before the end of that decade. Avoiding that outcome may require cooperation between governments, researchers, and major technology companies. Supporters believe early action could reduce risks before advanced systems become difficult to control.

One thing I find striking in the discourse between AI 2040 and its detractors is that the two seem to be locked in to totally incompatible worldviews of how fast and how much of a big deal AI progress is:

* In AI 2040, every scenario sees superintelligence of some kind emerging…

However, critics argue that broad controls could reduce freedom and weaken open-source AI development. They also fear large companies could use strict rules against smaller rivals. Those concerns appear reasonable when AI develops slowly and remains similar to other technologies.

Buterin said the calculation changes if machines outperform humans across science, security, business, and government. People could then lose control over systems that shape economies and public life. Meanwhile, companies operating advanced AI could gain unusual political and financial power.

Defensive Technology May Provide Common Ground

Buterin has supported defensive acceleration, which is often known as d/acc. The approach promotes tools that protect people without creating wider central control. It also aims to make communities stronger against digital, biological, and physical threats.

Key areas include cryptography, secure hardware, software checks, pandemic protection, and reliable food supplies. The platform also supports tools that improve access to trusted public information. These projects could remain useful whether advanced AI arrives quickly or slowly.

Buterin has also welcomed the AI 2040 plans support for open-source technology. Open access can reduce dependence on a small group of companies or governments. However, safety rules would still need clear limits, public review, and fair enforcement.

Read also: Ethereum Holders Are Under Historic Stress – Is a Major Rebound Next？

Clear Warning Signs Could Guide AI Limits

Buterin proposed setting agreed warning signs before stronger limits become necessary. Possible triggers include mass unemployment, AI-linked pandemics, or wider use of autonomous weapons. Governments and researchers could approve these conditions before a serious crisis begins.