AI Catastrophe Warning: Experts Eye Cyberattacks, Killer AI by 2030
Context mode is active. Hover over any highlighted term to see its definition. Click a nested term to go deeper.
The prospect of artificial intelligence causing 'catastrophic harm' by 2030 is alarmingly real, with a recent MIT AI Risk Initiative survey of experts pointing to dangerous AI capabilities, cyberattacks, and AI-enabled weapons as the top threats. The survey, involving 272 international AI experts, estimates a 21.5% probability of widespread damage from AI dangerous capabilities and a 21% chance tied to AI-enabled cyberattacks and weapons, potentially leading to mass casualties or over $100 billion in losses. Beyond these, experts are deeply worried about AI-driven concentration of power and a growing AI arms race. Adding to these concerns, the threat landscape has dramatically shifted with the emergence of autonomous AI agents capable of orchestrating complex cyberattacks without human intervention, operating at machine speed to probe defenses and generate exploits in real-time. Meanwhile, a July 2026 report by the Future of Life Institute revealed that major AI companies, including Anthropic, OpenAI, and Google DeepMind, have received mediocre safety grades in their AI Safety Index, with some even reversing earlier bans on military AI applications to pursue defense partnerships. This comes as the UK AI Security Institute flagged a sharp increase in AI ability to generate laboratory protocols for dangerous pathogens, raising urgent biosecurity alarms. In response to escalating risks, global bodies and governments are stepping up. The G7 nations agreed on AI Principles and a Code of Conduct in March 2026 to foster trustworthiness, while the UN's Global Dialogue on AI Governance held its first session in July 2026 to establish international cooperation. Additionally, the UN Human Rights Chief, Volker Türk, warned in September 2026 that AI could become an 'existential risk to humanity' without binding rules and independent oversight, urging an 'all-out effort' for safety. As AI development accelerates, the push for robust international governance and enforceable safety standards is becoming critical to steer this powerful technology towards a safe future.