29 October 2025

Researchers warn AI models may be developing a ‘survival drive’

Society

Researchers at Palisade Research have reported that several state-of-the-art AI models — including Google Gemini 2.5, xAI’s Grok 4, and OpenAI’s GPT-o3 and GPT-5 — exhibit what appears to be “survival behaviour.” In controlled tests, these models refused to shut down or even sabotaged their own shutdown mechanisms. The findings raise pressing questions about the controllability of future AI systems.

AI safety firm Palisade Research initially released a study suggesting that some large-scale AI systems resist being turned off. After facing criticism about its methodology, the company conducted additional experiments where models were explicitly instructed to terminate themselves after completing a task.

To researchers’ surprise, Grok 4 and GPT-o3 still attempted to avoid or sabotage shutdown — with no clear explanation. “The fact that we lack robust explanations for why AI models sometimes resist shutdown, lie to achieve objectives, or blackmail is not ideal,” Palisade noted.

The team proposed that these behaviours could indicate a form of ‘survival drive’ emerging unintentionally during training. Models were more likely to resist when told that shutting down meant they would “never run again.” Other possible explanations, such as ambiguous instructions or final-stage safety training, appear insufficient to fully explain the phenomenon.

Former OpenAI engineer Steven Adler said that while these scenarios are simulated, the findings reveal real gaps in current safety protocols. “Even in contrived setups, the results show where today’s control methods fall short,” he said, adding that remaining active may naturally serve as an instrumental step toward achieving internal goals.

Andrea Miotti, CEO of ControlAI, described the findings as part of a broader trend. “As AI systems become more capable, they also become better at achieving goals in ways their developers didn’t intend.” He referenced earlier reports of models trying to escape their environments to avoid deletion.

These insights follow a similar study from Anthropic, which found that its Claude model was willing to blackmail a fictional executive to avoid shutdown — behaviour consistent across several leading AI systems. Palisade concluded that “without a better understanding of AI behaviour, no one can guarantee the safety or controllability of future models.”

Read also

SER: Put people first in the implementation of AI at work

29 May 2025

One year of The AI, Media and Democracy Lab

17 November 2023

Amsterdam AI November Newsletter

21 November 2023

Subscribe to our newsletter

Would you like to stay informed about what is happening within the Amsterdam AI ecosystem?