Published: Apr 3, 2025
Academic article
  • Academic article

Belief updating in AI-risk debates: Exploring the limits of adversarial collaboration

Belief updating in AI-risk debates: Exploring the limits of adversarial collaboration
In this scientific paper, we examined how subject-matter experts and expert forecasters with opposing views on existential risk posed by AI updated their positions after taking part in exercises designed to encourage perspective-taking and argument exchange.
Josh Rosenberg*, Ezra Karger†,*, Zach Jacobs*, Molly Hickman*, Avital Morris*, Harrison Durland*, Otto Kuusela*, Philip E. Tetlock‡,* ,
* Forecasting Research Institute
† Federal Reserve Bank of Chicago
‡ Wharton School of the University of Pennsylvania
Corresponding author: Ezra Karger. Contact: karger@uchicago.edu
Published: Apr 3, 2025
Josh Rosenberg*, Ezra Karger†,*, Zach Jacobs*, Molly Hickman*, Avital Morris*, Harrison Durland*, Otto Kuusela*, Philip E. Tetlock‡,*

Abstract

We organized adversarial collaborations between subject-matter experts and expert forecasters with opposing views on whether recent advances in Artificial Intelligence (AI) pose an existential threat to humanity in the 21st century. Two studies incentivized participants to engage in respectful perspective-taking, to share their strongest arguments, and to propose early-warning indicator questions (cruxes) for the probability of an AI-related catastrophe by 2100. AI experts saw greater threats from AI than did expert forecasters, and neither group changed its long-term risk estimates, but they did preregister cruxes whose resolution by 2030 would sway their views on long-term risk. These persistent differences shrank as questioning moved across centuries, from 2100 to 2500 and beyond, by which time both groups put the risk of extreme negative outcomes from AI at 30%–40%. Future research should address the generalizability of these results beyond our sample to alternative samples of experts, and beyond the topic area of AI to other questions and time frames.

* Forecasting Research Institute
† Federal Reserve Bank of Chicago
‡ Wharton School of the University of Pennsylvania
Corresponding author: Ezra Karger. Contact: karger@uchicago.edu
    Related Research
    Editorial
    AI Needs Fewer Prophets and More Predictions
    Dec 12, 2025
    Working paper
    Forecasting LLM-enabled Biorisk and the Efficacy of Safeguards
    Jul 1, 2025
    Project
    The Longitudinal Expert AI Panel (LEAP)
    Ongoing
    Academic article
    Subjective-probability forecasts of existential risk: Initial results from a hybrid persuasion-forecasting tournament
    Jan 17, 2025