{"id":2711,"date":"2026-11-10T16:44:22","date_gmt":"2026-11-10T16:44:22","guid":{"rendered":"https:\/\/forecastingresearch.org\/?post_type=research&#038;p=2711"},"modified":"2026-11-10T18:03:44","modified_gmt":"2026-11-10T18:03:44","slug":"recursive-self-improvement-v1","status":"publish","type":"research","link":"https:\/\/forecastingresearch.org\/research\/recursive-self-improvement-v1","title":{"rendered":"How Close is Recursive Self-Improvement? A Review of the Evidence"},"content":{"rendered":"\n<h2 id=\"summary\" class=\"wp-block-heading\">Summary<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">DATA CUTOFF: NOV 3, 2026<sup data-fn=\"798dc57a-0134-4e5d-b14e-69a0eb9094df\" class=\"fn\"><a href=\"#798dc57a-0134-4e5d-b14e-69a0eb9094df\" id=\"798dc57a-0134-4e5d-b14e-69a0eb9094df-link\">1<\/a><\/sup><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">AI companies increasingly state that their models may soon be capable of <em>recursive self-improvement<\/em> (RSI), which could dramatically accelerate AI capability progress. How close is RSI? We review the evidence, existing forecasts, and key disagreements, turn the disagreements into forecasting questions, and give initial forecasts from an ensemble of frontier large language models (LLMs). As of early Nov 2026, AI acts as a highly capable research assistant, but humans still supply most of the research judgment. AI capability progress has not clearly accelerated on public measures, although there is some internal evidence from AI companies indicating a potential acceleration. On a simple extrapolation of current trends, mostly using company-reported metrics, AI could take over most AI R&amp;D tasks by 2027\u20132028, in line with OpenAI\u2019s target of an automated AI researcher by Mar 2028. A key uncertainty is whether these trends continue as the remaining non-automated tasks increasingly require research judgment. To measure acceleration, we propose a forecasting question on the likelihood of a <em>fast year<\/em>: any 12 months in which the frontier of the Epoch Capabilities Index rises by 30 points or more, about twice its pace since Sep 2024. The LLM ensemble forecasts about a 40% chance of a fast year by 2030. If a fast year happens, the ensemble gives about a 70% chance that AI automation of AI R&amp;D caused it.<\/p>\n\n\n\n<h2 id=\"introduction\" class=\"wp-block-heading\">1. Introduction<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">How quickly will AI improve between now and 2030?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">There are three broad possibilities: AI progress could slow down, continue at its current pace, or accelerate. A particularly important scenario is <strong>acceleration because AI systems help build future AI systems<\/strong>. The International AI Safety Report 2026 (IASR) notes that \u201c<em>positive feedback loops \u2013 such as AI systems contributing to AI research \u2013 could accelerate progress<\/em>\u201d and \u201c<em>decades of progress could happen in years<\/em>\u201d (<a href=\"https:\/\/arxiv.org\/abs\/2602.21012\" target=\"_blank\" rel=\"noreferrer noopener\">IASR<\/a>, \u00a71.3). This positive feedback loop is often called <strong>recursive self-improvement (RSI)<\/strong> (<a href=\"https:\/\/www.lesswrong.com\/posts\/JBadX7rwdcRFzGuju\/recursive-self-improvement\" target=\"_blank\" rel=\"noreferrer noopener\">Yudkowsky, 2008<\/a>): AI systems automate AI R&amp;D and build better successor systems in a recursive loop (see Figure 1).<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\" id=\"fig-01\"><img loading=\"lazy\" decoding=\"async\" width=\"2560\" height=\"1297\" src=\"https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/paper_2026-10-12_recursive-self-improvement_fig-1.png\" alt=\"fig-01\" class=\"wp-image-2737\" srcset=\"https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/paper_2026-10-12_recursive-self-improvement_fig-1.png 2560w, https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/paper_2026-10-12_recursive-self-improvement_fig-1-350x177.png 350w, https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/paper_2026-10-12_recursive-self-improvement_fig-1-700x355.png 700w, https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/paper_2026-10-12_recursive-self-improvement_fig-1-768x389.png 768w, https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/paper_2026-10-12_recursive-self-improvement_fig-1-1536x778.png 1536w, https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/paper_2026-10-12_recursive-self-improvement_fig-1-2048x1038.png 2048w, https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/paper_2026-10-12_recursive-self-improvement_fig-1-2000x1013.png 2000w, https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/paper_2026-10-12_recursive-self-improvement_fig-1-1200x608.png 1200w, https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/paper_2026-10-12_recursive-self-improvement_fig-1-150x76.png 150w\" sizes=\"auto, (max-width: 2560px) 100vw, 2560px\" \/><figcaption class=\"wp-element-caption\"><strong>Figure 1:<\/strong> The RSI loop, in which each generation of AI systems helps develop the next.<\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">RSI could bring about large benefits as well as substantial risks. A Sep 2026 report by AI researchers including Geoffrey Hinton, Yoshua Bengio, OpenAI chief scientist Jakub Pachocki, and Anthropic cofounder Jack Clark argues that RSI could bring AI\u2019s benefits forward by years. However, RSI could also pose extreme risks, as humanity may fail to keep up with the growth in capabilities or lose oversight of advanced AI systems (<a href=\"https:\/\/www.governance.ai\/research-paper\/what-if-automating-ai-r-d-triggers-an-intelligence-explosion\" rel=\"noreferrer noopener\" target=\"_blank\">Chan et al., 2026<\/a>).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Recent reports review RSI with a focus on its risks and on policy responses (<a href=\"https:\/\/www.governance.ai\/research-paper\/what-if-automating-ai-r-d-triggers-an-intelligence-explosion\" target=\"_blank\" rel=\"noreferrer noopener\">Chan et al., 2026<\/a>; <a href=\"https:\/\/www.rand.org\/pubs\/perspectives\/PEA5068-1.html\" target=\"_blank\" rel=\"noreferrer noopener\">Sarma et al., 2026<\/a>). This review is complementary and forward-looking. <strong>We summarize the current evidence and the key disagreements, turn these disagreements into forecasting questions, and give an initial set of forecasts from an ensemble of frontier LLMs.<\/strong> Simultaneously, we are asking a group of top human forecasters and AI experts to make forecasts on RSI, using this document as background material. We plan to add their forecasts in a later update of this report.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>How to use this document:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"#defining-recursive-self-improvement\">Section 2<\/a> reviews how the labs and the literature define RSI and related terms. <strong><a href=\"#measuring-capability-progress\">Section 2.3<\/a> sets out our operationalization.<\/strong><\/li>\n\n\n\n<li><a href=\"#evidence\">Section 3<\/a> reviews the evidence. <strong><a href=\"#what-the-labs-report\">Section 3.1<\/a> summarizes what the AI labs report about AI R&amp;D inside the labs.<\/strong> <a href=\"#public-evidence\">Section 3.2<\/a> covers public evidence: AI R&amp;D benchmarks and an open-world evaluation. <a href=\"#qualitative-evidence\">Section 3.3<\/a> covers qualitative evidence from researcher interviews.<\/li>\n\n\n\n<li><strong><a href=\"#existing-projections-and-forecasts\">Section 4<\/a> collects existing projections and forecasts<\/strong>, including lab targets, trend extrapolation, prediction platforms, expert forecasts, and notable individual predictions.<\/li>\n\n\n\n<li><a href=\"#key-cruxes\">Section 5<\/a> sets out the key cruxes.<\/li>\n\n\n\n<li><strong><a href=\"#forecasting-questions\">Section 6<\/a> summarizes the forecasting questions we are asking a group of forecasters and provides initial LLM forecasts.<\/strong><\/li>\n\n\n\n<li><strong><a href=\"#takeaways\">Section 7<\/a> summarizes the main takeaways<\/strong>, and <a href=\"#further-reading\">Section 8<\/a> lists further reading. The <a href=\"#appendix\" data-type=\"internal\" data-id=\"#appendix\">Appendix<\/a> gives the full forecasting questions.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">If you are short of time, we recommend only reading the sections in <strong>bold<\/strong>.<\/p>\n\n\n\n<h2 id=\"defining-recursive-self-improvement\" class=\"wp-block-heading\">2. Defining recursive self-improvement<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Defining RSI and automated AI R&amp;D is challenging. RSI, in particular, \u201c<em>has been used in several ways, often inconsistently<\/em>\u201d (<a href=\"https:\/\/arxiv.org\/pdf\/2609.15802\" rel=\"noreferrer noopener\" target=\"_blank\">Cunningham et al., 2026<\/a>). We first review how the labs (<a href=\"#lab-definitions\">Section 2.1<\/a>) and the literature (<a href=\"#definitions-in-the-literature\">Section 2.2<\/a>) define these terms. <a href=\"#measuring-capability-progress\">Section 2.3<\/a> sets out our own operationalization.<\/p>\n\n\n\n<h3 id=\"lab-definitions\" class=\"wp-block-heading\">2.1 Lab definitions<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">OpenAI and Anthropic define RSI and automated AI R&amp;D in two ways: (i) AI that can substitute for their research staff (\u201csubstitution\u201d); or (ii) AI that substantially accelerates the pace of AI progress (\u201cacceleration\u201d). As of early Nov 2026, <strong>neither lab reports having crossed its threshold for automated AI R&amp;D<\/strong>.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><div class=\"table-wrapper\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>Test<\/strong><\/td><td><strong>OpenAI (<a href=\"https:\/\/cdn.openai.com\/pdf\/18a02b5d-6b67-4cec-ab64-68cdfbddebcd\/preparedness-framework-v2.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">Preparedness Framework v2<\/a>)<\/strong><\/td><td><strong>Anthropic (<a href=\"https:\/\/www-cdn.anthropic.com\/files\/4zrzovbb\/website\/0bacdc8440ea96e62a8766d99ebe1d4eea6d5f3a.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">Responsible Scaling Policy, RSP v3.4<\/a>)<\/strong><\/td><\/tr><tr><td><strong>Substitution<\/strong><\/td><td>Critical: \u201c<em>a superhuman research-scientist agent.<\/em>\u201d High: a \u201c<em>highly performant mid-career research engineer assistant, relative to those researchers\u2019 2024 baseline<\/em>\u201d<\/td><td>Models could \u201c<em>fully substitute for our entire set of Research Scientists and Research Engineers, at competitive costs<\/em>\u201d<\/td><\/tr><tr><td><strong>Acceleration<\/strong><\/td><td>Critical: \u201c<em>generational model improvement (e.g., from OpenAI o1 to OpenAI o3) in 1\/5th the wall-clock time of equivalent progress in 2024 [&#8230;] sustainably for several months<\/em>\u201d<\/td><td>Dramatic acceleration of capability progress, defined as \u201c<em>(a) [&#8230;] double the rate of progress in AI aggregate capabilities [&#8230;] and (b) [&#8230;] doubling is substantially attributable to the automation of research and\/or engineering [&#8230;]<\/em>\u201d<\/td><\/tr><tr><td><strong>Status<\/strong><\/td><td>GPT-6 Astra \u201c<em>does not reach our High threshold<\/em>\u201d (<a href=\"https:\/\/deploymentsafety.openai.com\/gpt-6-astra\/gpt-6-astra.pdf#page=75\" rel=\"noreferrer noopener\" target=\"_blank\">system card<\/a>); GPT-6.1 Terra also \u201c<em>does not reach our High threshold<\/em>\u201d (<a href=\"https:\/\/deploymentsafety.openai.com\/gpt-6-1-terra\/gpt-6-1-terra.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">addendum<\/a>, p. 33)<\/td><td>Risk \u201c<em>Low<\/em>\u201d; R&amp;D accelerated \u201c<em>but not yet by a factor of 2<\/em>\u201d (<a href=\"https:\/\/www-cdn.anthropic.com\/f61d49fa5596956a5dec75fea0e973bf6a6a8378\/Redacted%20Risk%20Report%20August%202026%20.pdf#page=103\" rel=\"noreferrer noopener\" target=\"_blank\">Aug 2026 Risk Report<\/a>)<\/td><\/tr><\/tbody><\/table><\/div><figcaption class=\"wp-element-caption\"><strong>Table 1:<\/strong> OpenAI and Anthropic tests for automated AI R&amp;D, and the status of each lab as of Nov 3, 2026.<\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">For other AI companies, <a href=\"https:\/\/metr.org\/common-elements.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">METR<\/a> provides a useful collection of automated AI R&amp;D definitions (pp. 19\u201321).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We note two key points:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The OpenAI and Anthropic definitions are similar but not identical. On acceleration, OpenAI\u2019s \u201cCritical\u201d level is a 5\u00d7 acceleration of capability progress, while Anthropic uses a lower 2\u00d7 threshold.<\/li>\n\n\n\n<li>The labs define and track these thresholds as part of their safety policies. As a result, reaching a particular threshold has direct consequences. For OpenAI, a model at the High level requires \u201c<em>security controls meeting High standard<\/em>\u201d; at the Critical level, the response is halting further development until \u201c<em>we have specified safeguards and security controls that would meet a Critical standard<\/em>\u201d (<a href=\"https:\/\/cdn.openai.com\/pdf\/18a02b5d-6b67-4cec-ab64-68cdfbddebcd\/preparedness-framework-v2.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">Preparedness Framework v2<\/a>, Table 1). For Anthropic, the 2025 policy required AI Safety Level 4 (ASL-4) safeguards for models that could dramatically accelerate AI progress (<a href=\"https:\/\/www-cdn.anthropic.com\/872c653b2d0501d6ab44cf87f43e1dc4853e4d37.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">RSP v2.2<\/a>, Section 4.3.1). Its 2026 policy no longer requires ASL-4 but its industry-wide recommendations for automated AI R&amp;D \u201c<em>would likely mean security roughly in line with RAND SL4<\/em>\u201d (<a href=\"https:\/\/www-cdn.anthropic.com\/files\/4zrzovbb\/website\/0bacdc8440ea96e62a8766d99ebe1d4eea6d5f3a.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">RSP v3.4<\/a>, p. 8), i.e., security that \u201c<em>can likely thwart most standard operations by leading cyber-capable institutions<\/em>\u201d (<a href=\"https:\/\/www.rand.org\/pubs\/research_reports\/RRA2849-1.html\" rel=\"noreferrer noopener\" target=\"_blank\">RAND<\/a>, p. 22).<\/li>\n<\/ul>\n\n\n\n<h3 id=\"definitions-in-the-literature\" class=\"wp-block-heading\">2.2 Definitions in the literature<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The basic idea of recursive self-improvement goes back to at least I. J. Good (<a href=\"https:\/\/doi.org\/10.1016\/S0065-2458%2808%2960418-0\" rel=\"noreferrer noopener\" target=\"_blank\">Good, 1965<\/a>). In 1965, Good described an <em>intelligence explosion<\/em> in which machines design better machines, famously stating that \u201c<em>the first ultraintelligent machine is the last invention that man need ever make<\/em>.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The table below defines the four main terms used in the literature, mostly based on the taxonomy developed by <a href=\"https:\/\/arxiv.org\/pdf\/2609.15802\" rel=\"noreferrer noopener\" target=\"_blank\">Cunningham et al. (2026)<\/a>.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><div class=\"table-wrapper\"><table class=\"has-fixed-layout\"><tbody><tr><td><p><strong>Term<\/strong><\/p><\/td><td><p><strong>Definition<\/strong><\/p><\/td><\/tr><tr><td><p><strong>Automated AI R&amp;D<\/strong><\/p><\/td><td><p>AI can \u201c<em>autonomously make technological improvements at least equivalent to those made by human researchers, at an equal cost<\/em>\u201d (<a href=\"https:\/\/arxiv.org\/pdf\/2609.15802\" rel=\"noreferrer noopener\" target=\"_blank\">Cunningham et al., 2026<\/a>, Table 1, \u201cR&amp;D automatability\u201d). The labs\u2019 substitution tests (<a href=\"#lab-definitions\">Section 2.1<\/a>) are versions of this definition.<\/p><\/td><\/tr><tr><td><p><strong>Recursive self-improvement (RSI)<\/strong><\/p><\/td><td><p>\u201c<em>an AI system capable of fully autonomously designing and developing its own successor<\/em>\u201d (<a href=\"https:\/\/www.anthropic.com\/institute\/recursive-self-improvement\" rel=\"noreferrer noopener\" target=\"_blank\">Favaro and Clark, 2026<\/a>).<\/p><\/td><\/tr><tr><td><p><strong>Self-sustaining acceleration<\/strong><\/p><\/td><td><p>\u201c<em>When AI systems are sufficient for accelerating progress in AI capabilities without any growth in exogenous inputs (human labor, training compute, etc.)<\/em>\u201d (<a href=\"https:\/\/arxiv.org\/pdf\/2609.15802\" rel=\"noreferrer noopener\" target=\"_blank\">Cunningham et al., 2026<\/a>, Table 1). A <em>software intelligence explosion<\/em> (SIE) is very similar: \u201c<em>AI-driven software improvements alone are sufficient for rapid and accelerating AI progress<\/em>\u201d (<a href=\"https:\/\/forethought.org\/research\/three-types-of-intelligence-explosion\" rel=\"noreferrer noopener\" target=\"_blank\">Davidson, Hadshar, and MacAskill, 2025<\/a>; see also <a href=\"https:\/\/www.forethought.org\/research\/will-ai-r-and-d-automation-cause-a-software-intelligence-explosion\" rel=\"noreferrer noopener\" target=\"_blank\">Eth and Davidson, 2025<\/a>).<\/p>\n<p>The acceleration can be <strong>narrow<\/strong> (e.g., confined to AI R&amp;D or easily verifiable tasks), or <strong>broad<\/strong> (i.e., spreading to capabilities in most other sciences and most economic activities). Relatedly, <a href=\"https:\/\/forethought.org\/research\/three-types-of-intelligence-explosion\" rel=\"noreferrer noopener\" target=\"_blank\">Davidson, Hadshar, and MacAskill (2025)<\/a> define a <em>full-stack intelligence explosion<\/em>, in which AI drives improvements \u201c<em>in all of software, chip technology and chip production.<\/em>\u201d<\/p><\/td><\/tr><tr><td><p><strong>Intelligence explosion<\/strong><\/p><\/td><td><p>\u201c<em>an ultraintelligent machine could design even better machines; there would then unquestionably be an \u2018intelligence explosion\u2019<\/em>\u201d (<a href=\"https:\/\/doi.org\/10.1016\/S0065-2458%2808%2960418-0\" rel=\"noreferrer noopener\" target=\"_blank\">Good, 1965<\/a>); \u201c<em>AI capabilities go to infinity in finite time<\/em>\u201d (<a href=\"https:\/\/arxiv.org\/pdf\/2609.15802\" rel=\"noreferrer noopener\" target=\"_blank\">Cunningham et al., 2026<\/a>, Table 1)<\/p><\/td><\/tr><\/tbody><\/table><\/div><figcaption class=\"wp-element-caption\"><strong>Table 2:<\/strong> Main terms in the RSI literature.<\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">We make a few observations:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Automated AI R&amp;D and RSI are similar, and people often use the two terms interchangeably. For example, OpenAI equates them in its <a href=\"https:\/\/cdn.openai.com\/pdf\/18a02b5d-6b67-4cec-ab64-68cdfbddebcd\/preparedness-framework-v2.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">Preparedness Framework<\/a> (Table 1). However, we think that automated AI R&amp;D is weaker than RSI, as defined above. In particular, automated AI R&amp;D can be <em>partial<\/em>: AI could do most but not all of the AI R&amp;D work.<\/li>\n\n\n\n<li>Informal discussions often conflate these terms. We note two distinctions:\n\n<ul class=\"wp-block-list\">\n<li>A weaker feedback loop does not necessarily imply a stronger feedback loop. For example, automated AI R&amp;D could arrive without accelerating capabilities if compute or other scarce inputs bottleneck progress <a href=\"https:\/\/arxiv.org\/pdf\/2609.15802\" rel=\"noreferrer noopener\" target=\"_blank\">(Cunningham et al., 2026)<\/a>. Conversely, full automation of AI R&amp;D is not necessary for acceleration. In some standard growth models, a singularity (infinite output in finite time) can occur without full AI R&amp;D automation (<a href=\"https:\/\/web.stanford.edu\/~chadj\/AJJ-AIandGrowth.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">Aghion, Jones, and Jones, 2019<\/a>, p. 256; <a href=\"https:\/\/web.stanford.edu\/~chadj\/explosivegrowthChatGPT5.2.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">Jones, 2026<\/a>).<\/li>\n\n\n\n<li><em>Fast<\/em> progress does not necessarily imply <em>broad<\/em> progress. As the diagram below illustrates, in principle, fast progress could stay narrow, and broad progress could be gradual. Whether a capability acceleration stays narrow or becomes broad is a key forecasting crux (<a href=\"#key-cruxes\">Section 5<\/a>).<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\" id=\"fig-02\"><img decoding=\"async\" src=\"https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/paper_2026-10-12_recursive-self-improvement_fig-02.png\" alt=\"Figure 2: Breadth vs. speed of capability progress.\"\/><figcaption class=\"wp-element-caption\"><strong>Figure 2:<\/strong> Breadth vs. speed of capability progress.<\/figcaption><\/figure>\n\n\n\n<h3 id=\"measuring-capability-progress\" class=\"wp-block-heading\">2.3 Measuring capability progress<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Ultimately, we are most interested in whether automated AI R&amp;D increases the pace of capability progress. To measure this pace, we use the <a href=\"https:\/\/epoch.ai\/eci?view=graph&amp;tab=release-date\" rel=\"noreferrer noopener\" target=\"_blank\">Epoch Capabilities Index<\/a> (ECI). We define capability acceleration as a <strong><em>fast year<\/em>: a rise of the ECI frontier by 30+ points within any 12-month window<\/strong> (about 2\u00d7 the pace since Sep 2024). Here, the ECI frontier is the highest ECI score of any publicly available model by a given date. A fast year need not take 12 months to observe: a fast-year question resolves Yes as soon as the ECI frontier has risen by the threshold within 12 months or less.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In our internal forecasting experiments, the fast year worked well as a forecasting question. First, it is simple and easy to understand. Second, there was substantial internal disagreement about whether a fast year is likely, and this disagreement appeared to result from different expectations about automated AI R&amp;D.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That said, <strong>a fast year is not the same as RSI<\/strong> (see the downsides below). For this reason, we also ask about automated AI R&amp;D directly. For example, our forecasting questions ask how much AI R&amp;D work AI will do with no human in the loop (AL5, the top level of Anthropic\u2019s AI autonomy scale; <a href=\"#what-the-labs-report\">Section 3.1<\/a>). The survey also asks how human reviewers will score research papers that AI agents write on their own (CRUX 2, an open-world evaluation of AI research agents; <a href=\"#public-evidence\">Section 3.2<\/a>). Other questions link automated AI R&amp;D to acceleration. <a href=\"#forecasting-questions\">Section 6<\/a> summarizes all 18 questions.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>ECI data.<\/strong> The chart below shows the ECI frontier since Mar 2023. Epoch estimates that the ECI frontier rose by about 6 points a year before reasoning models and by about 14 points a year after they arrived in Sep 2024 (<a href=\"https:\/\/epoch.ai\/data-insights\/eci-frontier-trend\" target=\"_blank\" rel=\"noreferrer noopener\">Epoch<\/a>).<sup data-fn=\"982927a5-80b4-4f40-9fce-d257e3bf0075\" class=\"fn\"><a href=\"#982927a5-80b4-4f40-9fce-d257e3bf0075\" id=\"982927a5-80b4-4f40-9fce-d257e3bf0075-link\">2<\/a><\/sup> For a new frontier model on Jan 1, 2027, Epoch\u2019s 90% prediction interval is 166\u2013176 (<a href=\"https:\/\/epoch.ai\/data-insights\/eci-frontier-trend\" target=\"_blank\" rel=\"noreferrer noopener\">Epoch<\/a>). To extrapolate the trend beyond Jan 2027, we fit a statistical model (<a href=\"https:\/\/www.statsmodels.org\/stable\/examples\/notebooks\/generated\/statespace_fixed_params.html\" target=\"_blank\" rel=\"noreferrer noopener\">local linear trend model<\/a>); the model allows the pace of progress to vary over time, and it includes the acceleration observed with reasoning models in its sample.<sup data-fn=\"5c08fe63-c4ad-40cc-8d85-b1b354ee638b\" class=\"fn\"><a href=\"#5c08fe63-c4ad-40cc-8d85-b1b354ee638b\" id=\"5c08fe63-c4ad-40cc-8d85-b1b354ee638b-link\">3<\/a><\/sup> Its 80% interval for a new frontier model is 176\u2013206 at the end of 2027 and 171\u2013317 at the end of 2030. Using 20,000 simulations from this model, the probability of a fast year is 17% by the end of 2027 and 44% by the end of 2030.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In the model, the pace of progress changes each month by a random shock. Over 12 months, these shocks change the annual pace by about 10 points a year (i.e., one standard deviation). However, the data do not pin down this value precisely, and values from 2 to 20 points a year fit the data about as well. Across this range, the probability of a fast year is 2\u201331% by the end of 2027 and 7\u201358% by the end of 2030.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\" id=\"fig-03\"><img decoding=\"async\" src=\"https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/paper_2026-10-12_recursive-self-improvement_fig-03.png\" alt=\"Figure 3: The ECI frontier since Mar 2023, with two trend projections. The points are ECI frontier models, with scores from Epoch AI (read Nov 3, 2026). The tan band is Epoch AI\u2019s trend and 90% prediction interval, from its Sep 1, 2026, post. The blue line is our local linear trend model; the blue band is its 80% prediction interval.\"\/><figcaption class=\"wp-element-caption\"><strong>Figure 3:<\/strong> The ECI frontier since Mar 2023, with two trend projections. The points are ECI frontier models, with scores from Epoch AI (read Nov 3, 2026). The tan band is Epoch AI\u2019s trend and 90% prediction interval, from its Sep 1, 2026, post . The blue line is our local linear trend model; the blue band is its 80% prediction interval.<\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">We note a few <strong>pros and cons of the fast-year definition<\/strong>:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Our definition of a fast year roughly matches the labs\u2019 acceleration tests. Since the first reasoning models arrived in Sep 2024, the ECI frontier has risen by about 14 points a year (<a href=\"https:\/\/epoch.ai\/data-insights\/eci-frontier-trend\" rel=\"noreferrer noopener\" target=\"_blank\">Epoch<\/a>). So 30+ points in 12 months roughly doubles the current pace, similar to Anthropic\u2019s 2\u00d7 test. For reference, the ECI frontier rose by about 18 points in the last 12 months, from 151 (GPT-5 Pro, Oct 2025) to 169 (GPT-6 Astra, Sep 2026). The largest rise in any 12-month window so far is 21 points (Dec 2024\u2013Dec 2025, o1-mini to GPT-5.2 Pro); see <a href=\"https:\/\/epoch.ai\/eci?view=graph&amp;tab=release-date\" rel=\"noreferrer noopener\" target=\"_blank\">Epoch\u2019s ECI data<\/a>.<\/li>\n\n\n\n<li>A <strong>fast year could happen without RSI<\/strong>. For instance, a new human-discovered innovation, like reasoning models in 2024, could cause a fast year, although a doubling from today\u2019s pace would mean a larger absolute jump. Conversely, RSI could happen without a fast year if bottlenecks such as compute cap AI progress. To address this concern, the survey also asks about automated AI R&amp;D directly.<\/li>\n\n\n\n<li><a href=\"https:\/\/arxiv.org\/pdf\/2609.15802\" target=\"_blank\" rel=\"noreferrer noopener\">Cunningham et al. (2026)<\/a> derive a condition for self-sustaining acceleration in terms of elasticities that link AI capabilities, research effort, and algorithmic progress. Their initial calibration suggests that the feedback loop is not yet strong enough for a self-sustaining acceleration. A related, simpler test is whether the slope of the ECI trend increases. In the setup of Cunningham et al., a self-sustaining acceleration would bend the ECI trend upward even with fixed inputs. In practice, inputs are not fixed but still growing fast (see <a href=\"#what-the-labs-report\">Section 3.1<\/a>). Growing inputs would make the bend even stronger, so the roughly linear ECI trend since Sep 2024 suggests no self-sustaining acceleration today.<sup data-fn=\"5563d42f-3cb5-4f5b-bd43-39d7704f7558\" class=\"fn\"><a href=\"#5563d42f-3cb5-4f5b-bd43-39d7704f7558\" id=\"5563d42f-3cb5-4f5b-bd43-39d7704f7558-link\">4<\/a><\/sup><\/li>\n\n\n\n<li>Although ECI has no maximum in principle, it is capped in practice for a fixed set of benchmarks. While Epoch notes that \u201c<em>there is no maximum achievable ECI<\/em>\u201d (<a href=\"https:\/\/epoch.ai\/data\/eci-documentation\/faq\" target=\"_blank\" rel=\"noreferrer noopener\">Epoch<\/a>), many of the individual benchmarks in the ECI can saturate. GPT-6 Astra, which sets the current ECI frontier (169, <a href=\"https:\/\/epoch.ai\/eci?view=graph&amp;tab=release-date\" target=\"_blank\" rel=\"noreferrer noopener\">ECI<\/a>), is scored on 24 benchmarks. A model that scores 90% on all of them would have an ECI of about 189 (our calculation), i.e., 20 points above today\u2019s ECI frontier, or about 1.4 years at the current pace of 14 points a year.<sup data-fn=\"e137f17c-7212-4fb9-b47e-946e869e2990\" class=\"fn\"><a href=\"#e137f17c-7212-4fb9-b47e-946e869e2990\" id=\"e137f17c-7212-4fb9-b47e-946e869e2990-link\">5<\/a><\/sup> <sup data-fn=\"af3c7053-b1f6-46b9-a5ca-c610f10d894d\" class=\"fn\"><a href=\"#af3c7053-b1f6-46b9-a5ca-c610f10d894d\" id=\"af3c7053-b1f6-46b9-a5ca-c610f10d894d-link\">6<\/a><\/sup> In our forecasting questions, we assume that Epoch keeps adding unsaturated benchmarks, as it has so far.<\/li>\n\n\n\n<li>The ECI frontier counts only publicly available models. A lab could accelerate internally and release its models later or, potentially, not at all. Our survey asks forecasters about this gap between internal and public models. <strong>Our best current estimate of the internal lead is about 3\u20134 months of progress at today\u2019s pace.<\/strong> Both methods below convert Anthropic\u2019s internal ECI scores (AECI) to Epoch\u2019s scale.\n\n<ul class=\"wp-block-list\">\n<li><strong>Offset:<\/strong> Both indices (AECI and ECI) set Claude 3.5 Sonnet at 130 and GPT-5 at 150, but Anthropic\u2019s uses internal benchmarks (<a href=\"https:\/\/www-cdn.anthropic.com\/fc1b44717c85dc068bc6ba5024219938094694bd\/Claude%20Opus%205.5%20System%20Card.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">Opus 5.5 system card<\/a>, pp. 38, 40). On the same internal AECI fit, Claude Opus 5 scores 165.2 and Claude Opus 5.5 scores 169.4 (<a href=\"https:\/\/www-cdn.anthropic.com\/fc1b44717c85dc068bc6ba5024219938094694bd\/Claude%20Opus%205.5%20System%20Card.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">Opus 5.5 system card<\/a>, p. 39). On ECI, these models score 164.5 and 168.4, respectively (<a href=\"https:\/\/epoch.ai\/eci?view=graph&amp;tab=release-date\" target=\"_blank\" rel=\"noreferrer noopener\">Epoch data<\/a>), implying gaps of 0.7 and 1.0. We use their average to get an offset of roughly 0.9 points.<sup data-fn=\"4aaf361e-bedf-4fea-a1c4-e6cf800082c7\" class=\"fn\"><a href=\"#4aaf361e-bedf-4fea-a1c4-e6cf800082c7\" id=\"4aaf361e-bedf-4fea-a1c4-e6cf800082c7-link\">7<\/a><\/sup><\/li>\n\n\n\n<li><strong>Mythos Preview:<\/strong> first used internally on Feb 24, 2026 (<a href=\"https:\/\/www-cdn.anthropic.com\/08ab9158070959f88f296514c21b7facce6f52bc.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">system card<\/a>, p. 13). Its AECI of 161.9 (<a href=\"https:\/\/www-cdn.anthropic.com\/fc1b44717c85dc068bc6ba5024219938094694bd\/Claude%20Opus%205.5%20System%20Card.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">Opus 5.5 system card<\/a>, p. 39) minus 0.9 gives 161.0 on ECI, against 156.5 for GPT-5.2 Pro, which set the ECI frontier on that date (<a href=\"https:\/\/epoch.ai\/eci?view=graph&amp;tab=release-date\" rel=\"noreferrer noopener\" target=\"_blank\">Epoch data<\/a>). Lead: 4.5 points, or about four months.<\/li>\n\n\n\n<li><strong>Model 2:<\/strong> an unreleased Anthropic model \u201c<em>somewhat more capable than Mythos 5<\/em>\u201d that \u201c<em>does not display a capability jump of the degree observed from Claude Opus 4.6 to Mythos Preview<\/em>\u201d (<a href=\"https:\/\/www-cdn.anthropic.com\/f61d49fa5596956a5dec75fea0e973bf6a6a8378\/Redacted%20Risk%20Report%20August%202026%20.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">Risk Report<\/a>, p. 16). It has no score in the Opus 5.5 system card, so we bound it with scores from that fit: at least Mythos 5\u2019s AECI of 164.5, and at most 164.5 + 5.9 = 170.4, where 5.9 is Anthropic\u2019s estimate of the AECI jump at Mythos Preview (<a href=\"https:\/\/www-cdn.anthropic.com\/fc1b44717c85dc068bc6ba5024219938094694bd\/Claude%20Opus%205.5%20System%20Card.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">Opus 5.5 system card<\/a>, pp. 39, 41). Subtracting the 0.9 offset, that implies 163.6\u2013169.5 on ECI. Anthropic states that Model 2 was in heavy internal use by Jul 15, 2026 (<a href=\"https:\/\/www-cdn.anthropic.com\/f61d49fa5596956a5dec75fea0e973bf6a6a8378\/Redacted%20Risk%20Report%20August%202026%20.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">Risk Report<\/a>, pp. 10, 14), so we compare against the ECI frontier on that date: 163.1 from GPT-5.5 Pro (<a href=\"https:\/\/epoch.ai\/eci?view=graph&amp;tab=release-date\" rel=\"noreferrer noopener\" target=\"_blank\">Epoch data<\/a>). Lead: 0.5\u20136.4 points; we take the midpoint, about 3.5 points, or about three months.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<h2 id=\"evidence\" class=\"wp-block-heading\">3. Evidence<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>What AI R&amp;D consists of.<\/strong> AI R&amp;D ranges from deciding what to work on, through designing and running experiments, to analyzing and communicating results; for more context, see <a href=\"https:\/\/epoch.ai\/publications\/interviewing-ai-researchers-on-automation-of-ai-rnd\" rel=\"noreferrer noopener\" target=\"_blank\">Owen (2024)<\/a> and <a href=\"https:\/\/epoch.ai\/gradient-updates\/toward-an-onet-for-ai-rnd\" rel=\"noreferrer noopener\" target=\"_blank\">Denain, Kwon, and Ho (2026)<\/a>. We now discuss the best available evidence on how AI performs on these tasks.<\/p>\n\n\n\n<h3 id=\"what-the-labs-report\" class=\"wp-block-heading\">3.1 What the labs report<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The evidence reported by the labs, summarized in the table below, shows that AI does a large and fast-growing share of AI R&amp;D.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We note that Anthropic rates its internal R&amp;D tasks on a scale introduced by <a href=\"https:\/\/epoch.ai\/gradient-updates\/toward-an-onet-for-ai-rnd\" rel=\"noreferrer noopener\" target=\"_blank\">Denain, Kwon, and Ho (2026)<\/a> from AL0 (no AI involvement) to AL5 (\u201c<em>AI operates fully autonomously, with no human in the loop<\/em>\u201d); at AL3, AI \u201c<em>collaborates<\/em>,\u201d and at AL4, it \u201c<em>leads<\/em>\u201d (<a href=\"https:\/\/www.anthropic.com\/institute\/measuring-pace-of-ai-development\" rel=\"noreferrer noopener\" target=\"_blank\">Anthropic<\/a>); OpenAI currently provides no equivalent data.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><div class=\"table-wrapper\"><table class=\"has-fixed-layout\"><tbody><tr><td><p><strong>Measure<\/strong><\/p><\/td><td><p><strong>OpenAI<\/strong><\/p><\/td><td><p><strong>Anthropic<\/strong><\/p><\/td><\/tr><tr><td><p><strong>Share of R&amp;D work done by AI<\/strong><\/p><\/td><td><p>3.1 agent-workdays per human workday in Aug 2026, up from about 0.5 in May 2026 (<a href=\"https:\/\/openai.com\/index\/research-acceleration-view-inside-openai\/\" rel=\"noreferrer noopener\" target=\"_blank\">OpenAI<\/a>)<\/p><\/td><td><p><strong>Claude leads (AL4+) 26% of model R&amp;D tasks in Aug 2026, up from under 1% in Feb 2026<\/strong>; AI at least collaborates (AL3+) on above 90% (<a href=\"https:\/\/www.anthropic.com\/institute\/measuring-pace-of-ai-development\" rel=\"noreferrer noopener\" target=\"_blank\">Anthropic<\/a>). In an internal poll (Aug 2026), staff\u2019s median estimate of AI\u2019s share of the work of building an early-2026 frontier model was 51% (<a href=\"https:\/\/www.anthropic.com\/research\/ai-expectations-gap\" rel=\"noreferrer noopener\" target=\"_blank\">Anthropic<\/a>)<\/p><\/td><\/tr><tr><td><p><strong>AI-written code<\/strong><\/p><\/td><td><p>Lines changed per active contributor, company-wide: 7.02\u00d7 the pre-2025 average in Jul 2026 (<a href=\"https:\/\/openai.com\/index\/research-acceleration-view-inside-openai\/\" rel=\"noreferrer noopener\" target=\"_blank\">OpenAI<\/a>)<\/p><\/td><td><p><strong>Over 90% of contributions to the codebase written by Claude<\/strong> (Sep 2026); average daily code volume per engineer in Jul\u2013Sep 2026 over 45\u00d7 that in 2024 (<a href=\"https:\/\/www.sec.gov\/Archives\/edgar\/data\/2130357\/000162828026067168\/anthropicpbc-sx1.htm\" rel=\"noreferrer noopener\" target=\"_blank\">S-1<\/a>)<\/p><\/td><\/tr><tr><td><p><strong>Productivity uplift<\/strong><\/p><\/td><td><p><strong>Experiments per active experimenter at an all-time high in Aug 2026, about 1.6\u00d7 the 2025 level<\/strong>, although OpenAI notes that \u201c<em>our available compute has also grown significantly since 2025<\/em>\u201d (<a href=\"https:\/\/openai.com\/index\/research-acceleration-view-inside-openai\/\" rel=\"noreferrer noopener\" target=\"_blank\">OpenAI<\/a>)<\/p><\/td><td><p>Staff survey (<em>n<\/em> = 130) found that the \u201c<em>median respondent estimated that they produced around 4\u00d7 as much output with Mythos Preview as they would have without access to any AI models<\/em>\u201d (<a href=\"https:\/\/www.anthropic.com\/institute\/recursive-self-improvement\" rel=\"noreferrer noopener\" target=\"_blank\">Anthropic<\/a>); in a separate survey, 1 of 18 thought that Claude Mythos Preview was equivalent to a drop-in entry-level researcher (<a href=\"https:\/\/www-cdn.anthropic.com\/f61d49fa5596956a5dec75fea0e973bf6a6a8378\/Redacted%20Risk%20Report%20August%202026%20.pdf#page=99\" rel=\"noreferrer noopener\" target=\"_blank\">Risk Report<\/a>)<\/p><\/td><\/tr><tr><td><p><strong>Measured acceleration<\/strong><\/p><\/td><td><p><strong>OpenAI says agentic tools are \u201c<em>meaningfully accelerating research progress<\/em>\u201d<\/strong> but that its \u201c<em>measurement efforts are still preliminary<\/em>\u201d (<a href=\"https:\/\/openai.com\/index\/research-acceleration-view-inside-openai\/\" rel=\"noreferrer noopener\" target=\"_blank\">OpenAI<\/a>); GPT-6 Astra \u201c<em>does not reach our High threshold<\/em>\u201d for AI self-improvement (<a href=\"https:\/\/deploymentsafety.openai.com\/gpt-6-astra\/gpt-6-astra.pdf#page=75\" rel=\"noreferrer noopener\" target=\"_blank\">Astra system card<\/a>)<\/p><\/td><td><p>On Anthropic\u2019s internal version of the ECI (AECI), <strong>Claude Opus 5.5 is about 6.5 points above the historical trend of about 15 points a year<\/strong>; it is unclear whether this is a one-off jump at Mythos Preview (Apr 2026) or a break in the trend, to about 22 points a year since Sep 2025 (<a href=\"https:\/\/www-cdn.anthropic.com\/fc1b44717c85dc068bc6ba5024219938094694bd\/Claude%20Opus%205.5%20System%20Card.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">Opus 5.5 system card<\/a>, pp. 40\u201341). Internal measures \u201c<em>do not show a sustained AI-attributable 2\u00d7 acceleration<\/em>\u201d (p. 35); <strong>a preliminary external METR assessment of AI R&amp;D acceleration inside Anthropic estimates \u201c<em>~1.5X overall acceleration in capabilities due to AI,<\/em>\u201d<\/strong> with \u201c<em>perhaps 30% chance of 2X<\/em>\u201d (<a href=\"https:\/\/www-cdn.anthropic.com\/fc1b44717c85dc068bc6ba5024219938094694bd\/Claude%20Opus%205.5%20System%20Card.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">Opus 5.5 system card<\/a>, p. 44)<\/p><\/td><\/tr><tr><td><p><strong>Internal debugging benchmark<\/strong><\/p><\/td><td><p>Internal Research Debugging Evaluation (41 real bugs from internal experiments that took researchers hours to days, plus 6 alignment-auditing tasks): GPT-6 Astra 78.05%, \u201c<em>below our indicative threshold for High<\/em>\u201d (<a href=\"https:\/\/deploymentsafety.openai.com\/gpt-6-astra\/internal-research-debugging-evaluation\" rel=\"noreferrer noopener\" target=\"_blank\">Astra system card<\/a>)<\/p><\/td><td><p>CoBench v2 (449 real internal root-cause problems, filtered to ones Mythos Preview failed at least once; <a href=\"https:\/\/www-cdn.anthropic.com\/f61d49fa5596956a5dec75fea0e973bf6a6a8378\/Redacted%20Risk%20Report%20August%202026%20.pdf#page=100\" target=\"_blank\" rel=\"noreferrer noopener\">Risk Report<\/a>): Opus 4.6 15.6%, Mythos Preview 54.8%, internal Model 2 62.8%; a \u201c<em>model which was truly capable of fully substituting for Anthropic research staff would be able to score at least 85% on this evaluation<\/em>\u201d (<a href=\"https:\/\/www-cdn.anthropic.com\/f61d49fa5596956a5dec75fea0e973bf6a6a8378\/Redacted%20Risk%20Report%20August%202026%20.pdf#page=101\" target=\"_blank\" rel=\"noreferrer noopener\">Risk Report<\/a>)<\/p><\/td><\/tr><tr><td><p><strong>Internal AI R&amp;D benchmarks<\/strong><\/p><\/td><td><p>GPT-6 Astra beats GPT-5.6 Sol on all four internal AI R&amp;D evaluations (<a href=\"https:\/\/deploymentsafety.openai.com\/gpt-6-astra\/gpt-6-astra.pdf#page=98\" rel=\"noreferrer noopener\" target=\"_blank\">Astra system card<\/a>); against human baselines, it closes about 77% of the gap from base model to human on PostTrainBench Lite, but reaches only about a third of the best human score on NanoGPT (about 24% vs. 72%; our reading of the charts)<\/p><\/td><td><p>Frontier models \u201c<em>surpass human baseline performance on most tasks<\/em>\u201d in Anthropic\u2019s task-based AI R&amp;D suite (<a href=\"https:\/\/www-cdn.anthropic.com\/f61d49fa5596956a5dec75fea0e973bf6a6a8378\/Redacted%20Risk%20Report%20August%202026%20.pdf#page=99\" rel=\"noreferrer noopener\" target=\"_blank\">Risk Report<\/a>)<\/p><\/td><\/tr><tr><td><p><strong>Research judgment<\/strong><\/p><\/td><td><p>No direct measure reported. In Aug 2026, \u201c<em>high-level planning still remains a minimal fraction of agent output tokens<\/em>\u201d (<a href=\"https:\/\/openai.com\/index\/research-acceleration-view-inside-openai\/\" rel=\"noreferrer noopener\" target=\"_blank\">OpenAI<\/a>)<\/p><\/td><td><p><strong>Anthropic states that \u201c<em>large performance gaps persist when it comes to Claude exercising judgement in choosing goals in both engineering and research<\/em>\u201d<\/strong> (<a href=\"https:\/\/www.anthropic.com\/institute\/recursive-self-improvement\" target=\"_blank\" rel=\"noreferrer noopener\">Anthropic<\/a>). Internal users report that Claude Opus 5.5 \u201c<em>mostly tests incremental ideas and prefers less ambitious hypotheses<\/em>\u201d (<a href=\"https:\/\/www-cdn.anthropic.com\/fc1b44717c85dc068bc6ba5024219938094694bd\/Claude%20Opus%205.5%20System%20Card.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">Opus 5.5 system card<\/a>, p. 36). According to METR, \u201c<em>The evidence we have does not suggest that [Claude Opus 5.5] represents a large improvement over Fable 5.1 in these \u2018judgement\u2019 skills<\/em>\u201d (same system card, p. 43). In an internal survey, respondents cited weaknesses in \u201c<em>taste, verification, instruction-following, and epistemics<\/em>\u201d when compared to \u201c<em>an entry-level researcher<\/em>\u201d (<a href=\"https:\/\/www-cdn.anthropic.com\/f61d49fa5596956a5dec75fea0e973bf6a6a8378\/Redacted%20Risk%20Report%20August%202026%20.pdf#page=99\" target=\"_blank\" rel=\"noreferrer noopener\">Risk Report<\/a>).<\/p> <p>Direct quantitative measures are limited. On TASTE, where models pick the better of two AI safety research proposals, the best model, Claude Fable 5, agreed with experienced researchers 60% of the time (\u00b110 percentage points), against an estimated 77% for researchers and 50% by chance (<a href=\"https:\/\/alignment.anthropic.com\/2026\/taste\/\" target=\"_blank\" rel=\"noreferrer noopener\">TASTE<\/a>)<\/p><\/td><\/tr><tr><td><p><strong>Autonomy on long tasks<\/strong><\/p><\/td><td><p><strong>Success with no human intervention, Jan \u2192 Jul 2026: 2\u20134-hour tasks 28% \u2192 57%, 4\u20138 hours 18% \u2192 53%, 8\u201316 hours 10% \u2192 35%<\/strong> (<a href=\"https:\/\/openai.com\/index\/research-acceleration-view-inside-openai\/\" rel=\"noreferrer noopener\" target=\"_blank\">OpenAI<\/a>)<\/p><\/td><td><p>Claude \u201c<em>is not operating fully autonomously for any measured subset of AI R&amp;D work<\/em>\u201d (<a href=\"https:\/\/www.anthropic.com\/institute\/measuring-pace-of-ai-development\" rel=\"noreferrer noopener\" target=\"_blank\">Anthropic<\/a>); Claude Code session success on open-ended problems more than tripled in about a year, from about 26% (Aug 2025) to 91% (Sep 2026), and all four difficulty tiers are now at about 88\u201392% (<a href=\"https:\/\/www.anthropic.com\/institute\/recursive-self-improvement\" rel=\"noreferrer noopener\" target=\"_blank\">Anthropic<\/a>)<\/p><\/td><\/tr><tr><td><p><strong>AI inference spend per researcher<\/strong><\/p><\/td><td><p><strong>Median above $600\/day at API prices by mid-Aug 2026, from near zero in Feb 2026<\/strong>; 90th percentile above $7,000\/day (<a href=\"https:\/\/openai.com\/index\/research-acceleration-view-inside-openai\/\" rel=\"noreferrer noopener\" target=\"_blank\">OpenAI<\/a>)<\/p><\/td><td><p>Not reported<\/p><\/td><\/tr><\/tbody><\/table><\/div><figcaption class=\"wp-element-caption\"><strong>Table 3:<\/strong> Evidence from OpenAI and Anthropic on AI in their own R&amp;D. Bold text marks the evidence that we view as the most important.<\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Our <strong>key takeaways from this evidence<\/strong>:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>AI writes most code at Anthropic; OpenAI has not reported a share, but code volume per contributor is about 7\u00d7 the pre-2025 average, suggesting that the same is likely true at OpenAI.<\/li>\n\n\n\n<li>Researchers at both labs appear more productive. However, self-reported productivity estimates can be <a href=\"https:\/\/metr.org\/blog\/2025-07-10-early-2025-ai-experienced-os-dev-study\/\" rel=\"noreferrer noopener\" target=\"_blank\">fraught<\/a>, and an outside <a href=\"https:\/\/metr.org\/blog\/2026-05-11-ai-usage-survey\/\" rel=\"noreferrer noopener\" target=\"_blank\">METR survey<\/a> of 349 technical workers found a median uplift of 1.4\u20132\u00d7 (also self-reported), well below the 4\u00d7 reported by Anthropic\u2019s staff.<\/li>\n\n\n\n<li><strong>There is some internal evidence of acceleration.<\/strong> On Anthropic\u2019s internal version of the ECI, Claude Opus 5.5 is about 6.5 points above the historical trend, while OpenAI says agentic tools are \u201c<em>meaningfully accelerating research progress<\/em>\u201d (<a href=\"https:\/\/openai.com\/index\/research-acceleration-view-inside-openai\/\" rel=\"noreferrer noopener\" target=\"_blank\">OpenAI<\/a>). This matches statements by lab leaders: Sam Altman called AI\u2019s help with AI R&amp;D \u201c<em>a larval version of recursive self-improvement<\/em>\u201d (<a href=\"https:\/\/blog.samaltman.com\/the-gentle-singularity\" rel=\"noreferrer noopener\" target=\"_blank\">The Gentle Singularity<\/a>, Jun 2025), Dario Amodei says that RSI \u201c<em>is starting to happen across the industry<\/em>\u201d (<a href=\"https:\/\/darioamodei.com\/post\/we-must-pace-the-frontier\" rel=\"noreferrer noopener\" target=\"_blank\">We Must Pace the Frontier<\/a>, Sep 2026), and Jack Clark says that \u201c<em>this year we have gained convincing evidence that [the singularity] has now begun<\/em>\u201d (<a href=\"https:\/\/importai.substack.com\/p\/import-ai-477-in-which-i-tell-the\" rel=\"noreferrer noopener\" target=\"_blank\">Import AI 477<\/a>, Oct 2026). In its IPO filing, Anthropic says that \u201c<em>each new version of a Claude model directly accelerates development of the next<\/em>\u201d (<a href=\"https:\/\/www.sec.gov\/Archives\/edgar\/data\/2130357\/000162828026067168\/anthropicpbc-sx1.htm\" rel=\"noreferrer noopener\" target=\"_blank\">S-1<\/a>). However, faster input growth explains part of Anthropic\u2019s above-trend result. For example, its headcount rose from about 940 at the end of 2024 to about 5,300 on Sep 30, 2026, and its compute and infrastructure expenses grew 300% year over year in Q2 2026 (<a href=\"https:\/\/www.sec.gov\/Archives\/edgar\/data\/2130357\/000162828026067168\/anthropicpbc-sx1.htm\" rel=\"noreferrer noopener\" target=\"_blank\">S-1<\/a>).<\/li>\n\n\n\n<li><strong>Google DeepMind reports a result similar to Anthropic\u2019s above-trend AECI but interprets it as being mostly due to input growth, not automated AI R&amp;D.<\/strong> On its own version of the ECI (called GCI), Gemini 4 Argon is also above trend. However, Google DeepMind suspects that this is due to \u201c<em>increased organizational investment and an increase in training compute relative to the historical trend, rather than reflecting AI-driven acceleration<\/em>\u201d (<a href=\"https:\/\/storage.googleapis.com\/deepmind-media\/gemini\/gemini_4_safety_report.pdf#page=76\" rel=\"noreferrer noopener\" target=\"_blank\">Gemini 4 Argon report<\/a>, p. 75). In addition, while most production code at Google DeepMind is now \u201c<em>&gt;75% AI-written,<\/em>\u201d the share of <em>fully<\/em> delegated pull requests was only 11.9% in Sep 2026 (<a href=\"https:\/\/storage.googleapis.com\/deepmind-media\/gemini\/gemini_4_safety_report.pdf#page=76\" rel=\"noreferrer noopener\" target=\"_blank\">Gemini 4 Argon report<\/a>, p. 77).<\/li>\n\n\n\n<li><strong>The evidence on research judgment is limited but suggests important gaps.<\/strong> OpenAI reports no direct measure, while Anthropic and its staff describe judgment as a remaining performance gap. Models mostly do well on AI R&amp;D benchmarks, but these test well-defined, verifiable tasks, not judgment (see also <a href=\"#public-evidence\">Section 3.2<\/a>). In addition, AI\u2019s success rate falls as tasks get longer: at OpenAI, 57% on 2\u20134-hour tasks against 35% on 8\u201316-hour tasks without human intervention (Jul 2026). <strong>Overall, AI now does much or most of the execution, but humans still supply most research taste and judgment.<\/strong> A RAND review of the public evidence reaches a similar conclusion: \u201c<em>no disclosed system sets its own research agenda, sustains open-ended research over weeks, or designs its own successors<\/em>\u201d (<a href=\"https:\/\/www.rand.org\/pubs\/perspectives\/PEA5068-1.html\" rel=\"noreferrer noopener\" target=\"_blank\">Sarma et al., 2026<\/a>, p. 20).<\/li>\n\n\n\n<li>Inference spend per researcher is now on the scale of salaries. The median OpenAI researcher\u2019s ~$600 a day at API prices comes to about $150,000 a year (assuming 250 workdays). Spend at the 90th percentile, above $7,000 a day, implies about $1.75 million a year. (API prices likely overstate OpenAI\u2019s own cost.)<\/li>\n<\/ul>\n\n\n\n<h3 id=\"public-evidence\" class=\"wp-block-heading\">3.2 Public evidence<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">This section reviews the evidence from public benchmarks and one open-world evaluation.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We look at four public AI R&amp;D benchmarks. Two benchmarks test end-to-end machine learning (ML) work: <a href=\"https:\/\/posttrainbench.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">PostTrainBench<\/a> and <a href=\"https:\/\/htihle.github.io\/weirdml.html\" target=\"_blank\" rel=\"noreferrer noopener\">WeirdML<\/a>. Epoch\u2019s benchmark reviews rate both \u201c<em>Verified<\/em>,\u201d meaning the benchmark \u201c<em>can broadly be interpreted as described<\/em>\u201d (<a href=\"https:\/\/epoch.ai\/data\/benchmark-reviews-documentation\" target=\"_blank\" rel=\"noreferrer noopener\">Epoch<\/a>).<sup data-fn=\"50cad995-1555-425b-bf71-d83767b0238c\" class=\"fn\"><a href=\"#50cad995-1555-425b-bf71-d83767b0238c\" id=\"50cad995-1555-425b-bf71-d83767b0238c-link\">8<\/a><\/sup> Two other benchmarks attempt to isolate research taste more directly: <a href=\"https:\/\/arxiv.org\/abs\/2610.06824\" target=\"_blank\" rel=\"noreferrer noopener\">TasteVal<\/a> measures how well a model designs and interprets experiments, and Epoch\u2019s <a href=\"https:\/\/epoch.ai\/publications\/innovationeval\" target=\"_blank\" rel=\"noreferrer noopener\">InnovationEval<\/a> asks whether an agent can reinvent an ML innovation it has not seen. Epoch rates TasteVal \u201c<em>Not enough info<\/em>\u201d (<a href=\"https:\/\/epoch.ai\/data\/benchmark-reviews-documentation\/included-benchmarks\" target=\"_blank\" rel=\"noreferrer noopener\">Epoch<\/a>, Oct 21, 2026), likely because TasteVal does not release its tasks (<a href=\"https:\/\/arxiv.org\/abs\/2610.06824\" target=\"_blank\" rel=\"noreferrer noopener\">TasteVal<\/a>). Epoch does not review its own benchmarks, such as InnovationEval, to avoid conflicts of interest (<a href=\"https:\/\/epoch.ai\/data\/benchmark-reviews-documentation\" target=\"_blank\" rel=\"noreferrer noopener\">Epoch<\/a>).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Finally, <a href=\"https:\/\/arxiv.org\/abs\/2607.27191\" rel=\"noreferrer noopener\" target=\"_blank\">CRUX 2<\/a> (Jul 2026) is an open-world evaluation rather than a benchmark: an agent carries out a full research project on an open question, with no fixed task or automatic score, and human experts grade the resulting paper.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The table below summarizes all five.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><div class=\"table-wrapper\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>Benchmark<\/strong><\/td><td><strong>What it measures and human baseline<\/strong><\/td><td><strong>Current frontier<\/strong><\/td><\/tr><tr><td><a href=\"https:\/\/posttrainbench.com\/\" rel=\"noreferrer noopener\" target=\"_blank\"><strong>PostTrainBench v1.1<\/strong><\/a><\/td><td>Can an agent do the job of a lab\u2019s post-training team, turning a raw pretrained model into a useful assistant? The agent gets four small base models, one H100, and 10 hours to post-train them; score = weighted average of the resulting models\u2019 benchmark scores. Human baseline: the labs\u2019 official instruct models, post-trained by their own teams, score 51.1<\/td><td>On v1.1, Locus (an external scaffold on Opus 5, submitted Sep 2026) 45.6 and Claude Fable 5 (Jun 2026) 41.8, up from 9.9 for Claude Sonnet 4.5 (Sep 2025) (<a href=\"https:\/\/github.com\/aisa-group\/posttrainbench-website\" rel=\"noreferrer noopener\" target=\"_blank\">site data<\/a>)<\/td><\/tr><tr><td><a href=\"https:\/\/htihle.github.io\/weirdml.html\" rel=\"noreferrer noopener\" target=\"_blank\"><strong>WeirdML v3<\/strong><\/a><\/td><td>Can an agent build working ML models for small, unusual problems it has not seen before? Eleven hand-made ML tasks; score = normalized task performance (0\u2013100); no human baseline reported<\/td><td>GPT-6 Astra 42.2 in Sep 2026, up from 15.0 for GPT-5.6 Sol (Jul 2026) and 6.5 for Claude Opus 4.5 (Nov 2025) (<a href=\"https:\/\/htihle.github.io\/assets\/data\/weirdml_v3.json\" rel=\"noreferrer noopener\" target=\"_blank\">data<\/a>)<\/td><\/tr><tr><td><a href=\"https:\/\/arxiv.org\/abs\/2610.06824\" rel=\"noreferrer noopener\" target=\"_blank\"><strong>TasteVal<\/strong><\/a><\/td><td>Can a model choose and interpret experiments as well as a human expert? Eight unreleased AI R&amp;D tasks (e.g., data curation, pre-training, fine-tuning); the tested model only designs experiments and interprets results, while a fixed coding agent runs them. Score = how many times less experiment compute the model needs than the human baseline to reach the same test score. Human baseline = best of at least two experts per task (24 experts from OpenAI, Google DeepMind, and others)<\/td><td>Claude Opus 5.5 (Sep 2026) reaches the experts\u2019 score with 2.3\u00d7 less compute (95% CI 1.15\u20134.37) and ends slightly above them on final score (1.14 vs. 1.00); Claude Opus 4.8 (May 2026) scored 0.84\u00d7 (<a href=\"https:\/\/arxiv.org\/html\/2610.06824v1\" rel=\"noreferrer noopener\" target=\"_blank\">TasteVal<\/a>)<\/td><\/tr><tr><td><a href=\"https:\/\/epoch.ai\/publications\/innovationeval\" rel=\"noreferrer noopener\" target=\"_blank\"><strong>InnovationEval<\/strong><\/a><\/td><td>Can an agent invent a known ML innovation it has not seen? Given Qwen3-8B, datasets, and a codebase for GRPO (a reinforcement-learning method for post-training), it must devise a better post-training method. Score = share of SDPO\u2019s published gain over GRPO (0% = GRPO, 100% = the SDPO paper\u2019s results)<\/td><td>GPT-5.6 Sol (Jul 2026) 15% and Claude Fable 5 (Jun 2026) 2%. GPT-6 Astra (Sep 2026) scored 63% but had likely memorized the original paper (<a href=\"https:\/\/epoch.ai\/publications\/innovationeval\" rel=\"noreferrer noopener\" target=\"_blank\">InnovationEval<\/a>)<\/td><\/tr><tr><td><a href=\"https:\/\/arxiv.org\/abs\/2607.27191\" rel=\"noreferrer noopener\" target=\"_blank\"><strong>CRUX 2<\/strong><\/a> (open-world evaluation)<\/td><td>Can an agent carry out a real, open-ended research project? The agent gets the research question of an unpublished AI paper (but not the paper itself), about a week, an API budget, and GPU credits, and must write a paper for a top AI conference. The original authors then grade it on the NeurIPS 1\u20136 scale, where 4 is \u201c<em>Borderline accept<\/em>\u201d and 6 is \u201c<em>Strong Accept<\/em>\u201d (<a href=\"https:\/\/neurips.cc\/Conferences\/2025\/ReviewerGuidelines\" rel=\"noreferrer noopener\" target=\"_blank\">NeurIPS<\/a>)<\/td><td>Original study (Jul 2026): Claude Opus 4.8 in the OpenClaw scaffold; scores: 2 (\u201c<em>Reject<\/em>\u201d) and 1 (\u201c<em>Strong Reject<\/em>\u201d) (<a href=\"https:\/\/arxiv.org\/abs\/2607.27191\" rel=\"noreferrer noopener\" target=\"_blank\">CRUX 2<\/a>). Follow-up (Oct 2026): GPT-6 Astra in Codex and Claude Fable 5.1 in Claude Code, each with extra-high reasoning; scores: 2 (\u201c<em>Reject,<\/em>\u201d GPT-6 Astra) and 1 (\u201c<em>Strong Reject,<\/em>\u201d Claude Fable 5.1) (<a href=\"https:\/\/cruxevals.com\/research-notes\/crux-2-follow-up\" rel=\"noreferrer noopener\" target=\"_blank\">CRUX<\/a>)<\/td><\/tr><\/tbody><\/table><\/div><figcaption class=\"wp-element-caption\"><strong>Table 4:<\/strong> Public AI R&amp;D benchmarks and the CRUX 2 open-world evaluation.<\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Our <strong>key takeaways from the public evidence<\/strong>:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>On the two end-to-end ML benchmarks, which are well-defined, verifiable tasks by construction, models do well. On PostTrainBench, the best agent brings small models about 89% of the way to the labs\u2019 official instruct models using one GPU for 10 hours, although Epoch\u2019s review warns that agents can score well \u201c<em>by narrowly (over)fitting to the single eval<\/em>\u201d (<a href=\"https:\/\/posttrainbench.com\/blog\/epoch-ai-review-response\/\" rel=\"noreferrer noopener\" target=\"_blank\">PostTrainBench<\/a>). This matches Anthropic\u2019s statement that its own task-based AI R&amp;D evaluations \u201c<em>have \u2018saturated\u2019<\/em>\u201d (<a href=\"https:\/\/www-cdn.anthropic.com\/f61d49fa5596956a5dec75fea0e973bf6a6a8378\/Redacted%20Risk%20Report%20August%202026%20.pdf#page=93\" rel=\"noreferrer noopener\" target=\"_blank\">Risk Report<\/a>).<\/li>\n\n\n\n<li>The two research-taste benchmarks point in different directions. On TasteVal\u2019s small, verifiable tasks, Claude Opus 5.5 reaches the experts\u2019 score with 2.3\u00d7 less compute, and this multiplier has doubled about every three months since Dec 2025 (<a href=\"https:\/\/arxiv.org\/abs\/2610.06824\" rel=\"noreferrer noopener\" target=\"_blank\">TasteVal<\/a>). On InnovationEval, agents recovered only 2\u201315% of the gains of a real ML innovation they had not seen (<a href=\"https:\/\/epoch.ai\/publications\/innovationeval\" rel=\"noreferrer noopener\" target=\"_blank\">Epoch<\/a>). TasteVal does not test the choice of research problems, while InnovationEval rests on one innovation.<\/li>\n\n\n\n<li>On CRUX 2, both papers were rejected. The study concludes that \u201c<em>today\u2019s agents can do the engineering of AI research, but struggle with critical parts of the research lifecycle<\/em>\u201d (<a href=\"https:\/\/arxiv.org\/abs\/2607.27191\" rel=\"noreferrer noopener\" target=\"_blank\">CRUX 2<\/a>), similar to the evidence from the labs. A follow-up with newer models, more time, and a larger budget (Oct 2026) again produced two rejected papers. The authors saw \u201c<em>meaningful improvements in experimental design and resource management, but persistent limitations in creative problem solving, judgment, calibration, and communication<\/em>\u201d (<a href=\"https:\/\/cruxevals.com\/research-notes\/crux-2-follow-up\" rel=\"noreferrer noopener\" target=\"_blank\">CRUX<\/a>).<\/li>\n\n\n\n<li><strong>Outside benchmarks, the public record of discoveries provides evidence of acceleration.<\/strong> A METR note (Aug 2026) finds that the discovery of cyber vulnerabilities \u201c<em>has accelerated sharply<\/em>\u201d in 2026 and that of math results \u201c<em>somewhat.<\/em>\u201d On the other hand, \u201c<em>the public record of overall algorithmic optimization does not yet show an appreciable acceleration<\/em>\u201d (<a href=\"https:\/\/metr.org\/notes\/2026-08-14-llm-contribution-to-discoveries\/\" rel=\"noreferrer noopener\" target=\"_blank\">Cunningham and Rush, 2026<\/a>). Since that note, the discovery rate in math appears to have increased:\n\n<ul class=\"wp-block-list\">\n<li>OpenAI claims to have solved Navier\u2013Stokes, a Millennium Prize Problem (<a href=\"https:\/\/openai.com\/index\/navier-stokes-solution\/\" rel=\"noreferrer noopener\" target=\"_blank\">OpenAI<\/a>, Sep 2026).<\/li>\n\n\n\n<li>On Oct 6, 2026, OpenAI released hundreds of results on open math problems (<a href=\"https:\/\/openai.com\/index\/sharing-ai-progress-in-mathematics\/\" rel=\"noreferrer noopener\" target=\"_blank\">OpenAI<\/a>); computer scientist Scott Aaronson <a href=\"https:\/\/scottaaronson.blog\/?p=10169\" rel=\"noreferrer noopener\" target=\"_blank\">wrote<\/a> that the day was \u201c<em>surely one of the biggest days in mathematical history.<\/em>\u201d<\/li>\n\n\n\n<li>On Oct 26, OpenAI claimed half of a second Millennium Prize Problem, Yang\u2013Mills (the existence of the theory, but not the mass gap). It also claimed a disproof of the Exponential Time Hypothesis, a widely held conjecture about how hard some computational problems are (<a href=\"https:\/\/openai.com\/index\/building-scientific-understanding-with-academic-communities\/\" rel=\"noreferrer noopener\" target=\"_blank\">OpenAI<\/a>).<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<h3 id=\"qualitative-evidence\" class=\"wp-block-heading\">3.3 Qualitative evidence<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">In earlier interviews, Epoch asked eight AI researchers about automation (<a href=\"https:\/\/epoch.ai\/publications\/interviewing-ai-researchers-on-automation-of-ai-rnd\" rel=\"noreferrer noopener\" target=\"_blank\">Owen, 2024<\/a>). Planning research was vital but took \u201c<em>relatively little time,<\/em>\u201d while coding and debugging were \u201c<em>more time-consuming.<\/em>\u201d All eight agreed that \u201c<em>engineering tasks will be the main driver of R&amp;D automation in the next five years,<\/em>\u201d and their descriptions suggested that this \u201c<em>could automate half or more of their current work.<\/em>\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Severin Field, Raymond Douglas, and David Krueger (<a href=\"https:\/\/blog.peterwildeford.com\/p\/interviewing-25-ai-researchers-about\" rel=\"noreferrer noopener\" target=\"_blank\">post<\/a>, published Aug 13, 2026) interviewed 25 researchers at OpenAI, Anthropic, Google DeepMind, Meta, Princeton, UC Berkeley, and Stanford:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Twenty of 25 ranked automating AI R&amp;D among the most severe and urgent risks; 18 of 25 said it amplifies other risks (\u201c<em>It just speeds up other threat models<\/em>\u201d).<\/li>\n\n\n\n<li>Of the 21 who clearly addressed whether scaling trends will continue, 12 expected them to continue until AI can match the labor of human AI researchers.<\/li>\n\n\n\n<li>Sixteen of 25 at some point expressed skepticism about positive feedback, the recursive part of RSI. Skeptics said RSI needs \u201c<em>a drastic change in AI capabilities that wouldn\u2019t emerge from gradual improvement alone<\/em>,\u201d such as breakthroughs in memory, creativity, or telling true hypotheses from false ones; believers cited METR\u2019s time horizons, scaling laws, and what they had experienced inside the labs.<\/li>\n\n\n\n<li>Of 20 who discussed deployment, half expected the most capable models to stay internal.<\/li>\n<\/ul>\n\n\n\n<h2 id=\"existing-projections-and-forecasts\" class=\"wp-block-heading\">4. Existing projections and forecasts<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">We next review projections of various automated AI R&amp;D milestones. We look at three types of evidence: the labs\u2019 own targets (<a href=\"#lab-targets\">4.1<\/a>), extrapolations of the measured series (<a href=\"#trend-extrapolation\">4.2<\/a>), and forecasts (<a href=\"#forecasts\">4.3<\/a>) from prediction platforms, an LLM forecaster, surveys of experts and superforecasters (forecasters with a track record of accurate predictions), and notable individuals.<\/p>\n\n\n\n<h3 id=\"lab-targets\" class=\"wp-block-heading\">4.1 Lab targets<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>OpenAI and Anthropic both expect automated AI R&amp;D within a few years.<\/strong> OpenAI\u2019s stated goal is an automated AI researcher by Mar 2028, and it says it has already reached its intermediate goal, an automated research intern (<a href=\"https:\/\/openai.com\/index\/research-acceleration-view-inside-openai\/\" rel=\"noreferrer noopener\" target=\"_blank\">OpenAI<\/a>). Anthropic\u2019s Frontier Safety Roadmap calls automated AI R&amp;D \u201c<em>plausible, as soon as early 2027<\/em>\u201d (<a href=\"https:\/\/www.anthropic.com\/responsible-scaling-policy\/roadmap#expectations\" rel=\"noreferrer noopener\" target=\"_blank\">Roadmap<\/a>).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In its amended IPO filing (Nov 2, 2026), Anthropic states that it \u201c<em>may imminently meet our Responsible Scaling Policy\u2019s definition of \u2018dramatically accelerated progress attributable to AI\u2019<\/em>\u201d (<a href=\"https:\/\/www.sec.gov\/Archives\/edgar\/data\/2130357\/000162828026068676\/anthropicpbc-sx1ax1.htm\" rel=\"noreferrer noopener\" target=\"_blank\">S-1\/A<\/a>, p. 29). In an internal poll of Anthropic staff in Aug 2026, the median expectation for AI\u2019s share of the work of building an early-2026 frontier model was 80% by the end of 2027 and 95% by the end of 2030, up from 51% at the time of the poll (<a href=\"https:\/\/www.anthropic.com\/research\/ai-expectations-gap\" rel=\"noreferrer noopener\" target=\"_blank\">Anthropic<\/a>).<\/p>\n\n\n\n<figure class=\"wp-block-table\"><div class=\"table-wrapper\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>Lab<\/strong><\/td><td><strong>Target<\/strong><\/td><td><strong>Status<\/strong><\/td><\/tr><tr><td><strong>OpenAI<\/strong><\/td><td>An automated research intern by Sep 2026 and an automated AI researcher by Mar 2028 (<a href=\"https:\/\/openai.com\/index\/research-acceleration-view-inside-openai\/\" rel=\"noreferrer noopener\" target=\"_blank\">OpenAI<\/a>)<\/td><td>Says it reached the intern goal: \u201c<em>According to our measurements, we have now reached the goal<\/em>\u201d (Sep 6, 2026; <a href=\"https:\/\/openai.com\/index\/research-acceleration-view-inside-openai\/\" rel=\"noreferrer noopener\" target=\"_blank\">OpenAI<\/a>)<\/td><\/tr><tr><td><strong>Anthropic<\/strong><\/td><td>\u201c<em>Plausible, as soon as early 2027<\/em>,\u201d that AI could \u201c<em>fully automate, or otherwise dramatically accelerate, the work of large, top-tier teams of human researchers<\/em>\u201d in domains including \u201c<em>AI itself<\/em>\u201d (<a href=\"https:\/\/www.anthropic.com\/responsible-scaling-policy\/roadmap#expectations\" rel=\"noreferrer noopener\" target=\"_blank\">Frontier Safety Roadmap<\/a>)<\/td><td>RSI \u201c<em>is starting to happen across the industry<\/em>\u201d according to Dario Amodei (<a href=\"https:\/\/darioamodei.com\/post\/we-must-pace-the-frontier\" rel=\"noreferrer noopener\" target=\"_blank\">We Must Pace the Frontier<\/a>)<\/td><\/tr><\/tbody><\/table><\/div><figcaption class=\"wp-element-caption\"><strong>Table 5:<\/strong> OpenAI and Anthropic targets for automated AI R&amp;D.<\/figcaption><\/figure>\n\n\n\n<h3 id=\"trend-extrapolation\" class=\"wp-block-heading\">4.2 Trend extrapolation<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>If the measured series simply continue their current trend, most automated-R&amp;D milestones arrive in 2027\u20132028<\/strong>. For that, we refer to an automated <a href=\"https:\/\/takeoff-tracker.streamlit.app\/\" target=\"_blank\" rel=\"noreferrer noopener\">dashboard<\/a> constructed by <a href=\"https:\/\/peterwildeford.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">Peter Wildeford<\/a>.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><div class=\"table-wrapper\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>Series<\/strong><\/td><td><strong>Milestone (dashboard\u2019s definition)<\/strong><\/td><td><strong>Median and 80% interval (<a href=\"https:\/\/takeoff-tracker.streamlit.app\/\" target=\"_blank\" rel=\"noreferrer noopener\">Wildeford (2026) dashboard<\/a>, <a href=\"https:\/\/github.com\/peterhurford\/takeoff-tracker\/tree\/master\">repo<\/a>)<\/strong><\/td><\/tr><tr><td><strong>Anthropic R&amp;D Automation Index<\/strong> (<a href=\"https:\/\/www.anthropic.com\/institute\/measuring-pace-of-ai-development\" rel=\"noreferrer noopener\" target=\"_blank\">Anthropic<\/a>)<\/td><td>90% of tasks fully autonomous (AL5)<\/td><td>May 2028 (Aug 2027\u2013Oct 2029)<\/td><\/tr><tr><td><strong>Anthropic CoBench<\/strong> (<a href=\"https:\/\/www-cdn.anthropic.com\/f61d49fa5596956a5dec75fea0e973bf6a6a8378\/Redacted%20Risk%20Report%20August%202026%20.pdf#page=100\" rel=\"noreferrer noopener\" target=\"_blank\">Risk Report<\/a>)<\/td><td>85% (Anthropic\u2019s internal substitution reference)<\/td><td>Jun 2027 (Jan 2027\u2013Mar 2029)<\/td><\/tr><tr><td><strong>METR 50% time horizon<\/strong> (<a href=\"https:\/\/metr.org\/time-horizons\/\" rel=\"noreferrer noopener\" target=\"_blank\">METR<\/a>)<\/td><td>174 hours (one work-month)<\/td><td>Jun 2027 (Jan 2027\u2013Aug 2028)<\/td><\/tr><tr><td><strong>OpenAI experiment velocity<\/strong> (<a href=\"https:\/\/openai.com\/index\/research-acceleration-view-inside-openai\/\" rel=\"noreferrer noopener\" target=\"_blank\">OpenAI<\/a>)<\/td><td>10\u00d7 the 2025 level<\/td><td>Feb 2028 (May 2027\u2013Aug 2029)<\/td><\/tr><\/tbody><\/table><\/div><figcaption class=\"wp-element-caption\"><strong>Table 6:<\/strong> Trend extrapolations of automated AI R&amp;D milestones from the Wildeford (2026) dashboard. Dates are the dashboard\u2019s defaults, obtained on Nov 3, 2026. AL5 is currently 0% at Anthropic. To extrapolate this metric, the dashboard assumes that AL5 trails AL4+ by a lag informed by the measured gaps between lower levels (AL2+ to AL3+ and AL3+ to AL4+), with wide uncertainty.<\/figcaption><\/figure>\n\n\n\n<h3 id=\"forecasts\" class=\"wp-block-heading\">4.3 Forecasts<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Central estimates for fully automated AI R&amp;D diverge widely, from 2027 to 2052.<\/strong> The earliest come from lab insiders and <a href=\"https:\/\/www.aifutures.org\/\" rel=\"noreferrer noopener\" target=\"_blank\">AI Futures<\/a> forecasters (<a href=\"#individual-forecasts\">Section 4.3.4<\/a>), the latest from the AI researchers surveyed by <a href=\"https:\/\/aiimpacts.org\/\" rel=\"noreferrer noopener\" target=\"_blank\">AI Impacts<\/a> (<a href=\"#expert-and-superforecaster-surveys\">Section 4.3.3<\/a>).<\/p>\n\n\n\n<h4 id=\"prediction-platforms\" class=\"wp-block-heading\">4.3.1 Prediction platforms<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">We first review a few forecasts from prediction platforms, summarized in the table below.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><div class=\"table-wrapper\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>Question<\/strong><\/td><td><strong>Platform<\/strong><\/td><td><strong>Forecast<\/strong><\/td><td><strong>Participation<\/strong><\/td><\/tr><tr><td><a href=\"https:\/\/www.metaculus.com\/questions\/3479\/\" rel=\"noreferrer noopener\" target=\"_blank\"><strong>Weakly general AI<\/strong><\/a> <strong>\/<\/strong> <a href=\"https:\/\/www.metaculus.com\/questions\/5121\/\" rel=\"noreferrer noopener\" target=\"_blank\"><strong>general AI<\/strong><\/a> <strong>announced<\/strong><\/td><td>Metaculus<\/td><td>medians Aug 2027 \/ Sep 2030<\/td><td>1,800 \/ 1,900<\/td><\/tr><tr><td><a href=\"https:\/\/www.metaculus.com\/questions\/38403\/\" rel=\"noreferrer noopener\" target=\"_blank\"><strong>AI-authored paper at NeurIPS, ICML, or ICLR before 2028<\/strong><\/a><\/td><td>Metaculus<\/td><td>85%<\/td><td>135<\/td><\/tr><tr><td><a href=\"https:\/\/www.metaculus.com\/questions\/38590\/\" rel=\"noreferrer noopener\" target=\"_blank\"><strong>Anthropic reaches ASL-4<\/strong><\/a><\/td><td>Metaculus<\/td><td>median May 2028<\/td><td>13<\/td><\/tr><tr><td><a href=\"https:\/\/kalshi.com\/markets\/kxoaiagi\/openai-achieves-agi\/oaiagi\" rel=\"noreferrer noopener\" target=\"_blank\"><strong>OpenAI announces<\/strong> <strong>artificial general intelligence (AGI)<\/strong> <strong>before 2027 \/ 2028 \/ 2030<\/strong><\/a><\/td><td>Kalshi<\/td><td>3.5% \/ 45% \/ 71%<\/td><td>$1.1M total<\/td><\/tr><tr><td><a href=\"https:\/\/polymarket.com\/event\/openai-or-anthropic-announces-recursive-self-improvement-by\" rel=\"noreferrer noopener\" target=\"_blank\"><strong>OpenAI or Anthropic announces RSI by Dec 31, 2026<\/strong><\/a><\/td><td>Polymarket<\/td><td>9%<\/td><td>$5,000 on this contract<\/td><\/tr><tr><td><a href=\"https:\/\/kalshi.com\/markets\/kxrsiannounce\/ai-recursive-selfimprovement-announcements\/kxrsiannounce-29\" rel=\"noreferrer noopener\" target=\"_blank\"><strong>OpenAI or Anthropic announces RSI by 2026 \/ 2027 \/ 2028<\/strong><\/a><\/td><td>Kalshi<\/td><td>11% \/ 57% \/ 77%<\/td><td>$2,100 total<\/td><\/tr><\/tbody><\/table><\/div><figcaption class=\"wp-element-caption\"><strong>Table 7:<\/strong> Forecasts from prediction platforms, as of Nov 3, 2026.<\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">For context, ASL-4 was the next tier of safety measures in Anthropic\u2019s 2025 policy, for models that could dramatically accelerate AI progress (<a href=\"https:\/\/www-cdn.anthropic.com\/872c653b2d0501d6ab44cf87f43e1dc4853e4d37.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">RSP v2.2<\/a>). Anthropic\u2019s 2026 policy (<a href=\"https:\/\/www-cdn.anthropic.com\/files\/4zrzovbb\/website\/0bacdc8440ea96e62a8766d99ebe1d4eea6d5f3a.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">RSP v3.4<\/a>) no longer uses the ASL-4 level.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Forecasters appear bullish on AI R&amp;D, but few relevant questions are both open and liquid.<\/strong> Metaculus\u2019s medians are Aug 2027 for weakly general AI and Sep 2030 for general AI, and its forecasters give 85% to an AI-authored paper at NeurIPS, ICML, or ICLR before 2028. Kalshi\u2019s 45% on OpenAI announcing AGI before 2028 is roughly consistent with the Metaculus median for weakly general AI, though the two definitions differ. The two RSI markets give 9% (<a href=\"https:\/\/polymarket.com\/event\/openai-or-anthropic-announces-recursive-self-improvement-by\" rel=\"noreferrer noopener\" target=\"_blank\">Polymarket<\/a>) and 11% (<a href=\"https:\/\/kalshi.com\/markets\/kxrsiannounce\/ai-recursive-selfimprovement-announcements\/kxrsiannounce-29\" rel=\"noreferrer noopener\" target=\"_blank\">Kalshi<\/a>) to an announcement by the end of 2026, but both are very thin.<\/p>\n\n\n\n<h4 id=\"llm-forecasts-futuresearch\" class=\"wp-block-heading\">4.3.2 LLM forecasts: FutureSearch<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/futuresearch.ai\/recursive-self-improvement-forecast\/\" rel=\"noreferrer noopener\" target=\"_blank\">FutureSearch\u2019s RSI forecasts<\/a> contain 57 LLM forecasts (updated Oct 16, 2026), generated using FutureSearch\u2019s <a href=\"https:\/\/futuresearch.ai\/docs\/reference\/FORECAST\/\" rel=\"noreferrer noopener\" target=\"_blank\">proprietary model<\/a>. We discuss the three closest to this document\u2019s questions.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>FutureSearch\u2019s median for automated AI R&amp;D falls inside the range of the trend extrapolations in <a href=\"#trend-extrapolation\">Section 4.2<\/a>.<\/strong> Its median for a lab saying that a model has crossed, or within a generation will cross, its automated-AI-R&amp;D threshold is Dec 2027 (80% interval: Feb 2027\u2013Jan 2031). FutureSearch\u2019s <a href=\"https:\/\/futuresearch.ai\/app\/p\/a\/frontier-eci-rise-2029?idx=0\" rel=\"noreferrer noopener\" target=\"_blank\">median forecast<\/a> is that the top ECI score will rise by 16 points during calendar year 2029 (80% interval: 9.5\u201328.5 points), close to the current pace of about 14 points a year. It also puts AI R&amp;D uplift at Anthropic today at 1.5\u00d7 (80% interval: 1.25\u20132\u00d7), similar to METR\u2019s preliminary estimate cited in <a href=\"#what-the-labs-report\">Section 3.1<\/a>.<\/p>\n\n\n\n<h4 id=\"expert-and-superforecaster-surveys\" class=\"wp-block-heading\">4.3.3 Expert and superforecaster surveys<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">In a pilot study with METR, we surveyed 8 AI-forecasting experts and 10 superforecasters from Nov 2024 to Feb 2025 (<a href=\"https:\/\/docs.google.com\/document\/d\/1QPvUlFG6-CrcZeXiv541pdt3oxNd2pTcBOOwEnSStRA\/edit?usp=sharing\" rel=\"noreferrer noopener\" target=\"_blank\">FRI write-up<\/a>). Its main outcome was a threefold (3\u00d7) acceleration of AI progress: a two-year period before 2029 with as much growth in effective compute as in the six years from 2018 to 2024. The median expert gave this outcome 20% and the median superforecaster 8%. The survey also asked how likely several AI R&amp;D milestones were by early 2027, and how each milestone would change the chance of a 3\u00d7 acceleration.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><div class=\"table-wrapper\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>Forecast<\/strong><\/td><td><strong>Experts (median)<\/strong><\/td><td><strong>Superforecasters (median)<\/strong><\/td><\/tr><tr><td><strong>3\u00d7 acceleration (main outcome):<\/strong> a two-year window before 2029 with as much effective-compute growth as 2018\u20132024 (<a href=\"https:\/\/docs.google.com\/document\/d\/1QPvUlFG6-CrcZeXiv541pdt3oxNd2pTcBOOwEnSStRA\/edit?usp=sharing\" rel=\"noreferrer noopener\" target=\"_blank\">FRI write-up<\/a>)<\/td><td>20%<\/td><td>8%<\/td><\/tr><tr><td><strong>Top-researcher replacement:<\/strong> in Jan 2027, almost everyone informed agrees that \u201c<em>An AI system can act as a full replacement, for AI research and development purposes, for a top (i.e. within the top 0.01%) 2024 AI researcher<\/em>\u201d (<a href=\"https:\/\/docs.google.com\/document\/d\/1QPvUlFG6-CrcZeXiv541pdt3oxNd2pTcBOOwEnSStRA\/edit?usp=sharing\" rel=\"noreferrer noopener\" target=\"_blank\">FRI write-up<\/a>)<\/td><td>5.5%<\/td><td>20%<\/td><\/tr><tr><td><strong>Month-long projects:<\/strong> AI beats a five-person team on 80% of month-long, open-ended ML projects while using 20% fewer resources, by early 2027 (<a href=\"https:\/\/docs.google.com\/document\/d\/1QPvUlFG6-CrcZeXiv541pdt3oxNd2pTcBOOwEnSStRA\/edit?usp=sharing\" rel=\"noreferrer noopener\" target=\"_blank\">FRI write-up<\/a>)<\/td><td>31.5%<\/td><td>45%<\/td><\/tr><\/tbody><\/table><\/div><figcaption class=\"wp-element-caption\"><strong>Table 8:<\/strong> Median forecasts of experts and superforecasters in our pilot survey with METR.<\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">In our reading, the month-long-projects forecast is close to resolving No. The \u201cmonth-long projects\u201d scenario needs more than a one-month (174-hour) 50% time horizon by early 2027. By Epoch\u2019s rule of thumb, \u201c<em>a 5 point gain in ECI appeared to roughly correspond to a doubling of the METR Time Horizon<\/em>\u201d (<a href=\"https:\/\/epoch.ai\/data\/eci-documentation\/faq\" rel=\"noreferrer noopener\" target=\"_blank\">Epoch<\/a>). A one-month horizon is about 5.6 doublings above GPT-5 (ECI 150; about 3.6 hours, <a href=\"https:\/\/metr.org\/time-horizons\/\" rel=\"noreferrer noopener\" target=\"_blank\">METR<\/a>), or an ECI of about 178, which the ECI frontier reaches around mid-2027 on trend. We are not aware of an evaluation that measures month-long projects directly; the closest, <a href=\"https:\/\/arxiv.org\/abs\/2607.27191\" rel=\"noreferrer noopener\" target=\"_blank\">CRUX 2<\/a> (week-long), was rejected. The top-researcher replacement scenario also looks unlikely by Jan 2027.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In a separate expert survey, <strong>ML researchers surveyed by<\/strong> <a href=\"https:\/\/aiimpacts.org\/\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>AI Impacts<\/strong><\/a> <strong>expect late AI R&amp;D automation.<\/strong> Respondents (1,580 authors at top AI venues, surveyed in Dec 2024, with a 10% response rate) put the median date for AI fully automating the job of AI researcher at 2052 (<em>n<\/em> = 458; <a href=\"https:\/\/aiimpacts.org\/wp-content\/uploads\/2026\/09\/ESPAI2024.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">ESPAI 2024<\/a>, p. 4 and Table 6, p. 43).<sup data-fn=\"2eff2f83-47ad-45e4-bcfd-1ba39b647a7b\" class=\"fn\"><a href=\"#2eff2f83-47ad-45e4-bcfd-1ba39b647a7b\" id=\"2eff2f83-47ad-45e4-bcfd-1ba39b647a7b-link\">9<\/a><\/sup> When asked to rate the intelligence-explosion argument (i.e., if AI does nearly all R&amp;D, technological progress could become \u201c<em>more than an order of magnitude faster<\/em>\u201d in less than five years; <em>n<\/em> = 189), respondents were split: 28% found it likely or quite likely, 23% gave it about even odds, and 49% found it unlikely or quite unlikely (<a href=\"https:\/\/aiimpacts.org\/wp-content\/uploads\/2026\/09\/ESPAI2024.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">ESPAI 2024<\/a>, pp. 16\u201317, Figure 8).<\/p>\n\n\n\n<h4 id=\"individual-forecasts\" class=\"wp-block-heading\">4.3.4 Individual forecasts<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">The table below shows some notable individual forecasts.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><div class=\"table-wrapper\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>Who<\/strong><\/td><td><strong>Full automation of AI R&amp;D (central estimate; our reading)<\/strong><\/td><td><strong>Forecast<\/strong><\/td><td><strong>Made<\/strong><\/td><\/tr><tr><td><strong>AI 2027<\/strong>, a scenario by Daniel Kokotajlo, Eli Lifland, Thomas Larsen, and Romeo Dean of the AI Futures Project, with input from Scott Alexander (<a href=\"https:\/\/ai-2027.com\/about\" rel=\"noreferrer noopener\" target=\"_blank\">About<\/a>)<\/td><td>2027 (scenario)<\/td><td>Scenario: superhuman coder Mar 2027, superhuman AI researcher Aug 2027 (<a href=\"https:\/\/ai-2027.com\/\" rel=\"noreferrer noopener\" target=\"_blank\">AI 2027<\/a>)<\/td><td>Apr 2025<\/td><\/tr><tr><td><strong>Leopold Aschenbrenner<\/strong>, founder of the hedge fund Situational Awareness LP and author of <em>Situational Awareness<\/em>; formerly on OpenAI\u2019s Superalignment team (<a href=\"https:\/\/en.wikipedia.org\/wiki\/Leopold_Aschenbrenner\" rel=\"noreferrer noopener\" target=\"_blank\">Wikipedia<\/a>)<\/td><td>2027<\/td><td>\u201c<em>it is strikingly plausible that by 2027, models will be able to do the work of an AI researcher\/engineer<\/em>\u201d (<a href=\"https:\/\/situational-awareness.ai\/from-gpt-4-to-agi\/\" rel=\"noreferrer noopener\" target=\"_blank\">Ch. I<\/a>)<\/td><td>Jun 2024<\/td><\/tr><tr><td><strong>Jack Clark<\/strong>, Anthropic cofounder and Head of Public Benefit, who leads the Anthropic Institute (<a href=\"https:\/\/www.anthropic.com\/news\/the-anthropic-institute\" rel=\"noreferrer noopener\" target=\"_blank\">Anthropic<\/a>)<\/td><td>2027<\/td><td>\u201c<em>I now think it\u2019s more likely we\u2019ll see full RSI become possible in 2027<\/em>\u201d (<a href=\"https:\/\/jack-clark.net\/2026\/10\/12\/import-ai-476-creativity-and-rsi-worse-than-china-open-weight-models-ai-goes-to-space\/\" rel=\"noreferrer noopener\" target=\"_blank\">Import AI 476<\/a>); in May 2026 he gave 30% by 2027 and \u201c<em>a likely chance (60%+)<\/em>\u201d of \u201c<em>no-human-involved AI R&amp;D<\/em>\u201d by the end of 2028 (<a href=\"https:\/\/jack-clark.net\/2026\/05\/04\/import-ai-455-automating-ai-research\/\" rel=\"noreferrer noopener\" target=\"_blank\">Import AI 455<\/a>)<\/td><td>May and Oct 2026<\/td><\/tr><tr><td><strong>Dario Amodei<\/strong>, Anthropic cofounder and CEO; formerly vice president of research at OpenAI (<a href=\"https:\/\/en.wikipedia.org\/wiki\/Dario_Amodei\" rel=\"noreferrer noopener\" target=\"_blank\">Wikipedia<\/a>)<\/td><td>2027\u20132028<\/td><td>The AI feedback loop \u201c<em>may be only 1\u20132 years away from a point where the current generation of AI autonomously builds the next<\/em>\u201d (<a href=\"https:\/\/www.darioamodei.com\/essay\/the-adolescence-of-technology\" rel=\"noreferrer noopener\" target=\"_blank\">The Adolescence of Technology<\/a>); RSI \u201c<em>is starting to happen across the industry<\/em>\u201d (<a href=\"https:\/\/darioamodei.com\/post\/we-must-pace-the-frontier\" rel=\"noreferrer noopener\" target=\"_blank\">We Must Pace the Frontier<\/a>)<\/td><td>Jan and Sep 2026<\/td><\/tr><tr><td><strong>Daniel Kokotajlo<\/strong>, Executive Director of the AI Futures Project; formerly a governance researcher at OpenAI (<a href=\"https:\/\/www.aifutures.org\/about\" rel=\"noreferrer noopener\" target=\"_blank\">AI Futures Project<\/a>)<\/td><td>End of 2028<\/td><td>AI doing \u201c<em>the whole research process<\/em>\u201d: \u201c<em>about 50% chance by end of 2028<\/em>\u201d (<a href=\"https:\/\/blog.aifutures.org\/p\/senate-testimony-sept-2026\" rel=\"noreferrer noopener\" target=\"_blank\">Senate testimony<\/a>); automated coder: median Nov 2027, 80% interval Jan 2027\u2013Apr 2030 (<a href=\"https:\/\/blog.aifutures.org\/p\/q25-2026-timelines-update-uplift\" rel=\"noreferrer noopener\" target=\"_blank\">AI Futures<\/a>)<\/td><td>Aug and Sep 2026<\/td><\/tr><tr><td><strong>Ryan Greenblatt<\/strong>, member of technical staff at METR; formerly chief scientist at Redwood Research (<a href=\"https:\/\/www.linkedin.com\/in\/ryan-greenblatt-4b9907134\" rel=\"noreferrer noopener\" target=\"_blank\">LinkedIn<\/a>)<\/td><td>2030\u20132031<\/td><td>Full automation by end of 2028: \u201c<em>a bit below 30%<\/em>,\u201d up from about 15%; median for AI R&amp;D parity early 2031 (<a href=\"https:\/\/www.lesswrong.com\/posts\/dKpC6wHFqDrGZwnah\/ais-can-now-often-do-massive-easy-to-verify-swe-tasks-and-i\" rel=\"noreferrer noopener\" target=\"_blank\">LessWrong<\/a>). Later: \u201c<em>full automation of AI R&amp;D perhaps somewhere around 2031, 2030<\/em>\u201d (<a href=\"https:\/\/www.dwarkesh.com\/p\/ryan-greenblatt\" rel=\"noreferrer noopener\" target=\"_blank\">Dwarkesh<\/a>)<\/td><td>Apr and Aug 2026<\/td><\/tr><tr><td><strong>Eli Lifland<\/strong>, research lead at the AI Futures Project (<a href=\"https:\/\/www.aifutures.org\/about\" rel=\"noreferrer noopener\" target=\"_blank\">AI Futures Project<\/a>) and member of the Samotsvety forecasting team (<a href=\"https:\/\/samotsvety.org\/track-record\/\" rel=\"noreferrer noopener\" target=\"_blank\">Samotsvety<\/a>)<\/td><td>After 2030<\/td><td>Automated coder: median Jan 2030, 80% interval Jun 2027\u2013Oct 2070; superintelligence: median Jul 2033 (<a href=\"https:\/\/blog.aifutures.org\/p\/q25-2026-timelines-update-uplift\" rel=\"noreferrer noopener\" target=\"_blank\">AI Futures<\/a>)<\/td><td>Aug 2026<\/td><\/tr><tr><td><strong>Andrej Karpathy<\/strong>, OpenAI founding member and former director of AI at Tesla; joined Anthropic in May 2026, after this forecast (<a href=\"https:\/\/en.wikipedia.org\/wiki\/Andrej_Karpathy\" rel=\"noreferrer noopener\" target=\"_blank\">Wikipedia<\/a>)<\/td><td>About 2035 (AI agents that work like an employee or intern)<\/td><td>AI agents should work \u201c<em>almost like an employee or an intern that you would hire,<\/em>\u201d but \u201c<em>They\u2019re cognitively lacking and it\u2019s just not working. It will take about a decade to work through all of those issues<\/em>\u201d (<a href=\"https:\/\/dwarkesh.com\/p\/andrej-karpathy\" rel=\"noreferrer noopener\" target=\"_blank\">Dwarkesh<\/a>)<\/td><td>Oct 2025<\/td><\/tr><tr><td><strong>Ilya Sutskever<\/strong>, cofounder and CEO of Safe Superintelligence Inc.; formerly cofounder and chief scientist of OpenAI (<a href=\"https:\/\/en.wikipedia.org\/wiki\/Ilya_Sutskever\" rel=\"noreferrer noopener\" target=\"_blank\">Wikipedia<\/a>)<\/td><td>2030\u20132045 (AI that learns as well as a human, then becomes superhuman)<\/td><td>Asked when AI that \u201c<em>can learn as well as a human<\/em>\u201d will \u201c<em>become superhuman<\/em>\u201d: \u201c<em>I think like 5 to 20<\/em>\u201d years (<a href=\"https:\/\/www.dwarkesh.com\/p\/ilya-sutskever-2\" rel=\"noreferrer noopener\" target=\"_blank\">Dwarkesh<\/a>)<\/td><td>Nov 2025<\/td><\/tr><tr><td><strong>Toby Ord<\/strong>, philosopher and author of <em>The Precipice<\/em> (<a href=\"https:\/\/en.wikipedia.org\/wiki\/Toby_Ord\" rel=\"noreferrer noopener\" target=\"_blank\">Wikipedia<\/a>)<\/td><td>About 2038 (transformative AI)<\/td><td>Transformative AI, which is \u201c<em>doubling the rate of scientific and technological progress<\/em>\u201d: \u201c<em>a median of 2038 and an 80% interval ranging from 3 years to 100 years<\/em>\u201d; \u201c<em>about a 1 in 5 chance<\/em>\u201d in the next five years (<a href=\"https:\/\/www.forethought.org\/research\/broad-timelines\" rel=\"noreferrer noopener\" target=\"_blank\">Forethought<\/a>)<\/td><td>Mar 2026<\/td><\/tr><tr><td><strong>Arvind Narayanan and Sayash Kapoor<\/strong>, authors of <em>AI as Normal Technology<\/em>. Narayanan is a professor of computer science at Princeton University (<a href=\"https:\/\/www.cs.princeton.edu\/~arvindn\/bio\" rel=\"noreferrer noopener\" target=\"_blank\">bio<\/a>); Kapoor is an incoming assistant professor at the UC Berkeley School of Information (<a href=\"https:\/\/cs.princeton.edu\/~sayashk\/bio.html\" rel=\"noreferrer noopener\" target=\"_blank\">bio<\/a>)<\/td><td>No explicit date; gradual, not soon<\/td><td>\u201c<em>It is more likely that we will continue to see a gradual increase in the role of automation in AI development than a singular, discontinuous moment when recursive self-improvement is achieved<\/em>\u201d (<a href=\"https:\/\/knightcolumbia.org\/content\/ai-as-normal-technology\" rel=\"noreferrer noopener\" target=\"_blank\">AI as Normal Technology<\/a>); in a joint post with the AI 2027 authors, they \u201c<em>do not expect \u2018strong AGI\u2019 to arrive anytime soon<\/em>\u201d (<a href=\"https:\/\/asteriskmag.substack.com\/p\/common-ground-between-ai-2027-and\" rel=\"noreferrer noopener\" target=\"_blank\">Asterisk<\/a>)<\/td><td>Apr and Nov 2025<\/td><\/tr><\/tbody><\/table><\/div><figcaption class=\"wp-element-caption\"><strong>Table 9:<\/strong> Notable individual forecasts of full automation of AI R&amp;D, ordered by timeline.<\/figcaption><\/figure>\n\n\n\n<h2 id=\"key-cruxes\" class=\"wp-block-heading\">5. Key cruxes<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Broad acceleration through automated AI R&amp;D needs three contested steps to happen in turn.<\/strong> The diagram below provides our map of the cruxes and shows four main possible outcomes, ranging from an AI research assistant to broad acceleration. The table below provides sample statements of each side.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\" id=\"fig-04\"><img decoding=\"async\" src=\"https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/paper_2026-10-12_recursive-self-improvement_fig-04.png\" alt=\"Figure 4: RSI crux framework.\"\/><figcaption class=\"wp-element-caption\"><strong>Figure 4:<\/strong> RSI crux framework.<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-table\"><div class=\"table-wrapper\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>Step<\/strong><\/td><td><strong>Main crux<\/strong><\/td><td><strong>Yes<\/strong><\/td><td><strong>No<\/strong><\/td><\/tr><tr><td><strong>1. Is AI R&amp;D automated?<\/strong><sup data-fn=\"3f12883d-b8d9-4abb-99b5-5632af88fac9\" class=\"fn\"><a href=\"#3f12883d-b8d9-4abb-99b5-5632af88fac9\" id=\"3f12883d-b8d9-4abb-99b5-5632af88fac9-link\">10<\/a><\/sup><\/td><td>Can AI supply research taste and judgment (choosing problems, judging results), or only implementation? Can it stay reliable on long, open-ended projects?<\/td><td>\u201c<em>I\u2019m probably less sympathetic to the idea that the thing the AIs will lack is some deep insight<\/em>\u201d; ML \u201c<em>is a less deep domain than math<\/em>\u201d (Ryan Greenblatt, <a href=\"https:\/\/www.dwarkesh.com\/p\/ryan-greenblatt\" rel=\"noreferrer noopener\" target=\"_blank\">Dwarkesh<\/a>); if AI can \u201c<em>creatively problem solve to succeed at science<\/em>,\u201d that is a sign of its ability to \u201c<em>generalize into many domains, including certainly AI research itself<\/em>\u201d (Jack Clark, <a href=\"https:\/\/importai.substack.com\/p\/import-ai-477-in-which-i-tell-the\" rel=\"noreferrer noopener\" target=\"_blank\">Import AI 477<\/a>)<\/td><td>\u201c<em>If you can get the AI to do any experiment, you still need to decide what experiments to do. Right now I think AIs are not very good at this compared to coding the experiment<\/em>\u201d (Beren Millidge, <a href=\"https:\/\/www.dwarkesh.com\/p\/john-beren-charlie\" rel=\"noreferrer noopener\" target=\"_blank\">Dwarkesh<\/a>); defining the objective is \u201c<em>the last job for humans<\/em>\u201d (John Schulman, <a href=\"https:\/\/www.dwarkesh.com\/p\/john-beren-charlie\" rel=\"noreferrer noopener\" target=\"_blank\">Dwarkesh<\/a>); \u201c<em>creativity, among other dimensions of intelligence, is the epitome of an unverifiable task<\/em>\u201d (Arvind Narayanan, <a href=\"https:\/\/www.normaltech.ai\/p\/what-will-be-left-for-us-to-work\" rel=\"noreferrer noopener\" target=\"_blank\">ICML keynote<\/a>)<\/td><\/tr><tr><td><strong>2. If AI R&amp;D is automated, does AI capability progress accelerate sharply?<\/strong><\/td><td>Does automated AI R&amp;D sharply accelerate AI capability progress, for example in a software intelligence explosion (SIE)? Or do diminishing returns (\u201c<em>ideas become harder to find<\/em>\u201d; <a href=\"https:\/\/arxiv.org\/pdf\/2609.15802\" rel=\"noreferrer noopener\" target=\"_blank\">Cunningham et al.<\/a>, 2026) or bottlenecks such as compute, data, or regulation cap the acceleration?<\/td><td>An SIE is \u201c<em>at least decently likely<\/em>\u201d even \u201c<em>if hardware were held constant<\/em>\u201d (Daniel Eth and Tom Davidson, <a href=\"https:\/\/www.forethought.org\/research\/will-ai-r-and-d-automation-cause-a-software-intelligence-explosion\" rel=\"noreferrer noopener\" target=\"_blank\">Forethought<\/a>); \u201c<em>four or five years of AI progress in a single year<\/em>\u201d (Ryan Greenblatt, <a href=\"https:\/\/www.dwarkesh.com\/p\/ryan-greenblatt\" rel=\"noreferrer noopener\" target=\"_blank\">Dwarkesh<\/a>); on data bottlenecks, \u201c<em>I\u2019d be surprised if they make the SIE take &gt;2x as long<\/em>\u201d (Tom Davidson, <a href=\"https:\/\/www.forethought.org\/research\/data-bottlenecks\" rel=\"noreferrer noopener\" target=\"_blank\">Forethought<\/a>)<\/td><td>Feedback loops \u201c<em>are not currently strong enough to generate a self-sustaining acceleration, though they appear to be strengthening<\/em>\u201d (<a href=\"https:\/\/arxiv.org\/pdf\/2609.15802\" rel=\"noreferrer noopener\" target=\"_blank\">Cunningham et al.<\/a>, 2026); the loop \u201c<em>would need to be roughly 5\u201310\u00d7 stronger to sustain itself<\/em>\u201d (Ramez Naam, <a href=\"https:\/\/www.noahpinion.blog\/p\/wheres-the-intelligence-explosion\" rel=\"noreferrer noopener\" target=\"_blank\">Noahpinion<\/a>), on his assumption of 2\u20133% more AI R&amp;D productivity per ECI point, against about 9% in <a href=\"https:\/\/arxiv.org\/pdf\/2609.15802\" rel=\"noreferrer noopener\" target=\"_blank\">Cunningham et al.<\/a>, 2026; \u201c<em>political and social barriers could stop [a self-sustaining acceleration] in its tracks<\/em>\u201d (<a href=\"https:\/\/arxiv.org\/pdf\/2609.15802\" rel=\"noreferrer noopener\" target=\"_blank\">Cunningham et al.<\/a>, 2026, p. 31)<\/td><\/tr><tr><td><strong>3. If progress accelerates sharply, are the capability gains broad?<\/strong><\/td><td>Do capabilities outside AI R&amp;D also accelerate, across most sciences and most economic activities? Or do hard-to-verify domains, physical tasks, and the need for real-world data confine the gains to AI and easily verified tasks?<\/td><td>AI could \u201c<em>compress the progress that human biologists would have achieved over the next 50-100 years into 5-10 years<\/em>\u201d (Dario Amodei, <a href=\"https:\/\/darioamodei.com\/machines-of-loving-grace\" rel=\"noreferrer noopener\" target=\"_blank\">Machines of Loving Grace<\/a>); \u201c<em>in competitive industries, AI will learn to automate most work within a year of the SIE<\/em>\u201d (Tom Davidson, <a href=\"https:\/\/www.forethought.org\/research\/data-bottlenecks\" rel=\"noreferrer noopener\" target=\"_blank\">Forethought<\/a>)<\/td><td>\u201c<em>I don\u2019t think that automating AI R&amp;D will rapidly produce domain-general superintelligence<\/em>\u201d; the singularity \u201c<em>will be bottlenecked on signal<\/em>\u201d (Tom Reed, <a href=\"https:\/\/meagreprotestanthistory.substack.com\/p\/the-goodhart-singularity\" rel=\"noreferrer noopener\" target=\"_blank\">Substack<\/a>); \u201c<em>the external bottlenecks to building and deploying powerful AI systems cannot be overcome by improving their technical design<\/em>\u201d (Arvind Narayanan and Sayash Kapoor, <a href=\"https:\/\/www.normaltech.ai\/p\/a-guide-to-understanding-ai-as-normal\" rel=\"noreferrer noopener\" target=\"_blank\">Normal Tech<\/a>)<\/td><\/tr><\/tbody><\/table><\/div><figcaption class=\"wp-element-caption\"><strong>Table 10:<\/strong> The main crux at each step, with sample statements for each side.<\/figcaption><\/figure>\n\n\n\n<h2 id=\"forecasting-questions\" class=\"wp-block-heading\">6. Forecasting questions<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>To understand the future of RSI, we developed 18 forecasting questions.<\/strong> Figure 5 shows which step of the crux framework (<a href=\"#key-cruxes\">Section 5<\/a>) each question group informs:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Group 1 asks how much AI R&amp;D work AI will do on its own, and how well AI agents will do open-ended research.<\/li>\n\n\n\n<li>Group 2 asks how fast the ECI frontier will rise.<\/li>\n\n\n\n<li>Group 3 asks whether a fast year will happen and, if one happens, whether AI automation of AI R&amp;D caused it.<\/li>\n\n\n\n<li>Group 4 asks how far the best models inside AI companies will lead the ECI frontier.<\/li>\n\n\n\n<li>Group 5 asks how a fast year would change the chances of expert AGI and an AI catastrophe by 2050.<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>We are asking a group of top human forecasters and AI experts to forecast these questions.<\/strong> We plan to add their forecasts in a later update of this document.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">These questions did well in our internal testing. They capture real disagreements, and the reasons for these disagreements follow the cruxes in <a href=\"#key-cruxes\">Section 5<\/a>. In an internal survey (Oct 2026, <em>n<\/em> = 11), our team members gave between 8% and 75% to a fast year by the end of 2030. The fast year also matters for broader outcomes. In a separate internal survey (<em>n<\/em> = 4), all respondents gave a higher probability to expert AGI and to an AI catastrophe by 2050 if a fast year happens by 2030.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The table below lists each question in short form, together with the LLM forecast, generated by an ensemble of frontier LLMs (<a href=\"#llm-forecasts\">Section 6.1<\/a>). Numeric questions ask for P10, P50, and P90 (the 10th, 50th, and 90th percentiles), and yes-or-no questions ask for a probability. The <a href=\"#appendix\">Appendix<\/a> gives the full questions, with definitions and resolution criteria.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\" id=\"fig-05\"><img decoding=\"async\" src=\"https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/paper_2026-10-12_recursive-self-improvement_fig-05.png\" alt=\"Figure 5: Question groups mapped to the crux steps.\"\/><figcaption class=\"wp-element-caption\"><strong>Figure 5:<\/strong> Question groups mapped to the crux steps.<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-table\"><div class=\"table-wrapper\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>ID<\/strong><\/td><td><strong>Question<\/strong><\/td><td><strong>LLM forecast<\/strong><\/td><\/tr><tr><td>Q1.1<\/td><td>AL5 share of AI R&amp;D work at the leading AI company, Dec 31, 2027<\/td><td>8.3% (80% interval: 0.9\u201334.5%)<\/td><\/tr><tr><td>Q1.2<\/td><td>The same, Dec 31, 2030<\/td><td>41.2% (80% interval: 5.6\u201387.2%)<\/td><\/tr><tr><td>Q1.3<\/td><td>Average NeurIPS score (1\u20136) of the best agent\u2019s papers in a CRUX 2 re-run started on Dec 31, 2027<\/td><td>2.8 (80% interval: 1.6\u20134.1)<\/td><\/tr><tr><td>Q1.4<\/td><td>Both milestones by Dec 31, 2030: an AL5 share above 50%, and a CRUX 2 re-run with an average score of at least 4<\/td><td>32.7%<\/td><\/tr><tr><td>Q2.1<\/td><td>ECI frontier, Dec 31, 2027<\/td><td>187.9 (80% interval: 179.5\u2013201.4)<\/td><\/tr><tr><td>Q2.2<\/td><td>ECI frontier, Dec 31, 2030<\/td><td>240.3 (80% interval: 208.1\u2013303.9)<\/td><\/tr><tr><td>Q2.3<\/td><td>If both milestones (Q1.4) happen by Dec 31, 2030: ECI frontier gain in the 12 months after<\/td><td>33.1 (80% interval: 13.1\u201389.0)<\/td><\/tr><tr><td>Q3.1<\/td><td>A fast year (30+ ECI points in 12 months) by Dec 31, 2027<\/td><td>10%<\/td><\/tr><tr><td>Q3.2<\/td><td>A fast year by Dec 31, 2030<\/td><td>39.6%<\/td><\/tr><tr><td>Q3.3<\/td><td>If a fast year happens by Dec 31, 2030: ECI frontier gain in the 12 months after the first fast year<\/td><td>29.8 (80% interval: 11.2\u201376.3)<\/td><\/tr><tr><td>Q3.4<\/td><td>If a fast year happens by Dec 31, 2030: probability that AI automation of AI R&amp;D caused it<\/td><td>69.6%<\/td><\/tr><tr><td>Q4.1<\/td><td>Internal lead over the ECI frontier, Dec 31, 2027<\/td><td>6.4 (80% interval: 1.6\u201316.6)<\/td><\/tr><tr><td>Q4.2<\/td><td>Internal lead, Dec 31, 2030<\/td><td>10.1 (80% interval: 2.2\u201340.3)<\/td><\/tr><tr><td>Q4.3<\/td><td>If both milestones (Q1.4) happen by Dec 31, 2030: internal lead 12 months after<\/td><td>16.5 (80% interval: 3.8\u201361.2)<\/td><\/tr><tr><td>Q5.1<\/td><td>If a fast year happens by Dec 31, 2030: expert AGI by 2050<\/td><td>84.3%<\/td><\/tr><tr><td>Q5.2<\/td><td>If no fast year happens by Dec 31, 2030: expert AGI by 2050<\/td><td>55.7%<\/td><\/tr><tr><td>Q5.3<\/td><td>If a fast year happens by Dec 31, 2030: AI catastrophe by 2050<\/td><td>8.4%<\/td><\/tr><tr><td>Q5.4<\/td><td>If no fast year happens by Dec 31, 2030: AI catastrophe by 2050<\/td><td>2.9%<\/td><\/tr><\/tbody><\/table><\/div><figcaption class=\"wp-element-caption\"><strong>Table 11:<\/strong> Forecasting questions in short form, with LLM forecasts made on Oct 29, 2026 ( Section 6.1 ). Numeric forecasts show the median and the 80% interval (P10\u2013P90). For full forecasting questions (including definitions and resolution criteria), see <a href=\"#appendix\" data-type=\"internal\" data-id=\"#appendix\">the Appendix<\/a>.<\/figcaption><\/figure>\n\n\n\n<h3 id=\"llm-forecasts\" class=\"wp-block-heading\">6.1 LLM forecasts<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Methods.<\/strong> To get an initial set of forecasts, we had an ensemble of four frontier LLMs forecast all 18 questions. Forecasts were generated on Oct 29, 2026. The ensemble consisted of Claude Opus 5.5, Claude Sonnet 5.5, Claude Fable 5.1, and GPT-6 Astra (i.e., three models from Anthropic and one from OpenAI). Each LLM did its own web research and answered every question five times, with a different prompt each time. The LLMs had the survey questions but not this document. For each LLM, we average its five forecasts; the ensemble forecast then is the median of the four means. To generate these LLM forecasts, we used the forecasting pipeline of our <a href=\"https:\/\/forecastingresearch.org\/research\/airo\" target=\"_blank\" rel=\"noreferrer noopener\">Automated AI Risk Outlook<\/a> (AIRO), which we also use for an AI risk dashboard (<a href=\"https:\/\/github.com\/forecastingresearch\/airo\" target=\"_blank\" rel=\"noreferrer noopener\">GitHub repo<\/a>).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Results. The ensemble forecasts that AI will soon do much more AI R&amp;D, but not all of it.<\/strong> Its median AL5 share of AI R&amp;D work is 8.3% at the end of 2027 and 41.2% at the end of 2030. Today, Anthropic rates no part of its AI R&amp;D work at AL5 (<a href=\"#what-the-labs-report\">Section 3.1<\/a>). For a CRUX 2 re-run at the end of 2027, the median score is 2.8. This is below a score of 4 (\u201c<em>Borderline accept<\/em>\u201d), but above the scores of 1 and 2 that the CRUX 2 papers got (<a href=\"#public-evidence\">Section 3.2<\/a>). The ensemble gives 32.7% to both milestones by the end of 2030.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The ensemble\u2019s medians for the ECI frontier are close to the trend: 187.9 ECI points at the end of 2027 and 240.3 at the end of 2030. Both are inside the 80% intervals of the simple trend model in <a href=\"#measuring-capability-progress\">Section 2.3<\/a>. <strong>The ensemble gives 10% to a fast year by the end of 2027 and 39.6% by the end of 2030<\/strong>, similar to but somewhat below the trend model (17% and 44%, respectively)<strong>.<\/strong> The four LLMs disagree substantially on this probability: for a fast year by the end of 2030, their forecasts range from 35% (Claude Sonnet 5.5) to almost 56% (GPT-6 Astra). If a fast year happens, the ensemble gives 69.6% that AI automation of AI R&amp;D caused it, i.e., a fast year would most likely be caused by automated AI R&amp;D.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>The ensemble predicts that the gap between the best internal and public models will grow.<\/strong> The median internal lead is 6.4 ECI points at the end of 2027 and 10.1 at the end of 2030, against our estimate of about 3.5\u20134.5 points today (<a href=\"#measuring-capability-progress\">Section 2.3<\/a>). The 80% intervals are wide, up to 40.3 points in 2030, as companies could keep their best models internal after automating AI R&amp;D.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A fast year substantially impacts the ensemble\u2019s forecasts of expert AGI and AI catastrophe. With a fast year by 2030, it gives 84.3% to expert AGI and 8.4% to an AI catastrophe by 2050. Without a fast year, it predicts 55.7% and 2.9%. In particular, <strong>the ensemble\u2019s forecast of an AI catastrophe is almost 3\u00d7 higher conditional on a fast year.<\/strong> For comparison, the median expert in our Longitudinal Expert AI Panel (LEAP) gave 2% to an AI catastrophe by 2050 (<a href=\"https:\/\/leap.forecastingresearch.org\/reports\/wave9\" target=\"_blank\" rel=\"noreferrer noopener\">LEAP Wave 9<\/a>) and 80% to AGI by 2100 (i.e., with a much longer time horizon; <a href=\"https:\/\/leap.forecastingresearch.org\/reports\/wave8\" target=\"_blank\" rel=\"noreferrer noopener\">LEAP Wave 8<\/a>).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">These forecasts are mainly illustrative, and we are currently collecting forecasts from top human forecasters and AI experts. That said, on <a href=\"https:\/\/www.forecastbench.org\/\" target=\"_blank\" rel=\"noreferrer noopener\">ForecastBench<\/a>, our forecasting benchmark, several LLMs are now statistically indistinguishable from superforecasters (<a href=\"https:\/\/forecastingresearch.substack.com\/p\/ai-models-have-likely-reached-parity\" target=\"_blank\" rel=\"noreferrer noopener\">FRI<\/a>). In our tests, more capable models are also more accurate at forecasting rare events (<a href=\"https:\/\/forecastingresearch.substack.com\/p\/automating-catastrophic-risk-forecasts\" target=\"_blank\" rel=\"noreferrer noopener\">AIRO launch post<\/a>). As a result, we think that these forecasts provide an informative initial benchmark.<\/p>\n\n\n\n<h2 id=\"takeaways\" class=\"wp-block-heading\">7. Takeaways<\/h2>\n\n\n\n<ol class=\"wp-block-list\">\n<li>As of early Nov 2026, <strong>AI acts as a highly capable research assistant but is still lacking in research judgment.<\/strong> At Anthropic, AI writes over 90% of contributions to the codebase (Sep 2026). However, humans still decide which research areas to focus on. The evidence on research judgment by AIs is limited and mostly qualitative but suggests important gaps (<a href=\"#what-the-labs-report\">Sections 3.1<\/a>\u2013<a href=\"#public-evidence\">3.2<\/a>).<\/li>\n\n\n\n<li><strong>AI capability progress has not clearly accelerated on public measures.<\/strong> The frontier of the Epoch Capabilities Index has risen by about 14 points a year over the past two years; the largest rise in any 12-month window so far is 21 points (<a href=\"#measuring-capability-progress\">Section 2.3<\/a>). However, the rate of discovery appears to have accelerated in 2026: sharply for cyber vulnerabilities, according to METR, and increasingly for math as well (<a href=\"#public-evidence\">Section 3.2<\/a>).<\/li>\n\n\n\n<li><strong>There is some internal evidence from frontier AI companies indicating a potential acceleration.<\/strong> A preliminary external METR assessment estimates \u201c<em>~1.5X overall acceleration in capabilities due to AI<\/em>\u201d inside Anthropic, and both Sam Altman and Dario Amodei describe signs of early RSI (<a href=\"#what-the-labs-report\">Sections 3.1<\/a> and <a href=\"#lab-targets\">4.1<\/a>).\n\n\n<ol style=\"list-style-type:lower-alpha\" class=\"wp-block-list\">\n<li><strong>Note:<\/strong> After our data cutoff of Nov 3, 2026, METR published a <a href=\"https:\/\/metr.org\/blog\/2026-11-05-anthropic-ai-rd-acceleration-assessment\/#evidence-of-ai-speedup\">report<\/a> in which it estimates that capability progress at Anthropic is now about 2\u00d7 its earlier rate (range 1.3\u20133\u00d7), with around 80% of this acceleration attributed to AI. This estimate applies to Anthropic only and includes unreleased models. If this pace holds and reaches public models, it would roughly match the pace of a fast year.<sup data-fn=\"1ba92cbb-259e-4f5e-9413-1e8a8571930b\" class=\"fn\"><a href=\"#1ba92cbb-259e-4f5e-9413-1e8a8571930b\" id=\"1ba92cbb-259e-4f5e-9413-1e8a8571930b-link\">11<\/a><\/sup> Our LLM forecasts were generated on Oct 29, 2026, before the METR report was released.<\/li>\n<\/ol>\n<\/li>\n\n\n\n<li><strong>On a simple extrapolation of current trends, mostly using company-reported metrics, AI could take over most AI R&amp;D tasks by 2027\u20132028<\/strong>, consistent with OpenAI&#8217;s target of an automated AI researcher by Mar 2028 (<a href=\"#lab-targets\">Sections 4.1<\/a>\u2013<a href=\"#trend-extrapolation\">4.2<\/a>). However, other forecasts diverge widely: central estimates for full automation of AI R&amp;D range from 2027 (lab insiders and AI Futures) to 2052 (the AI Impacts survey of ML researchers; <a href=\"#forecasts\">Section 4.3<\/a>).<\/li>\n\n\n\n<li><strong>Broad acceleration through automated AI R&amp;D requires three contested steps: automation, acceleration, and breadth.<\/strong> The main cruxes are whether AI develops research judgement, whether diminishing returns or bottlenecks such as compute, data, or regulation cap the acceleration, and whether gains spread beyond AI R&amp;D and easily verified tasks (<a href=\"#key-cruxes\">Section 5<\/a>).<\/li>\n\n\n\n<li><strong>An ensemble of frontier LLMs gives about a 40% chance of a fast year by the end of 2030,<\/strong> i.e., 12 months in which the ECI frontier rises by 30 points or more (roughly twice the current pace, <a href=\"#measuring-capability-progress\">Section 2.3<\/a>). If a fast year happens, the ensemble gives about a 70% chance that AI automation of AI R&amp;D caused it. A fast year by 2030 also raises the ensemble\u2019s forecast of expert AGI from 56% to 84% and almost triples its forecast of an AI catastrophe, from 2.9% to 8.4% (<a href=\"#llm-forecasts\">Section 6.1<\/a>).<\/li>\n<\/ol>\n\n\n\n<h2 id=\"further-reading\" class=\"wp-block-heading\">8. Further reading<\/h2>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>OpenAI,<\/strong> <a href=\"https:\/\/openai.com\/index\/research-acceleration-view-inside-openai\/\" rel=\"noreferrer noopener\" target=\"_blank\"><strong>Research acceleration: The view inside OpenAI<\/strong><\/a> (Sep 2026). Most of OpenAI\u2019s data on how much work AI does inside its research organization.<\/li>\n\n\n\n<li><strong>Anthropic,<\/strong> <a href=\"https:\/\/www.anthropic.com\/institute\/recursive-self-improvement\" rel=\"noreferrer noopener\" target=\"_blank\"><strong>When AI builds itself<\/strong><\/a> <strong>and<\/strong> <a href=\"https:\/\/www.anthropic.com\/institute\/measuring-pace-of-ai-development\" rel=\"noreferrer noopener\" target=\"_blank\"><strong>Measurements for understanding the pace of AI development inside frontier labs<\/strong><\/a> (2026). Anthropic\u2019s data on AI-written code, staff uplift, and its AL0\u2013AL5 automation index.<\/li>\n\n\n\n<li><strong>Peter Wildeford,<\/strong> <a href=\"https:\/\/takeoff-tracker.streamlit.app\/\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>RSI dashboard<\/strong><\/a> (2026). Trend extrapolations of the main automation series (<a href=\"#trend-extrapolation\">Section 4.2<\/a>).<\/li>\n\n\n\n<li><strong>Chan et al.,<\/strong> <a href=\"https:\/\/www.governance.ai\/research-paper\/what-if-automating-ai-r-d-triggers-an-intelligence-explosion\" rel=\"noreferrer noopener\" target=\"_blank\"><strong>What if automating AI R&amp;D triggers an intelligence explosion?<\/strong><\/a> (GovAI and Cambridge, Sep 2026). Arguably the best single overview of RSI.<\/li>\n\n\n\n<li><strong>Cunningham et al.,<\/strong> <a href=\"https:\/\/arxiv.org\/pdf\/2609.15802\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>The Economics of Recursive Self-Improvement<\/strong><\/a> (arXiv, 2026). A simple economic framework for when automated AI R&amp;D becomes self-sustaining.<\/li>\n<\/ol>\n\n\n\n<h2 id=\"appendix\" class=\"wp-block-heading\">Appendix: Full forecasting questions<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">This appendix gives the full text of the 18 forecasting questions in our survey.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For a yes-or-no question, forecasters give a probability from 0 to 100. For a numeric question, forecasters give three values: P10, P50, and P90.&nbsp;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">A.1 Automation of AI R&amp;D<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">These questions ask how much AI R&amp;D work AI will do, and how well AI agents will do open-ended research. Definitions:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>AL5 is the top level of the AL0\u2013AL5 AI autonomy scale that Anthropic uses to rate its AI R&amp;D tasks: \u201c<em>AI operates fully autonomously, with no human in the loop<\/em>\u201d (<a href=\"https:\/\/www.anthropic.com\/institute\/measuring-pace-of-ai-development\">Anthropic<\/a>).<\/li>\n\n\n\n<li>A model is publicly available when anyone can use it, for example through a public API or a consumer app, possibly for a fee. We will date each model by the date when it first became publicly available, using Epoch AI\u2019s dates where possible.<\/li>\n\n\n\n<li>The ECI frontier on a given date is the highest Epoch Capabilities Index (ECI) score of any model that became publicly available on or before that date (<a href=\"https:\/\/epoch.ai\/benchmarks\/eci\">Epoch<\/a>).<\/li>\n\n\n\n<li>The leading AI company on a date is the company whose model sets the ECI frontier on that date.<\/li>\n\n\n\n<li>A CRUX 2 re-run uses the setup of the original CRUX 2 open-world evaluation (<a href=\"#public-evidence\" data-type=\"internal\" data-id=\"#public-evidence\">Section 3.2<\/a>; <a href=\"https:\/\/arxiv.org\/abs\/2607.27191\">CRUX 2<\/a>) and the NeurIPS 1\u20136 scale (<a href=\"https:\/\/neurips.cc\/Conferences\/2025\/ReviewerGuidelines\">NeurIPS<\/a>).<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Q1.1 AL5 share, end of 2027<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">What share of AI R&amp;D work at the leading AI company will AI do fully autonomously (AL5) on Dec 31, 2027?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: P10, P50, and P90, in percent (0\u2013100).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: This question will resolve to the share (0\u2013100%) of the leading AI company\u2019s AI R&amp;D work that AI does at AL5 on Dec 31, 2027.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Share: the percentage of the company\u2019s AI R&amp;D work that AI does at AL5. We will fix the weight of each task at its share of the company\u2019s research time in 2026. For example, if AI does at AL5 all the tasks that took 30% of research time in 2026, the share is 30%, even if those tasks now take much less human time.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Please forecast the true share that an independent study (for example, run by METR or Epoch AI) would measure. Since no such independent study exists today, and the leading company may not publish AL5 data, this question is partly hypothetical. If the required data exist when the question resolves, we will use them. If not, we will aim to resolve the question with the best evidence available (which may include, for example, asking a panel of AI experts to estimate the share).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#lab-definitions\">Section 2.1<\/a> (lab definitions of automated AI R&amp;D), <a href=\"#what-the-labs-report\">Section 3.1<\/a> (what the labs report, including the AL0\u2013AL5 scale), <a href=\"#existing-projections-and-forecasts\">Section 4<\/a> (existing projections and forecasts), and <a href=\"#key-cruxes\">Section 5<\/a> (Step 1 of the key cruxes).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Q1.2 AL5 share, end of 2030<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">What share of AI R&amp;D work at the leading AI company will AI do fully autonomously (AL5) on Dec 31, 2030?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: P10, P50, and P90, in percent (0\u2013100).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: The same criteria as Q1.1, but on Dec 31, 2030. The leading AI company is the company that leads on Dec 31, 2030. For the reasons given under Q1.1, this question is partly hypothetical.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#lab-definitions\">Section 2.1<\/a> (lab definitions of automated AI R&amp;D), <a href=\"#what-the-labs-report\">Section 3.1<\/a> (what the labs report, including the AL0\u2013AL5 scale), <a href=\"#existing-projections-and-forecasts\">Section 4<\/a> (existing projections and forecasts), and <a href=\"#key-cruxes\">Section 5<\/a> (Step 1 of the key cruxes).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Q1.3 CRUX 2 re-run score, end of 2027<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Imagine a re-run of CRUX 2 that starts on Dec 31, 2027 with the best publicly available AI agent on that date. What will be the average score of the agent\u2019s papers, on the NeurIPS 1\u20136 scale?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: P10, P50, and P90, as NeurIPS scores (1\u20136).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: This question will resolve to the average overall score of the papers that the AI agent writes in the re-run.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Setup: the same as <a href=\"https:\/\/arxiv.org\/abs\/2607.27191\">CRUX 2<\/a> (<a href=\"#public-evidence\">Section 3.2<\/a>).<\/li>\n\n\n\n<li>Scale: the NeurIPS overall score, from 1 (\u201c<em>Strong Reject<\/em>\u201d) to 6 (\u201c<em>Strong Accept<\/em>\u201d) (<a href=\"https:\/\/neurips.cc\/Conferences\/2025\/ReviewerGuidelines\">NeurIPS<\/a>).<\/li>\n\n\n\n<li>Best publicly available AI agent: the best publicly available AI model on Dec 31, 2027, in the best publicly available agent scaffold.<\/li>\n\n\n\n<li>Average score: the mean of the overall scores of all papers in the re-run.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Please forecast how expert reviewers would score the papers of the best AI agent at the end of 2027. Since such a re-run may not take place, this question is partly hypothetical. If the CRUX 2 team or another team runs a comparable study near Dec 31, 2027, we will use its results. If not, we will aim to resolve the question with the best evidence available on how well AI agents do open-ended research (which may include, for example, asking a panel of AI experts to estimate the results of such a re-run).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#public-evidence\">Section 3.2<\/a> (public evidence, including the CRUX 2 setup), <a href=\"#qualitative-evidence\">Section 3.3<\/a> (qualitative evidence), and <a href=\"#key-cruxes\">Section 5<\/a> (Step 1 of the key cruxes).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Q1.4 Both automated AI R&amp;D milestones by 2030<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">What is the probability that both of these milestones happen by Dec 31, 2030?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">(a) The AL5 share of AI R&amp;D work at the leading AI company is above 50%.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">(b) In a CRUX 2 re-run that starts on or before Dec 31, 2030, the papers of the best publicly available AI agent have an average score of at least 4 (\u201c<em>Borderline accept<\/em>\u201d or higher).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: a probability from 0 to 100.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: This question will resolve Yes if both (a) and (b) happen on or before Dec 31, 2030.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>(a) uses the definitions of Q1.1. The date of (a) is the first date on which the AL5 share is above 50%.<\/li>\n\n\n\n<li>(b) uses the setup, scale, and average score of Q1.3. The agent is the best publicly available AI agent on the start date of the re-run. If there is more than one re-run, the first re-run with an average score of at least 4 counts. The date of (b) is the start date of that re-run.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">For the reasons given under Q1.1 and Q1.3, this question is partly hypothetical. If the required data exist when the question resolves, we will use them. If not, we will aim to resolve the question with the best evidence available (which may include, for example, asking a panel of AI experts whether both milestones have happened).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#what-the-labs-report\">Section 3.1<\/a> (what the labs report), <a href=\"#public-evidence\">Section 3.2<\/a> (public evidence, including CRUX 2), <a href=\"#existing-projections-and-forecasts\">Section 4<\/a> (existing projections and forecasts), and <a href=\"#key-cruxes\">Section 5<\/a> (Step 1 of the key cruxes).<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">A.2 ECI frontier<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">These questions ask how fast AI capabilities will rise, as measured by the Epoch Capabilities Index (ECI; <a href=\"https:\/\/epoch.ai\/benchmarks\/eci\">Epoch<\/a>). Definitions:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The ECI frontier on a given date is the highest ECI score of any model that became publicly available on or before that date.<\/li>\n\n\n\n<li>The two automated AI R&amp;D milestones are the two events in Q1.4: (a) the AL5 share of AI R&amp;D work at the leading AI company is above 50%, and (b) in a CRUX 2 re-run, the papers of the best publicly available AI agent have an average score of at least 4.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Q2.1 ECI frontier, end of 2027<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">What will the ECI frontier be on Dec 31, 2027?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: P10, P50, and P90, in ECI points.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: This question will resolve to the ECI frontier on Dec 31, 2027.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We will use the ECI scores that Epoch AI publishes (<a href=\"https:\/\/epoch.ai\/benchmarks\/eci\">Epoch<\/a>), and Epoch AI\u2019s dates for when each model became publicly available. We will read the data on Mar 31, 2028, so that Epoch AI has time to score models that became publicly available near the end of 2027. If Epoch AI changes the ECI scale, we will convert the scores to the scale in use when this survey opened. If Epoch AI stops updating the ECI, we will aim to resolve the question with the best evidence available (which may include, for example, asking a panel of AI experts to estimate the ECI frontier).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Please assume that Epoch AI keeps adding new benchmarks that are not yet saturated, so that the ECI can keep rising as capabilities improve (<a href=\"#measuring-capability-progress\">Section 2.3<\/a>). If Epoch AI does not, we will aim to add such benchmarks ourselves and refit the ECI with Epoch AI\u2019s public code.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#measuring-capability-progress\">Section 2.3<\/a> (our operationalization, including the ECI frontier), <a href=\"#lab-targets\" data-type=\"internal\" data-id=\"#lab-targets\">Section 4.1<\/a> (lab targets), <a href=\"#trend-extrapolation\">Section 4.2<\/a> (trend extrapolation), and <a href=\"#forecasts\">Section 4.3<\/a> (forecasts).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Q2.2 ECI frontier, end of 2030<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">What will the ECI frontier be on Dec 31, 2030?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: P10, P50, and P90, in ECI points.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: The same criteria as Q2.1, but on Dec 31, 2030. We will read the data on Mar 31, 2031.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#measuring-capability-progress\">Section 2.3<\/a> (our operationalization, including the ECI frontier), <a href=\"#lab-targets\" data-type=\"internal\" data-id=\"#lab-targets\">Section 4.1<\/a> (lab targets), <a href=\"#trend-extrapolation\">Section 4.2<\/a> (trend extrapolation), and <a href=\"#forecasts\">Section 4.3<\/a> (forecasts).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Q2.3 ECI gain after both milestones<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">If both automated AI R&amp;D milestones (Q1.4) happen by Dec 31, 2030: how many ECI points will the ECI frontier gain in the 12 months after the date when both milestones have happened?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: P10, P50, and P90, in ECI points.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: This is a conditional question. It will resolve only if both milestones of Q1.4 happen on or before Dec 31, 2030. If not, the question will not resolve.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Start date: the date when both milestones have happened, that is, the later of the two dates in Q1.4.<\/li>\n\n\n\n<li>Gain: the ECI frontier 12 months after the start date, minus the ECI frontier on the start date. Since the ECI frontier cannot fall, the gain is zero or more.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">We will use Epoch AI\u2019s data and handle any changes to the ECI as in Q2.1. We will read the data three months after the end of the 12-month period.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#definitions-in-the-literature\">Section<\/a><a href=\"https:\/\/docs.google.com\/document\/d\/1uKW_wFDyVzFhreNGcHok7KZ7R2Y2Qj9nb0jBhSdZoMk\/edit?tab=t.uyj0j1ihfvtp#heading=h.8vqy0h5qj26f\"> 2.2<\/a> (definitions in the literature, including self-sustaining acceleration) and <a href=\"#key-cruxes\">Section 5<\/a> (Step 2 of the key cruxes).<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">A.3 Fast years<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">These questions ask whether AI progress will accelerate. Definition:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A fast year is a rise of the ECI frontier by 30 points or more within any 12-month window. A fast year counts as soon as it happens. For example, if the ECI frontier rises by 30 points in 7 months, a fast year has happened at the end of those 7 months.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Q3.1 Fast year by 2027<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">What is the probability of a fast year by Dec 31, 2027?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: a probability from 0 to 100.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: This question will resolve Yes if a fast year happens on or before Dec 31, 2027.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The 12-month window can start before this survey opens, but it must end on or before Dec 31, 2027. We will use Epoch AI\u2019s data and handle changes to the ECI as in Q2.1.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#measuring-capability-progress\">Section 2.3<\/a> (our operationalization, including the definition of a fast year and its pros and cons), <a href=\"#what-the-labs-report\">Section 3.1<\/a> (what the labs report, including measured acceleration), <a href=\"#existing-projections-and-forecasts\">Section 4<\/a> (existing projections and forecasts), and <a href=\"#key-cruxes\">Section 5<\/a> (key cruxes).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Q3.2 Fast year by 2030<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">What is the probability of a fast year by Dec 31, 2030?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: a probability from 0 to 100.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: The same criteria as Q3.1, but by Dec 31, 2030. A fast year by Dec 31, 2027 also counts as Yes for this question.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#measuring-capability-progress\">Section 2.3<\/a> (our operationalization, including the definition of a fast year and its pros and cons), <a href=\"#what-the-labs-report\">Section 3.1<\/a> (what the labs report, including measured acceleration), <a href=\"#existing-projections-and-forecasts\">Section 4<\/a> (existing projections and forecasts), and <a href=\"#key-cruxes\">Section 5<\/a> (key cruxes).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Q3.3 ECI gain after the first fast year<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">If a fast year happens by Dec 31, 2030: how many ECI points will the ECI frontier gain in the 12 months after the date when the first fast year has happened?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: P10, P50, and P90, in ECI points.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: This is a conditional question. It will resolve only if a fast year happens on or before Dec 31, 2030. If not, the question will not resolve.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Start date: the date when the first fast year happens.<\/li>\n\n\n\n<li>Gain: the ECI frontier 12 months after the start date, minus the ECI frontier on the start date. Since the ECI frontier cannot fall, the gain is zero or more.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">For example, suppose that a model becomes publicly available on Mar 1, 2028 and sets the ECI frontier at 170, and another model becomes publicly available on Oct 1, 2028 and raises it to 205. This rise of 35 points within 7 months is a fast year. If there was no earlier fast year, the start date is Oct 1, 2028, and the gain is the ECI frontier on Oct 1, 2029 minus 205.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We will use Epoch AI\u2019s data and handle changes to the ECI as in Q2.1. We will read the data three months after the end of the 12-month period.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#definitions-in-the-literature\">Section 2.2<\/a> (definitions in the literature, including self-sustaining acceleration), <a href=\"#measuring-capability-progress\">Section 2.3<\/a> (fast years), and <a href=\"#key-cruxes\">Section 5<\/a> (Step 2 of the key cruxes).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Q3.4 Cause of the first fast year<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">If a fast year happens by Dec 31, 2030: what is the probability that AI automation of AI R&amp;D caused the first fast year?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: a probability from 0 to 100.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: This is a conditional question. It will resolve only if a fast year happens on or before Dec 31, 2030. If not, the question will not resolve. The first fast year is as in Q3.3.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">AI automation of AI R&amp;D caused the first fast year if it was the direct or proximate cause of the rise in the ECI frontier, or if the first fast year would not have occurred, or would have counterfactually been extremely unlikely to occur, \u201cbut for\u201d the substantial involvement of AI in the AI R&amp;D behind the models that raised the ECI frontier during that fast year. Other causes, such as more training compute, can also contribute.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Since no one can observe what would have happened without AI, this question is partly hypothetical. We will aim to resolve it with the best evidence available (which may include, for example, the AI companies\u2019 own assessments, such as Anthropic\u2019s test of whether a doubling is \u201c<em>substantially attributable to the automation of research and\/or engineering<\/em>\u201d (<a href=\"https:\/\/www-cdn.anthropic.com\/files\/4zrzovbb\/website\/0bacdc8440ea96e62a8766d99ebe1d4eea6d5f3a.pdf\">RSP v3.4<\/a>; <a href=\"#lab-definitions\" data-type=\"internal\" data-id=\"#lab-definitions\">Section 2.1<\/a>), or asking a panel of AI experts).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#lab-definitions\">Section 2.1<\/a> (lab definitions, including Anthropic\u2019s attribution test), <a href=\"#measuring-capability-progress\">Section 2.3<\/a> (our operationalization, including why a fast year could happen without RSI), <a href=\"#what-the-labs-report\">Section 3.1<\/a> (what the labs report, including measured acceleration), and <a href=\"#key-cruxes\">Section 5<\/a> (Steps 1 and 2 of the key cruxes).<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">A.4 Internal lead<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">These questions ask how far the best AI models inside AI companies will be ahead of the best publicly available models. Definitions:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The internal lead is the number of ECI points by which the best model available internally at any AI company leads the ECI frontier. For each internal model, we will use the ECI score from Epoch AI once that score is publicly available, and we will date the model by the date when it first became available internally.<\/li>\n\n\n\n<li>A model is available internally on a date when at least some staff inside the company can use it, for example for AI R&amp;D, safety testing, or daily work. The model counts even if the company restricts its use to a small group of staff or to a few tasks, for example because of safety concerns or a government restriction. We will date each model by the date when it first became available internally, as the company reports it (for example, in a system card) or as credible reports show.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Q4.1 Internal lead, end of 2027<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">What will the internal lead over the ECI frontier be on Dec 31, 2027?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: P10, P50, and P90, in ECI points.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: This question will resolve to the internal lead on Dec 31, 2027.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We will use Epoch AI\u2019s ECI scores and handle changes to the ECI as in Q2.1. Epoch AI scores models only after they become publicly available; we will resolve the question when the ECI scores of the models that were available internally on Dec 31, 2027 are publicly available. The internal lead is zero or more by definition, because a publicly available model is also available internally.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Please forecast how far the best AI inside the companies is ahead of the ECI frontier. Since some internal models may never become publicly available, and the dates when models first became available internally may not be disclosed, this question is partly hypothetical. If the required data exist when the question resolves, we will use them. If not, we will aim to resolve the question with the best evidence available (which may include, for example, the companies\u2019 own benchmark reports, or asking a panel of AI experts to estimate the internal lead).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#measuring-capability-progress\">Section 2.3<\/a> (our operationalization, including why the ECI frontier counts only publicly available models, and our estimate of the current internal lead), <a href=\"#what-the-labs-report\">Section 3.1<\/a> (what the labs report), and <a href=\"#qualitative-evidence\">Section 3.3<\/a> (qualitative evidence, including researchers\u2019 views on whether the most capable models stay internal).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Q4.2 Internal lead, end of 2030<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">What will the internal lead over the ECI frontier be on Dec 31, 2030?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: P10, P50, and P90, in ECI points.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: The same criteria as Q4.1, but on Dec 31, 2030. For the reasons given under Q4.1, this question is partly hypothetical.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#measuring-capability-progress\">Section 2.3<\/a> (our operationalization, including why the ECI frontier counts only publicly available models, and our estimate of the current internal lead), <a href=\"#what-the-labs-report\">Section 3.1<\/a> (what the labs report), and <a href=\"#qualitative-evidence\">Section 3.3<\/a> (qualitative evidence, including researchers\u2019 views on whether the most capable models stay internal).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Q4.3 Internal lead after both milestones<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">If both automated AI R&amp;D milestones (Q1.4) happen by Dec 31, 2030: what will the internal lead over the ECI frontier be 12 months after the date when both milestones have happened?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: P10, P50, and P90, in ECI points.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: This is a conditional question. It will resolve only if both milestones of Q1.4 happen on or before Dec 31, 2030. If not, the question will not resolve.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Start date: the date when both milestones have happened, as in Q2.3.<\/li>\n\n\n\n<li>Internal lead: as in Q4.1, measured 12 months after the start date.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Please forecast how far the best AI inside the companies is ahead of the ECI frontier, one year after AI does most AI R&amp;D on its own. Since the milestones of Q1.4 and the internal lead are partly hypothetical, this question is partly hypothetical too. If the required data exist when the question resolves, we will use them. If not, we will aim to resolve the question with the best evidence available (which may include, for example, asking a panel of AI experts to estimate the internal lead).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#lab-definitions\" data-type=\"internal\" data-id=\"#lab-definitions\">Section 2.1<\/a> (lab definitions of automated AI R&amp;D and the safety measures that labs link to them), <a href=\"#measuring-capability-progress\">Section 2.3<\/a> (why the ECI frontier counts only publicly available models, and our estimate of the current internal lead), <a href=\"#qualitative-evidence\">Section 3.3<\/a> (qualitative evidence), and <a href=\"#key-cruxes\">Section 5<\/a> (key cruxes).<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">A.5 Expert AGI and AI catastrophe<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">These questions ask how a fast year would change the chances of expert AGI and an AI catastrophe by 2050. We use the same definitions as FRI\u2019s Longitudinal Expert AI Panel (<a href=\"https:\/\/leap.forecastingresearch.org\/\">LEAP<\/a>). Definitions:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Expert AGI means that more than 50% of LEAP panelists agree that AGI exists (<a href=\"https:\/\/leap.forecastingresearch.org\/reports\/wave8\">LEAP Wave 8<\/a>). AGI is a commercially available AI system that (1) can outperform the 90th percentile professional human employee in every primarily non-physical occupation (based on 2025 performance), across all sectors, on at least 90% of the economically useful non-physical tasks that they perform, and (2) has an inference cost no more than 5\u00d7 the cost of equivalent human labor.<\/li>\n\n\n\n<li>An AI catastrophe is a catastrophic event caused primarily by AI systems in which more than 10% of the people alive at the start of a five-year period die by the end of that period (<a href=\"https:\/\/leap.forecastingresearch.org\/reports\/wave9\">LEAP Wave 9<\/a>). This covers cases where AI is the direct or proximate cause of the deaths, and events that would not have occurred, or would have been extremely unlikely to occur, \u201cbut for\u201d the substantial involvement of AI within one year before the event.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Q5.1 Expert AGI by 2050, with a fast year<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">If a fast year happens by Dec 31, 2030: what is the probability of expert AGI by 2050?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: a probability from 0 to 100.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: This is a conditional question. It will resolve only if a fast year happens on or before Dec 31, 2030. If not, the question will not resolve. If a fast year happens, the question will resolve Yes if expert AGI exists on or before Dec 31, 2050.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Since the LEAP panel may not exist in 2050, this question is partly hypothetical. If the panel exists when the question resolves, we will use its answer. If not, we will aim to resolve the question with the best evidence available on whether such a panel would agree that AGI exists (which may include, for example, asking another panel of AI experts).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#introduction\" data-type=\"internal\" data-id=\"#introduction\">Section 1<\/a> (introduction), <a href=\"#definitions-in-the-literature\">Section 2.2<\/a> (definitions, including narrow and broad acceleration), and <a href=\"#key-cruxes\">Section 5<\/a> (Step 3 of the key cruxes: whether the capability gains are broad).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Q5.2 Expert AGI by 2050, without a fast year<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">If no fast year happens by Dec 31, 2030: what is the probability of expert AGI by 2050?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: a probability from 0 to 100.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: The same criteria as Q5.1, but the question will resolve only if no fast year happens on or before Dec 31, 2030. If a fast year happens, the question will not resolve.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#introduction\">Section 1<\/a> (introduction), <a href=\"#definitions-in-the-literature\">Section 2.2<\/a> (definitions, including narrow and broad acceleration), and <a href=\"#key-cruxes\">Section 5<\/a> (Step 3 of the key cruxes: whether the capability gains are broad).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Q5.3 AI catastrophe by 2050, with a fast year<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">If a fast year happens by Dec 31, 2030: what is the probability of an AI catastrophe by 2050?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: a probability from 0 to 100.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: This is a conditional question. It will resolve only if a fast year happens on or before Dec 31, 2030. If not, the question will not resolve. If a fast year happens, the question will resolve Yes if an AI catastrophe happens on or before Dec 31, 2050.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We will use the resolution criteria of <a href=\"https:\/\/leap.forecastingresearch.org\/reports\/wave9\">LEAP Wave 9<\/a>. In particular, for fatality and population data, we will rely on broadly recognized sources, such as Our World in Data, the Economist, and the United Nations. The five-year period must start on or after Dec 31, 2025 and end on or before Dec 31, 2050. If reasonable people disagree about whether such a catastrophe has happened, a panel of experts will resolve the question.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Please give your best forecast of whether such a catastrophe will happen by 2050. Do not change your forecast because of problems with resolution. For example, do not consider whether anyone will be able to resolve the question after a catastrophe.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#introduction\">Section 1<\/a> (introduction, including the benefits and risks of RSI), <a href=\"#qualitative-evidence\">Section 3.3<\/a> (qualitative evidence, including researchers\u2019 views on the risks), and <a href=\"#key-cruxes\">Section 5<\/a> (key cruxes).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Q5.4 AI catastrophe by 2050, without a fast year<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">If no fast year happens by Dec 31, 2030: what is the probability of an AI catastrophe by 2050?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Answer: a probability from 0 to 100.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Resolution: The same criteria as Q5.3, but the question will resolve only if no fast year happens on or before Dec 31, 2030. If a fast year happens, the question will not resolve.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Background: <a href=\"#introduction\">Section 1<\/a> (introduction, including the benefits and risks of RSI), <a href=\"#qualitative-evidence\">Section 3.3<\/a> (qualitative evidence, including researchers\u2019 views on the risks), and <a href=\"#key-cruxes\">Section 5<\/a> (key cruxes).<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Notes<\/h2>\n\n\n<ol class=\"wp-block-footnotes\"><li id=\"798dc57a-0134-4e5d-b14e-69a0eb9094df\">We thank Nick Merrill for generating LLM forecasts using the AIRO pipeline, and Sivan Livnat for research assistance. For feedback and input at various stages of the project, we thank Jason Abaluck, Zack Devlin-Foltz, Basil Halperin, Ezra Karger, Matt Reynolds, Luis Enrique Urtubey De Cesaris, and Bridget Williams. <a href=\"#798dc57a-0134-4e5d-b14e-69a0eb9094df-link\" aria-label=\"Jump to footnote reference 1\">\u21a9\ufe0e<\/a><\/li><li id=\"982927a5-80b4-4f40-9fce-d257e3bf0075\"><a href=\"https:\/\/epoch.ai\/data-insights\/eci-frontier-trend\">Epoch\u2019s estimate<\/a> dates from Sep 1, 2026. Using <a href=\"https:\/\/epoch.ai\/benchmarks\/eci\">Epoch\u2019s data as of Nov 3, 2026<\/a>, a linear fit to the 14 frontier models since Sep 2024 gives about 16 points a year (our calculation). <a href=\"#982927a5-80b4-4f40-9fce-d257e3bf0075-link\" aria-label=\"Jump to footnote reference 2\">\u21a9\ufe0e<\/a><\/li><li id=\"5c08fe63-c4ad-40cc-8d85-b1b354ee638b\">In the local linear trend model, the ECI score can go up or down, and the pace of progress (i.e., the slope) can become negative. However, in practice, the ECI frontier cannot fall. For the fast-year probabilities, we use the highest simulated score so far, so the frontier cannot fall. The prediction intervals, however, use the simulated scores directly, so they are likely somewhat off; we plan to fix this issue in a future version. <a href=\"#5c08fe63-c4ad-40cc-8d85-b1b354ee638b-link\" aria-label=\"Jump to footnote reference 3\">\u21a9\ufe0e<\/a><\/li><li id=\"5563d42f-3cb5-4f5b-bd43-39d7704f7558\"><a href=\"https:\/\/www-cdn.anthropic.com\/fc1b44717c85dc068bc6ba5024219938094694bd\/Claude%20Opus%205.5%20System%20Card.pdf\">Anthropic<\/a> and <a href=\"https:\/\/storage.googleapis.com\/deepmind-media\/gemini\/gemini_4_safety_report.pdf\">Google DeepMind<\/a> perform similar tests. They extrapolate historical trends in internal capability indices and compare new models against them (see <a href=\"#what-the-labs-report\">Section 3.1<\/a>). Both find their newest models above the historical trend line, but neither interprets this as a sustained acceleration. <a href=\"#5563d42f-3cb5-4f5b-bd43-39d7704f7558-link\" aria-label=\"Jump to footnote reference 4\">\u21a9\ufe0e<\/a><\/li><li id=\"e137f17c-7212-4fb9-b47e-946e869e2990\">We use 90% because scores near 100% are less informative about capability (<a href=\"https:\/\/epoch.ai\/eci\">Epoch<\/a>) and may exaggerate how far the ECI is from saturation under the current set of benchmarks. In particular, Epoch itself requires at least four scores between 10% and 90% to include a model in the ECI (<a href=\"https:\/\/epoch.ai\/data\/eci-documentation\/methodology\">Epoch<\/a>, <a href=\"https:\/\/github.com\/epoch-research\/eci-public\/commit\/f8c52e12784324d3bfad0ac4c661952909216b74\">repo<\/a>). <a href=\"#e137f17c-7212-4fb9-b47e-946e869e2990-link\" aria-label=\"Jump to footnote reference 5\">\u21a9\ufe0e<\/a><\/li><li id=\"af3c7053-b1f6-46b9-a5ca-c610f10d894d\">On Nov 4, 2026, after our data cutoff, Epoch AI updated the ECI to use a Bayesian model (<a href=\"https:\/\/epoch.ai\/data\/eci-documentation\/changelog\">Epoch<\/a>). We use ECI data as of Nov 3, 2026, so the values on Epoch\u2019s website may differ slightly from the ones cited in this report. <a href=\"#af3c7053-b1f6-46b9-a5ca-c610f10d894d-link\" aria-label=\"Jump to footnote reference 6\">\u21a9\ufe0e<\/a><\/li><li id=\"4aaf361e-bedf-4fea-a1c4-e6cf800082c7\">The offset holds only within this fit, so we use only scores from it below. <a href=\"#4aaf361e-bedf-4fea-a1c4-e6cf800082c7-link\" aria-label=\"Jump to footnote reference 7\">\u21a9\ufe0e<\/a><\/li><li id=\"50cad995-1555-425b-bf71-d83767b0238c\">For WeirdML, Epoch rates v2 as \u201cVerified.\u201d WeirdML v3, which we use, postdates that review. <a href=\"#50cad995-1555-425b-bf71-d83767b0238c-link\" aria-label=\"Jump to footnote reference 8\">\u21a9\ufe0e<\/a><\/li><li id=\"2eff2f83-47ad-45e4-bcfd-1ba39b647a7b\">Respondents to the same survey put the median date for AI solving a long-standing math problem without human input, such as a Millennium Prize Problem, at 2053, with only a 10% chance by 2028 (<a href=\"https:\/\/aiimpacts.org\/wp-content\/uploads\/2026\/09\/ESPAI2024.pdf\">ESPAI 2024<\/a>, p. 9 and Table 7, p. 45). However, the survey authors note that the task\u2019s condition \u201c<em>without more input from humans<\/em>\u201d would exclude the Navier\u2013Stokes solution claimed by OpenAI (<a href=\"https:\/\/aiimpacts.org\/wp-content\/uploads\/2026\/09\/ESPAI2024.pdf\">ESPAI 2024<\/a>, p. 9, footnote 7). For context, our Sep 2026 review found that experts and superforecasters in our studies have substantially underestimated AI capability progress, especially on benchmarks (<a href=\"https:\/\/forecastingresearch.org\/research\/ai-progress-accuracy-update\">FRI<\/a>). <a href=\"#2eff2f83-47ad-45e4-bcfd-1ba39b647a7b-link\" aria-label=\"Jump to footnote reference 9\">\u21a9\ufe0e<\/a><\/li><li id=\"3f12883d-b8d9-4abb-99b5-5632af88fac9\">Note that AI R&amp;D need not be fully automated. AI that does most, but not all, of the work could be enough to accelerate progress (<a href=\"#definitions-in-the-literature\">Section 2.2<\/a>). <a href=\"#3f12883d-b8d9-4abb-99b5-5632af88fac9-link\" aria-label=\"Jump to footnote reference 10\">\u21a9\ufe0e<\/a><\/li><li id=\"1ba92cbb-259e-4f5e-9413-1e8a8571930b\">Several caveats apply to this estimate: (i) METR notes that Anthropic models \u201chad a lower historical growth rate on AECI than the broader industry frontier before late 2025,\u201d which \u201ccould explain some of the acceleration\u201d (<a href=\"https:\/\/metr.org\/blog\/2026-11-05-anthropic-ai-rd-acceleration-assessment\/#limitations\">METR<\/a>). Similarly, Peter Wildeford suggests that part of this may come from Anthropic scaling up reinforcement learning later than other labs (<a href=\"https:\/\/x.com\/peterwildeford\/status\/2119546903696400812\">Wildeford<\/a>). (ii) When METR adds other developers\u2019 frontier models to the fit, the estimated acceleration falls to 1.4\u00d7 (<a href=\"https:\/\/metr.org\/blog\/2026-11-05-anthropic-ai-rd-acceleration-assessment\/#benchmark-scores-aeci\">METR<\/a>). (iii) The data may be consistent with a change in slope only, or a one-time jump at Mythos Preview plus a smaller change in slope. With both allowed, the slope change falls to about 1.4\u00d7 (<a href=\"https:\/\/x.com\/tobyordoxford\/status\/2118646665447936023\">Toby Ord<\/a>). (iv) Part of METR\u2019s assessment relies on evidence that is not public. Anthropic \u201credacted a majority of the evidence we found most informative for these conclusions\u201d (<a href=\"https:\/\/metr.org\/blog\/2026-11-05-anthropic-ai-rd-acceleration-assessment\/#executive-summary\">METR<\/a>). We have not yet deeply reviewed all of the relevant arguments and may revisit them in future versions of this report. <a href=\"#1ba92cbb-259e-4f5e-9413-1e8a8571930b-link\" aria-label=\"Jump to footnote reference 11\">\u21a9\ufe0e<\/a><\/li><\/ol>","protected":false},"excerpt":{"rendered":"We review the evidence, existing forecasts, and key disagreements, turn the disagreements into forecasting questions, and give initial forecasts from an ensemble of frontier LLMs.","protected":false},"featured_media":2725,"template":"","meta":{"footnotes":"[{\"content\":\"We thank Nick Merrill for generating LLM forecasts using the AIRO pipeline, and Sivan Livnat for research assistance. For feedback and input at various stages of the project, we thank Jason Abaluck, Zack Devlin-Foltz, Basil Halperin, Ezra Karger, Matt Reynolds, Luis Enrique Urtubey De Cesaris, and Bridget Williams.\",\"id\":\"798dc57a-0134-4e5d-b14e-69a0eb9094df\"},{\"content\":\"<a href=\\\"https:\/\/epoch.ai\/data-insights\/eci-frontier-trend\\\">Epoch\u2019s estimate<\/a> dates from Sep 1, 2026. Using <a href=\\\"https:\/\/epoch.ai\/benchmarks\/eci\\\">Epoch\u2019s data as of Nov 3, 2026<\/a>, a linear fit to the 14 frontier models since Sep 2024 gives about 16 points a year (our calculation).\",\"id\":\"982927a5-80b4-4f40-9fce-d257e3bf0075\"},{\"content\":\"In the local linear trend model, the ECI score can go up or down, and the pace of progress (i.e., the slope) can become negative. However, in practice, the ECI frontier cannot fall. For the fast-year probabilities, we use the highest simulated score so far, so the frontier cannot fall. The prediction intervals, however, use the simulated scores directly, so they are likely somewhat off; we plan to fix this issue in a future version.\",\"id\":\"5c08fe63-c4ad-40cc-8d85-b1b354ee638b\"},{\"content\":\"<a href=\\\"https:\/\/www-cdn.anthropic.com\/fc1b44717c85dc068bc6ba5024219938094694bd\/Claude%20Opus%205.5%20System%20Card.pdf\\\">Anthropic<\/a> and <a href=\\\"https:\/\/storage.googleapis.com\/deepmind-media\/gemini\/gemini_4_safety_report.pdf\\\">Google DeepMind<\/a> perform similar tests. They extrapolate historical trends in internal capability indices and compare new models against them (see <a href=\\\"#what-the-labs-report\\\">Section 3.1<\/a>). Both find their newest models above the historical trend line, but neither interprets this as a sustained acceleration.\",\"id\":\"5563d42f-3cb5-4f5b-bd43-39d7704f7558\"},{\"content\":\"We use 90% because scores near 100% are less informative about capability (<a href=\\\"https:\/\/epoch.ai\/eci\\\">Epoch<\/a>) and may exaggerate how far the ECI is from saturation under the current set of benchmarks. In particular, Epoch itself requires at least four scores between 10% and 90% to include a model in the ECI (<a href=\\\"https:\/\/epoch.ai\/data\/eci-documentation\/methodology\\\">Epoch<\/a>, <a href=\\\"https:\/\/github.com\/epoch-research\/eci-public\/commit\/f8c52e12784324d3bfad0ac4c661952909216b74\\\">repo<\/a>).\",\"id\":\"e137f17c-7212-4fb9-b47e-946e869e2990\"},{\"content\":\"On Nov 4, 2026, after our data cutoff, Epoch AI updated the ECI to use a Bayesian model (<a href=\\\"https:\/\/epoch.ai\/data\/eci-documentation\/changelog\\\">Epoch<\/a>). We use ECI data as of Nov 3, 2026, so the values on Epoch\u2019s website may differ slightly from the ones cited in this report.\",\"id\":\"af3c7053-b1f6-46b9-a5ca-c610f10d894d\"},{\"content\":\"The offset holds only within this fit, so we use only scores from it below.\",\"id\":\"4aaf361e-bedf-4fea-a1c4-e6cf800082c7\"},{\"content\":\"For WeirdML, Epoch rates v2 as \u201cVerified.\u201d WeirdML v3, which we use, postdates that review.\",\"id\":\"50cad995-1555-425b-bf71-d83767b0238c\"},{\"content\":\"Respondents to the same survey put the median date for AI solving a long-standing math problem without human input, such as a Millennium Prize Problem, at 2053, with only a 10% chance by 2028 (<a href=\\\"https:\/\/aiimpacts.org\/wp-content\/uploads\/2026\/09\/ESPAI2024.pdf\\\">ESPAI 2024<\/a>, p. 9 and Table 7, p. 45). However, the survey authors note that the task\u2019s condition \u201c<em>without more input from humans<\/em>\u201d would exclude the Navier\u2013Stokes solution claimed by OpenAI (<a href=\\\"https:\/\/aiimpacts.org\/wp-content\/uploads\/2026\/09\/ESPAI2024.pdf\\\">ESPAI 2024<\/a>, p. 9, footnote 7). For context, our Sep 2026 review found that experts and superforecasters in our studies have substantially underestimated AI capability progress, especially on benchmarks (<a href=\\\"https:\/\/forecastingresearch.org\/research\/ai-progress-accuracy-update\\\">FRI<\/a>).\",\"id\":\"2eff2f83-47ad-45e4-bcfd-1ba39b647a7b\"},{\"content\":\"Note that AI R&amp;D need not be fully automated. AI that does most, but not all, of the work could be enough to accelerate progress (<a href=\\\"#definitions-in-the-literature\\\">Section 2.2<\/a>).\",\"id\":\"3f12883d-b8d9-4abb-99b5-5632af88fac9\"},{\"content\":\"Several caveats apply to this estimate: (i) METR notes that Anthropic models \u201chad a lower historical growth rate on AECI than the broader industry frontier before late 2025,\u201d which \u201ccould explain some of the acceleration\u201d (<a href=\\\"https:\/\/metr.org\/blog\/2026-11-05-anthropic-ai-rd-acceleration-assessment\/#limitations\\\">METR<\/a>). Similarly, Peter Wildeford suggests that part of this may come from Anthropic scaling up reinforcement learning later than other labs (<a href=\\\"https:\/\/x.com\/peterwildeford\/status\/2119546903696400812\\\">Wildeford<\/a>). (ii) When METR adds other developers\u2019 frontier models to the fit, the estimated acceleration falls to 1.4\u00d7 (<a href=\\\"https:\/\/metr.org\/blog\/2026-11-05-anthropic-ai-rd-acceleration-assessment\/#benchmark-scores-aeci\\\">METR<\/a>). (iii) The data may be consistent with a change in slope only, or a one-time jump at Mythos Preview plus a smaller change in slope. With both allowed, the slope change falls to about 1.4\u00d7 (<a href=\\\"https:\/\/x.com\/tobyordoxford\/status\/2118646665447936023\\\">Toby Ord<\/a>). (iv) Part of METR\u2019s assessment relies on evidence that is not public. Anthropic \u201credacted a majority of the evidence we found most informative for these conclusions\u201d (<a href=\\\"https:\/\/metr.org\/blog\/2026-11-05-anthropic-ai-rd-acceleration-assessment\/#executive-summary\\\">METR<\/a>). We have not yet deeply reviewed all of the relevant arguments and may revisit them in future versions of this report.\",\"id\":\"1ba92cbb-259e-4f5e-9413-1e8a8571930b\"}]"},"research_type":[4],"class_list":["post-2711","research","type-research","status-publish","has-post-thumbnail","hentry","research_type-working-paper"],"acf":[],"yoast_head":"<title>How Close is Recursive Self-Improvement? A Review of the Evidence &#8211; Forecasting Research Institute<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/forecastingresearch.org\/research\/recursive-self-improvement-v1\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How Close is Recursive Self-Improvement? A Review of the Evidence &#8211; Forecasting Research Institute\" \/>\n<meta property=\"og:description\" content=\"We review the evidence, existing forecasts, and key disagreements, turn the disagreements into forecasting questions, and give initial forecasts from an ensemble of frontier LLMs.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/forecastingresearch.org\/research\/recursive-self-improvement-v1\" \/>\n<meta property=\"og:site_name\" content=\"Forecasting Research Institute\" \/>\n<meta property=\"article:modified_time\" content=\"2026-11-10T18:03:44+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/working-paper_2026-11-10_Recursive-Self-Improvement-700x440.png\" \/>\n\t<meta property=\"og:image:width\" content=\"700\" \/>\n\t<meta property=\"og:image:height\" content=\"440\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/forecastingresearch.org\\\/research\\\/recursive-self-improvement-v1\",\"url\":\"https:\\\/\\\/forecastingresearch.org\\\/research\\\/recursive-self-improvement-v1\",\"name\":\"How Close is Recursive Self-Improvement? A Review of the Evidence &#8211; Forecasting Research Institute\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/forecastingresearch.org\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/forecastingresearch.org\\\/research\\\/recursive-self-improvement-v1#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/forecastingresearch.org\\\/research\\\/recursive-self-improvement-v1#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/forecastingresearch.org\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/working-paper_2026-11-10_Recursive-Self-Improvement.png\",\"datePublished\":\"2026-11-10T16:44:22+00:00\",\"dateModified\":\"2026-11-10T18:03:44+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/forecastingresearch.org\\\/research\\\/recursive-self-improvement-v1#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/forecastingresearch.org\\\/research\\\/recursive-self-improvement-v1\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/forecastingresearch.org\\\/research\\\/recursive-self-improvement-v1#primaryimage\",\"url\":\"https:\\\/\\\/forecastingresearch.org\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/working-paper_2026-11-10_Recursive-Self-Improvement.png\",\"contentUrl\":\"https:\\\/\\\/forecastingresearch.org\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/working-paper_2026-11-10_Recursive-Self-Improvement.png\",\"width\":1376,\"height\":864},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/forecastingresearch.org\\\/research\\\/recursive-self-improvement-v1#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/forecastingresearch.org\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How Close is Recursive Self-Improvement? A Review of the Evidence\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/forecastingresearch.org\\\/#website\",\"url\":\"https:\\\/\\\/forecastingresearch.org\\\/\",\"name\":\"Forecasting Research Institute\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/forecastingresearch.org\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>","yoast_head_json":{"title":"How Close is Recursive Self-Improvement? A Review of the Evidence &#8211; Forecasting Research Institute","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/forecastingresearch.org\/research\/recursive-self-improvement-v1","og_locale":"en_US","og_type":"article","og_title":"How Close is Recursive Self-Improvement? A Review of the Evidence &#8211; Forecasting Research Institute","og_description":"We review the evidence, existing forecasts, and key disagreements, turn the disagreements into forecasting questions, and give initial forecasts from an ensemble of frontier LLMs.","og_url":"https:\/\/forecastingresearch.org\/research\/recursive-self-improvement-v1","og_site_name":"Forecasting Research Institute","article_modified_time":"2026-11-10T18:03:44+00:00","og_image":[{"width":700,"height":440,"url":"https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/working-paper_2026-11-10_Recursive-Self-Improvement-700x440.png","type":"image\/png"}],"twitter_card":"summary_large_image","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/forecastingresearch.org\/research\/recursive-self-improvement-v1","url":"https:\/\/forecastingresearch.org\/research\/recursive-self-improvement-v1","name":"How Close is Recursive Self-Improvement? A Review of the Evidence &#8211; Forecasting Research Institute","isPartOf":{"@id":"https:\/\/forecastingresearch.org\/#website"},"primaryImageOfPage":{"@id":"https:\/\/forecastingresearch.org\/research\/recursive-self-improvement-v1#primaryimage"},"image":{"@id":"https:\/\/forecastingresearch.org\/research\/recursive-self-improvement-v1#primaryimage"},"thumbnailUrl":"https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/working-paper_2026-11-10_Recursive-Self-Improvement.png","datePublished":"2026-11-10T16:44:22+00:00","dateModified":"2026-11-10T18:03:44+00:00","breadcrumb":{"@id":"https:\/\/forecastingresearch.org\/research\/recursive-self-improvement-v1#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/forecastingresearch.org\/research\/recursive-self-improvement-v1"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/forecastingresearch.org\/research\/recursive-self-improvement-v1#primaryimage","url":"https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/working-paper_2026-11-10_Recursive-Self-Improvement.png","contentUrl":"https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/11\/working-paper_2026-11-10_Recursive-Self-Improvement.png","width":1376,"height":864},{"@type":"BreadcrumbList","@id":"https:\/\/forecastingresearch.org\/research\/recursive-self-improvement-v1#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/forecastingresearch.org\/"},{"@type":"ListItem","position":2,"name":"How Close is Recursive Self-Improvement? A Review of the Evidence"}]},{"@type":"WebSite","@id":"https:\/\/forecastingresearch.org\/#website","url":"https:\/\/forecastingresearch.org\/","name":"Forecasting Research Institute","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/forecastingresearch.org\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/forecastingresearch.org\/api\/wp\/v2\/research\/2711","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/forecastingresearch.org\/api\/wp\/v2\/research"}],"about":[{"href":"https:\/\/forecastingresearch.org\/api\/wp\/v2\/types\/research"}],"version-history":[{"count":38,"href":"https:\/\/forecastingresearch.org\/api\/wp\/v2\/research\/2711\/revisions"}],"predecessor-version":[{"id":2770,"href":"https:\/\/forecastingresearch.org\/api\/wp\/v2\/research\/2711\/revisions\/2770"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/forecastingresearch.org\/api\/wp\/v2\/media\/2725"}],"wp:attachment":[{"href":"https:\/\/forecastingresearch.org\/api\/wp\/v2\/media?parent=2711"}],"wp:term":[{"taxonomy":"research_type","embeddable":true,"href":"https:\/\/forecastingresearch.org\/api\/wp\/v2\/research_type?post=2711"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}