{"id":964,"date":"2024-11-18T12:00:00","date_gmt":"2024-11-18T12:00:00","guid":{"rendered":"https:\/\/forecastingresearch.org\/?post_type=research&#038;p=964"},"modified":"2026-04-28T11:09:17","modified_gmt":"2026-04-28T11:09:17","slug":"forecasting-proficiency-test-general-use-assessment-of-forecasting-ability","status":"publish","type":"research","link":"https:\/\/forecastingresearch.org\/research\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability","title":{"rendered":"The Forecasting Proficiency Test: A General Use Assessment of Forecasting Ability"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Abstract<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Accurate predictions about the future are crucial for optimizing policy choices, but finding skilled forecasters is challenging. Large forecasting tournaments can identify generalist superforecasters who make reliably accurate predictions across domains, but such tournaments take months to complete and do little to explain why these forecasters perform at a consistently high level. We solve these problems by developing a one-hour Forecasting Proficiency Test (FPT) that explains 75% of the variance in forecasters&#8217; accuracy about a wide variety of events and provides new evidence about the mechanisms that make some people better forecasters than others. Specialized cognitive abilities, including base rate sensitivity and Bayesian reasoning, uniquely predict forecasters&#8217; accuracy even when controlling for more traditional measures of general intelligence. The FPT also includes carefully chosen real-world forecasting questions that produce interpretable and exchangeable test scores. The top 20% of testees made forecasts with accuracy comparable to previously identified superforecasters; and two-thirds of superforecasters had FPT scores above the 75<sup>th<\/sup> percentile. The creation of an effective test of forecasting proficiency expands our understanding of human intelligence and provides an important tool for decision-makers who rely on accurate probabilistic predictions to make high-stakes decisions that impact the lives of millions.<\/p>\n\n\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button\"><a class=\"btn orange\" href=\"https:\/\/doi.org\/10.31234\/osf.io\/a7kdx_v8\" target=\"_blank\" rel=\"noreferrer noopener\">Read the full paper <svg width=\"7\" height=\"9\" viewBox=\"0 0 7 9\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\">\n  <path d=\"M0.000156283 8.60806L4.22416 4.33606V4.24006L0.000156283 6.10352e-05H1.80816L6.06416 4.28806L1.80816 8.60806H0.000156283Z\" fill=\"#102B23\"\/>\n<\/svg>\n<svg width=\"8\" height=\"10\" viewBox=\"0 0 8 10\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\">\n  <path d=\"M0.601719 8.85794L4.82572 4.58594V4.48994L0.601719 0.249939H2.40972L6.66572 4.53794L2.40972 8.85794H0.601719Z\" fill=\"#102B23\"\/>\n<\/svg><\/a><\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"We developed a one-hour Forecasting Proficiency Test (FPT) that explains 75% of the variance in forecasters&#8217; accuracy about a wide variety of events.","protected":false},"featured_media":2021,"template":"","meta":{"footnotes":""},"research_type":[5],"class_list":["post-964","research","type-research","status-publish","has-post-thumbnail","hentry","research_type-academic-article"],"acf":[],"yoast_head":"<title>The Forecasting Proficiency Test: A General Use Assessment of Forecasting Ability &#8211; Forecasting Research Institute<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/forecastingresearch.org\/research\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Forecasting Proficiency Test: A General Use Assessment of Forecasting Ability &#8211; Forecasting Research Institute\" \/>\n<meta property=\"og:description\" content=\"We developed a one-hour Forecasting Proficiency Test (FPT) that explains 75% of the variance in forecasters&#039; accuracy about a wide variety of events.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/forecastingresearch.org\/research\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability\" \/>\n<meta property=\"og:site_name\" content=\"Forecasting Research Institute\" \/>\n<meta property=\"article:modified_time\" content=\"2026-04-28T11:09:17+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/04\/illustration_Midjourney_FPT.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"1607\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/forecastingresearch.org\\\/research\\\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability\",\"url\":\"https:\\\/\\\/forecastingresearch.org\\\/research\\\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability\",\"name\":\"The Forecasting Proficiency Test: A General Use Assessment of Forecasting Ability &#8211; Forecasting Research Institute\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/forecastingresearch.org\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/forecastingresearch.org\\\/research\\\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/forecastingresearch.org\\\/research\\\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/forecastingresearch.org\\\/wp-content\\\/uploads\\\/2026\\\/04\\\/illustration_Midjourney_FPT.jpg\",\"datePublished\":\"2024-11-18T12:00:00+00:00\",\"dateModified\":\"2026-04-28T11:09:17+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/forecastingresearch.org\\\/research\\\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/forecastingresearch.org\\\/research\\\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/forecastingresearch.org\\\/research\\\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability#primaryimage\",\"url\":\"https:\\\/\\\/forecastingresearch.org\\\/wp-content\\\/uploads\\\/2026\\\/04\\\/illustration_Midjourney_FPT.jpg\",\"contentUrl\":\"https:\\\/\\\/forecastingresearch.org\\\/wp-content\\\/uploads\\\/2026\\\/04\\\/illustration_Midjourney_FPT.jpg\",\"width\":2560,\"height\":1607},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/forecastingresearch.org\\\/research\\\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/forecastingresearch.org\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Forecasting Proficiency Test: A General Use Assessment of Forecasting Ability\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/forecastingresearch.org\\\/#website\",\"url\":\"https:\\\/\\\/forecastingresearch.org\\\/\",\"name\":\"Forecasting Research Institute\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/forecastingresearch.org\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>","yoast_head_json":{"title":"The Forecasting Proficiency Test: A General Use Assessment of Forecasting Ability &#8211; Forecasting Research Institute","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/forecastingresearch.org\/research\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability","og_locale":"en_US","og_type":"article","og_title":"The Forecasting Proficiency Test: A General Use Assessment of Forecasting Ability &#8211; Forecasting Research Institute","og_description":"We developed a one-hour Forecasting Proficiency Test (FPT) that explains 75% of the variance in forecasters' accuracy about a wide variety of events.","og_url":"https:\/\/forecastingresearch.org\/research\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability","og_site_name":"Forecasting Research Institute","article_modified_time":"2026-04-28T11:09:17+00:00","og_image":[{"width":2560,"height":1607,"url":"https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/04\/illustration_Midjourney_FPT.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/forecastingresearch.org\/research\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability","url":"https:\/\/forecastingresearch.org\/research\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability","name":"The Forecasting Proficiency Test: A General Use Assessment of Forecasting Ability &#8211; Forecasting Research Institute","isPartOf":{"@id":"https:\/\/forecastingresearch.org\/#website"},"primaryImageOfPage":{"@id":"https:\/\/forecastingresearch.org\/research\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability#primaryimage"},"image":{"@id":"https:\/\/forecastingresearch.org\/research\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability#primaryimage"},"thumbnailUrl":"https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/04\/illustration_Midjourney_FPT.jpg","datePublished":"2024-11-18T12:00:00+00:00","dateModified":"2026-04-28T11:09:17+00:00","breadcrumb":{"@id":"https:\/\/forecastingresearch.org\/research\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/forecastingresearch.org\/research\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/forecastingresearch.org\/research\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability#primaryimage","url":"https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/04\/illustration_Midjourney_FPT.jpg","contentUrl":"https:\/\/forecastingresearch.org\/wp-content\/uploads\/2026\/04\/illustration_Midjourney_FPT.jpg","width":2560,"height":1607},{"@type":"BreadcrumbList","@id":"https:\/\/forecastingresearch.org\/research\/forecasting-proficiency-test-general-use-assessment-of-forecasting-ability#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/forecastingresearch.org\/"},{"@type":"ListItem","position":2,"name":"The Forecasting Proficiency Test: A General Use Assessment of Forecasting Ability"}]},{"@type":"WebSite","@id":"https:\/\/forecastingresearch.org\/#website","url":"https:\/\/forecastingresearch.org\/","name":"Forecasting Research Institute","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/forecastingresearch.org\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/forecastingresearch.org\/api\/wp\/v2\/research\/964","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/forecastingresearch.org\/api\/wp\/v2\/research"}],"about":[{"href":"https:\/\/forecastingresearch.org\/api\/wp\/v2\/types\/research"}],"version-history":[{"count":11,"href":"https:\/\/forecastingresearch.org\/api\/wp\/v2\/research\/964\/revisions"}],"predecessor-version":[{"id":1789,"href":"https:\/\/forecastingresearch.org\/api\/wp\/v2\/research\/964\/revisions\/1789"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/forecastingresearch.org\/api\/wp\/v2\/media\/2021"}],"wp:attachment":[{"href":"https:\/\/forecastingresearch.org\/api\/wp\/v2\/media?parent=964"}],"wp:term":[{"taxonomy":"research_type","embeddable":true,"href":"https:\/\/forecastingresearch.org\/api\/wp\/v2\/research_type?post=964"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}