Skip to content
@forecastingresearch

Forecasting Research Institute

Advancing the science of forecasting for the public good

We develop forecasting methods to improve decision-making on high-stakes issues. First-generation forecasting research—spearheaded by FRI Chief Scientist Philip Tetlock and coauthors—focused on establishing a rigorous standard for prediction accuracy. The next generation of work aims to channel this approach into real-world relevance. We work with policymakers and nonprofit organizations to design practical forecasting tools, and test them in large experiments.

Our research centers on:

  1. Producing high-quality forecasting questions about complex, long-run topics;
  2. Novel methods for resolving unresolvable questions;
  3. Testing the robustness of forecasting techniques across different domains and contexts; and
  4. Using forecasting tools to help organizations make better decisions.

Pinned Loading

  1. xpt-lib xpt-lib Public

    Provides the data (anonymized) and code necessary to replicate the results of the Existential Risk Persuasion Tournament (XPT). The XPT was a forecasting tournament that explored potential threats …

    R 5 1

  2. aggutils aggutils Public

    Utilities for Aggregating Probabilistic Forecasts

    R 3

  3. forecastbench forecastbench Public

    A dynamic forecasting benchmark for LLMs

    Python 11 1

  4. forecastbench-datasets forecastbench-datasets Public

    Forecastbench Datasets, updated nightly

    JSON 4

  5. adversarial-collab adversarial-collab Public

    Provides the data (anonymized) and code necessary to replicate the results in FRI's report "Roots of Disagreement on AI Risk: Exploring the Potential and Pitfalls of Adversarial Collaboration."

  6. voivod voivod Public

    Provides a set of statistics for evaluating forecasting questions (not forecasts, but the questions themselves, with respect to another question), i.e. assessing the cruxiness of questions. Current…

    R

Repositories

Showing 9 of 9 repositories
  • forecastbench-datasets Public

    Forecastbench Datasets, updated nightly

    forecastingresearch/forecastbench-datasets’s past year of commit activity
    JSON 4 CC-BY-SA-4.0 0 0 0 Updated Jan 6, 2025
  • forecastbench Public

    A dynamic forecasting benchmark for LLMs

    forecastingresearch/forecastbench’s past year of commit activity
    Python 11 MIT 1 14 2 Updated Dec 19, 2024
  • xpt-lib Public

    Provides the data (anonymized) and code necessary to replicate the results of the Existential Risk Persuasion Tournament (XPT). The XPT was a forecasting tournament that explored potential threats to humanity, with a focus on artificial intelligence, biosecurity, climate, and nuclear arms.

    forecastingresearch/xpt-lib’s past year of commit activity
    R 5 1 0 0 Updated Dec 6, 2024
  • xpt-ijf-replication Public

    A repository containing code needed for replicating results from "Subjective-Probability Forecasts of Existential Risk: Initial Results from a Hybrid Persuasion-Forecasting Tournament"

    forecastingresearch/xpt-ijf-replication’s past year of commit activity
    R 0 0 0 0 Updated Dec 4, 2024
  • utils Public

    Utility files (mainly GCP functions)

    forecastingresearch/utils’s past year of commit activity
    Python 0 MIT 0 0 0 Updated Oct 10, 2024
  • .github Public
    forecastingresearch/.github’s past year of commit activity
    0 MIT 0 0 0 Updated Oct 1, 2024
  • voivod Public

    Provides a set of statistics for evaluating forecasting questions (not forecasts, but the questions themselves, with respect to another question), i.e. assessing the cruxiness of questions. Currently the package includes several implementations each of value of information (VOI) and value of discrimination (VOD).

    forecastingresearch/voivod’s past year of commit activity
    R 0 MIT 0 1 0 Updated Jul 11, 2024
  • adversarial-collab Public

    Provides the data (anonymized) and code necessary to replicate the results in FRI's report "Roots of Disagreement on AI Risk: Exploring the Potential and Pitfalls of Adversarial Collaboration."

    forecastingresearch/adversarial-collab’s past year of commit activity
    0 MIT 0 0 0 Updated Mar 5, 2024
  • aggutils Public

    Utilities for Aggregating Probabilistic Forecasts

    forecastingresearch/aggutils’s past year of commit activity
    R 3 0 1 0 Updated Feb 9, 2024

Top languages

Loading…

Most used topics

Loading…