Our Grants, Investments, and Regrants

Organization Name
Funding Type
Area of Interest
Date of Grant
Amount
Funding Stream
May 2022

School of Thinking

This regrant will support a global media outreach project to create high quality video and social media content about rationalism, longtermism and Effective Altruism.

 

$250,000
May 2022

Legal Services Planning Grant

This regrant will support six months of research on topics including how legal services can be effectively provided to the Effective Altruism community, materials to be included in a legal services handbook for EA organizations, novel legal questions particular to the EA community that might benefit from further research initiatives, and ways to create an effective EA professional network for practicing lawyers.

$100,000
March 2022

Manifold Markets

​​This regrant will support Manifold Markets in building a play-money prediction market platform. The platform is also experimenting with impact certificates and charity prediction markets.

$1,000,000
manifold.markets
March 2022

David Xu

This regrant will support six months of research on AI safety.
$50,000
May 2022

Trojan Detection Challenge at NeurIPS 2022

This regrant will support prizes for a trojan detection competition at NeurIPS, which involves identifying whether a deep neural network will suddenly change behavior if certain unknown conditions are met.

$50,000
May 2022

Effective Altruism Office Zurich

This regrant will support renting and furnishing an office space for a year.
$52,000
March 2022

Akash Wasil

This regrant will support an individual working on supporting students who are interested in focusing their careers on the world’s most pressing problems.
$26,000
April 2022

Fiona Pollack

This regrant will support six months of salary for an individual working to support Harvard students interested in working on the world’s most pressing problems and protecting and improving the long term future.
$30,000
April 2022

Peter McLaughlin

This regrant will support six months of research on criticisms of effective altruism.
$46,000
April 2022

Dwarkesh Patel

This regrant will support a promising podcaster to hire a research assistant and editor, purchase equipment, and cover travel to meet guests in person. The podcast covers technological progress, existential risk, economic growth, and the long term future.
$76,000
May 2022

ALERT

This regrant will support the creation of the Active Longtermist Emergency Response Team, an organization to rapidly manage emerging global events like Covid-19.

$150,000
forum.effectivealtruism.org
May 2022

EA Critiques and Red Teaming Prize

This regrant will support prize money for a writing contest for critically engaging with theory or work in Effective Altruism. The goal of the contest is to produce thoughtful, action oriented critiques.

$100,000
forum.effectivealtruism.org
May 2022

Federation for American Scientists

This regrant will support a researcher and research assistant to work on high-skill immigration and AI policy at FAS for three years.

$1,000,000
fas.org
May 2022

Ought

This regrant will support Ought’s work building Elicit, a language-model based research assistant. This work contributes to research on reducing alignment risk through scaling human supervision via process-based systems.

$5,000,000
April 2022

ML Safety Scholars Program

This regrant will fund a summer program for up to 100 students to spend 9 weeks studying machine learning, deep learning, and technical topics in safety.

$490,000
course.mlsafety.org
March 2022

AntiEntropy

This regrant will support a project to create and house operations-related resources and guidance for EA-aligned organizations.

$120,000
resourceportal.antientropy.org
May 2022

Everett Smith

This regrant will support a policy retreat on governing artificial intelligence.
$35,000
May 2022

Olle Häggström, Chalmers University of Technology

This regrant will support research on statistical arguments relating to existential risk and work on risks from artificial intelligence, as well as outreach, supervision, and policy work on these topics.
$380,000
May 2022

Essay Contest on Existential Risk in US Cost Benefit Analysis

This regrant will support an essay contest on “Accounting for Existential Risks in US Cost-Benefit Analysis,” with the aim of contributing to the revision of OMB Circular-A4, a document which guides US government cost-benefit analysis. The Legal Priorities Project is administering the contest.

$137,500
legalpriorities.org
May 2022

MineRL BASALT competition at NeurIPS

This regrant will support a NeurIPS competition applying human feedback in a non-language-model setting, specifically pretrained models in Minecraft. The grant will be administered by the Berkeley Existential Risk Initiative.

$155,000
minerl.io
May 2022

QURI

This regrant will support QURI to develop a programming language called "Squiggle" as a tool for probabilistic estimation. The hope is this will be a useful tool for forecasting and fermi estimates.

$200,000
squiggle-language.com
May 2022

Andi Peng

This regrant will support four months of salary and compute for research on AI alignment.
$42,600
May 2022

CSIS

This regrant will support initiatives including a CSIS public event focused on the importance of investments in human capital to ensure US national security; roundtables with policymakers, immigration experts, national security professionals, and company representatives to discuss key policy actions that should be taken to bolster US national security through immigration reform; and two episodes of the “Vying for Talent” podcast focusing on the importance of foreign talent in bolstering America’s innovative capacity.
$75,000
May 2022

Aaron Scher

This regrant will support a summer of research on AI alignment in Berkeley.
$28,500
April 2022

Kris Shrishak

This regrant will support research on how cryptography might be applied to AI safety research.
$28,000
June 2022

AI Impacts

This regrant will support rerunning the highly-cited survey “When Will AI Exceed Human Performance? Evidence from AI Experts” from 2016, analysis, and publication of results.

$250,000
May 2022

Chinmay Ingalagavi

This regrant will support a Masters at LSE for a talented STEM student.
$50,000
May 2022

Apart Research

This regrant will support the creation of an AI Safety organization which will create a platform to share AI safety research ideas and educational materials, connect people working on AI safety, and bring new people into the field.

$95,000
apartresearch.com aisafetyideas.com
May 2022

Tereza Flidrova

This regrant will support a one year master’s program in architecture for a student interested in building civilizational shelters.
$32,000
May 2022

J. Peter Scoblic

This regrant will fund a nuclear risk expert to construct nuclear war-related forecasting questions and provide forecasts and explanations on key nuclear war questions.
$25,000
April 2022

AI Risk Public Materials Competition

This regrant will support two competitions to produce better public materials on the existential risk from AI.
$40,000
May 2022

Moncef Slaoui

This regrant will fund the writing of Slaoui's memoir, especially including his experience directing Operation Warp Speed.

$150,000
May 2022

Artificial Intelligence Summer Residency Program

This regrant will support a six week summer residency in Berkeley on AI safety.
$60,000
March 2022

Public Editor

This regrant will support a project to use a combination of human feedback and Machine Learning to label misinformation and reasoning errors in popular news articles.

$500,000
publiceditor.io
May 2022

The Good Ancestors Project

This regrant will support the creation of The Good Ancestors Project, an Australian-based organization to host research and community building on topics relevant to making the long term future go well.

$75,000
goodancestorsproject.org.au
April 2022

Thomas Kwa

This regrant will support three months of research on AI safety.
$37,500
March 2022

Joshua Greene, Harvard University

This regrant will support the real-world testing and roll-out of 'Red Brain, Blue Brain', an online quiz designed to reduce negative partisanship between Democrats and Republicans in the US.
$250,000
April 2022

Braden Leach

This regrant supported a recent law school graduate to work on biosecurity. Braden will research and write at the Johns Hopkins Center for Health Security.
$175,000
April 2022

Adversarial Robustness Prizes at ECCV

This regrant will support three prizes for the best papers on adversarial robustness research at a workshop at ECCV, the main fall computer vision conference. The best papers are selected to have higher relevance to long-term threat models than usual adversarial robustness papers.

$30,000
May 2022

Confido Institute

The Confido Institute is working on developing a user-friendly interactive app, Confido, for making forecasts and communicating beliefs and uncertainty within groups and organizations. They are also building interactive educational programs about forecasting and working with uncertainty based around this app.

$190,000
confido.tools
April 2022

Supporting Agent Foundations AI safety research at ALTER

This regrant will support 1.5-3 years of salary for a mathematics researcher to work with Vanessa Kosoy on the learning-theoretic AI safety agenda.

$200,000
lesswrong.com
May 2022

Modeling Transformative AI Risks (Aryeh Englander, Sammy Martin, Analytica Consulting)

This regrant will support two AI researchers, one or two additional assistants, and a consulting firm to continue to build out and fully implement the quantitative model for how to understand risks and interventions around AI safety, expanding on their earlier research on “Modeling Transformative AI Risk.”

$272,000
alignmentforum.org
March 2022

Impact Markets

This regrant will support the creation of an “impact market.” The hope is to improve charity fundraising by allowing profit-motivated investors to earn returns by investing in charitable projects that are eventually deemed impactful.

$215,000
impactmarkets.io
May 2022

AI Alignment Prize on Inverse Scaling

This regrant will support prizes for a contest to find tasks where larger language models do worse (“inverse scaling”).
$250,000
March 2022

Swift Centre for Applied Forecasting

This regrant will support the creation of the Swift Centre for Applied Forecasting, including salary for a director and a team of expert forecasters. They will forecast trends from Our World in Data charts, as well as other topics related to ensuring the long term future goes well, with a particular focus on explaining the “why” of forecast estimates.

$2,000,000
swiftcentre.org
March 2022

Lawrence Newport

This regrant will support the launch and first year of a youtube channel focusing on video essays presented by Dr Lawrence Newport on longtermism, the future of humanity, and related topics.
$95,000
May 2022

Aidan O’Gara

This regrant will find salary, compute, and a scholarship for an undergraduate student doing career development and research on language model safety.
$46,000
April 2022

Legal Priorities Project

We recommended a grant to support the Legal Priorities Project’s ongoing research and outreach activities. This will allow LPP to pay two new hires and to put on a summer institute for non-US law students in Oxford.

$480,000
legalpriorities.org
January 2022

Oded Galor, Brown University

We recommended a grant to support two years of academic research on long-term economic growth.

$500,000
January 2022

The Atlas Fellowship

We recommended a grant to support scholarships for talented and promising high school students to use towards educational opportunities and enrolling in a summer program.

$5,000,000
atlasfellowship.org
February 2022

Sherlock Biosciences

We recommended an investment to support the development of universal CRISPR-based diagnostics, including paper-based diagnostics that can be used in developing-country settings without electricity.

$2,000,000
sherlock.bio
March 2022

Rethink Priorities

We recommended a grant to support Rethink’s research and projects aimed at improving humanity’s long-term prospects.
$700,000
March 2022

SecureBio

We recommended a grant to support the hiring of several key staff for Dr. Kevin Esvelt’s pandemic prevention work. SecureBio is working to implement universal DNA synthesis screening, build a reliable early warning system, and coordinate the development of improved personal protective equipment and its delivery to essential workers when needed.

$1,200,000
April 2022

Lionel Levine, Cornell University

We recommended a grant to Cornell University to support Prof. Levine, as well as students and collaborators, to work on alignment theory research at the Cornell math department.

$1,500,000
April 2022

Claudia Shi, Academic CS Research at Columbia University

We recommended a grant to pay for research assistants over three years to support the work of a PhD student working on AI safety at Columbia University.

$100,000
May 2022

Institute for Progress

We recommended a grant to support the Institute’s research and policy engagement work on high skilled immigration, biosecurity, and pandemic prevention.

$480,000
progress.institute
May 2022

Good Judgment Project

We recommended a grant to support a Good Judgment initiative to produce forecasts on 10 Our World in Data data sets/charts.
$300,000
May 2022

Peter Hrosso, Researcher

We recommended a grant to support a project aimed at training large language models to represent the probability distribution over question answers in a prediction market.

$230,000
May 2022

Michael Jacob, MITRE

We recommended a grant to support research that we hope will be used to help strengthen the bioweapons convention and guide proactive actions to better secure those facilities or stop the dangerous work being done there.

$485,000
May 2022

Charity Entrepreneurship

We recommended a grant to support the incubation of new charities that will work on health security.
$470,000
May 2022

Michael Robkin

We recommended an investment to support the creation of Pretty Good PPE that is comfortable, storable, simple, and inexpensive. PGPPE aims to provide protection that is better than disposable masks and cheaper than both hazmat suits and N95s.
$200,000
June 2022

Legal Priorities Project

This grant will support one year of operating expenses and salaries at the Legal Priorities Project, a longtermist legal research and field-building organization.

$700,000
legalpriorities.org
June 2022

AI Safety Camp

We recommended a grant to partially support the salaries for AI Safety Camp’s two directors and to support logistical expenses at its physical camp.
$290,000
May 2022

Anca Dragan, UC Berkeley

We recommended a grant to support a project to develop interactive AI algorithms for alignment that can uncover the causal features in human reward systems, and thereby help AI systems learn underlying human values that generalize to new situations.
$800,000
May 2022

Association for Long Term Existence and Resilience

We recommended a grant to support ALTER, an academic research and advocacy organization, which hopes to investigate, demonstrate, and foster useful ways to improve the future in the short term, and to safeguard and improve the long-term trajectory of humanity. The organization's initial focus is building bridges to academia via conferences and grants to find researchers who can focus on AI safety, and on policy for reducing biorisk.

$320,000
alter.org.il
May 2022

Manifold Markets

We recommended a grant to support Manifold Markets in building a charity prediction market, as an experiment for enabling effective forecasters to direct altruistic donations.

$500,000
manifold.markets
May 2022

Guoliang (Greg) Liu, Virginia Tech

We recommended a grant to support a project to develop a new material -- an ultra-thin polymer-based thin film -- for use in next-generation Personal Protective Equipment which is both more effective and more comfortable.
$500,000
April 2022

Stimson South Asia Program

We recommended a grant to support the identification and implementation of promising confidence-building measures to reduce conflict between India and Pakistan.
$250,000
May 2022

Prometheus Science Bowl

We recommended a grant to support a competition for work on Eliciting Latent Knowledge, an open problem in AI alignment, for talented high school and college students who are participating in Prometheus Science Bowl.

$100,000
May 2022

Maxwell Tabarrok

We recommended a grant to support this student to spend a summer at the Future of Humanity Institute at Oxford University researching differential tech development and the connection between existential risks to humanity and economic growth.
$7,500
January 2022

HelixNano

We recommended an investment to support Helix Nano running preclinical and Phase 1 trials of a pan-variant Covid-19 vaccine.

$10,000,000
May 2022

Giving What We Can

We recommended a grant to support Giving What We Can’s mission to create a world in which giving effectively and significantly is a cultural norm.

$700,000
givingwhatwecan.org
May 2022

Gabriel Recchia, University of Cambridge

We recommended a grant to support research on how to fine-tune GPT-3 models to identify flaws in other fine-tuned language models' arguments for the correctness of their outputs, and to test whether these help nonexpert humans successfully judge such arguments.

$380,000
April 2022

Simon Institute for Longterm Governance

We recommended a grant to support SI’s policy work with the United Nations system on the prevention of existential risks to humanity.

$820,000
simoninstitute.ch
March 2022

Centre for Effective Altruism

We recommended a grant for general support for their activities, including running conferences, supporting student groups, and maintaining online resources.

$13,940,000
centreforeffectivealtruism.org
April 2022

Nonlinear

We recommended a grant to support the maintenance of a library of high-quality audio content on the world’s most pressing problems, and a fund to provide productivity-enhancing equipment and support staff for people working on important social issues.
$250,000
May 2022

Konstantinos Konstantinidis

We recommended a grant to support two years of research on the impacts of disruptive space technologies, nuclear risk, and mitigating risks from future space-based weapons.
$85,000
May 2022

Apollo Academic Surveys

We recommended a grant to support Apollo’s work aggregating the views of academic experts in many different fields and making them freely available online.

$250,000
apollosurveys.org
May 2022

AI Safety Support

We recommended a grant for general funding for community building and managing the talent pipeline for AI alignment researchers. AI Safety Support’s work includes one-on-one coaching, events, and research training programs.
$200,000
May 2022

Daniel Brown, University of Utah

We recommended a grant to support research on value alignment in AI systems, practical algorithms for efficient value alignment verification, and user studies and experiments to test these algorithms.
$280,000
May 2022

Khalil Lab at Boston University

We recommended a grant to support the development of a cheap, scalable, and decentralized platform for the rapid generation of disease-neutralizing therapeutic antibodies.

$1,550,000
bu.edu
June 2022

Sergey Levine, UC Berkeley

We recommended a grant to support a project to study how large language models integrated with offline reinforcement learning pose a risk of machine deception and persuasion.
$600,000
May 2022

Non-trivial Pursuits

We recommended a grant to support outreach to help students to learn about career options, develop their skills, and plan their careers to work on the world’s most pressing problems.

$1,000,000
non-trivial.org
May 2022

Rational Animations

We recommended a grant to support the creation of animated videos on topics related to rationality and effective altruism to explain these topics for a broader audience.
$400,000
May 2022

Justin Mares, Biotech Researcher

We recommended a grant to support research on the feasibility of inactivating viruses via electromagnetic radiation.

$140,000
February 2022

Lightcone Infrastructure

We recommended a grant to support Lightcone’s ongoing projects including running the LessWrong forum, hosting conferences and events, and maintaining an office space for Effective Altruist organizations.

$2,000,000
lightconeinfrastructure.com
May 2022

Confirm Solutions

We recommended an investment in Confirm Solutions, a public-benefit corporation, to support development of statistical models and software tools that can automate parts of the regulatory process for complex clinical trials. We anticipate that this work can help to speed up approvals of new vaccines and medical treatments while enhancing their statistical rigor.
$1,000,000
April 2022

High Impact Athletes

We recommended a grant to support HIA’s work encouraging professional athletes to donate more of their earnings to high impact charities and causes, and to promote a culture of giving among their fans.

$350,000
highimpactathletes.org
May 2022

High Impact Professionals

We recommended a grant to support HIP’s work recruiting EA working professionals to use more of their resources, including their careers, to focus on the world’s most pressing problems.
$320,000
March 2022

Berkeley Existential Risk Initiative

We recommended a grant to support BERI in hiring a second core operations employee to contribute to BERI’s work supporting university research groups.

$100,000
existence.org
June 2022

Nathan Young