Home Artificial Intelligence Frontier Model Forum updates

Frontier Model Forum updates

0
Frontier Model Forum updates

Over the past yr, industry has driven significant advances within the capabilities of AI. As those advances have accelerated, latest academic research into AI safety is required. To deal with this gap, the Forum and philanthropic partners are making a latest AI Safety Fund, which can support independent researchers from world wide affiliated with academic institutions, research institutions, and startups. The initial funding commitment for the AI Safety Fund comes from Anthropic, Google, Microsoft, and OpenAI, and the generosity of our philanthropic partners, the Patrick J. McGovern Foundation, the David and Lucile Packard Foundation[^footnote-1], Eric Schmidt, and Jaan Tallinn. Together this amounts to over $10 million in initial funding. We predict additional contributions from other partners.

Earlier this yr, the members of the Forum signed on to voluntary AI commitments on the White House, which included a pledge to facilitate third-party discovery and reporting of vulnerabilities in our AI systems. The Forum views the AI Safety Fund as a crucial a part of fulfilling this commitment by providing the external community with funding to higher evaluate and understand frontier systems. The worldwide discussion on AI safety and the final AI knowledge base will profit from a wider range of voices and perspectives. 

The first focus of the Fund will probably be supporting the event of recent model evaluations and techniques for red teaming AI models to assist develop and test evaluation techniques for potentially dangerous capabilities of frontier systems. We imagine that increased funding on this area will help raise safety and security standards and supply insights into the mitigations and controls industry, governments, and civil society need to answer the challenges presented by AI systems. 

The Fund will put out a call for proposals inside the subsequent few months. Meridian Institute will administer the Fund—their work will probably be supported by an advisory committee comprised of independent external experts, experts from AI firms, and individuals with experience in grantmaking.

LEAVE A REPLY

Please enter your comment!
Please enter your name here