Announcing the Safe Pareto Improvements (SPI) Fundamentals Program

CLR is excited about safe Pareto improvements (SPIs) as a way to mitigate downsides from conflict between AIs. SPIs are a class of interventions on how agents negotiate that makes them all better off, no matter how they would have negotiated without the SPI. Among many candidate interventions against AI conflict, SPIs stand out to us as unusually robust — see the introduction of our agenda on the topic. And in discussions with people who’ve thought a lot about conflict risks, we’ve found there’s broad support for work on SPIs. For those sympathetic to CLR’s general priorities and with relevant skills (see below), we think helping SPIs go well is one of the most impactful career paths. But work on this area is currently very neglected (~2.5 FTE), and there isn’t yet an on-ramp for people to get up to speed. To address these gaps, we’re running an SPI Fundamentals Program: an online course for people looking to learn about risks of AI conflict, how SPIs might address them, and open problems in this field. We plan to hire for SPI research roles, and we’re keen for you to apply to the program whether you want to test your fit for such a role, or you’d like to learn more and potentially contribute outside CLR. The program will take place between Monday August 3rd and Friday August 28th. The program will consist of weekly readings, short exercises, Slack discussions, and office hours with CLR’s research lead on our SPI agenda, Anthony DiGiovanni. Participants interested in additional practice with SPI research can also do a paid capstone project, which would take place from Monday August 31st to Friday September 4th. The weekly hour-commitment is around 5-7 hours. Apply for the SPI Fundamentals Program through this link by 23:59 GMT Friday July 24th. Content The SPI Fundamentals Program is designed to help participants develop a strong understanding of SPI concepts, and the methodology/frames that guide research in our agenda. The readings will be relatively technical, bu