Scoopfeeds — Intelligent news, curated.
agentic-ai

theory uplift differentially benefits safety & is underleveraged

LessWrong · May 20, 2026, 9:43 PM

ARC is a much better bet now than it was in 2023. [5.2]. My understanding is also that no one is working on developing AI-powered conceptual tooling infrastructure for tackling problems in, for instance, metaphilosophy. This is a much harder problem.[6] In worlds where alignment is easy, prosaic methods may scale. In worlds where alignment is harder than easy, guarantees are more wanted. Hard worlds are less hard now because guarantees are easier. This is incredible and should be leveraged.^Concretely: I expect an OAI model to serve as a more efficient proof oracle for ~any well-specified mathematics problem (bar perhaps a singular expert) by Q1 2027.^AI Futures has as medians for automated coder and superhuman AI researcher as June and December 2028 respectively.^I mean this in both the absolute sense and the relative sense.Who comes to mind: Convergent is incubating a FRO focused on the specification generation problem, Theorem is working on formal verification, ARIA is funding formal methods broadly, Fulcrum is working on elicitation. 5.5 Pro estimates total investment in these orgs t

Article preview — originally published by LessWrong. Full story at the source.
Read full story on LessWrong → More top stories
Aggregated and edited by the Scoop newsroom. We surface news from LessWrong alongside other reporting so you can compare coverage in one place. Editorial policy · Corrections · About Scoop