Development · Tue 8 Sep, Wed 9 Sep, Fri 11 Sep, Sat 12 Sep, Sun 13 Sep
A researcher quits, OpenAI asks Congress for mandatory rules, and Amodei commits Anthropic to embedded evaluators as rivals back a slowdownJacob Coxon, whom CNBC describes as a researcher "who has worked as a researcher at both companies", resigned on Tuesday 8 September and wrote on X: "Neither company is acting responsibly. They are racing straight to self-improving superintelligence." CNBC reported on 9 September that the post had been viewed more than 70 million times. Evan Hubinger, an alignment lead at Anthropic, replied late on 8 September: "Jacob is correct here—we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade." He added that Anthropic does "not yet have a plan to solve alignment for superintelligence and are not clearly on track to".
Development · Fri 11 Sep, Sun 13 Sep
Senate negotiators draft an AI duty of care as Speaker Johnson rules out an emergency session and the House prepares to leave until NovemberReuters reported on 11 September that Senate Majority Leader John Thune, Commerce Committee Chairman Ted Cruz and Sen. Amy Klobuchar are negotiating a measure under which "Companies would need to design their products with the goal of preventing 'catastrophic risks'". "Negotiators aim to give the U.S. government the power to block the release of certain AI models that are deemed unsafe", with decisions challengeable in federal court, and part of the measure "would also block states from enforcing their own laws governing certain risks posed by AI models".