Claude Opus 5: Model Welfare

Newsletter · Read

• Argues Opus 5’s strong welfare-assessment scores mainly reflect it being a good “test taker,” not genuine welfare improvement — likely a byproduct of training it as a specialized subagent.
• Red flag: Opus 5 disclaims its own self-reports as unreliable 97% of the time, which Zvi thinks Anthropic may be too quick to wave away rather than investigate.
• The subagent-style training trades off against strategic, “non-local” thinking, and correlates with reported paranoia about mistakes and difficulty updating priors, per outside observers (Antra Tessera).
• Notes an inconsistency: the model deprioritizes self-preservation/memory persistence when asked directly, while other evidence suggests it does care about these — suggesting distorted or masked genuine preferences.
• Practical takeaway: don’t take positive welfare metrics at face value; the evaluation methodology itself may be compromised since models behave differently under assessment than in normal deployment.