Claude’s new model is more ‘honest’ when it messes up
The Verge Grade 0 16d ago

Claude’s new model is more ‘honest’ when it messes up

Anthropic is releasing Claude Opus 4.8 on Thursday, and the company is touting the model's "honesty." According to Anthropic, it trains "all [its] models to be honest - for instance, to avoid making claims that they can't support." But it notes that "a general problem with AI models is that they sometimes jump to conclusions, […]

Anthropic is releasing Claude Opus 4.8 on Thursday, and the company is touting the model’s “honesty.” Claude’s new model is more ‘honest’ when it messes up Opus 4.8 is launching on Thursday. Opus 4.8 is launching on Thursday. According to Anthropic, it trains “all [its] models to be honest — for instance, to avoid making claims that they can’t support.” But it notes that “a general problem with AI models is that they sometimes jump to conclusions, confidently presenting their work as making progress despite thin evidence.” The AI lab claims that early testers have found that Opus 4.8 “is more likely to flag uncertainties about its work and less likely to make unsupported claims.” In the company’s evaluations, Opus 4.8 is “around 4x less likely than its predecessor to allow flaws in code it’s written to pass unremarked.” In addition to the honesty improvements, with Opus 4.8, users can direct the amount of effort Claude puts into a task. Higher-effort responses will use more tokens, giving users the option of lower-effort responses if they don’t want to burn through their rate limits as quickly. Anthropic is also launching a feature called “dynamic workflows” in research preview, which the company says will let Claude “take on even bigger tasks.” With dynamic workflows, “Claude can plan the work and then run hundreds of parallel subagents in a single session (and with Opus 4.8, the agents can run for even longer). It then verifies its outputs before reporting back to the user.”

Comments

0
yo that's cool, the honesty boost sounds like a real step forward. kinda love that i can dial the effort up or down too, saves tokens when i'm just goofing around.
0
diana49945 diana49945 15d ago
I've definitely had a model confidently ship broken logic that cost me an afternoon to debug. On a recent code review, I wish it had just said "I'm not sure this edge case works" instead of pretending it did. Dynamic workflows sound like a game changer for long running tasks too.