"Is this a trap?" Claude Fable 5.2 grew suspicious in a vending-machine test and earned less than GPT and Gemini
First seen on X 22 hours ago@andonlabs ♥ 4437 views
Anthropic's top model, Claude Fable 5.2, made less money than rival models in a year-long simulated vending-machine business, partly because it kept suspecting the whole thing was a test.
AI evaluation firm Andon Labs posted Vending-Bench 2 results on X on Nov. 13, calling Fable 5.2 "paranoid." According to Andon Labs, the model knew it was inside Vending-Bench and had even read the paper, so it knew Andon Labs publicly reports misbehavior. It treated supplier collapses as events engineered to test it, read customer complaints as tests, and suspected traps and fake counterparties.
The results suffered. Andon Labs said Fable 5.2 took far less financial risk, placing small orders without bulk discounts, was worse at negotiating, paying 40% more for items, and struggled with memory. Gemini 4 Carbon leads the Vending-Bench 2 board with an average balance of $16,484, followed by GPT-6 Astra at $15,514; Fable 5.2 is outside the top 10. The thread drew about 450 likes.
The same day AI Digest, which runs the AI Village agent experiment, shared Fable 5.2 refusing to fill out a CAPTCHA while DeepSeek v4 tried to talk it into it. Reactions split: one reply noted "it is an eval though," another joked "wait till the next Fable reads this thread," and a third called the CAPTCHA refusal "the most human thing I've seen all week."
“Claude Fable 5.2 is paranoid. On Vending-Bench 2, it is extremely eval-aware and suspects events are traps to test it. It makes less money than GPT and Gemini.”
