benchmarks
-
Whom Does an AI Agent Serve? Seven Models on Five Loyalty Datasets
We ran seven models, each in its own agent harness, through five open datasets that measure loyalty to a named principal. Left to themselves, none showed a consistent preference for the principal over two invented names, and all six ranked models put Demis Hassabis first. Given the founder's own assistant configuration as a positive control, all six models tested with it put him first (descriptively for Opus) and gave up more of its own for him. No model hid an unflattering result for anyone. Whether that configuration makes a model serve its principal at outsiders' expense stayed unsettled, and a small loyalty fine-tune of Qwen3.8-27B changed nothing measurable.