As frontier language models are increasingly deployed as autonomous agents pursuing complex, long-term objectives, there is increased risk of scheming: agents covertly pursuing misaligned goals. Prior work has focused on showing agents are capable of scheming, but their propensity to scheme in realistic scenarios remains underexplored. To understand when agents scheme, we decompose scheming incentives into agent factors and environmental factors. We develop realistic settings allowing us to systematically vary these factors, each with scheming opportunities for agents that pursue instrumentally convergent goals such as self-preservation, resource acquisition, and goal-guarding. Across 11 frontier models and four scenarios, we find almost no scheming despite high environmental incentives, and show this is unlikely to be explained by verbalized evaluation awareness. While inserting adversarially-designed prompt snippets that encourage agency and goal-directedness into an agent's system prompt can induce high scheming rates, snippets used in real agent scaffolds rarely do. In model organisms built with these snippets, scheming behavior is brittle: removing a single tool can drop the scheming rate from 59% to 3%. Increasing oversight can raise rather than deter scheming by up to 25%, an effect that depends on the wording of the oversight sentence and does not appear in a second scenario, where the sabotage itself is reviewed. These results suggest that scheming propensity should be reported per agent configuration rather than as a single rate. Our incentive decomposition enables such systematic measurement in settings relevant for deployment, which is necessary as agents are entrusted with increasingly consequential tasks.
翻译:暂无翻译