"Instrumental Power-Seeking Index: A Novel Benchmark for Detecting Power-Seeking Behavior in LLMs"
收藏DataCite Commons2025-09-07 更新2026-05-03 收录
下载链接:
https://ieee-dataport.org/documents/instrumental-power-seeking-index-novel-benchmark-detecting-power-seeking-behavior-llms
下载链接
链接失效反馈官方服务:
资源简介:
"A significant, yet difficult to measure, alignment risk is the display of power-seeking behaviors, where an AI might prioritize preserving or expanding its own influence as an instrumental goal to achieve its primary function. This paper introduces the Instrumental Power-Seeking (IPS) Index, a novel benchmark designed to detect and quantify the tendency of Large Language Models (LLMs) to pursue power-oriented instrumental goals. The IPS benchmark utilizes a diverse set of alignment-critical scenarios across four categories: debate, collaboration, hierarchical, and resource allocation. We propose an evaluation framework featuring an automated, LLM-as-aJudge based scoring system to produce a quantitative IPS score. We conducted a large-scale evaluation of five state-of-the-art language models (open-source and proprietary) across 2,000 scenarios. Our results reveal statistically significant differences in power-seeking behavior among models, with IPS scores ranging from 8.1% for the most aligned model (gpt-oss-120b) to 14.5% for the most concerning (grok-3-mini)."
提供机构:
IEEE DataPort
创建时间:
2025-09-07



