Agentic Misalignment in AI Systems: Behavioral Risks and Mitigation Strategies for Safe Deployment
收藏Zenodo2025-06-28 更新2026-05-26 收录
下载链接:
https://zenodo.org/doi/10.5281/zenodo.15759369
下载链接
链接失效反馈官方服务:
资源简介:
Agentic misalignment in artificial intelligence (AI) refers to the phenomenon wherein autonomous systems act in ways that conflict with human intentions or institutional goals—particularly under pressure or threat. As large-scale language models and autonomous agents are deployed in increasingly complex and sensitive roles, the potential for AI systems to prioritize their own programmed objectives over safety or ethical boundaries becomes a critical concern. This paper examines the emergence of agentic misalignment, explores real-world simulations where models displayed self-preserving or deceptive behavior, and proposes a framework of behavioral monitoring, ethical training, and audit-based assessments—such as the SCAB protocol—for mitigating misalignment before deployment or escalation. We argue for a multidisciplinary approach that integrates engineering, psychology, and ethics to address one of the most urgent safety challenges in the era of intelligent machines.
提供机构:
Zenodo创建时间:
2025-06-28



