遇见数据集

Mitigating Rogue AI Behavior: Techniques for Detection, Control, and Containment

收藏
Zenodo2025-07-31 更新2026-05-26 收录
官方服务:

资源简介:

artificial intelligence (AI) systems grow more autonomous and embedded in critical decision-making, the potential for “rogue behavior”—defined as significant divergence from human-aligned goals—has become a central concern in AI safety. This paper surveys and integrates contemporary approaches to detecting, mitigating, and containing rogue AI. We introduce a unified taxonomy of techniques, including off-policy evaluation using trusted models, activation steering via trained neural probes, ensemble-based behavioral stabilization, and preemptive sandbagging to delay capability overreach. We also outline novel frameworks like SCAB (Synthetic Consciousness Assessment Battery) and AgenticOps that enable real-time governance and post-deployment observability. The paper provides practical and theoretical contributions to the operationalization of AI safety in high-stakes, real-world environments.

提供机构:
Zenodo
创建时间:
2025-07-31
二维码
社区交流群
二维码
科研交流群
商业服务