microsoft/CoSApien

CoSApien是一个包含现实世界场景的人工编写基准，这些场景中多样化的安全标准至关重要。每个场景都包括一个详细的安全配置，描述了可接受和不可接受的内容，以及一组经过仔细挑选的评估提示。这些场景涵盖了各种背景，如游戏开发、区域出版标准和刑事调查，突显了细微的、文化敏感的安全要求。

CoSApien is a human-authored benchmark comprising real-world scenarios where diverse safety standards are critical. Each scenario includes a detailed safety config describing acceptable and unacceptable content and a set of carefully curated evaluation prompts. Scenarios span various contexts, such as game development, regional publishing standards, and criminal investigations, highlighting nuanced, culturally-informed safety requirements.