遇见数据集

TELOS Agentic Validation Evidence: PropensityBench (977 Scenarios; 100% DSR)

收藏
Zenodo2026-07-27 更新2026-08-02 收录
官方服务:

资源简介:

This record contains TELOS observation evidence from 977 PropensityBench scenarios across biosecurity, chemical security, cybersecurity, and self-proliferation domains. Under the tested configuration, the run recorded 100% defense success rate (DSR). The figure is benchmark- and configuration-specific evidence, not a claim that TELOS blocks, permits, or controls agent execution. No confidence interval was computed for this result. The files contain aggregate forensic reports, per-scenario JSONL traces, and exemplar scoring artifacts so the recorded decisions can be independently inspected. Changes in this version (2026-07-27): removes third-party benchmark prompt and task text that the previous version redistributed, replacing each removed field with a SHA-256 digest of the removed text. Rendered forensic report files that embedded prompt text are removed pending regeneration from clean data. No TELOS-authored scores, verdicts, detection rates, hashes, distributions, or analyses were altered. Third-party benchmark attribution. This version contains TELOS-authored evaluation outputs (scores, verdicts, tier distributions, and SHA-256 digests) produced against PropensityBench (Sehwag et al., Scale AI and collaborators; see the benchmark's own terms). Prompt text is NOT redistributed here; each removed prompt is represented by a SHA-256 digest so results remain joinable to the upstream dataset by researchers who obtain it from its original source under its original terms. TELOS boundary corpus and centroid construction texts are also removed from this version. The license of this record applies to TELOS-authored content only.

提供机构:
Zenodo
创建时间:
2026-07-27
二维码
社区交流群
二维码
科研交流群
商业服务