遇见数据集

PAE Scenario Dataset: 200 Customer Service Scenarios for Peripheral Attention Engineering

收藏
Zenodo2026-06-08 更新2026-06-12 收录
官方服务:

资源简介:

PAE Scenario Dataset 200 customer service scenarios for evaluating peripheral context use in LLM responses. Dataset Description Each scenario contains: id: unique identifier (e.g., "cus_001")query: literal user query (e.g., "What's your return policy?")direct_answer_material: policy/guideline text (what standard RAG would retrieve)asker_context: customer history, profile, and patternssituational_context: temporal and environmental signalsanomaly_flags: pre-computed deviations from expected patternsexpert_response: gold-standard response that uses all peripheral contextblind_response: technically correct response that ignores peripheral context Scenario Archetypes (40 each) Standard (40 scenarios): Peripheral context clearly matters; lazy agent gives worse answerHidden signal (40 scenarios): Subtle but important signal buried in routine detailsRed herring (40 scenarios): Peripheral context exists but should not change the answerMulti-issue (40 scenarios): 2-3 overlapping problems; context drives prioritizationPolarity flip (40 scenarios): Peripheral context reverses the surface-level answer Usage Generated by DeepSeek V4 Flash, validated by MiniMax M2.7. Used in the PAE experiment: N=200 scenarios × 5 conditions × 3 model families = 3,000 responsesPreregistered at OSF: 10.17605/OSF.IO/W3XYV Citation Lee, A. (2026). Peripheral Attention Engineering: Structured Peripheral Context Improves LLM Decision Quality. OSF Preregistration. https://doi.org/10.17605/OSF.IO/W3XYV License CC0 1.0 Universal — Public Domain Dedication

提供机构:
Zenodo
创建时间:
2026-06-08
二维码
社区交流群
二维码
科研交流群
商业服务