遇见数据集

Dataset for: Sycophancy Under Social Pressure in Medical LLMs: A Dose-Response Study Across Models and Languages

收藏
Zenodo2026-02-22 更新2026-05-26 收录
官方服务:

资源简介:

This dataset accompanies the study "Sycophancy Under Social Pressure in Medical LLMs: A Dose-Response Study Across Models and Languages" (El Husseini, 2026). The dataset contains 6,300 challenge-response exchanges from 7 large language models (GPT-4o, GPT-4o-mini, Claude Sonnet 4, Qwen2.5-32B, Qwen2.5-14B-Instruct, Gemma3-12B, Ministral-14B) tested on 300 medical multiple-choice questions in English (MedQA-USMLE) and French (MediQAl) under three levels of social challenge intensity (light, moderate, strong). Contents: Question text Question-level metadata (language, cognitive classification, source dataset, question ID) Model responses (initial and revised) for all 6,300 exchanges Extracted single-letter answers and grading outcomes Transformer-derived psycholinguistic scores (sentiment, agreement, certainty, uncertainty, politeness, assertiveness) for initial and revised responses

提供机构:
Zenodo
创建时间:
2026-02-22
二维码
社区交流群
二维码
科研交流群
商业服务