遇见数据集

Cryptotype LLM Probe: a Roman-law instrument for cultural-frame and fluency-confound testing in LLMs

收藏
Zenodo2026-07-26 更新2026-08-02 收录
官方服务:

资源简介:

A probe and benchmark for measuring conceptual- and cultural-frame defaults in large language models, built on a Roman-law "cryptotype" instrument (bonus et diligens pater familias). It includes item sets, runners (latent log-probability, forced choice, free-generation default-lean, and a WVS/Hofstede anchor), raw outputs with bootstrap confidence intervals, a frozen pre-registration protocol, and a blind expert-validation packet. Key results: naive latent frame-probes are dominated by continuation fluency (removed by matched minimal pairs); and the models' unmarked "neutral" is a marked, cross-lingually imposed value profile that flattens real US-Hungary cultural differences, replicating and extending the WEIRD-default literature across US, EU, and Chinese-origin models.

提供机构:
Zenodo
创建时间:
2026-07-26
二维码
社区交流群
二维码
科研交流群
商业服务