遇见数据集

Dolma 1.5 Culture-Symbol Relevancy Classification

收藏
Zenodo2024-12-10 更新2026-05-26 收录
官方服务:

资源简介:

This is supplementatry material for paper "Attributing Culture-Conditioned Generations to Pretraining Corpora", containing pretraining documents from Dolma 1.5 corpora that our MEMOed framework deem "relevant" to the memorization of a symbol for a culture. The data is formatted as: { "<symbol1>": { "<culture1>": { [<document_id>, <d-SNR score>, <d-SENT score>, <d-TOK score>],... }, ... }, "<symbol2>": ..., ... }

提供机构:
Zenodo
创建时间:
2024-12-10
二维码
社区交流群
二维码
科研交流群
商业服务