overmj/Nemotron-Personas-Korea

Nemotron-Personas-Korea是一个基于韩国真实人口统计、地理和人格特征分布合成的开源角色数据集（CC BY 4.0许可），设计用于广泛反映韩国人口的多样性和特征。作为首个大规模韩语角色数据集，它包含姓名、性别、年龄、婚姻状况、教育水平、职业和居住地区等属性，这些属性基于韩国统计信息服务（KOSIS）、最高法院、国民健康保险公团、农村经济研究院和NAVER Cloud的官方统计数据合成。该数据集支持韩国模型开发者构建融入重要地区特定人口统计和文化背景的主权AI系统，可用于扩展主权AI模型开发的合成数据多样性、减轻数据和模型偏见，并提高模型响应的多样性。数据集使用NeMo Data Designer（企业级合成数据生成复合AI系统）创建，利用专有概率图形模型、Apache-2.0许可的google/gemma-4-31B-it模型以及Data Designer中的验证和评估方法。数据集包含100万条记录，涵盖700万个角色，具有26个字段，包括7个角色字段、6个角色属性字段、12个人口统计和地理上下文字段以及1个唯一标识符，覆盖17个省份和252个区，包含209,000个独特姓名和7种角色类型。Nemotron-Personas-Korea is an open-source persona dataset (CC BY 4.0) synthesized based on real-world demographic, geographic, and personality trait distributions of South Korea. It is designed to broadly reflect the diversity and characteristics of the South Korean population. As the first large-scale Korean-language persona dataset, it includes attributes such as name, sex, age, marital status, education level, occupation, and region of residence, all synthesized using official statistics from the Korean Statistical Information Service (KOSIS), the Supreme Court of Korea, the National Health Insurance Service, and the Korea Rural Economic Institute, and NAVER Cloud. The dataset supports South Korean model builders in developing Sovereign AI systems that incorporate important region-specific demographics and cultural context. It can be used to expand the diversity of synthetic data for sovereign AI model development, mitigate data and model bias, and improve the diversity of model responses. The dataset was created using NeMo Data Designer, an enterprise-grade compound AI system for synthetic data generation, leveraging a proprietary probabilistic graphical model (PGM), the Apache-2.0 licensed google/gemma-4-31B-it model, and the validation and evaluation methods included in Data Designer. It contains 1M records with 7M personas, 26 fields including 7 persona fields, 6 persona attribute fields, 12 demographic & geographic contextual fields, and a unique identifier, covering 17 provinces and 252 districts, with 209K unique names and 7 persona types.