NZ Demographic Bias Dataset
收藏arXiv2023-09-12 更新2024-08-06 收录
下载链接：
http://arxiv.org/abs/2309.08624v1
下载链接
链接失效反馈官方服务：
资源简介：
NZ Demographic Bias Dataset是由奥克兰大学计算机科学学院创建的，旨在量化新西兰社会中未被充分代表群体的偏见。该数据集包含285条文本，通过手动标注来评估大型语言模型中的偏见。数据集的创建过程涉及使用预定义模板生成文本，并由三名了解新西兰社会背景的标注者进行评估。该数据集主要用于研究和开发减少偏见的技术，以及评估算法在不同社会群体中的公平性。
NZ Demographic Bias Dataset was developed by the School of Computer Science at the University of Auckland, with the aim of quantifying bias against underrepresented groups in New Zealand society. This dataset comprises 285 texts, which are manually annotated to evaluate bias in large language models (LLMs). The dataset creation process involves generating texts using predefined templates, followed by evaluation conducted by three annotators who have a solid understanding of New Zealand's social context. This dataset is primarily utilized for research and development of bias mitigation technologies, as well as assessing the fairness of algorithms across diverse social groups.
提供机构：
奥克兰大学计算机科学学院
创建时间：
2023-09-12
