ADD 2023 Challenge Track 1.2 Evaluation Dataset (Round 1)

Audio deepfake detection is an emerging topic in the artificial intelligence community. The second Audio Deepfake Detection Challenge (ADD 2023) aims to spur researchers around the world to build new innovative technologies that can further accelerate and foster research on detecting and analyzing deepfake speech utterances. Different from previous challenges (e.g. ADD 2022), ADD 2023 focuses on surpassing the constraints of binary real/fake classification, and actually localizing the manipulated intervals in a partially fake speech as well as pinpointing the source responsible for generating any fake audio. Furthermore, ADD 2023 includes more rounds of evaluation for the fake audio game sub-challenge. The ADD 2023 challenge (http://addchallenge.cn/add2023) includes three subchallenges: audio fake game (FG), manipulation region location (RL) and deepfake algorithm recognition (AR). This paper describes the datasets, evaluation metrics, and protocols. Some findings are also reported in audio deepfake detection tasks. The ADD 2023 dataset is publicly available. This data set is licensed with a CC BY-NC-ND 4.0 license. If you use this dataset, please cite the following paper: Jiangyan Yi, Jianhua Tao, Ruibo Fu, Xinrui Yan, Chenglong Wang, Tao Wang, Chu Yuan Zhang, Xiaohui Zhang, Yan Zhao, Yong Ren, Le Xu, Junzuo Zhou, Hao Gu, Zhengqi Wen, Shan Liang, Zheng Lian, Shuai Nie, Haizhou Li: ADD 2023: the Second Audio Deepfake Detection Challenge. DADA@IJCAI 2023: 125-130音频深度伪造检测是人工智能领域的新兴研究方向。第二届音频深度伪造检测挑战赛（Audio Deepfake Detection Challenge，ADD 2023）旨在激励全球研究者开发创新性技术，进一步推动并深化深度伪造语音的检测与分析研究。与往届挑战赛（如ADD 2022）不同，ADD 2023突破了二元真假分类的局限，不仅能够定位部分伪造语音中的篡改区间，还可精准识别伪造音频的生成来源。此外，针对伪造音频博弈子挑战赛，ADD 2023增设了多轮评估环节。本次ADD 2023挑战赛（http://addchallenge.cn/add2023）下设三个子挑战赛：音频伪造博弈赛（Audio Fake Game，FG）、篡改区域定位赛（Manipulation Region Location，RL）以及深度伪造算法识别赛（Deepfake Algorithm Recognition，AR）。本文详细介绍了本次挑战赛的数据集、评估指标与评测流程，并汇报了音频深度伪造检测任务中的部分研究发现。 ADD 2023数据集已公开发布。 该数据集采用CC BY-NC-ND 4.0开源许可协议。 若使用本数据集，请引用如下论文： 易江艳、陶建华、傅瑞波、闫新瑞、王成龙、王涛、张楚源、张晓辉、赵岩、任勇、徐乐、周俊佐、顾昊、温正棋、梁善、连政、聂帅、李海洲：ADD 2023：第二届音频深度伪造检测挑战赛，DADA@IJCAI 2023，第125-130页。