Codecfake dataset - training set (part 2 of 3)

This dataset is the training set (part 2 of 3) of the Codecfake dataset , corresponding to the manuscript "The Codecfake Dataset and Countermeasures for Universal Deepfake Audio Detection".

Abstract

With the proliferation of Audio Language Model (ALM) based deepfake audio, there is an urgent need for effective detection methods. Unlike traditional deepfake audio generation, which often involves multi-step processes culminating in vocoder usage, ALM directly utilizes neural codec methods to decode discrete codes into audio. Moreover, driven by large-scale data, ALMs exhibit remarkable robustness and versatility, posing a significant challenge to current audio deepfake detection (ADD)models. To effectively detect ALM-based deepfake audio, we focus on the mechanism of the ALM-based audio generation method, the conversion from neural codec to waveform. We initially construct the Codecfake dataset, an open-source large-scale dataset, including two languages, millions of audio samples, and various test conditions, tailored for ALM-based audio detection. Additionally, to achieve universal detection of deepfake audio and tackle domain ascent bias issue of original SAM, we proposethe CSAM strategy to learn a domain balanced and generalized minima. Experiment results demonstrate that co-training on Codecfake dataset and vocoded dataset with CSAM strategy yield the lowest average Equal Error Rate (EER) of 0.616% across all test conditions compared to baseline models.

Codecfake Dataset

Due to platform restrictions on the size of zenodo repositories, we have divided the Codecfake dataset into various subsets as shown in the table below:

Codecfake dataset
description
link

training set (part 1 of 3) & label
train_split.zip & train_split.z01 - train_split.z06
https://zenodo.org/records/11171708

training set (part 2 of 3)
train_split.z07 - train_split.z14
https://zenodo.org/records/11171720

training set (part 3 of 3)
train_split.z15 - train_split.z19
https://zenodo.org/records/11171724

development set
dev_split.zip & dev_split.z01 - dev_split.z02
https://zenodo.org/records/11169872

test set (part 1 of 2)
Codec test: C1.zip - C6.cip & ALM test: A1.zip - A3.zip
https://zenodo.org/records/11169781

test set (part 2 of 2)
Codec unseen test: C7.zip
https://zenodo.org/records/11125029

Countermeasure

The source code of the countermeasure and pre-trained model are available on GitHub https://github.com/xieyuankun/Codecfake.

The Codecfake dataset and pre-trained model are licensed with CC BY-NC-ND 4.0 license.