voxlingua33 in WebDataset Format

This dataset is the voxlingua33 dataset, formatted in the WebDataset format. WebDataset files are essentially tar archives, where each example in the dataset is represented by a pair of files: a WAV audio file and a corresponding JSON metadata file. The JSON file contains the class label and other relevant information for that particular audio sample. $ tar tvf train_subset_2k_0000000.tar|head -r--r--r-- bigdata/bigdata 16 2025-01-14 12:47 aY52TYclAwM__U__S1---0600_720-0603_400.json -r--r--r-- bigdata/bigdata 85804 2025-01-14 12:47 aY52TYclAwM__U__S1---0600_720-0603_400.wav -r--r--r-- bigdata/bigdata 16 2025-01-14 12:47 djLw9m-efBw__U__S10---0011_620-0024_700.json -r--r--r-- bigdata/bigdata 418604 2025-01-14 12:47 djLw9m-efBw__U__S10---0011_620-0024_700.wav -r--r--r-- bigdata/bigdata 16 2025-01-14 12:47 7uydbHTC7aI__U__S0---0011_290-0025_880.json -r--r--r-- bigdata/bigdata 466924 2025-01-14 12:47 7uydbHTC7aI__U__S0---0011_290-0025_880.wav -r--r--r-- bigdata/bigdata 16 2025-01-14 12:47 T7JlObbeXnk__U__S142---1050_920-1064_590.json -r--r--r-- bigdata/bigdata 437484 2025-01-14 12:47 T7JlObbeXnk__U__S142---1050_920-1064_590.wav -r--r--r-- bigdata/bigdata 16 2025-01-14 12:47 OzEFTYKDD4E__U__S11---0090_640-0097_250.json -r--r--r-- bigdata/bigdata 211564 2025-01-14 12:47 OzEFTYKDD4E__U__S11---0090_640-0097_250.wav $ cat aY52TYclAwM__U__S1---0600_720-0603_400.json {"labels": "de"}