AlleNoise - large-scale text classification benchmark dataset with real-world label noise

AlleNoise is a benchmark dataset for large-scale multi-class text classification with real-world label noise. It consists of e-commerce product titles from Allegro.com with corresponding category labels. The noise distribution comes from actual users of a major e-commerce marketplace, so it realistically reflects the semantics of human mistakes. In addition to the noisy labels, we provide human-verified clean labels and a meaningful, hierarchical taxonomy of categories. Code and data is available at https://github.com/allegro/AlleNoise.