SpectralWaste Dataset: Multimodal Data for Waste Sorting Automation

This dataset contains multimodal images captured in a real waste processing facility specialized in plastics, cartons, and cans. The data was collected with a true-to-life prototype of the conveyor belt installed on the waste separation line, closely mimicking the actual installation. The setup has two synchronized cameras: a line-scan RGB camera (Teledyne DALSA Linea) and line-scan hyperspectral sensor (Specim FX17) that captures 224 contiguous spectral bands in a range from 900 to 1700 nm. The images are annotated for semantic segmentation with categories based on the requirements of the facility. Each one represents elements that commonly cause operational problems in recycling lines and impact the efficiency of the sorting process. Among these problems, machinery jams pose significant issues because they can cause complete stoppages in the process until the obstructing object is removed. The categories include: film and basket, large objects that can clog the conveyor belts as they are not easily breakable; video tape and filament, representing long objects prone to entangling with mechanical parts and requiring manual intervention; trash bag, which encompasses closed bags containing waste that need to be mechanically opened for further processing; and cardboard, paper objects whose recovery adds value by sending them to another recycling process. Our project page can be found at https://sites.google.com/unizar.es/spectralwaste.本数据集包含在专注于塑料、纸箱与金属罐的真实垃圾处理设施中采集的多模态图像。数据采集采用安装于垃圾分选线上的高仿真传送带原型设备，其配置与真实生产线高度贴合。该采集装置搭载两台同步相机：线扫描RGB相机（Teledyne DALSA Linea）与线扫描高光谱传感器（Specim FX17），后者可捕获900至1700 nm范围内的224个连续光谱波段。所有图像均按照该设施的需求完成语义分割标注，标注类别对应再生资源回收线中常见的影响分选效率的运行故障诱因。其中，设备卡滞会引发严重故障，可导致整条生产线完全停机，直至阻塞物被清除。本次标注的类别如下：1. 薄膜与筐篮：因不易破碎而易堵塞传送带的大型杂物；2. 胶带与细丝：易缠绕机械部件、需人工干预清理的长条形杂物；3. 垃圾袋：指装有垃圾的密闭袋，需通过机械方式开封后方可进行后续处理；4. 纸板与纸质物料：可通过送至其他回收流程实现资源化增值的纸质物料。本项目的公开页面可访问：https://sites.google.com/unizar.es/spectralwaste。