Metal Surface Defect Dataset

Automated Optical Inspection (AOI) technology plays a significant role in industrial defect detection.However, traditional static optical systems are affected by shadows and surface reflectivity, resulting in a high sensitivity to the direction of the illuminant, false positives, and missed detections, especially for metal parts with complex geometries. Moreover, there is still a lack of large-scale datasets for surface defect detection in such scenarios. To address these issues, an automatic metal surface defect detection technique was proposed based on deep learning and photometric stereo vision, and a Metal Surface Defect Dataset (MSDD) was constructed. Firstly, a Stroboscopic Illuminant Image Acquisition (SIIA) method is proposed, which incorporates a specially designed arrangement of illuminants and a channel mixer to blend the collected multi-channel images into RGB pseudo-color images. Secondly, the MSDD is constructed using this technology. We achieve end-to-end surface defect detection using universal object detectors by mapping color space transformations to spatial domain transformations and employing hue randomization for data augmentation. Finally, four universal object detection methods, including FCOS, YOLOv5, YOLOv8, and RT-DETR are validated on this dataset. The results indicate that these models achieve an average precision of 85.4% on the dataset, significantly outperforming traditional methods.The MSDD consists of a total of 138,585 single-channel images and 9,239 mixed images, including 5746 defect-free images and 3493 images containing a total of eight types of defects. The defect patterns included are generally applicable for the automated visual inspection of casting-formed metal blank surface defects, highlighting its high research value.

自动光学检测（Automated Optical Inspection, AOI）技术在工业缺陷检测中发挥着重要作用。然而，传统静态光学系统易受阴影与表面反光性的影响，对照明光源方向敏感度高，易产生假阳性与漏检情况，针对几何形状复杂的金属部件尤为如此。此外，此类场景下的表面缺陷检测仍缺乏大规模数据集。为解决上述问题，本文提出了一种基于深度学习与光度立体视觉的自动金属表面缺陷检测技术，并构建了金属表面缺陷数据集（Metal Surface Defect Dataset, MSDD）。首先，本文提出了频闪光源图像采集（Stroboscopic Illuminant Image Acquisition, SIIA）方法，该方法采用特殊设计的光源排布方案，并通过通道混合器将采集到的多通道图像融合为RGB伪彩色图像。其次，利用该技术构建了MSDD数据集。通过将色彩空间变换映射为空间域变换，并采用色调随机化进行数据增强，本文利用通用目标检测器实现了端到端的表面缺陷检测。最后，在该数据集上验证了包括FCOS、YOLOv5、YOLOv8以及RT-DETR在内的四种通用目标检测方法。实验结果表明，这些模型在该数据集上的平均精度可达85.4%，显著优于传统检测方法。MSDD共计包含138585张单通道图像与9239张混合图像，其中包括5746张无缺陷图像，以及3493张共包含8类缺陷的图像。所涵盖的缺陷类型普遍适用于铸造金属毛坯表面缺陷的自动视觉检测，凸显了该数据集的较高研究价值。

搜集汇总

背景与挑战

背景概述

Metal Surface Defect Dataset是一个专门用于金属表面缺陷检测的大规模数据集，包含13.8万单通道图像和9239张混合图像，涵盖8种缺陷类型。该数据集采用创新的光源采集技术和色彩空间转换方法，已通过多种目标检测模型验证，平均准确率达85.4%，在铸造金属坯料表面缺陷检测领域具有重要研究价值。