CoMMons

Recognizing textures and materials in real-world images has played an important role in object recognition and scene understanding. Aiming at describing objects or scenes with more detailed information, we explore how to computationally characterize apparent or latent properties (e.g. surface smoothness) of materials, i.e., computational material characterization, which moves a step further beyond material recognition. For this purpose, we introduce a large, publicly available dataset named challenging microscopic material surface dataset (CoMMonS). We utilize a powerful microscope to capture high-resolution images with fine details of fabric surfaces. The CoMMonS dataset consists of 6,912 images covering 24 fabric samples in a controlled environment under varying imaging conditions such as lighting, zoom levels, geometric variations, and touching directions. This dataset can be used to assess the performance of existing deep learning-based algorithms and to develop our own method for material characterization in terms of fabric properties such as fiber length, surface smoothness, and toweling effect.

The "CoMMonS_FullResolution" folder includes 6912 full resolution images (2560x1920). The "CoMMonS_Sampled" folder includes sampled images (resolution: 300x300), which are sampled from full resolution images with different positions (x, y), rotation angles (r), zoom levels (z), a touching direction ("pile"), a lightness condition ("l5"), and a camera function setting ("ed3u"). This "CoMMonS_Sampled" folder is an example of a dataset subset for training and testing (e.g. 5: 1). Our dataset focuses on material characterization for one material (fabric) in terms of one of three properties (fiber length, smoothness, and toweling effect), facilitating a fine-grained texture classification. In this particular case, the dataset is used for a standard supervised problem of material quality evaluation. It takes fabric samples with human expert ratings as training inputs, and takes fabric samples without human subject ratings as testing inputs to predict quality ratings of the testing samples. The texture patches are classified into 4 classes according to each surface property measured by human sense of touch. For example, the human expert rates surface fiber length into 4 levels, from 1 (very short) to 4 (long), and similarly for smoothness and toweling effect. In short, the "CoMMonS_Sampled" folder includes 9 subfolders, each of which inclues both sampled images and attribute class labels.

Please note that for images captured under different imaging conditions/settings, their physical image sizes vary. Here I can give two examples so that you can have some ideas about the image size. An image with full resolution (2560 x 1920 pixels) and zooming level 200, the physical image size is around 1.9mm x 1.4mm; For an image with full resolution (2560 x 1920 pixels) with zooming level 50, the physical image size is around 6.6mm x 4.9mm. Therefore, with these information, you can have some rough ideas about the physical sizes for image pixels.