AI-derived annotations for the NLST and NSCLC-Radiomics computed tomography imaging collections

Public imaging datasets are critical for the development and evaluation of automated tools in cancer imaging. Unfortunately, many of the available datasets do not provide annotations of tumors or organs-at-risk, crucial for the assessment of these tools. This is due to the fact that annotation of medical images is time consuming and requires domain expertise. It has been demonstrated that artificial intelligence (AI) based annotation tools can achieve acceptable performance and thus can be used to automate the annotation of large datasets. As part of the effort to enrich the public data available within NCI Imaging Data Commons (IDC) (https://imaging.datacommons.cancer.gov/) [1], we introduce this dataset that consists of such AI-generated annotations for two publicly available medical imaging collections of Computed Tomography (CT) images of the chest. We use publicly available pre-trained AI tools to enhance CT lung cancer collections that are unlabeled or partially labeled. The first tool is the nnU-Net deep learning framework [2] for volumetric segmentation of organs, where we use a pretrained model (Task D18 using the SegTHOR dataset) for labeling volumetric regions in the image corresponding to the heart, trachea, aorta and esophagus. These are the major organs-at-risk for radiation therapy for lung cancer. We further enhance these annotations by computing 3D shape radiomics features using the pyradiomics package [3]. The second tool is a pretrained model for per-slice automatic labeling of anatomic landmarks and imaged body part regions in axial CT volumes [4]. We focus on enhancing two publicly available collections, the Non-small Cell Lung Cancer Radiomics (NSCLC-Radiomics collection) [5,6], and the National Lung Screening Trial (NLST collection) [7,8]. The CT data for these collections are available both in The Cancer Imaging Archive (TCIA) [9] and in NCI Imaging Data Commons (IDC). Further, the NSLSC-Radiomics collection includes expert-generated manual annotations of several chest organs, allowing us to quantify performance of the AI tools in that subset of data. IDC is relying on the DICOM standard to achieve FAIR [10] sharing of data and interoperability. Generated annotations are saved as DICOM Segmentation objects (volumetric segmentations of regions of interest) created using the <em>dcmqi</em> [11], and DICOM Structured Report (SR) objects (per-slice annotations of the body part imaged, anatomical landmarks and radiomics features) created using <em>dcmqi </em>and <em>highdicom</em> [12]. 3D shape radiomics features and corresponding DICOM SR objects are also provided for the manual segmentations available in the NSCLC-Radiomics collection. The dataset shared will be available in IDC, and will be accompanied by a manuscript describing the details of how it was generated, and how the resulting DICOM objects can be interpreted and used in tools. Description of this dataset will be updated accordingly in the future. The annotations are organized as follows. For NSCLC-Radiomics, three nnU-Net models were evaluated ('2d-tta', '3d_lowres-tta' and '3d_fullres-tta'). Within each folder, the PatientID and the StudyInstanceUID are subdirectories, and within this the DICOM Segmentation object and the DICOM SR for the 3D shape features are stored. A separate directory for the DICOM SR body part regression regions ('sr_regions') and landmarks ('sr_landmarks') are also provided with the same folder structure as above. Lastly, the DICOM SR for the existing manual annotations are provided in the 'sr_gt' directory. For NSCLC-Radiomics, each patient has a single StudyInstanceUID. The DICOM Segmentation and SR objects are named according to the SeriesInstanceUID of the original CT files. nsclc 2d-tta PatientID StudyInstanceUID ReferencedSeriesInstanceUID_SEG.dcm ReferencedSeriesInstanceUID_features_SR.dcm 3d_lowres-tta PatientID StudyInstanceUID ReferencedSeriesInstanceUID_SEG.dcm ReferencedSeriesInstanceUID_features_SR.dcm 3d_fullres-tta PatientID StudyInstanceUID ReferencedSeriesInstanceUID_SEG.dcm ReferencedSeriesInstanceUID_features_SR.dcm sr_regions PatientID StudyInstanceUID ReferencedSeriesInstanceUID_regions_SR.dcm sr_landmarks PatientID StudyInstanceUID ReferencedSeriesInstanceUID_landmarks_SR.dcm sr_gt PatientID StudyInstanceUID ReferencedSeriesInstanceUID_features_SR.dcm For NLST, the '3d_fullres-tta' model was evaluated. The data is organized the same as above, where within each folder the PatientID and the StudyInstanceUID are subdirectories. For the NLST collection, it is possible that some patients have more than one StudyInstanceUID subdirectory. A separate directory for the DICOM SR body par regions ('sr_regions') and landmarks ('sr_landmarks') are also provided. The DICOM Segmentation and SR objects are named according to the SeriesInstanceUID of the original CT files. nlst 3d_fullres-tta PatientID StudyInstanceUID ReferencedSeriesInstanceUID_SEG.dcm ReferencedSeriesInstanceUID_features_SR.dcm sr_regions PatientID StudyInstanceUID ReferencedSeriesInstanceUID_regions_SR.dcm sr_landmarks PatientID StudyInstanceUID ReferencedSeriesInstanceUID_landmarks_SR.dcm