RadGraph2: Tracking Findings Over Time in Radiology Reports

RadGraph2 is a dataset of 800 chest radiology reports annotated using a fine-
grained entity-relationship schema, which is an expanded version of the
previously introduced RadGraph dataset. In contrast with the previous
approaches and the original RadGraph, the new version of the used information
extraction schema is designed to capture not only the key findings and their
context but also the mentions of changes that occurred between the prior
radiology examinations and the more recent study. These changes may include
the appearance of new conditions affecting the patient, their progression, or
the differences in the setup of the observed supporting devices. The
information extracted from each report is represented in the form of a
knowledge graph composed of clinically relevant entities and relations, which
makes it easily amenable to automated processing. In addition to the dataset
of manually labeled reports, we release more than 220,000 reports
automatically annotated by our benchmark model. This model achieved an F1
micro performance of 0.88 and 0.74 on two differently sourced withheld test
sets (from MIMIC-CXR-JPG and CheXpert, respectively). We believe that
RadGraph2 could facilitate the development of clinically useful systems for
the automated processing of radiology reports, particularly those reasoning
about the evolution of a patient's state over time.