NeSy4VRD: A Multifaceted Resource for Neurosymbolic AI Research using Knowledge Graphs in Visual Relationship Detection

The NeSy4VRD dataset consists of an image dataset and matching visual relationship annotations. The images of the dataset are same as those that were once publicly available as part of the VRD dataset. The visual relationship annotations are a highly customised and quality-improved version of the original visual relationship annotations of the VRD dataset. The NeSy4VRD dataset is designed for computer vision-based research that involves detecting objects in images and predicting the relationships between ordered pairs of those objects that have been annotated for the images. The images and matching annotations are split into training and test sets as per the original VRD dataset. The NeSy4VRD dataset is one component of larger, multifaceted resource designed to foster neurosymbolic AI (NeSy) research, particularly NeSy research using the Semantic Web technologies of OWL, OWL ontologies and OWL-based knowledge graphs. One of the key components of NeSy4VRD is a well-aligned OWL ontology that has been custom designed to be a companion of the NeSy4VRD dataset. This OWL ontology is called VRD-World. Information about NeSy4VRD, including the VRD-World OWL ontology, is available at: https://github.com/djherron/nesy4vrd