Human-In-The-Loop Workflow for Neuro-Symbolic Scholarly Knowledge Organization - Experiment material

We conducted an experiment to evaluate the practical usability of a Human-in-the-Loop (HITL) tool designed to assist in the creation of scientific content for knowledge graphs. The tool supports researchers during two key stages: the creation of a corpus of relevant literature, and the extraction and manual refinement of scientific content. To assess its effectiveness, we engaged participants familiar with the Open Research Knowledge Graph (ORKG). Each participant received detailed instructions prior to the experiment. The accompanying CSV file contains the raw data gathered throughout the study. This tool was developed as part of the Master’s thesis of Ahmed Malek Ghanmi at Leibniz University Hannover. The corresponding research paper is currently under review.