RiCoRecA: Rich Cooking Recipe Annotation Schema (Dataset)

Despite recent advancements, modern kitchens, at best, have one or more isolated (non-communicating) “smart” devices. The vision of having a fully-fledged ambient kitchen where devices know what to do and when has yet to be realised. RiCoRecA, a novel schema for parsing cooking recipes into a workflow representation suitable for automation, is a step towards that direction. The schema requires a number of information extraction tasks, i.e., theannotation of named entities, the identification of relations between them, coreference resolution as well as entity tracking. RiCoRecA differs from previously reported approaches in that it learns these different information extraction tasks using one joint model. We also provide a dataset containing annotations that follow this schema. Furthermore, we compared two transformer-based models for parsing recipes into workflows, namely, PEGASUS-X and LongT5. Our results demonstrate that PEGASUS-X surpassed LongT5 on all of the annotation tasks. Specifically, PEGASUS-X surpassed LongT5 by 39% in terms of F-Score when averaging the performance on all the tasks; it demonstrated almost human-like performance.