Dataset for Named Entity Recognition and Entity Linking from Greek Wikipedia Events

An automated benchmark dataset for (Named Entity Recognition) NER and (Named Entity Linking) NEL tools, based on Greek Wikipedia events pages. Note: This data includes data from the following sources:<br> - Wikipedia el.wikipedia.org <strong>Description</strong> The dataset is provided in the form of three JSON-formatted subsets i.e., train, validation and test in an analogy of 70-20-10. The current version of the dataset contains 18,617 events annotated with 40,798 entity mentions and 36,189 links to elWikipedia (and wikidata ids). The dataset contains annotations belonging to 8 entity types: person, organization, location, gpe, event, facility, product and work of art. Overall dataset statistics Docs Tokens Sentences Surface Mentions Valid Links Red Links <strong>Train</strong> 13,031 332,077 16,927 28,593 25,365 3,228 <strong>Validation</strong> 3,722 94,746 4,844 8,168 7,240 928 <strong>Test</strong> 1,862 47,450 2,427 4,037 3,584 453 <strong>Total</strong> 18,617 474,361 24,200 40,798 36,189 4,609 <strong>Example</strong> A record example is given below. { "json_file": "February 2012_39_0 events",<br> "text": "Sudan and South Sudan sign non-aggression pact.",<br> "ground_truth_mentions": [<br> {"start": 0, "end": 4, "surface_mention": "Sudan", "mention_type": "GPE"},<br> {"start": 10, "end": 20, "surface_mention": "South Sudan", "mention_type": "GPE"}<br> ],<br> "ground_truth_links": [<br> {"enwiki": "Sudan","wikidata": "Q1049"},<br> {"enwiki": "South_Sudan", "wikidata": "Q958"}<br> ]<br> } <strong>Code</strong> https://gitlab.isl.ics.forth.gr/debatelab/elwiki_events_benchmark <strong>Acknowledgments</strong> This work has received funding from the Hellenic Foundation for Research and Innovation (HFRI) and the General Secretariat for Research and Technology (GSRT), under grant agreement No 4195.