Romanian micro-blogging named entity recognition (MicroBloggingNERo)

MicroBloggingNERo is a manually annotated corpus for named entity recognition in Romanian micro-blogging texts. <br> It provides gold annotations for organizations, locations, persons, time expressions, legal references, medical devices,<br> chemicals, anatomical parts and disorders found in micro-blogging texts. The text was anonymized, by replacing all<br> URLs with &lt;url&gt;, user references with &lt;user&gt;, person names, specific locations and organizations with new randomized names. <br> Anonymization was realized in the same way, regardless of the micro-blogging platform specific format. Since names were replaced with new random ones, any resemblance to real individuals is by pure chance of the random names<br> generator. No real person is depicted in the included messages. <br> DATA The MicroBloggingNERo corpus is available in different formats: text, span-based, and token-based. Text files are in the folder "text" with .txt extension, in UTF-8 encoding. Span-based annotations are given in BRAT (https://brat.nlplab.org/) ann format. These annotations can be found in folders starting with "ann_". Token-based annotations are given in CONLLUP files, following the CoNLL-U Plus format https://universaldependencies.org/ext-format.html .<br> Part-of-speech tagging was realized using UDPIPE. <br> Named entity annotations are placed in the column "RELATE:NE" (the 11th column) as defined in the "global.columns" metadata field.<br> Automatic processing was performed through the RELATE platform (https://relate.racai.ro). The archive contains: - ann_EVERYTHING <br> Folder in which all the files are in .ann format and contains annotations of: legal references, persons, locations, organizations, time, chemicals, medical devices, anatomical parts and disorders. <br> Overlapping annotations of organizations and time entities inside legal references were allowed. - ann_EVERYTHING_LARGEST_SPAN <br> Folder in which all the files are in .ann format and contains annotations of: legal references, persons, locations, organizations, time, chemicals, medical devices, anatomical parts and disorders. <br> Overlapping annotations were not allowed and only the longest named entities were annotated. This affects primarily the legal references class. - ann_LEGAL_PER_LOC_ORG_TIME <br> Folder in which all the files are in .ann format and contains annotations of: legal references, persons, locations, organizations and time. <br> There are no overlapping annotations. - ann_PER_LOC_ORG_TIME <br> Folder in which all the files are in .ann format and contains annotations of: persons, locations, organizations and time. <br> There are no overlapping annotations. - ann_BIOMEDICAL<br> Folder in which all the files are in .ann format and contains annotations of: medical devices, chemicals, anatomical parts and disorders. <br> There are no overlapping annotations. - conllup_EVERYTHING_LARGEST_SPAN<br> Folder in which all the files are in .ann format and contains annotations of: legal references, persons, locations, organizations, time, chemicals, medical devices, anatomical parts and disorders. <br> There are no overlapping annotations. - conllup_LEGAL_PER_LOC_ORG_TIME <br> Folder in which all the files are in .conllup format and contains annotations of: legal references, persons, locations, organizations and time. <br> Overlapping annotations were not allowed and only the longest named entities were annotated. - conllup_PER_LOC_ORG_TIME <br> Folder in which all the files are in .conllup format and contains annotations of: persons, locations, organizations and time. <br> Overlapping annotations were not allowed and only the longest named entities were annotated. - conllup_BIOMEDICAL<br> Folder in which all the files are in .conllup format and contains annotations of: medical devices, chemicals, anatomical parts and disorders. <br> Overlapping annotations were not allowed and only the longest named entities were annotated. - text <br> Folder containing the raw texts. - splits.tsv<br> Proposed splits into train,test,valid following a distribution of 70-15-15% for each entity class, based on the ann_EVERYTHING_LARGEST_SPAN folder LICENSING This work is provided under the license CC BY-NC-ND 4.0 (Attribution-NonCommercial-NoDerivatives 4.0 International).<br> The license can be viewed online here: https://creativecommons.org/licenses/by-nc-nd/4.0/ <br> and the full text here: https://creativecommons.org/licenses/by-nc-nd/4.0/legalcode . <br> CONTACT Research Institute for Artificial Intelligence "Mihai Draganescu", Romanian Academy<br> Web: http://www.racai.ro <br> Contact emails: [e-mail] , [e-mail] , [e-mail] , [e-mail]