Rare Diseases hand-annotated news articles and research articles

This dataset was produced in 2023 from the data collected throughout 2022 from MEDLINE (scientific articles) and from Event Registry (news) for the development of the Rare Diseases Mining project (https://idefine-europe.org/medline)
The data is distributed across 16 diseases supporting the research paper "Automatic text classification and interactive data visualization of published scientific and news articles on Rare Diseases"
The available data comes in 2 kinds and file formats:CSV - the hand annotation of the news articles in TXT with 5 to 10 MeSH headingsJSON - the input file for the evaluation of the classifier, including the title, news article body and MeSH heading IDs (available from https://www.ncbi.nlm.nih.gov/mesh/)
The CSV files with name starting in "f1_", "pr_", "re_" are the results of the F1/Precision/Recall evaluation for each of the cases.
This work was prepared by Joao Pita Costa (researcher) and curated by Tanja Zdolšek Draksler (domain expert)