MultiClinSum-2 Test Dataset: Multilingual Summarization of Clinical Case Reports

Task Overview

MultiClinSum-2 is a shared task focused on automatic summarization of clinical case reports across 15 languages. The task challenges participants to develop models capable of condensing lengthy clinical narratives into concise summaries while preserving essential diagnostic and clinically relevant information, and supporting healthcare professionals and researchers in efficiently extracting key clinical insights from biomedical literature.

The task is organized by the Barcelona Supercomputing Center's NLP for Biomedical Information Analysis group (NLP4BIA) and promoted by European projects DataTools4Heart and AI4HF.

The shared task data combines two complementary sources from the biomedical domain:

PMC-Patients Subset: Full case-summary pairs derived from the PMC-Patients subset of PubMed Central, where reference summaries were extracted from specific abstract sections. Originally in English, these cases have been translated into all task languages.

Native Case Reports: Case reports selected from PubMed with manually-written summaries by the authors. These cases are natively written in English, Spanish, French, and Portuguese, and were translated into all remaining task languages to ensure comprehensive multilingual coverage.

Task Website: https://temu.bsc.es/multiclinsum2/

Test Dataset

This repository contains the test dataset for MultiClinSum-2 (multiclinsum2_test_set.zip), comprising 1,000 full clinical case reports per language (15,000 total), derived from the same biomedical sources as the training data: the PMC-Patients subset of PubMed Central and manually curated case reports from PubMed. Each case requires participants to generate a concise summary preserving essential clinical details and information.

Languages included: English, Spanish, French, Portuguese, Italian, Russian, Catalan, Norwegian, Danish, Romanian, German, Greek, Dutch, Czech, and Swedish.

Participants must submit their generated summaries by May 8, 2026, 15:00 CET. Reference summaries will be released after the submission deadline. For submission guidelines, evaluation details, and task information, visit: https://temu.bsc.es/multiclinsum2/

Important: Reference summaries are NOT included in this release and will be made available after the submission deadline (May 8, 2026, 15:00 CET).

Related Datasets

Training dataset (https://zenodo.org/records/18887797)Includes ~26,000 full case-summary pairs for each of the 15 task languages.

Sample dataset (https://zenodo.org/records/18663291)Includes 50 full case-summary pairs for each of the 15 task languages.

Contact

For questions about the dataset or shared task, please contact:

Miguel Rodríguez-Ortega ([e-mail])

Eduard Rodríguez-López ([e-mail])

Salvador Lima-López ([e-mail])

Martin Krallinger ([e-mail])

License: This work is licensed under a CC BY-NC-SA 4.0 (Creative Commons Attribution 4.0 International) License.