SweDN 1.0

I. IDENTIFYING INFORMATION

Title*
SWE-DN

Subtitle
A Swedish text summarization corpus

Created by*
Julius Monsen ([e-mail]), Arne Jönsson ([e-mail])

Publisher(s)*
Linköping University

Link(s) / permanent identifier(s)*
https://spraakbanken.gu.se/resurser/superlim

Abstract*
The SWE-DN corpus is based on 1,963,576 news articles from the Swedish newspaper Dagens Nyheter (DN) during the years 2000--2020. The articles are filtered to resemble the CNN/DailyMail dataset both regarding textual structure

Funded by*
SweClarin

Cite as
[1] A method for building non-English corpora for abstractive text summarization, Julius Monsen, Arne Jönsson, Proceedings of the CLARIN Annual Conference, 2021

Related datasets
Similar to CNN/DailyMail; part of SuperLim 2.0 collection

II. USAGE

Key applications
Training text summarizers, both extractive and abstractive.

Intended task(s)/usage(s)
Given a text (article), provide its summary.

Recommended evaluation measures
Harmonic mean of Bleu and Rouge; Rouge, BERTScore, Coh-Metrix

Dataset function(s)
Model development

Recommended split(s)
"The articles in the dataset fall into five categories: domestic news, economy, sports, culture, other. The training set consists of the first three categories (78% of the dataset), the test set contains the fourth category (12%), the test set the fifth category (10%). The purpose is to have a cross-domain split which helps evaluate the model's ability to generalize to new data. The "other" category was chosen for the test set as the most diverse one (and presumably the most difficult)."

III. DATA

Primary data*
Text

Language*
Swedish

Dataset in numbers*
38,121 news articles with corresponding preambles

Nature of the content*
News texts

Format*
JSONL and TSV files with id, headline, summary, article and article category. An additional file with various statistics for each entry (including length measures, embedding similarity and article category) can be accessed at Språkbanken's website. The entries can be matched using the ids.

Data source(s)*
Dagens Nyheter news texts from 2000--2020

Data collection method(s)*
Received 1,936,576 news articles from Dagens Nyheter

Data selection and filtering*
Filtered to resemble the CNN/DailyMail dataset, see [1]

Data preprocessing*
See [1]

Data labeling*
None

Annotator characteristics

IV. ETHICS AND CAVEATS

Ethical considerations

Things to watch out for

V. ABOUT DOCUMENTATION

Data last updated*
20221217, Julius Monsen

Which changes have been made, compared to the previous version*
First data release

Access to previous versions

This document created*
20221206, Arne Jönsson

This document last updated*
20230203, Aleksandrs Berdicevskis

Where to look for further details

Documentation template version*
v1.1

VI. OTHER

Related projects

References
[1] A method for building non-English corpora for abstractive text summarization, Julius Monsen, Arne Jönsson, Proceedings of the CLARIN Annual Conference, 2021