clarin-knext/cst_directed_datasets

---
license: cc
task_categories:
- text-classification
language:
- pl
- en
pretty_name: Cross-Document Structure Theory datasets
size_categories:
- 1K<n<10K
---

# Cross Document Structure Theory datasets

## Table of Contents

- [Dataset Description](#dataset-description)
- [Dataset Summary](#dataset-summary)
- [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
- [Languages](#languages)
- [Dataset Structure](#dataset-structure)
- [Data Instances](#data-instances)
- [Data Fields](#data-fields)
- [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
- [Curation Rationale](#curation-rationale)
- [Source Data](#source-data)
- [Annotations](#annotations)
- [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
- [Social Impact of Dataset](#social-impact-of-dataset)
- [Discussion of Biases](#discussion-of-biases)
- [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
- [Dataset Curators](#dataset-curators)
- [Licensing Information](#licensing-information)
- [Citation Information](#citation-information)
- [Contributions](#contributions)

## Dataset Description

- **Homepage:**
- **Repository:**
- **Paper:**
- **Point of Contact:** [e-mail]

### Dataset Summary

Collection of sentence pairs annotated for the Cross-Document Structure Theory (CST) task.
It consists of 4 distinct datasets:

- WUT
- PODCAST
- SNLI
- WNLI

### Supported Tasks and Leaderboards

[More Information Needed]

### Languages

Polish language, PL
English language, EN

## Dataset Structure

### Data Instances

Data are structured in JSONL format, each single text sample is divided by sentence.

```
{
"id": 0,
"sentence_1": "According to the television coverage of the royal wedding, the bride looked beautiful.",
"sentence_2": "The bride looked exceptionally beautiful.",
"cst": [
{
"supertype": "overlap",
"type": "attribution",
"knowledge": "text"
},
{
"supertype": "overlap",
"type": "elaboration",
"knowledge": "text"
}
]
}
```

### Data Fields

Description of json keys:

- `id`: identifier of the sentence pair
- `sentence_1`: first sentence
- `sentence_2`: second sentence
- `cst`: list of CST labels
- `supertype`: relation supertype
- `type`: specific relation type
- `knowledge`: premise knowledge source

### Data Splits

We do not specify an exact data split for training and evaluation.

## Dataset Creation

### Curation Rationale

[More Information Needed]

### Source Data

#### Initial Data Collection, Normalization and Post-processing

[More Information Needed]

### Annotations


#### Annotation process

[More Information Needed]

#### Who are the annotators?

- professional linguists (mention all people involved)

### Personal and Sensitive Information

The datasets do not contain any personal or sensitive information.

## Considerations for Using the Data

### Discussion of Biases

[More Information Needed]

### Other Known Limitations

[More Information Needed]

## Additional Information

### Dataset Curators

Arkadiusz Janz ([e-mail])

### Licensing Information

WUT [CC-BY 2.5](https://creativecommons.org/licenses/by/2.5/)
PODCAST [CC-BY-SA 4.0](https://creativecommons.org/licenses/by-sa/4.0/)
SNLI [CC-BY-SA 4.0](https://creativecommons.org/licenses/by-sa/4.0/)
WNLI [CC-BY-SA 4.0](https://creativecommons.org/licenses/by-sa/4.0/)

### Citation Information

[More Information Needed]