DDSC/partial-danish-gigaword-small-test-sample

---
dataset_info:
features:
- name: text
dtype: string
- name: source
dtype: string
- name: doc_id
dtype: string
- name: LICENSE
dtype: string
- name: uri
dtype: string
- name: date_built
dtype: string
splits:
- name: train
num_bytes: 23816547.04337273
num_examples: 2411
download_size: 11686492
dataset_size: 23816547.04337273
language:
- da
pretty_name: Danish Gigaword Test Sample
---
# Dataset Card for "Danish Gigaword Test Sample"

This is a small sample of the dataset `DDSC/partial-danish-gigaword-no-twitter`. It is meant as a small dataset for testing code. It is constructed using the following code:

```python
from datasets import concatenate_datasets, load_dataset

# download dataset from huggingface
dataset = load_dataset("DDSC/partial-danish-gigaword-no-twitter")

# All of the dataset is available in the train split - we can simply:
dataset = dataset["train"]

# downsample it to three domains
legal = dataset.filter(lambda x: x["source"] == "retsinformationdk")
news = dataset.filter(lambda x: x["source"] == "tv2r")
speech = dataset.filter(lambda x: x["source"] == "spont")

# downsample to 1000 samples
legal = legal.select(range(1000))
news = news.select(range(1000))

# combine the three domains
dataset = concatenate_datasets([legal, news, speech])

# upload to hub
dataset.push_to_hub("DDSC/partial-danish-gigaword-small-test-sample")
```