anggawarjaya18/simple-wiki

---
language:
- en
multilinguality:
- monolingual
size_categories:
- 100K<n<1M
task_categories:
- feature-extraction
- sentence-similarity
pretty_name: Simple Wiki
tags:
- sentence-transformers
dataset_info:
config_name: pair
features:
- name: text
dtype: string
- name: simplified
dtype: string
splits:
- name: train
num_bytes: 28560372
num_examples: 102225
download_size: 18402665
dataset_size: 28560372
configs:
- config_name: pair
data_files:
- split: train
path: pair/train-*
---

# Dataset Card for Simple Wiki

This dataset is a collection of pairs of English Wikipedia entries and their simplified variants. See [Simple-Wiki](https://cs.pomona.edu/~dkauchak/simplification/) for additional information.
This dataset can be used directly with Sentence Transformers to train embedding models.

## Dataset Subsets

### `pair` subset

* Columns: "text", "simplified"
* Column types: `str`, `str`
* Examples:
```python
{
'text': "Charles Michael `` Chuck '' Palahniuk ( ; born February 21 , 1962 ) is an American transgressional fiction novelist and freelance journalist .",
"simplified": 'Chuck Palahniuk ( born February 21 , 1962 ) is an American satire author .',
}
```
* Collection strategy: Reading the SimpleWiki dataset from [embedding-training-data](https://huggingface.co/datasets/sentence-transformers/embedding-training-data).
* Deduplified: No