Norod78/HebrewStageAndLyricsWithNewLines

---
dataset_info:
features:
- name: text
dtype: string
splits:
- name: test
num_bytes: 12638465.341690589
num_examples: 11113
- name: train
num_bytes: 240110370.6583094
num_examples: 211129
download_size: 133520933
dataset_size: 252748836.0
language:
- he
multilinguality:
- monolingual
task_categories:
- text-generation
- fill-mask
task_ids:
- language-modeling
- masked-language-modeling
---
# Dataset Card for "HebrewStageAndLyricsWithNewLines"

* Contains poems and stories from "New Stage" ("במה חדשה")
* Contains text lines from various Hebrew song lyrics
* Data contains new-line characters
* Generated from a text file in which different poems were seperated using a double new-line character
* The script I made for converting the text file into a dataset is [available here](https://huggingface.co/datasets/Norod78/HebrewStageAndLyricsWithNewLines/blob/main/load_ds.py)

原始信息汇总

数据集概述

基本信息

• 名称: HebrewStageAndLyricsWithNewLines
• 语言: 希伯来语（he）
• 多语言性: 单语种

数据特征

• 特征:
  • text: 字符串类型

数据分割

• 训练集:
  • 样本数: 211,129
  • 数据大小: 240,110,370.6583094 字节
• 测试集:
  • 样本数: 11,113
  • 数据大小: 12,638,465.341690589 字节

数据大小

• 下载大小: 133,520,933 字节
• 数据集总大小: 252,748,836.0 字节

任务与应用

• 任务类别:
  • 文本生成
  • 填空（fill-mask）
• 任务ID:
  • 语言建模
  • 掩码语言建模

数据内容

• 包含来自“New Stage”（במה חדשה）的诗歌和故事
• 包含各种希伯来歌词的文本行
• 数据包含换行符
• 不同诗歌通过双换行符分隔