Norod78/HebrewStageAndLyricsWithNewLines

--- dataset_info: features: - name: text dtype: string splits: - name: test num_bytes: 12638465.341690589 num_examples: 11113 - name: train num_bytes: 240110370.6583094 num_examples: 211129 download_size: 133520933 dataset_size: 252748836.0 language: - he multilinguality: - monolingual task_categories: - text-generation - fill-mask task_ids: - language-modeling - masked-language-modeling --- # Dataset Card for "HebrewStageAndLyricsWithNewLines" * Contains poems and stories from "New Stage" ("במה חדשה") * Contains text lines from various Hebrew song lyrics * Data contains new-line characters * Generated from a text file in which different poems were seperated using a double new-line character * The script I made for converting the text file into a dataset is [available here](https://huggingface.co/datasets/Norod78/HebrewStageAndLyricsWithNewLines/blob/main/load_ds.py)

原始信息汇总

数据集概述

基本信息

• 名称: HebrewStageAndLyricsWithNewLines
• 语言: 希伯来语（he）
• 多语言性: 单语种

数据特征

• 特征:
  • text: 字符串类型

数据分割

• 训练集:
  • 样本数: 211,129
  • 数据大小: 240,110,370.6583094 字节
• 测试集:
  • 样本数: 11,113
  • 数据大小: 12,638,465.341690589 字节

数据大小

• 下载大小: 133,520,933 字节
• 数据集总大小: 252,748,836.0 字节

任务与应用

• 任务类别:
  • 文本生成
  • 填空（fill-mask）
• 任务ID:
  • 语言建模
  • 掩码语言建模

数据内容

• 包含来自“New Stage”（במה חדשה）的诗歌和故事
• 包含各种希伯来歌词的文本行
• 数据包含换行符
• 不同诗歌通过双换行符分隔