Minuri/nsina-sentences-raw

--- language: - si license: cc-by-sa-4.0 task_categories: - text-generation pretty_name: Sinhala Raw Sentences - NSINA size_categories: - 1M<n<10M tags: - sinhala - low-resource - pretraining - news - raw --- # Sinhala Raw Sentences - NSINA Raw Sinhala sentences extracted and sentence-split from the `sinhala-nlp/NSINA` news corpus using the SinLing sentence tokenizer. This is an intermediate dataset used in the construction of `Minuri/diverse_sinhala_dataset`. ## Dataset Structure | Column | Description | |---|---| | `text` | Raw Sinhala sentence | | `char_count` | Character count of the sentence | | `word_count` | Word count of the sentence | | Split | Rows | |---|---| | train | 5,415,583 | ## Pipeline Position `sinhala-nlp/NSINA` → **this repo** → `Minuri/nsina_cleaned_version` → `Minuri/diverse_sinhala_dataset` ## Sources & Licenses | Source | License | |---|---| | [sinhala-nlp/NSINA](https://huggingface.co/datasets/sinhala-nlp/NSINA) | CC BY-SA 4.0 - ShareAlike applies | ## Related Repositories | Repo | Description | |---|---| | `Minuri/nsina_cleaned_version` | Cleaned version (3,546,626 sentences) | | `Minuri/diverse_sinhala_dataset` | Final parent corpus |language: - 僧伽罗语（si） license: CC BY-SA 4.0 task_categories: - 文本生成 pretty_name: 僧伽罗语原始语句 - NSINA size_categories: - 1M<n<10M tags: - 僧伽罗语 - 低资源 - 预训练 - 新闻 - 原始数据 # 僧伽罗语原始语句 - NSINA 本数据集通过SinLing语句分词器（SinLing Sentence Tokenizer）从`sinhala-nlp/NSINA`新闻语料库中提取并分句得到的原始僧伽罗语语句。本数据集是构建`Minuri/diverse_sinhala_dataset`过程中使用的中间数据集。 ## 数据集结构 | 列名 | 描述 | |---|---| | `text` | 原始僧伽罗语语句 | | `char_count` | 语句的字符数 | | `word_count` | 语句的词数 | | 拆分集 | 数据条数 | |---|---| | 训练集 | 5,415,583 | ## 流水线位置 `sinhala-nlp/NSINA` → **本仓库** → `Minuri/nsina_cleaned_version` → `Minuri/diverse_sinhala_dataset` ## 来源与许可 | 来源 | 许可 | |---|---| | [sinhala-nlp/NSINA](https://huggingface.co/datasets/sinhala-nlp/NSINA) | CC BY-SA 4.0 - 共享相同方式（ShareAlike）适用 | ## 相关仓库 | 仓库 | 描述 | |---|---| | `Minuri/nsina_cleaned_version` | 清理后的版本（含3,546,626条语句） | | `Minuri/diverse_sinhala_dataset` | 最终的父级语料库