SynhalaAI/sinhala-song-lyrics

--- language: - si license: mit size_categories: - 1K<n<10K task_categories: - text-generation - mask-generation dataset_info: features: - name: title dtype: string - name: lyrics dtype: string - name: artist dtype: string - name: source dtype: string --- # 🎵 SynhalaAI — Ultimate Sinhala Song Lyrics Dataset (Gold Mix)  ## Dataset Description The **SynhalaAI Lyrics Corpus** is a meticulously engineered, high-fidelity dataset of Sinhala song lyrics. It was designed specifically to train Large Language Models (LLMs) and advanced tokenizers on the poetic, colloquial, and structured linguistic patterns of the Sinhala language. Unlike standard web-scraped datasets that are littered with English guitar chords, metadata, and HTML noise, this dataset has undergone a **"Sinhala-First" Surgical Scrub**. It is pristine, purely Sinhala, and spans decades of Sri Lankan music history. ### 🌟 Key Features * **AI-Grade Cleanliness:** All English characters, guitar chords (e.g., `[Am]`, `G`, `Dm`), beat markers (e.g., `Beat: 4/4`), invisible Unicode ghost characters, and web links have been surgically removed. * **Strict Deduplication:** Songs are aggressively deduplicated using a 150-character lyric fingerprinting algorithm combined with title cross-referencing. * **Generational Span:** Contains everything from classic 1960s hits to fresh 2024-2026 releases. ## 🏗️ The 3-Pronged Data Strategy This Master Dataset is a conglomerate of the best Sinhala archives available, gathered through a three-phase data engineering pipeline: 1. **The Mega Conglomerate (History Archive):** Aggregated data from 8+ of the largest open-source Sinhala search engine projects on GitHub, bringing in the bulk of classic and popular songs. * *Sources:* Repositories by DilanSachi, BhanukaD610, Rashmini, Tharindu KW, rpjayasekara, Nirmal Gamage, and Thilina TLM. 2. **Linguistic & Metaphor Integration:** Integrated high-quality, human-curated data from Kaggle (`pasinduudawatta/sinhala-songs-and-metaphors`). 3. **DIY Fresh Mixer (2024-2026):** A custom, polite web scraper targeted at the "Gold Standard" (`Sinhalasongbook.com`) to extract the absolute latest releases omitted from older static archives. ## 📊 Dataset Structure The dataset is provided as a unified JSON array (`sinhala_lyrics_MASTER.json`) and a flat text corpus (`sinhala_lyrics_corpus_MASTER.txt`) optimized for tokenizer training (BPE/SentencePiece). ### Data Fields * `title` *(string)*: The title of the song (usually in Sinhala or Singlish). * `lyrics` *(string)*: The deeply cleaned, Sinhala-only text of the song lyrics. * `artist` *(string)*: The artist or singer of the song. * `source` *(string)*: The original source of the data (e.g., `github_archive`, `kaggle_metaphors`, `fresh_scraper`). ### Sample Entry ```json { "title": "Bambareku Anduwa", "lyrics": "බඹරෙකු ඇඬුවා මලක් ළඟදි බඹරෙකු ඇඬුවා\nඇඬුවා... මලක් ළඟදි බඹරෙකු ඇඬුවා \nඇහේ කඳුලු ඇති ඒ බඹරිඳු දැක\nඅඬන්නෙ ඇයිදෝ මල ඇසුවා... මල ඇසුවා...", "artist": "Niranjala Sarojini", "source": "fresh_scraper" }--- language: - 僧伽罗语（Sinhala） license: MIT协议 size_categories: - 1千<样本数<1万 task_categories: - 文本生成 - 掩码生成 dataset_info: features: - name: 标题 dtype: 字符串 - name: 歌词 dtype: 字符串 - name: 演唱者 dtype: 字符串 - name: 来源 dtype: 字符串 --- # 🎵 SynhalaAI——终极僧伽罗语（Sinhala）歌词数据集（黄金精选版）  ## 数据集说明 **SynhalaAI歌词语料库**是一款精心打造、高保真的僧伽罗语（Sinhala）歌词数据集，专为针对僧伽罗语的诗歌性、口语化与结构化语言模式，训练大语言模型（Large Language Model, LLM）及高级分词器而设计。 与充斥着英文吉他和弦、元数据与HTML冗余信息的标准网络爬取数据集不同，本数据集经过了**“僧伽罗语优先”的精细化净化处理**，内容纯净无杂，仅包含僧伽罗语文本，涵盖了斯里兰卡数十年来的音乐发展历程。 ### 🌟 核心特性 * **AI级纯净度**：已彻底移除所有英文字符、吉他和弦（如`[Am]`、`G`、`Dm`）、节拍标记（如`Beat: 4/4`）、不可见Unicode幽灵字符与网络链接。 * **严格去重机制**：采用基于150字符歌词指纹的算法结合标题交叉引用，对歌曲进行高强度去重处理。 * **跨时代覆盖**：收录内容从20世纪60年代的经典金曲，直至2024至2026年的最新发行作品。 ## 🏗️ 三位一体数据构建策略 这款旗舰数据集整合了当前最优的僧伽罗语语料库资源，通过三阶段数据工程流水线完成采集与整合： 1. **巨型整合库（历史档案库）**：从GitHub上8个以上规模最大的开源僧伽罗语搜索引擎项目中聚合数据，获取绝大多数经典与热门歌曲。 * *数据来源*：DilanSachi、BhanukaD610、Rashmini、Tharindu KW、rpjayasekara、Nirmal Gamage及Thilina TLM维护的代码仓库。 2. **语言与隐喻语料整合**：整合来自Kaggle平台（`pasinduudawatta/sinhala-songs-and-metaphors`）的高质量人工标注语料。 3. **自主更新模块（2024-2026）**：针对“黄金标准平台”`Sinhalasongbook.com`开发定制化合规网络爬虫，提取旧静态语料库未收录的最新发行作品。 ## 📊 数据集结构 本数据集提供两种格式：统一JSON数组格式文件`sinhala_lyrics_MASTER.json`，以及专为分词器训练（BPE/SentencePiece）优化的纯文本语料库`sinhala_lyrics_corpus_MASTER.txt`。 ### 数据字段说明 * `title`（字符串类型）：歌曲标题（通常为僧伽罗语或新加坡式英语）。 * `lyrics`（字符串类型）：经过深度净化的纯僧伽罗语歌词文本。 * `artist`（字符串类型）：歌曲的演唱者或创作者。 * `source`（字符串类型）：数据的原始来源（例如`github_archive`、`kaggle_metaphors`、`fresh_scraper`）。 ### 示例条目 json { "title": "Bambareku Anduwa", "lyrics": "බඹරෙකු ඇඬුවා මලක් ළඟදි බඹරෙකු ඇඬුවා ඇඬුවා... මලක් ළඟදි බඹරෙකු ඇඬුවා අහේ කඳුලු ඇති ඒ බඹරිඳු දැක අඬන්නෙ ඇයිදෝ මල ඇසුවා... මල ඇසුවා...", "artist": "Niranjala Sarojini", "source": "fresh_scraper" }