gluclose-D/nepali-news-scraped

该数据集是一个经过整理的文本集合，爬取自尼泊尔主要新闻门户网站，包括Kantipur、Gorkhapatra、Setopati等。尼泊尔语在自然语言处理中被历史性地归类为低资源语言，因为缺乏高质量、格式清晰且大规模的训练语料库。本资源库旨在通过提供干净、表格化的当代天城文文本数据集来弥补这一缺口，适用于训练分词器词汇、微调语言模型（如通过QLoRA的BERT、DeBERTa或LLaMA变体）以及评估下游文本分类任务。数据集语言为尼泊尔语，使用天城文字母，格式为.txt文件，并经过UTF-8编码标准化和噪声过滤处理，仅保留原始可读新闻文本。

This dataset is a curated collection of text scraped from prominent Nepalese news portals, including Kantipur, Gorkhapatra, Setopati, and others. Nepali is historically classified as a low-resource language in Natural Language Processing due to the scarcity of high-quality, cleanly formatted, and large-scale textual corpora. This repository bridges that gap by providing a clean, tabular dataset of contemporary Devanagari text suitable for training tokenizer vocabularies, fine-tuning language models (like BERT, DeBERTa, or LLaMA variants via QLoRA), and evaluating downstream text classification tasks. The dataset is in Nepali language, uses Devanagari script, is formatted as .txt files, and has been standardized to UTF-8 encoding with noise reduction to retain only raw, readable news text.