aliarda/turkish-news-1.8M-tokenized

这是一个使用aliarda/turkish-news-32k-tokenizer分词工具处理后的土耳其新闻数据集，原始数据集名为habanoz/news-tr-1.8M。数据集包含文本内容、文本URL、文本的分词表示和文本长度四个字段，并提供训练集分割。该数据集是为了实验用途而创建的。This is the tokenized version of the Turkish news dataset habanoz/news-tr-1.8M using aliarda/turkish-news-32k-tokenizer for experimental purposes. The dataset includes fields for text content, URL of the text source, tokenized representation of the text, and the length of the text, with a training split provided.