IlyaGusev/ru_stackoverflow

Russian StackOverflow数据集包含来自ru.stackoverflow.com的问题、答案和评论，主要用于文本生成和问答任务。数据以俄语为主，包含一些编程代码。数据集的特征包括问题ID、URL、答案数量、HTML和Markdown格式的文本、评分、标题、标签、浏览量、作者、时间戳、评论和答案等。数据集的大小在100K到1M之间，训练集包含437,604个实例。数据集的来源是Russian StackOverflow网站，处理脚本和原始XML文件也提供了链接。数据集未匿名化，包含原始作者的信息，并根据CC BY-SA 2.5许可证分发。

The Russian StackOverflow Dataset contains questions, answers, and comments from ru.stackoverflow.com, primarily intended for text generation and question answering tasks. The data is predominantly in Russian, with some programming code included. The features of the dataset include question ID, URL, number of answers, text in HTML and Markdown formats, scores, titles, tags, page views, authors, timestamps, comments, and answers, among others. The size of the dataset ranges between 100K and 1M, with the training set containing 437,604 instances. The dataset originates from the Russian StackOverflow website, and links to the processing scripts and original XML files are also provided. The dataset is not anonymized, includes information of the original authors, and is distributed under the CC BY-SA 2.5 license.

原始信息汇总

Russian StackOverflow dataset

数据集概述

基本信息

• 许可证: other
• 任务类别:
  • text-generation
  • question-answering
• 语言: Russian
• 数据集大小: 100K<n<1M

数据集特征

• question_id: uint32
• url: string
• answer_count: uint32
• text_html: string
• text_markdown: string
• score: int32
• title: string
• tags: sequence of string
• views: uint64
• author: string
• timestamp: uint64
• comments: sequence
  • text: string
  • author: string
  • comment_id: uint32
  • score: int32
  • timestamp: uint64
• answers: sequence
  • answer_id: uint32
  • is_accepted: uint8
  • text_html: string
  • text_markdown: string
  • score: int32
  • author: string
  • timestamp: uint64
  • comments: sequence
    • text: string
    • author: string
    • comment_id: uint32
    • score: int32
    • timestamp: uint64

数据集分割

• train
  • num_bytes: 3013377174
  • num_examples: 437604
• 下载大小: 670468664
• 数据集大小: 3013377174

数据实例

{ "question_id": 11235, "answer_count": 1, "url": "https://ru.stackoverflow.com/questions/11235", "score": 2, "tags": ["c++", "сериализация"], "title": "Извлечение из файла, запись в файл", "views": 1309, "author": "...", "timestamp": 1303205289, "text_html": "...", "text_markdown": "...", "comments": { "text": ["...", "..."], "author": ["...", "..."], "comment_id": [11236, 11237], "score": [0, 0], "timestamp": [1303205411, 1303205678] }, "answers": { "answer_id": [11243, 11245], "timestamp": [1303207791, 1303207792], "is_accepted": [1, 0], "text_html": ["...", "..."], "text_markdown": ["...", "..."], "score": [3, 0], "author": ["...", "..."], "comments": { "text": ["...", "..."], "author": ["...", "..."], "comment_id": [11246, 11249], "score": [0, 0], "timestamp": [1303207961, 1303207800] } } }

许可证信息

• 许可证: CC BY-SA 2.5