Webis-WikiDiscussions-18
收藏NIAID Data Ecosystem2026-03-13 收录
下载链接:
https://zenodo.org/record/3339151
下载链接
链接失效反馈官方服务:
资源简介:
Webis-WikiDiscussions-18 Corpus is the output of parsing the entire set of Wikipedia talk pages. The corpus contains about six million discussions, consisting of about 20 million turns. The turns comprise around 74,000 different tags with a total of about 100,000 instances, around 7000 different shortcuts with about 400,000 instances, and around 51,000 different inline templates with about 3.3 million instances.
The database has the following structure:
PAGES: PAGE-ID, URL, TITLE
DISCUSSIONS: DISCUSSION-ID, PAGE-ID, TITLE
COMMENTS: COMMENT-ID, DISCUSSION-ID, PARENT-ID, TEXT-RAW, TEXT-CLEAN, USER
TAGS: TAG-ID, COMMENT-ID, TAG-TEXT, TAG-CLASS
TEMPLATES: TEMPLATE-ID, DISCUSSION-ID, TEMPLATE-TEXT
SHORTCUTS: SHORTCUT-ID, COMMENT-ID, SHORTCUT-TEXT, SHORTCUT-CLASS
LINKS: LINK-ID, COMMENT-ID, LINK-TEXT
INLINE-TEMPLATES: IL-TEMPLATE-ID, COMMENT-ID, IL-TEMPLATE-TEXT, TYPE, DESCRIPTION
创建时间:
2022-08-29



