遇见数据集

Wikipedia Time-Series Graph

收藏
Zenodo2022-09-20 更新2026-05-25 收录
数据链接:
官方服务:

资源简介:

Wikipedia temporal graph. The dataset is based on two Wikipedia SQL dumps: (1) English language articles and (2) user visit counts per page per hour (aka pagecounts). The original datasets are publicly available on the Wikimedia website. Static graph structure is extracted from English language Wikipedia articles. Redirects are removed. Before building the Wikipedia graph we introduce thresholds on the minimum number of visits per hour and maximum in-degree. We remove the pages that have less than 500 visits per hour at least once during the specified period. Besides, we remove the nodes (pages) with in-degree higher than 8 000 to build a more meaningful initial graph. After cleaning, the graph contains 116 016 nodes (out of total 4 856 639 pages), 6 573 475 edges. The graph can be imported in two ways: (1) using edges.csv and vertices.csv or (2) using enwiki-20150403-graph.gt file that can be opened with open source Python library Graph-Tool. Time-series data contains users' visit counts from 02:00, 23 September 2014 until 23:00, 30 April 2015. The total number of hours is 5278. The data is stored in two formats: CSV and H5. CSV file contains data in the following format [page_id :: count_views :: layer], where layer represents an hour. In H5 file, each layer corresponds to an hour as well.

维基百科时序图(Wikipedia temporal graph)。本数据集基于两份维基百科结构化查询语言(Structured Query Language,SQL)导出文件:其一为英文维基百科条目,其二为各页面每小时的用户访问量(亦称pagecounts)。原始数据集可在维基媒体基金会官方网站公开获取。静态图结构从英文维基百科条目中提取,且已剔除所有重定向页面。在构建该维基百科时序图前,我们设定了两项阈值:最低每小时访问量与最高入度。我们将移除在指定观测时段内,至少存在一次每小时访问量不足500的页面;此外,为构建更具学术价值的初始图结构,我们还剔除了入度高于8000的节点(即页面)。经数据清洗后,该图共包含116016个节点(原始总页面数为4856639)与6573475条边。该图可通过两种方式导入:其一为使用edges.csv与vertices.csv文件;其二为使用enwiki-20150403-graph.gt文件,该文件可通过开源Python库Graph-Tool加载。时序数据集涵盖2014年9月23日02:00至2015年4月30日23:00的用户访问量统计数据,总时长共计5278小时。该数据以两种格式存储:CSV与H5。CSV文件的数据格式为`[page_id :: count_views :: layer]`,其中layer代表单个小时时段;H5文件中,每个层同样对应一个小时的统计单元。

提供机构:
Zenodo
创建时间:
2017-09-07
二维码
社区交流群
二维码
科研交流群
商业服务