遇见数据集

Hash data files for "Hashes are not suitable to verify fixity of the public archived web"

收藏
Zenodo2022-09-15 更新2026-05-26 收录
数据链接:
官方服务:

资源简介:

This work investigates the fixity of a set of archived webpages, or mementos. We conducted a study on 16,627 mementos from 17 public web archives. We replayed and downloaded the mementos 39 times using a headless browser over a period of 442 days and generated a hash for each memento after each download, resulting in 39 hashes per memento. The hashes were generated by creating Merkle trees to represent hashes at each level of the memento. A hash was generated for each resource used to construct the full webpage and then the hashes were combined to generate an overall hash for the composite memento. There are 39 data files, one for each download. The mementos downloaded come from the dataset at https://github.com/oduwsdl/mementos-fixity/

本研究围绕归档网页(memento)的固定性展开探讨。我们针对来自17个公开网络档案馆的16627个存档副本开展了相关研究。在442天的周期内,我们使用无头浏览器对这些存档副本进行了39次回放与下载操作;每次下载完成后,均为每份存档副本生成一则哈希值,最终每份存档副本对应39条哈希值。哈希生成过程通过构建梅克尔树(Merkle tree)来表征存档副本各层级的哈希值:首先为构建完整网页所用到的每一项资源生成哈希值,随后将这些哈希值进行合并,以得到该复合存档副本的总哈希值。本次研究共包含39份数据文件,分别对应每一次下载操作所产生的结果。本研究使用的存档副本数据集来源于https://github.com/oduwsdl/mementos-fixity/

提供机构:
Zenodo
创建时间:
2022-09-15
二维码
社区交流群
二维码
科研交流群
商业服务