遇见数据集

CrawlCheck agentic-web census, weekly edition 2026-W44

收藏
Zenodo2026-11-02 更新2026-11-05 收录
官方服务:

资源简介:

The top sites on a fixed frame (top 1,000 and top 10,000, both daily): crawler policy, machine files, declared capabilities and whether AI crawlers get what a browser gets. Each weekly edition is sealed with a sha256 and an Ed25519 signature; the signing key is published at https://crawlcheck.io/keys. Change is like-for-like between the last run of the week and the last run before it. No site is named. Edition 2026-W44. Canonical copy and verification: https://crawlcheck.io/data/census/weekly?week=2026-W44. Archive URL: https://crawlcheck.io/api/v1/census/weekly/2026-W44.json. Edition sha256: 45742c834da1315b273752e6df4097284be421d5e2734b1a37b6fded3a3daf8c. Every CrawlCheck dataset: https://crawlcheck.io/datasets.

提供机构:
Zenodo
创建时间:
2026-11-02
二维码
社区交流群
二维码
科研交流群
商业服务