CrawlCheck agentic-web census, weekly edition 2026-W44
收藏官方服务:
资源简介:
The top sites on a fixed frame (top 1,000 and top 10,000, both daily): crawler policy, machine files, declared capabilities and whether AI crawlers get what a browser gets. Each weekly edition is sealed with a sha256 and an Ed25519 signature; the signing key is published at https://crawlcheck.io/keys. Change is like-for-like between the last run of the week and the last run before it. No site is named. Edition 2026-W44. Canonical copy and verification: https://crawlcheck.io/data/census/weekly?week=2026-W44. Archive URL: https://crawlcheck.io/api/v1/census/weekly/2026-W44.json. Edition sha256: 45742c834da1315b273752e6df4097284be421d5e2734b1a37b6fded3a3daf8c. Every CrawlCheck dataset: https://crawlcheck.io/datasets.
提供机构:
Zenodo创建时间:
2026-11-02



