ThatDeveloperGuy13/engine-optimization-reference

该数据集是一个精心策划的引擎优化参考语料库快照，涵盖了搜索引擎优化（SEO）、人工智能优化（AEO）、地理优化（GEO）和AI搜索的合并领域。它由ThatDevPro维护，索引了26个来自ThatDevPro参考库的规范参考页面，每个页面涵盖一个特定的爬虫信号，如HTML元标签（包括viewport、theme-color等12个主题）、Open Graph和Twitter Cards（2个主题）、HTTP状态码（2xx、3xx、4xx、5xx共4个主题）以及HTTP头（包括缓存、内容、CORS等8个主题）。该数据集旨在训练和评估AEO/GEO评分系统、llms.txt验证器和结构化数据提取模型，适用于文本分类和文本检索任务。A curated snapshot of canonical reference documentation for engine optimization (the merge of SEO + AEO + AIO + GEO), maintained by ThatDevPro. This dataset indexes 26 canonical reference pages from the ThatDevPro Reference Library, each covering one specific crawler signal a website emits. It includes categories such as HTML meta tags (12 topics like viewport, theme-color, etc.), Open Graph & Twitter Cards (2 topics), HTTP status codes (4 topics: 2xx, 3xx, 4xx, 5xx), and HTTP headers (8 topics: caching, content, CORS, etc.). The dataset is intended for training and evaluating AEO/GEO scoring systems, llms.txt validators, and structured-data extraction models, suitable for text-classification and text-retrieval tasks.