mlfoundations-dev/organic_chemistry_pdf_word_search

该数据集包含网页文本及其相关元数据，特征包括文本中不重复n-gram的数量、页面语言ID（使用FastText表示）、元数据（如内容长度、内容类型、Warc相关信息等）、前一个单词的数量、文本内容、URL、Warc信息、相似度指标（包括平均、最大和最小相似度及其对应的索引和文本）。数据集仅包含训练集划分，共98828个示例，总大小为3176240803字节。The dataset consists of web page texts and their associated metadata, features include the count of unique n-grams in the text, language ID of the whole page represented by FastText, metadata (such as content length, content type, Warc-related information, etc.), the count of the previous word, the text content, URL, Warc information, similarity metrics (including average, maximum, and minimum similarity and their corresponding indices and texts). The dataset contains only the training split, with a total of 98828 examples and a size of 3176240803 bytes.