遇见数据集

Documents first indexed in the SLUB catalog in 2025

收藏
Zenodo2026-02-03 更新2026-05-26 收录
官方服务:

资源简介:

The data set is available as a gzip-compressed, line-delimited JSON file and contains the 35,688,401 documents first indexed in the SLUB catalog in 2025 with the fields id (document identifier) and first_indexed (timestamp). The id consists of a creator id (optional), source id and a record id according to the scheme [{creator_id}-]{source_id}-{record_id}. If the record id contains characters that are unsuitable for URLs, it is base64-encoded without any padding. The first_indexed field, which is part of VuFind's Solr index schema, was determined using a Django application that regularly monitors the Solr cores of the SLUB catalog. The respective document sets from different points in time are compared with each other in order to determine new documents, i.e. document identifiers. If a new document is found, first_indexed is assigned the timestamp from the last_indexed field. The field obtained in this way serves as the basis for creating a list of new titles. However, it should be noted that neither all first indexed documents necessarily represent new titles, nor do the documents contained in this data set still have to be in the catalog. To check whether a document is currently in the SLUB catalog, its detailed view can be retrieved using the following URL scheme: https://katalog.slub-dresden.de/id/{id}. Example: https://katalog.slub-dresden.de/id/0-1929313942.

本数据集以gzip压缩的行分隔JSON文件形式提供,包含2025年首次在萨克森州立和大学图书馆(SLUB)目录中完成索引的35,688,401条文档,字段涵盖id(文档标识符)与first_indexed(时间戳)。id遵循[{creator_id}-]{source_id}-{record_id}格式,由创建者标识符(可选)、源标识符与记录标识符组成。若记录标识符包含不适用于URL的字符,则会进行无填充的Base64编码。 first_indexed字段属于VuFind的Solr索引模式,其取值通过定期监控SLUB目录Solr核心的Django应用程序确定。该程序会比对不同时间点的对应文档集以识别新增文档(即新增的文档标识符),若发现新文档,则将first_indexed字段赋值为last_indexed字段对应的时间戳。通过该方式得到的字段可作为生成新增书目列表的基础。 但需注意:并非所有首次索引的文档都必然对应新增书目,且本数据集收录的文档也未必仍留存于SLUB目录中。若需验证某文档当前是否仍在SLUB目录内,可通过以下URL模板获取其详情页面:https://katalog.slub-dresden.de/id/{id}。示例:https://katalog.slub-dresden.de/id/0-1929313942。

提供机构:
Zenodo
创建时间:
2026-02-03
二维码
社区交流群
二维码
科研交流群
商业服务