Dateno
收藏资源简介：
Dateno is a next-generation dataset search engine that provides fast, comprehensive access to open datasets worldwide. Our mission is to make data discovery and integration as seamless as possible for researchers, analysts, developers, journalists, and anyone else working with data. Our Vision We believe that access to data should be easy and efficient. By creating a powerful search engine specifically for datasets, we aim to accelerate research, innovation, and data-driven decision-making across various fields. What Sets Us Apart Speed: We've optimized our search functionality to deliver results as quickly as possible using Meilisearch. Comprehensive Filtering: Our advanced filtering system allows users to narrow down results by various parameters, making it easier to find exactly what you need. API-First Architecture: We're building Dateno with API access in mind, allowing for seamless integration into your workflows and applications. Extensive Index: Our constantly growing index includes millions of records from thousands of data catalogs worldwide. Data Preservation: We're committed to archiving datasets that are at risk of disappearing, ensuring valuable data remains accessible. How It Works Dateno is built on the Dateno registry of data catalogs. We crawl various types of data sources, including: - Open data portals - Geoservers/geoportals - Scientific data repositories - Microdata catalogs - Databases of indicators We use common APIs and export formats like DCAT, CKAN API, CSW, WFS, WMS, and ArcGIS Rest API to gather data. After crawling, we enrich the data and convert it to a unified structure similar to DCAT, creating a single search index.
Dateno是一款新一代数据集搜索引擎，可让用户快速、全面地获取全球范围内的开放数据集。我们的使命是为研究人员、分析师、开发者、记者及所有从事数据相关工作的人士，打造尽可能流畅无缝的数据发现与集成体验。 我们的愿景 我们坚信数据获取应当便捷高效。通过打造一款专为数据集设计的强大搜索引擎，我们致力于加速各领域的研究、创新与数据驱动型决策。 核心优势 搜索速度：我们采用Meilisearch对搜索功能进行优化，以尽可能快速地返回查询结果。 全面筛选：我们的高级筛选系统允许用户通过各类参数缩小结果范围，便于精准定位所需数据。 API优先架构：我们在开发Dateno时优先考虑API接入需求，可实现与各类工作流程及应用程序的无缝集成。 海量索引库：我们的索引库持续扩容，目前收录了来自全球数千个数据目录的数百万条数据记录。 数据留存保护：我们致力于对濒临消失的数据集进行归档，确保珍贵数据始终可被访问。 工作原理 Dateno基于数据目录的Dateno注册库构建。我们会抓取各类数据源，具体包括： - 开放数据门户 - 地理服务器/地理门户 - 科学数据仓储 - 微数据目录 - 指标数据库 我们通过DCAT、CKAN API、CSW、WFS、WMS及ArcGIS Rest API等通用API与导出格式采集数据。完成数据抓取后，我们会对数据进行富集处理，并将其转换为类似DCAT的统一结构，从而构建统一的搜索索引。
