大数据应用开放平台（数据接入）

数据接入功能需实现多源异构的数据接入，通过数据采集技术，如实时同步、批量同步、数据库事务日志同步、API对接和数据填报等，同时通过跨网前置传输、数据加密传输、等手段保证数据采集过程的安全、稳定和可靠。支持MYSQL、HDFS等主流数据库类型的数据接入。

The data access function is required to realize multi-source and heterogeneous data access. It leverages diverse data collection technologies such as real-time synchronization, batch synchronization, database transaction log synchronization, API docking, and data reporting, etc. Meanwhile, it adopts measures including cross-network pre-transmission and encrypted data transmission to guarantee the safety, stability and reliability throughout the data collection process. Furthermore, it supports data access from mainstream database types such as MySQL and HDFS.

搜集汇总

背景与挑战

背景概述

该数据集提供多源异构数据接入解决方案，支持多种数据采集技术和主流数据库类型，覆盖人工智能、企业服务等多个领域。