Web scraping and API projects from "Online Data Collection and Management" (Spring 2022)
收藏资源简介:
As part of "Online Data Collection and Management" (taught at Tilburg University, Spring 2022), students collected publicly available datasets for use in academic research projects. With this repository, I am sharing (a) the documentation of these data sets, and (b) the associated source code that led to the collection of the data. The repository also contains the collected datasets. The data consists of the following projects: Autoscout (electric cars vs gasoline cars in the Dutch market) Mediamarkt (e-commerce) Steam API Twitch (chat capture) Zalando (e-commerce) Course website: https://odcm.hannesdatta.com. Archived at https://doi.org/10.5281/zenodo.6641811 (check for more recent versions if available).
本数据集源自蒂尔堡大学(Tilburg University)2022年春季开设的《在线数据采集与管理》(Online Data Collection and Management)课程,课程中学生们采集了公开可获取的数据集用于学术研究项目。通过本代码仓库,我将分享两类资源:一是上述数据集的文档资料,二是用于采集这些数据的配套源代码;本仓库同时收录了全部已采集完成的数据集。本次涵盖的数据集项目包括:Autoscout(荷兰市场电动汽车与燃油汽车对比数据集)、Mediamarkt(电商数据集)、Steam应用程序接口(API)、Twitch(聊天记录采集数据集)以及Zalando(电商数据集)。课程官方网站:https://odcm.hannesdatta.com。本数据集已存档于https://doi.org/10.5281/zenodo.6641811,若有更新版本可查询该存档链接。



