Dataset Question Answering for Admission of Higher Education Institution

The data collection process commenced with web scraping of a selected higher education institution's website, collecting any data that relates to the admission topic of higher education institutions, during the period from July to September 2023. This resulted in a raw dataset primarily cantered around admission-related content. Subsequently, meticulous data cleaning and organization procedures were implemented to refine the dataset. The primary data, in its raw form before annotation into a question-and-answer format, was predominantly in the Indonesian language. Following this, a comprehensive annotation process was conducted to enrich the dataset with specific admission-related information, transforming it into secondary data. Both primary and secondary data predominantly remained in the Indonesian language. To enhance data quality, we added filters to remove or exclude: 1) data not in the Indonesian language, 2) data unrelated to the admission topic, and 3) redundant entries. This meticulous curation has culminated in the creation of a finalized dataset, meticulously prepared and now readily available for research and analysis in the domain of higher education admission.

本数据集的采集流程如下：2023年7月至9月期间，针对选定的某高等教育机构官网开展网络爬虫抓取工作，收集所有与高等院校招生主题相关的数据，由此得到以招生相关内容为核心的原始数据集。随后，通过严谨的数据清洗与整理流程对该数据集进行优化提纯。在未被标注为问答格式的原始初级阶段，数据主体以印尼语（Indonesian）呈现。在此基础上，项目组开展了全面的标注工作，通过补充特定招生相关信息将其转化为次级数据集。初级与次级数据集仍以印尼语为主要语言。为进一步提升数据质量，我们增设了三重过滤规则以剔除不符合要求的数据：1）非印尼语数据；2）与招生主题无关的数据；3）冗余重复条目。经过此番细致的遴选打磨，最终生成定稿数据集，该数据集经精心筹备，现已可直接应用于高等教育招生领域的研究与分析工作。

搜集汇总

背景与挑战

背景概述

该数据集是针对高等教育机构招生主题的问答数据集，数据来源于2023年7月至9月对选定机构网站的爬取，原始数据以印尼语为主，经过清洗、注释和过滤处理，最终形成高质量的问答格式数据，适用于高等教育招生领域的研究分析。