Data accountability databases from collecting Antarctic Treaty Consultative Meeting documents
收藏资源简介:
We present a consolidated dataset of Antarctic Treaty Consultative Meeting documents spanning 1961 to 2024 (ATCM I to ATCM XLVI). Our dataset drew primarily from the Antarctic Treaty Secretariat Database (ATSD, https://www.ats.aq/), with gaps in the ATSD's Working Paper collection filled from the Antarctic Treaty Documents Database (ATADD https://www.utas.edu.au/library-resources/atadd). We extracted machine-readable text from all documents using a combination of direct text extraction and OCR using a multimodal large language model for scanned documents. At each stage of our process, we documented the decisions we made and stored intermediate results to enhance reproducibility and provide data accountability. All HTTP responses from both databases were stored in a persistent cache, which will also allow future users to detect when the source datasets change; and the full OCR pipeline was also stored.



