ICAO USOAP CMA dataset issues 2022-2025

This dataset includes International Civil Aviation Organization (ICAO) Universal Safety Oversight Audit Programme (USOAP) Continuous Monitoring Approach (CMA) public online data covering Effective implementation (EI) of ICAO Standards and Recommended Practices (SARPs) in relation to Accident Investigation (AIG). Because the USOAP database (see https://www.icao.int/safety/CMAForum/Pages/USOAP-Results.aspx) varies continuously, it is not possible to view historical data unless it has been downloaded and copied on a particular date and time in relation to one or more of ICAO's approximately 190 Member States. This also applies to the global average EI compliance for AIG. Initially, relevant ICAO Member State data was downloaded on 3 September 2022 to provide context for broader research in relation to those ICAO Member States that were members of the International Transportation Safety Association (ITSA). When an additional ITSA Accident Investigation Authority (AIA) had its first ICAO USOAP AIG audit, the USOAP online results for it and the other participants were reviewed on 15 April 2023. Some major discrepancies were found between the two dates without any change to the most recent (last) audit date underpinning the data. Ongoing liaison with ICAO and provision of the problematic data to them did not lead to an explanation for most of the issues. Additional ITSA research participants also had problematic data when the online database was accessed on 29 July 2024, 28 December 2024 and 19 March 2025. Further data has been added for 1 May 2025 and 12 May 2025. A draft manuscript with detailed analysis of the issues did not lead to a substantive response from ICAO. Additional ICAO subscription API datasets with USOAP data recorded conflicting results for the same last Mission audit year and Member States, compared with each other and with the accessed online data. After almost 2 years of raising these concerns, a manuscript has been completed that addresses the issues and their likely significance which may be much greater than for the 12 sampled ITSA AIAs. While the USOAP data is tabulated and discussed in this manuscript, it is not possible for other researchers to access the historical data unless they are separately made available by ICAO through restricted internal sources (if feasible). The files provided in the dataset provide this information. Because the issues were unexpected, the files include rough handwritten comments on the hard copies downloaded at the time.本数据集涵盖国际民用航空组织（International Civil Aviation Organization, ICAO）通用安全监督审计计划（Universal Safety Oversight Audit Programme, USOAP）持续监测方法（Continuous Monitoring Approach, CMA）的公开在线数据，内容涉及事故调查（Accident Investigation, AIG）领域ICAO标准与建议措施（Standards and Recommended Practices, SARPs）的有效实施（Effective Implementation, EI）情况。 鉴于USOAP数据库（详见https://www.icao.int/safety/CMAForum/Pages/USOAP-Results.aspx）处于实时更新状态，除非在特定日期和时间下载并留存了与ICAO约190个成员国中一个或多个成员国相关的数据，否则无法查看对应历史数据。全球事故调查领域的EI合规性平均水平同样遵循这一规则。 最初，相关ICAO成员国的数据集于2022年9月3日完成下载，旨在为针对国际运输安全协会（International Transportation Safety Association, ITSA）成员国的拓展研究提供数据背景。当某一新增ITSA事故调查主管部门（Accident Investigation Authority, AIA）首次接受ICAO USOAP的AIG审计后，研究团队于2023年4月15日复核了该部门及其他参与方的USOAP在线结果。 研究人员在两个时间点的数据中发现多处显著差异，但支撑数据的最新（末次）审计日期并未发生变更。尽管与ICAO持续沟通并向其提交了存在异常的数据，但多数问题仍未获得合理解释。 在2024年7月29日、2024年12月28日及2025年3月19日访问在线数据库时，额外纳入的ITSA研究参与方的数据集也出现了同类异常。后续又补充了2025年5月1日及2025年5月12日的数据集。 一份针对上述异常开展详细分析的稿件初稿并未收到ICAO的实质性回应。此外，两份包含USOAP数据的ICAO订阅式API数据集，在同一末次任务审计年度及成员国的数据上出现相互矛盾的结果，且二者与此前访问的在线数据也存在冲突。 在历时近两年持续反馈这些问题后，研究团队最终完成了一篇针对这些异常及其潜在影响的稿件——其潜在影响可能远超本次采样的12家ITSA事故调查主管部门。尽管本稿件中对USOAP数据进行了制表与讨论，但其他研究人员仍无法获取历史数据，除非ICAO通过受限内部渠道另行提供（若可行）。本数据集所提供的文件即包含此类历史数据。由于上述异常均为意外发现，文件中附带了当时下载纸质副本时写下的粗略手写注释。