Supplements to: Understanding use of Evidence in AI Ethics Guidelines Development Through a PRISMA-ETHICS informed Scoping Review of Guidelines

Supplements to: Understanding use of Evidence in AI Ethics Guidelines Development Through a PRISMA-ETHICS informed Scoping Review of Guidelines<b>Supplement 1: PRISMA-ETHICS Reporting Guideline Reporting </b>checklist for the review. <b>Supplement 2: Detailed sources and data processing </b>Detail of source and search information, and detailed data processing. <b>Supplement 3: Approach for Guideline Development</b>Proposed approach for guideline development process, and structure. <b>Supplement 4: Guideline Draft Template </b>Draft template for guideline document. <b>Supplement 5: Mapping of Ethics Principles Across International Research Ethics Guidelines</b>Table Mapping of Principles from Australian National Statement on Ethical Conduct in Human Research to international frameworks identified in earlier review [71]. <b>Supplement 6: Items by search </b>Mapping of items to retrieval approach. - Refs.html - Search_strategy.html - Full_text_refs.docx The full set of items retrieved, screened, full-text reviewed, and included can be found in the supplement. First 10 columns were full-text screened (EXCLUDED captures those excluded at this stage), remaining columns indicate results returned against search strategies, and those items included at screening (columns labelled "include"). The full list of items retrieved, and full-text reviewed is also available in the supplement (prepended by a citation-key which can be used for cross-referencing in the original data files). <b>Supplement 7: Summaries of guideline development approaches </b>Mapping of information extracted. - Guideline-method-summaries.xlsx Contains sheets: - Method_REIGN For each item, identifies the approach taken to guideline development using the REIGN scheme, with summaries - Sections For each item, identifies the sections present in the materials, with summaries - method_summaries Provides counts of the methods adopted<br><br>Is that a Guideline? Addressing Learning in Ethics Guidelines Through a PRISMA-ETHICS informed Scoping Review of Guidelines<b>Objectives</b>: There have been recent calls for new ethics guidelines regarding the use of artificial intelligence in research. How should we go about developing such ethics guidance documents with respect to emerging contexts such as new technologies, and established domains such as research in education? This paper provides a PRISMA-ETHICS informed scoping review of approaches to ethics guideline development, the structures of ethics guidelines, and their audiences and purposes particularly in the context of education and AI.<b>Search and synthesis approach</b>: A broad search of scholarly and grey literature was conducted to identify both ethics guidelines and material discussing their development; n = 592 distinct items were identified, including 182 that identified via recent reviews of AI ethics guidelines. n = 47 guideline-sets were identified as meeting our criteria as ‘guidelines’.<b>Data extraction and analysis</b>: Guidelines were analysed with respect to their development approach, audience and purpose, and structural elements through which guidance is delivered; most included statements regarding their development approach (79%) and audience (72%) typically in 1-2 paragraphs in the introduction. Where evidence underpinning the guidance was discussed, it was largely at a global content level (69%), rather than with respect to the specific context/domain of the guideline use, principles drawn on, or approaches and strategies one might adopt in navigating ethical issues (23, 29, and 21% respectively). Consultation with stakeholders and experts were the most common forms of evidence. Across the guidelines there are commonalities in the majority including: an overview statement of the topic, audience, and guideline purpose; an indication of rights or license describing reuse conditions; an overview of the ethical concepts and their detailed elaboration; challenging cases or edge issues; and approaches or strategies one might adopt to navigate these. However, only the first element (overview) was present in all guidelines, a finding born out in the further analysis of items relating specifically to AI and education. Recommendations regarding the development of ethics guidelines, and their structure are provided.<b>Systematic review registration</b>: The review was not pre-registered.