Replication Data for: AI vs. Students: A Study of the Capability of ChatGPT to Write Model UN Position Papers

This paper investigates the impact of ChatGPT on student writing in the context of Model United Nations position papers, which require extensive research and concise articulation of policies on international issues. By comparing student-written papers and ChatGPT-generated papers, we find that, while AI-generated papers receive higher evaluations overall, award-winning student papers outperform AI-generated ones. Furthermore, the quality of AI-generated writing is shown to depend on human input, emphasizing the importance of a human-centered approach to AI in education.

本研究探讨了ChatGPT在模拟联合国立场文件场景下对学生写作的影响——这类文件要求针对国际议题开展广泛研究并简洁阐述相关政策。通过对比学生撰写的论文与ChatGPT生成的论文，研究发现：尽管AI生成论文整体评分更高，但获奖学生论文的表现仍优于AI生成论文。此外，研究表明AI生成文本的质量取决于人类输入，这凸显了教育领域中AI应用需秉持以人类为中心的方法的重要性。