A Scoping Review on the Effectiveness of ChatGPT in Improving Critical Thinking Dispositions and Abilities at the Undergraduate Level

The increasing use of ChatGPT on college campuses around the world has reinvigorated debates on its potential to promote or hide critical thinking development among undergraduate students. Little systematic research has reviewed the effectiveness of ChatGPT on learners' critical thinking dispositions and abilities. This research presents the findings from a scoping review of 12 experimental and observational studies testing the effects of ChatGPT on critical thinking development. Using Web of Science and Scopus databases, three independent researchers searched, screened, and coded 12 investigations covering the effects of ChatGPT on 26 critical thinking dispositions and abilities from 11 countries between 2022 and 2024. A total of 91 distinct statistical statements linked ChatGPT to 26 critical thinking dispositions and abilities. Among them, 35 statements referenced a minimal effect of ChatGPT on critical thinking, while 24 statements reported a moderate effect. On the other hand, 19 statements demonstrated no effects of ChatGPT on critical thinking, whereas 13 statements indicated strong effects. ChatGPT's use was more effective in developing learners' (a) openness, (b) awareness, (c) collaboration with peers, and d) understanding of basic content. On the other hand, using ChatGPT was least effective in developing students' (a) creation of new ideas, (b) innovative search abilities, (c) algorithmic inference, and d) constructive reflection abilities. Structured guided implementation of ChatGPT generates more effective gains on critical thinking abilities at the undergraduate level.