five

"Large Language Models on Problem-Solving Skills in Programming Debugging of IT Undergraduates"

收藏
DataCite Commons2025-09-26 更新2026-05-03 收录
下载链接:
https://ieee-dataport.org/documents/large-language-models-problem-solving-skills-programming-debugging-it-undergraduates
下载链接
链接失效反馈
官方服务:
资源简介:
"This dataset captures multi-dimensional information from undergraduate students enrolled in Level 2 of an IT-related program, focusing on their engagement with Large Language Models (LLMs) and debugging performance. The first component of the dataset records demographic details (gender, academic stream, and A\/L Z-score), academic performance indicators (overall GPA and Level 1 programming module results), and tool usage patterns. Students reported their preferred and frequently used LLMs, with ChatGPT being the most dominant, alongside Copilot, Gemini, and other emerging models. Additional variables include self-rated confidence in debugging tasks (on a 1\u20135 scale), timestamps of pre-test, mid-test, and post-test sessions, and the Integrated Development Environments (IDEs) used (e.g., Visual Studio Code, NetBeans, Online Java compilers).The second component of the dataset consists of mock-test results from 4 students and proper-test results from 83 students. It evaluates debugging performance across pre-test, mid-test, and post-test phases, measuring (i) number of errors identified, (ii) number of errors correctly fixed, (iii) error types (logical vs. syntax), (iv) duration taken to complete tasks, and (v) accuracy rate. The sample demonstrates progression in error identification and correction skills, with notable improvements in mid-test performance (100% accuracy for some students), followed by more realistic outcomes in the post-tests where accuracy rates ranged around 56%.Together, these datasets provide a comprehensive foundation for examining the relationship between LLM adoption, student confidence, and actual debugging performance. They enable comparative analyses of learning progression, the role of AI-assisted tools in programming education, and the balance between speed, accuracy, and tool reliance in problem-solving tasks."
提供机构:
IEEE DataPort
创建时间:
2025-09-26
5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作