I-STUDIO: A reliable statistical automatic short answer assessment dataset

I-STUDIO is an automatic assessment dataset for both NLP and statistical education use. It consists of an instrument to assess the statistical reasoning skills of college students. This dataset derives from an investigation of an assessment instrument entitled: The Introductory Statistics Transfer of Understanding and Discernment Outcomes (I-STUDIO). The data collection used a sample of 1,935 students (from colleges across the USA and elsewhere) who completed the I-STUDIO instrument, which included 6 open-ended questions with one or more parts to each question, while describing their thinking out loud. The original study had IRB approval, and the IRB confirmed that the data can now be made public for research purposes in this de-identified form. The data was randomly partitioned to produce, resulting in the training (N=5,018), validation (N=627), and test (N=627) set sizes.