Hedging-Based Scoring Rules for Multiple-Choice Questions

Replication package for "Hedging-Based Scoring Rules for Multiple-Choice Questions", by Jingcheng Fu, Xing Zhang and Songfa Zhong.

Stata data file: FZZ_iq_mcq_sr.dta

Index of the do-files and definition of the necessary globals before running any of the other do files: _master.do

Figures:
Figure 2: Frequency of mixing by condition: sum_iq.do
Figure 3a: Proportion of questions answered with mixing by difficulty level: sum_iq_rule.do
Figure 3b: Proportion of questions answered with mixing by question order: sum_iq_qorder.do
Figure 4: Distribution of IQ score by condition: sum_iq.do
Figure 5: Response time and return on time investment by difficulty level: sum_roti.do
Figure 6: Score and mixing by treatment and risk aversion: sum_risk.do
Figure 7: Score and mixing by treatment and false diversification: sum_fd.do
Figure 8: Spearman correlation between GPA and IQ score: corr_gpa.do

Tables:
Table 1: Determinants of hedging by mixing: reg_iq.do
Table 2: Determinants of standardized IQ score: reg_iq.do
Table 3: Treatment effects conditional on risk attitude: sum_risk.do
Table 4: Treatment effects conditional on false diversification: sum_fd.do
Table 5: Treatment effects conditional on gender: sum_gender.do

Computing Cronbach alpha and confidence intervals: sum_cronbach_alpha.do

Appendix:
Figure A1: Score by difficulty level: sum_iq_rule.do
Figure A2: Score by question order: sum_iq_qorder.do
Figure A3: Response time and ROTI by difficulty level, split by time constraint: sum_roti.do
Figure A4: Summary of raw GPA by university and faculty: corr_gpa.do
Figure A5: GPA-IQ Spearman correlation by randomly drawn question subsets: corr_gpa_subsets.do
Table A1: Interaction effects between time constraint and treatments: reg_iq.do
Table A2: Question-level analysis of mixing: reg_iq_question.do
Table A3: Question-level analysis of IQ scores: reg_iq_question.do
Table A4: Determinants of decision time: reg_iq.do
Table A5: Return on time investment by condition: sum_roti.do
Table A6: Balance checks for post-IQ test characteristics: sum_spillover.do
Table A7: Big Five personality traits summary: sum_big5.do
Table A8: Replication of Table 1 excluding subjects with missing administrative data: reg_iq.do
Table A9: Replication of Table 2 excluding subjects with missing administrative data: reg_iq.do