Computerized methods for collecting confidence ratings: Task influences on patterns of responding: Dataset

Retrospective confidence ratings and other judgments frequently are collected in computer-based psychology studies, but little research has investigated whether the method with which these ratings are collected influences the resulting data. To explore whether different confidence rating entry methods elicit different responses, 96 subjects were tested in a recognition memory paradigm. To rate confidence in recognition decisions from 0 - 100, half of the subjects used the numeric keypad on the keyboard to respond whereas the other half used an on-screen slider. Notably, whereas subjects using the numeric keypad frequently chose to enter confidence ratings divisible by 5 and 10, subjects using the slider showed no such preference but instead were more likely to accept the slider default value (i.e., 50) for each trial. The method with which confidence ratings are collected may have unintended consequences on confidence rating data and their interpretation.

在基于计算机的心理学研究中，回溯性信心评分（retrospective confidence ratings）与其他判断结果的收集工作颇为常见，但目前鲜有研究探讨此类评分的收集方式是否会对最终产出的数据产生影响。为探究不同信心评分录入方式是否会引发差异化的被试反应，本研究采用再认记忆范式（recognition memory paradigm）对96名被试开展实验。在对0至100分区间内的再认决策信心进行评分时，半数被试使用键盘数字小键盘（numeric keypad）作答，其余半数则采用屏幕滑块（on-screen slider）进行评分。值得注意的是，使用数字小键盘的被试常会选择输入以5或10为倍数的信心评分，而使用滑块的被试则无此类偏好，反而更倾向于在每一轮试次（trial）中直接采用滑块的默认值（即50分）。由此可见，信心评分的收集方式可能会对信心评分数据及其解读产生意想不到的影响。