Dataset Take your Time

Despite recent trends towards graphical represent information, little is known about its impact on decision consistency in multiple criteria decision problems. In an online experiment, we query the performance ratings of six subordinates and examine the influence of information representation (graphs vs. tables vs. graphs with data labels) on decision consistency. We further address the (unavoidable) subjectivity of weighting multiple criteria by applying the analytic hierarchy process that is not yet applied in this research field. This methodological approach overcomes weaknesses of previous studies examining decision accuracy based on objective weights. Somewhat surprisingly, our results show that tables lead to the highest decision consistency and effort levels. They suggest that decision-makers prefer to minimize effort, i.e. decision time and the share of analytical judgment processes, if they are confronted with a mixed information representation (graphs or graphs with data labels). We caution against an unreflective use of graphical information representations in management reports and presentations lead to worse decision consistency and are no panacea for higher decision consistency in multiple criteria decision problems.