Sas programs related to: Ranking versus rating in peer review of research grant applications

In this study, we compared the reliability and potential sources of bias associated with application rating with those of application ranking in 3,156 applications to the Canadian Institutes of Health Research. We cannot publish the data related to this manuscript but we are sharing 3 SAS programs to show how we calculated some of a) the reviewer level variables b) the icc score c) the multivariate analysis. The programs were not written to be used with datasets other than the ones provided by CIHR.