Quantified rating reliability among observers and Matlab codes.

Inter-rater reliability between observers and Matlab codes, as well as intra-rater reliability of one observer and the Matlab codes, was quantified using Cohen’s Kappa. Mathematically, the Cohen’s Kappa ranges from zero to one with larger values indicating better consistency. Acceptable values have been debated, but values above 0.6 have generally been considered acceptable [29]. A label of 72 hours. indicates a second trial performed by the same observer or Matlab codes 72 hours following the first. The percent agreement was also calculated for each pair and was consistently above 90%.