Lightning Pose dataset: CRIM13

The Caltech Resident-Intruder Mouse dataset (CRIM13) (Burgos-Artizzu et al., CVPR 2012) consists of two mice interacting in an enclosed arena, captured by top and side view cameras at 30 Hz. We only use the top view. Seven keypoints are labeled on each mouse for a total of 14 keypoints (Segalin et al., eLife 2021).
Each keypoint in the original CRIM13 dataset (https://data.caltech.edu/records/4emt5-b0t10) is labeled by five different annotators. To create the final set of labels, we take the median across all labels for each keypoint. Additionally, we remove all frames where one or both mice were absent.
The labeled data are partitioned into disjoint "in-distribution" (InD) and "out-of-distribution" (OOD) sets. Each set contains different sessions / animals. We use the train/test split provided in the original dataset - the (4) resident mice are present in both InD and OOD splits; however, the intruder mouse is different for each session. The InD data contain 3986 labeled frames, and 37 unlabeled videos; the OOD data contain 1274 labeled frames, and 19 unlabeled videos.
Many thanks to the authors of the CRIM13 paper who collected and analyzed the original video dataset: Xavier P. Burgos-Artizzu, Piotr Dollár, Dayu Lin, David J. Anderson and Pietro Perona.
We also thank the authors of the MARS paper who collected keypoint annotations for the CRIM13 dataset: Cristina Segalin, Jalani Williams, Tomomi Karigo, May Hui, Moriel Zelikowsky, Jennifer J Sun, Pietro Perona, David J Anderson and Ann Kennedy.