Annotations for ConfLab: A Data Collection Concept, Dataset, and Benchmark for Machine Analysis of Free-Standing Social Interactions in the Wild

This file contains the annotations for the ConfLab dataset, including actions (speaking status), pose, and F-formations. ------------------ ./actions/speaking_status: ./processed: the processed speaking status files, aggregated into a single data frame per segment. Skipped rows in the raw data (see https://josedvq.github.io/covfee/docs/output for details) have been imputed using the code at: https://github.com/TUDelft-SPC-Lab/conflab/tree/master/preprocessing/speaking_status The processed annotations consist of: ./speaking: The first row contains person IDs matching the sensor IDs, The rest of the row contains binary speaking status annotations at 60fps for the corresponding 2 min video segment (7200 frames). ./confidence: Same as above. These annotations reflect the continuous-valued rating of confidence of the annotators in their speaking annotation. To load these files with pandas: pd.read_csv(p, index_col=False) <br> ./raw-covfee.zip: the raw outputs from speaking status annotation for each of the eight annotated 2-min video segments. These were were output by the covfee annotation tool (https://github.com/josedvq/covfee) Annotations were done at 60 fps. -------------------- ./pose: ./coco: the processed pose files in coco JSON format, aggregated into a single data frame per video segment. These files have been generated from the raw files using the code at: https://github.com/TUDelft-SPC-Lab/conflab-keypoints To load in Python: f = json.load(open('/path/to/cam2_vid3_seg1_coco.json')) The skeleton structure (limbs) is contained within each file in: f['categories'][0]['skeleton'] and keypoint names at: f['categories'][0]['keypoints'] ./raw-covfee.zip: the raw outputs from continuous pose annotation. These were were output by the covfee annotation tool (https://github.com/josedvq/covfee) Annotations were done at 60 fps. --------------------- ./f_formations: seg 2: 14:00 onwards, for videos of the form x2xxx.MP4 in /video/raw/ for the relevant cameras (2,4,6,8,10). seg 3: for videos of the form x3xxx.MP4 in /video/raw/ for the relevant cameras (2,4,6,8,10). Note that camera 10 doesn't include meaningful subject information/body parts that are not already covered in camera 8. First column: time stamp Second column: "()" delineates groups, "&lt;&gt;" delineates subjects, cam X indicates the best camera view for which a particular group exists. <br> phone.csv: time stamp (pertaining to seg3), corresponding group, ID of person using the phone

本文件包含ConfLab数据集（ConfLab dataset）的标注信息，涵盖行为（说话状态）、姿态（pose）以及F型群体结构（F-formations）。
------------------ ./actions/speaking_status:
./processed：已处理的说话状态文件，按片段聚合为单个数据帧。原始数据中的跳过行（详见https://josedvq.github.io/covfee/docs/output）已通过https://github.com/TUDelft-SPC-Lab/conflab/tree/master/preprocessing/speaking_status处的代码完成插补。已处理的标注包含以下内容：
./speaking：首行为与传感器ID匹配的人员ID，其余行对应2分钟视频片段（共7200帧）以60fps帧率生成的二值化说话状态标注。
./confidence：格式与上述一致。此类标注反映标注人员对自身说话状态标注的连续置信度评分。可通过pandas加载此类文件：pd.read_csv(p, index_col=False)
./raw-covfee.zip：包含8个已标注2分钟视频片段各自的原始说话状态标注输出结果，由covfee标注工具（covfee annotation tool，https://github.com/josedvq/covfee）生成，标注帧率为60fps。
-------------------- ./pose:
./coco：已处理的姿态文件采用COCO JSON格式（coco JSON format），按视频片段聚合为单个数据帧。此类文件通过https://github.com/TUDelft-SPC-Lab/conflab-keypoints处的代码由原始文件转换生成。可通过以下Python代码加载：f = json.load(open('/path/to/cam2_vid3_seg1_coco.json'))
骨骼结构（肢体）信息存储于每个文件的f['categories'][0]['skeleton']中，关键点名称则存储于f['categories'][0]['keypoints']。
./raw-covfee.zip：包含连续姿态标注的原始输出结果，由covfee标注工具生成，标注帧率为60fps。
--------------------- ./f_formations:
片段2：对应/video/raw/路径下格式为x2xxx.MP4的视频，适用相机为2、4、6、8、10，时间范围为14:00及以后。
片段3：对应/video/raw/路径下格式为x3xxx.MP4的视频，适用相机为2、4、6、8、10。需注意，相机10未包含相机8已覆盖的有效主体信息与身体部位。
第一列为时间戳，第二列中，"()"用于界定群体，"<>"用于界定主体，cam X表示某一群体对应的最佳拍摄相机视角。
phone.csv：包含片段3的时间戳、对应群体以及使用手机的人员ID。