Human Behavioral Reaction Collection

This dataset collects human behavioral reactions to robotic failures. This data was recorded from a user study and has been processed for anonymization. The dataset.csv contains human responses in terms of facial emotional values of the participants for the robot failures as they collaborated with a Baxter robot in a HRC task. The task details are defined in the papers:

Citation

If you use this dataset, please cite the following papers:

P. Khanna, E. Yadollahi, M. Bj¨orkman, I. Leite, and C. Smith, “Effects of explanation strategies to resolve failures in human-robot collaboration,” in IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2023, pp. 1829–1836

P. Khanna, E. Yadollahi, M. Bj¨orkman, I. Leite, and C. Smith, “User study exploring the role of explanation of failures byrobots in human robot collaboration tasks,” in The Imperfectly Relatable Robot: An interdisciplinary workshop on the role of failure in HRI, Stockholm, Sweden, Mar. 2023. [Online]. Available: https://doi.org/10.48550/arXiv.2303.16010

@misc{khanna2023userstudyexploringrole,      title={User Study Exploring the Role of Explanation of Failures by Robots in Human Robot Collaboration Tasks},       author={Parag Khanna and Elmira Yadollahi and Mårten Björkman and Iolanda Leite and Christian Smith},      year={2023},      eprint={2303.16010},      archivePrefix={arXiv},      primaryClass={cs.RO},      url={https://arxiv.org/abs/2303.16010}, }

@misc{khanna2025reflexdatasetmultimodaldataset,

      title={REFLEX Dataset: A Multimodal Dataset of Human Reactions to Robot Failures and Explanations},       author={Parag Khanna and Andreas Naoum and Elmira Yadollahi and Mårten Björkman and Christian Smith},      year={2025},      eprint={2502.14185},      archivePrefix={arXiv},      primaryClass={cs.RO},      url={https://arxiv.org/abs/2502.14185}, }