Data underlying the publication- SENS3: Multisensory Database of Finger-Surface Interactions and Corresponding Sensations

The growing demand for natural interactions with technology underscores the importance of achieving realistic touch sensations in digital environments. Realizing this goal highly depends on comprehensive databases of finger-surface interactions, which need further development. Here, we present SENS3—www.sens3.net— an extensive open-access repository of multisensory data acquired from fifty surfaces when two participants explored them with their fingertips through static contact, pressing, tapping, and sliding. SENS3 encompasses high-fidelity visual, audio, and haptic information recorded during these interactions, including videos, sounds, contact forces, torques, positions, accelerations, skin temperature, heat flux, and surface photographs. Additionally, it incorporates thirteen participants’ psychophysical sensation ratings (rough–smooth, flat–bumpy, sticky–slippery, hot–cold, regular–irregular, fine–coarse, hard–soft, and wet–dry) while exploring these surfaces freely. Designed with an open-ended framework, SENS3 has the potential to be expanded with additional textures and participants. We anticipate that SENS3 will be valuable for advancing multisensory texture rendering, user experience development, and touch sensing in robotics.<br>

随着人们对与技术实现自然交互的需求持续增长，在数字环境中营造逼真触觉感知的重要性日益凸显。而达成这一目标，高度依赖于覆盖手指与物体表面交互的全面数据库，此类数据库仍有待进一步发展完善。本研究介绍了SENS3——其官网为www.sens3.net——这一规模庞大的开放获取多感官数据集仓库：该数据集采集了50种不同表面的多感官数据，由2名参与者通过指尖以静态接触、按压、点击与滑动四种交互方式探索这些表面时获取。SENS3涵盖了此类交互过程中录制的高保真视觉、听觉与触觉信息，具体包括视频、音频、接触力、扭矩、位置、加速度、皮肤温度、热通量以及表面照片。此外，该数据集还包含13名参与者在自由探索这些表面时的心理物理感知评分，评分维度涵盖粗糙-光滑、平整-凹凸、粘性-滑腻、炎热-寒冷、规则-不规则、精细-粗糙、坚硬-柔软以及湿润-干燥。SENS3采用开放式框架设计，具备进一步扩展以纳入更多材质纹理与参与者数据的潜力。我们期望SENS3能够对多感官纹理渲染、用户体验开发以及机器人触觉感知领域的发展起到积极推动作用。