NeuMa (Raw): A multimodal Neuromarketing dataset

A novel multimodal Neuromarketing dataset that encompasses the data from 42 individuals who participated in an advertising brochure-browsing scenario is introduced here. In more detail, participants were exposed to a series of supermarket brochures (containing various products) and instructed to select the products they intended to buy. The data collected for each individual executing this protocol included: (i) encephalographic (EEG) recordings, (ii) eye tracking (ET) recordings, (iii) questionnaire responses (demographic, profiling and product related questions), and (iv) computer mouse data. <br> <strong>The preprocessed version of this dataset can be found here: </strong>https://figshare.com/articles/dataset/NeuMa_PreProcessed_A_multimodal_Neuromarketing_dataset/22117124 <strong>Experimental Protocol</strong> The experimental paradigm simulated the browsing experience of a digital advertising brochure, where the participants had to select the products they intended to buy. The paradigm was designed accordingly so as to monitor the subject’s brain and ocular activity throughout the browsing experience, with the original scope being the identification of distinct brain and ocular activity patterns with respect to selected (i.e. intended to buy) and non selected products. Aiming to mimic this experience in a realistic way, the participants were instructed to select the products (using a computer mouse to click on them) they intended to buy in accordance to their regular buying habits, without having any global restrictions with respect to either the cost or the total number of products bought. During the experimental procedure, participants were seated in a comfortable armchair placed 50 cm from a 28 inch LCD monitor. Prior to the product presentation, resting state EEG was recorded for two minutes. Once the recording of resting state was completed, participants could freely browse among the provided brochures by pressing the keyboard’s left and right arrow to move forwards and backwards respectively. In total 6 brochures were provided. Each page encompassed a total number of 24 different supermarket products that belonged to the same product category (e.g. the first collection included dairy products, the second frozen products, etc.). During this task the participants were instructed to identify and select (by left clicking on) the products they intended to buy.Once the browsing/product selection experience was completed (ended by each participant on his/her own time), each participant was asked to fill in a questionnaire. The questionnaire included demographic questions (e.g. age, marital status, education, etc.), profiling questions (e.g. the big five personality traits, impulsive buying behaviour, etc.) and specific questions related to each of the selected products (i.e. reasons of selection, familiarity towards the selected product and whether the selected product constitutes a frequent purchase or not). <strong>Participant Demographics</strong> A total of 45 individuals participated in this study. However, the dataset in its final form includes 42 subjects (23 males and 19 females, aged 31.5 ± 8.84), denoted as S01, S02, …, S42, as the data from three subjects were excluded due to high levels of artifactual contamination. <strong>Acquisition setup</strong> The raw data was recorded using Wearable Sensing’s DSI 24 and Tobii Pro Fusion for the EEG and ET data respectively. The brain activity was recorded, with a sampling frequency of 300Hz, via 21 dry sensors, namely Fp1, Fp2, Fz, F3, F4, F7, F8, Cz, C3, C4, T7/T3, T8/T4, Pz, P3, P4, P7/T5, P8/T6, O1, O2, A1 and A2, that were placed at locations corresponding to the 10-20 International System. The Sensors A1 and A2 were the reference electrodes and were placed on the mastoids. Prior to the experimental procedure, impedance for all electrodes was set below 10KΩ and EEG signals were inspected to avoid any irregularities. The gaze data was recorded via Tobii’s screen based solution, with the eye movements being captured at a sampling frequency of 120Hz. Prior to initiation of the experimental procedure, a 9-point calibration was performed for each subject, using the Tobii Pro SDK, to formulate the individual’s eye model and gaze point.

本数据集为一款新型多模态神经营销（Neuromarketing）数据集，收录了42名参与广告宣传册浏览任务的受试者的各类数据。具体而言，受试者需浏览一系列包含各类商品的超市宣传册，并从中选择自身计划购买的商品。针对完成本实验流程的每名受试者，采集的数据包括：(i) 脑电（EEG）记录数据；(ii) 眼动（ET）记录数据；(iii) 问卷作答数据（涵盖人口统计学、人格画像及商品相关问题）；(iv) 电脑鼠标操作数据。
<strong>该数据集的预处理版本可通过以下链接获取：</strong>https://figshare.com/articles/dataset/NeuMa_PreProcessed_A_multimodal_Neuromarketing_dataset/22117124 <strong>实验流程</strong>
本实验范式模拟了数字化广告宣传册的浏览体验，要求受试者从中选择计划购买的商品。该范式的设计目标为在浏览过程中监测受试者的脑活动与眼动活动，核心初衷是识别与已选（即计划购买）及未选商品对应的特异性脑活动与眼动活动模式。
为尽可能还原真实购物场景，受试者需依据自身日常购物习惯，通过电脑鼠标点击选中计划购买的商品，且未设置购买总金额或商品总数的全局限制。
实验过程中，受试者坐在距离28英寸液晶显示器50厘米处的舒适扶手椅上。商品展示前，需先采集2分钟的静息态脑电数据。静息态数据采集完成后，受试者可通过键盘左右箭头键分别向前或向后翻页，自由浏览提供的宣传册。本次实验共提供6份宣传册，每一页包含24款隶属于同一商品类别的超市商品（例如第一组为乳制品，第二组为冷冻食品等）。在此任务阶段，受试者需识别并通过左键点击选中自身计划购买的商品。
浏览与商品选择任务完成后（由受试者自行终止任务），每名受试者需填写一份问卷。问卷内容包括人口统计学问题（如年龄、婚姻状况、受教育程度等）、人格画像问题（如大五人格特质、冲动性购买行为等），以及与每名选中商品相关的具体问题（即选择该商品的原因、对选中商品的熟悉程度，以及该商品是否为高频购买商品）。
<strong>受试者人口统计学特征</strong>
本研究共招募45名受试者参与，但最终数据集仅包含42名受试者的数据（23名男性，19名女性，年龄均值±标准差为31.5±8.84），编号依次为S01、S02……S42。剩余3名受试者的数据因存在严重的伪迹污染被剔除。
<strong>数据采集装置</strong>
原始脑电与眼动数据分别通过Wearable Sensing公司的DSI 24设备与Tobii Pro Fusion设备采集。脑电活动通过21个干电极传感器采集，采样频率为300Hz，传感器位置符合国际10-20系统标准，具体包括Fp1、Fp2、Fz、F3、F4、F7、F8、Cz、C3、C4、T7/T3、T8/T4、Pz、P3、P4、P7/T5、P8/T6、O1、O2、A1及A2。其中A1与A2为参考电极，放置于乳突位置。实验开始前，需将所有电极的阻抗设置为10kΩ以下，并检查脑电信号以排除异常情况。眼动数据通过Tobii的屏幕式采集方案记录，眼动信号的采样频率为120Hz。实验正式开始前，每名受试者需使用Tobii Pro SDK完成9点校准，以建立个体眼部模型与注视点映射关系。