Speech_DPOAEs

This repository contains the complete dataset from "Otoacoustic emissions evoked by the time-varying harmonic structure of speech" paper, and an example code covering the analysis method and leading to figure 3E. It contains: (1) The pure-tone and speech otoacousitc emissions (OAEs) of the 24 subjects (Recordings_1.zip; 13 subjects and out of the ear control, Recordings_2.zip; 11 remaining subjects). (2) The speech derived waveforms used to generate as well as to measure the speech-OAEs (Waveforms_Male.zip; male voice, Waveforms_Female.zip; female voice). (3) The raw speech stimuli from which the waveforms were derived and to which subjects payed attention to (Speech.zip). (4) The basic Matlab analysis code leading to the speech-OAE function (Code.zip) which includes a function for reading the recording files, the analysis pipeline and the computation of the complex cross-correlation. (5) Readme.txt file describes how to run the example code. Stimuli The speech stimuli are continuous natural speech (audiobooks) recorded by us. A male and female speaker read the same story. The audiobook is divided into 2 minutes sections (section_1 to section_28) and so are the derived harmonic waveforms, both for male and female voices. Recordings The individual recordings contain (1) the pure-tone DPOAEs (i.e. using primary frequencies of 1 kHz and 1.2 kHz, for 30 seconds) and (2) the speech-OAEs. The speech-OAEs recordings are divided into 14 sections (not to be confused with the stimuli and waveforms sections). As the paper describes, the speech-OAEs were recorded from the contralateral ear by simulating the right ear with two waveforms wm(t) and wn(t) that tracked the mth and nth harmonics of the fundamental frequency of the speech we wanted to record the speech-OAEs from, and which was simultaneously played in the left ear. The speech-OAEs were measured while the subjects listed to speech both in quiet and in noise. To this end, we employed different 2 minutes segments. Some speech segments consisted only of the male or of the female voice, while others had both voices mixed together. There was a total of 14 segments (section_1 to section_14 in individual recordings). Key information is detailed in results_details.txt files. For each subject and segment, results_details.txt, describes the recording condition. In particular, it says which gender (male or female) and speech/waveform section (1 to 28) it was used. We started by measuring speech-OAEs in quiet. To this end we employed one speech stimulus that consisted of the male voice, as well as another stimulus that contained the female voice. These correspond to section_1 and section_2, respectively. Therefore, results_details.txt files in these sections say “DPOAE gender: Male, DPOAE section: 1, Attended: one speaker”, and “DPOAE gender: Female, DPOAE section: 2, Attended: one speaker”, respectively, meaning that male, and female voices in quiet were tracked, using segments 1 and 2 from the audiobooks. The potential influence of selective attention to speech on the speech-OAES was then assessed. We therefore employed 12 segments (sections_2 to section_14 in recordings) with competing speech, that is, segments that contained both the male and the female voice. During each segment the subject was asked to attend either the female or the male speaker. Speech-OAEs related to either the male or the female speaker were measured from the contralateral ear. The order of the attentional focus, as well as the order in which speech-OAEs to the male and the female voice were measured, was determined randomly per subject. Speech_permultation.txt file describes this information, for each participant. For instance, for subject 21 this file says: “Attended: Female_ Female_ Female* Female* Male_ Male_ Male_ Male* Female* Male* Male* Female_”. It indicates that the subject was instructed to pay attention to that order of speakers along the 12 segments. The starts (*) denote that, the speech-OAEs were measured in those segments, while the underscore (_) denotes that the competing story was tracked. The attended vs ignored segments were paired. They were all played and recorded twice, once as attended and one as ignored such that we obtained three recordings of speech-OAEs to the male voice, both when that voice was attended and when it was ignored; and analogously with the female condition. To get this information, one has to look at the results_details.txt files from the individual segments. As an example, subject 21, section_5, reads “DPOAE gender: Female, DPOAE section: 5, Attended: Yes”. It means that we recorded the speech-OAEs of the female voice reading audiobook section 5, while the subject was paying attention to it. This competing speakers segment would be compared with section_9 which reads “DPOAE gender: Female, DPOAE section: 5, Attended: No”, as the same audiobook section was used but this time the attention was focused in the competing speaker. Refer to readme.txt for further clarification.本仓库包含来自论文《言语时变谐波结构诱发的耳声发射（Otoacoustic emissions evoked by the time-varying harmonic structure of speech）》的完整数据集，以及涵盖分析方法并可复现图3E的示例代码。数据集包含以下内容：(1) 24名受试者的纯音与言语诱发耳声发射（otoacoustic emissions, OAEs）数据：其中Recordings_1.zip包含13名受试者及对侧耳对照数据，Recordings_2.zip包含剩余11名受试者的数据。(2) 用于生成并测量言语诱发耳声发射（speech-OAEs）的言语衍生波形：Waveforms_Male.zip为男性语音波形，Waveforms_Female.zip为女性语音波形。(3) 衍生出上述波形的原始言语刺激素材，即受试者聆听的言语内容：Speech.zip。(4) 用于计算言语诱发耳声发射函数的基础Matlab分析代码（Code.zip），其中包含读取记录文件的函数、分析流程以及复互相关（complex cross-correlation）的计算代码。(5) Readme.txt文件说明了如何运行示例代码。刺激素材：本研究录制的连续自然言语（有声书）作为言语刺激素材。一名男性与一名女性朗读者朗读同一故事。该有声书被划分为28段2分钟的片段（section_1至section_28），男女语音的衍生谐波波形也对应划分为相同数量的片段。记录数据：单受试者记录包含两部分内容：(1) 纯音畸变产物耳声发射（distortion product otoacoustic emissions, DPOAE）数据（即使用1 kHz与1.2 kHz的主频率，录制时长30秒）；(2) 言语诱发耳声发射数据。言语诱发耳声发射记录被划分为14段（注意勿与刺激素材及波形片段混淆）。如论文所述，本研究通过模拟右耳的两个波形wm(t)与wn(t)来追踪目标言语基频的第m与第n次谐波，同时在左耳播放该波形，由此从对侧耳记录言语诱发耳声发射。受试者在安静与噪声环境下均完成了言语诱发耳声发射的测量。为此，我们使用了不同的2分钟片段。部分言语片段仅包含男性或女性语音，其余片段则混合了男女双语音频。记录中共包含14段片段（单受试者记录中的section_1至section_14）。关键细节详见results_details.txt文件。该文件针对每一名受试者与每一段记录，描述了记录条件，具体包括所使用的语音性别（男性/女性）以及言语/波形片段编号（1至28）。我们首先在安静环境下测量言语诱发耳声发射。为此，我们分别使用了仅包含男性语音与仅包含女性语音的两段刺激素材，对应section_1与section_2。因此，这些片段对应的results_details.txt文件分别标注为："DPOAE gender: Male, DPOAE section: 1, Attended: one speaker" 与 "DPOAE gender: Female, DPOAE section: 2, Attended: one speaker"，即分别使用有声书的第1、2段片段，追踪安静环境下的男性与女性语音诱发耳声发射。随后，我们评估了选择性注意对言语诱发耳声发射的潜在影响。为此，我们使用了12段包含竞争性语音的片段（单受试者记录中的section_2至section_14），即同时包含男女双语音频的片段。在每一段片段中，受试者被要求注意男性或女性朗读者的语音，由此测量对应目标语音的言语诱发耳声发射。注意焦点的顺序以及针对男女语音的言语诱发耳声发射测量顺序，均为每名受试者随机设定。Speech_permultation.txt文件记录了每名参与者的上述信息。例如，受试者21对应的文件内容为："Attended: Female_ Female_ Female* Female* Male_ Male_ Male_ Male* Female* Male* Male* Female_"。该内容表示受试者在12段片段中按照该顺序被要求注意对应朗读者：其中带星号（*）的片段表示在此期间测量了言语诱发耳声发射，下划线（_）表示此时仅追踪竞争性语音故事。注意与忽视的片段采用配对设计：所有片段均被播放并录制两次，一次为注意状态，一次为忽视状态，由此我们分别获得了男性语音被注意与被忽视时的3次言语诱发耳声发射记录，女性语音的记录设置同理。如需获取该配对信息，需查阅各片段对应的results_details.txt文件。例如，受试者21的section_5对应的文件内容为"DPOAE gender: Female, DPOAE section: 5, Attended: Yes"，即表示受试者在注意该语音的情况下，录制了女性朗读者朗读有声书第5段片段时的言语诱发耳声发射。该竞争性语音片段可与section_9的记录进行对比：后者标注为"DPOAE gender: Female, DPOAE section: 5, Attended: No"，即使用了相同的有声书片段，但此时受试者的注意力被引导至竞争性朗读者。如需进一步说明，请参阅Readme.txt文件。