Speech_DPOAEs

This repository contains the complete dataset from <b><i>"Otoacoustic emissions evoked by the time-varying harmonic structure of speech" </i></b>paper, and an example code covering the analysis method and leading to figure 3E.<br><br>It contains:<br><b>(1)</b> The pure-tone and speech otoacousitc emissions (OAEs) of the 24 subjects (<i>Recordings_1.zip</i>; 13 subjects and out of the ear control, <i>Recordings_2.zip</i>; 11 remaining subjects).<br><b>(2)</b> The speech derived waveforms used to generate as well as to measure the speech-OAEs (<i>Waveforms_Male.zip</i>; male voice, <i>Waveforms_Female.zip</i>; female voice).<br><b>(3) </b>The raw speech stimuli from which the waveforms were derived and to which subjects payed attention to (<i>Speech.zip</i>).<br><b>(4)</b> The basic Matlab analysis code leading to the speech-OAE function (<i>Code.zip</i>) which includes a function for reading the recording files, the analysis pipeline and the computation of the complex cross-correlation.<br><b>(5)</b> <i>Readme.txt </i>file describes how to run the example code.<br><br>Stimuli<br>The speech stimuli are continuous natural speech (audiobooks) recorded by us. A male and female speaker read the same story. The audiobook is divided into 2 minutes sections (section_1 to section_28) and so are the derived harmonic waveforms, both for male and female voices.<br><br>Recordings<br>The individual recordings contain (1) the pure-tone DPOAEs (<i>i.e.</i> using primary frequencies of 1 kHz and 1.2 kHz, for 30 seconds) and (2) the speech-OAEs. The speech-OAEs recordings are divided into 14 sections (not to be confused with the stimuli and waveforms sections). As the paper describes, the speech-OAEs were recorded from the contralateral ear by simulating the right ear with two waveforms w_m(t) and w_n(t) that tracked the m^thand n^th harmonics of the fundamental frequency of the speech we wanted to record the speech-OAEs from, and which was simultaneously played in the left ear. The speech-OAEs were measured while the subjects listed to speech both in quiet and in noise. To this end, we employed different 2 minutes segments. Some speech segments consisted only of the male or of the female voice, while others had both voices mixed together. There was a total of 14 segments (section_1 to section_14 in individual recordings). Key information is detailed in <i>results_details.txt</i> files. For each subject and segment, <i>results_details.txt</i>, describes the recording condition. In particular, it says which gender (male or female) and speech/waveform section (1 to 28) it was used. We started by measuring <b>speech-OAEs in quiet.</b> To this end we employed one speech stimulus that consisted of the male voice, as well as another stimulus that contained the female voice. These correspond to section_1 and section_2, respectively. Therefore, <i>results_details.txt</i> files in these sections say <i>“DPOAE gender: Male, DPOAE section: 1, Attended: one speaker”</i>, and <i>“DPOAE gender: Female, DPOAE section: 2, Attended: one speaker”</i>, respectively, meaning that male, and female voices in quiet were tracked, using segments 1 and 2 from the audiobooks. The potential influence of <b>selective attention</b> to speech on the speech-OAES was then assessed. We therefore employed 12 segments (sections_2 to section_14 in recordings) with competing speech, that is, segments that contained both the male and the female voice. During each segment the subject was asked to attend either the female or the male speaker. Speech-OAEs related to either the male or the female speaker were measured from the contralateral ear. The order of the attentional focus, as well as the order in which speech-OAEs to the male and the female voice were measured, was determined randomly per subject. <i>Speech_permultation.txt</i> file describes this information, for each participant. For instance, for subject 21 this file says: <i>“Attended: Female_ Female_ Female* Female* Male_ Male_ Male_ Male* Female* Male* Male* Female_”</i>. It indicates that the subject was instructed to pay attention to that order of speakers along the 12 segments. The starts (*) denote that, the speech-OAEs were measured in those segments, while the underscore (_) denotes that the competing story was tracked. The attended vs ignored segments were paired. They were all played and recorded twice, once as attended and one as ignored such that we obtained three recordings of speech-OAEs to the male voice, both when that voice was attended and when it was ignored; and analogously with the female condition. To get this information, one has to look at the <i>results_details.txt</i> files from the individual segments. As an example, subject 21, section_5, reads <i>“DPOAE gender: Female, DPOAE section: 5, Attended: Yes”</i>. It means that we recorded the speech-OAEs of the female voice reading audiobook section 5, while the subject was paying attention to it. This competing speakers segment would be compared with section_9 which reads<i> “DPOAE gender: Female, DPOAE section: 5, Attended: No”</i>, as the same audiobook section was used but this time the attention was focused in the competing speaker. Refer to <i>readme.txt</i> for further clarification.

本代码仓库包含论文《由言语时变谐波结构诱发的耳声发射》（Otoacoustic emissions evoked by the time-varying harmonic structure of speech）的完整数据集，以及涵盖分析方法并可复现图3E的示例代码。

其包含以下内容：
(1) 24名受试者的纯音诱发耳声发射与言语诱发耳声发射（otoacoustic emissions, OAEs）：其中<Recordings_1.zip>包含13名受试者及对侧耳对照数据，<Recordings_2.zip>包含剩余11名受试者的数据。
(2) 用于生成并测量言语诱发耳声发射的言语衍生波形：<Waveforms_Male.zip>包含男性语音波形，<Waveforms_Female.zip>包含女性语音波形。
(3) 用于衍生上述波形且为受试者所聆听的原始言语刺激素材，存储于<Speech.zip>。
(4) 用于实现言语诱发耳声发射分析函数的基础Matlab分析代码（<Code.zip>），其中包含读取记录文件的函数、完整分析流程以及复值互相关的计算模块。
(5) <Readme.txt>文件详细说明了示例代码的运行方法。

### 刺激材料
本研究的言语刺激素材为我们录制的连续自然言语（有声书），由一名男性与一名女性朗读者诵读同一篇故事。该有声书被划分为28个2分钟时长的片段（section_1至section_28），男女语音的衍生谐波波形同样被划分为对应数量的片段。

### 记录数据
单份记录数据包含两部分：(1) 纯音诱发畸变产物耳声发射（DPOAEs），即使用1 kHz与1.2 kHz的基频进行30秒采集的数据；(2) 言语诱发耳声发射。
言语诱发耳声发射的记录被划分为14个片段（请勿与刺激素材及波形片段混淆）。正如论文所述，本研究通过模拟右耳的两个波形w_m(t)与w_n(t)，分别追踪目标言语基频的第m与第n次谐波，同时在左耳播放该波形，从而从对侧耳采集言语诱发耳声发射。
受试者在安静环境与噪声环境下均聆听言语时，我们对言语诱发耳声发射进行了测量。为此我们采用了不同的2分钟时长片段：部分片段仅包含男性或女性语音，其余片段则包含混合的男女双语音频。单份记录数据中共包含14个片段（section_1至section_14），详细信息记录于<results_details.txt>文件中。

对于每名受试者与每个片段，<results_details.txt>均会说明该次记录的具体条件，包括所使用的语音性别（男性/女性）以及言语/波形片段编号（1至28）。我们首先测量**安静环境下的言语诱发耳声发射**：为此我们分别采用了仅包含男性语音与仅包含女性语音的两段刺激素材，对应记录片段section_1与section_2。因此这两个片段的<results_details.txt>文件分别标注为"DPOAE gender: Male, DPOAE section: 1, Attended: one speaker"与"DPOAE gender: Female, DPOAE section: 2, Attended: one speaker"，即分别使用有声书片段1与片段2的语音，追踪安静环境下的男性与女性语音诱发的耳声发射。

随后我们评估了**言语选择性注意**对言语诱发耳声发射的潜在影响。为此我们采用了12个包含竞争性言语的片段（记录数据中的section_2至section_14），即同时包含男女双语音频的片段。在每个片段中，受试者被要求专注于男性或女性朗读者之一，我们从对侧耳采集对应目标语音的言语诱发耳声发射。每名受试者的注意焦点顺序以及男女语音的测量顺序均为随机设定。<Speech_permultation.txt>文件记录了每名参与者的相关信息。例如受试者21的该文件内容为："Attended: Female_ Female_ Female* Female* Male_ Male_ Male_ Male* Female* Male* Male* Female_"，该内容指示受试者在12个片段中需要遵循的注意顺序：其中带星号（*）的片段表示该段中采集了对应语音的言语诱发耳声发射，下划线（_）表示该段仅播放竞争性故事音频。

注意与忽略的片段被两两配对：所有片段均被播放并记录两次，一次为专注目标语音，一次为忽略目标语音，最终我们分别获得了目标语音为男性（无论该语音被专注或忽略）与女性时的3份言语诱发耳声发射记录。相关信息可通过各片段的<results_details.txt>文件获取。例如受试者21的section_5的记录为"DPOAE gender: Female, DPOAE section: 5, Attended: Yes"，即表示当受试者专注于该语音时，我们采集了诵读有声书片段5的女性语音诱发的耳声发射。该竞争性片段可与section_9的记录进行对比，后者标注为"DPOAE gender: Female, DPOAE section: 5, Attended: No"，即使用了相同的有声书片段，但此时受试者的注意力被分配给了竞争性朗读者。更多细节请参阅<readme.txt>。