Adults' Production of Speech (Optotrak Recordings)

This data set contains Optotrak, audio-visual as well as audio recordings of adult native speakers of Mandarin and Thai producing syllables with all their tones in both syllable and sentential context in 3 different conditions - normal speech, whispered speech and Lombard speech (noise level: 75 dB). There are 2,160 syllables and 2,160 sentences from 12 Mandarin speakers, and 1,800 syllables and 1,800 sentences from 6 Thai speakers. Optotrak raw data files are in .nrw and .nor format and data files are in .n3d, .nco, and .nov format and can be viewed using NDI First Principles or NDI DataView programs. Audio-visual videos are in .avi and audio files are in .wav format which can be viewed via most media players. Optotrak file size varies from 20 KB to5 MB depending on file type. The size for each audio file is approximately 340 to 650 MB depending on the language. Video file size is approximately 14 to 20 GB depending on the total testing time. Optotrak recordings used Northern Digital Inc./NDI Optotrak 3020 cameras with NDI Optotrak system control Unit and NDI Optotrak Data Acquisition Unit II running on a Window XP OS computer. Audio-visual video recordings used Adobe Premiere Pro 2.0 software running on Lenovo ThinkPad T500 laptop and Sony HVR-V1P HDV video camera. Audio recordings used Audacity program running on Lenovo ThinkPad T500 laptop.

本数据集包含Optotrak系统（Optotrak）、音视频及音频录制数据，采集对象为成年普通话母语者与泰语母语者，录制场景涵盖单音节语境与语句语境，录制内容为包含全部声调的音节，共设置三种录制工况：正常语音、耳语语音与隆德语音（Lombard speech），背景噪音水平为75分贝。12名普通话母语者共录制2160个音节与2160句语句；6名泰语母语者共录制1800个音节与1800句语句。Optotrak原始数据文件格式为.nrw与.nor，标准数据文件格式为.n3d、.nco及.nov，可通过NDI First Principles或NDI DataView程序查看。音视频文件格式为.avi，音频文件格式为.wav，可通过绝大多数主流媒体播放器播放。Optotrak文件大小因文件类型不同，介于20 KB至5 MB之间；单条音频文件大小约为340 MB至650 MB，因录制语言不同存在差异；视频文件大小约为14 GB至20 GB，因总测试时长不同存在差异。本次Optotrak数据录制采用北方数字公司（Northern Digital Inc.，简称NDI）的Optotrak 3020摄像头，搭配NDI Optotrak系统控制单元与NDI Optotrak数据采集单元II，运行于搭载Windows XP操作系统的计算机。音视频录制采用运行于联想ThinkPad T500笔记本电脑上的Adobe Premiere Pro 2.0软件，搭配Sony HVR-V1P HDV摄像机完成。音频录制采用运行于联想ThinkPad T500笔记本电脑上的Audacity软件完成。