hiraki/candor-turntaking-annotations

--- language: - en license: cc-by-4.0 task_categories: - automatic-speech-recognition tags: - speech - transcription - conversation - turn-taking - candor - canary size_categories: - 100K<n<1M dataset_info: features: - name: audio_filename dtype: string - name: offset dtype: float64 - name: duration dtype: float64 - name: segment_id dtype: string - name: conversation_id dtype: string - name: channel dtype: string - name: text dtype: string - name: model dtype: string - name: alignment_mean_prob dtype: float64 - name: tt_label dtype: string - name: tt_confidence dtype: float64 - name: llm_label dtype: string - name: llm_confidence dtype: float64 - name: llm_rationale dtype: string - name: final_tag dtype: string - name: accepted dtype: bool - name: accept_reason dtype: string - name: reject_reason dtype: string splits: - name: train num_examples: 172591 download_size: 12900000 dataset_size: 172591 configs: - config_name: default data_files: - split: train path: data/train-* --- # CANDOR - Turn-Taking Annotations Speech transcription and turn-taking annotation dataset built from the [CANDOR corpus](https://github.com/CANDORcorpus/candor-corpus) using **NVIDIA Canary-Qwen2.5B** ASR. ## Dataset Description This dataset contains **172,591 transcribed speech segments** from the CANDOR conversational speech corpus (1,656 conversations). Each segment is a per-speaker utterance with Canary ASR transcript, designed for turn-taking prediction research. ### Source - **Audio corpus**: [CANDOR](https://github.com/CANDORcorpus/candor-corpus) (English conversational speech, 1,656 conversations) - **ASR model**: NVIDIA Canary-Qwen2.5B (`canary-qwen-2.5b`) - **Audio format**: Per-speaker mono WAV (16kHz), extracted from stereo MP3 ## Dataset Structure | Column | Type | Description | |--------|------|-------------| | `audio_filename` | string | Per-speaker WAV filename (e.g., `{uuid}_L.wav`) | | `offset` | float | Start time within the audio file (seconds) | | `duration` | float | Duration of the segment (seconds) | | `segment_id` | string | Unique segment identifier | | `conversation_id` | string | CANDOR conversation UUID | | `channel` | string | Speaker channel (`L` or `R`) | | `text` | string | Canary ASR transcript | | `model` | string | ASR model (`canary-qwen-2.5b`) | | `alignment_mean_prob` | float | Parakeet CTC forced alignment score (to be added) | | `tt_label` | string | TEN turn-taking label: finished/unfinished/wait (to be added) | | `tt_confidence` | float | TEN confidence (3-way softmax) (to be added) | | `llm_label` | string | LLM label: COMPLETE/INCOMPLETE/BACKCHANNEL (to be added) | | `llm_confidence` | float | LLM confidence (to be added) | | `llm_rationale` | string | LLM reasoning (to be added) | | `final_tag` | string | Cross-annotation consensus label (to be added) | | `accepted` | bool | Whether segment passed all quality gates (to be added) | | `accept_reason` | string | Reason for acceptance (to be added) | | `reject_reason` | string | Reason for rejection (to be added) | ### Annotation Pipeline (in progress) Annotations are being added incrementally: 1. **Parakeet CTC forced alignment** → `alignment_mean_prob` 2. **TEN turn-taking model** → `tt_label`, `tt_confidence` 3. **LLM annotation (Qwen2.5-32B)** → `llm_label`, `llm_confidence`, `llm_rationale` 4. **Cross-annotation** → `final_tag`, `accepted` (requires tt_confidence >= 0.9, alignment_mean_prob >= 0.9) ## Statistics - **Total segments**: 172,591 - **Conversations**: 1,656 - **Segments with text**: 165,925 (96.1%) - **Mean duration**: 7.6s ## Intended Use This dataset is intended for research on: - Turn-taking prediction and modeling - Conversational speech recognition - Backchannel detection ## Related Datasets - [hiraki/seamless-interact-canary-transcripts](https://huggingface.co/datasets/hiraki/seamless-interact-canary-transcripts) — Same pipeline applied to Seamless Interact corpus (2.78M segments) ## License CC-BY-4.0 (following the CANDOR corpus license).language: - 英语 license: CC-BY-4.0 task_categories: - 自动语音识别（automatic-speech-recognition） tags: - 语音 - 转录 - 对话 - 轮流发言 - CANDOR - Canary size_categories: - 10万<n<100万 dataset_info: features: - name: audio_filename dtype: 字符串 - name: offset dtype: 64位浮点数 - name: duration dtype: 64位浮点数 - name: segment_id dtype: 字符串 - name: conversation_id dtype: 字符串 - name: channel dtype: 字符串 - name: text dtype: 字符串 - name: model dtype: 字符串 - name: alignment_mean_prob dtype: 64位浮点数 - name: tt_label dtype: 字符串 - name: tt_confidence dtype: 64位浮点数 - name: llm_label dtype: 字符串 - name: llm_confidence dtype: 64位浮点数 - name: llm_rationale dtype: 字符串 - name: final_tag dtype: 字符串 - name: accepted dtype: 布尔值 - name: accept_reason dtype: 字符串 - name: reject_reason dtype: 字符串 splits: - name: train num_examples: 172591 download_size: 12900000 dataset_size: 172591 configs: - config_name: default data_files: - split: train path: data/train-* # CANDOR——轮流发言标注数据集 基于[CANDOR语料库（CANDOR corpus）](https://github.com/CANDORcorpus/candor-corpus)构建，使用**NVIDIA Canary-Qwen2.5B**自动语音识别（Automatic Speech Recognition, ASR）模型生成，包含语音转录与轮流发言标注。 ## 数据集说明 本数据集包含来自CANDOR对话语音语料库的**172,591条转录语音片段**，共涵盖1,656场对话。每条片段为单说话人话语，均附带Canary ASR转录结果，专为轮流发言预测研究设计。 ### 数据来源 - **语音语料库**：[CANDOR语料库（CANDOR corpus）](https://github.com/CANDORcorpus/candor-corpus)（英语对话语音，共1,656场对话） - **ASR模型**：NVIDIA Canary-Qwen2.5B（`canary-qwen-2.5b`） - **音频格式**：单声道WAV格式（16kHz），从立体声音频MP3中提取得到。 ## 数据集结构 | 列名 | 数据类型 | 说明 | |--------|------|-------------| | `audio_filename` | 字符串 | 单说话人WAV文件名（例如：`{uuid}_L.wav`） | | `offset` | 64位浮点数 | 音频文件内的起始时间（单位：秒） | | `duration` | 64位浮点数 | 片段时长（单位：秒） | | `segment_id` | 字符串 | 唯一片段标识符 | | `conversation_id` | 字符串 | CANDOR对话UUID | | `channel` | 字符串 | 说话人声道（`L`或`R`） | | `text` | 字符串 | Canary ASR转录文本 | | `model` | 字符串 | ASR模型（`canary-qwen-2.5b`） | | `alignment_mean_prob` | 64位浮点数 | Parakeet CTC强制对齐得分（待补充） | | `tt_label` | 字符串 | TEN轮流发言标签：已完成/未完成/等待中（待补充） | | `tt_confidence` | 64位浮点数 | TEN置信度（3分类softmax结果）（待补充） | | `llm_label` | 字符串 | 大语言模型（Large Language Model, LLM）标签：COMPLETE/INCOMPLETE/BACKCHANNEL（待补充） | | `llm_confidence` | 64位浮点数 | 大语言模型置信度（待补充） | | `llm_rationale` | 字符串 | 大语言模型推理依据（待补充） | | `final_tag` | 字符串 | 跨标注共识标签（待补充） | | `accepted` | 布尔值 | 该片段是否通过所有质量校验（待补充） | | `accept_reason` | 字符串 | 接受该片段的原因（待补充） | | `reject_reason` | 字符串 | 拒绝该片段的原因（待补充） | ### 标注流程（开发中） 标注内容将逐步追加： 1. **Parakeet CTC强制对齐** → 对应字段`alignment_mean_prob` 2. **TEN轮流发言模型** → 对应字段`tt_label`、`tt_confidence` 3. **大语言模型标注（Qwen2.5-32B）** → 对应字段`llm_label`、`llm_confidence`、`llm_rationale` 4. **跨标注审核** → 对应字段`final_tag`、`accepted`（需满足`tt_confidence ≥ 0.9`且`alignment_mean_prob ≥ 0.9`） ## 数据统计 - **总片段数**：172,591 - **对话场数**：1,656 - **带转录文本的片段数**：165,925（占比96.1%） - **平均片段时长**：7.6秒 ## 预期用途 本数据集适用于以下方向的研究： - 轮流发言预测与建模 - 对话语音识别 - 反馈语检测 ## 相关数据集 - [hiraki/seamless-interact-canary-transcripts](https://huggingface.co/datasets/hiraki/seamless-interact-canary-transcripts) — 相同流程应用于Seamless Interact语料库（共278万条片段） ## 许可证 CC-BY-4.0（遵循CANDOR语料库的许可证协议）。