five

Coldog2333/tiage

收藏
Hugging Face2023-10-11 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/Coldog2333/tiage
下载链接
链接失效反馈
官方服务:
资源简介:
--- license: mit language: - en tags: - dialogue segmentation size_categories: - n<1K --- # Dataset Card for SuperDialseg ## Table of Contents - [Table of Contents](#table-of-contents) - [Dataset Description](#dataset-description) - [Dataset Summary](#dataset-summary) - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards) - [Languages](#languages) - [Dataset Structure](#dataset-structure) - [Data Instances](#data-instances) - [Data Fields](#data-fields) - [Data Splits](#data-splits) - [Dataset Creation](#dataset-creation) - [Curation Rationale](#curation-rationale) - [Source Data](#source-data) - [Annotations](#annotations) - [Personal and Sensitive Information](#personal-and-sensitive-information) - [Considerations for Using the Data](#considerations-for-using-the-data) - [Social Impact of Dataset](#social-impact-of-dataset) - [Discussion of Biases](#discussion-of-biases) - [Other Known Limitations](#other-known-limitations) - [Additional Information](#additional-information) - [Dataset Curators](#dataset-curators) - [Licensing Information](#licensing-information) - [Citation Information](#citation-information) - [Contributions](#contributions) ## Dataset Description - **Homepage:** [https://github.com/HuiyuanXie/tiage](https://github.com/HuiyuanXie/tiage) - **Repository:** [https://github.com/HuiyuanXie/tiage](https://github.com/HuiyuanXie/tiage) - **Paper:** TIAGE: A Benchmark for Topic-Shift Aware Dialog Modeling - **Leaderboard:** - **Point of Contact:** ### Dataset Summary [More Information Needed] ### Supported Tasks and Leaderboards [More Information Needed] ### Languages: English ## Dataset Structure ### Data Instances ``` { "dial_data": { "tiage": [ { "dial_id": "tiage_dial_001", "turns": [ { "da": "", "role": "user", "turn_id": 0, "utterance": "hello , how are you doing tonight ?", "topic_id": 0, "segmentation_label": 0 }, ... { "da": "", "role": "user", "turn_id": 15, "utterance": "i bet it is oh i could not", "topic_id": 4, "segmentation_label": 1 } ], ... } ] } ``` ### Data Fields #### Dialogue-Level + `dial_id`: ID of a dialogue; + `turns`: All utterances of a dialogue. #### Utterance-Level + `da`: Dialogue Act annotation (here is Null); + `role`: Role annotation (here is user/agent/user/agent... in default); + `turn_id`: ID of an utterance; + `utterance`: Text of the utterance; + `topic_id`: ID (order) of the current topic; + `segmentation_label`: 1: it is the end of a topic; 0: others. ### Data Splits [More Information Needed] ## Dataset Creation ### Curation Rationale [More Information Needed] ### Source Data #### Initial Data Collection and Normalization [More Information Needed] #### Who are the source language producers? [More Information Needed] ### Annotations #### Annotation process [More Information Needed] #### Who are the annotators? [More Information Needed] ### Personal and Sensitive Information [More Information Needed] ## Considerations for Using the Data ### Social Impact of Dataset [More Information Needed] ### Discussion of Biases [More Information Needed] ### Other Known Limitations [More Information Needed] ## Additional Information ### Dataset Curators [More Information Needed] ### Licensing Information MIT ### Citation Information ``` @article{xie2021tiage, title={TIAGE: A Benchmark for Topic-Shift Aware Dialog Modeling}, author={Xie, Huiyuan and Liu, Zhenghao and Xiong, Chenyan and Liu, Zhiyuan and Copestake, Ann}, journal={arXiv preprint arXiv:2109.04562}, year={2021} } ``` ### Contributions + Thanks to [@HuiyuanXie](https://github.com/HuiyuanXie/) for collecting this dataset. + Thanks to [@Coldog2333](https://github.com/Coldog2333) for adding this dataset.
提供机构:
Coldog2333
原始信息汇总

数据集卡片 for SuperDialseg

数据集描述

数据集摘要

[更多信息需要]

支持的任务和排行榜

[更多信息需要]

语言

英语

数据集结构

数据实例

json { "dial_data": { "tiage": [ { "dial_id": "tiage_dial_001", "turns": [ { "da": "", "role": "user", "turn_id": 0, "utterance": "hello , how are you doing tonight ?", "topic_id": 0, "segmentation_label": 0 }, ... { "da": "", "role": "user", "turn_id": 15, "utterance": "i bet it is oh i could not", "topic_id": 4, "segmentation_label": 1 } ] } ] } }

数据字段

对话级别

  • dial_id: 对话的ID;
  • turns: 对话的所有话语。

话语级别

  • da: 对话行为标注(此处为空);
  • role: 角色标注(此处为默认的user/agent/user/agent...);
  • turn_id: 话语的ID;
  • utterance: 话语的文本;
  • topic_id: 当前话题的ID(顺序);
  • segmentation_label: 1: 表示话题结束;0: 其他。

数据分割

[更多信息需要]

数据集创建

策划理由

[更多信息需要]

源数据

初始数据收集和规范化

[更多信息需要]

源语言生产者是谁?

[更多信息需要]

标注

标注过程

[更多信息需要]

标注者是谁?

[更多信息需要]

个人和敏感信息

[更多信息需要]

使用数据时的考虑

数据集的社会影响

[更多信息需要]

偏见的讨论

[更多信息需要]

其他已知限制

[更多信息需要]

附加信息

数据集策展人

[更多信息需要]

许可信息

MIT

引用信息

plaintext @article{xie2021tiage, title={TIAGE: A Benchmark for Topic-Shift Aware Dialog Modeling}, author={Xie, Huiyuan and Liu, Zhenghao and Xiong, Chenyan and Liu, Zhiyuan and Copestake, Ann}, journal={arXiv preprint arXiv:2109.04562}, year={2021} }

贡献

5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作