topicsum

# Dataset Card for TopicSum Corpus [Single Dataset Comprising of XSUM & DialogSUM for One Liner Summarization/ Topic Generation of Text]
## Dataset Description
### Links
- **DialogSUM:** https://github.com/cylnlp/dialogsum
- **XSUM:** https://huggingface.co/datasets/knkarthick/xsum
- **Point of Contact:** https://huggingface.co/knkarthick

### Dataset Summary
TopicSUM is collection of large-scale dialogue summarization dataset from XSUM & DialogSUM, consisting of 241,171 dialogues with corresponding manually labeled one-liner summaries/ topics.
### Languages
English

## Dataset Structure
### Data Instances
TopicSum is a large-scale dialogue summarization dataset collection [XSUM & DialogDUM], consisting of 241,171 dialogues split into train, test and validation.

The first instance in the training set:
{'dialogue': 'The full cost of damage in Newton Stewart, one of the areas worst affected, is still being assessed.\nRepair work is ongoing in Hawick and many roads in Peeblesshire remain badly affected by standing water.\nTrains on the west coast mainline face disruption due to damage at the Lamington Viaduct.\nMany businesses and householders were affected by flooding in Newton Stewart after the River Cree overflowed into the town.\nFirst Minister Nicola Sturgeon visited the area to inspect the damage.\nThe waters breached a retaining wall, flooding many commercial properties on Victoria Street - the main shopping thoroughfare.\nJeanette Tate, who owns the Cinnamon Cafe which was badly affected, said she could not fault the multi-agency response once the flood hit.\nHowever, she said more preventative work could have been carried out to ensure the retaining wall did not fail.\n"It is difficult but I do think there is so much publicity for Dumfries and the Nith - and I totally appreciate that - but it is almost like we\'re neglected or forgotten," she said.\n"That may not be true but it is perhaps my perspective over the last few days.\n"Why were you not ready to help us a bit more when the warning and the alarm alerts had gone out?"\nMeanwhile, a flood alert remains in place across the Borders because of the constant rain.\nPeebles was badly hit by problems, sparking calls to introduce more defences in the area.\nScottish Borders Council has put a list on its website of the roads worst affected and drivers have been urged not to ignore closure signs.\nThe Labour Party\'s deputy Scottish leader Alex Rowley was in Hawick on Monday to see the situation first hand.\nHe said it was important to get the flood protection plan right but backed calls to speed up the process.\n"I was quite taken aback by the amount of damage that has been done," he said.\n"Obviously it is heart-breaking for people who have been forced out of their homes and the impact on businesses."\nHe said it was important that "immediate steps" were taken to protect the areas most vulnerable and a clear timetable put in place for flood prevention plans.\nHave you been affected by flooding in Dumfries and Galloway or the Borders? Tell us about your experience of the situation and how it was handled. Email us on [e-mail] or [e-mail].', 'summary': 'Clean-up operations are continuing across the Scottish Borders and Dumfries and Galloway after flooding caused by Storm Frank.',
'id': '35232142'}

### Data Fields
- dialogue: text of dialogue.
- summary: human written one-liner summary/ topic of the dialogue.
- id: unique file id of an example.

### Data Splits
- train: 216,505
- val: 11,832
- test: 12,834

## Dataset Creation
### Curation Rationale
Collection of XSUM & DialogSUM Datasets.
### Who are the source language producers?
linguists
### Who are the annotators?
language experts

## Licensing Information
non-commercial licence: MIT
## Citation Information
Refer the above links for Credits & Citations.

# TopicSum 语料库数据集卡片 [单数据集整合XSUM与DialogSUM，用于文本单行摘要生成/主题生成任务]
## 数据集说明
### 相关链接
- **DialogSUM（DialogSUM）**：https://github.com/cylnlp/dialogsum
- **XSUM（XSUM）**：https://huggingface.co/datasets/knkarthick/xsum
- **联络人**：https://huggingface.co/knkarthick

### 数据集概述
TopicSUM 是由 XSUM 与 DialogSUM 整合而成的大规模对话摘要数据集，包含241,171条对话及对应的人工标注单行摘要/主题。

### 语言
英语

## 数据集结构
### 数据实例
TopicSum 是涵盖 XSUM 与 DialogSUM 的大规模对话摘要数据集集合，包含241,171条对话，划分为训练集、验证集与测试集。

训练集的首个示例如下：
{
'dialogue': '苏格兰受灾最严重的地区之一牛顿斯图尔特的全部损失成本仍在评估中。
霍伊克的修复工作正在进行，皮布尔斯郡的多条道路仍因积水受到严重影响。
由于拉明顿高架桥受损，西海岸干线的列车面临延误。
因克里河泛滥涌入城镇，牛顿斯图尔特的众多企业和住户受到洪水影响。
苏格兰首席大臣尼古拉·斯特金前往该地区视察灾情。
河水冲垮了一道护墙，淹没了维多利亚街的多处商业建筑——这是主要的购物商业街。
受影响严重的肉桂咖啡馆店主珍妮特·塔特表示，洪水过后的多机构应对措施无可指摘。
但她也表示，本可以开展更多预防性工作以确保护墙不被冲垮。
"情况很艰难，但我确实认为，邓弗里斯和尼思获得了如此多的关注——我完全理解这一点——但我们几乎像是被忽视或遗忘了，"她说道。
"这或许并非事实，但这可能是我过去几天的感受。
"为什么当预警和警报发出时，你们不能多提供一些帮助？"
与此同时，由于持续降雨，边境地区仍处于洪水预警状态。
皮布尔斯遭受了严重的洪涝灾害，引发了在该地区引入更多防洪设施的呼吁。
苏格兰边境委员会在其网站上列出了受灾最严重的道路名单，并敦促司机切勿忽视封闭标志。
工党苏格兰副领袖亚历克斯·罗利周一前往霍伊克实地查看情况。
他表示，制定合适的防洪计划至关重要，但支持加快该进程的呼吁。
"我对造成的破坏程度感到相当震惊，"他说道。
"对于被迫流离失所的民众和对企业造成的影响，这显然令人心碎。"
他表示，采取"紧急措施"保护最脆弱地区，并为防洪计划制定明确的时间表至关重要。
您是否在邓弗里斯和加洛韦或边境地区受到洪水影响？请向我们分享您对此次灾情及应对措施的经历。请发送邮件至 [e-mail] 或 [e-mail]。',
'summary': '弗兰克风暴引发洪水后，苏格兰边境地区与邓弗里斯和加洛韦的清理工作仍在继续。',
'id': '35232142'
}

### 数据字段
- dialogue：对话文本
- summary：人工撰写的对话单行摘要/主题
- id：单个示例的唯一文件标识

### 数据划分
- 训练集（train）：216,505条
- 验证集（val）：11,832条
- 测试集（test）：12,834条

## 数据集构建
### 构建初衷
整合 XSUM 与 DialogSUM 数据集。
### 源语言生成者
语言学家
### 标注人员
语言专家

## 许可信息
非商业许可：MIT 协议

## 引用信息
相关致谢与引用请参阅上述链接。