BOLT Chinese SMS/Chat

Introduction BOLT Chinese SMS/Chat was developed by the Linguistic Data Consortium (LDC) and consists of naturally-occurring Short Message Service (SMS) and Chat (CHT) data collected through data donations and live collection involving native speakers of Chinese. The corpus contains 14,877 conversations totaling 3,005,810 words across 497,543 messages. The BOLT (Broad Operational Language Translation) program developed machine translation and information retrieval for less formal genres, focusing particularly on user-generated content. LDC supported the BOLT program by collecting informal data sources -- discussion forums, text messaging and chat -- in Chinese, Egyptian Arabic and English. The collected data was translated and annotated for various tasks including word alignment, treebanking, propbanking and co-reference. Data The data in this release was collected using two methods: new collection via LDC's collection platform, and donation of SMS or chat archives from BOLT collection participants. All data collected were reviewed manually to exclude any messages/conversations that were not in the target language or that had sensitive content, such as personal identifying information (PII). All data is presented in UTF-8 XML. Acknowledgement This material is based upon work supported by the Defense Advanced Research Projects Agency (DARPA) under Contract No. HR0011-11-C-0145. The content does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred. Samples Please view this sample. Updates None at this time. Portions © 2018 Trustees of the University of Pennsylvania

### 引言
BOLT中文短信/聊天语料库由语言数据联盟（Linguistic Data Consortium, LDC）开发，其数据源自面向汉语母语者开展的数据捐赠与实地采集工作所获得的自然产生的短消息服务（Short Message Service, SMS）与聊天（Chat, CHT）文本。该语料库包含14877段对话，总计497543条消息，总字数达3005810词。
BOLT（Broad Operational Language Translation，宽域实用语言翻译）项目面向非正式文本场景开发机器翻译与信息检索技术，尤其聚焦用户生成内容。LDC为该BOLT项目采集了汉语、埃及阿拉伯语与英语三类语言的非正式数据源，包括论坛、短信与聊天文本。采集得到的数据已针对词对齐、树库句法标注、谓词论元标注与共指消解等多项任务完成翻译与标注工作。

### 数据说明
本次发布的数据采用两种采集方式：一是通过LDC专属采集平台开展的全新采集，二是由BOLT项目采集参与者捐赠的短信或聊天存档。所有采集到的数据均经过人工审核，剔除了非目标语言文本或包含敏感内容（如个人身份信息（Personal Identifying Information, PII））的消息与对话。所有数据均以UTF-8 XML格式呈现。

### 致谢说明
本材料基于美国国防高级研究计划局（Defense Advanced Research Projects Agency, DARPA）编号为HR0011-11-C-0145的合同资助项目开发而成。本内容未必代表美国政府的立场或政策，亦不应被视为获得官方背书。

### 样本
请查看本语料库附带的样本。

### 更新说明
暂无最新更新。

### 版权声明
部分内容 © 2018 宾夕法尼亚大学托管会

搜集汇总

背景与挑战

背景概述

BOLT Chinese SMS/Chat 是一个中文短信和聊天数据集，包含14,877个对话、3,005,810个词和497,543条消息，来源于数据捐赠和实时收集，以UTF-8 XML格式呈现。该数据集用于BOLT项目的机器翻译和信息检索应用，专注于非正式文本类型，并经过手动审查以确保语言准确性和内容安全。