ACL/DCI

ACL Data Collection Initiative contains text from the Wall Street Journal, the Collins English Dictionary, scientific abstracts provided by the U.S. Department of Energy and a variety of grammatically tagged and parsed materials from the Treebank project at the University of Pennsylvania. The total amount of uncompressed text is 620 Mbytes. The many formats of the original texts have been mapped into a markup language consistent with the SGML standard (ISO 8879). The format of the material from the Wall Street Journal uses a labelled bracketing, expressed in the style of SGML, although no formal SGML DTD is provided. The tag set has been modified by turning the Dow Jones header categories into tags and by creating ad hoc tags such as "". The original datelines are presented as separate text units; the text is divided and tagged into paragraphs and sentences with each sentence presented on a single line. Nothing has been done to modify the typographical methods used to subdivide headlines and stories into sections, nor are any of the text features within sentences (quotes, ellipsis, etc.) normalized. The Collins English Dictionary is present in two forms. One form was approximately parsed into fielded records as an exercise in learning a language called "FIT", by a student working under the direction of Lloyd Nakatani at ATT Bell Laboratories during the summer of 1990. The original digital image of the typographer's tape that the database version was prepared from had serious flaws that were not detected and corrected until later; the corrected version, a clean typographer's tape, is presented in a separate directory. A properly-analyzed database version will be provided in the future. The documentation includes notes developed during the new attempt to analyze the tape from scratch. The Department of Energy abstracts reside in files that are approximately one megabyte each. The original 950 separators have been replaced with newlines and space padding between articles was removed. An acronym dictionary that was extracted from the database as an indication of the material's topic areas has been included in a separate directory. Provisional material from the Penn Treebank project is divided into two subdirectories on this disk. The subdirectory "postext" contains text with part-of-speech annotations; "parstext" contains text with syntactic bracketing. Portions © 1987-1989 Dow Jones & Company, Inc., © 1979 William Collins Sons Co., Ltd., © 1990, 1991, 1993 Trustees of the University of Pennsylvania

ACL数据集采集项目（ACL Data Collection Initiative）包含《华尔街日报》文本、柯林斯英语词典文本、美国能源部提供的科学摘要，以及宾夕法尼亚大学Treebank语料库项目（Treebank Project）产出的各类语法标注与句法解析材料。未压缩文本总体量达620兆字节。
原始文本的多种格式已被映射为符合标准通用标记语言（Standard Generalized Markup Language，SGML）标准（ISO 8879）的标记语言。尽管未提供正式的SGML文档类型定义（Document Type Definition，DTD），但《华尔街日报》的文本材料采用了SGML风格的带标注括号格式。标注集已通过将道琼斯（Dow Jones）页眉类别转换为标注项，以及创建诸如""这类临时自定义标注得到修订。原始的电头文本被作为独立文本单元保留；文本已被拆分并标注为段落与句子，且每个句子单独占一行。未对用于将标题与报道拆分为板块的排版格式进行任何修改，句内的文本特征（如引号、省略号等）也未做标准化处理。
柯林斯英语词典包含两种版本。1990年夏季，AT&T贝尔实验室（AT&T Bell Laboratories）的劳埃德·中谷（Lloyd Nakatani）指导下的一名学生，为学习名为"FIT"的编程语言，将该词典的一个版本初步解析为带字段的记录格式。用于生成该数据库版本的原始排版胶带数字镜像存在严重缺陷，直至后续阶段才被检测并修复；修复后的干净排版胶带版本被置于单独的目录中。未来将发布经过完整解析的数据库版本。本次发布的文档包含了从原始排版胶带重新解析时所撰写的相关说明。
美国能源部的科学摘要每个文件体量约为1兆字节。原始的950个分隔符已被替换为换行符，且删除了文章间的空格填充内容。从数据库中提取的、用于体现数据集主题类别的缩写词典已被置于单独目录中。
本磁盘中宾夕法尼亚大学Treebank语料库项目的临时材料被分为两个子目录：子目录"postext"包含带有词性标注的文本；"parstext"包含带有句法括号标注的文本。
部分内容版权归©1987-1989道琼斯公司（Dow Jones & Company, Inc.）、©1979威廉·柯林斯父子有限公司（William Collins Sons Co., Ltd.）、©1990、1991、1993宾夕法尼亚大学托管委员会所有。

搜集汇总

背景与挑战

背景概述

ACL/DCI数据集是一个多源文本集合，包含来自《华尔街日报》、柯林斯英语词典、科学摘要和Treebank项目的材料，总大小为620 MB，采用SGML兼容标记，但格式多样，适用于自然语言处理任务如词性标注和句法分析。