文言文(古文)-现代文平行语料
收藏AI_Studio2022-02-08 更新2024-03-04 收录
下载链接:
https://aistudio.baidu.com/datasetdetail/127439
下载链接
链接失效反馈官方服务:
资源简介:
基本涵盖了大部分经典古籍著作。共计约96万句对。原始爬取的数据是篇章级对齐,经过脚本分句(按照句号分号感叹号问号划分)以及人工校对,形成共计约96万句对。
目录bitext下是文言文-现代文对齐的平行数据。此外,目录source下是文言文单语数据,target下是现代文单语数据,这两个目录下的文件内容按行对齐。
This dataset covers most classic ancient Chinese literary works, with a total of approximately 960,000 sentence pairs. The originally crawled data was aligned at the chapter level, and was then split into individual sentences via a script (splitting based on periods, semicolons, exclamation marks, and question marks) followed by manual proofreading, resulting in the finalized 960,000 sentence pairs. The `bitext` directory stores parallel aligned data between classical Chinese and modern Chinese. Additionally, the `source` directory contains monolingual classical Chinese data, and the `target` directory holds monolingual modern Chinese data; the files under these two directories are line-aligned with one another.
提供机构:
炼丹师233搜集汇总
数据集介绍

背景与挑战
背景概述
该数据集是一个文言文与现代文之间的平行语料库,涵盖了大量经典古籍著作,包含约96万句对,经过分句和人工校对处理,确保了数据质量。数据集结构包括对齐的平行语料和单语文档,适用于机器翻译、语言学研究等任务,支持对文言文到现代文的转换和分析。
以上内容由遇见数据集搜集并总结生成



