Cross-Register Projection for Headline Part of Speech Tagging

POSH: The POS-tagged HeadlIne corpus was created for the paper “Cross-Register Projection for Headline Part of Speech Tagging” published in EMNLP 2021. This dataset contains headlines with gold annotated POS tags. The <em>GSCh</em> evaluation set is here: GSCh/gsc-headline-gold.test.conllu The smaller evaluation set of GSC headlines sampled uniformly at random (described in section 2.3) is here: gold_unconstrained_headlines/unifrand_gsc.test.conllu The POS-tagged NYT headlines described in section 2.3 are not shared directly as this text was drawn from the New York Times Annotated Corpus (LDC2008T19), and subject to license constraints. However, if you have access to and have untarred LDC2008T19, you can recover this evaluation set with: TAG_PATH="./unifrand_onlynyt.tags.json" # mapping from NYT headline span to gold POS tag python build_gold_nyt_headlines.py --nyt_dir /PATH/TO/ANNOTATED/NYT/CORPUS/ --tag_path ${TAG_PATH} --num_proc 4 Increase the argument to --num_procs to process more shards from the NYT corpus in parallel and reduce build time. Under GSCproj we also share the <em>GSCproj</em> folds which we used to train and validate our models. These are not gold POS tags, and are shared purely for reproducibility sake.POSH：带词性标注（Part of Speech, POS）的标题语料库，是为发表于EMNLP 2021的论文《Cross-Register Projection for Headline Part of Speech Tagging》所构建。该数据集包含带有金标准人工词性标注的标题文本。<em>GSCh</em>评估集的存放路径为：GSCh/gsc-headline-gold.test.conllu。按2.3节所述方法随机均匀采样得到的小型GSC标题评估集，其存放路径为：gold_unconstrained_headlines/unifrand_gsc.test.conllu。2.3节中提及的带词性标注的《纽约时报》（New York Times）标题无法直接共享，因该文本取自《纽约时报》标注语料库（LDC2008T19），受许可协议约束。若您已获取并解压了LDC2008T19，可通过以下命令复现该评估集： TAG_PATH="./unifrand_onlynyt.tags.json" # 从《纽约时报》标题片段到金标准词性标签的映射文件 python build_gold_nyt_headlines.py --nyt_dir /PATH/TO/ANNOTATED/NYT/CORPUS/ --tag_path ${TAG_PATH} --num_proc 4 可增大`--num_procs`参数的值，以并行处理更多《纽约时报》语料库分片，缩短数据集构建耗时。在GSCproj路径下，我们还共享了用于模型训练与验证的<em>GSCproj</em>交叉验证折份。此类数据并非金标准词性标注标签，仅为保障研究可复现性而共享。