NEZHA-Large-WWM

华为诺亚方舟实验室公开发布的NEZHA-Large-WWM语言模型。
下载自https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/NEZHA-TensorFlow
该模型以Apache License Version 2.0协议开源。
使用、转发等请遵循Apache License Version 2.0协议。

引用：
Junqiu Wei, Xiaozhe Ren, Xiaoguang Li, Wenyong Huang, Yi Liao, Yasheng Wang, Jiashu Lin, Xin Jiang, Xiao Chen, Qun Liu. NEZHA: Neural Contextualized Representation for Chinese Language Understanding. arXiv preprint arXiv:1909.00204

@article{wei2019nezha,
title = {NEZHA: Neural Contextualized Representation for Chinese Language Understanding},
author = {Junqiu Wei, Xiaozhe Ren, Xiaoguang Li, Wenyong Huang, Yi Liao, Yasheng Wang, Jiashu Lin, Xin Jiang, Xiao Chen, Qun Liu},
journal = {arXiv preprint arXiv:1909.00204},
year = {2019},
}

Apache License Version 2.0

搜集汇总

背景与挑战

背景概述

NEZHA-Large-WWM是华为诺亚方舟实验室发布的一个预训练中文语言模型，专为中文语言理解任务设计。该模型以Apache License Version 2.0协议开源。