RUC-AIBOX/Llama-3-SynE-Dataset
收藏Hugging Face2025-05-31 更新2025-07-05 收录
下载链接：
https://hf-mirror.com/datasets/RUC-AIBOX/Llama-3-SynE-Dataset
下载链接
链接失效反馈官方服务：
资源简介：
Llama-3-SynE是一个通过持续预训练（CPT）显著增强的Llama-3 (8B)版本，旨在提高其中文语言能力和科学推理能力。通过精心设计的数据混合和课程策略，Llama-3-SynE在增强新能力的同时，保持了原始模型的表现。
Llama-3-SynE (Synthetic data Enhanced Llama-3) is a significantly enhanced version of [Llama-3 (8B)](https://github.com/meta-llama/llama3), achieved through continual pre-training (CPT) to improve its **Chinese language ability and scientific reasoning capability**. By employing a meticulously designed data mixture and curriculum strategy, Llama-3-SynE successfully enhances new abilities while maintaining the original model’s performance.
提供机构：
RUC-AIBOX
