tulsatime37/Llama-Nemotron-Post-Training-Dataset

该数据集是NVIDIA发布的Llama-Nemotron-Post-Training-Dataset-v1.1版本，旨在支持Llama-3.1-Nemotron-Ultra-253B-v1等模型的改进。数据集包含监督微调（SFT）和强化学习（RL）数据，覆盖数学、代码、科学、聊天、安全和指令跟随等多个领域。数据集中包含大量合成生成的数据，使用了多种模型进行响应生成。数据集的主要目的是用于训练和评估开放模型，以提高其在数学、代码、一般推理和指令跟随等方面的能力。This dataset is a compilation of SFT and RL data that supports improvements of math, code, general reasoning, and instruction following capabilities of the original Llama instruct model, in support of NVIDIA’s release of Llama-3.1-Nemotron-Ultra-253B-v1, Llama-3.3-Nemotron-Super-49B-v1 and Llama-3.1-Nemotron-Nano-8B-v1. The dataset includes data in categories such as math, code, science, chat, safety, and instruction following, with responses synthetically generated by a variety of models. The primary purpose of this dataset is to enable the community to continue improving open models through training and evaluation.