llm-jp-4-thinking-sft-data

# llm-jp-4-thinking-sft-data ## Overview This dataset is a supervised fine-tuning (SFT) dataset used to train `llm-jp-4-*-thinking` models. This dataset is constructed by extracting prompts from multiple data sources and generating reasoning processes and final responses using [gpt-oss-120b](https://huggingface.co/openai/gpt-oss-120b). The splits `reasoning_low`, `reasoning_medium`, and `reasoning_high` correspond to different reasoning effort settings used during generation with `gpt-oss-120b`. To support the continued development of LLM-jp, we would greatly appreciate it if you could share how you utilize LLM-jp outcomes via the [survey form](https://forms.gle/AvbNXTNT2ADsssHq5). ## Data Sources and Licenses `llm-jp-4-*-thinking` are constructed based on the following data sources. Since each dataset has its own license, please ensure compliance with the respective licenses when using this dataset. Some subsets cannot be redistributed due to licensing restrictions and are therefore not included. | Dataset | License | Notes | | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | --------------------------------------------------------------- | ------------------------------------------------------- | | [ac_002](https://huggingface.co/datasets/llm-jp/AnswerCarefully) | answer-carefully-dataset-tou | Not included due to redistribution restrictions | | [daring_anteater](https://huggingface.co/datasets/nvidia/Daring-Anteater) | CC BY 4.0 | - | | [flan](https://huggingface.co/datasets/allenai/dolmino-mix-1124) | ODC-BY | - | | [ichikara](https://liat-aip.sakura.ne.jp/wp/llm%E3%81%AE%E3%81%9F%E3%82%81%E3%81%AE%E6%97%A5%E6%9C%AC%E8%AA%9E%E3%82%A4%E3%83%B3%E3%82%B9%E3%83%88%E3%83%A9%E3%82%AF%E3%82%B7%E3%83%A7%E3%83%B3%E3%83%87%E3%83%BC%E3%82%BF%E4%BD%9C%E6%88%90/) | - | Requires paid license, not included | | [jaster_v1.4.1](https://github.com/llm-jp/llm-jp-eval/tree/v1.4.1) | CC BY-SA 4.0, CC BY-SA 3.0, CC BY 4.0, BSD-3, Apache-2.0, MIT | - | | [llmjp_extraction_wiki_ja_v0.x](https://huggingface.co/datasets/llm-jp/extraction-wiki-ja) | Apache-2.0 | - | | [llmjp_magpie_sft_v1.0](https://huggingface.co/datasets/llm-jp/magpie-sft-v1.0) | Apache-2.0 | - | | llmc_math_dataset | - | To be released | | [logical_math_coding_wizard8x22b](https://huggingface.co/datasets/llm-jp/wizardlm8x22b-logical-math-coding-sft-ja) | Apache-2.0 | - | | [multiturn_calm3](https://huggingface.co/datasets/kanhatakeyama/AutoMultiTurnByCalm3-22B) | Apache-2.0, CC BY-SA 3.0, CC0, CC BY 4.0 | - | | [nemotron_post_v2_stem](https://huggingface.co/datasets/nvidia/Nemotron-Post-Training-Dataset-v2) | CC BY 4.0 | - | | [nemotron_post_v3_chat](https://huggingface.co/datasets/nvidia/Nemotron-Instruction-Following-Chat-v1) | CC BY 4.0 | - | | [nemotron_post_v3_if](https://huggingface.co/datasets/nvidia/Nemotron-Instruction-Following-Chat-v1) | CC BY 4.0 | - | | [nemotron_post_v3_math](https://huggingface.co/datasets/nvidia/Nemotron-Math-v2) | CC BY-SA 4.0 | - | | [random_to_fixed_multiturn_calm3](https://huggingface.co/datasets/kanhatakeyama/ramdom-to-fixed-multiturn-Calm3) | Apache-2.0 | - | | synthetic_if_ja | - | To be released | | self_system_question | CC BY 4.0 | Newly created dataset about model-related questions | | [synthetic_jp_en_coding](https://huggingface.co/datasets/llm-jp/Synthetic-JP-EN-Coding-Dataset) | Apache-2.0 | - | | system_prompt_question | CC BY 4.0 | Newly created dataset about model identity and metadata | ## Data Format Each sample has the following format: ```json { "ID": "...", "messages": [ {"role": "system", "name": null, "content": ["..."]}, {"role": "user", "name": null, "content": ["..."]}, {"role": "assistant", "name": null, "content": ["..."], "channel": "analysis"}, {"role": "assistant", "name": null, "content": ["..."], "channel": "final"}, ... ] } ``` * `channel="analysis"` represents the reasoning process (chain-of-thought) * `channel="final"` represents the final response The `messages` field contains conversational data and is fully compatible with [openai-harmony](https://github.com/openai/harmony). You can convert it into a `Conversation` object as follows: ```python from openai_harmony import Message, Conversation sample = { "ID": "...", "messages": [] } conversation = Conversation.from_messages( [Message.from_dict(m) for m in sample["messages"]] ) ``` This format allows direct handling of both reasoning processes and final responses. ## Notes * This dataset contains reasoning processes and responses generated by a large language model (`gpt-oss-120b`). * Generated content may include errors, inaccuracies, biases, or harmful outputs. ## Send Questions to llm-jp(at)nii.ac.jp ## Model Card Authors The names are listed in alphabetical order. Hirokazu Kiyomaru and Takashi Kodama.