tiny-think-sft-math-n-stem
收藏资源简介:
# Shekswess/tiny-think-sft-math-n-stem ## Overview Supervised fine-tuning (SFT) dataset built from `allenai/Dolci-Think-SFT-7B` plus GSM8K like think-style SFT from `openai/gsm8k`, using the `facebook/MobileLLM-R1-140M-base` tokenizer and chat template. This dataset targets math and STEM reasoning. ## Dataset Details - **Build date:** 2026-01-10 - **Sources:** 4 - **Rows:** 29,149 - **Tokens:** 59,999,048 (below budget; used all available tokens) - **Max sequence length:** 4096 tokens per example (chat template) - **Token budget:** 60,000,000 tokens (equal strategy) - **Columns:** `messages`, `dataset_source`, `token_count` ## Data Schema - `messages`: list of chat messages (role/content) - `dataset_source`: string identifier for the originating source dataset. - `token_count`: total tokens for the example under the tokenizer. ## Intended Use SFT for small models on single-GPU setups, emphasizing math and STEM reasoning.



