Yujivus/fineweb-edu-phaseformer-1.5B

--- dataset_info: features: - name: input_ids list: int32 splits: - name: train num_bytes: 6011719776 num_examples: 2929688 - name: validation num_bytes: 40079664 num_examples: 19532 - name: test num_bytes: 40079664 num_examples: 19532 download_size: 3158928752 dataset_size: 6091879104 configs: - config_name: default data_files: - split: train path: data/train-* - split: validation path: data/validation-* - split: test path: data/test-* ---