stukenov/sozkz-corpus-tokenized-kk-llama50k-v5

--- dataset_info: features: - name: input_ids list: int32 - name: labels list: int64 splits: - name: train num_bytes: 5938439272 num_examples: 482957 - name: validation num_bytes: 59992184 num_examples: 4879 download_size: 5999905631 dataset_size: 5998431456 configs: - config_name: default data_files: - split: train path: data/train-* - split: validation path: data/validation-* ---