JKaiii/assignment4-qwen25-7b-pairrm-lima-dpo

--- dataset_info: features: - name: instruction dtype: string - name: prompt dtype: string - name: chosen dtype: string - name: rejected dtype: string - name: all_responses sequence: string - name: pairrm_ranks sequence: int64 - name: chosen_index dtype: int64 - name: rejected_index dtype: int64 splits: - name: train num_bytes: 403561 num_examples: 50 download_size: 223865 dataset_size: 403561 configs: - config_name: default data_files: - split: train path: data/train-* ---