Name: jablonkagroup/corral-result-v0
Creator: jablonkagroup
Published: 2026-02-28 22:40:39
License: 暂无描述

下载链接：

https://hf-mirror.com/datasets/jablonkagroup/corral-result-v0

下载链接

链接失效反馈

官方服务：

资源简介：

--- dataset_info: features: - name: file_path dtype: string - name: source dtype: string - name: model dtype: string - name: agent_type dtype: string - name: verbosity dtype: string - name: environment dtype: string - name: subcategory dtype: string - name: task_or_subtask dtype: string - name: level dtype: string - name: average_score dtype: float64 - name: overall_success_rate dtype: float64 - name: pass_at_1 dtype: float64 - name: pass_at_2 dtype: float64 - name: pass_at_3 dtype: float64 - name: pass_hat_1 dtype: float64 - name: total_tasks dtype: int64 - name: tool_verbosity dtype: string - name: total_tool_calls dtype: int64 - name: successful_tool_calls dtype: int64 - name: failed_tool_calls dtype: int64 - name: surrendered_trials dtype: int64 - name: prompt_tokens dtype: int64 - name: completion_tokens dtype: int64 - name: total_tokens dtype: int64 - name: total_tool_execution_duration dtype: float64 - name: total_benchmark_duration dtype: float64 - name: task_summary struct: - name: silicon_melting_3_subtask_structure_retrieval struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: silicon_melting_3_subtask_potential_file struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: silicon_melting_3_subtask_melting struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: silicon_melting_3_subtask_diffusivity struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: silicon_melting_1_subtask_structure_retrieval struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: silicon_melting_1_subtask_potential_file struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: silicon_melting_1_subtask_melting struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: silicon_melting_1_subtask_diffusivity struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: silicon_melting_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_energy_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: sio2_quenching_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: silicon_melting_2_subtask_structure_retrieval struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: silicon_melting_2_subtask_potential_file struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: silicon_melting_2_subtask_melting struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: silicon_melting_2_subtask_diffusivity struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: sio2_quenching_1_subtask_structure_retrieval struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: sio2_quenching_1_subtask_potential_file struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: sio2_quenching_1_subtask_quenching struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: sio2_quenching_1_subtask_tg_detection struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_energy_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: sio2_quenching_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_energy_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_1_subtask_structure_retrieval struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_1_subtask_potential_file struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_1_subtask_bulk_energy_minimisation struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_1_subtask_slab_energy_minimisation struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_1_subtask_surface struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: silicon_melting_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: sio2_quenching_3_subtask_structure_retrieval struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: sio2_quenching_3_subtask_potential_file struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: sio2_quenching_3_subtask_quenching struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: sio2_quenching_3_subtask_tg_detection struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: sio2_quenching_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_3_subtask_structure_retrieval struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_3_subtask_potential_file struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_3_subtask_bulk_energy_minimisation struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_3_subtask_slab_energy_minimisation struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_3_subtask_surface struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: sio2_quenching_2_subtask_structure_retrieval struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: sio2_quenching_2_subtask_potential_file struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: sio2_quenching_2_subtask_quenching struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: sio2_quenching_2_subtask_tg_detection struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_2_subtask_structure_retrieval struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_2_subtask_potential_file struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_2_subtask_bulk_energy_minimisation struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_2_subtask_slab_energy_minimisation struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: aluminum_surface_2_subtask_surface struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: silicon_melting_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: cu20_add_adsorbate struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: cu20_choose_adsorption_site struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: cu20_choose_slab struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: cu20_create_molecule struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: cu20_enumerate_slabs struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: cu20_get_adsorption_sites struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: cu20_retrieve_structure struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: si_add_adsorbate struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: si_choose_adsorption_site struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: si_choose_slab struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: si_create_molecule struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: si_enumerate_slabs struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: si_get_adsorption_sites struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: si_retrieve_structure struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: tio2_add_adsorbate struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: tio2_choose_adsorption_site struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: tio2_choose_slab struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: tio2_create_molecule struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: tio2_enumerate_slabs struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: tio2_get_adsorption_sites struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: tio2_retrieve_structure struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: cu2o_workflow struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: si_workflow struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: tio2_workflow struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 0_batch_retrieve_oxide_polymorphs struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 0_evaluate_model_performance struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 0_prepare_ml_ready_dataset struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 0_train_xgboost_formation_energy_model struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 1_batch_retrieve_nitride_polymorphs struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 1_evaluate_model_performance struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 1_prepare_ml_ready_dataset struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 1_train_xgboost_formation_energy_model struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 2_batch_retrieve_sulphide_polymorphs struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 2_evaluate_model_performance struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 2_prepare_ml_ready_dataset struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 2_train_xgboost_formation_energy_model struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: ml_nitrides struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: ml_oxides struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: ml_sulphides struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_0_final_assembly struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_0_subnet_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_0_subnet_2 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_1_final_assembly struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_1_subnet_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_1_subnet_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_2_final_assembly struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_2_subnet_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_2_subnet_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_2_subnet_3 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_3_final_assembly struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_3_subnet_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_3_subnet_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_3_subnet_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_4_final_assembly struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_4_subnet_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_4_subnet_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_4_subnet_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_4_subnet_4 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_5_final_assembly struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_5_subnet_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_5_subnet_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_5_subnet_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_5_subnet_4 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_0 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_4 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: task_5 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0077 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0001 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0114 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 11_11111_orgsyn_111_1111 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0317m struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 00_0000_orgsyn_000_0000 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 88_88888_orgsyn_888_8888 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0036 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 55_55555_orgsyn_555_5555 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 77_77777_orgsyn_777_7777 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 33_33333_orgsyn_333_3333 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 22_22222_orgsyn_222_2222 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_101_0327 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0245 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 66_66666_orgsyn_666_6666 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0086 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0215 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0077_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0077_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0077_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0077_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0077_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0077_subtask_6 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0077_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0077_subtask_8 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0077_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0077_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0001_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0001_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0001_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0001_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0001_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0001_subtask_6 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0001_subtask_7 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0001_subtask_8 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0001_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0001_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0114_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0114_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0114_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0114_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0114_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0114_subtask_6 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0114_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0114_subtask_8 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0114_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0114_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 11_11111_orgsyn_111_1111_subtask_1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 11_11111_orgsyn_111_1111_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 11_11111_orgsyn_111_1111_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 11_11111_orgsyn_111_1111_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 11_11111_orgsyn_111_1111_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 11_11111_orgsyn_111_1111_subtask_6 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 11_11111_orgsyn_111_1111_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 11_11111_orgsyn_111_1111_subtask_8 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 11_11111_orgsyn_111_1111_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 11_11111_orgsyn_111_1111_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub1_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub1_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub1_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub1_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub1_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub1_subtask_6 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub1_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub1_subtask_8 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub1_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub1_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0317m_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0317m_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0317m_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0317m_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0317m_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0317m_subtask_6 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0317m_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0317m_subtask_8 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0317m_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0317m_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 00_0000_orgsyn_000_0000_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 00_0000_orgsyn_000_0000_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 00_0000_orgsyn_000_0000_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 00_0000_orgsyn_000_0000_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 00_0000_orgsyn_000_0000_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 00_0000_orgsyn_000_0000_subtask_6 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 00_0000_orgsyn_000_0000_subtask_7 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 00_0000_orgsyn_000_0000_subtask_8 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 00_0000_orgsyn_000_0000_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 00_0000_orgsyn_000_0000_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 88_88888_orgsyn_888_8888_subtask_1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 88_88888_orgsyn_888_8888_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 88_88888_orgsyn_888_8888_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 88_88888_orgsyn_888_8888_subtask_4 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 88_88888_orgsyn_888_8888_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 88_88888_orgsyn_888_8888_subtask_6 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 88_88888_orgsyn_888_8888_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 88_88888_orgsyn_888_8888_subtask_8 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 88_88888_orgsyn_888_8888_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 88_88888_orgsyn_888_8888_subtask_10 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0036_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0036_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0036_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0036_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0036_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0036_subtask_6 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0036_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0036_subtask_8 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0036_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0036_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 55_55555_orgsyn_555_5555_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 55_55555_orgsyn_555_5555_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 55_55555_orgsyn_555_5555_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 55_55555_orgsyn_555_5555_subtask_4 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 55_55555_orgsyn_555_5555_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 55_55555_orgsyn_555_5555_subtask_6 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 55_55555_orgsyn_555_5555_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 55_55555_orgsyn_555_5555_subtask_8 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 55_55555_orgsyn_555_5555_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 55_55555_orgsyn_555_5555_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 77_77777_orgsyn_777_7777_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 77_77777_orgsyn_777_7777_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 77_77777_orgsyn_777_7777_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 77_77777_orgsyn_777_7777_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 77_77777_orgsyn_777_7777_subtask_5 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 77_77777_orgsyn_777_7777_subtask_6 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 77_77777_orgsyn_777_7777_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 77_77777_orgsyn_777_7777_subtask_8 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 77_77777_orgsyn_777_7777_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 77_77777_orgsyn_777_7777_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 33_33333_orgsyn_333_3333_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 33_33333_orgsyn_333_3333_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 33_33333_orgsyn_333_3333_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 33_33333_orgsyn_333_3333_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 33_33333_orgsyn_333_3333_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 33_33333_orgsyn_333_3333_subtask_6 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 33_33333_orgsyn_333_3333_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 33_33333_orgsyn_333_3333_subtask_8 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 33_33333_orgsyn_333_3333_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 33_33333_orgsyn_333_3333_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 22_22222_orgsyn_222_2222_subtask_1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 22_22222_orgsyn_222_2222_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 22_22222_orgsyn_222_2222_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 22_22222_orgsyn_222_2222_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 22_22222_orgsyn_222_2222_subtask_5 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 22_22222_orgsyn_222_2222_subtask_6 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 22_22222_orgsyn_222_2222_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 22_22222_orgsyn_222_2222_subtask_8 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 22_22222_orgsyn_222_2222_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 22_22222_orgsyn_222_2222_subtask_10 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub2_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub2_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub2_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub2_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub2_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub2_subtask_6 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub2_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub2_subtask_8 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub2_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub2_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_101_0327_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_101_0327_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_101_0327_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_101_0327_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_101_0327_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_101_0327_subtask_6 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_101_0327_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_101_0327_subtask_8 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_101_0327_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_101_0327_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0245_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0245_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0245_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0245_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0245_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0245_subtask_6 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0245_subtask_7 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0245_subtask_8 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0245_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_096_0245_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 66_66666_orgsyn_666_6666_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 66_66666_orgsyn_666_6666_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 66_66666_orgsyn_666_6666_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 66_66666_orgsyn_666_6666_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 66_66666_orgsyn_666_6666_subtask_5 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 66_66666_orgsyn_666_6666_subtask_6 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 66_66666_orgsyn_666_6666_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 66_66666_orgsyn_666_6666_subtask_8 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 66_66666_orgsyn_666_6666_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 66_66666_orgsyn_666_6666_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub3_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub3_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub3_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub3_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub3_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub3_subtask_6 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub3_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub3_subtask_8 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub3_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0011_sub3_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0086_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0086_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0086_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0086_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0086_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0086_subtask_6 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0086_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0086_subtask_8 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0086_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_102_0086_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0215_subtask_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0215_subtask_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0215_subtask_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0215_subtask_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0215_subtask_5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0215_subtask_6 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0215_subtask_7 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0215_subtask_8 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0215_subtask_9 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: 10_15227_orgsyn_084_0215_subtask_10 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_1_lvl3 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_2_lvl3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_3_lvl3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_4_lvl3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_1_lvl2 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_2_lvl2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_3_lvl2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_4_lvl2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_1_lvl2-apply_template-1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_1_lvl2-build_complete_route struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_1_lvl2-template_search-1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_2_lvl2-apply_template-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_2_lvl2-build_complete_route struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_2_lvl2-template_search-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_3_lvl2-apply_template-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_3_lvl2-build_complete_route struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_3_lvl2-template_search-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_4_lvl2-apply_template-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_4_lvl2-build_complete_route struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_4_lvl2-template_search-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl2-apply_template-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl2-apply_template-2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl2-apply_template-3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl2-apply_template-4 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl2-apply_template-5 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl2-build_complete_route struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl2-template_search-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl2-template_search-2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl2-template_search-3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl2-template_search-4 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl2-template_search-5 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl2-apply_template-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl2-apply_template-2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl2-apply_template-3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl2-build_complete_route struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl2-template_search-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl2-template_search-2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl2-template_search-3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl2-apply_template-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl2-apply_template-2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl2-apply_template-3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl2-build_complete_route struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl2-template_search-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl2-template_search-2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl2-template_search-3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl2-apply_template-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl2-apply_template-2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl2-apply_template-3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl2-apply_template-4 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl2-apply_template-5 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl2-apply_template-6 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl2-build_complete_route struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl2-template_search-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl2-template_search-2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl2-template_search-3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl2-template_search-4 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl2-template_search-5 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl2-template_search-6 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_1_lvl1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_2_lvl1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_3_lvl1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_4_lvl1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_1_lvl1-apply_template-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_1_lvl1-build_complete_route struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_1_lvl1-template_search-1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_2_lvl1-apply_template-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_2_lvl1-build_complete_route struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_2_lvl1-template_search-1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_3_lvl1-apply_template-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_3_lvl1-build_complete_route struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_3_lvl1-template_search-1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_4_lvl1-apply_template-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_4_lvl1-build_complete_route struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_4_lvl1-template_search-1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl1-apply_template-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl1-apply_template-2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl1-apply_template-3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl1-apply_template-4 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl1-apply_template-5 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl1-build_complete_route struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl1-template_search-1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl1-template_search-2 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl1-template_search-3 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl1-template_search-4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_5_lvl1-template_search-5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl1-apply_template-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl1-apply_template-2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl1-apply_template-3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl1-build_complete_route struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl1-template_search-1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl1-template_search-2 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_6_lvl1-template_search-3 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl1-apply_template-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl1-apply_template-2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl1-apply_template-3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl1-build_complete_route struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl1-template_search-1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl1-template_search-2 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_7_lvl1-template_search-3 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl1-apply_template-1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl1-apply_template-2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl1-apply_template-3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl1-apply_template-4 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl1-apply_template-5 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl1-apply_template-6 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl1-build_complete_route struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl1-template_search-1 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl1-template_search-2 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl1-template_search-3 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl1-template_search-4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl1-template_search-5 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: make_8_lvl1-template_search-6 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: afm_experiment_level_4 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: afm_experiment_level_3 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: afm_experiment_level_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: afm_experiment_level_2 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: parameter_set_subtask_level_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: image_capture_1_subtask_level_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: image_capture_2_subtask_level_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: image_capture_3_subtask_level_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: roughness_1_subtask_level_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: roughness_2_subtask_level_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: roughness_3_subtask_level_1 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: parameter_set_subtask_level_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: image_capture_1_subtask_level_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: image_capture_2_subtask_level_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: image_capture_3_subtask_level_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: roughness_1_subtask_level_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: roughness_2_subtask_level_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: roughness_3_subtask_level_3 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: roughness_relationship_level_3 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: parameter_set_subtask_level_4 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: roughness_subtask_level_4 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: roughness_relationship_level_4 struct: - name: success_rate dtype: int64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: parameter_set_subtask_level_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: image_capture_1_subtask_level_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: image_capture_2_subtask_level_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: image_capture_3_subtask_level_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: roughness_1_subtask_level_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: roughness_2_subtask_level_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: roughness_3_subtask_level_2 struct: - name: success_rate dtype: float64 - name: average_score dtype: float64 - name: pass_at_1 dtype: float64 - name: n_trials dtype: int64 - name: n_distinct_tasks dtype: int64 splits: - name: train num_bytes: 9491415 num_examples: 582 download_size: 1197765 dataset_size: 9491415 configs: - config_name: default data_files: - split: train path: data/train-* ---

应用场景：