yalhessi/lemexp-task1-v3-eval-results

Name: yalhessi/lemexp-task1-v3-eval-results
Creator: yalhessi
Published: 2025-12-16 13:46:45
License: 暂无描述

Hugging Face2025-12-16 更新2026-03-29 收录

下载链接：

https://hf-mirror.com/datasets/yalhessi/lemexp-task1-v3-eval-results

下载链接

链接失效反馈

官方服务：

资源简介：

--- dataset_info: - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 40659250 num_examples: 18975 download_size: 3558145 dataset_size: 40659250 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 33224575 num_examples: 18975 download_size: 2909918 dataset_size: 33224575 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 508434 num_examples: 350 download_size: 59521 dataset_size: 508434 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 416307 num_examples: 350 download_size: 51433 dataset_size: 416307 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 10890407 num_examples: 4740 download_size: 1127583 dataset_size: 10890407 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 8874214 num_examples: 4740 download_size: 975528 dataset_size: 8874214 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 44545019 num_examples: 18975 download_size: 3634392 dataset_size: 44545019 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 33565610 num_examples: 18975 download_size: 2977594 dataset_size: 33565610 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 553422 num_examples: 350 download_size: 60591 dataset_size: 553422 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 417788 num_examples: 350 download_size: 52216 dataset_size: 417788 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 11464400 num_examples: 4740 download_size: 1132790 dataset_size: 11464400 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 8951673 num_examples: 4740 download_size: 1001802 dataset_size: 8951673 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 42969902 num_examples: 18975 download_size: 3617230 dataset_size: 42969902 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 33841269 num_examples: 18975 download_size: 3102342 dataset_size: 33841269 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 571013 num_examples: 350 download_size: 67293 dataset_size: 571013 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 418871 num_examples: 350 download_size: 52596 dataset_size: 418871 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 12151199 num_examples: 4740 download_size: 1302139 dataset_size: 12151199 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 8991629 num_examples: 4740 download_size: 1009935 dataset_size: 8991629 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 42393713 num_examples: 18975 download_size: 3653149 dataset_size: 42393713 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 34133860 num_examples: 18975 download_size: 3111610 dataset_size: 34133860 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 519956 num_examples: 350 download_size: 64221 dataset_size: 519956 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 419150 num_examples: 350 download_size: 52531 dataset_size: 419150 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 12492671 num_examples: 4740 download_size: 1314846 dataset_size: 12492671 - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 8985126 num_examples: 4740 download_size: 1008497 dataset_size: 8985126 - config_name: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_afp_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 39202973 num_examples: 18975 download_size: 3217132 dataset_size: 39202973 - config_name: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_afp_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 32824972 num_examples: 18975 download_size: 2735809 dataset_size: 32824972 - config_name: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_octonions_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 513180 num_examples: 350 download_size: 51444 dataset_size: 513180 - config_name: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_octonions_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 417555 num_examples: 350 download_size: 48383 dataset_size: 417555 - config_name: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_small_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 10318990 num_examples: 4740 download_size: 1070282 dataset_size: 10318990 - config_name: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_small_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 8785433 num_examples: 4740 download_size: 942241 dataset_size: 8785433 - config_name: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 38789672 num_examples: 18975 download_size: 3249283 dataset_size: 38789672 - config_name: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 32856370 num_examples: 18975 download_size: 2738577 dataset_size: 32856370 - config_name: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 494079 num_examples: 350 download_size: 50798 dataset_size: 494079 - config_name: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 416770 num_examples: 350 download_size: 48616 dataset_size: 416770 - config_name: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 10190257 num_examples: 4740 download_size: 1061876 dataset_size: 10190257 - config_name: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 8793250 num_examples: 4740 download_size: 944631 dataset_size: 8793250 - config_name: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_afp_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 37968635 num_examples: 18975 download_size: 3235914 dataset_size: 37968635 - config_name: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_afp_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 32763466 num_examples: 18975 download_size: 2704086 dataset_size: 32763466 - config_name: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_octonions_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 526516 num_examples: 350 download_size: 56634 dataset_size: 526516 - config_name: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_octonions_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 414556 num_examples: 350 download_size: 47807 dataset_size: 414556 - config_name: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_small_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 10615718 num_examples: 4740 download_size: 1186780 dataset_size: 10615718 - config_name: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_small_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 8807104 num_examples: 4740 download_size: 950450 dataset_size: 8807104 - config_name: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 38155475 num_examples: 18975 download_size: 3046996 dataset_size: 38155475 - config_name: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 33265124 num_examples: 18975 download_size: 2816326 dataset_size: 33265124 - config_name: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 520196 num_examples: 350 download_size: 56250 dataset_size: 520196 - config_name: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 417175 num_examples: 350 download_size: 48649 dataset_size: 417175 - config_name: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 10713609 num_examples: 4740 download_size: 1192640 dataset_size: 10713609 - config_name: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 8819255 num_examples: 4740 download_size: 950111 dataset_size: 8819255 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 41376725 num_examples: 18975 download_size: 3426029 dataset_size: 41376725 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 33365320 num_examples: 18975 download_size: 2841152 dataset_size: 33365320 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 515737 num_examples: 350 download_size: 56578 dataset_size: 515737 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 417713 num_examples: 350 download_size: 50329 dataset_size: 417713 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 10889354 num_examples: 4740 download_size: 1054771 dataset_size: 10889354 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 8889262 num_examples: 4740 download_size: 959709 dataset_size: 8889262 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 41039723 num_examples: 18975 download_size: 3488394 dataset_size: 41039723 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 33280549 num_examples: 18975 download_size: 2839979 dataset_size: 33280549 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 497053 num_examples: 350 download_size: 56340 dataset_size: 497053 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 417024 num_examples: 350 download_size: 49724 dataset_size: 417024 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 10828286 num_examples: 4740 download_size: 1082739 dataset_size: 10828286 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 8896831 num_examples: 4740 download_size: 960272 dataset_size: 8896831 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_afp_notypes_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 42471090 num_examples: 18975 download_size: 3585267 dataset_size: 42471090 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_afp_notypes_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 33441963 num_examples: 18975 download_size: 2877533 dataset_size: 33441963 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_octonions_notypes_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 517866 num_examples: 350 download_size: 56377 dataset_size: 517866 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_octonions_notypes_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 417933 num_examples: 350 download_size: 50054 dataset_size: 417933 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_small_notypes_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 10880908 num_examples: 4740 download_size: 1072226 dataset_size: 10880908 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_small_notypes_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 8889807 num_examples: 4740 download_size: 959862 dataset_size: 8889807 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 40958988 num_examples: 18975 download_size: 3618456 dataset_size: 40958988 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 33338034 num_examples: 18975 download_size: 2886432 dataset_size: 33338034 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 503528 num_examples: 350 download_size: 59963 dataset_size: 503528 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 417326 num_examples: 350 download_size: 50435 dataset_size: 417326 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 11039984 num_examples: 4740 download_size: 1117060 dataset_size: 11039984 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 8923880 num_examples: 4740 download_size: 973878 dataset_size: 8923880 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 40435447 num_examples: 18975 download_size: 3621582 dataset_size: 40435447 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 33435526 num_examples: 18975 download_size: 2890158 dataset_size: 33435526 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 565805 num_examples: 350 download_size: 72844 dataset_size: 565805 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 423550 num_examples: 350 download_size: 53375 dataset_size: 423550 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 11469496 num_examples: 4740 download_size: 1302391 dataset_size: 11469496 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 8956011 num_examples: 4740 download_size: 1003047 dataset_size: 8956011 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_afp_notypes_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 41062820 num_examples: 18975 download_size: 3786021 dataset_size: 41062820 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_afp_notypes_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 33675034 num_examples: 18975 download_size: 2967862 dataset_size: 33675034 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_octonions_notypes_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 502773 num_examples: 350 download_size: 60577 dataset_size: 502773 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_octonions_notypes_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 414871 num_examples: 350 download_size: 50905 dataset_size: 414871 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_small_notypes_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 10885346 num_examples: 4740 download_size: 1140303 dataset_size: 10885346 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_small_notypes_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 8911916 num_examples: 4740 download_size: 968559 dataset_size: 8911916 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_afp_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 42504522 num_examples: 18975 download_size: 3947226 dataset_size: 42504522 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_afp_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 33108518 num_examples: 18975 download_size: 2631804 dataset_size: 33108518 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_octonions_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 576170 num_examples: 350 download_size: 61266 dataset_size: 576170 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_octonions_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 422263 num_examples: 350 download_size: 46938 dataset_size: 422263 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_small_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 10790518 num_examples: 4740 download_size: 1220576 dataset_size: 10790518 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_small_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 8786083 num_examples: 4740 download_size: 926618 dataset_size: 8786083 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 42167360 num_examples: 18975 download_size: 3910297 dataset_size: 42167360 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 33055970 num_examples: 18975 download_size: 2641919 dataset_size: 33055970 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 686411 num_examples: 350 download_size: 68797 dataset_size: 686411 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 430499 num_examples: 350 download_size: 48164 dataset_size: 430499 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 12081400 num_examples: 4740 download_size: 1328445 dataset_size: 12081400 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 8854618 num_examples: 4740 download_size: 941321 dataset_size: 8854618 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_afp_notypes_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 41885269 num_examples: 18975 download_size: 3924625 dataset_size: 41885269 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_afp_notypes_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 32959590 num_examples: 18975 download_size: 2655520 dataset_size: 32959590 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_octonions_notypes_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 565662 num_examples: 350 download_size: 63005 dataset_size: 565662 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_octonions_notypes_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 419364 num_examples: 350 download_size: 46604 dataset_size: 419364 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_small_notypes_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 10746735 num_examples: 4740 download_size: 1215152 dataset_size: 10746735 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_small_notypes_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 8776938 num_examples: 4740 download_size: 924812 dataset_size: 8776938 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_afp_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 45077206 num_examples: 18975 download_size: 4205452 dataset_size: 45077206 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_afp_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 32919962 num_examples: 18975 download_size: 2649241 dataset_size: 32919962 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_octonions_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 646160 num_examples: 350 download_size: 69087 dataset_size: 646160 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_octonions_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 415015 num_examples: 350 download_size: 46759 dataset_size: 415015 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_small_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 11481001 num_examples: 4740 download_size: 1285066 dataset_size: 11481001 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_small_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 8798016 num_examples: 4740 download_size: 930392 dataset_size: 8798016 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 49599566 num_examples: 18975 download_size: 4515924 dataset_size: 49599566 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 33435401 num_examples: 18975 download_size: 2724434 dataset_size: 33435401 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 748782 num_examples: 350 download_size: 79835 dataset_size: 748782 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 417249 num_examples: 350 download_size: 48141 dataset_size: 417249 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 11850458 num_examples: 4740 download_size: 1345595 dataset_size: 11850458 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 8854916 num_examples: 4740 download_size: 946067 dataset_size: 8854916 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_afp_notypes_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 50330130 num_examples: 18975 download_size: 4708787 dataset_size: 50330130 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_afp_notypes_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 34035746 num_examples: 18975 download_size: 2803078 dataset_size: 34035746 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_octonions_notypes_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 637814 num_examples: 350 download_size: 71753 dataset_size: 637814 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_octonions_notypes_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 415619 num_examples: 350 download_size: 47190 dataset_size: 415619 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_small_notypes_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 11195113 num_examples: 4740 download_size: 1285519 dataset_size: 11195113 - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_small_notypes_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 8794928 num_examples: 4740 download_size: 931762 dataset_size: 8794928 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 41505430 num_examples: 18975 download_size: 4070252 dataset_size: 41505430 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 37031502 num_examples: 18975 download_size: 3094637 dataset_size: 37031502 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 511345 num_examples: 350 download_size: 65448 dataset_size: 511345 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 461358 num_examples: 350 download_size: 54353 dataset_size: 461358 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 15218647 num_examples: 4740 download_size: 1575125 dataset_size: 15218647 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 9669463 num_examples: 4740 download_size: 1047046 dataset_size: 9669463 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 40724625 num_examples: 18975 download_size: 3847113 dataset_size: 40724625 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 33282979 num_examples: 18975 download_size: 2891208 dataset_size: 33282979 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 491749 num_examples: 350 download_size: 62360 dataset_size: 491749 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 415386 num_examples: 350 download_size: 49867 dataset_size: 415386 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 10789418 num_examples: 4740 download_size: 1193118 dataset_size: 10789418 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 9509186 num_examples: 4740 download_size: 964397 dataset_size: 9509186 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 41265251 num_examples: 18975 download_size: 4152827 dataset_size: 41265251 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 33467190 num_examples: 18975 download_size: 2920583 dataset_size: 33467190 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 498572 num_examples: 350 download_size: 63582 dataset_size: 498572 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 417544 num_examples: 350 download_size: 49791 dataset_size: 417544 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 10777814 num_examples: 4740 download_size: 1242187 dataset_size: 10777814 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 8919416 num_examples: 4740 download_size: 972513 dataset_size: 8919416 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 41287891 num_examples: 18975 download_size: 4085467 dataset_size: 41287891 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 33300755 num_examples: 18975 download_size: 2888558 dataset_size: 33300755 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 491584 num_examples: 350 download_size: 63377 dataset_size: 491584 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 414368 num_examples: 350 download_size: 50002 dataset_size: 414368 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_beam-search list: string - name: lemma_object_levenshtein_scores_beam-search dtype: int64 - name: lemma_object_success_beam-search dtype: bool splits: - name: train num_bytes: 10857260 num_examples: 4740 download_size: 1227654 dataset_size: 10857260 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: lemma_object_predictions_greedy list: string - name: lemma_object_levenshtein_scores_greedy dtype: int64 - name: lemma_object_success_greedy dtype: bool splits: - name: train num_bytes: 8900333 num_examples: 4740 download_size: 969712 dataset_size: 8900333 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_afp_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 40232115 num_examples: 18975 download_size: 3798736 dataset_size: 40232115 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_afp_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 31548615 num_examples: 18975 download_size: 2305019 dataset_size: 31548615 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_octonions_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 511252 num_examples: 350 download_size: 57356 dataset_size: 511252 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_octonions_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 417226 num_examples: 350 download_size: 47059 dataset_size: 417226 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_small_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 10499865 num_examples: 4740 download_size: 1207831 dataset_size: 10499865 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_small_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 8792693 num_examples: 4740 download_size: 930655 dataset_size: 8792693 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 41660703 num_examples: 18975 download_size: 4032926 dataset_size: 41660703 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 35428312 num_examples: 18975 download_size: 3323841 dataset_size: 35428312 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 546615 num_examples: 350 download_size: 65209 dataset_size: 546615 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 421301 num_examples: 350 download_size: 48709 dataset_size: 421301 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 15508402 num_examples: 4740 download_size: 1512489 dataset_size: 15508402 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 8866318 num_examples: 4740 download_size: 966922 dataset_size: 8866318 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_afp_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 39475289 num_examples: 18975 download_size: 3779432 dataset_size: 39475289 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_afp_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 32786173 num_examples: 18975 download_size: 2633319 dataset_size: 32786173 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_octonions_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 496704 num_examples: 350 download_size: 55984 dataset_size: 496704 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_octonions_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 414274 num_examples: 350 download_size: 47018 dataset_size: 414274 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_small_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 10510643 num_examples: 4740 download_size: 1216784 dataset_size: 10510643 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_small_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 8798918 num_examples: 4740 download_size: 932764 dataset_size: 8798918 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 46204487 num_examples: 18975 download_size: 4124563 dataset_size: 46204487 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 32770918 num_examples: 18975 download_size: 2636559 dataset_size: 32770918 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 507293 num_examples: 350 download_size: 57394 dataset_size: 507293 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 416932 num_examples: 350 download_size: 47617 dataset_size: 416932 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_beam-search features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_beam-search list: string - name: template_levenshtein_scores_beam-search dtype: int64 - name: template_success_beam-search dtype: bool splits: - name: train num_bytes: 10935937 num_examples: 4740 download_size: 1275460 dataset_size: 10935937 - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_greedy features: - name: theory_file dtype: string - name: lemma_name dtype: string - name: lemma_command dtype: string - name: lemma_object dtype: string - name: template dtype: string - name: symbols list: string - name: types list: string - name: defs list: string - name: template_predictions_greedy list: string - name: template_levenshtein_scores_greedy dtype: int64 - name: template_success_greedy dtype: bool splits: - name: train num_bytes: 8812980 num_examples: 4740 download_size: 937403 dataset_size: 8812980 configs: - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_afp_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_afp_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_afp_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_afp_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_octonions_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_octonions_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_octonions_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_octonions_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_small_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_small_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_small_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_full_eval_on_template_small_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_afp_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_afp_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_afp_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_afp_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_octonions_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_octonions_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_octonions_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_octonions_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_small_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_small_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_small_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_small_eval_on_template_small_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_greedy/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_beam-search data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_beam-search/train-* - config_name: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_greedy data_files: - split: train path: model_Llama-3.2-1B_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_afp_notypes_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_afp_notypes_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_afp_notypes_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_afp_notypes_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_octonions_notypes_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_octonions_notypes_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_octonions_notypes_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_octonions_notypes_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_small_notypes_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_small_notypes_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_small_notypes_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_full_notypes_eval_on_lemma_object_small_notypes_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_afp_notypes_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_afp_notypes_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_afp_notypes_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_afp_notypes_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_octonions_notypes_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_octonions_notypes_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_octonions_notypes_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_octonions_notypes_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_small_notypes_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_small_notypes_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_small_notypes_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_lemma_object_small_notypes_eval_on_lemma_object_small_notypes_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_afp_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_afp_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_afp_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_afp_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_octonions_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_octonions_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_octonions_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_octonions_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_small_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_small_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_small_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_eval_on_template_small_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_afp_notypes_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_afp_notypes_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_afp_notypes_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_afp_notypes_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_octonions_notypes_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_octonions_notypes_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_octonions_notypes_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_octonions_notypes_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_small_notypes_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_small_notypes_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_small_notypes_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_full_notypes_eval_on_template_small_notypes_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_afp_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_afp_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_afp_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_afp_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_octonions_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_octonions_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_octonions_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_octonions_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_small_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_small_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_small_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_eval_on_template_small_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_afp_notypes_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_afp_notypes_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_afp_notypes_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_afp_notypes_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_octonions_notypes_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_octonions_notypes_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_octonions_notypes_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_octonions_notypes_generation_greedy/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_small_notypes_generation_beam-search data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_small_notypes_generation_beam-search/train-* - config_name: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_small_notypes_generation_greedy data_files: - split: train path: model_deepseek-coder-1.3b-base_finetuned_on_template_small_notypes_eval_on_template_small_notypes_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_afp_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_octonions_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_eval_on_lemma_object_small_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_full_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_afp_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_octonions_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_eval_on_lemma_object_small_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_afp_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_octonions_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_lemma_object_small_nodefs_eval_on_lemma_object_small_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_afp_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_afp_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_afp_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_afp_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_octonions_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_octonions_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_octonions_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_octonions_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_small_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_small_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_small_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_full_eval_on_template_small_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_afp_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_octonions_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_full_nodefs_eval_on_template_small_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_afp_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_afp_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_afp_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_afp_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_octonions_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_octonions_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_octonions_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_octonions_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_small_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_small_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_small_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_small_eval_on_template_small_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_afp_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_octonions_nodefs_generation_greedy/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_beam-search data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_beam-search/train-* - config_name: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_greedy data_files: - split: train path: model_deepseek-coder-6.7b-base_finetuned_on_template_small_nodefs_eval_on_template_small_nodefs_generation_greedy/train-* ---

提供机构：

yalhessi

5,000+

优质数据集

54 个

任务类型

进入经典数据集