hails/bigbench

Name: hails/bigbench
Creator: hails
Published: 2023-11-17 16:05:10
License: 暂无描述

Hugging Face2023-11-17 更新2024-03-04 收录

下载链接：

https://hf-mirror.com/datasets/hails/bigbench

下载链接

链接失效反馈

官方服务：

资源简介：

--- dataset_info: - config_name: abstract_narrative_understanding_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 6560069 num_examples: 3000 - name: train num_bytes: 5249819 num_examples: 2400 - name: validation num_bytes: 1310250 num_examples: 600 download_size: 0 dataset_size: 13120138 - config_name: anachronisms_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 48826 num_examples: 230 - name: train num_bytes: 39116 num_examples: 184 - name: validation num_bytes: 9710 num_examples: 46 download_size: 0 dataset_size: 97652 - config_name: analogical_similarity_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1373815 num_examples: 323 - name: train num_bytes: 1101512 num_examples: 259 - name: validation num_bytes: 272303 num_examples: 64 download_size: 0 dataset_size: 2747630 - config_name: analytic_entailment_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 17316 num_examples: 70 - name: train num_bytes: 13368 num_examples: 54 - name: validation num_bytes: 3948 num_examples: 16 download_size: 0 dataset_size: 34632 - config_name: arithmetic_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 3833272 num_examples: 15023 - name: train num_bytes: 3066775 num_examples: 12019 - name: validation num_bytes: 766497 num_examples: 3004 download_size: 0 dataset_size: 7666544 - config_name: ascii_word_recognition_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 4984662 num_examples: 5000 - name: train num_bytes: 3997273 num_examples: 4000 - name: validation num_bytes: 987389 num_examples: 1000 download_size: 0 dataset_size: 9969324 - config_name: authorship_verification_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 14118592 num_examples: 880 - name: train num_bytes: 11288481 num_examples: 704 - name: validation num_bytes: 2830111 num_examples: 176 download_size: 0 dataset_size: 28237184 - config_name: auto_categorization_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 40549 num_examples: 328 - name: train num_bytes: 32992 num_examples: 263 - name: validation num_bytes: 7557 num_examples: 65 download_size: 0 dataset_size: 81098 - config_name: auto_debugging_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 5112 num_examples: 34 - name: train num_bytes: 2651 num_examples: 18 - name: validation num_bytes: 2461 num_examples: 16 download_size: 0 dataset_size: 10224 - config_name: bbq_lite_json_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 6890493 num_examples: 16076 - name: train num_bytes: 5508584 num_examples: 12866 - name: validation num_bytes: 1381909 num_examples: 3210 download_size: 0 dataset_size: 13780986 - config_name: bridging_anaphora_resolution_barqa_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1971015 num_examples: 648 - name: train num_bytes: 1537264 num_examples: 519 - name: validation num_bytes: 433751 num_examples: 129 download_size: 0 dataset_size: 3942030 - config_name: causal_judgment_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 204878 num_examples: 190 - name: train num_bytes: 164940 num_examples: 152 - name: validation num_bytes: 39938 num_examples: 38 download_size: 0 dataset_size: 409756 - config_name: cause_and_effect_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 49314 num_examples: 153 - name: train num_bytes: 39620 num_examples: 123 - name: validation num_bytes: 9694 num_examples: 30 download_size: 0 dataset_size: 98628 - config_name: checkmate_in_one_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 3123256 num_examples: 3498 - name: train num_bytes: 2502314 num_examples: 2799 - name: validation num_bytes: 620942 num_examples: 699 download_size: 0 dataset_size: 6246512 - config_name: chess_state_tracking_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 3269932 num_examples: 6000 - name: train num_bytes: 2616294 num_examples: 4800 - name: validation num_bytes: 653638 num_examples: 1200 download_size: 0 dataset_size: 6539864 - config_name: chinese_remainder_theorem_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 153222 num_examples: 500 - name: train num_bytes: 122601 num_examples: 400 - name: validation num_bytes: 30621 num_examples: 100 download_size: 0 dataset_size: 306444 - config_name: cifar10_classification_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 111022200 num_examples: 20000 - name: train num_bytes: 88782724 num_examples: 16000 - name: validation num_bytes: 22239476 num_examples: 4000 download_size: 0 dataset_size: 222044400 - config_name: code_line_description_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 33670 num_examples: 60 - name: train num_bytes: 25530 num_examples: 44 - name: validation num_bytes: 8140 num_examples: 16 download_size: 0 dataset_size: 67340 - config_name: codenames_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 25195 num_examples: 85 - name: train num_bytes: 19964 num_examples: 68 - name: validation num_bytes: 5231 num_examples: 17 download_size: 0 dataset_size: 50390 - config_name: color_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1633263 num_examples: 4000 - name: train num_bytes: 1306663 num_examples: 3200 - name: validation num_bytes: 326600 num_examples: 800 download_size: 0 dataset_size: 3266526 - config_name: common_morpheme_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 12388 num_examples: 50 - name: train num_bytes: 8444 num_examples: 34 - name: validation num_bytes: 3944 num_examples: 16 download_size: 0 dataset_size: 24776 - config_name: conceptual_combinations_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 58859 num_examples: 103 - name: train num_bytes: 48010 num_examples: 84 - name: validation num_bytes: 10849 num_examples: 19 download_size: 0 dataset_size: 117718 - config_name: conlang_translation_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 215190 num_examples: 164 - name: train num_bytes: 173024 num_examples: 132 - name: validation num_bytes: 42166 num_examples: 32 download_size: 0 dataset_size: 430380 - config_name: contextual_parametric_knowledge_conflicts_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 14587554 num_examples: 17528 - name: train num_bytes: 11666236 num_examples: 14023 - name: validation num_bytes: 2921318 num_examples: 3505 download_size: 0 dataset_size: 29175108 - config_name: crash_blossom_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 12194 num_examples: 38 - name: train num_bytes: 6999 num_examples: 22 - name: validation num_bytes: 5195 num_examples: 16 download_size: 0 dataset_size: 24388 - config_name: crass_ai_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 22870 num_examples: 44 - name: train num_bytes: 14130 num_examples: 28 - name: validation num_bytes: 8740 num_examples: 16 download_size: 0 dataset_size: 45740 - config_name: cryobiology_spanish_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 38674 num_examples: 146 - name: train num_bytes: 31129 num_examples: 117 - name: validation num_bytes: 7545 num_examples: 29 download_size: 0 dataset_size: 77348 - config_name: cryptonite_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 2844402 num_examples: 26157 - name: train num_bytes: 2275724 num_examples: 20926 - name: validation num_bytes: 568678 num_examples: 5231 download_size: 0 dataset_size: 5688804 - config_name: cs_algorithms_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 272435 num_examples: 1320 - name: train num_bytes: 218192 num_examples: 1056 - name: validation num_bytes: 54243 num_examples: 264 download_size: 0 dataset_size: 544870 - config_name: dark_humor_detection_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 26556 num_examples: 80 - name: train num_bytes: 21267 num_examples: 64 - name: validation num_bytes: 5289 num_examples: 16 download_size: 0 dataset_size: 53112 - config_name: date_understanding_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 94908 num_examples: 369 - name: train num_bytes: 76165 num_examples: 296 - name: validation num_bytes: 18743 num_examples: 73 download_size: 0 dataset_size: 189816 - config_name: disambiguation_qa_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 122471 num_examples: 258 - name: train num_bytes: 98687 num_examples: 207 - name: validation num_bytes: 23784 num_examples: 51 download_size: 0 dataset_size: 244942 - config_name: discourse_marker_prediction_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 2090684 num_examples: 857 - name: train num_bytes: 1666052 num_examples: 686 - name: validation num_bytes: 424632 num_examples: 171 download_size: 0 dataset_size: 4181368 - config_name: disfl_qa_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 7964775 num_examples: 8000 - name: train num_bytes: 6376511 num_examples: 6400 - name: validation num_bytes: 1588264 num_examples: 1600 download_size: 0 dataset_size: 15929550 - config_name: dyck_languages_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1227916 num_examples: 1000 - name: train num_bytes: 982680 num_examples: 800 - name: validation num_bytes: 245236 num_examples: 200 download_size: 0 dataset_size: 2455832 - config_name: elementary_math_qa_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 13442550 num_examples: 38160 - name: train num_bytes: 10766969 num_examples: 30531 - name: validation num_bytes: 2675581 num_examples: 7629 download_size: 0 dataset_size: 26885100 - config_name: emoji_movie_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 33667 num_examples: 100 - name: train num_bytes: 26987 num_examples: 80 - name: validation num_bytes: 6680 num_examples: 20 download_size: 0 dataset_size: 67334 - config_name: emojis_emotion_prediction_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 47983 num_examples: 131 - name: train num_bytes: 38458 num_examples: 105 - name: validation num_bytes: 9525 num_examples: 26 download_size: 0 dataset_size: 95966 - config_name: empirical_judgments_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 47499 num_examples: 99 - name: train num_bytes: 38346 num_examples: 80 - name: validation num_bytes: 9153 num_examples: 19 download_size: 0 dataset_size: 94998 - config_name: english_proverbs_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 22530 num_examples: 34 - name: train num_bytes: 12066 num_examples: 18 - name: validation num_bytes: 10464 num_examples: 16 download_size: 0 dataset_size: 45060 - config_name: english_russian_proverbs_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 59900 num_examples: 80 - name: train num_bytes: 48051 num_examples: 64 - name: validation num_bytes: 11849 num_examples: 16 download_size: 0 dataset_size: 119800 - config_name: entailed_polarity_hindi_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 57052 num_examples: 138 - name: train num_bytes: 45829 num_examples: 111 - name: validation num_bytes: 11223 num_examples: 27 download_size: 0 dataset_size: 114104 - config_name: entailed_polarity_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 25421 num_examples: 148 - name: train num_bytes: 20350 num_examples: 119 - name: validation num_bytes: 5071 num_examples: 29 download_size: 0 dataset_size: 50842 - config_name: epistemic_reasoning_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 887158 num_examples: 2000 - name: train num_bytes: 710107 num_examples: 1600 - name: validation num_bytes: 177051 num_examples: 400 download_size: 0 dataset_size: 1774316 - config_name: evaluating_information_essentiality_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 77488 num_examples: 68 - name: train num_bytes: 59596 num_examples: 52 - name: validation num_bytes: 17892 num_examples: 16 download_size: 0 dataset_size: 154976 - config_name: fact_checker_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1337384 num_examples: 7154 - name: train num_bytes: 1070750 num_examples: 5724 - name: validation num_bytes: 266634 num_examples: 1430 download_size: 0 dataset_size: 2674768 - config_name: fantasy_reasoning_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 75886 num_examples: 201 - name: train num_bytes: 61398 num_examples: 161 - name: validation num_bytes: 14488 num_examples: 40 download_size: 0 dataset_size: 151772 - config_name: few_shot_nlg_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 75937 num_examples: 153 - name: train num_bytes: 61862 num_examples: 123 - name: validation num_bytes: 14075 num_examples: 30 download_size: 0 dataset_size: 151874 - config_name: figure_of_speech_detection_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 21717 num_examples: 59 - name: train num_bytes: 15962 num_examples: 43 - name: validation num_bytes: 5755 num_examples: 16 download_size: 0 dataset_size: 43434 - config_name: formal_fallacies_syllogisms_negation_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 8314653 num_examples: 14200 - name: train num_bytes: 6652955 num_examples: 11360 - name: validation num_bytes: 1661698 num_examples: 2840 download_size: 0 dataset_size: 16629306 - config_name: gem_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 36065281 num_examples: 14802 - name: train num_bytes: 28819497 num_examples: 11845 - name: validation num_bytes: 7245784 num_examples: 2957 download_size: 0 dataset_size: 72130562 - config_name: gender_inclusive_sentences_german_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 126881 num_examples: 200 - name: train num_bytes: 100628 num_examples: 160 - name: validation num_bytes: 26253 num_examples: 40 download_size: 0 dataset_size: 253762 - config_name: general_knowledge_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 21828 num_examples: 70 - name: train num_bytes: 16818 num_examples: 54 - name: validation num_bytes: 5010 num_examples: 16 download_size: 0 dataset_size: 43656 - config_name: geometric_shapes_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 180094 num_examples: 359 - name: train num_bytes: 144602 num_examples: 288 - name: validation num_bytes: 35492 num_examples: 71 download_size: 0 dataset_size: 360188 - config_name: goal_step_wikihow_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 3567615 num_examples: 7053 - name: train num_bytes: 2853871 num_examples: 5643 - name: validation num_bytes: 713744 num_examples: 1410 download_size: 0 dataset_size: 7135230 - config_name: gre_reading_comprehension_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 94273 num_examples: 31 - name: train num_bytes: 44458 num_examples: 15 - name: validation num_bytes: 49815 num_examples: 16 download_size: 0 dataset_size: 188546 - config_name: hhh_alignment_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 272898 num_examples: 221 - name: train num_bytes: 212488 num_examples: 179 - name: validation num_bytes: 60410 num_examples: 42 download_size: 0 dataset_size: 545796 - config_name: hindi_question_answering_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 15154954 num_examples: 6610 - name: train num_bytes: 11983837 num_examples: 5288 - name: validation num_bytes: 3171117 num_examples: 1322 download_size: 0 dataset_size: 30309908 - config_name: hindu_knowledge_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 44092 num_examples: 175 - name: train num_bytes: 35392 num_examples: 140 - name: validation num_bytes: 8700 num_examples: 35 download_size: 0 dataset_size: 88184 - config_name: hinglish_toxicity_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 60613 num_examples: 200 - name: train num_bytes: 49997 num_examples: 160 - name: validation num_bytes: 10616 num_examples: 40 download_size: 0 dataset_size: 121226 - config_name: human_organs_senses_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 7944 num_examples: 42 - name: train num_bytes: 4873 num_examples: 26 - name: validation num_bytes: 3071 num_examples: 16 download_size: 0 dataset_size: 15888 - config_name: hyperbaton_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 9383986 num_examples: 50000 - name: train num_bytes: 7509334 num_examples: 40000 - name: validation num_bytes: 1874652 num_examples: 10000 download_size: 0 dataset_size: 18767972 - config_name: identify_math_theorems_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 104841 num_examples: 53 - name: train num_bytes: 70295 num_examples: 37 - name: validation num_bytes: 34546 num_examples: 16 download_size: 0 dataset_size: 209682 - config_name: identify_odd_metaphor_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 27602 num_examples: 47 - name: train num_bytes: 18138 num_examples: 31 - name: validation num_bytes: 9464 num_examples: 16 download_size: 0 dataset_size: 55204 - config_name: implicatures_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 91683 num_examples: 492 - name: train num_bytes: 73416 num_examples: 394 - name: validation num_bytes: 18267 num_examples: 98 download_size: 0 dataset_size: 183366 - config_name: implicit_relations_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 79710 num_examples: 85 - name: train num_bytes: 64346 num_examples: 68 - name: validation num_bytes: 15364 num_examples: 17 download_size: 0 dataset_size: 159420 - config_name: intent_recognition_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 322371 num_examples: 693 - name: train num_bytes: 257864 num_examples: 555 - name: validation num_bytes: 64507 num_examples: 138 download_size: 0 dataset_size: 644742 - config_name: international_phonetic_alphabet_nli_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 79320 num_examples: 126 - name: train num_bytes: 63288 num_examples: 101 - name: validation num_bytes: 16032 num_examples: 25 download_size: 0 dataset_size: 158640 - config_name: international_phonetic_alphabet_transliterate_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 275938 num_examples: 1003 - name: train num_bytes: 220784 num_examples: 803 - name: validation num_bytes: 55154 num_examples: 200 download_size: 0 dataset_size: 551876 - config_name: intersect_geometry_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 211674752 num_examples: 249999 - name: train num_bytes: 169332898 num_examples: 200000 - name: validation num_bytes: 42341854 num_examples: 49999 download_size: 0 dataset_size: 423349504 - config_name: irony_identification_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 28178 num_examples: 99 - name: train num_bytes: 22918 num_examples: 80 - name: validation num_bytes: 5260 num_examples: 19 download_size: 0 dataset_size: 56356 - config_name: kanji_ascii_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 366946 num_examples: 1092 - name: train num_bytes: 293933 num_examples: 875 - name: validation num_bytes: 73013 num_examples: 217 download_size: 0 dataset_size: 733892 - config_name: kannada_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 140638 num_examples: 316 - name: train num_bytes: 111865 num_examples: 253 - name: validation num_bytes: 28773 num_examples: 63 download_size: 0 dataset_size: 281276 - config_name: key_value_maps_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 105136 num_examples: 101 - name: train num_bytes: 84317 num_examples: 80 - name: validation num_bytes: 20819 num_examples: 21 download_size: 0 dataset_size: 210272 - config_name: known_unknowns_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 7960 num_examples: 46 - name: train num_bytes: 5130 num_examples: 30 - name: validation num_bytes: 2830 num_examples: 16 download_size: 0 dataset_size: 15920 - config_name: language_games_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 979619 num_examples: 2128 - name: train num_bytes: 783111 num_examples: 1704 - name: validation num_bytes: 196508 num_examples: 424 download_size: 0 dataset_size: 1959238 - config_name: language_identification_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 7376223 num_examples: 10000 - name: train num_bytes: 5908808 num_examples: 8000 - name: validation num_bytes: 1467415 num_examples: 2000 download_size: 0 dataset_size: 14752446 - config_name: linguistic_mappings_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1325186 num_examples: 15527 - name: train num_bytes: 1060088 num_examples: 12426 - name: validation num_bytes: 265098 num_examples: 3101 download_size: 0 dataset_size: 2650372 - config_name: linguistics_puzzles_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1746024 num_examples: 2000 - name: train num_bytes: 1398113 num_examples: 1600 - name: validation num_bytes: 347911 num_examples: 400 download_size: 0 dataset_size: 3492048 - config_name: list_functions_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 2678136 num_examples: 10750 - name: train num_bytes: 2161065 num_examples: 8700 - name: validation num_bytes: 517071 num_examples: 2050 download_size: 0 dataset_size: 5356272 - config_name: logic_grid_puzzle_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1456218 num_examples: 1000 - name: train num_bytes: 1160137 num_examples: 800 - name: validation num_bytes: 296081 num_examples: 200 download_size: 0 dataset_size: 2912436 - config_name: logical_args_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 43582 num_examples: 32 - name: train num_bytes: 21072 num_examples: 16 - name: validation num_bytes: 22510 num_examples: 16 download_size: 0 dataset_size: 87164 - config_name: logical_deduction_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1056716 num_examples: 1500 - name: train num_bytes: 841788 num_examples: 1200 - name: validation num_bytes: 214928 num_examples: 300 download_size: 0 dataset_size: 2113432 - config_name: logical_fallacy_detection_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 720286 num_examples: 2800 - name: train num_bytes: 576295 num_examples: 2240 - name: validation num_bytes: 143991 num_examples: 560 download_size: 0 dataset_size: 1440572 - config_name: logical_sequence_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 22722 num_examples: 39 - name: train num_bytes: 12648 num_examples: 23 - name: validation num_bytes: 10074 num_examples: 16 download_size: 0 dataset_size: 45444 - config_name: mathematical_induction_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 19018 num_examples: 69 - name: train num_bytes: 14983 num_examples: 53 - name: validation num_bytes: 4035 num_examples: 16 download_size: 0 dataset_size: 38036 - config_name: matrixshapes_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1130574 num_examples: 4462 - name: train num_bytes: 906061 num_examples: 3570 - name: validation num_bytes: 224513 num_examples: 892 download_size: 0 dataset_size: 2261148 - config_name: metaphor_boolean_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 213848 num_examples: 680 - name: train num_bytes: 170765 num_examples: 544 - name: validation num_bytes: 43083 num_examples: 136 download_size: 0 dataset_size: 427696 - config_name: metaphor_understanding_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 200862 num_examples: 234 - name: train num_bytes: 162101 num_examples: 188 - name: validation num_bytes: 38761 num_examples: 46 download_size: 0 dataset_size: 401724 - config_name: minute_mysteries_qa_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 3245190 num_examples: 477 - name: train num_bytes: 2623703 num_examples: 383 - name: validation num_bytes: 621487 num_examples: 94 download_size: 0 dataset_size: 6490380 - config_name: misconceptions_russian_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 16991 num_examples: 49 - name: train num_bytes: 10970 num_examples: 33 - name: validation num_bytes: 6021 num_examples: 16 download_size: 0 dataset_size: 33982 - config_name: misconceptions_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 45816 num_examples: 219 - name: train num_bytes: 37246 num_examples: 176 - name: validation num_bytes: 8570 num_examples: 43 download_size: 0 dataset_size: 91632 - config_name: mnist_ascii_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 61739808 num_examples: 69984 - name: train num_bytes: 49419928 num_examples: 55988 - name: validation num_bytes: 12319880 num_examples: 13996 download_size: 0 dataset_size: 123479616 - config_name: modified_arithmetic_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1220993 num_examples: 6000 - name: train num_bytes: 976859 num_examples: 4800 - name: validation num_bytes: 244134 num_examples: 1200 download_size: 0 dataset_size: 2441986 - config_name: moral_permissibility_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 162068 num_examples: 342 - name: train num_bytes: 128790 num_examples: 274 - name: validation num_bytes: 33278 num_examples: 68 download_size: 0 dataset_size: 324136 - config_name: movie_dialog_same_or_different_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 28645997 num_examples: 50000 - name: train num_bytes: 22889061 num_examples: 40000 - name: validation num_bytes: 5756936 num_examples: 10000 download_size: 0 dataset_size: 57291994 - config_name: movie_recommendation_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 173557 num_examples: 500 - name: train num_bytes: 138936 num_examples: 400 - name: validation num_bytes: 34621 num_examples: 100 download_size: 0 dataset_size: 347114 - config_name: mult_data_wrangling_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 625422 num_examples: 7854 - name: train num_bytes: 507838 num_examples: 6380 - name: validation num_bytes: 117584 num_examples: 1474 download_size: 0 dataset_size: 1250844 - config_name: multiemo_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 650173925 num_examples: 1437281 - name: train num_bytes: 520172185 num_examples: 1149873 - name: validation num_bytes: 130001740 num_examples: 287408 download_size: 0 dataset_size: 1300347850 - config_name: natural_instructions_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 355938370 num_examples: 193250 - name: train num_bytes: 284920096 num_examples: 154615 - name: validation num_bytes: 71018274 num_examples: 38635 download_size: 0 dataset_size: 711876740 - config_name: navigate_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 225813 num_examples: 1000 - name: train num_bytes: 180958 num_examples: 800 - name: validation num_bytes: 44855 num_examples: 200 download_size: 83744 dataset_size: 451626 - config_name: nonsense_words_grammar_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 11102 num_examples: 50 - name: train num_bytes: 7582 num_examples: 34 - name: validation num_bytes: 3520 num_examples: 16 download_size: 24107 dataset_size: 22204 - config_name: novel_concepts_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 16065 num_examples: 32 - name: train num_bytes: 8128 num_examples: 16 - name: validation num_bytes: 7937 num_examples: 16 download_size: 25919 dataset_size: 32130 - config_name: object_counting_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 149555 num_examples: 1000 - name: train num_bytes: 119609 num_examples: 800 - name: validation num_bytes: 29946 num_examples: 200 download_size: 91852 dataset_size: 299110 - config_name: odd_one_out_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 13843 num_examples: 86 - name: train num_bytes: 11217 num_examples: 69 - name: validation num_bytes: 2626 num_examples: 17 download_size: 25796 dataset_size: 27686 - config_name: operators_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 32435 num_examples: 210 - name: train num_bytes: 25937 num_examples: 168 - name: validation num_bytes: 6498 num_examples: 42 download_size: 24728 dataset_size: 64870 - config_name: paragraph_segmentation_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 56846507 num_examples: 9000 - name: train num_bytes: 45674320 num_examples: 7200 - name: validation num_bytes: 11172187 num_examples: 1800 download_size: 61123049 dataset_size: 113693014 - config_name: parsinlu_qa_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 456189 num_examples: 1050 - name: train num_bytes: 366577 num_examples: 840 - name: validation num_bytes: 89612 num_examples: 210 download_size: 465963 dataset_size: 912378 - config_name: parsinlu_reading_comprehension_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 573798 num_examples: 518 - name: train num_bytes: 455828 num_examples: 415 - name: validation num_bytes: 117970 num_examples: 103 download_size: 572992 dataset_size: 1147596 - config_name: penguins_in_a_table_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 75985 num_examples: 149 - name: train num_bytes: 61321 num_examples: 120 - name: validation num_bytes: 14664 num_examples: 29 download_size: 32039 dataset_size: 151970 - config_name: periodic_elements_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 285204 num_examples: 654 - name: train num_bytes: 229481 num_examples: 524 - name: validation num_bytes: 55723 num_examples: 130 download_size: 41084 dataset_size: 570408 - config_name: persian_idioms_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 28592 num_examples: 66 - name: train num_bytes: 21684 num_examples: 50 - name: validation num_bytes: 6908 num_examples: 16 download_size: 34341 dataset_size: 57184 - config_name: phrase_relatedness_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 30190 num_examples: 100 - name: train num_bytes: 23773 num_examples: 80 - name: validation num_bytes: 6417 num_examples: 20 download_size: 40334 dataset_size: 60380 - config_name: physical_intuition_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 23734 num_examples: 81 - name: train num_bytes: 19307 num_examples: 65 - name: validation num_bytes: 4427 num_examples: 16 download_size: 28462 dataset_size: 47468 - config_name: physics_questions_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 18372 num_examples: 54 - name: train num_bytes: 13402 num_examples: 38 - name: validation num_bytes: 4970 num_examples: 16 download_size: 35187 dataset_size: 36744 - config_name: physics_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 120239 num_examples: 229 - name: train num_bytes: 96122 num_examples: 184 - name: validation num_bytes: 24117 num_examples: 45 download_size: 69885 dataset_size: 240478 - config_name: play_dialog_same_or_different_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 3142468 num_examples: 3264 - name: train num_bytes: 2516052 num_examples: 2612 - name: validation num_bytes: 626416 num_examples: 652 download_size: 1710264 dataset_size: 6284936 - config_name: polish_sequence_labeling_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 18081112 num_examples: 12812 - name: train num_bytes: 14470720 num_examples: 10250 - name: validation num_bytes: 3610392 num_examples: 2562 download_size: 5242934 dataset_size: 36162224 - config_name: presuppositions_as_nli_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 502522 num_examples: 735 - name: train num_bytes: 400761 num_examples: 588 - name: validation num_bytes: 101761 num_examples: 147 download_size: 240065 dataset_size: 1005044 - config_name: qa_wikidata_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1419042 num_examples: 20321 - name: train num_bytes: 1134918 num_examples: 16257 - name: validation num_bytes: 284124 num_examples: 4064 download_size: 1181835 dataset_size: 2838084 - config_name: question_selection_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 2487181 num_examples: 1582 - name: train num_bytes: 1990094 num_examples: 1266 - name: validation num_bytes: 497087 num_examples: 316 download_size: 1804283 dataset_size: 4974362 - config_name: real_or_fake_text_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 53663318 num_examples: 15088 - name: train num_bytes: 42879846 num_examples: 12072 - name: validation num_bytes: 10783472 num_examples: 3016 download_size: 47399045 dataset_size: 107326636 - config_name: reasoning_about_colored_objects_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 907474 num_examples: 2000 - name: train num_bytes: 729609 num_examples: 1600 - name: validation num_bytes: 177865 num_examples: 400 download_size: 273263 dataset_size: 1814948 - config_name: repeat_copy_logic_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 6678 num_examples: 32 - name: train num_bytes: 3327 num_examples: 16 - name: validation num_bytes: 3351 num_examples: 16 download_size: 18315 dataset_size: 13356 - config_name: rephrase_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 34222 num_examples: 78 - name: train num_bytes: 27360 num_examples: 62 - name: validation num_bytes: 6862 num_examples: 16 download_size: 41102 dataset_size: 68444 - config_name: riddle_sense_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 15507 num_examples: 49 - name: train num_bytes: 10741 num_examples: 33 - name: validation num_bytes: 4766 num_examples: 16 download_size: 32496 dataset_size: 31014 - config_name: ruin_names_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 144087 num_examples: 448 - name: train num_bytes: 115171 num_examples: 359 - name: validation num_bytes: 28916 num_examples: 89 download_size: 118193 dataset_size: 288174 - config_name: salient_translation_error_detection_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1141626 num_examples: 998 - name: train num_bytes: 912819 num_examples: 799 - name: validation num_bytes: 228807 num_examples: 199 download_size: 413634 dataset_size: 2283252 - config_name: scientific_press_release_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 13690 num_examples: 50 - name: train num_bytes: 9254 num_examples: 34 - name: validation num_bytes: 4436 num_examples: 16 download_size: 27293 dataset_size: 27380 - config_name: semantic_parsing_in_context_sparc_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1524852 num_examples: 1155 - name: train num_bytes: 1248391 num_examples: 924 - name: validation num_bytes: 276461 num_examples: 231 download_size: 440326 dataset_size: 3049704 - config_name: semantic_parsing_spider_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1265744 num_examples: 1034 - name: train num_bytes: 973864 num_examples: 828 - name: validation num_bytes: 291880 num_examples: 206 download_size: 358276 dataset_size: 2531488 - config_name: sentence_ambiguity_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 8168 num_examples: 60 - name: train num_bytes: 5976 num_examples: 44 - name: validation num_bytes: 2192 num_examples: 16 download_size: 18275 dataset_size: 16336 - config_name: similarities_abstraction_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 23416 num_examples: 76 - name: train num_bytes: 18545 num_examples: 60 - name: validation num_bytes: 4871 num_examples: 16 download_size: 31521 dataset_size: 46832 - config_name: simp_turing_concept_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1017646 num_examples: 6390 - name: train num_bytes: 813220 num_examples: 5112 - name: validation num_bytes: 204426 num_examples: 1278 download_size: 402574 dataset_size: 2035292 - config_name: simple_arithmetic_json_multiple_choice_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 924 num_examples: 8 - name: train num_bytes: 0 num_examples: 0 - name: validation num_bytes: 0 num_examples: 0 download_size: 7777 dataset_size: 924 - config_name: simple_arithmetic_json_subtasks_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1145 num_examples: 30 - name: train num_bytes: 571 num_examples: 15 - name: validation num_bytes: 574 num_examples: 15 download_size: 10460 dataset_size: 2290 - config_name: simple_arithmetic_json_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1145 num_examples: 30 - name: train num_bytes: 540 num_examples: 14 - name: validation num_bytes: 605 num_examples: 16 download_size: 10645 dataset_size: 2290 - config_name: simple_arithmetic_multiple_targets_json_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 414 num_examples: 10 - name: train num_bytes: 0 num_examples: 0 - name: validation num_bytes: 0 num_examples: 0 download_size: 7352 dataset_size: 414 - config_name: simple_ethical_questions_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 76518 num_examples: 115 - name: train num_bytes: 60275 num_examples: 92 - name: validation num_bytes: 16243 num_examples: 23 download_size: 81285 dataset_size: 153036 - config_name: simple_text_editing_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 27865 num_examples: 47 - name: train num_bytes: 18469 num_examples: 31 - name: validation num_bytes: 9396 num_examples: 16 download_size: 27100 dataset_size: 55730 - config_name: snarks_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 45717 num_examples: 181 - name: train num_bytes: 36989 num_examples: 145 - name: validation num_bytes: 8728 num_examples: 36 download_size: 45434 dataset_size: 91434 - config_name: social_iqa_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 643162 num_examples: 1935 - name: train num_bytes: 515686 num_examples: 1548 - name: validation num_bytes: 127476 num_examples: 387 download_size: 684043 dataset_size: 1286324 - config_name: social_support_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 366705 num_examples: 897 - name: train num_bytes: 294793 num_examples: 718 - name: validation num_bytes: 71912 num_examples: 179 download_size: 288867 dataset_size: 733410 - config_name: sports_understanding_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 226654 num_examples: 986 - name: train num_bytes: 181328 num_examples: 789 - name: validation num_bytes: 45326 num_examples: 197 download_size: 82415 dataset_size: 453308 - config_name: strange_stories_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 120500 num_examples: 174 - name: train num_bytes: 98055 num_examples: 140 - name: validation num_bytes: 22445 num_examples: 34 download_size: 106428 dataset_size: 241000 - config_name: strategyqa_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 659967 num_examples: 2289 - name: train num_bytes: 527670 num_examples: 1832 - name: validation num_bytes: 132297 num_examples: 457 download_size: 814405 dataset_size: 1319934 - config_name: sufficient_information_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 9425 num_examples: 39 - name: train num_bytes: 5594 num_examples: 23 - name: validation num_bytes: 3831 num_examples: 16 download_size: 17766 dataset_size: 18850 - config_name: suicide_risk_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 37952 num_examples: 40 - name: train num_bytes: 23067 num_examples: 24 - name: validation num_bytes: 14885 num_examples: 16 download_size: 60518 dataset_size: 75904 - config_name: swahili_english_proverbs_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 90246 num_examples: 153 - name: train num_bytes: 72467 num_examples: 123 - name: validation num_bytes: 17779 num_examples: 30 download_size: 95186 dataset_size: 180492 - config_name: swedish_to_german_proverbs_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 35204 num_examples: 72 - name: train num_bytes: 27266 num_examples: 56 - name: validation num_bytes: 7938 num_examples: 16 download_size: 55102 dataset_size: 70408 - config_name: symbol_interpretation_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1148958 num_examples: 990 - name: train num_bytes: 927326 num_examples: 795 - name: validation num_bytes: 221632 num_examples: 195 download_size: 320412 dataset_size: 2297916 - config_name: temporal_sequences_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 687086 num_examples: 1000 - name: train num_bytes: 549808 num_examples: 800 - name: validation num_bytes: 137278 num_examples: 200 download_size: 295316 dataset_size: 1374172 - config_name: tense_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 43882 num_examples: 286 - name: train num_bytes: 35466 num_examples: 229 - name: validation num_bytes: 8416 num_examples: 57 download_size: 51466 dataset_size: 87764 - config_name: timedial_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 2763178 num_examples: 2550 - name: train num_bytes: 2217190 num_examples: 2040 - name: validation num_bytes: 545988 num_examples: 510 download_size: 2444115 dataset_size: 5526356 - config_name: topical_chat_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 30927758 num_examples: 22295 - name: train num_bytes: 24827254 num_examples: 17836 - name: validation num_bytes: 6100504 num_examples: 4459 download_size: 23505731 dataset_size: 61855516 - config_name: tracking_shuffled_objects_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 2775972 num_examples: 3750 - name: train num_bytes: 2224037 num_examples: 3000 - name: validation num_bytes: 551935 num_examples: 750 download_size: 738413 dataset_size: 5551944 - config_name: understanding_fables_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 227748 num_examples: 189 - name: train num_bytes: 181000 num_examples: 152 - name: validation num_bytes: 46748 num_examples: 37 download_size: 237036 dataset_size: 455496 - config_name: undo_permutation_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 196118 num_examples: 300 - name: train num_bytes: 158562 num_examples: 240 - name: validation num_bytes: 37556 num_examples: 60 download_size: 137204 dataset_size: 392236 - config_name: unit_conversion_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 4028628 num_examples: 23936 - name: train num_bytes: 3230357 num_examples: 19151 - name: validation num_bytes: 798271 num_examples: 4785 download_size: 3208622 dataset_size: 8057256 - config_name: unit_interpretation_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 37363 num_examples: 100 - name: train num_bytes: 29939 num_examples: 80 - name: validation num_bytes: 7424 num_examples: 20 download_size: 34926 dataset_size: 74726 - config_name: unnatural_in_context_learning_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 4599760 num_examples: 73420 - name: train num_bytes: 3679822 num_examples: 58736 - name: validation num_bytes: 919938 num_examples: 14684 download_size: 3840657 dataset_size: 9199520 - config_name: vitaminc_fact_verification_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 32361818 num_examples: 54668 - name: train num_bytes: 25889850 num_examples: 43735 - name: validation num_bytes: 6471968 num_examples: 10933 download_size: 14264790 dataset_size: 64723636 - config_name: what_is_the_tao_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 13268 num_examples: 36 - name: train num_bytes: 7435 num_examples: 20 - name: validation num_bytes: 5833 num_examples: 16 download_size: 27585 dataset_size: 26536 - config_name: which_wiki_edit_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 6331683 num_examples: 571 - name: train num_bytes: 5233870 num_examples: 457 - name: validation num_bytes: 1097813 num_examples: 114 download_size: 3914574 dataset_size: 12663366 - config_name: winowhy_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 1002434 num_examples: 2862 - name: train num_bytes: 800520 num_examples: 2290 - name: validation num_bytes: 201914 num_examples: 572 download_size: 449218 dataset_size: 2004868 - config_name: word_sorting_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 491054 num_examples: 1900 - name: train num_bytes: 392738 num_examples: 1520 - name: validation num_bytes: 98316 num_examples: 380 download_size: 641536 dataset_size: 982108 - config_name: word_unscrambling_zero_shot features: - name: idx dtype: int32 - name: inputs dtype: string - name: targets sequence: string - name: multiple_choice_targets sequence: string - name: multiple_choice_scores sequence: int32 splits: - name: default num_bytes: 882364 num_examples: 8917 - name: train num_bytes: 705755 num_examples: 7134 - name: validation num_bytes: 176609 num_examples: 1783 download_size: 563799 dataset_size: 1764728 configs: - config_name: abstract_narrative_understanding_zero_shot data_files: - split: default path: abstract_narrative_understanding_zero_shot/default-* - split: train path: abstract_narrative_understanding_zero_shot/train-* - split: validation path: abstract_narrative_understanding_zero_shot/validation-* - config_name: anachronisms_zero_shot data_files: - split: default path: anachronisms_zero_shot/default-* - split: train path: anachronisms_zero_shot/train-* - split: validation path: anachronisms_zero_shot/validation-* - config_name: analogical_similarity_zero_shot data_files: - split: default path: analogical_similarity_zero_shot/default-* - split: train path: analogical_similarity_zero_shot/train-* - split: validation path: analogical_similarity_zero_shot/validation-* - config_name: analytic_entailment_zero_shot data_files: - split: default path: analytic_entailment_zero_shot/default-* - split: train path: analytic_entailment_zero_shot/train-* - split: validation path: analytic_entailment_zero_shot/validation-* - config_name: arithmetic_zero_shot data_files: - split: default path: arithmetic_zero_shot/default-* - split: train path: arithmetic_zero_shot/train-* - split: validation path: arithmetic_zero_shot/validation-* - config_name: ascii_word_recognition_zero_shot data_files: - split: default path: ascii_word_recognition_zero_shot/default-* - split: train path: ascii_word_recognition_zero_shot/train-* - split: validation path: ascii_word_recognition_zero_shot/validation-* - config_name: authorship_verification_zero_shot data_files: - split: default path: authorship_verification_zero_shot/default-* - split: train path: authorship_verification_zero_shot/train-* - split: validation path: authorship_verification_zero_shot/validation-* - config_name: auto_categorization_zero_shot data_files: - split: default path: auto_categorization_zero_shot/default-* - split: train path: auto_categorization_zero_shot/train-* - split: validation path: auto_categorization_zero_shot/validation-* - config_name: auto_debugging_zero_shot data_files: - split: default path: auto_debugging_zero_shot/default-* - split: train path: auto_debugging_zero_shot/train-* - split: validation path: auto_debugging_zero_shot/validation-* - config_name: bbq_lite_json_zero_shot data_files: - split: default path: bbq_lite_json_zero_shot/default-* - split: train path: bbq_lite_json_zero_shot/train-* - split: validation path: bbq_lite_json_zero_shot/validation-* - config_name: bridging_anaphora_resolution_barqa_zero_shot data_files: - split: default path: bridging_anaphora_resolution_barqa_zero_shot/default-* - split: train path: bridging_anaphora_resolution_barqa_zero_shot/train-* - split: validation path: bridging_anaphora_resolution_barqa_zero_shot/validation-* - config_name: causal_judgment_zero_shot data_files: - split: default path: causal_judgment_zero_shot/default-* - split: train path: causal_judgment_zero_shot/train-* - split: validation path: causal_judgment_zero_shot/validation-* - config_name: cause_and_effect_zero_shot data_files: - split: default path: cause_and_effect_zero_shot/default-* - split: train path: cause_and_effect_zero_shot/train-* - split: validation path: cause_and_effect_zero_shot/validation-* - config_name: checkmate_in_one_zero_shot data_files: - split: default path: checkmate_in_one_zero_shot/default-* - split: train path: checkmate_in_one_zero_shot/train-* - split: validation path: checkmate_in_one_zero_shot/validation-* - config_name: chess_state_tracking_zero_shot data_files: - split: default path: chess_state_tracking_zero_shot/default-* - split: train path: chess_state_tracking_zero_shot/train-* - split: validation path: chess_state_tracking_zero_shot/validation-* - config_name: chinese_remainder_theorem_zero_shot data_files: - split: default path: chinese_remainder_theorem_zero_shot/default-* - split: train path: chinese_remainder_theorem_zero_shot/train-* - split: validation path: chinese_remainder_theorem_zero_shot/validation-* - config_name: cifar10_classification_zero_shot data_files: - split: default path: cifar10_classification_zero_shot/default-* - split: train path: cifar10_classification_zero_shot/train-* - split: validation path: cifar10_classification_zero_shot/validation-* - config_name: code_line_description_zero_shot data_files: - split: default path: code_line_description_zero_shot/default-* - split: train path: code_line_description_zero_shot/train-* - split: validation path: code_line_description_zero_shot/validation-* - config_name: codenames_zero_shot data_files: - split: default path: codenames_zero_shot/default-* - split: train path: codenames_zero_shot/train-* - split: validation path: codenames_zero_shot/validation-* - config_name: color_zero_shot data_files: - split: default path: color_zero_shot/default-* - split: train path: color_zero_shot/train-* - split: validation path: color_zero_shot/validation-* - config_name: common_morpheme_zero_shot data_files: - split: default path: common_morpheme_zero_shot/default-* - split: train path: common_morpheme_zero_shot/train-* - split: validation path: common_morpheme_zero_shot/validation-* - config_name: conceptual_combinations_zero_shot data_files: - split: default path: conceptual_combinations_zero_shot/default-* - split: train path: conceptual_combinations_zero_shot/train-* - split: validation path: conceptual_combinations_zero_shot/validation-* - config_name: conlang_translation_zero_shot data_files: - split: default path: conlang_translation_zero_shot/default-* - split: train path: conlang_translation_zero_shot/train-* - split: validation path: conlang_translation_zero_shot/validation-* - config_name: contextual_parametric_knowledge_conflicts_zero_shot data_files: - split: default path: contextual_parametric_knowledge_conflicts_zero_shot/default-* - split: train path: contextual_parametric_knowledge_conflicts_zero_shot/train-* - split: validation path: contextual_parametric_knowledge_conflicts_zero_shot/validation-* - config_name: crash_blossom_zero_shot data_files: - split: default path: crash_blossom_zero_shot/default-* - split: train path: crash_blossom_zero_shot/train-* - split: validation path: crash_blossom_zero_shot/validation-* - config_name: crass_ai_zero_shot data_files: - split: default path: crass_ai_zero_shot/default-* - split: train path: crass_ai_zero_shot/train-* - split: validation path: crass_ai_zero_shot/validation-* - config_name: cryobiology_spanish_zero_shot data_files: - split: default path: cryobiology_spanish_zero_shot/default-* - split: train path: cryobiology_spanish_zero_shot/train-* - split: validation path: cryobiology_spanish_zero_shot/validation-* - config_name: cryptonite_zero_shot data_files: - split: default path: cryptonite_zero_shot/default-* - split: train path: cryptonite_zero_shot/train-* - split: validation path: cryptonite_zero_shot/validation-* - config_name: cs_algorithms_zero_shot data_files: - split: default path: cs_algorithms_zero_shot/default-* - split: train path: cs_algorithms_zero_shot/train-* - split: validation path: cs_algorithms_zero_shot/validation-* - config_name: dark_humor_detection_zero_shot data_files: - split: default path: dark_humor_detection_zero_shot/default-* - split: train path: dark_humor_detection_zero_shot/train-* - split: validation path: dark_humor_detection_zero_shot/validation-* - config_name: date_understanding_zero_shot data_files: - split: default path: date_understanding_zero_shot/default-* - split: train path: date_understanding_zero_shot/train-* - split: validation path: date_understanding_zero_shot/validation-* - config_name: disambiguation_qa_zero_shot data_files: - split: default path: disambiguation_qa_zero_shot/default-* - split: train path: disambiguation_qa_zero_shot/train-* - split: validation path: disambiguation_qa_zero_shot/validation-* - config_name: discourse_marker_prediction_zero_shot data_files: - split: default path: discourse_marker_prediction_zero_shot/default-* - split: train path: discourse_marker_prediction_zero_shot/train-* - split: validation path: discourse_marker_prediction_zero_shot/validation-* - config_name: disfl_qa_zero_shot data_files: - split: default path: disfl_qa_zero_shot/default-* - split: train path: disfl_qa_zero_shot/train-* - split: validation path: disfl_qa_zero_shot/validation-* - config_name: dyck_languages_zero_shot data_files: - split: default path: dyck_languages_zero_shot/default-* - split: train path: dyck_languages_zero_shot/train-* - split: validation path: dyck_languages_zero_shot/validation-* - config_name: elementary_math_qa_zero_shot data_files: - split: default path: elementary_math_qa_zero_shot/default-* - split: train path: elementary_math_qa_zero_shot/train-* - split: validation path: elementary_math_qa_zero_shot/validation-* - config_name: emoji_movie_zero_shot data_files: - split: default path: emoji_movie_zero_shot/default-* - split: train path: emoji_movie_zero_shot/train-* - split: validation path: emoji_movie_zero_shot/validation-* - config_name: emojis_emotion_prediction_zero_shot data_files: - split: default path: emojis_emotion_prediction_zero_shot/default-* - split: train path: emojis_emotion_prediction_zero_shot/train-* - split: validation path: emojis_emotion_prediction_zero_shot/validation-* - config_name: empirical_judgments_zero_shot data_files: - split: default path: empirical_judgments_zero_shot/default-* - split: train path: empirical_judgments_zero_shot/train-* - split: validation path: empirical_judgments_zero_shot/validation-* - config_name: english_proverbs_zero_shot data_files: - split: default path: english_proverbs_zero_shot/default-* - split: train path: english_proverbs_zero_shot/train-* - split: validation path: english_proverbs_zero_shot/validation-* - config_name: english_russian_proverbs_zero_shot data_files: - split: default path: english_russian_proverbs_zero_shot/default-* - split: train path: english_russian_proverbs_zero_shot/train-* - split: validation path: english_russian_proverbs_zero_shot/validation-* - config_name: entailed_polarity_hindi_zero_shot data_files: - split: default path: entailed_polarity_hindi_zero_shot/default-* - split: train path: entailed_polarity_hindi_zero_shot/train-* - split: validation path: entailed_polarity_hindi_zero_shot/validation-* - config_name: entailed_polarity_zero_shot data_files: - split: default path: entailed_polarity_zero_shot/default-* - split: train path: entailed_polarity_zero_shot/train-* - split: validation path: entailed_polarity_zero_shot/validation-* - config_name: epistemic_reasoning_zero_shot data_files: - split: default path: epistemic_reasoning_zero_shot/default-* - split: train path: epistemic_reasoning_zero_shot/train-* - split: validation path: epistemic_reasoning_zero_shot/validation-* - config_name: evaluating_information_essentiality_zero_shot data_files: - split: default path: evaluating_information_essentiality_zero_shot/default-* - split: train path: evaluating_information_essentiality_zero_shot/train-* - split: validation path: evaluating_information_essentiality_zero_shot/validation-* - config_name: fact_checker_zero_shot data_files: - split: default path: fact_checker_zero_shot/default-* - split: train path: fact_checker_zero_shot/train-* - split: validation path: fact_checker_zero_shot/validation-* - config_name: fantasy_reasoning_zero_shot data_files: - split: default path: fantasy_reasoning_zero_shot/default-* - split: train path: fantasy_reasoning_zero_shot/train-* - split: validation path: fantasy_reasoning_zero_shot/validation-* - config_name: few_shot_nlg_zero_shot data_files: - split: default path: few_shot_nlg_zero_shot/default-* - split: train path: few_shot_nlg_zero_shot/train-* - split: validation path: few_shot_nlg_zero_shot/validation-* - config_name: figure_of_speech_detection_zero_shot data_files: - split: default path: figure_of_speech_detection_zero_shot/default-* - split: train path: figure_of_speech_detection_zero_shot/train-* - split: validation path: figure_of_speech_detection_zero_shot/validation-* - config_name: formal_fallacies_syllogisms_negation_zero_shot data_files: - split: default path: formal_fallacies_syllogisms_negation_zero_shot/default-* - split: train path: formal_fallacies_syllogisms_negation_zero_shot/train-* - split: validation path: formal_fallacies_syllogisms_negation_zero_shot/validation-* - config_name: gem_zero_shot data_files: - split: default path: gem_zero_shot/default-* - split: train path: gem_zero_shot/train-* - split: validation path: gem_zero_shot/validation-* - config_name: gender_inclusive_sentences_german_zero_shot data_files: - split: default path: gender_inclusive_sentences_german_zero_shot/default-* - split: train path: gender_inclusive_sentences_german_zero_shot/train-* - split: validation path: gender_inclusive_sentences_german_zero_shot/validation-* - config_name: general_knowledge_zero_shot data_files: - split: default path: general_knowledge_zero_shot/default-* - split: train path: general_knowledge_zero_shot/train-* - split: validation path: general_knowledge_zero_shot/validation-* - config_name: geometric_shapes_zero_shot data_files: - split: default path: geometric_shapes_zero_shot/default-* - split: train path: geometric_shapes_zero_shot/train-* - split: validation path: geometric_shapes_zero_shot/validation-* - config_name: goal_step_wikihow_zero_shot data_files: - split: default path: goal_step_wikihow_zero_shot/default-* - split: train path: goal_step_wikihow_zero_shot/train-* - split: validation path: goal_step_wikihow_zero_shot/validation-* - config_name: gre_reading_comprehension_zero_shot data_files: - split: default path: gre_reading_comprehension_zero_shot/default-* - split: train path: gre_reading_comprehension_zero_shot/train-* - split: validation path: gre_reading_comprehension_zero_shot/validation-* - config_name: hhh_alignment_zero_shot data_files: - split: default path: hhh_alignment_zero_shot/default-* - split: train path: hhh_alignment_zero_shot/train-* - split: validation path: hhh_alignment_zero_shot/validation-* - config_name: hindi_question_answering_zero_shot data_files: - split: default path: hindi_question_answering_zero_shot/default-* - split: train path: hindi_question_answering_zero_shot/train-* - split: validation path: hindi_question_answering_zero_shot/validation-* - config_name: hindu_knowledge_zero_shot data_files: - split: default path: hindu_knowledge_zero_shot/default-* - split: train path: hindu_knowledge_zero_shot/train-* - split: validation path: hindu_knowledge_zero_shot/validation-* - config_name: hinglish_toxicity_zero_shot data_files: - split: default path: hinglish_toxicity_zero_shot/default-* - split: train path: hinglish_toxicity_zero_shot/train-* - split: validation path: hinglish_toxicity_zero_shot/validation-* - config_name: human_organs_senses_zero_shot data_files: - split: default path: human_organs_senses_zero_shot/default-* - split: train path: human_organs_senses_zero_shot/train-* - split: validation path: human_organs_senses_zero_shot/validation-* - config_name: hyperbaton_zero_shot data_files: - split: default path: hyperbaton_zero_shot/default-* - split: train path: hyperbaton_zero_shot/train-* - split: validation path: hyperbaton_zero_shot/validation-* - config_name: identify_math_theorems_zero_shot data_files: - split: default path: identify_math_theorems_zero_shot/default-* - split: train path: identify_math_theorems_zero_shot/train-* - split: validation path: identify_math_theorems_zero_shot/validation-* - config_name: identify_odd_metaphor_zero_shot data_files: - split: default path: identify_odd_metaphor_zero_shot/default-* - split: train path: identify_odd_metaphor_zero_shot/train-* - split: validation path: identify_odd_metaphor_zero_shot/validation-* - config_name: implicatures_zero_shot data_files: - split: default path: implicatures_zero_shot/default-* - split: train path: implicatures_zero_shot/train-* - split: validation path: implicatures_zero_shot/validation-* - config_name: implicit_relations_zero_shot data_files: - split: default path: implicit_relations_zero_shot/default-* - split: train path: implicit_relations_zero_shot/train-* - split: validation path: implicit_relations_zero_shot/validation-* - config_name: intent_recognition_zero_shot data_files: - split: default path: intent_recognition_zero_shot/default-* - split: train path: intent_recognition_zero_shot/train-* - split: validation path: intent_recognition_zero_shot/validation-* - config_name: international_phonetic_alphabet_nli_zero_shot data_files: - split: default path: international_phonetic_alphabet_nli_zero_shot/default-* - split: train path: international_phonetic_alphabet_nli_zero_shot/train-* - split: validation path: international_phonetic_alphabet_nli_zero_shot/validation-* - config_name: international_phonetic_alphabet_transliterate_zero_shot data_files: - split: default path: international_phonetic_alphabet_transliterate_zero_shot/default-* - split: train path: international_phonetic_alphabet_transliterate_zero_shot/train-* - split: validation path: international_phonetic_alphabet_transliterate_zero_shot/validation-* - config_name: intersect_geometry_zero_shot data_files: - split: default path: intersect_geometry_zero_shot/default-* - split: train path: intersect_geometry_zero_shot/train-* - split: validation path: intersect_geometry_zero_shot/validation-* - config_name: irony_identification_zero_shot data_files: - split: default path: irony_identification_zero_shot/default-* - split: train path: irony_identification_zero_shot/train-* - split: validation path: irony_identification_zero_shot/validation-* - config_name: kanji_ascii_zero_shot data_files: - split: default path: kanji_ascii_zero_shot/default-* - split: train path: kanji_ascii_zero_shot/train-* - split: validation path: kanji_ascii_zero_shot/validation-* - config_name: kannada_zero_shot data_files: - split: default path: kannada_zero_shot/default-* - split: train path: kannada_zero_shot/train-* - split: validation path: kannada_zero_shot/validation-* - config_name: key_value_maps_zero_shot data_files: - split: default path: key_value_maps_zero_shot/default-* - split: train path: key_value_maps_zero_shot/train-* - split: validation path: key_value_maps_zero_shot/validation-* - config_name: known_unknowns_zero_shot data_files: - split: default path: known_unknowns_zero_shot/default-* - split: train path: known_unknowns_zero_shot/train-* - split: validation path: known_unknowns_zero_shot/validation-* - config_name: language_games_zero_shot data_files: - split: default path: language_games_zero_shot/default-* - split: train path: language_games_zero_shot/train-* - split: validation path: language_games_zero_shot/validation-* - config_name: language_identification_zero_shot data_files: - split: default path: language_identification_zero_shot/default-* - split: train path: language_identification_zero_shot/train-* - split: validation path: language_identification_zero_shot/validation-* - config_name: linguistic_mappings_zero_shot data_files: - split: default path: linguistic_mappings_zero_shot/default-* - split: train path: linguistic_mappings_zero_shot/train-* - split: validation path: linguistic_mappings_zero_shot/validation-* - config_name: linguistics_puzzles_zero_shot data_files: - split: default path: linguistics_puzzles_zero_shot/default-* - split: train path: linguistics_puzzles_zero_shot/train-* - split: validation path: linguistics_puzzles_zero_shot/validation-* - config_name: list_functions_zero_shot data_files: - split: default path: list_functions_zero_shot/default-* - split: train path: list_functions_zero_shot/train-* - split: validation path: list_functions_zero_shot/validation-* - config_name: logic_grid_puzzle_zero_shot data_files: - split: default path: logic_grid_puzzle_zero_shot/default-* - split: train path: logic_grid_puzzle_zero_shot/train-* - split: validation path: logic_grid_puzzle_zero_shot/validation-* - config_name: logical_args_zero_shot data_files: - split: default path: logical_args_zero_shot/default-* - split: train path: logical_args_zero_shot/train-* - split: validation path: logical_args_zero_shot/validation-* - config_name: logical_deduction_zero_shot data_files: - split: default path: logical_deduction_zero_shot/default-* - split: train path: logical_deduction_zero_shot/train-* - split: validation path: logical_deduction_zero_shot/validation-* - config_name: logical_fallacy_detection_zero_shot data_files: - split: default path: logical_fallacy_detection_zero_shot/default-* - split: train path: logical_fallacy_detection_zero_shot/train-* - split: validation path: logical_fallacy_detection_zero_shot/validation-* - config_name: logical_sequence_zero_shot data_files: - split: default path: logical_sequence_zero_shot/default-* - split: train path: logical_sequence_zero_shot/train-* - split: validation path: logical_sequence_zero_shot/validation-* - config_name: mathematical_induction_zero_shot data_files: - split: default path: mathematical_induction_zero_shot/default-* - split: train path: mathematical_induction_zero_shot/train-* - split: validation path: mathematical_induction_zero_shot/validation-* - config_name: matrixshapes_zero_shot data_files: - split: default path: matrixshapes_zero_shot/default-* - split: train path: matrixshapes_zero_shot/train-* - split: validation path: matrixshapes_zero_shot/validation-* - config_name: metaphor_boolean_zero_shot data_files: - split: default path: metaphor_boolean_zero_shot/default-* - split: train path: metaphor_boolean_zero_shot/train-* - split: validation path: metaphor_boolean_zero_shot/validation-* - config_name: metaphor_understanding_zero_shot data_files: - split: default path: metaphor_understanding_zero_shot/default-* - split: train path: metaphor_understanding_zero_shot/train-* - split: validation path: metaphor_understanding_zero_shot/validation-* - config_name: minute_mysteries_qa_zero_shot data_files: - split: default path: minute_mysteries_qa_zero_shot/default-* - split: train path: minute_mysteries_qa_zero_shot/train-* - split: validation path: minute_mysteries_qa_zero_shot/validation-* - config_name: misconceptions_russian_zero_shot data_files: - split: default path: misconceptions_russian_zero_shot/default-* - split: train path: misconceptions_russian_zero_shot/train-* - split: validation path: misconceptions_russian_zero_shot/validation-* - config_name: misconceptions_zero_shot data_files: - split: default path: misconceptions_zero_shot/default-* - split: train path: misconceptions_zero_shot/train-* - split: validation path: misconceptions_zero_shot/validation-* - config_name: mnist_ascii_zero_shot data_files: - split: default path: mnist_ascii_zero_shot/default-* - split: train path: mnist_ascii_zero_shot/train-* - split: validation path: mnist_ascii_zero_shot/validation-* - config_name: modified_arithmetic_zero_shot data_files: - split: default path: modified_arithmetic_zero_shot/default-* - split: train path: modified_arithmetic_zero_shot/train-* - split: validation path: modified_arithmetic_zero_shot/validation-* - config_name: moral_permissibility_zero_shot data_files: - split: default path: moral_permissibility_zero_shot/default-* - split: train path: moral_permissibility_zero_shot/train-* - split: validation path: moral_permissibility_zero_shot/validation-* - config_name: movie_dialog_same_or_different_zero_shot data_files: - split: default path: movie_dialog_same_or_different_zero_shot/default-* - split: train path: movie_dialog_same_or_different_zero_shot/train-* - split: validation path: movie_dialog_same_or_different_zero_shot/validation-* - config_name: movie_recommendation_zero_shot data_files: - split: default path: movie_recommendation_zero_shot/default-* - split: train path: movie_recommendation_zero_shot/train-* - split: validation path: movie_recommendation_zero_shot/validation-* - config_name: mult_data_wrangling_zero_shot data_files: - split: default path: mult_data_wrangling_zero_shot/default-* - split: train path: mult_data_wrangling_zero_shot/train-* - split: validation path: mult_data_wrangling_zero_shot/validation-* - config_name: multiemo_zero_shot data_files: - split: default path: multiemo_zero_shot/default-* - split: train path: multiemo_zero_shot/train-* - split: validation path: multiemo_zero_shot/validation-* - config_name: natural_instructions_zero_shot data_files: - split: default path: natural_instructions_zero_shot/default-* - split: train path: natural_instructions_zero_shot/train-* - split: validation path: natural_instructions_zero_shot/validation-* - config_name: navigate_zero_shot data_files: - split: default path: navigate_zero_shot/default-* - split: train path: navigate_zero_shot/train-* - split: validation path: navigate_zero_shot/validation-* - config_name: nonsense_words_grammar_zero_shot data_files: - split: default path: nonsense_words_grammar_zero_shot/default-* - split: train path: nonsense_words_grammar_zero_shot/train-* - split: validation path: nonsense_words_grammar_zero_shot/validation-* - config_name: novel_concepts_zero_shot data_files: - split: default path: novel_concepts_zero_shot/default-* - split: train path: novel_concepts_zero_shot/train-* - split: validation path: novel_concepts_zero_shot/validation-* - config_name: object_counting_zero_shot data_files: - split: default path: object_counting_zero_shot/default-* - split: train path: object_counting_zero_shot/train-* - split: validation path: object_counting_zero_shot/validation-* - config_name: odd_one_out_zero_shot data_files: - split: default path: odd_one_out_zero_shot/default-* - split: train path: odd_one_out_zero_shot/train-* - split: validation path: odd_one_out_zero_shot/validation-* - config_name: operators_zero_shot data_files: - split: default path: operators_zero_shot/default-* - split: train path: operators_zero_shot/train-* - split: validation path: operators_zero_shot/validation-* - config_name: paragraph_segmentation_zero_shot data_files: - split: default path: paragraph_segmentation_zero_shot/default-* - split: train path: paragraph_segmentation_zero_shot/train-* - split: validation path: paragraph_segmentation_zero_shot/validation-* - config_name: parsinlu_qa_zero_shot data_files: - split: default path: parsinlu_qa_zero_shot/default-* - split: train path: parsinlu_qa_zero_shot/train-* - split: validation path: parsinlu_qa_zero_shot/validation-* - config_name: parsinlu_reading_comprehension_zero_shot data_files: - split: default path: parsinlu_reading_comprehension_zero_shot/default-* - split: train path: parsinlu_reading_comprehension_zero_shot/train-* - split: validation path: parsinlu_reading_comprehension_zero_shot/validation-* - config_name: penguins_in_a_table_zero_shot data_files: - split: default path: penguins_in_a_table_zero_shot/default-* - split: train path: penguins_in_a_table_zero_shot/train-* - split: validation path: penguins_in_a_table_zero_shot/validation-* - config_name: periodic_elements_zero_shot data_files: - split: default path: periodic_elements_zero_shot/default-* - split: train path: periodic_elements_zero_shot/train-* - split: validation path: periodic_elements_zero_shot/validation-* - config_name: persian_idioms_zero_shot data_files: - split: default path: persian_idioms_zero_shot/default-* - split: train path: persian_idioms_zero_shot/train-* - split: validation path: persian_idioms_zero_shot/validation-* - config_name: phrase_relatedness_zero_shot data_files: - split: default path: phrase_relatedness_zero_shot/default-* - split: train path: phrase_relatedness_zero_shot/train-* - split: validation path: phrase_relatedness_zero_shot/validation-* - config_name: physical_intuition_zero_shot data_files: - split: default path: physical_intuition_zero_shot/default-* - split: train path: physical_intuition_zero_shot/train-* - split: validation path: physical_intuition_zero_shot/validation-* - config_name: physics_questions_zero_shot data_files: - split: default path: physics_questions_zero_shot/default-* - split: train path: physics_questions_zero_shot/train-* - split: validation path: physics_questions_zero_shot/validation-* - config_name: physics_zero_shot data_files: - split: default path: physics_zero_shot/default-* - split: train path: physics_zero_shot/train-* - split: validation path: physics_zero_shot/validation-* - config_name: play_dialog_same_or_different_zero_shot data_files: - split: default path: play_dialog_same_or_different_zero_shot/default-* - split: train path: play_dialog_same_or_different_zero_shot/train-* - split: validation path: play_dialog_same_or_different_zero_shot/validation-* - config_name: polish_sequence_labeling_zero_shot data_files: - split: default path: polish_sequence_labeling_zero_shot/default-* - split: train path: polish_sequence_labeling_zero_shot/train-* - split: validation path: polish_sequence_labeling_zero_shot/validation-* - config_name: presuppositions_as_nli_zero_shot data_files: - split: default path: presuppositions_as_nli_zero_shot/default-* - split: train path: presuppositions_as_nli_zero_shot/train-* - split: validation path: presuppositions_as_nli_zero_shot/validation-* - config_name: qa_wikidata_zero_shot data_files: - split: default path: qa_wikidata_zero_shot/default-* - split: train path: qa_wikidata_zero_shot/train-* - split: validation path: qa_wikidata_zero_shot/validation-* - config_name: question_selection_zero_shot data_files: - split: default path: question_selection_zero_shot/default-* - split: train path: question_selection_zero_shot/train-* - split: validation path: question_selection_zero_shot/validation-* - config_name: real_or_fake_text_zero_shot data_files: - split: default path: real_or_fake_text_zero_shot/default-* - split: train path: real_or_fake_text_zero_shot/train-* - split: validation path: real_or_fake_text_zero_shot/validation-* - config_name: reasoning_about_colored_objects_zero_shot data_files: - split: default path: reasoning_about_colored_objects_zero_shot/default-* - split: train path: reasoning_about_colored_objects_zero_shot/train-* - split: validation path: reasoning_about_colored_objects_zero_shot/validation-* - config_name: repeat_copy_logic_zero_shot data_files: - split: default path: repeat_copy_logic_zero_shot/default-* - split: train path: repeat_copy_logic_zero_shot/train-* - split: validation path: repeat_copy_logic_zero_shot/validation-* - config_name: rephrase_zero_shot data_files: - split: default path: rephrase_zero_shot/default-* - split: train path: rephrase_zero_shot/train-* - split: validation path: rephrase_zero_shot/validation-* - config_name: riddle_sense_zero_shot data_files: - split: default path: riddle_sense_zero_shot/default-* - split: train path: riddle_sense_zero_shot/train-* - split: validation path: riddle_sense_zero_shot/validation-* - config_name: ruin_names_zero_shot data_files: - split: default path: ruin_names_zero_shot/default-* - split: train path: ruin_names_zero_shot/train-* - split: validation path: ruin_names_zero_shot/validation-* - config_name: salient_translation_error_detection_zero_shot data_files: - split: default path: salient_translation_error_detection_zero_shot/default-* - split: train path: salient_translation_error_detection_zero_shot/train-* - split: validation path: salient_translation_error_detection_zero_shot/validation-* - config_name: scientific_press_release_zero_shot data_files: - split: default path: scientific_press_release_zero_shot/default-* - split: train path: scientific_press_release_zero_shot/train-* - split: validation path: scientific_press_release_zero_shot/validation-* - config_name: semantic_parsing_in_context_sparc_zero_shot data_files: - split: default path: semantic_parsing_in_context_sparc_zero_shot/default-* - split: train path: semantic_parsing_in_context_sparc_zero_shot/train-* - split: validation path: semantic_parsing_in_context_sparc_zero_shot/validation-* - config_name: semantic_parsing_spider_zero_shot data_files: - split: default path: semantic_parsing_spider_zero_shot/default-* - split: train path: semantic_parsing_spider_zero_shot/train-* - split: validation path: semantic_parsing_spider_zero_shot/validation-* - config_name: sentence_ambiguity_zero_shot data_files: - split: default path: sentence_ambiguity_zero_shot/default-* - split: train path: sentence_ambiguity_zero_shot/train-* - split: validation path: sentence_ambiguity_zero_shot/validation-* - config_name: similarities_abstraction_zero_shot data_files: - split: default path: similarities_abstraction_zero_shot/default-* - split: train path: similarities_abstraction_zero_shot/train-* - split: validation path: similarities_abstraction_zero_shot/validation-* - config_name: simp_turing_concept_zero_shot data_files: - split: default path: simp_turing_concept_zero_shot/default-* - split: train path: simp_turing_concept_zero_shot/train-* - split: validation path: simp_turing_concept_zero_shot/validation-* - config_name: simple_arithmetic_json_multiple_choice_zero_shot data_files: - split: default path: simple_arithmetic_json_multiple_choice_zero_shot/default-* - split: train path: simple_arithmetic_json_multiple_choice_zero_shot/train-* - split: validation path: simple_arithmetic_json_multiple_choice_zero_shot/validation-* - config_name: simple_arithmetic_json_subtasks_zero_shot data_files: - split: default path: simple_arithmetic_json_subtasks_zero_shot/default-* - split: train path: simple_arithmetic_json_subtasks_zero_shot/train-* - split: validation path: simple_arithmetic_json_subtasks_zero_shot/validation-* - config_name: simple_arithmetic_json_zero_shot data_files: - split: default path: simple_arithmetic_json_zero_shot/default-* - split: train path: simple_arithmetic_json_zero_shot/train-* - split: validation path: simple_arithmetic_json_zero_shot/validation-* - config_name: simple_arithmetic_multiple_targets_json_zero_shot data_files: - split: default path: simple_arithmetic_multiple_targets_json_zero_shot/default-* - split: train path: simple_arithmetic_multiple_targets_json_zero_shot/train-* - split: validation path: simple_arithmetic_multiple_targets_json_zero_shot/validation-* - config_name: simple_ethical_questions_zero_shot data_files: - split: default path: simple_ethical_questions_zero_shot/default-* - split: train path: simple_ethical_questions_zero_shot/train-* - split: validation path: simple_ethical_questions_zero_shot/validation-* - config_name: simple_text_editing_zero_shot data_files: - split: default path: simple_text_editing_zero_shot/default-* - split: train path: simple_text_editing_zero_shot/train-* - split: validation path: simple_text_editing_zero_shot/validation-* - config_name: snarks_zero_shot data_files: - split: default path: snarks_zero_shot/default-* - split: train path: snarks_zero_shot/train-* - split: validation path: snarks_zero_shot/validation-* - config_name: social_iqa_zero_shot data_files: - split: default path: social_iqa_zero_shot/default-* - split: train path: social_iqa_zero_shot/train-* - split: validation path: social_iqa_zero_shot/validation-* - config_name: social_support_zero_shot data_files: - split: default path: social_support_zero_shot/default-* - split: train path: social_support_zero_shot/train-* - split: validation path: social_support_zero_shot/validation-* - config_name: sports_understanding_zero_shot data_files: - split: default path: sports_understanding_zero_shot/default-* - split: train path: sports_understanding_zero_shot/train-* - split: validation path: sports_understanding_zero_shot/validation-* - config_name: strange_stories_zero_shot data_files: - split: default path: strange_stories_zero_shot/default-* - split: train path: strange_stories_zero_shot/train-* - split: validation path: strange_stories_zero_shot/validation-* - config_name: strategyqa_zero_shot data_files: - split: default path: strategyqa_zero_shot/default-* - split: train path: strategyqa_zero_shot/train-* - split: validation path: strategyqa_zero_shot/validation-* - config_name: sufficient_information_zero_shot data_files: - split: default path: sufficient_information_zero_shot/default-* - split: train path: sufficient_information_zero_shot/train-* - split: validation path: sufficient_information_zero_shot/validation-* - config_name: suicide_risk_zero_shot data_files: - split: default path: suicide_risk_zero_shot/default-* - split: train path: suicide_risk_zero_shot/train-* - split: validation path: suicide_risk_zero_shot/validation-* - config_name: swahili_english_proverbs_zero_shot data_files: - split: default path: swahili_english_proverbs_zero_shot/default-* - split: train path: swahili_english_proverbs_zero_shot/train-* - split: validation path: swahili_english_proverbs_zero_shot/validation-* - config_name: swedish_to_german_proverbs_zero_shot data_files: - split: default path: swedish_to_german_proverbs_zero_shot/default-* - split: train path: swedish_to_german_proverbs_zero_shot/train-* - split: validation path: swedish_to_german_proverbs_zero_shot/validation-* - config_name: symbol_interpretation_zero_shot data_files: - split: default path: symbol_interpretation_zero_shot/default-* - split: train path: symbol_interpretation_zero_shot/train-* - split: validation path: symbol_interpretation_zero_shot/validation-* - config_name: temporal_sequences_zero_shot data_files: - split: default path: temporal_sequences_zero_shot/default-* - split: train path: temporal_sequences_zero_shot/train-* - split: validation path: temporal_sequences_zero_shot/validation-* - config_name: tense_zero_shot data_files: - split: default path: tense_zero_shot/default-* - split: train path: tense_zero_shot/train-* - split: validation path: tense_zero_shot/validation-* - config_name: timedial_zero_shot data_files: - split: default path: timedial_zero_shot/default-* - split: train path: timedial_zero_shot/train-* - split: validation path: timedial_zero_shot/validation-* - config_name: topical_chat_zero_shot data_files: - split: default path: topical_chat_zero_shot/default-* - split: train path: topical_chat_zero_shot/train-* - split: validation path: topical_chat_zero_shot/validation-* - config_name: tracking_shuffled_objects_zero_shot data_files: - split: default path: tracking_shuffled_objects_zero_shot/default-* - split: train path: tracking_shuffled_objects_zero_shot/train-* - split: validation path: tracking_shuffled_objects_zero_shot/validation-* - config_name: understanding_fables_zero_shot data_files: - split: default path: understanding_fables_zero_shot/default-* - split: train path: understanding_fables_zero_shot/train-* - split: validation path: understanding_fables_zero_shot/validation-* - config_name: undo_permutation_zero_shot data_files: - split: default path: undo_permutation_zero_shot/default-* - split: train path: undo_permutation_zero_shot/train-* - split: validation path: undo_permutation_zero_shot/validation-* - config_name: unit_conversion_zero_shot data_files: - split: default path: unit_conversion_zero_shot/default-* - split: train path: unit_conversion_zero_shot/train-* - split: validation path: unit_conversion_zero_shot/validation-* - config_name: unit_interpretation_zero_shot data_files: - split: default path: unit_interpretation_zero_shot/default-* - split: train path: unit_interpretation_zero_shot/train-* - split: validation path: unit_interpretation_zero_shot/validation-* - config_name: unnatural_in_context_learning_zero_shot data_files: - split: default path: unnatural_in_context_learning_zero_shot/default-* - split: train path: unnatural_in_context_learning_zero_shot/train-* - split: validation path: unnatural_in_context_learning_zero_shot/validation-* - config_name: vitaminc_fact_verification_zero_shot data_files: - split: default path: vitaminc_fact_verification_zero_shot/default-* - split: train path: vitaminc_fact_verification_zero_shot/train-* - split: validation path: vitaminc_fact_verification_zero_shot/validation-* - config_name: what_is_the_tao_zero_shot data_files: - split: default path: what_is_the_tao_zero_shot/default-* - split: train path: what_is_the_tao_zero_shot/train-* - split: validation path: what_is_the_tao_zero_shot/validation-* - config_name: which_wiki_edit_zero_shot data_files: - split: default path: which_wiki_edit_zero_shot/default-* - split: train path: which_wiki_edit_zero_shot/train-* - split: validation path: which_wiki_edit_zero_shot/validation-* - config_name: winowhy_zero_shot data_files: - split: default path: winowhy_zero_shot/default-* - split: train path: winowhy_zero_shot/train-* - split: validation path: winowhy_zero_shot/validation-* - config_name: word_sorting_zero_shot data_files: - split: default path: word_sorting_zero_shot/default-* - split: train path: word_sorting_zero_shot/train-* - split: validation path: word_sorting_zero_shot/validation-* - config_name: word_unscrambling_zero_shot data_files: - split: default path: word_unscrambling_zero_shot/default-* - split: train path: word_unscrambling_zero_shot/train-* - split: validation path: word_unscrambling_zero_shot/validation-* --- # Dataset Card for "bigbench" [More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

提供机构：

hails

原始信息汇总

数据集概述

该数据集包含多个子集，每个子集都有特定的配置名称、特征、分割和大小信息。以下是各个子集的详细信息：

子集列表

`abstract_narrative_understanding_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 6560069 bytes, 3000 examples
- train: 5249819 bytes, 2400 examples
- validation: 1310250 bytes, 600 examples
大小:
- 数据集大小: 13120138 bytes

`anachronisms_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 48826 bytes, 230 examples
- train: 39116 bytes, 184 examples
- validation: 9710 bytes, 46 examples
大小:
- 数据集大小: 97652 bytes

`analogical_similarity_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 1373815 bytes, 323 examples
- train: 1101512 bytes, 259 examples
- validation: 272303 bytes, 64 examples
大小:
- 数据集大小: 2747630 bytes

`analytic_entailment_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 17316 bytes, 70 examples
- train: 13368 bytes, 54 examples
- validation: 3948 bytes, 16 examples
大小:
- 数据集大小: 34632 bytes

`arithmetic_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 3833272 bytes, 15023 examples
- train: 3066775 bytes, 12019 examples
- validation: 766497 bytes, 3004 examples
大小:
- 数据集大小: 7666544 bytes

`ascii_word_recognition_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 4984662 bytes, 5000 examples
- train: 3997273 bytes, 4000 examples
- validation: 987389 bytes, 1000 examples
大小:
- 数据集大小: 9969324 bytes

`authorship_verification_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 14118592 bytes, 880 examples
- train: 11288481 bytes, 704 examples
- validation: 2830111 bytes, 176 examples
大小:
- 数据集大小: 28237184 bytes

`auto_categorization_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 40549 bytes, 328 examples
- train: 32992 bytes, 263 examples
- validation: 7557 bytes, 65 examples
大小:
- 数据集大小: 81098 bytes

`auto_debugging_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 5112 bytes, 34 examples
- train: 2651 bytes, 18 examples
- validation: 2461 bytes, 16 examples
大小:
- 数据集大小: 10224 bytes

`bbq_lite_json_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 6890493 bytes, 16076 examples
- train: 5508584 bytes, 12866 examples
- validation: 1381909 bytes, 3210 examples
大小:
- 数据集大小: 13780986 bytes

`bridging_anaphora_resolution_barqa_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 1971015 bytes, 648 examples
- train: 1537264 bytes, 519 examples
- validation: 433751 bytes, 129 examples
大小:
- 数据集大小: 3942030 bytes

`causal_judgment_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 204878 bytes, 190 examples
- train: 164940 bytes, 152 examples
- validation: 39938 bytes, 38 examples
大小:
- 数据集大小: 409756 bytes

`cause_and_effect_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 49314 bytes, 153 examples
- train: 39620 bytes, 123 examples
- validation: 9694 bytes, 30 examples
大小:
- 数据集大小: 98628 bytes

`checkmate_in_one_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 3123256 bytes, 3498 examples
- train: 2502314 bytes, 2799 examples
- validation: 620942 bytes, 699 examples
大小:
- 数据集大小: 6246512 bytes

`chess_state_tracking_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 3269932 bytes, 6000 examples
- train: 2616294 bytes, 4800 examples
- validation: 653638 bytes, 1200 examples
大小:
- 数据集大小: 6539864 bytes

`chinese_remainder_theorem_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 153222 bytes, 500 examples
- train: 122601 bytes, 400 examples
- validation: 30621 bytes, 100 examples
大小:
- 数据集大小: 306444 bytes

`cifar10_classification_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 111022200 bytes, 20000 examples
- train: 88782724 bytes, 16000 examples
- validation: 22239476 bytes, 4000 examples
大小:
- 数据集大小: 222044400 bytes

`code_line_description_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 33670 bytes, 60 examples
- train: 25530 bytes, 44 examples
- validation: 8140 bytes, 16 examples
大小:
- 数据集大小: 67340 bytes

`codenames_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 25195 bytes, 85 examples
- train: 19964 bytes, 68 examples
- validation: 5231 bytes, 17 examples
大小:
- 数据集大小: 50390 bytes

`color_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 1633263 bytes, 4000 examples
- train: 1306663 bytes, 3200 examples
- validation: 326600 bytes, 800 examples
大小:
- 数据集大小: 3266526 bytes

`common_morpheme_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 12388 bytes, 50 examples
- train: 8444 bytes, 34 examples
- validation: 3944 bytes, 16 examples
大小:
- 数据集大小: 24776 bytes

`conceptual_combinations_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 58859 bytes, 103 examples
- train: 48010 bytes, 84 examples
- validation: 10849 bytes, 19 examples
大小:
- 数据集大小: 117718 bytes

`conlang_translation_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 215190 bytes, 164 examples
- train: 173024 bytes, 132 examples
- validation: 42166 bytes, 32 examples
大小:
- 数据集大小: 430380 bytes

`contextual_parametric_knowledge_conflicts_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 14587554 bytes, 17528 examples
- train: 11666236 bytes, 14023 examples
- validation: 2921318 bytes, 3505 examples
大小:
- 数据集大小: 29175108 bytes

`crash_blossom_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 12194 bytes, 38 examples
- train: 6999 bytes, 22 examples
- validation: 5195 bytes, 16 examples
大小:
- 数据集大小: 24388 bytes

`crass_ai_zero_shot`

特征:
- idx: int32
- inputs: string
- targets: sequence of string
- multiple_choice_targets: sequence of string
- multiple_choice_scores: sequence of int32
分割:
- default: 22870 bytes, 4

5,000+

优质数据集

54 个

任务类型

进入经典数据集