five

RanGu2025/P3

收藏
Hugging Face2026-04-02 更新2026-04-12 收录
下载链接：
https://hf-mirror.com/datasets/RanGu2025/P3
下载链接
链接失效反馈
官方服务：
资源简介：
--- annotations_creators: - crowdsourced - expert-generated language: - en license: - apache-2.0 multilinguality: - monolingual size_categories: - 100M<n<1B task_categories: - other pretty_name: P3 dataset_info: - config_name: adversarial_qa_dbert_answer_the_following_q features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 18313753 num_examples: 10000 - name: validation num_bytes: 1791034 num_examples: 1000 download_size: 6288641 dataset_size: 20104787 - config_name: adversarial_qa_dbert_based_on features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 17580553 num_examples: 10000 - name: validation num_bytes: 1717566 num_examples: 1000 download_size: 6206744 dataset_size: 19298119 - config_name: adversarial_qa_dbert_generate_question features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 18552810 num_examples: 10000 - name: validation num_bytes: 1824231 num_examples: 1000 - name: test num_bytes: 1954952 num_examples: 1000 download_size: 5882604 dataset_size: 22331993 - config_name: adversarial_qa_dbert_question_context_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 16859685 num_examples: 10000 - name: validation num_bytes: 1646118 num_examples: 1000 download_size: 6180363 dataset_size: 18505803 - config_name: adversarial_qa_dbert_tell_what_it_is features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 17793277 num_examples: 10000 - name: validation num_bytes: 1739418 num_examples: 1000 download_size: 6276720 dataset_size: 19532695 - config_name: adversarial_qa_dbidaf_answer_the_following_q features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 18273217 num_examples: 10000 - name: validation num_bytes: 1797789 num_examples: 1000 download_size: 6321670 dataset_size: 20071006 - config_name: adversarial_qa_dbidaf_based_on features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 17539777 num_examples: 10000 - name: validation num_bytes: 1724577 num_examples: 1000 download_size: 6247591 dataset_size: 19264354 - config_name: adversarial_qa_dbidaf_generate_question features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 18508967 num_examples: 10000 - name: validation num_bytes: 1830585 num_examples: 1000 - name: test num_bytes: 1925723 num_examples: 1000 download_size: 5983857 dataset_size: 22265275 - config_name: adversarial_qa_dbidaf_question_context_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 16821505 num_examples: 10000 - name: validation num_bytes: 1652425 num_examples: 1000 download_size: 6292806 dataset_size: 18473930 - config_name: adversarial_qa_dbidaf_tell_what_it_is features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 17755161 num_examples: 10000 - name: validation num_bytes: 1745717 num_examples: 1000 download_size: 6250903 dataset_size: 19500878 - config_name: adversarial_qa_droberta_answer_the_following_q features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 18084393 num_examples: 10000 - name: validation num_bytes: 1798375 num_examples: 1000 download_size: 6223439 dataset_size: 19882768 - config_name: adversarial_qa_droberta_based_on features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 17352073 num_examples: 10000 - name: validation num_bytes: 1725151 num_examples: 1000 download_size: 6202901 dataset_size: 19077224 - config_name: adversarial_qa_droberta_generate_question features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 18257414 num_examples: 10000 - name: validation num_bytes: 1828966 num_examples: 1000 - name: test num_bytes: 1997556 num_examples: 1000 download_size: 5928633 dataset_size: 22083936 - config_name: adversarial_qa_droberta_question_context_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 16638393 num_examples: 10000 - name: validation num_bytes: 1653815 num_examples: 1000 download_size: 6193786 dataset_size: 18292208 - config_name: adversarial_qa_droberta_tell_what_it_is features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 17571837 num_examples: 10000 - name: validation num_bytes: 1747043 num_examples: 1000 download_size: 6152157 dataset_size: 19318880 - config_name: ag_news_classify features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 79459523 num_examples: 120000 - name: test num_bytes: 5007082 num_examples: 7600 download_size: 37504540 dataset_size: 84466605 - config_name: ag_news_classify_question_first features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 79339523 num_examples: 120000 - name: test num_bytes: 4999482 num_examples: 7600 download_size: 37311664 dataset_size: 84339005 - config_name: ag_news_classify_with_choices features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 91699523 num_examples: 120000 - name: test num_bytes: 5782282 num_examples: 7600 download_size: 38377186 dataset_size: 97481805 - config_name: ag_news_classify_with_choices_question_first features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 91699523 num_examples: 120000 - name: test num_bytes: 5782282 num_examples: 7600 download_size: 38318638 dataset_size: 97481805 - config_name: ag_news_recommend features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 94039523 num_examples: 120000 - name: test num_bytes: 5930482 num_examples: 7600 download_size: 38368116 dataset_size: 99970005 - config_name: ag_news_which_section features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 83899523 num_examples: 120000 - name: test num_bytes: 5288282 num_examples: 7600 download_size: 37893964 dataset_size: 89187805 - config_name: ag_news_which_section_choices features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 100099523 num_examples: 120000 - name: test num_bytes: 6314282 num_examples: 7600 download_size: 39167925 dataset_size: 106413805 - config_name: ai2_arc_ARC_Challenge_heres_a_problem features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 870695 num_examples: 1119 - name: validation num_bytes: 237526 num_examples: 299 - name: test num_bytes: 929144 num_examples: 1172 download_size: 796298 dataset_size: 2037365 - config_name: ai2_arc_ARC_Challenge_i_am_hesitating features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1063080 num_examples: 1119 - name: validation num_bytes: 290313 num_examples: 299 - name: test num_bytes: 1135794 num_examples: 1172 download_size: 1087298 dataset_size: 2489187 - config_name: ai2_arc_ARC_Challenge_multiple_choice features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1079865 num_examples: 1119 - name: validation num_bytes: 294798 num_examples: 299 - name: test num_bytes: 1153374 num_examples: 1172 download_size: 1096748 dataset_size: 2528037 - config_name: ai2_arc_ARC_Challenge_pick_false_options features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 965402 num_examples: 1119 - name: validation num_bytes: 263171 num_examples: 299 - name: test num_bytes: 1032956 num_examples: 1172 download_size: 1043688 dataset_size: 2261529 - config_name: ai2_arc_ARC_Challenge_pick_the_most_correct_option features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 812508 num_examples: 1119 - name: validation num_bytes: 221981 num_examples: 299 - name: test num_bytes: 868204 num_examples: 1172 download_size: 791475 dataset_size: 1902693 - config_name: ai2_arc_ARC_Challenge_qa_options features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 815781 num_examples: 1119 - name: validation num_bytes: 224234 num_examples: 299 - name: test num_bytes: 876782 num_examples: 1172 download_size: 1044349 dataset_size: 1916797 - config_name: ai2_arc_ARC_Easy_heres_a_problem features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1585434 num_examples: 2251 - name: validation num_bytes: 402833 num_examples: 570 - name: test num_bytes: 1680740 num_examples: 2376 download_size: 1372031 dataset_size: 3669007 - config_name: ai2_arc_ARC_Easy_i_am_hesitating features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1893561 num_examples: 2251 - name: validation num_bytes: 479155 num_examples: 570 - name: test num_bytes: 2003593 num_examples: 2376 download_size: 1829256 dataset_size: 4376309 - config_name: ai2_arc_ARC_Easy_multiple_choice features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1927326 num_examples: 2251 - name: validation num_bytes: 487705 num_examples: 570 - name: test num_bytes: 2039233 num_examples: 2376 download_size: 1833872 dataset_size: 4454264 - config_name: ai2_arc_ARC_Easy_pick_false_options features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1702829 num_examples: 2251 - name: validation num_bytes: 431949 num_examples: 570 - name: test num_bytes: 1803223 num_examples: 2376 download_size: 1773690 dataset_size: 3938001 - config_name: ai2_arc_ARC_Easy_pick_the_most_correct_option features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1468388 num_examples: 2251 - name: validation num_bytes: 373194 num_examples: 570 - name: test num_bytes: 1557195 num_examples: 2376 download_size: 1359858 dataset_size: 3398777 - config_name: ai2_arc_ARC_Easy_qa_options features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1396090 num_examples: 2251 - name: validation num_bytes: 353185 num_examples: 570 - name: test num_bytes: 1478497 num_examples: 2376 download_size: 1744673 dataset_size: 3227772 - config_name: amazon_polarity_Is_this_product_review_positive features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3657525221 num_examples: 3600000 - name: test num_bytes: 406170885 num_examples: 400000 download_size: 2087209082 dataset_size: 4063696106 - config_name: amazon_polarity_Is_this_review features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3691725225 num_examples: 3600000 - name: test num_bytes: 409970885 num_examples: 400000 download_size: 2092135054 dataset_size: 4101696110 - config_name: amazon_polarity_Is_this_review_negative features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3596325225 num_examples: 3600000 - name: test num_bytes: 399370885 num_examples: 400000 download_size: 2088926047 dataset_size: 3995696110 - config_name: amazon_polarity_User_recommend_this_product features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3647231922 num_examples: 3600000 - name: test num_bytes: 405019064 num_examples: 400000 download_size: 1970470915 dataset_size: 4052250986 - config_name: amazon_polarity_convey_negative_or_positive_sentiment features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3853725225 num_examples: 3600000 - name: test num_bytes: 427970885 num_examples: 400000 download_size: 2107131644 dataset_size: 4281696110 - config_name: amazon_polarity_flattering_or_not features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 4156125225 num_examples: 3600000 - name: test num_bytes: 461570885 num_examples: 400000 download_size: 2121811218 dataset_size: 4617696110 - config_name: amazon_polarity_negative_or_positive_tone features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3983325221 num_examples: 3600000 - name: test num_bytes: 442370885 num_examples: 400000 download_size: 2105973069 dataset_size: 4425696106 - config_name: amazon_polarity_user_satisfied features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 4269525221 num_examples: 3600000 - name: test num_bytes: 474170885 num_examples: 400000 download_size: 2112525496 dataset_size: 4743696106 - config_name: amazon_polarity_would_you_buy features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 4541325221 num_examples: 3600000 - name: test num_bytes: 504370885 num_examples: 400000 download_size: 2145762328 dataset_size: 5045696106 - config_name: anli_GPT_3_style_r1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 15891829 num_examples: 16946 - name: validation num_bytes: 939241 num_examples: 1000 - name: test num_bytes: 937388 num_examples: 1000 download_size: 6820413 dataset_size: 17768458 - config_name: anli_GPT_3_style_r1_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 46818519 num_examples: 50838 - name: validation num_bytes: 2767114 num_examples: 3000 - name: test num_bytes: 2761555 num_examples: 3000 download_size: 9095632 dataset_size: 52347188 - config_name: anli_GPT_3_style_r2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 42010764 num_examples: 45460 - name: validation num_bytes: 926684 num_examples: 1000 - name: test num_bytes: 932575 num_examples: 1000 download_size: 13987598 dataset_size: 43870023 - config_name: anli_GPT_3_style_r2_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 123746670 num_examples: 136380 - name: validation num_bytes: 2729443 num_examples: 3000 - name: test num_bytes: 2747116 num_examples: 3000 download_size: 17660861 dataset_size: 129223229 - config_name: anli_GPT_3_style_r3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 88846603 num_examples: 100459 - name: validation num_bytes: 1075843 num_examples: 1200 - name: test num_bytes: 1071704 num_examples: 1200 download_size: 28572176 dataset_size: 90994150 - config_name: anli_GPT_3_style_r3_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 261465576 num_examples: 301377 - name: validation num_bytes: 3166845 num_examples: 3600 - name: test num_bytes: 3154428 num_examples: 3600 download_size: 36725759 dataset_size: 267786849 - config_name: anli_MNLI_crowdsource_r1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 18848410 num_examples: 16946 - name: validation num_bytes: 1112388 num_examples: 1000 - name: test num_bytes: 1110687 num_examples: 1000 download_size: 7035294 dataset_size: 21071485 - config_name: anli_MNLI_crowdsource_r1_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 55009135 num_examples: 50838 - name: validation num_bytes: 3250566 num_examples: 3000 - name: test num_bytes: 3245463 num_examples: 3000 download_size: 9425583 dataset_size: 61505164 - config_name: anli_MNLI_crowdsource_r2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 49982127 num_examples: 45460 - name: validation num_bytes: 1100103 num_examples: 1000 - name: test num_bytes: 1105922 num_examples: 1000 download_size: 14500912 dataset_size: 52188152 - config_name: anli_MNLI_crowdsource_r2_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 145734458 num_examples: 136380 - name: validation num_bytes: 3213711 num_examples: 3000 - name: test num_bytes: 3231168 num_examples: 3000 download_size: 18328088 dataset_size: 152179337 - config_name: anli_MNLI_crowdsource_r3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 106340935 num_examples: 100459 - name: validation num_bytes: 1283055 num_examples: 1200 - name: test num_bytes: 1279208 num_examples: 1200 download_size: 29613603 dataset_size: 108903198 - config_name: anli_MNLI_crowdsource_r3_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 309970922 num_examples: 301377 - name: validation num_bytes: 3745161 num_examples: 3600 - name: test num_bytes: 3733620 num_examples: 3600 download_size: 38024929 dataset_size: 317449703 - config_name: anli_always_sometimes_never_r1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 17096889 num_examples: 16946 - name: validation num_bytes: 1010063 num_examples: 1000 - name: test num_bytes: 1008362 num_examples: 1000 download_size: 6912252 dataset_size: 19115314 - config_name: anli_always_sometimes_never_r1_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 50213417 num_examples: 50838 - name: validation num_bytes: 2967566 num_examples: 3000 - name: test num_bytes: 2962463 num_examples: 3000 download_size: 9270417 dataset_size: 56143446 - config_name: anli_always_sometimes_never_r2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 45261254 num_examples: 45460 - name: validation num_bytes: 997778 num_examples: 1000 - name: test num_bytes: 1003597 num_examples: 1000 download_size: 14120029 dataset_size: 47262629 - config_name: anli_always_sometimes_never_r2_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 132869278 num_examples: 136380 - name: validation num_bytes: 2930711 num_examples: 3000 - name: test num_bytes: 2948168 num_examples: 3000 download_size: 17944324 dataset_size: 138748157 - config_name: anli_always_sometimes_never_r3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 95972062 num_examples: 100459 - name: validation num_bytes: 1160247 num_examples: 1200 - name: test num_bytes: 1156400 num_examples: 1200 download_size: 29037937 dataset_size: 98288709 - config_name: anli_always_sometimes_never_r3_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 281541025 num_examples: 301377 - name: validation num_bytes: 3405561 num_examples: 3600 - name: test num_bytes: 3394020 num_examples: 3600 download_size: 37305627 dataset_size: 288340606 - config_name: anli_based_on_the_previous_passage_r1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 16818701 num_examples: 16946 - name: validation num_bytes: 993730 num_examples: 1000 - name: test num_bytes: 992029 num_examples: 1000 download_size: 6901005 dataset_size: 18804460 - config_name: anli_based_on_the_previous_passage_r1_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 49891443 num_examples: 50838 - name: validation num_bytes: 2948566 num_examples: 3000 - name: test num_bytes: 2943463 num_examples: 3000 download_size: 9261038 dataset_size: 55783472 - config_name: anli_based_on_the_previous_passage_r2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 44512935 num_examples: 45460 - name: validation num_bytes: 981445 num_examples: 1000 - name: test num_bytes: 987264 num_examples: 1000 download_size: 14177762 dataset_size: 46481644 - config_name: anli_based_on_the_previous_passage_r2_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 132005538 num_examples: 136380 - name: validation num_bytes: 2911711 num_examples: 3000 - name: test num_bytes: 2929168 num_examples: 3000 download_size: 18008279 dataset_size: 137846417 - config_name: anli_based_on_the_previous_passage_r3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 94323940 num_examples: 100459 - name: validation num_bytes: 1140645 num_examples: 1200 - name: test num_bytes: 1136798 num_examples: 1200 download_size: 29048655 dataset_size: 96601383 - config_name: anli_based_on_the_previous_passage_r3_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 279632304 num_examples: 301377 - name: validation num_bytes: 3382761 num_examples: 3600 - name: test num_bytes: 3371220 num_examples: 3600 download_size: 37313374 dataset_size: 286386285 - config_name: anli_can_we_infer_r1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 16276429 num_examples: 16946 - name: validation num_bytes: 961730 num_examples: 1000 - name: test num_bytes: 960029 num_examples: 1000 download_size: 6839362 dataset_size: 18198188 - config_name: anli_can_we_infer_r1_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 48213789 num_examples: 50838 - name: validation num_bytes: 2849566 num_examples: 3000 - name: test num_bytes: 2844463 num_examples: 3000 download_size: 9152590 dataset_size: 53907818 - config_name: anli_can_we_infer_r2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 43058215 num_examples: 45460 - name: validation num_bytes: 949445 num_examples: 1000 - name: test num_bytes: 955264 num_examples: 1000 download_size: 14093701 dataset_size: 44962924 - config_name: anli_can_we_infer_r2_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 127504998 num_examples: 136380 - name: validation num_bytes: 2812711 num_examples: 3000 - name: test num_bytes: 2830168 num_examples: 3000 download_size: 17846937 dataset_size: 133147877 - config_name: anli_can_we_infer_r3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 91109252 num_examples: 100459 - name: validation num_bytes: 1102245 num_examples: 1200 - name: test num_bytes: 1098398 num_examples: 1200 download_size: 29010139 dataset_size: 93309895 - config_name: anli_can_we_infer_r3_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 269686863 num_examples: 301377 - name: validation num_bytes: 3263961 num_examples: 3600 - name: test num_bytes: 3252420 num_examples: 3600 download_size: 37077346 dataset_size: 276203244 - config_name: anli_claim_true_false_inconclusive_r1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 17425779 num_examples: 16946 - name: validation num_bytes: 1028386 num_examples: 1000 - name: test num_bytes: 1026685 num_examples: 1000 download_size: 6930995 dataset_size: 19480850 - config_name: anli_claim_true_false_inconclusive_r1_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 51094609 num_examples: 50838 - name: validation num_bytes: 3019566 num_examples: 3000 - name: test num_bytes: 3014463 num_examples: 3000 download_size: 9259651 dataset_size: 57128638 - config_name: anli_claim_true_false_inconclusive_r2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 46165603 num_examples: 45460 - name: validation num_bytes: 1016101 num_examples: 1000 - name: test num_bytes: 1021920 num_examples: 1000 download_size: 14229410 dataset_size: 48203624 - config_name: anli_claim_true_false_inconclusive_r2_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 135233198 num_examples: 136380 - name: validation num_bytes: 2982711 num_examples: 3000 - name: test num_bytes: 3000168 num_examples: 3000 download_size: 18010030 dataset_size: 141216077 - config_name: anli_claim_true_false_inconclusive_r3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 97905962 num_examples: 100459 - name: validation num_bytes: 1182249 num_examples: 1200 - name: test num_bytes: 1178402 num_examples: 1200 download_size: 29101408 dataset_size: 100266613 - config_name: anli_claim_true_false_inconclusive_r3_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 286764893 num_examples: 301377 - name: validation num_bytes: 3467961 num_examples: 3600 - name: test num_bytes: 3456420 num_examples: 3600 download_size: 37244732 dataset_size: 293689274 - config_name: anli_consider_always_sometimes_never_r1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 17445207 num_examples: 16946 - name: validation num_bytes: 1030579 num_examples: 1000 - name: test num_bytes: 1028726 num_examples: 1000 download_size: 6839509 dataset_size: 19504512 - config_name: anli_consider_always_sometimes_never_r1_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 51258371 num_examples: 50838 - name: validation num_bytes: 3029114 num_examples: 3000 - name: test num_bytes: 3023555 num_examples: 3000 download_size: 9180137 dataset_size: 57311040 - config_name: anli_consider_always_sometimes_never_r2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 46190558 num_examples: 45460 - name: validation num_bytes: 1018022 num_examples: 1000 - name: test num_bytes: 1023913 num_examples: 1000 download_size: 14079808 dataset_size: 48232493 - config_name: anli_consider_always_sometimes_never_r2_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 135657190 num_examples: 136380 - name: validation num_bytes: 2991443 num_examples: 3000 - name: test num_bytes: 3009116 num_examples: 3000 download_size: 17994408 dataset_size: 141657749 - config_name: anli_consider_always_sometimes_never_r3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 98053665 num_examples: 100459 - name: validation num_bytes: 1185475 num_examples: 1200 - name: test num_bytes: 1181336 num_examples: 1200 download_size: 28801257 dataset_size: 100420476 - config_name: anli_consider_always_sometimes_never_r3_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 287785834 num_examples: 301377 - name: validation num_bytes: 3481245 num_examples: 3600 - name: test num_bytes: 3468828 num_examples: 3600 download_size: 37388930 dataset_size: 294735907 - config_name: anli_does_it_follow_that_r1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 16014691 num_examples: 16946 - name: validation num_bytes: 946246 num_examples: 1000 - name: test num_bytes: 944393 num_examples: 1000 download_size: 6850268 dataset_size: 17905330 - config_name: anli_does_it_follow_that_r1_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 47479413 num_examples: 50838 - name: validation num_bytes: 2806114 num_examples: 3000 - name: test num_bytes: 2800555 num_examples: 3000 download_size: 9157471 dataset_size: 53086082 - config_name: anli_does_it_follow_that_r2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 42350959 num_examples: 45460 - name: validation num_bytes: 933689 num_examples: 1000 - name: test num_bytes: 939580 num_examples: 1000 download_size: 14009301 dataset_size: 44224228 - config_name: anli_does_it_follow_that_r2_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 125519610 num_examples: 136380 - name: validation num_bytes: 2768443 num_examples: 3000 - name: test num_bytes: 2786116 num_examples: 3000 download_size: 17813878 dataset_size: 131074169 - config_name: anli_does_it_follow_that_r3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 89574331 num_examples: 100459 - name: validation num_bytes: 1084273 num_examples: 1200 - name: test num_bytes: 1080134 num_examples: 1200 download_size: 28722764 dataset_size: 91738738 - config_name: anli_does_it_follow_that_r3_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 265383477 num_examples: 301377 - name: validation num_bytes: 3213645 num_examples: 3600 - name: test num_bytes: 3201228 num_examples: 3600 download_size: 36971806 dataset_size: 271798350 - config_name: anli_does_this_imply_r1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 16378105 num_examples: 16946 - name: validation num_bytes: 967730 num_examples: 1000 - name: test num_bytes: 966029 num_examples: 1000 download_size: 6857952 dataset_size: 18311864 - config_name: anli_does_this_imply_r1_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 48569655 num_examples: 50838 - name: validation num_bytes: 2870566 num_examples: 3000 - name: test num_bytes: 2865463 num_examples: 3000 download_size: 9206568 dataset_size: 54305684 - config_name: anli_does_this_imply_r2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 43330975 num_examples: 45460 - name: validation num_bytes: 955445 num_examples: 1000 - name: test num_bytes: 961264 num_examples: 1000 download_size: 14096217 dataset_size: 45247684 - config_name: anli_does_this_imply_r2_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 128459658 num_examples: 136380 - name: validation num_bytes: 2833711 num_examples: 3000 - name: test num_bytes: 2851168 num_examples: 3000 download_size: 17893659 dataset_size: 134144537 - config_name: anli_does_this_imply_r3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 91712006 num_examples: 100459 - name: validation num_bytes: 1109445 num_examples: 1200 - name: test num_bytes: 1105598 num_examples: 1200 download_size: 28905910 dataset_size: 93927049 - config_name: anli_does_this_imply_r3_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 271796502 num_examples: 301377 - name: validation num_bytes: 3289161 num_examples: 3600 - name: test num_bytes: 3277620 num_examples: 3600 download_size: 37105176 dataset_size: 278363283 - config_name: anli_guaranteed_possible_impossible_r1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 17379156 num_examples: 16946 - name: validation num_bytes: 1028063 num_examples: 1000 - name: test num_bytes: 1026362 num_examples: 1000 download_size: 6881642 dataset_size: 19433581 - config_name: anli_guaranteed_possible_impossible_r1_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 50721797 num_examples: 50838 - name: validation num_bytes: 2997566 num_examples: 3000 - name: test num_bytes: 2992463 num_examples: 3000 download_size: 9206674 dataset_size: 56711826 - config_name: anli_guaranteed_possible_impossible_r2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 45981380 num_examples: 45460 - name: validation num_bytes: 1015778 num_examples: 1000 - name: test num_bytes: 1021597 num_examples: 1000 download_size: 14327402 dataset_size: 48018755 - config_name: anli_guaranteed_possible_impossible_r2_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 134233078 num_examples: 136380 - name: validation num_bytes: 2960711 num_examples: 3000 - name: test num_bytes: 2978168 num_examples: 3000 download_size: 18001499 dataset_size: 140171957 - config_name: anli_guaranteed_possible_impossible_r3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 97659823 num_examples: 100459 - name: validation num_bytes: 1181793 num_examples: 1200 - name: test num_bytes: 1177946 num_examples: 1200 download_size: 29238079 dataset_size: 100019562 - config_name: anli_guaranteed_possible_impossible_r3_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 284554795 num_examples: 301377 - name: validation num_bytes: 3441561 num_examples: 3600 - name: test num_bytes: 3430020 num_examples: 3600 download_size: 37381060 dataset_size: 291426376 - config_name: anli_guaranteed_true_r1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 16395051 num_examples: 16946 - name: validation num_bytes: 968730 num_examples: 1000 - name: test num_bytes: 967029 num_examples: 1000 download_size: 6862070 dataset_size: 18330810 - config_name: anli_guaranteed_true_r1_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 48569655 num_examples: 50838 - name: validation num_bytes: 2870566 num_examples: 3000 - name: test num_bytes: 2865463 num_examples: 3000 download_size: 9211504 dataset_size: 54305684 - config_name: anli_guaranteed_true_r2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 43376435 num_examples: 45460 - name: validation num_bytes: 956445 num_examples: 1000 - name: test num_bytes: 962264 num_examples: 1000 download_size: 14102262 dataset_size: 45295144 - config_name: anli_guaranteed_true_r2_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 128459658 num_examples: 136380 - name: validation num_bytes: 2833711 num_examples: 3000 - name: test num_bytes: 2851168 num_examples: 3000 download_size: 17993347 dataset_size: 134144537 - config_name: anli_guaranteed_true_r3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 91812465 num_examples: 100459 - name: validation num_bytes: 1110645 num_examples: 1200 - name: test num_bytes: 1106798 num_examples: 1200 download_size: 29020314 dataset_size: 94029908 - config_name: anli_guaranteed_true_r3_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 271796502 num_examples: 301377 - name: validation num_bytes: 3289161 num_examples: 3600 - name: test num_bytes: 3277620 num_examples: 3600 download_size: 37078739 dataset_size: 278363283 - config_name: anli_justified_in_saying_r1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 16310321 num_examples: 16946 - name: validation num_bytes: 963730 num_examples: 1000 - name: test num_bytes: 962029 num_examples: 1000 download_size: 6899924 dataset_size: 18236080 - config_name: anli_justified_in_saying_r1_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 48315465 num_examples: 50838 - name: validation num_bytes: 2855566 num_examples: 3000 - name: test num_bytes: 2850463 num_examples: 3000 download_size: 9182043 dataset_size: 54021494 - config_name: anli_justified_in_saying_r2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 43149135 num_examples: 45460 - name: validation num_bytes: 951445 num_examples: 1000 - name: test num_bytes: 957264 num_examples: 1000 download_size: 14140227 dataset_size: 45057844 - config_name: anli_justified_in_saying_r2_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 127777758 num_examples: 136380 - name: validation num_bytes: 2818711 num_examples: 3000 - name: test num_bytes: 2836168 num_examples: 3000 download_size: 17890170 dataset_size: 133432637 - config_name: anli_justified_in_saying_r3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 91310170 num_examples: 100459 - name: validation num_bytes: 1104645 num_examples: 1200 - name: test num_bytes: 1100798 num_examples: 1200 download_size: 28886089 dataset_size: 93515613 - config_name: anli_justified_in_saying_r3_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 270289617 num_examples: 301377 - name: validation num_bytes: 3271161 num_examples: 3600 - name: test num_bytes: 3259620 num_examples: 3600 download_size: 36998968 dataset_size: 276820398 - config_name: anli_must_be_true_r1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 16700079 num_examples: 16946 - name: validation num_bytes: 986730 num_examples: 1000 - name: test num_bytes: 985029 num_examples: 1000 download_size: 6857831 dataset_size: 18671838 - config_name: anli_must_be_true_r1_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 49484739 num_examples: 50838 - name: validation num_bytes: 2924566 num_examples: 3000 - name: test num_bytes: 2919463 num_examples: 3000 download_size: 9235780 dataset_size: 55328768 - config_name: anli_must_be_true_r2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 44194715 num_examples: 45460 - name: validation num_bytes: 974445 num_examples: 1000 - name: test num_bytes: 980264 num_examples: 1000 download_size: 14268219 dataset_size: 46149424 - config_name: anli_must_be_true_r2_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 130914498 num_examples: 136380 - name: validation num_bytes: 2887711 num_examples: 3000 - name: test num_bytes: 2905168 num_examples: 3000 download_size: 17976639 dataset_size: 136707377 - config_name: anli_must_be_true_r3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 93620727 num_examples: 100459 - name: validation num_bytes: 1132245 num_examples: 1200 - name: test num_bytes: 1128398 num_examples: 1200 download_size: 29164064 dataset_size: 95881370 - config_name: anli_must_be_true_r3_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 277221288 num_examples: 301377 - name: validation num_bytes: 3353961 num_examples: 3600 - name: test num_bytes: 3342420 num_examples: 3600 download_size: 37276016 dataset_size: 283917669 - config_name: anli_should_assume_r1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 16445889 num_examples: 16946 - name: validation num_bytes: 971730 num_examples: 1000 - name: test num_bytes: 970029 num_examples: 1000 download_size: 6863556 dataset_size: 18387648 - config_name: anli_should_assume_r1_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 48722169 num_examples: 50838 - name: validation num_bytes: 2879566 num_examples: 3000 - name: test num_bytes: 2874463 num_examples: 3000 download_size: 9223555 dataset_size: 54476198 - config_name: anli_should_assume_r2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 43512815 num_examples: 45460 - name: validation num_bytes: 959445 num_examples: 1000 - name: test num_bytes: 965264 num_examples: 1000 download_size: 14186174 dataset_size: 45437524 - config_name: anli_should_assume_r2_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 128868798 num_examples: 136380 - name: validation num_bytes: 2842711 num_examples: 3000 - name: test num_bytes: 2860168 num_examples: 3000 download_size: 17939154 dataset_size: 134571677 - config_name: anli_should_assume_r3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 92113842 num_examples: 100459 - name: validation num_bytes: 1114245 num_examples: 1200 - name: test num_bytes: 1110398 num_examples: 1200 download_size: 29007024 dataset_size: 94338485 - config_name: anli_should_assume_r3_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 272700633 num_examples: 301377 - name: validation num_bytes: 3299961 num_examples: 3600 - name: test num_bytes: 3288420 num_examples: 3600 download_size: 37311289 dataset_size: 279289014 - config_name: anli_take_the_following_as_truth_r1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 18052781 num_examples: 16946 - name: validation num_bytes: 1065386 num_examples: 1000 - name: test num_bytes: 1063685 num_examples: 1000 download_size: 6958316 dataset_size: 20181852 - config_name: anli_take_the_following_as_truth_r1_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 52975615 num_examples: 50838 - name: validation num_bytes: 3130566 num_examples: 3000 - name: test num_bytes: 3125463 num_examples: 3000 download_size: 9296438 dataset_size: 59231644 - config_name: anli_take_the_following_as_truth_r2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 47847623 num_examples: 45460 - name: validation num_bytes: 1053101 num_examples: 1000 - name: test num_bytes: 1058920 num_examples: 1000 download_size: 14375001 dataset_size: 49959644 - config_name: anli_take_the_following_as_truth_r2_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 140279258 num_examples: 136380 - name: validation num_bytes: 3093711 num_examples: 3000 - name: test num_bytes: 3111168 num_examples: 3000 download_size: 18164060 dataset_size: 146484137 - config_name: anli_take_the_following_as_truth_r3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 101622945 num_examples: 100459 - name: validation num_bytes: 1226649 num_examples: 1200 - name: test num_bytes: 1222802 num_examples: 1200 download_size: 29425321 dataset_size: 104072396 - config_name: anli_take_the_following_as_truth_r3_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 297915842 num_examples: 301377 - name: validation num_bytes: 3601161 num_examples: 3600 - name: test num_bytes: 3589620 num_examples: 3600 download_size: 37584887 dataset_size: 305106623 - config_name: app_reviews_categorize_rating_using_review features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 129261543 num_examples: 288065 download_size: 27269906 dataset_size: 129261543 - config_name: app_reviews_convert_to_rating features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 109714706 num_examples: 288065 download_size: 26630751 dataset_size: 109714706 - config_name: app_reviews_convert_to_star_rating features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 131909805 num_examples: 288065 download_size: 26563470 dataset_size: 131909805 - config_name: app_reviews_generate_review features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 113484842 num_examples: 288065 download_size: 24274319 dataset_size: 113484842 - config_name: cnn_dailymail_3.0.0_2_or_3_sentences features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1353303824 num_examples: 287113 - name: validation num_bytes: 63377730 num_examples: 13368 - name: test num_bytes: 54248498 num_examples: 11490 download_size: 826634652 dataset_size: 1470930052 - config_name: cnn_dailymail_3.0.0_generate_story features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1323444072 num_examples: 287113 - name: validation num_bytes: 61987458 num_examples: 13368 - name: test num_bytes: 53053538 num_examples: 11490 download_size: 814354501 dataset_size: 1438485068 - config_name: cnn_dailymail_3.0.0_news_card_view features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1358758971 num_examples: 287113 - name: validation num_bytes: 63631722 num_examples: 13368 - name: test num_bytes: 54466808 num_examples: 11490 download_size: 828285509 dataset_size: 1476857501 - config_name: cnn_dailymail_3.0.0_news_stock features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1342393530 num_examples: 287113 - name: validation num_bytes: 62869746 num_examples: 13368 - name: test num_bytes: 53811878 num_examples: 11490 download_size: 823791331 dataset_size: 1459075154 - config_name: cnn_dailymail_3.0.0_news_summary features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1315404908 num_examples: 287113 - name: validation num_bytes: 61613154 num_examples: 13368 - name: test num_bytes: 52731818 num_examples: 11490 download_size: 816889262 dataset_size: 1429749880 - config_name: cnn_dailymail_3.0.0_spice_up_story features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1346700225 num_examples: 287113 - name: validation num_bytes: 63070266 num_examples: 13368 - name: test num_bytes: 53984228 num_examples: 11490 download_size: 816375399 dataset_size: 1463754719 - config_name: cnn_dailymail_3.0.0_sum_in_brief features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1318276038 num_examples: 287113 - name: validation num_bytes: 61746834 num_examples: 13368 - name: test num_bytes: 52846718 num_examples: 11490 download_size: 816868929 dataset_size: 1432869590 - config_name: cnn_dailymail_3.0.0_tldr_summary features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1362778553 num_examples: 287113 - name: validation num_bytes: 63818874 num_examples: 13368 - name: test num_bytes: 54627668 num_examples: 11490 download_size: 829270743 dataset_size: 1481225095 - config_name: cnn_dailymail_3.0.0_write_an_outline features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1341819304 num_examples: 287113 - name: validation num_bytes: 62843010 num_examples: 13368 - name: test num_bytes: 53788898 num_examples: 11490 download_size: 823267139 dataset_size: 1458451212 - config_name: common_gen_Example_prompt features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 29031267 num_examples: 67389 - name: validation num_bytes: 1772492 num_examples: 4018 - name: test num_bytes: 506143 num_examples: 1497 download_size: 6812479 dataset_size: 31309902 - config_name: common_gen_Given_concepts_type_1 features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 21820644 num_examples: 67389 - name: validation num_bytes: 1342566 num_examples: 4018 - name: test num_bytes: 345964 num_examples: 1497 download_size: 6585498 dataset_size: 23509174 - config_name: common_gen_Given_concepts_type_2 features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 23168424 num_examples: 67389 - name: validation num_bytes: 1422926 num_examples: 4018 - name: test num_bytes: 375904 num_examples: 1497 download_size: 6556584 dataset_size: 24967254 - config_name: common_gen_Put_together features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 18114249 num_examples: 67389 - name: validation num_bytes: 1121576 num_examples: 4018 - name: test num_bytes: 263629 num_examples: 1497 download_size: 6345743 dataset_size: 19499454 - config_name: common_gen_choice_in_concept_centric_sentence_generation features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 23307700 num_examples: 67389 - name: validation num_bytes: 1427491 num_examples: 4018 - name: test num_bytes: 378012 num_examples: 1497 download_size: 7465408 dataset_size: 25113203 - config_name: common_gen_random_task_template_prompt features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 17999994 num_examples: 67389 - name: validation num_bytes: 1113822 num_examples: 4018 - name: test num_bytes: 261700 num_examples: 1497 download_size: 6656542 dataset_size: 19375516 - config_name: common_gen_sentence_to_concepts features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 18929101 num_examples: 67389 - name: validation num_bytes: 1169868 num_examples: 4018 - name: test num_bytes: 287581 num_examples: 1497 download_size: 6675913 dataset_size: 20386550 - config_name: common_gen_topic_to_sentence features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 15085866 num_examples: 67389 - name: validation num_bytes: 914278 num_examples: 4018 - name: test num_bytes: 169777 num_examples: 1497 download_size: 5634470 dataset_size: 16169921 - config_name: common_gen_topics_from_the_sentence features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 16631691 num_examples: 67389 - name: validation num_bytes: 1033180 num_examples: 4018 - name: test num_bytes: 230695 num_examples: 1497 download_size: 6505604 dataset_size: 17895566 - config_name: cos_e_v1.11_aligned_with_common_sense features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 5953379 num_examples: 9741 - name: validation num_bytes: 727452 num_examples: 1221 download_size: 2505981 dataset_size: 6680831 - config_name: cos_e_v1.11_description_question_option_id features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 4842890 num_examples: 9741 - name: validation num_bytes: 603242 num_examples: 1221 download_size: 1883409 dataset_size: 5446132 - config_name: cos_e_v1.11_description_question_option_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 5269699 num_examples: 9741 - name: validation num_bytes: 656059 num_examples: 1221 download_size: 2370657 dataset_size: 5925758 - config_name: cos_e_v1.11_explain_why_human features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 5427397 num_examples: 9741 - name: validation num_bytes: 661522 num_examples: 1221 download_size: 2543940 dataset_size: 6088919 - config_name: cos_e_v1.11_generate_explanation_given_text features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 4677340 num_examples: 9741 - name: validation num_bytes: 567505 num_examples: 1221 download_size: 2486018 dataset_size: 5244845 - config_name: cos_e_v1.11_i_think features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 6041080 num_examples: 9741 - name: validation num_bytes: 738445 num_examples: 1221 download_size: 2559311 dataset_size: 6779525 - config_name: cos_e_v1.11_question_description_option_id features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 4570142 num_examples: 9741 - name: validation num_bytes: 569054 num_examples: 1221 download_size: 1857489 dataset_size: 5139196 - config_name: cos_e_v1.11_question_description_option_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 4967728 num_examples: 9741 - name: validation num_bytes: 618208 num_examples: 1221 download_size: 2336489 dataset_size: 5585936 - config_name: cos_e_v1.11_question_option_description_id features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3693452 num_examples: 9741 - name: validation num_bytes: 459164 num_examples: 1221 download_size: 1816326 dataset_size: 4152616 - config_name: cos_e_v1.11_question_option_description_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 4120261 num_examples: 9741 - name: validation num_bytes: 511981 num_examples: 1221 download_size: 2303921 dataset_size: 4632242 - config_name: cos_e_v1.11_rationale features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 5252059 num_examples: 9741 - name: validation num_bytes: 639544 num_examples: 1221 download_size: 2527140 dataset_size: 5891603 - config_name: cosmos_qa_context_answer_to_question features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 26180650 num_examples: 25262 - name: validation num_bytes: 3249006 num_examples: 2985 - name: test num_bytes: 6946224 num_examples: 6963 download_size: 14635073 dataset_size: 36375880 - config_name: cosmos_qa_context_description_question_answer_id features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 34592659 num_examples: 25262 - name: validation num_bytes: 4377835 num_examples: 2985 - name: test num_bytes: 10239710 num_examples: 6963 download_size: 18447200 dataset_size: 49210204 - config_name: cosmos_qa_context_description_question_answer_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 39970634 num_examples: 25262 - name: validation num_bytes: 5161781 num_examples: 2985 - name: test num_bytes: 12030085 num_examples: 6963 download_size: 22547457 dataset_size: 57162500 - config_name: cosmos_qa_context_description_question_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 29196303 num_examples: 25262 - name: validation num_bytes: 3705275 num_examples: 2985 - name: test num_bytes: 8646080 num_examples: 6963 download_size: 17329708 dataset_size: 41547658 - config_name: cosmos_qa_context_question_description_answer_id features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 31990673 num_examples: 25262 - name: validation num_bytes: 4070380 num_examples: 2985 - name: test num_bytes: 9522521 num_examples: 6963 download_size: 18002331 dataset_size: 45583574 - config_name: cosmos_qa_context_question_description_answer_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 37368648 num_examples: 25262 - name: validation num_bytes: 4854326 num_examples: 2985 - name: test num_bytes: 11312896 num_examples: 6963 download_size: 22181690 dataset_size: 53535870 - config_name: cosmos_qa_context_question_description_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 28514229 num_examples: 25262 - name: validation num_bytes: 3624680 num_examples: 2985 - name: test num_bytes: 8458079 num_examples: 6963 download_size: 17310690 dataset_size: 40596988 - config_name: cosmos_qa_description_context_question_answer_id features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 34668445 num_examples: 25262 - name: validation num_bytes: 4386790 num_examples: 2985 - name: test num_bytes: 10260599 num_examples: 6963 download_size: 18455761 dataset_size: 49315834 - config_name: cosmos_qa_description_context_question_answer_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 40046420 num_examples: 25262 - name: validation num_bytes: 5170736 num_examples: 2985 - name: test num_bytes: 12050974 num_examples: 6963 download_size: 22574952 dataset_size: 57268130 - config_name: cosmos_qa_description_context_question_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 30105735 num_examples: 25262 - name: validation num_bytes: 3812735 num_examples: 2985 - name: test num_bytes: 8896748 num_examples: 6963 download_size: 17392729 dataset_size: 42815218 - config_name: cosmos_qa_no_prompt_id features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 29843403 num_examples: 25262 - name: validation num_bytes: 3816655 num_examples: 2985 - name: test num_bytes: 8930666 num_examples: 6963 download_size: 17856956 dataset_size: 42590724 - config_name: cosmos_qa_no_prompt_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 35221378 num_examples: 25262 - name: validation num_bytes: 4600601 num_examples: 2985 - name: test num_bytes: 10721041 num_examples: 6963 download_size: 21950786 dataset_size: 50543020 - config_name: cosmos_qa_only_question_answer features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 9307051 num_examples: 25262 - name: validation num_bytes: 1265511 num_examples: 2985 - name: test num_bytes: 2916821 num_examples: 6963 download_size: 6171348 dataset_size: 13489383 - config_name: dbpedia_14_given_a_choice_of_categories_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 719436519 num_examples: 560000 - name: test num_bytes: 89954668 num_examples: 70000 download_size: 231812702 dataset_size: 809391187 - config_name: dbpedia_14_given_a_list_of_category_what_does_the_title_belong_to features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 409923864 num_examples: 560000 - name: test num_bytes: 51249097 num_examples: 70000 download_size: 38870531 dataset_size: 461172961 - config_name: dbpedia_14_given_list_what_category_does_the_paragraph_belong_to features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 698518491 num_examples: 560000 - name: test num_bytes: 87332355 num_examples: 70000 download_size: 219363263 dataset_size: 785850846 - config_name: dbpedia_14_pick_one_category_for_the_following_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 717756507 num_examples: 560000 - name: test num_bytes: 89744668 num_examples: 70000 download_size: 230680647 dataset_size: 807501175 - config_name: dream_answer_to_dialogue features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 9167493 num_examples: 6116 - name: validation num_bytes: 3008442 num_examples: 2040 - name: test num_bytes: 3008242 num_examples: 2041 download_size: 3571012 dataset_size: 15184177 - config_name: dream_baseline features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 10027147 num_examples: 6116 - name: validation num_bytes: 3280100 num_examples: 2040 - name: test num_bytes: 3289529 num_examples: 2041 download_size: 6311330 dataset_size: 16596776 - config_name: dream_generate_first_utterance features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 7880062 num_examples: 6116 - name: validation num_bytes: 2580535 num_examples: 2040 - name: test num_bytes: 2584957 num_examples: 2041 download_size: 2989013 dataset_size: 13045554 - config_name: dream_generate_last_utterance features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 8125880 num_examples: 6116 - name: validation num_bytes: 2659720 num_examples: 2040 - name: test num_bytes: 2660169 num_examples: 2041 download_size: 3018904 dataset_size: 13445769 - config_name: dream_read_the_following_conversation_and_answer_the_question features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 10461383 num_examples: 6116 - name: validation num_bytes: 3424940 num_examples: 2040 - name: test num_bytes: 3434440 num_examples: 2041 download_size: 6276363 dataset_size: 17320763 - config_name: duorc_ParaphraseRC_answer_question features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 307403792 num_examples: 69524 - name: validation num_bytes: 68663700 num_examples: 15591 - name: test num_bytes: 70505620 num_examples: 15857 download_size: 99055163 dataset_size: 446573112 - config_name: duorc_ParaphraseRC_build_story_around_qa features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 249444969 num_examples: 58752 - name: validation num_bytes: 55541425 num_examples: 13111 - name: test num_bytes: 57135051 num_examples: 13449 download_size: 71643871 dataset_size: 362121445 - config_name: duorc_ParaphraseRC_decide_worth_it features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 314845789 num_examples: 69524 - name: validation num_bytes: 70331271 num_examples: 15591 - name: test num_bytes: 72204115 num_examples: 15857 download_size: 100794562 dataset_size: 457381175 - config_name: duorc_ParaphraseRC_extract_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 308636910 num_examples: 69524 - name: validation num_bytes: 68940369 num_examples: 15591 - name: test num_bytes: 70789828 num_examples: 15857 download_size: 99839398 dataset_size: 448367107 - config_name: duorc_ParaphraseRC_generate_question features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 289153644 num_examples: 69524 - name: validation num_bytes: 64571759 num_examples: 15591 - name: test num_bytes: 66337503 num_examples: 15857 download_size: 74472346 dataset_size: 420062906 - config_name: duorc_ParaphraseRC_generate_question_by_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 254613731 num_examples: 58752 - name: validation num_bytes: 56695982 num_examples: 13111 - name: test num_bytes: 58319337 num_examples: 13449 download_size: 85228208 dataset_size: 369629050 - config_name: duorc_ParaphraseRC_movie_director features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 313618847 num_examples: 69524 - name: validation num_bytes: 70059761 num_examples: 15591 - name: test num_bytes: 71923481 num_examples: 15857 download_size: 97051040 dataset_size: 455602089 - config_name: duorc_ParaphraseRC_question_answering features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 303335003 num_examples: 69524 - name: validation num_bytes: 67754823 num_examples: 15591 - name: test num_bytes: 69577638 num_examples: 15857 download_size: 97347736 dataset_size: 440667464 - config_name: duorc_ParaphraseRC_title_generation features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 286267262 num_examples: 69524 - name: validation num_bytes: 63924046 num_examples: 15591 - name: test num_bytes: 65673450 num_examples: 15857 download_size: 69655194 dataset_size: 415864758 - config_name: duorc_SelfRC_answer_question features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 263617804 num_examples: 60721 - name: validation num_bytes: 56257282 num_examples: 12961 - name: test num_bytes: 54002992 num_examples: 12559 download_size: 81555005 dataset_size: 373878078 - config_name: duorc_SelfRC_build_story_around_qa features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 245194648 num_examples: 60094 - name: validation num_bytes: 52411094 num_examples: 12845 - name: test num_bytes: 50178336 num_examples: 12415 download_size: 64377895 dataset_size: 347784078 - config_name: duorc_SelfRC_decide_worth_it features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 270001960 num_examples: 60721 - name: validation num_bytes: 57619748 num_examples: 12961 - name: test num_bytes: 55323474 num_examples: 12559 download_size: 83633588 dataset_size: 382945182 - config_name: duorc_SelfRC_extract_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 264596258 num_examples: 60721 - name: validation num_bytes: 56466014 num_examples: 12961 - name: test num_bytes: 54205435 num_examples: 12559 download_size: 81309597 dataset_size: 375267707 - config_name: duorc_SelfRC_generate_question features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 247615958 num_examples: 60721 - name: validation num_bytes: 52851295 num_examples: 12961 - name: test num_bytes: 50703125 num_examples: 12559 download_size: 60820233 dataset_size: 351170378 - config_name: duorc_SelfRC_generate_question_by_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 250482850 num_examples: 60094 - name: validation num_bytes: 53541352 num_examples: 12845 - name: test num_bytes: 51271129 num_examples: 12415 download_size: 76508439 dataset_size: 355295331 - config_name: duorc_SelfRC_movie_director features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 268967019 num_examples: 60721 - name: validation num_bytes: 57398891 num_examples: 12961 - name: test num_bytes: 55109435 num_examples: 12559 download_size: 80004661 dataset_size: 381475345 - config_name: duorc_SelfRC_question_answering features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 259527119 num_examples: 60721 - name: validation num_bytes: 55382968 num_examples: 12961 - name: test num_bytes: 53157679 num_examples: 12559 download_size: 79992380 dataset_size: 368067766 - config_name: duorc_SelfRC_title_generation features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 245154844 num_examples: 60721 - name: validation num_bytes: 52322017 num_examples: 12961 - name: test num_bytes: 50193684 num_examples: 12559 download_size: 57228086 dataset_size: 347670545 - config_name: gigaword_TLDR features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2050904486 num_examples: 3803957 - name: validation num_bytes: 102511962 num_examples: 189651 - name: test num_bytes: 1022016 num_examples: 1951 download_size: 1034760505 dataset_size: 2154438464 - config_name: gigaword_first_sentence_title features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2214474621 num_examples: 3803957 - name: validation num_bytes: 110666955 num_examples: 189651 - name: test num_bytes: 1105909 num_examples: 1951 download_size: 1045083572 dataset_size: 2326247485 - config_name: gigaword_generate_summary_for_this features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2282945863 num_examples: 3803957 - name: validation num_bytes: 114080673 num_examples: 189651 - name: test num_bytes: 1141027 num_examples: 1951 download_size: 1047958875 dataset_size: 2398167563 - config_name: gigaword_in_a_nutshell features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2107963841 num_examples: 3803957 - name: validation num_bytes: 105356727 num_examples: 189651 - name: test num_bytes: 1051281 num_examples: 1951 download_size: 1039054230 dataset_size: 2214371849 - config_name: gigaword_make_a_title features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2187846922 num_examples: 3803957 - name: validation num_bytes: 109339398 num_examples: 189651 - name: test num_bytes: 1092252 num_examples: 1951 download_size: 1041468039 dataset_size: 2298278572 - config_name: gigaword_reverse_writing features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2005257002 num_examples: 3803957 - name: validation num_bytes: 100236150 num_examples: 189651 - name: test num_bytes: 998604 num_examples: 1951 download_size: 1035911157 dataset_size: 2106491756 - config_name: gigaword_write_a_title_for_this_sentence features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2256318148 num_examples: 3803957 - name: validation num_bytes: 112753116 num_examples: 189651 - name: test num_bytes: 1127370 num_examples: 1951 download_size: 1047096693 dataset_size: 2370198634 - config_name: gigaword_write_an_article features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2340005218 num_examples: 3803957 - name: validation num_bytes: 116925438 num_examples: 189651 - name: test num_bytes: 1170292 num_examples: 1951 download_size: 1054197705 dataset_size: 2458100948 - config_name: gigaword_write_its_sentence features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2313377519 num_examples: 3803957 - name: validation num_bytes: 115597881 num_examples: 189651 - name: test num_bytes: 1156635 num_examples: 1951 download_size: 1050253600 dataset_size: 2430132035 - config_name: glue_mrpc_equivalent features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2501163 num_examples: 3668 - name: validation num_bytes: 278983 num_examples: 408 - name: test num_bytes: 1172357 num_examples: 1725 download_size: 1559623 dataset_size: 3952503 - config_name: glue_mrpc_generate_paraphrase features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1412371 num_examples: 2474 - name: validation num_bytes: 159956 num_examples: 279 - name: test num_bytes: 655043 num_examples: 1147 download_size: 1319923 dataset_size: 2227370 - config_name: glue_mrpc_generate_sentence features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1550915 num_examples: 2474 - name: validation num_bytes: 175580 num_examples: 279 - name: test num_bytes: 719275 num_examples: 1147 download_size: 1331017 dataset_size: 2445770 - config_name: glue_mrpc_paraphrase features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2468409 num_examples: 3668 - name: validation num_bytes: 275374 num_examples: 408 - name: test num_bytes: 1156805 num_examples: 1725 download_size: 1556570 dataset_size: 3900588 - config_name: glue_mrpc_replace features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2439065 num_examples: 3668 - name: validation num_bytes: 272110 num_examples: 408 - name: test num_bytes: 1143005 num_examples: 1725 download_size: 1568181 dataset_size: 3854180 - config_name: glue_mrpc_same_thing features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2255665 num_examples: 3668 - name: validation num_bytes: 251710 num_examples: 408 - name: test num_bytes: 1056755 num_examples: 1725 download_size: 1533352 dataset_size: 3564130 - config_name: glue_mrpc_want_to_know features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2464741 num_examples: 3668 - name: validation num_bytes: 274966 num_examples: 408 - name: test num_bytes: 1155080 num_examples: 1725 download_size: 1564693 dataset_size: 3894787 - config_name: glue_qqp_answer features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 138150624 num_examples: 363846 - name: validation num_bytes: 15346609 num_examples: 40430 - name: test num_bytes: 150346271 num_examples: 390965 download_size: 123951530 dataset_size: 303843504 - config_name: glue_qqp_duplicate features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 143209364 num_examples: 363846 - name: validation num_bytes: 15908817 num_examples: 40430 - name: test num_bytes: 155772241 num_examples: 390965 download_size: 124829152 dataset_size: 314890422 - config_name: glue_qqp_duplicate_or_not features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 166115206 num_examples: 363846 - name: validation num_bytes: 18454224 num_examples: 40430 - name: test num_bytes: 178133060 num_examples: 390965 download_size: 124310599 dataset_size: 362702490 - config_name: glue_qqp_meaning features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 153364082 num_examples: 363846 - name: validation num_bytes: 17036964 num_examples: 40430 - name: test num_bytes: 166404110 num_examples: 390965 download_size: 125881194 dataset_size: 336805156 - config_name: glue_qqp_quora features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 246541628 num_examples: 363846 - name: validation num_bytes: 27390937 num_examples: 40430 - name: test num_bytes: 266806301 num_examples: 390965 download_size: 138338190 dataset_size: 540738866 - config_name: glue_qqp_same_thing features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 138150624 num_examples: 363846 - name: validation num_bytes: 15346609 num_examples: 40430 - name: test num_bytes: 150346271 num_examples: 390965 download_size: 125586835 dataset_size: 303843504 - config_name: hellaswag_Appropriate_continuation_Yes_or_No features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 36636395 num_examples: 39905 - name: validation num_bytes: 9457712 num_examples: 10042 - name: test num_bytes: 9207968 num_examples: 10003 download_size: 22929700 dataset_size: 55302075 - config_name: hellaswag_Open_ended_completion features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 53208771 num_examples: 39905 - name: validation num_bytes: 13804081 num_examples: 10042 - name: test num_bytes: 13323189 num_examples: 10003 download_size: 44228748 dataset_size: 80336041 - config_name: hellaswag_Open_ended_start features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 31586178 num_examples: 39905 - name: validation num_bytes: 8175505 num_examples: 10042 - name: test num_bytes: 7918171 num_examples: 10003 download_size: 23750142 dataset_size: 47679854 - config_name: hellaswag_Predict_ending_with_hint features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 103772125 num_examples: 39905 - name: validation num_bytes: 26953584 num_examples: 10042 - name: test num_bytes: 26056289 num_examples: 10003 download_size: 79049479 dataset_size: 156781998 - config_name: hellaswag_Predict_ending_with_hint_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 327006481 num_examples: 159620 - name: validation num_bytes: 84933063 num_examples: 40168 - name: test num_bytes: 82304557 num_examples: 40012 download_size: 132747083 dataset_size: 494244101 - config_name: hellaswag_Randomized_prompts_template features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 101707929 num_examples: 39905 - name: validation num_bytes: 26424150 num_examples: 10042 - name: test num_bytes: 25517504 num_examples: 10003 download_size: 78615384 dataset_size: 153649583 - config_name: hellaswag_Randomized_prompts_template_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 318749697 num_examples: 159620 - name: validation num_bytes: 82815327 num_examples: 40168 - name: test num_bytes: 80149417 num_examples: 40012 download_size: 133148565 dataset_size: 481714441 - config_name: hellaswag_Reversed_appropriate_continuation_Yes_or_No features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 37685857 num_examples: 39905 - name: validation num_bytes: 9718940 num_examples: 10042 - name: test num_bytes: 9484298 num_examples: 10003 download_size: 23013938 dataset_size: 56889095 - config_name: hellaswag_Topic_of_the_context features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 33608243 num_examples: 39905 - name: validation num_bytes: 8699532 num_examples: 10042 - name: test num_bytes: 8451069 num_examples: 10003 download_size: 22556001 dataset_size: 50758844 - config_name: hellaswag_Topic_without_the_ending_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 22237242 num_examples: 39905 - name: validation num_bytes: 5743894 num_examples: 10042 - name: test num_bytes: 5617224 num_examples: 10003 download_size: 14359159 dataset_size: 33598360 - config_name: hellaswag_complete_first_then features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 102668715 num_examples: 39905 - name: validation num_bytes: 26660776 num_examples: 10042 - name: test num_bytes: 25754067 num_examples: 10003 download_size: 78228282 dataset_size: 155083558 - config_name: hellaswag_complete_first_then_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 322592841 num_examples: 159620 - name: validation num_bytes: 83761831 num_examples: 40168 - name: test num_bytes: 81095669 num_examples: 40012 download_size: 132338669 dataset_size: 487450341 - config_name: hellaswag_how_ends features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 71330813 num_examples: 39905 - name: validation num_bytes: 18491297 num_examples: 10042 - name: test num_bytes: 17929217 num_examples: 10003 download_size: 47966583 dataset_size: 107751327 - config_name: hellaswag_if_begins_how_continues features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 74842453 num_examples: 39905 - name: validation num_bytes: 19374993 num_examples: 10042 - name: test num_bytes: 18809481 num_examples: 10003 download_size: 48306373 dataset_size: 113026927 - config_name: hellaswag_if_begins_how_continues_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 293643445 num_examples: 159620 - name: validation num_bytes: 76058945 num_examples: 40168 - name: test num_bytes: 73802494 num_examples: 40012 download_size: 94001678 dataset_size: 443504884 - config_name: imdb_Movie_Expressed_Sentiment features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 62032706 num_examples: 25000 - name: test num_bytes: 61156510 num_examples: 25000 - name: unsupervised num_bytes: 124406157 num_examples: 50000 download_size: 128577979 dataset_size: 247595373 - config_name: imdb_Movie_Expressed_Sentiment_2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 62632706 num_examples: 25000 - name: test num_bytes: 61756510 num_examples: 25000 - name: unsupervised num_bytes: 125606157 num_examples: 50000 download_size: 128508345 dataset_size: 249995373 - config_name: imdb_Negation_template_for_positive_and_negative features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 61932706 num_examples: 25000 - name: test num_bytes: 61056510 num_examples: 25000 - name: unsupervised num_bytes: 123606157 num_examples: 50000 download_size: 128322307 dataset_size: 246595373 - config_name: imdb_Reviewer_Enjoyment features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 63445206 num_examples: 25000 - name: test num_bytes: 62569010 num_examples: 25000 - name: unsupervised num_bytes: 126656157 num_examples: 50000 download_size: 128649514 dataset_size: 252670373 - config_name: imdb_Reviewer_Enjoyment_Yes_No features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 61545206 num_examples: 25000 - name: test num_bytes: 60669010 num_examples: 25000 - name: unsupervised num_bytes: 123456157 num_examples: 50000 download_size: 128440487 dataset_size: 245670373 - config_name: imdb_Reviewer_Expressed_Sentiment features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 63182706 num_examples: 25000 - name: test num_bytes: 62306510 num_examples: 25000 - name: unsupervised num_bytes: 126706157 num_examples: 50000 download_size: 128979366 dataset_size: 252195373 - config_name: imdb_Reviewer_Opinion_bad_good_choices features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 62220206 num_examples: 25000 - name: test num_bytes: 61344010 num_examples: 25000 - name: unsupervised num_bytes: 124806157 num_examples: 50000 download_size: 128595877 dataset_size: 248370373 - config_name: imdb_Reviewer_Sentiment_Feeling features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 62257706 num_examples: 25000 - name: test num_bytes: 61381510 num_examples: 25000 - name: unsupervised num_bytes: 124856157 num_examples: 50000 download_size: 128516819 dataset_size: 248495373 - config_name: imdb_Sentiment_with_choices_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 62082706 num_examples: 25000 - name: test num_bytes: 61206510 num_examples: 25000 - name: unsupervised num_bytes: 124506157 num_examples: 50000 download_size: 128468742 dataset_size: 247795373 - config_name: imdb_Text_Expressed_Sentiment features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 62357706 num_examples: 25000 - name: test num_bytes: 61481510 num_examples: 25000 - name: unsupervised num_bytes: 125056157 num_examples: 50000 download_size: 128646772 dataset_size: 248895373 - config_name: imdb_Writer_Expressed_Sentiment features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 62657706 num_examples: 25000 - name: test num_bytes: 61781510 num_examples: 25000 - name: unsupervised num_bytes: 125656157 num_examples: 50000 download_size: 128736120 dataset_size: 250095373 - config_name: kilt_tasks_hotpotqa_combining_facts features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 28006020 num_examples: 88869 - name: validation num_bytes: 1631261 num_examples: 5600 download_size: 16337892 dataset_size: 29637281 - config_name: kilt_tasks_hotpotqa_complex_question features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 38936907 num_examples: 88869 - name: validation num_bytes: 2320061 num_examples: 5600 download_size: 17061376 dataset_size: 41256968 - config_name: kilt_tasks_hotpotqa_final_exam features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 28094889 num_examples: 88869 - name: validation num_bytes: 1636861 num_examples: 5600 download_size: 16329789 dataset_size: 29731750 - config_name: kilt_tasks_hotpotqa_formulate features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 30938697 num_examples: 88869 - name: validation num_bytes: 1816061 num_examples: 5600 download_size: 16488556 dataset_size: 32754758 - config_name: kilt_tasks_hotpotqa_straighforward_qa features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 23118225 num_examples: 88869 - name: validation num_bytes: 1323261 num_examples: 5600 download_size: 15949825 dataset_size: 24441486 - config_name: multi_news_distill features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 526482331 num_examples: 44972 - name: validation num_bytes: 64826209 num_examples: 5622 - name: test num_bytes: 65237355 num_examples: 5622 download_size: 357690260 dataset_size: 656545895 - config_name: multi_news_expand_reverse_task_ features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 267362109 num_examples: 44972 - name: validation num_bytes: 33300262 num_examples: 5622 - name: test num_bytes: 33227745 num_examples: 5622 download_size: 189087861 dataset_size: 333890116 - config_name: multi_news_summarize features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 525663317 num_examples: 44972 - name: validation num_bytes: 64723513 num_examples: 5622 - name: test num_bytes: 65134796 num_examples: 5622 download_size: 357146250 dataset_size: 655521626 - config_name: multi_news_summary_scenario features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 527516687 num_examples: 44972 - name: validation num_bytes: 64955515 num_examples: 5622 - name: test num_bytes: 65366661 num_examples: 5622 download_size: 357925759 dataset_size: 657838863 - config_name: multi_news_synthesize features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 525154825 num_examples: 44972 - name: validation num_bytes: 64662427 num_examples: 5622 - name: test num_bytes: 65072614 num_examples: 5622 download_size: 357282630 dataset_size: 654889866 - config_name: multi_news_what_are_the_key_points features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 526122555 num_examples: 44972 - name: validation num_bytes: 64781233 num_examples: 5622 - name: test num_bytes: 65192379 num_examples: 5622 download_size: 357472016 dataset_size: 656096167 - config_name: openbookqa_main_choices features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2153221 num_examples: 4957 - name: validation num_bytes: 236646 num_examples: 500 - name: test num_bytes: 224988 num_examples: 500 download_size: 1525965 dataset_size: 2614855 - config_name: openbookqa_main_choose_an_answer_with_options features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2351501 num_examples: 4957 - name: validation num_bytes: 256646 num_examples: 500 - name: test num_bytes: 244988 num_examples: 500 download_size: 1540999 dataset_size: 2853135 - config_name: openbookqa_main_only_options features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2044167 num_examples: 4957 - name: validation num_bytes: 225646 num_examples: 500 - name: test num_bytes: 213988 num_examples: 500 download_size: 1510736 dataset_size: 2483801 - config_name: openbookqa_main_pick_answer_with_options features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2391157 num_examples: 4957 - name: validation num_bytes: 260646 num_examples: 500 - name: test num_bytes: 248988 num_examples: 500 download_size: 1543503 dataset_size: 2900791 - config_name: openbookqa_main_pick_using_id features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2231304 num_examples: 4957 - name: validation num_bytes: 235175 num_examples: 500 - name: test num_bytes: 228627 num_examples: 500 download_size: 1091533 dataset_size: 2695106 - config_name: openbookqa_main_which_correct features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2311845 num_examples: 4957 - name: validation num_bytes: 252646 num_examples: 500 - name: test num_bytes: 240988 num_examples: 500 download_size: 1539423 dataset_size: 2805479 - config_name: openbookqa_main_which_correct_inverse features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2311845 num_examples: 4957 - name: validation num_bytes: 252646 num_examples: 500 - name: test num_bytes: 240988 num_examples: 500 download_size: 1557407 dataset_size: 2805479 - config_name: paws_labeled_final_Concatenation features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 35504031 num_examples: 49401 - name: validation num_bytes: 5747157 num_examples: 8000 - name: test num_bytes: 5751626 num_examples: 8000 download_size: 16144636 dataset_size: 47002814 - config_name: paws_labeled_final_Concatenation_no_label features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 34170204 num_examples: 49401 - name: validation num_bytes: 5531157 num_examples: 8000 - name: test num_bytes: 5535626 num_examples: 8000 download_size: 16107402 dataset_size: 45236987 - config_name: paws_labeled_final_Meaning features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 36887259 num_examples: 49401 - name: validation num_bytes: 5971157 num_examples: 8000 - name: test num_bytes: 5975626 num_examples: 8000 download_size: 16398207 dataset_size: 48834042 - config_name: paws_labeled_final_Meaning_no_label features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 35553432 num_examples: 49401 - name: validation num_bytes: 5755157 num_examples: 8000 - name: test num_bytes: 5759626 num_examples: 8000 download_size: 16275164 dataset_size: 47068215 - config_name: paws_labeled_final_PAWS_ANLI_GPT3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 29160017 num_examples: 49401 - name: validation num_bytes: 4719767 num_examples: 8000 - name: test num_bytes: 4724266 num_examples: 8000 download_size: 15896734 dataset_size: 38604050 - config_name: paws_labeled_final_PAWS_ANLI_GPT3_no_label features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 28587891 num_examples: 49401 - name: validation num_bytes: 4627157 num_examples: 8000 - name: test num_bytes: 4631626 num_examples: 8000 download_size: 15859385 dataset_size: 37846674 - config_name: paws_labeled_final_Rewrite features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 36195645 num_examples: 49401 - name: validation num_bytes: 5859157 num_examples: 8000 - name: test num_bytes: 5863626 num_examples: 8000 download_size: 16218433 dataset_size: 47918428 - config_name: paws_labeled_final_Rewrite_no_label features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 34861818 num_examples: 49401 - name: validation num_bytes: 5643157 num_examples: 8000 - name: test num_bytes: 5647626 num_examples: 8000 download_size: 16128581 dataset_size: 46152601 - config_name: paws_labeled_final_context_question features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 32095286 num_examples: 49401 - name: validation num_bytes: 5195157 num_examples: 8000 - name: test num_bytes: 5199626 num_examples: 8000 download_size: 16025554 dataset_size: 42490069 - config_name: paws_labeled_final_context_question_no_label features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 30761459 num_examples: 49401 - name: validation num_bytes: 4979157 num_examples: 8000 - name: test num_bytes: 4983626 num_examples: 8000 download_size: 15864193 dataset_size: 40724242 - config_name: paws_labeled_final_paraphrase_task features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 11968844 num_examples: 21829 - name: validation num_bytes: 1934151 num_examples: 3539 - name: test num_bytes: 1926799 num_examples: 3536 download_size: 9170780 dataset_size: 15829794 - config_name: paws_labeled_final_task_description_no_label features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 34417209 num_examples: 49401 - name: validation num_bytes: 5571157 num_examples: 8000 - name: test num_bytes: 5575626 num_examples: 8000 download_size: 16154086 dataset_size: 45563992 - config_name: piqa_Correct_the_solution features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 11641830 num_examples: 16113 - name: validation num_bytes: 1320985 num_examples: 1838 - name: test num_bytes: 1592862 num_examples: 3084 download_size: 5999625 dataset_size: 14555677 - config_name: piqa_Correct_the_solution_if_false_from_sol_1 features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 12887919 num_examples: 16113 - name: validation num_bytes: 1464087 num_examples: 1838 - name: test num_bytes: 2420392 num_examples: 3084 download_size: 7007961 dataset_size: 16772398 - config_name: piqa_Correct_the_solution_if_false_from_sol_2 features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 13211867 num_examples: 16113 - name: validation num_bytes: 1501638 num_examples: 1838 - name: test num_bytes: 2477792 num_examples: 3084 download_size: 6997845 dataset_size: 17191297 - config_name: piqa_Does_this_solution_make_sense_sol1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 6636301 num_examples: 16113 - name: validation num_bytes: 753973 num_examples: 1838 - name: test num_bytes: 1247802 num_examples: 3084 download_size: 3521901 dataset_size: 8638076 - config_name: piqa_Does_this_solution_make_sense_sol2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 5965494 num_examples: 16113 - name: validation num_bytes: 678150 num_examples: 1838 - name: test num_bytes: 1117926 num_examples: 3084 download_size: 3509157 dataset_size: 7761570 - config_name: piqa_choose_the_most_appropriate_solution features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 13494825 num_examples: 16113 - name: validation num_bytes: 1532355 num_examples: 1838 - name: test num_bytes: 2536713 num_examples: 3084 download_size: 5413070 dataset_size: 17563893 - config_name: piqa_finish_sentence_with_correct_choice features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 16905704 num_examples: 16113 - name: validation num_bytes: 1912341 num_examples: 1838 - name: test num_bytes: 3140101 num_examples: 3084 download_size: 9742835 dataset_size: 21958146 - config_name: piqa_no_prompt_needed features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 4712823 num_examples: 16113 - name: validation num_bytes: 534576 num_examples: 1838 - name: test num_bytes: 876526 num_examples: 3084 download_size: 3629823 dataset_size: 6123925 - config_name: piqa_pick_correct_choice_index features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 11722395 num_examples: 16113 - name: validation num_bytes: 1330175 num_examples: 1838 - name: test num_bytes: 2197473 num_examples: 3084 download_size: 5342526 dataset_size: 15250043 - config_name: piqa_pick_correct_choice_with_choice_given_before_goal features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 18033614 num_examples: 16113 - name: validation num_bytes: 2041001 num_examples: 1838 - name: test num_bytes: 3355981 num_examples: 3084 download_size: 9921311 dataset_size: 23430596 - config_name: piqa_what_is_the_correct_ending features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 16212845 num_examples: 16113 - name: validation num_bytes: 1833307 num_examples: 1838 - name: test num_bytes: 3007489 num_examples: 3084 download_size: 9698311 dataset_size: 21053641 - config_name: qasc_is_correct_1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3401103 num_examples: 8134 - name: validation num_bytes: 386132 num_examples: 926 - name: test num_bytes: 292623 num_examples: 920 download_size: 1007200 dataset_size: 4079858 - config_name: qasc_is_correct_2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3224126 num_examples: 8134 - name: validation num_bytes: 366377 num_examples: 926 - name: test num_bytes: 273894 num_examples: 920 download_size: 971146 dataset_size: 3864397 - config_name: qasc_qa_with_combined_facts_1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 5454180 num_examples: 8134 - name: validation num_bytes: 634966 num_examples: 926 - name: test num_bytes: 504845 num_examples: 920 download_size: 2361874 dataset_size: 6593991 - config_name: qasc_qa_with_separated_facts_1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 6720877 num_examples: 8134 - name: validation num_bytes: 775778 num_examples: 926 - name: test num_bytes: 552734 num_examples: 920 download_size: 2660711 dataset_size: 8049389 - config_name: qasc_qa_with_separated_facts_2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 7495374 num_examples: 8134 - name: validation num_bytes: 863300 num_examples: 926 - name: test num_bytes: 639038 num_examples: 920 download_size: 2861838 dataset_size: 8997712 - config_name: qasc_qa_with_separated_facts_3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 4698908 num_examples: 8134 - name: validation num_bytes: 533946 num_examples: 926 - name: test num_bytes: 321095 num_examples: 920 download_size: 1676862 dataset_size: 5553949 - config_name: qasc_qa_with_separated_facts_4 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 7652886 num_examples: 8134 - name: validation num_bytes: 882976 num_examples: 926 - name: test num_bytes: 655598 num_examples: 920 download_size: 2758819 dataset_size: 9191460 - config_name: qasc_qa_with_separated_facts_5 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 6924317 num_examples: 8134 - name: validation num_bytes: 788056 num_examples: 926 - name: test num_bytes: 563751 num_examples: 920 download_size: 1797726 dataset_size: 8276124 - config_name: quail_context_description_question_answer_id features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 43125519 num_examples: 10246 - name: validation num_bytes: 9171413 num_examples: 2164 - name: challenge num_bytes: 2357827 num_examples: 556 download_size: 11361949 dataset_size: 54654759 - config_name: quail_context_description_question_answer_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 44439949 num_examples: 10246 - name: validation num_bytes: 9451133 num_examples: 2164 - name: challenge num_bytes: 2421642 num_examples: 556 download_size: 12285007 dataset_size: 56312724 - config_name: quail_context_description_question_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 41312532 num_examples: 10246 - name: validation num_bytes: 8789051 num_examples: 2164 - name: challenge num_bytes: 2257033 num_examples: 556 download_size: 10325100 dataset_size: 52358616 - config_name: quail_context_question_answer_description_id features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 42080427 num_examples: 10246 - name: validation num_bytes: 8950685 num_examples: 2164 - name: challenge num_bytes: 2301115 num_examples: 556 download_size: 10880551 dataset_size: 53332227 - config_name: quail_context_question_answer_description_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 43456333 num_examples: 10246 - name: validation num_bytes: 9243389 num_examples: 2164 - name: challenge num_bytes: 2368266 num_examples: 556 download_size: 12002210 dataset_size: 55067988 - config_name: quail_context_question_description_answer_id features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 42070181 num_examples: 10246 - name: validation num_bytes: 8948521 num_examples: 2164 - name: challenge num_bytes: 2300559 num_examples: 556 download_size: 10990498 dataset_size: 53319261 - config_name: quail_context_question_description_answer_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 43384611 num_examples: 10246 - name: validation num_bytes: 9228241 num_examples: 2164 - name: challenge num_bytes: 2364374 num_examples: 556 download_size: 11855007 dataset_size: 54977226 - config_name: quail_context_question_description_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 41220318 num_examples: 10246 - name: validation num_bytes: 8769575 num_examples: 2164 - name: challenge num_bytes: 2252029 num_examples: 556 download_size: 9797404 dataset_size: 52241922 - config_name: quail_description_context_question_answer_id features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 43146011 num_examples: 10246 - name: validation num_bytes: 9175741 num_examples: 2164 - name: challenge num_bytes: 2358939 num_examples: 556 download_size: 11386473 dataset_size: 54680691 - config_name: quail_description_context_question_answer_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 44460441 num_examples: 10246 - name: validation num_bytes: 9455461 num_examples: 2164 - name: challenge num_bytes: 2422754 num_examples: 556 download_size: 12397346 dataset_size: 56338656 - config_name: quail_description_context_question_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 41681388 num_examples: 10246 - name: validation num_bytes: 8866955 num_examples: 2164 - name: challenge num_bytes: 2277049 num_examples: 556 download_size: 10025138 dataset_size: 52825392 - config_name: quail_no_prompt_id features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 41168533 num_examples: 10246 - name: validation num_bytes: 8758089 num_examples: 2164 - name: challenge num_bytes: 2251631 num_examples: 556 download_size: 10997708 dataset_size: 52178253 - config_name: quail_no_prompt_text features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 42482963 num_examples: 10246 - name: validation num_bytes: 9037809 num_examples: 2164 - name: challenge num_bytes: 2315446 num_examples: 556 download_size: 11939913 dataset_size: 53836218 - config_name: quarel_choose_between features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1121848 num_examples: 1941 - name: validation num_bytes: 162463 num_examples: 278 - name: test num_bytes: 322405 num_examples: 552 download_size: 744152 dataset_size: 1606716 - config_name: quarel_do_not_use features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1331476 num_examples: 1941 - name: validation num_bytes: 192487 num_examples: 278 - name: test num_bytes: 382021 num_examples: 552 download_size: 762421 dataset_size: 1905984 - config_name: quarel_heres_a_story features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1308176 num_examples: 1941 - name: validation num_bytes: 189143 num_examples: 278 - name: test num_bytes: 375385 num_examples: 552 download_size: 755827 dataset_size: 1872704 - config_name: quarel_logic_test features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1226662 num_examples: 1941 - name: validation num_bytes: 177475 num_examples: 278 - name: test num_bytes: 352213 num_examples: 552 download_size: 750383 dataset_size: 1756350 - config_name: quarel_testing_students features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1380001 num_examples: 1941 - name: validation num_bytes: 199429 num_examples: 278 - name: test num_bytes: 395809 num_examples: 552 download_size: 764977 dataset_size: 1975239 - config_name: quartz_answer_question_based_on features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1684739 num_examples: 2696 - name: validation num_bytes: 247716 num_examples: 384 - name: test num_bytes: 493561 num_examples: 784 download_size: 831927 dataset_size: 2426016 - config_name: quartz_answer_question_below features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1576899 num_examples: 2696 - name: validation num_bytes: 232356 num_examples: 384 - name: test num_bytes: 462201 num_examples: 784 download_size: 816299 dataset_size: 2271456 - config_name: quartz_given_the_fact_answer_the_q features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1568811 num_examples: 2696 - name: validation num_bytes: 231204 num_examples: 384 - name: test num_bytes: 459849 num_examples: 784 download_size: 820060 dataset_size: 2259864 - config_name: quartz_having_read_above_passage features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1971956 num_examples: 2696 - name: validation num_bytes: 289568 num_examples: 384 - name: test num_bytes: 576980 num_examples: 784 download_size: 899987 dataset_size: 2838504 - config_name: quartz_paragraph_question_plain_concat features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1350435 num_examples: 2696 - name: validation num_bytes: 200100 num_examples: 384 - name: test num_bytes: 396345 num_examples: 784 download_size: 819662 dataset_size: 1946880 - config_name: quartz_read_passage_below_choose features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1939604 num_examples: 2696 - name: validation num_bytes: 284960 num_examples: 384 - name: test num_bytes: 567572 num_examples: 784 download_size: 900803 dataset_size: 2792136 - config_name: quartz_use_info_from_paragraph_question features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1752139 num_examples: 2696 - name: validation num_bytes: 257316 num_examples: 384 - name: test num_bytes: 513161 num_examples: 784 download_size: 848383 dataset_size: 2522616 - config_name: quartz_use_info_from_question_paragraph features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1752139 num_examples: 2696 - name: validation num_bytes: 257316 num_examples: 384 - name: test num_bytes: 513161 num_examples: 784 download_size: 839102 dataset_size: 2522616 - config_name: quoref_Answer_Friend_Question features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 77399413 num_examples: 19399 - name: validation num_bytes: 9525595 num_examples: 2418 download_size: 21172797 dataset_size: 86925008 - config_name: quoref_Answer_Question_Given_Context features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 75906482 num_examples: 19399 - name: validation num_bytes: 9339515 num_examples: 2418 download_size: 21085034 dataset_size: 85245997 - config_name: quoref_Answer_Test features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 77478073 num_examples: 19399 - name: validation num_bytes: 9535373 num_examples: 2418 download_size: 20833370 dataset_size: 87013446 - config_name: quoref_Context_Contains_Answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 76410209 num_examples: 19399 - name: validation num_bytes: 9402213 num_examples: 2418 download_size: 20984076 dataset_size: 85812422 - config_name: quoref_Find_Answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 76972842 num_examples: 19399 - name: validation num_bytes: 9472336 num_examples: 2418 download_size: 21102482 dataset_size: 86445178 - config_name: quoref_Found_Context_Online features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 76216636 num_examples: 19399 - name: validation num_bytes: 9378034 num_examples: 2418 download_size: 21073714 dataset_size: 85594670 - config_name: quoref_Given_Context_Answer_Question features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 75847706 num_examples: 19399 - name: validation num_bytes: 9331924 num_examples: 2418 download_size: 20955369 dataset_size: 85179630 - config_name: quoref_Guess_Answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 76701159 num_examples: 19399 - name: validation num_bytes: 9438300 num_examples: 2418 download_size: 20961433 dataset_size: 86139459 - config_name: quoref_Guess_Title_For_Context features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 73151029 num_examples: 19399 - name: validation num_bytes: 9007516 num_examples: 2418 download_size: 15926200 dataset_size: 82158545 - config_name: quoref_Read_And_Extract_ features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 76216632 num_examples: 19399 - name: validation num_bytes: 9378203 num_examples: 2418 download_size: 21186451 dataset_size: 85594835 - config_name: quoref_What_Is_The_Answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 76274484 num_examples: 19399 - name: validation num_bytes: 9385073 num_examples: 2418 download_size: 20988976 dataset_size: 85659557 - config_name: race_high_Is_this_the_right_answer features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 224067250 num_examples: 62445 - name: validation num_bytes: 12288423 num_examples: 3451 - name: test num_bytes: 12402597 num_examples: 3498 download_size: 80907333 dataset_size: 248758270 - config_name: race_high_Read_the_article_and_answer_the_question_no_option_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 234697713 num_examples: 62445 - name: validation num_bytes: 12871866 num_examples: 3451 - name: test num_bytes: 13001506 num_examples: 3498 download_size: 88903583 dataset_size: 260571085 - config_name: race_high_Select_the_best_answer features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 241414491 num_examples: 62445 - name: validation num_bytes: 13240279 num_examples: 3451 - name: test num_bytes: 13378074 num_examples: 3498 download_size: 88927188 dataset_size: 268032844 - config_name: race_high_Select_the_best_answer_generate_span_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 253585983 num_examples: 62445 - name: validation num_bytes: 13907799 num_examples: 3451 - name: test num_bytes: 14065912 num_examples: 3498 download_size: 98442058 dataset_size: 281559694 - config_name: race_high_Select_the_best_answer_no_instructions_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 233109306 num_examples: 62445 - name: validation num_bytes: 12781296 num_examples: 3451 - name: test num_bytes: 12912840 num_examples: 3498 download_size: 88914316 dataset_size: 258803442 - config_name: race_high_Taking_a_test features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 247096986 num_examples: 62445 - name: validation num_bytes: 13554320 num_examples: 3451 - name: test num_bytes: 13696392 num_examples: 3498 download_size: 88119386 dataset_size: 274347698 - config_name: race_high_Write_a_multi_choice_question_for_the_following_article features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 241476936 num_examples: 62445 - name: validation num_bytes: 13243730 num_examples: 3451 - name: test num_bytes: 13381572 num_examples: 3498 download_size: 82830693 dataset_size: 268102238 - config_name: race_high_Write_a_multi_choice_question_options_given_ features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 249780949 num_examples: 62445 - name: validation num_bytes: 13701386 num_examples: 3451 - name: test num_bytes: 13849582 num_examples: 3498 download_size: 90227530 dataset_size: 277331917 - config_name: race_middle_Is_this_the_right_answer features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 59522502 num_examples: 25421 - name: validation num_bytes: 3374951 num_examples: 1436 - name: test num_bytes: 3426265 num_examples: 1436 download_size: 20970954 dataset_size: 66323718 - config_name: race_middle_Read_the_article_and_answer_the_question_no_option_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 62603262 num_examples: 25421 - name: validation num_bytes: 3549837 num_examples: 1436 - name: test num_bytes: 3602906 num_examples: 1436 download_size: 23083878 dataset_size: 69756005 - config_name: race_middle_Select_the_best_answer features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 64964719 num_examples: 25421 - name: validation num_bytes: 3683945 num_examples: 1436 - name: test num_bytes: 3736474 num_examples: 1436 download_size: 23238714 dataset_size: 72385138 - config_name: race_middle_Select_the_best_answer_generate_span_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 68147373 num_examples: 25421 - name: validation num_bytes: 3865611 num_examples: 1436 - name: test num_bytes: 3920536 num_examples: 1436 download_size: 26118277 dataset_size: 75933520 - config_name: race_middle_Select_the_best_answer_no_instructions_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 61583726 num_examples: 25421 - name: validation num_bytes: 3492957 num_examples: 1436 - name: test num_bytes: 3545486 num_examples: 1436 download_size: 23049312 dataset_size: 68622169 - config_name: race_middle_Taking_a_test features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 67278030 num_examples: 25421 - name: validation num_bytes: 3814621 num_examples: 1436 - name: test num_bytes: 3867150 num_examples: 1436 download_size: 23415950 dataset_size: 74959801 - config_name: race_middle_Write_a_multi_choice_question_for_the_following_article features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 64990140 num_examples: 25421 - name: validation num_bytes: 3685381 num_examples: 1436 - name: test num_bytes: 3737910 num_examples: 1436 download_size: 21692641 dataset_size: 72413431 - config_name: race_middle_Write_a_multi_choice_question_options_given_ features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 67842630 num_examples: 25421 - name: validation num_bytes: 3847385 num_examples: 1436 - name: test num_bytes: 3900558 num_examples: 1436 download_size: 24079756 dataset_size: 75590573 - config_name: ropes_background_new_situation_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 24148867 num_examples: 10924 - name: validation num_bytes: 3456292 num_examples: 1688 download_size: 3693602 dataset_size: 27605159 - config_name: ropes_background_situation_middle features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 24028703 num_examples: 10924 - name: validation num_bytes: 3437724 num_examples: 1688 download_size: 3632205 dataset_size: 27466427 - config_name: ropes_given_background_situation features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 23700983 num_examples: 10924 - name: validation num_bytes: 3387084 num_examples: 1688 download_size: 3700990 dataset_size: 27088067 - config_name: ropes_new_situation_background_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 24312727 num_examples: 10924 - name: validation num_bytes: 3481612 num_examples: 1688 download_size: 3650421 dataset_size: 27794339 - config_name: ropes_plain_background_situation features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 22357331 num_examples: 10924 - name: validation num_bytes: 3179460 num_examples: 1688 download_size: 3644216 dataset_size: 25536791 - config_name: ropes_plain_bottom_hint features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 22553963 num_examples: 10924 - name: validation num_bytes: 3209844 num_examples: 1688 download_size: 3577320 dataset_size: 25763807 - config_name: ropes_plain_no_background features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 7337231 num_examples: 10924 - name: validation num_bytes: 1455200 num_examples: 1688 download_size: 1685636 dataset_size: 8792431 - config_name: ropes_prompt_beginning features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 23963159 num_examples: 10924 - name: validation num_bytes: 3427596 num_examples: 1688 download_size: 3664414 dataset_size: 27390755 - config_name: ropes_prompt_bottom_hint_beginning features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 24170715 num_examples: 10924 - name: validation num_bytes: 3459668 num_examples: 1688 download_size: 3722200 dataset_size: 27630383 - config_name: ropes_prompt_bottom_no_hint features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 8691807 num_examples: 10924 - name: validation num_bytes: 1664512 num_examples: 1688 download_size: 1734881 dataset_size: 10356319 - config_name: ropes_prompt_mix features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 23919463 num_examples: 10924 - name: validation num_bytes: 3420844 num_examples: 1688 download_size: 3642481 dataset_size: 27340307 - config_name: ropes_read_background_situation features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 26606767 num_examples: 10924 - name: validation num_bytes: 3836092 num_examples: 1688 download_size: 3774488 dataset_size: 30442859 - config_name: rotten_tomatoes_Movie_Expressed_Sentiment features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3167752 num_examples: 8530 - name: validation num_bytes: 396113 num_examples: 1066 - name: test num_bytes: 398890 num_examples: 1066 download_size: 1715193 dataset_size: 3962755 - config_name: rotten_tomatoes_Movie_Expressed_Sentiment_2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3372472 num_examples: 8530 - name: validation num_bytes: 421697 num_examples: 1066 - name: test num_bytes: 424474 num_examples: 1066 download_size: 1718990 dataset_size: 4218643 - config_name: rotten_tomatoes_Reviewer_Enjoyment features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3619842 num_examples: 8530 - name: validation num_bytes: 452611 num_examples: 1066 - name: test num_bytes: 455388 num_examples: 1066 download_size: 1724405 dataset_size: 4527841 - config_name: rotten_tomatoes_Reviewer_Enjoyment_Yes_No features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3001417 num_examples: 8530 - name: validation num_bytes: 375326 num_examples: 1066 - name: test num_bytes: 378103 num_examples: 1066 download_size: 1712605 dataset_size: 3754846 - config_name: rotten_tomatoes_Reviewer_Expressed_Sentiment features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3560132 num_examples: 8530 - name: validation num_bytes: 445149 num_examples: 1066 - name: test num_bytes: 447926 num_examples: 1066 download_size: 1752369 dataset_size: 4453207 - config_name: rotten_tomatoes_Reviewer_Opinion_bad_good_choices features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3231727 num_examples: 8530 - name: validation num_bytes: 404108 num_examples: 1066 - name: test num_bytes: 406885 num_examples: 1066 download_size: 1722171 dataset_size: 4042720 - config_name: rotten_tomatoes_Reviewer_Sentiment_Feeling features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3244522 num_examples: 8530 - name: validation num_bytes: 405707 num_examples: 1066 - name: test num_bytes: 408484 num_examples: 1066 download_size: 1719424 dataset_size: 4058713 - config_name: rotten_tomatoes_Sentiment_with_choices_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3184812 num_examples: 8530 - name: validation num_bytes: 398245 num_examples: 1066 - name: test num_bytes: 401022 num_examples: 1066 download_size: 1716500 dataset_size: 3984079 - config_name: rotten_tomatoes_Text_Expressed_Sentiment features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3278642 num_examples: 8530 - name: validation num_bytes: 409971 num_examples: 1066 - name: test num_bytes: 412748 num_examples: 1066 download_size: 1721990 dataset_size: 4101361 - config_name: rotten_tomatoes_Writer_Expressed_Sentiment features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3381002 num_examples: 8530 - name: validation num_bytes: 422763 num_examples: 1066 - name: test num_bytes: 425540 num_examples: 1066 download_size: 1726264 dataset_size: 4229305 - config_name: samsum_Generate_a_summary_for_this_dialogue features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 20847939 num_examples: 14732 - name: validation num_bytes: 1132408 num_examples: 818 - name: test num_bytes: 1178375 num_examples: 819 download_size: 12231176 dataset_size: 23158722 - config_name: samsum_Given_the_above_dialogue_write_a_summary features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 20995259 num_examples: 14732 - name: validation num_bytes: 1140588 num_examples: 818 - name: test num_bytes: 1186565 num_examples: 819 download_size: 12287796 dataset_size: 23322412 - config_name: samsum_Sum_up_the_following_dialogue features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 20582763 num_examples: 14732 - name: validation num_bytes: 1117684 num_examples: 818 - name: test num_bytes: 1163633 num_examples: 819 download_size: 12224086 dataset_size: 22864080 - config_name: samsum_Summarize_ features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 20155535 num_examples: 14732 - name: validation num_bytes: 1093962 num_examples: 818 - name: test num_bytes: 1139882 num_examples: 819 download_size: 12178625 dataset_size: 22389379 - config_name: samsum_Summarize_this_dialogue_ features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 20494371 num_examples: 14732 - name: validation num_bytes: 1112776 num_examples: 818 - name: test num_bytes: 1158719 num_examples: 819 download_size: 12217491 dataset_size: 22765866 - config_name: samsum_To_sum_up_this_dialog features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 20450175 num_examples: 14732 - name: validation num_bytes: 1110322 num_examples: 818 - name: test num_bytes: 1156262 num_examples: 819 download_size: 12250518 dataset_size: 22716759 - config_name: samsum_Write_a_dialogue_that_match_this_summary features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 20951063 num_examples: 14732 - name: validation num_bytes: 1138134 num_examples: 818 - name: test num_bytes: 1184108 num_examples: 819 download_size: 12142707 dataset_size: 23273305 - config_name: sciq_Direct_Question features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 13620270 num_examples: 11679 - name: validation num_bytes: 1155436 num_examples: 1000 - name: test num_bytes: 1179499 num_examples: 1000 download_size: 7728424 dataset_size: 15955205 - config_name: sciq_Direct_Question_Closed_Book_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3203761 num_examples: 11679 - name: validation num_bytes: 278888 num_examples: 1000 - name: test num_bytes: 272132 num_examples: 1000 download_size: 2012231 dataset_size: 3754781 - config_name: sciq_Multiple_Choice features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 15429508 num_examples: 11679 - name: validation num_bytes: 1311751 num_examples: 1000 - name: test num_bytes: 1331575 num_examples: 1000 download_size: 8635433 dataset_size: 18072834 - config_name: sciq_Multiple_Choice_Closed_Book_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 5012999 num_examples: 11679 - name: validation num_bytes: 435203 num_examples: 1000 - name: test num_bytes: 424208 num_examples: 1000 download_size: 2927347 dataset_size: 5872410 - config_name: sciq_Multiple_Choice_Question_First features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 15943384 num_examples: 11679 - name: validation num_bytes: 1355751 num_examples: 1000 - name: test num_bytes: 1375575 num_examples: 1000 download_size: 8754807 dataset_size: 18674710 - config_name: social_i_qa_Check_if_a_random_answer_is_valid_or_not features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 13459148 num_examples: 33410 - name: validation num_bytes: 789738 num_examples: 1954 download_size: 4919461 dataset_size: 14248886 - config_name: social_i_qa_Generate_answer features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 12738672 num_examples: 33410 - name: validation num_bytes: 748953 num_examples: 1954 download_size: 6421176 dataset_size: 13487625 - config_name: social_i_qa_Generate_the_question_from_the_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 13496939 num_examples: 33410 - name: validation num_bytes: 790867 num_examples: 1954 download_size: 4698667 dataset_size: 14287806 - config_name: social_i_qa_I_was_wondering features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 13607332 num_examples: 33410 - name: validation num_bytes: 799757 num_examples: 1954 download_size: 6486811 dataset_size: 14407089 - config_name: social_i_qa_Show_choices_and_generate_answer features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 17810931 num_examples: 33410 - name: validation num_bytes: 1050997 num_examples: 1954 download_size: 8848333 dataset_size: 18861928 - config_name: social_i_qa_Show_choices_and_generate_index features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 19481067 num_examples: 33410 - name: validation num_bytes: 1144381 num_examples: 1954 download_size: 6800886 dataset_size: 20625448 - config_name: squad_v2_Jeopardy_with_Context features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 162658727 num_examples: 86821 - name: validation num_bytes: 11632760 num_examples: 5928 download_size: 47938364 dataset_size: 174291487 - config_name: squad_v2_Jeopardy_without_Context features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 27943826 num_examples: 86821 - name: validation num_bytes: 1932710 num_examples: 5928 download_size: 10250181 dataset_size: 29876536 - config_name: squad_v2_Questions_with_Context features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 228499124 num_examples: 130319 - name: validation num_bytes: 21788313 num_examples: 11873 download_size: 59960262 dataset_size: 250287437 - config_name: squad_v2_Questions_with_Context_Without_Prompt_Keywords features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 215624139 num_examples: 130319 - name: validation num_bytes: 20614543 num_examples: 11873 download_size: 60874266 dataset_size: 236238682 - config_name: squad_v2_Questions_with_Context_Without_Prompt_Keywords_unanswerable features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 231512168 num_examples: 130319 - name: validation num_bytes: 22043171 num_examples: 11873 download_size: 60038597 dataset_size: 253555339 - config_name: squad_v2_Questions_with_Context_unanswerable features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 244112278 num_examples: 130319 - name: validation num_bytes: 23192958 num_examples: 11873 download_size: 60081358 dataset_size: 267305236 - config_name: squad_v2_Topic_Prediction_Context features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 204107251 num_examples: 130319 - name: validation num_bytes: 19537183 num_examples: 11873 download_size: 36038550 dataset_size: 223644434 - config_name: squad_v2_Topic_Prediction_Context_with_randomized_prompt_options features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 202172444 num_examples: 130319 - name: validation num_bytes: 19361062 num_examples: 11873 download_size: 43519623 dataset_size: 221533506 - config_name: squad_v2_Topic_Prediction_Context_with_randomized_prompt_options_placed_in_the_end features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 201426597 num_examples: 130319 - name: validation num_bytes: 19292369 num_examples: 11873 download_size: 44546673 dataset_size: 220718966 - config_name: squad_v2_Topic_Prediction_Question_and_Answer_Pair features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 29250830 num_examples: 86821 - name: validation num_bytes: 2015099 num_examples: 5928 download_size: 9794616 dataset_size: 31265929 - config_name: squad_v2_Trivia features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 15357357 num_examples: 86821 - name: validation num_bytes: 1073346 num_examples: 5928 download_size: 9336599 dataset_size: 16430703 - config_name: squad_v2_Unanwerable_question features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 223883460 num_examples: 130319 - name: validation num_bytes: 21366141 num_examples: 11873 download_size: 55657772 dataset_size: 245249601 - config_name: super_glue_boolq_GPT_3_Style features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 12429618 num_examples: 9427 - name: validation num_bytes: 4259837 num_examples: 3270 - name: test num_bytes: 4346276 num_examples: 3245 download_size: 11729367 dataset_size: 21035731 - config_name: super_glue_boolq_I_wonder_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 12684151 num_examples: 9427 - name: validation num_bytes: 4348127 num_examples: 3270 - name: test num_bytes: 4433891 num_examples: 3245 download_size: 11746846 dataset_size: 21466169 - config_name: super_glue_boolq_after_reading features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 13662381 num_examples: 9427 - name: validation num_bytes: 4687497 num_examples: 3270 - name: test num_bytes: 4755146 num_examples: 3245 download_size: 11828199 dataset_size: 23105024 - config_name: super_glue_boolq_based_on_the_following_passage features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 12674724 num_examples: 9427 - name: validation num_bytes: 4344857 num_examples: 3270 - name: test num_bytes: 4430646 num_examples: 3245 download_size: 11703792 dataset_size: 21450227 - config_name: super_glue_boolq_based_on_the_previous_passage features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 12665297 num_examples: 9427 - name: validation num_bytes: 4341587 num_examples: 3270 - name: test num_bytes: 4427401 num_examples: 3245 download_size: 11739702 dataset_size: 21434285 - config_name: super_glue_boolq_could_you_tell_me_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 12844410 num_examples: 9427 - name: validation num_bytes: 4403717 num_examples: 3270 - name: test num_bytes: 4489056 num_examples: 3245 download_size: 11772122 dataset_size: 21737183 - config_name: super_glue_boolq_exam features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 13146074 num_examples: 9427 - name: validation num_bytes: 4508357 num_examples: 3270 - name: test num_bytes: 4592896 num_examples: 3245 download_size: 11785041 dataset_size: 22247327 - config_name: super_glue_boolq_exercise features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 13766078 num_examples: 9427 - name: validation num_bytes: 4723467 num_examples: 3270 - name: test num_bytes: 4790841 num_examples: 3245 download_size: 11847577 dataset_size: 23280386 - config_name: super_glue_boolq_valid_binary features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 12710254 num_examples: 9427 - name: validation num_bytes: 4357227 num_examples: 3270 - name: test num_bytes: 4427401 num_examples: 3245 download_size: 11791500 dataset_size: 21494882 - config_name: super_glue_boolq_yes_no_question features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 13240344 num_examples: 9427 - name: validation num_bytes: 4541057 num_examples: 3270 - name: test num_bytes: 4625346 num_examples: 3245 download_size: 11825029 dataset_size: 22406747 - config_name: super_glue_cb_GPT_3_style features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 206745 num_examples: 250 - name: validation num_bytes: 51198 num_examples: 56 - name: test num_bytes: 225575 num_examples: 250 download_size: 232846 dataset_size: 483518 - config_name: super_glue_cb_GPT_3_style_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 608780 num_examples: 750 - name: validation num_bytes: 150962 num_examples: 168 - name: test num_bytes: 646319 num_examples: 750 download_size: 293849 dataset_size: 1406061 - config_name: super_glue_cb_MNLI_crowdsource features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 249234 num_examples: 250 - name: validation num_bytes: 60676 num_examples: 56 - name: test num_bytes: 267315 num_examples: 250 download_size: 240138 dataset_size: 577225 - config_name: super_glue_cb_MNLI_crowdsource_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 730396 num_examples: 750 - name: validation num_bytes: 178038 num_examples: 168 - name: test num_bytes: 767539 num_examples: 750 download_size: 303137 dataset_size: 1675973 - config_name: super_glue_cb_always_sometimes_never features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 224613 num_examples: 250 - name: validation num_bytes: 55126 num_examples: 56 - name: test num_bytes: 244065 num_examples: 250 download_size: 237380 dataset_size: 523804 - config_name: super_glue_cb_always_sometimes_never_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 659646 num_examples: 750 - name: validation num_bytes: 162190 num_examples: 168 - name: test num_bytes: 696789 num_examples: 750 download_size: 300429 dataset_size: 1518625 - config_name: super_glue_cb_based_on_the_previous_passage features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 220597 num_examples: 250 - name: validation num_bytes: 54225 num_examples: 56 - name: test num_bytes: 240815 num_examples: 250 download_size: 237047 dataset_size: 515637 - config_name: super_glue_cb_based_on_the_previous_passage_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 654896 num_examples: 750 - name: validation num_bytes: 161126 num_examples: 168 - name: test num_bytes: 692039 num_examples: 750 download_size: 297139 dataset_size: 1508061 - config_name: super_glue_cb_can_we_infer features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 212347 num_examples: 250 - name: validation num_bytes: 52377 num_examples: 56 - name: test num_bytes: 232565 num_examples: 250 download_size: 235287 dataset_size: 497289 - config_name: super_glue_cb_can_we_infer_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 630146 num_examples: 750 - name: validation num_bytes: 155582 num_examples: 168 - name: test num_bytes: 667289 num_examples: 750 download_size: 296416 dataset_size: 1453017 - config_name: super_glue_cb_claim_true_false_inconclusive features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 228139 num_examples: 250 - name: validation num_bytes: 55959 num_examples: 56 - name: test num_bytes: 246565 num_examples: 250 download_size: 236784 dataset_size: 530663 - config_name: super_glue_cb_claim_true_false_inconclusive_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 672646 num_examples: 750 - name: validation num_bytes: 165102 num_examples: 168 - name: test num_bytes: 709789 num_examples: 750 download_size: 299461 dataset_size: 1547537 - config_name: super_glue_cb_consider_always_sometimes_never features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 229491 num_examples: 250 - name: validation num_bytes: 56274 num_examples: 56 - name: test num_bytes: 249075 num_examples: 250 download_size: 235869 dataset_size: 534840 - config_name: super_glue_cb_consider_always_sometimes_never_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 674280 num_examples: 750 - name: validation num_bytes: 165634 num_examples: 168 - name: test num_bytes: 711819 num_examples: 750 download_size: 297079 dataset_size: 1551733 - config_name: super_glue_cb_does_it_follow_that features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 208475 num_examples: 250 - name: validation num_bytes: 51565 num_examples: 56 - name: test num_bytes: 228825 num_examples: 250 download_size: 233857 dataset_size: 488865 - config_name: super_glue_cb_does_it_follow_that_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 618530 num_examples: 750 - name: validation num_bytes: 153146 num_examples: 168 - name: test num_bytes: 656069 num_examples: 750 download_size: 293804 dataset_size: 1427745 - config_name: super_glue_cb_does_this_imply features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 214097 num_examples: 250 - name: validation num_bytes: 52769 num_examples: 56 - name: test num_bytes: 234315 num_examples: 250 download_size: 235640 dataset_size: 501181 - config_name: super_glue_cb_does_this_imply_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 635396 num_examples: 750 - name: validation num_bytes: 156758 num_examples: 168 - name: test num_bytes: 672539 num_examples: 750 download_size: 296952 dataset_size: 1464693 - config_name: super_glue_cb_guaranteed_possible_impossible features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 230040 num_examples: 250 - name: validation num_bytes: 56341 num_examples: 56 - name: test num_bytes: 246565 num_examples: 250 download_size: 238566 dataset_size: 532946 - config_name: super_glue_cb_guaranteed_possible_impossible_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 667146 num_examples: 750 - name: validation num_bytes: 163870 num_examples: 168 - name: test num_bytes: 704289 num_examples: 750 download_size: 305681 dataset_size: 1535305 - config_name: super_glue_cb_guaranteed_true features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 214097 num_examples: 250 - name: validation num_bytes: 52769 num_examples: 56 - name: test num_bytes: 234315 num_examples: 250 download_size: 237038 dataset_size: 501181 - config_name: super_glue_cb_guaranteed_true_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 635396 num_examples: 750 - name: validation num_bytes: 156758 num_examples: 168 - name: test num_bytes: 672539 num_examples: 750 download_size: 298087 dataset_size: 1464693 - config_name: super_glue_cb_justified_in_saying features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 212847 num_examples: 250 - name: validation num_bytes: 52489 num_examples: 56 - name: test num_bytes: 233065 num_examples: 250 download_size: 235860 dataset_size: 498401 - config_name: super_glue_cb_justified_in_saying_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 631646 num_examples: 750 - name: validation num_bytes: 155918 num_examples: 168 - name: test num_bytes: 668789 num_examples: 750 download_size: 295846 dataset_size: 1456353 - config_name: super_glue_cb_must_be_true features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 218597 num_examples: 250 - name: validation num_bytes: 53777 num_examples: 56 - name: test num_bytes: 238815 num_examples: 250 download_size: 237859 dataset_size: 511189 - config_name: super_glue_cb_must_be_true_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 648896 num_examples: 750 - name: validation num_bytes: 159782 num_examples: 168 - name: test num_bytes: 686039 num_examples: 750 download_size: 299911 dataset_size: 1494717 - config_name: super_glue_cb_should_assume features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 214847 num_examples: 250 - name: validation num_bytes: 52937 num_examples: 56 - name: test num_bytes: 235065 num_examples: 250 download_size: 236740 dataset_size: 502849 - config_name: super_glue_cb_should_assume_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 637646 num_examples: 750 - name: validation num_bytes: 157262 num_examples: 168 - name: test num_bytes: 674789 num_examples: 750 download_size: 297354 dataset_size: 1469697 - config_name: super_glue_cb_take_the_following_as_truth features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 237389 num_examples: 250 - name: validation num_bytes: 58031 num_examples: 56 - name: test num_bytes: 255815 num_examples: 250 download_size: 238453 dataset_size: 551235 - config_name: super_glue_cb_take_the_following_as_truth_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 700396 num_examples: 750 - name: validation num_bytes: 171318 num_examples: 168 - name: test num_bytes: 737539 num_examples: 750 download_size: 301514 dataset_size: 1609253 - config_name: super_glue_copa_C1_or_C2_premise_so_because_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 145012 num_examples: 400 - name: validation num_bytes: 36931 num_examples: 100 - name: test num_bytes: 168625 num_examples: 500 download_size: 196088 dataset_size: 350568 - config_name: super_glue_copa_C1_or_C2_premise_so_because__score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 249441 num_examples: 800 - name: validation num_bytes: 63425 num_examples: 200 - name: test num_bytes: 305078 num_examples: 1000 download_size: 248725 dataset_size: 617944 - config_name: super_glue_copa__As_a_result_C1_or_C2_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 78677 num_examples: 202 - name: validation num_bytes: 18455 num_examples: 48 - name: test num_bytes: 90701 num_examples: 250 download_size: 109360 dataset_size: 187833 - config_name: super_glue_copa__As_a_result_C1_or_C2__score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 136724 num_examples: 404 - name: validation num_bytes: 32033 num_examples: 96 - name: test num_bytes: 165575 num_examples: 500 download_size: 139645 dataset_size: 334332 - config_name: super_glue_copa__What_could_happen_next_C1_or_C2_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 80899 num_examples: 202 - name: validation num_bytes: 18983 num_examples: 48 - name: test num_bytes: 93451 num_examples: 250 download_size: 109831 dataset_size: 193333 - config_name: super_glue_copa__What_could_happen_next_C1_or_C2__score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 141168 num_examples: 404 - name: validation num_bytes: 33089 num_examples: 96 - name: test num_bytes: 171075 num_examples: 500 download_size: 140116 dataset_size: 345332 - config_name: super_glue_copa__which_may_be_caused_by features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 77325 num_examples: 198 - name: validation num_bytes: 21236 num_examples: 52 - name: test num_bytes: 91674 num_examples: 250 download_size: 109280 dataset_size: 190235 - config_name: super_glue_copa__which_may_be_caused_by_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 134698 num_examples: 396 - name: validation num_bytes: 36912 num_examples: 104 - name: test num_bytes: 167004 num_examples: 500 download_size: 139320 dataset_size: 338614 - config_name: super_glue_copa__why_C1_or_C2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 71385 num_examples: 198 - name: validation num_bytes: 19676 num_examples: 52 - name: test num_bytes: 84174 num_examples: 250 download_size: 108308 dataset_size: 175235 - config_name: super_glue_copa__why_C1_or_C2_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 122818 num_examples: 396 - name: validation num_bytes: 33792 num_examples: 104 - name: test num_bytes: 152004 num_examples: 500 download_size: 137970 dataset_size: 308614 - config_name: super_glue_copa_best_option features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 182827 num_examples: 400 - name: validation num_bytes: 46371 num_examples: 100 - name: test num_bytes: 215833 num_examples: 500 download_size: 202995 dataset_size: 445031 - config_name: super_glue_copa_best_option_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 325071 num_examples: 800 - name: validation num_bytes: 82305 num_examples: 200 - name: test num_bytes: 399494 num_examples: 1000 download_size: 257050 dataset_size: 806870 - config_name: super_glue_copa_cause_effect features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 163033 num_examples: 400 - name: validation num_bytes: 41415 num_examples: 100 - name: test num_bytes: 191083 num_examples: 500 download_size: 197901 dataset_size: 395531 - config_name: super_glue_copa_cause_effect_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 285483 num_examples: 800 - name: validation num_bytes: 72393 num_examples: 200 - name: test num_bytes: 349994 num_examples: 1000 download_size: 250800 dataset_size: 707870 - config_name: super_glue_copa_choose features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 157421 num_examples: 400 - name: validation num_bytes: 40027 num_examples: 100 - name: test num_bytes: 184083 num_examples: 500 download_size: 195870 dataset_size: 381531 - config_name: super_glue_copa_choose_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 274259 num_examples: 800 - name: validation num_bytes: 69617 num_examples: 200 - name: test num_bytes: 335994 num_examples: 1000 download_size: 248339 dataset_size: 679870 - config_name: super_glue_copa_exercise features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 179021 num_examples: 400 - name: validation num_bytes: 45427 num_examples: 100 - name: test num_bytes: 211083 num_examples: 500 download_size: 200024 dataset_size: 435531 - config_name: super_glue_copa_exercise_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 317459 num_examples: 800 - name: validation num_bytes: 80417 num_examples: 200 - name: test num_bytes: 389994 num_examples: 1000 download_size: 253031 dataset_size: 787870 - config_name: super_glue_copa_i_am_hesitating features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 201033 num_examples: 400 - name: validation num_bytes: 50915 num_examples: 100 - name: test num_bytes: 238583 num_examples: 500 download_size: 204671 dataset_size: 490531 - config_name: super_glue_copa_i_am_hesitating_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 361483 num_examples: 800 - name: validation num_bytes: 91393 num_examples: 200 - name: test num_bytes: 444994 num_examples: 1000 download_size: 258257 dataset_size: 897870 - config_name: super_glue_copa_more_likely features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 195627 num_examples: 400 - name: validation num_bytes: 49571 num_examples: 100 - name: test num_bytes: 231833 num_examples: 500 download_size: 205679 dataset_size: 477031 - config_name: super_glue_copa_more_likely_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 350671 num_examples: 800 - name: validation num_bytes: 88705 num_examples: 200 - name: test num_bytes: 431494 num_examples: 1000 download_size: 260606 dataset_size: 870870 - config_name: super_glue_copa_plausible_alternatives features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 184629 num_examples: 400 - name: validation num_bytes: 46819 num_examples: 100 - name: test num_bytes: 218083 num_examples: 500 download_size: 201203 dataset_size: 449531 - config_name: super_glue_copa_plausible_alternatives_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 328675 num_examples: 800 - name: validation num_bytes: 83201 num_examples: 200 - name: test num_bytes: 403994 num_examples: 1000 download_size: 254263 dataset_size: 815870 - config_name: super_glue_multirc_I_was_going_to_say_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 87327367 num_examples: 27243 - name: validation num_bytes: 15270172 num_examples: 4848 - name: test num_bytes: 29317947 num_examples: 9693 download_size: 10202981 dataset_size: 131915486 - config_name: super_glue_multirc_Would_it_be_good_to_answer_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 86590210 num_examples: 27243 - name: validation num_bytes: 15138916 num_examples: 4848 - name: test num_bytes: 29055844 num_examples: 9693 download_size: 10145179 dataset_size: 130784970 - config_name: super_glue_multirc_confirm features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 88851379 num_examples: 27243 - name: validation num_bytes: 15541300 num_examples: 4848 - name: test num_bytes: 29860363 num_examples: 9693 download_size: 10343037 dataset_size: 134253042 - config_name: super_glue_multirc_correct features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 89540386 num_examples: 27243 - name: validation num_bytes: 15663439 num_examples: 4848 - name: test num_bytes: 30104448 num_examples: 9693 download_size: 10428485 dataset_size: 135308273 - config_name: super_glue_multirc_decide_valid features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 89151052 num_examples: 27243 - name: validation num_bytes: 15594628 num_examples: 4848 - name: test num_bytes: 29966986 num_examples: 9693 download_size: 10388384 dataset_size: 134712666 - config_name: super_glue_multirc_found_this_answer features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 88308115 num_examples: 27243 - name: validation num_bytes: 15444700 num_examples: 4848 - name: test num_bytes: 29666895 num_examples: 9693 download_size: 10310634 dataset_size: 133419710 - config_name: super_glue_multirc_grading features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 88933108 num_examples: 27243 - name: validation num_bytes: 15555844 num_examples: 4848 - name: test num_bytes: 29889442 num_examples: 9693 download_size: 10380847 dataset_size: 134378394 - config_name: super_glue_multirc_is_a_correct_answer_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 87897874 num_examples: 27243 - name: validation num_bytes: 15371620 num_examples: 4848 - name: test num_bytes: 29521108 num_examples: 9693 download_size: 10277901 dataset_size: 132790602 - config_name: super_glue_multirc_is_the_correct_answer_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 86487255 num_examples: 27243 - name: validation num_bytes: 15121640 num_examples: 4848 - name: test num_bytes: 29019715 num_examples: 9693 download_size: 10063584 dataset_size: 130628610 - config_name: super_glue_multirc_paragraph_question_is_it_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 85833423 num_examples: 27243 - name: validation num_bytes: 15005288 num_examples: 4848 - name: test num_bytes: 28787083 num_examples: 9693 download_size: 10024769 dataset_size: 129625794 - config_name: super_glue_record_Add_sentence_after_after_continuation_choices_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 405851847 num_examples: 100730 - name: validation num_bytes: 40002369 num_examples: 10000 - name: test num_bytes: 37604835 num_examples: 10000 download_size: 161336040 dataset_size: 483459051 - config_name: super_glue_record_Add_sentence_after_continuation_choices_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 397869219 num_examples: 100730 - name: validation num_bytes: 39209961 num_examples: 10000 - name: test num_bytes: 36813541 num_examples: 10000 download_size: 160939894 dataset_size: 473892721 - config_name: super_glue_record_Can_you_figure_out_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 265384317 num_examples: 100730 - name: validation num_bytes: 25888812 num_examples: 10000 - name: test num_bytes: 26013119 num_examples: 10000 download_size: 137075723 dataset_size: 317286248 - config_name: super_glue_record_GPT_3_style_continuation_choices_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 389547353 num_examples: 100730 - name: validation num_bytes: 38377029 num_examples: 10000 - name: test num_bytes: 35877641 num_examples: 10000 download_size: 161606657 dataset_size: 463802023 - config_name: super_glue_record_GPT_3_style_summary_only_continuation_choices_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 391488841 num_examples: 100730 - name: validation num_bytes: 38568843 num_examples: 10000 - name: test num_bytes: 36068935 num_examples: 10000 download_size: 161430527 dataset_size: 466126619 - config_name: super_glue_record_GPT_3_style_with_labels_continuation_choices_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 394006123 num_examples: 100730 - name: validation num_bytes: 38818755 num_examples: 10000 - name: test num_bytes: 36318935 num_examples: 10000 download_size: 161657804 dataset_size: 469143813 - config_name: super_glue_record_GPT_3_style_with_labels_without_hyphens_continuation_choices_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 386704249 num_examples: 100730 - name: validation num_bytes: 38142115 num_examples: 10000 - name: test num_bytes: 35743760 num_examples: 10000 download_size: 161860960 dataset_size: 460590124 - config_name: super_glue_record_GPT_3_style_without_hyphens_continuation_choices_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 382247592 num_examples: 100730 - name: validation num_bytes: 37700089 num_examples: 10000 - name: test num_bytes: 35302531 num_examples: 10000 download_size: 161214381 dataset_size: 455250212 - config_name: super_glue_record_In_the_question_above_the_placeholder_stands_for features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 263170377 num_examples: 100730 - name: validation num_bytes: 25668732 num_examples: 10000 - name: test num_bytes: 25793119 num_examples: 10000 download_size: 136915415 dataset_size: 314632228 - config_name: super_glue_record_New_highlight_continuation_choices_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 398639353 num_examples: 100730 - name: validation num_bytes: 39278843 num_examples: 10000 - name: test num_bytes: 36778935 num_examples: 10000 download_size: 161410433 dataset_size: 474697131 - config_name: super_glue_record_News_article_continuation_choices_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 400384809 num_examples: 100730 - name: validation num_bytes: 39459961 num_examples: 10000 - name: test num_bytes: 37063541 num_examples: 10000 download_size: 161149940 dataset_size: 476908311 - config_name: super_glue_record_Summary_first_continuation_choices_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 389936507 num_examples: 100730 - name: validation num_bytes: 38422422 num_examples: 10000 - name: test num_bytes: 36024835 num_examples: 10000 download_size: 161510844 dataset_size: 464383764 - config_name: super_glue_record_What_could_the_placeholder_be_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 291017905 num_examples: 100730 - name: validation num_bytes: 28253736 num_examples: 10000 - name: test num_bytes: 28355871 num_examples: 10000 download_size: 149257838 dataset_size: 347627512 - config_name: super_glue_record_Which_one_is_the_placeholder_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 290920684 num_examples: 100730 - name: validation num_bytes: 28243964 num_examples: 10000 - name: test num_bytes: 28345871 num_examples: 10000 download_size: 149149764 dataset_size: 347510519 - config_name: super_glue_record_choose_between features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 303576388 num_examples: 100730 - name: validation num_bytes: 29481844 num_examples: 10000 - name: test num_bytes: 29577381 num_examples: 10000 download_size: 150960677 dataset_size: 362635613 - config_name: super_glue_record_corrupted features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 272131126 num_examples: 100730 - name: validation num_bytes: 26559245 num_examples: 10000 - name: test num_bytes: 26683119 num_examples: 10000 download_size: 137380371 dataset_size: 325373490 - config_name: super_glue_record_exercise features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 269411416 num_examples: 100730 - name: validation num_bytes: 26288732 num_examples: 10000 - name: test num_bytes: 26413119 num_examples: 10000 download_size: 137400236 dataset_size: 322113267 - config_name: super_glue_record_pick_one_option features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 298946149 num_examples: 100730 - name: validation num_bytes: 29021173 num_examples: 10000 - name: test num_bytes: 29117381 num_examples: 10000 download_size: 149959507 dataset_size: 357084703 - config_name: super_glue_record_the_placeholder_refers_to_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 258633939 num_examples: 100730 - name: validation num_bytes: 25218812 num_examples: 10000 - name: test num_bytes: 25343119 num_examples: 10000 download_size: 137051827 dataset_size: 309195870 - config_name: super_glue_record_trying_to_decide features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 309721314 num_examples: 100730 - name: validation num_bytes: 30091894 num_examples: 10000 - name: test num_bytes: 30187381 num_examples: 10000 download_size: 151048548 dataset_size: 370000589 - config_name: super_glue_rte_GPT_3_style features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1822276 num_examples: 2490 - name: validation num_bytes: 196922 num_examples: 277 - name: test num_bytes: 2177860 num_examples: 3000 download_size: 2192949 dataset_size: 4197058 - config_name: super_glue_rte_GPT_3_style_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 3620347 num_examples: 4980 - name: validation num_bytes: 391279 num_examples: 554 - name: test num_bytes: 4173470 num_examples: 6000 download_size: 2981743 dataset_size: 8185096 - config_name: super_glue_rte_MNLI_crowdsource features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2152454 num_examples: 2490 - name: validation num_bytes: 233726 num_examples: 277 - name: test num_bytes: 2592972 num_examples: 3000 download_size: 2264401 dataset_size: 4979152 - config_name: super_glue_rte_MNLI_crowdsource_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 4300543 num_examples: 4980 - name: validation num_bytes: 466953 num_examples: 554 - name: test num_bytes: 4991694 num_examples: 6000 download_size: 3056693 dataset_size: 9759190 - config_name: super_glue_rte_based_on_the_previous_passage features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1975664 num_examples: 2490 - name: validation num_bytes: 214059 num_examples: 277 - name: test num_bytes: 2379972 num_examples: 3000 download_size: 2228456 dataset_size: 4569695 - config_name: super_glue_rte_based_on_the_previous_passage_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 3946963 num_examples: 4980 - name: validation num_bytes: 427619 num_examples: 554 - name: test num_bytes: 4565694 num_examples: 6000 download_size: 2997816 dataset_size: 8940276 - config_name: super_glue_rte_can_we_infer features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1893494 num_examples: 2490 - name: validation num_bytes: 204918 num_examples: 277 - name: test num_bytes: 2280972 num_examples: 3000 download_size: 2218834 dataset_size: 4379384 - config_name: super_glue_rte_can_we_infer_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 3782623 num_examples: 4980 - name: validation num_bytes: 409337 num_examples: 554 - name: test num_bytes: 4367694 num_examples: 6000 download_size: 3017504 dataset_size: 8559654 - config_name: super_glue_rte_does_it_follow_that features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1859666 num_examples: 2490 - name: validation num_bytes: 201152 num_examples: 277 - name: test num_bytes: 2240860 num_examples: 3000 download_size: 2207694 dataset_size: 4301678 - config_name: super_glue_rte_does_it_follow_that_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 3714967 num_examples: 4980 - name: validation num_bytes: 401805 num_examples: 554 - name: test num_bytes: 4287470 num_examples: 6000 download_size: 2971692 dataset_size: 8404242 - config_name: super_glue_rte_does_this_imply features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1910924 num_examples: 2490 - name: validation num_bytes: 206857 num_examples: 277 - name: test num_bytes: 2301972 num_examples: 3000 download_size: 2226281 dataset_size: 4419753 - config_name: super_glue_rte_does_this_imply_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 3817483 num_examples: 4980 - name: validation num_bytes: 413215 num_examples: 554 - name: test num_bytes: 4409694 num_examples: 6000 download_size: 3002523 dataset_size: 8640392 - config_name: super_glue_rte_guaranteed_true features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1910924 num_examples: 2490 - name: validation num_bytes: 206857 num_examples: 277 - name: test num_bytes: 2301972 num_examples: 3000 download_size: 2225019 dataset_size: 4419753 - config_name: super_glue_rte_guaranteed_true_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 3817483 num_examples: 4980 - name: validation num_bytes: 413215 num_examples: 554 - name: test num_bytes: 4409694 num_examples: 6000 download_size: 3007337 dataset_size: 8640392 - config_name: super_glue_rte_justified_in_saying features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1898474 num_examples: 2490 - name: validation num_bytes: 205472 num_examples: 277 - name: test num_bytes: 2286972 num_examples: 3000 download_size: 2216017 dataset_size: 4390918 - config_name: super_glue_rte_justified_in_saying_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 3792583 num_examples: 4980 - name: validation num_bytes: 410445 num_examples: 554 - name: test num_bytes: 4379694 num_examples: 6000 download_size: 2990847 dataset_size: 8582722 - config_name: super_glue_rte_must_be_true features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1955744 num_examples: 2490 - name: validation num_bytes: 211843 num_examples: 277 - name: test num_bytes: 2355972 num_examples: 3000 download_size: 2242926 dataset_size: 4523559 - config_name: super_glue_rte_must_be_true_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 3907123 num_examples: 4980 - name: validation num_bytes: 423187 num_examples: 554 - name: test num_bytes: 4517694 num_examples: 6000 download_size: 3019993 dataset_size: 8848004 - config_name: super_glue_rte_should_assume features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1918394 num_examples: 2490 - name: validation num_bytes: 207688 num_examples: 277 - name: test num_bytes: 2310972 num_examples: 3000 download_size: 2229173 dataset_size: 4437054 - config_name: super_glue_rte_should_assume_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 3832423 num_examples: 4980 - name: validation num_bytes: 414877 num_examples: 554 - name: test num_bytes: 4427694 num_examples: 6000 download_size: 2991273 dataset_size: 8674994 - config_name: super_glue_wic_GPT_3_prompt features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1983607 num_examples: 5428 - name: validation num_bytes: 241938 num_examples: 638 - name: test num_bytes: 574759 num_examples: 1400 download_size: 957361 dataset_size: 2800304 - config_name: super_glue_wic_GPT_3_prompt_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 3957715 num_examples: 10856 - name: validation num_bytes: 482760 num_examples: 1276 - name: test num_bytes: 1058868 num_examples: 2800 download_size: 1238602 dataset_size: 5499343 - config_name: super_glue_wic_GPT_3_prompt_with_label features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2119307 num_examples: 5428 - name: validation num_bytes: 257888 num_examples: 638 - name: test num_bytes: 609759 num_examples: 1400 download_size: 964203 dataset_size: 2986954 - config_name: super_glue_wic_GPT_3_prompt_with_label_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 4229115 num_examples: 10856 - name: validation num_bytes: 514660 num_examples: 1276 - name: test num_bytes: 1128868 num_examples: 2800 download_size: 1250446 dataset_size: 5872643 - config_name: super_glue_wic_affirmation_true_or_false features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2293003 num_examples: 5428 - name: validation num_bytes: 278304 num_examples: 638 - name: test num_bytes: 646159 num_examples: 1400 download_size: 983242 dataset_size: 3217466 - config_name: super_glue_wic_affirmation_true_or_false_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 4533083 num_examples: 10856 - name: validation num_bytes: 550388 num_examples: 1276 - name: test num_bytes: 1207268 num_examples: 2800 download_size: 1275345 dataset_size: 6290739 - config_name: super_glue_wic_grammar_homework features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2374423 num_examples: 5428 - name: validation num_bytes: 287874 num_examples: 638 - name: test num_bytes: 675559 num_examples: 1400 download_size: 984415 dataset_size: 3337856 - config_name: super_glue_wic_grammar_homework_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 4739347 num_examples: 10856 - name: validation num_bytes: 574632 num_examples: 1276 - name: test num_bytes: 1260468 num_examples: 2800 download_size: 1274392 dataset_size: 6574447 - config_name: super_glue_wic_polysemous features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2564403 num_examples: 5428 - name: validation num_bytes: 310204 num_examples: 638 - name: test num_bytes: 724559 num_examples: 1400 download_size: 1002838 dataset_size: 3599166 - config_name: super_glue_wic_polysemous_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 5119307 num_examples: 10856 - name: validation num_bytes: 619292 num_examples: 1276 - name: test num_bytes: 1358468 num_examples: 2800 download_size: 1301826 dataset_size: 7097067 - config_name: super_glue_wic_question_context features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1994463 num_examples: 5428 - name: validation num_bytes: 243214 num_examples: 638 - name: test num_bytes: 577559 num_examples: 1400 download_size: 943605 dataset_size: 2815236 - config_name: super_glue_wic_question_context_meaning features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1782771 num_examples: 5428 - name: validation num_bytes: 218332 num_examples: 638 - name: test num_bytes: 522959 num_examples: 1400 download_size: 930660 dataset_size: 2524062 - config_name: super_glue_wic_question_context_meaning_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 3556043 num_examples: 10856 - name: validation num_bytes: 435548 num_examples: 1276 - name: test num_bytes: 955268 num_examples: 2800 download_size: 1205881 dataset_size: 4946859 - config_name: super_glue_wic_question_context_meaning_with_label features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1918471 num_examples: 5428 - name: validation num_bytes: 234282 num_examples: 638 - name: test num_bytes: 557959 num_examples: 1400 download_size: 936102 dataset_size: 2710712 - config_name: super_glue_wic_question_context_meaning_with_label_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 3827443 num_examples: 10856 - name: validation num_bytes: 467448 num_examples: 1276 - name: test num_bytes: 1025268 num_examples: 2800 download_size: 1214072 dataset_size: 5320159 - config_name: super_glue_wic_question_context_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 3979427 num_examples: 10856 - name: validation num_bytes: 485312 num_examples: 1276 - name: test num_bytes: 1064468 num_examples: 2800 download_size: 1226262 dataset_size: 5529207 - config_name: super_glue_wic_same_sense features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2390707 num_examples: 5428 - name: validation num_bytes: 289788 num_examples: 638 - name: test num_bytes: 679759 num_examples: 1400 download_size: 991665 dataset_size: 3360254 - config_name: super_glue_wic_same_sense_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 4771915 num_examples: 10856 - name: validation num_bytes: 578460 num_examples: 1276 - name: test num_bytes: 1268868 num_examples: 2800 download_size: 1288864 dataset_size: 6619243 - config_name: super_glue_wic_similar_sense features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1316903 num_examples: 5428 - name: validation num_bytes: 162928 num_examples: 638 - name: test num_bytes: 401667 num_examples: 1400 download_size: 879241 dataset_size: 1881498 - config_name: super_glue_wic_similar_sense_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 2624307 num_examples: 10856 - name: validation num_bytes: 324740 num_examples: 1276 - name: test num_bytes: 712684 num_examples: 2800 download_size: 1137914 dataset_size: 3661731 - config_name: super_glue_wsc.fixed_GPT_3_Style features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 264750 num_examples: 554 - name: validation num_bytes: 58787 num_examples: 104 - name: test num_bytes: 90504 num_examples: 146 download_size: 112061 dataset_size: 414041 - config_name: super_glue_wsc.fixed_GPT_3_Style_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 528567 num_examples: 1108 - name: validation num_bytes: 117420 num_examples: 208 - name: test num_bytes: 171555 num_examples: 292 download_size: 162969 dataset_size: 817542 - config_name: super_glue_wsc.fixed_I_think_they_mean features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 245820 num_examples: 554 - name: validation num_bytes: 57798 num_examples: 104 - name: test num_bytes: 86703 num_examples: 146 download_size: 118405 dataset_size: 390321 - config_name: super_glue_wsc.fixed_I_think_they_mean_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 490707 num_examples: 1108 - name: validation num_bytes: 115442 num_examples: 208 - name: test num_bytes: 163953 num_examples: 292 download_size: 162352 dataset_size: 770102 - config_name: super_glue_wsc.fixed_Who_or_what_is_are features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 228569 num_examples: 554 - name: validation num_bytes: 51844 num_examples: 104 - name: test num_bytes: 81002 num_examples: 146 download_size: 106806 dataset_size: 361415 - config_name: super_glue_wsc.fixed_Who_or_what_is_are_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 456205 num_examples: 1108 - name: validation num_bytes: 103534 num_examples: 208 - name: test num_bytes: 152551 num_examples: 292 download_size: 146175 dataset_size: 712290 - config_name: super_glue_wsc.fixed_by_p_they_mean features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 220922 num_examples: 554 - name: validation num_bytes: 50643 num_examples: 104 - name: test num_bytes: 78988 num_examples: 146 download_size: 108198 dataset_size: 350553 - config_name: super_glue_wsc.fixed_by_p_they_mean_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 440911 num_examples: 1108 - name: validation num_bytes: 101132 num_examples: 208 - name: test num_bytes: 148523 num_examples: 292 download_size: 147153 dataset_size: 690566 - config_name: super_glue_wsc.fixed_does_p_stand_for features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 217102 num_examples: 554 - name: validation num_bytes: 49843 num_examples: 104 - name: test num_bytes: 77984 num_examples: 146 download_size: 109493 dataset_size: 344929 - config_name: super_glue_wsc.fixed_does_p_stand_for_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 433271 num_examples: 1108 - name: validation num_bytes: 99532 num_examples: 208 - name: test num_bytes: 146515 num_examples: 292 download_size: 144454 dataset_size: 679318 - config_name: super_glue_wsc.fixed_does_the_pronoun_refer_to features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 249788 num_examples: 554 - name: validation num_bytes: 55979 num_examples: 104 - name: test num_bytes: 86598 num_examples: 146 download_size: 110787 dataset_size: 392365 - config_name: super_glue_wsc.fixed_does_the_pronoun_refer_to_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 498643 num_examples: 1108 - name: validation num_bytes: 111804 num_examples: 208 - name: test num_bytes: 163743 num_examples: 292 download_size: 152623 dataset_size: 774190 - config_name: super_glue_wsc.fixed_in_other_words features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 248700 num_examples: 554 - name: validation num_bytes: 58350 num_examples: 104 - name: test num_bytes: 86507 num_examples: 146 download_size: 119385 dataset_size: 393557 - config_name: super_glue_wsc.fixed_in_other_words_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 491675 num_examples: 1108 - name: validation num_bytes: 115434 num_examples: 208 - name: test num_bytes: 164145 num_examples: 292 download_size: 162110 dataset_size: 771254 - config_name: super_glue_wsc.fixed_p_is_are_r features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 239521 num_examples: 554 - name: validation num_bytes: 54166 num_examples: 104 - name: test num_bytes: 82932 num_examples: 146 download_size: 109490 dataset_size: 376619 - config_name: super_glue_wsc.fixed_p_is_are_r_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 473317 num_examples: 1108 - name: validation num_bytes: 107066 num_examples: 208 - name: test num_bytes: 156995 num_examples: 292 download_size: 149543 dataset_size: 737378 - config_name: super_glue_wsc.fixed_replaced_with features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 263026 num_examples: 554 - name: validation num_bytes: 58547 num_examples: 104 - name: test num_bytes: 90084 num_examples: 146 download_size: 112203 dataset_size: 411657 - config_name: super_glue_wsc.fixed_replaced_with_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 525119 num_examples: 1108 - name: validation num_bytes: 116940 num_examples: 208 - name: test num_bytes: 170715 num_examples: 292 download_size: 155805 dataset_size: 812774 - config_name: super_glue_wsc.fixed_the_pronoun_refers_to features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 253850 num_examples: 554 - name: validation num_bytes: 56847 num_examples: 104 - name: test num_bytes: 86708 num_examples: 146 download_size: 110888 dataset_size: 397405 - config_name: super_glue_wsc.fixed_the_pronoun_refers_to_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 501975 num_examples: 1108 - name: validation num_bytes: 112428 num_examples: 208 - name: test num_bytes: 164547 num_examples: 292 download_size: 152745 dataset_size: 778950 - config_name: trec_fine_grained_ABBR features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 29061 num_examples: 86 - name: test num_bytes: 2872 num_examples: 9 download_size: 13471 dataset_size: 31933 - config_name: trec_fine_grained_ABBR_context_first features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 29147 num_examples: 86 - name: test num_bytes: 2881 num_examples: 9 download_size: 13476 dataset_size: 32028 - config_name: trec_fine_grained_DESC features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 393977 num_examples: 1162 - name: test num_bytes: 41418 num_examples: 138 download_size: 94925 dataset_size: 435395 - config_name: trec_fine_grained_DESC_context_first features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 395139 num_examples: 1162 - name: test num_bytes: 41556 num_examples: 138 download_size: 95790 dataset_size: 436695 - config_name: trec_fine_grained_ENTY features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1190181 num_examples: 1250 - name: test num_bytes: 87266 num_examples: 94 download_size: 150983 dataset_size: 1277447 - config_name: trec_fine_grained_HUM features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 405413 num_examples: 1223 - name: test num_bytes: 19663 num_examples: 65 download_size: 120132 dataset_size: 425076 - config_name: trec_fine_grained_HUM_context_first features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 405413 num_examples: 1223 - name: test num_bytes: 19663 num_examples: 65 download_size: 120510 dataset_size: 425076 - config_name: trec_fine_grained_LOC features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 293654 num_examples: 835 - name: test num_bytes: 26894 num_examples: 81 download_size: 73853 dataset_size: 320548 - config_name: trec_fine_grained_LOC_context_first features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 294489 num_examples: 835 - name: test num_bytes: 26975 num_examples: 81 download_size: 74431 dataset_size: 321464 - config_name: trec_fine_grained_NUM features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 517672 num_examples: 896 - name: test num_bytes: 62715 num_examples: 113 download_size: 87233 dataset_size: 580387 - config_name: trec_fine_grained_NUM_context_first features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 518568 num_examples: 896 - name: test num_bytes: 62828 num_examples: 113 download_size: 88066 dataset_size: 581396 - config_name: trec_fine_grained_open features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 4097073 num_examples: 5452 - name: test num_bytes: 361374 num_examples: 500 download_size: 483505 dataset_size: 4458447 - config_name: trec_fine_grained_open_context_first features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 4097073 num_examples: 5452 - name: test num_bytes: 361374 num_examples: 500 download_size: 487935 dataset_size: 4458447 - config_name: trec_pick_the_best_descriptor features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2383862 num_examples: 5452 - name: test num_bytes: 203911 num_examples: 500 download_size: 501452 dataset_size: 2587773 - config_name: trec_trec1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2149426 num_examples: 5452 - name: test num_bytes: 182411 num_examples: 500 download_size: 492132 dataset_size: 2331837 - config_name: trec_trec2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2291178 num_examples: 5452 - name: test num_bytes: 195411 num_examples: 500 download_size: 492952 dataset_size: 2486589 - config_name: trec_what_category_best_describe features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2372958 num_examples: 5452 - name: test num_bytes: 202911 num_examples: 500 download_size: 500367 dataset_size: 2575869 - config_name: trec_which_category_best_describes features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 2689174 num_examples: 5452 - name: test num_bytes: 231911 num_examples: 500 download_size: 511984 dataset_size: 2921085 - config_name: trivia_qa_unfiltered_first_person_context features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 23222479 num_examples: 87622 - name: validation num_bytes: 2998592 num_examples: 11313 - name: test num_bytes: 2891859 num_examples: 10832 download_size: 15869519 dataset_size: 29112930 - config_name: trivia_qa_unfiltered_formal_description features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 35314285 num_examples: 87622 - name: validation num_bytes: 4560592 num_examples: 11313 - name: test num_bytes: 4386675 num_examples: 10832 download_size: 16841793 dataset_size: 44261552 - config_name: trivia_qa_unfiltered_guess_question features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 26388503 num_examples: 87622 - name: validation num_bytes: 3405357 num_examples: 11313 download_size: 14849804 dataset_size: 29793860 - config_name: trivia_qa_unfiltered_question_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 23047205 num_examples: 87622 - name: validation num_bytes: 2974273 num_examples: 11313 - name: test num_bytes: 2870195 num_examples: 10832 download_size: 15992511 dataset_size: 28891673 - config_name: trivia_qa_unfiltered_question_with_instruction features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 23660575 num_examples: 87622 - name: validation num_bytes: 3054737 num_examples: 11313 - name: test num_bytes: 2946019 num_examples: 10832 download_size: 15886084 dataset_size: 29661331 - config_name: web_questions_get_the_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 804337 num_examples: 3778 - name: test num_bytes: 436882 num_examples: 2032 download_size: 489913 dataset_size: 1241219 - config_name: web_questions_potential_correct_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 872716 num_examples: 3778 - name: test num_bytes: 472848 num_examples: 2032 download_size: 495767 dataset_size: 1345564 - config_name: web_questions_question_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 509600 num_examples: 3778 - name: test num_bytes: 277649 num_examples: 2032 download_size: 463024 dataset_size: 787249 - config_name: web_questions_short_general_knowledge_q features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 713665 num_examples: 3778 - name: test num_bytes: 387500 num_examples: 2032 download_size: 480185 dataset_size: 1101165 - config_name: web_questions_whats_the_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 782036 num_examples: 3778 - name: test num_bytes: 424624 num_examples: 2032 download_size: 488302 dataset_size: 1206660 - config_name: wiki_bio_comprehension features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1630510502 num_examples: 582639 - name: test num_bytes: 203505789 num_examples: 72829 - name: val num_bytes: 203916390 num_examples: 72831 download_size: 888828114 dataset_size: 2037932681 - config_name: wiki_bio_guess_person features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 709582624 num_examples: 582639 - name: test num_bytes: 88627789 num_examples: 72829 - name: val num_bytes: 88793147 num_examples: 72831 download_size: 369465704 dataset_size: 887003560 - config_name: wiki_bio_key_content features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1427894706 num_examples: 582639 - name: test num_bytes: 178164868 num_examples: 72829 - name: val num_bytes: 178545380 num_examples: 72831 download_size: 805077501 dataset_size: 1784604954 - config_name: wiki_bio_what_content features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1005721358 num_examples: 582639 - name: test num_bytes: 125491764 num_examples: 72829 - name: val num_bytes: 125718669 num_examples: 72831 download_size: 509911784 dataset_size: 1256931791 - config_name: wiki_bio_who features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1439607119 num_examples: 582639 - name: test num_bytes: 179628525 num_examples: 72829 - name: val num_bytes: 180006405 num_examples: 72831 download_size: 808442534 dataset_size: 1799242049 - config_name: wiki_hop_original_choose_best_object_affirmative_1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 663150479 num_examples: 43738 - name: validation num_bytes: 83041884 num_examples: 5129 download_size: 385675449 dataset_size: 746192363 - config_name: wiki_hop_original_choose_best_object_affirmative_2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 663019265 num_examples: 43738 - name: validation num_bytes: 83026497 num_examples: 5129 download_size: 385780787 dataset_size: 746045762 - config_name: wiki_hop_original_choose_best_object_affirmative_3 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 666212139 num_examples: 43738 - name: validation num_bytes: 83400914 num_examples: 5129 download_size: 386516604 dataset_size: 749613053 - config_name: wiki_hop_original_choose_best_object_interrogative_1 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 658557989 num_examples: 43738 - name: validation num_bytes: 82503339 num_examples: 5129 download_size: 384888543 dataset_size: 741061328 - config_name: wiki_hop_original_choose_best_object_interrogative_2 features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 658601727 num_examples: 43738 - name: validation num_bytes: 82508468 num_examples: 5129 download_size: 385067937 dataset_size: 741110195 - config_name: wiki_hop_original_explain_relation features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 620991073 num_examples: 43738 - name: validation num_bytes: 77941958 num_examples: 5129 download_size: 366004566 dataset_size: 698933031 - config_name: wiki_hop_original_generate_object features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 621316721 num_examples: 43738 - name: validation num_bytes: 77980628 num_examples: 5129 download_size: 366787046 dataset_size: 699297349 - config_name: wiki_hop_original_generate_subject features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 623714465 num_examples: 43738 - name: validation num_bytes: 78260730 num_examples: 5129 download_size: 367748453 dataset_size: 701975195 - config_name: wiki_hop_original_generate_subject_and_object features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 624675259 num_examples: 43738 - name: validation num_bytes: 78374281 num_examples: 5129 download_size: 367493299 dataset_size: 703049540 - config_name: wiki_qa_Decide_good_answer features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 11928327 num_examples: 20360 - name: validation num_bytes: 1588513 num_examples: 2733 - name: test num_bytes: 3601306 num_examples: 6165 download_size: 6026723 dataset_size: 17118146 - config_name: wiki_qa_Direct_Answer_to_Question features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 464780 num_examples: 1040 - name: validation num_bytes: 62282 num_examples: 140 - name: test num_bytes: 128388 num_examples: 293 download_size: 395128 dataset_size: 655450 - config_name: wiki_qa_Generate_Question_from_Topic features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 600344 num_examples: 1040 - name: validation num_bytes: 80494 num_examples: 140 - name: test num_bytes: 166291 num_examples: 293 download_size: 434236 dataset_size: 847129 - config_name: wiki_qa_Is_This_True_ features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 9652071 num_examples: 20360 - name: validation num_bytes: 1282191 num_examples: 2733 - name: test num_bytes: 2918012 num_examples: 6165 download_size: 5726813 dataset_size: 13852274 - config_name: wiki_qa_Jeopardy_style features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 563988 num_examples: 1040 - name: validation num_bytes: 75570 num_examples: 140 - name: test num_bytes: 155917 num_examples: 293 download_size: 435303 dataset_size: 795475 - config_name: wiki_qa_Topic_Prediction_Answer_Only features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 476970 num_examples: 1040 - name: validation num_bytes: 63658 num_examples: 140 - name: test num_bytes: 131049 num_examples: 293 download_size: 377885 dataset_size: 671677 - config_name: wiki_qa_Topic_Prediction_Question_Only features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 242922 num_examples: 1040 - name: validation num_bytes: 32780 num_examples: 140 - name: test num_bytes: 68566 num_examples: 293 download_size: 130561 dataset_size: 344268 - config_name: wiki_qa_Topic_Prediction_Question_and_Answer_Pair features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 637104 num_examples: 1040 - name: validation num_bytes: 85410 num_examples: 140 - name: test num_bytes: 176567 num_examples: 293 download_size: 443010 dataset_size: 899081 - config_name: wiki_qa_automatic_system features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 12887927 num_examples: 20360 - name: validation num_bytes: 1715972 num_examples: 2733 - name: test num_bytes: 3899289 num_examples: 6165 download_size: 5942624 dataset_size: 18503188 - config_name: wiki_qa_exercise features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 14832087 num_examples: 20360 - name: validation num_bytes: 1976940 num_examples: 2733 - name: test num_bytes: 4488199 num_examples: 6165 download_size: 6093460 dataset_size: 21297226 - config_name: wiki_qa_found_on_google features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 11401647 num_examples: 20360 - name: validation num_bytes: 1516463 num_examples: 2733 - name: test num_bytes: 3449244 num_examples: 6165 download_size: 5814247 dataset_size: 16367354 - config_name: winogrande_winogrande_debiased_Replace features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3875803 num_examples: 9248 - name: validation num_bytes: 528582 num_examples: 1267 - name: test num_bytes: 739620 num_examples: 1767 download_size: 1782977 dataset_size: 5144005 - config_name: winogrande_winogrande_debiased_Replace_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 7551668 num_examples: 18496 - name: validation num_bytes: 1030154 num_examples: 2534 - name: test num_bytes: 1440851 num_examples: 3534 download_size: 2298663 dataset_size: 10022673 - config_name: winogrande_winogrande_debiased_does_underscore_refer_to features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3515131 num_examples: 9248 - name: validation num_bytes: 479169 num_examples: 1267 - name: test num_bytes: 670707 num_examples: 1767 download_size: 1745005 dataset_size: 4665007 - config_name: winogrande_winogrande_debiased_does_underscore_refer_to_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 6830324 num_examples: 18496 - name: validation num_bytes: 931328 num_examples: 2534 - name: test num_bytes: 1303025 num_examples: 3534 download_size: 2251303 dataset_size: 9064677 - config_name: winogrande_winogrande_debiased_fill_in_the_blank features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3894299 num_examples: 9248 - name: validation num_bytes: 531116 num_examples: 1267 - name: test num_bytes: 743154 num_examples: 1767 download_size: 1791464 dataset_size: 5168569 - config_name: winogrande_winogrande_debiased_fill_in_the_blank_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 7588660 num_examples: 18496 - name: validation num_bytes: 1035222 num_examples: 2534 - name: test num_bytes: 1447919 num_examples: 3534 download_size: 2325131 dataset_size: 10071801 - config_name: winogrande_winogrande_debiased_stand_for features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3533627 num_examples: 9248 - name: validation num_bytes: 481703 num_examples: 1267 - name: test num_bytes: 674241 num_examples: 1767 download_size: 1726262 dataset_size: 4689571 - config_name: winogrande_winogrande_debiased_stand_for_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 6904308 num_examples: 18496 - name: validation num_bytes: 941464 num_examples: 2534 - name: test num_bytes: 1317161 num_examples: 3534 download_size: 2236146 dataset_size: 9162933 - config_name: winogrande_winogrande_debiased_underscore_refer_to features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 3635355 num_examples: 9248 - name: validation num_bytes: 495640 num_examples: 1267 - name: test num_bytes: 693678 num_examples: 1767 download_size: 1753140 dataset_size: 4824673 - config_name: winogrande_winogrande_debiased_underscore_refer_to_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 7070772 num_examples: 18496 - name: validation num_bytes: 964270 num_examples: 2534 - name: test num_bytes: 1348967 num_examples: 3534 download_size: 2260695 dataset_size: 9384009 - config_name: winogrande_winogrande_xl_Replace features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 16754221 num_examples: 40398 - name: validation num_bytes: 528582 num_examples: 1267 - name: test num_bytes: 739620 num_examples: 1767 download_size: 5219643 dataset_size: 18022423 - config_name: winogrande_winogrande_xl_Replace_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 32627062 num_examples: 80796 - name: validation num_bytes: 1030154 num_examples: 2534 - name: test num_bytes: 1440851 num_examples: 3534 download_size: 7524715 dataset_size: 35098067 - config_name: winogrande_winogrande_xl_does_underscore_refer_to features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 15178699 num_examples: 40398 - name: validation num_bytes: 479169 num_examples: 1267 - name: test num_bytes: 670707 num_examples: 1767 download_size: 5110009 dataset_size: 16328575 - config_name: winogrande_winogrande_xl_does_underscore_refer_to_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 29476018 num_examples: 80796 - name: validation num_bytes: 931328 num_examples: 2534 - name: test num_bytes: 1303025 num_examples: 3534 download_size: 7414291 dataset_size: 31710371 - config_name: winogrande_winogrande_xl_fill_in_the_blank features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 16835017 num_examples: 40398 - name: validation num_bytes: 531116 num_examples: 1267 - name: test num_bytes: 743154 num_examples: 1767 download_size: 5218314 dataset_size: 18109287 - config_name: winogrande_winogrande_xl_fill_in_the_blank_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 32788654 num_examples: 80796 - name: validation num_bytes: 1035222 num_examples: 2534 - name: test num_bytes: 1447919 num_examples: 3534 download_size: 7679499 dataset_size: 35271795 - config_name: winogrande_winogrande_xl_stand_for features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 15259495 num_examples: 40398 - name: validation num_bytes: 481703 num_examples: 1267 - name: test num_bytes: 674241 num_examples: 1767 download_size: 5036118 dataset_size: 16415439 - config_name: winogrande_winogrande_xl_stand_for_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 29799202 num_examples: 80796 - name: validation num_bytes: 941464 num_examples: 2534 - name: test num_bytes: 1317161 num_examples: 3534 download_size: 7352127 dataset_size: 32057827 - config_name: winogrande_winogrande_xl_underscore_refer_to features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 15703873 num_examples: 40398 - name: validation num_bytes: 495640 num_examples: 1267 - name: test num_bytes: 693678 num_examples: 1767 download_size: 5127188 dataset_size: 16893191 - config_name: winogrande_winogrande_xl_underscore_refer_to_score_eval features: - name: idx sequence: int32 - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: is_correct dtype: bool - name: targets sequence: int32 - name: targets_pretokenized dtype: string - name: weight dtype: float32 splits: - name: train num_bytes: 30526366 num_examples: 80796 - name: validation num_bytes: 964270 num_examples: 2534 - name: test num_bytes: 1348967 num_examples: 3534 download_size: 7446677 dataset_size: 32839603 - config_name: wiqa_does_the_supposed_perturbation_have_an_effect features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 32441234 num_examples: 29808 - name: validation num_bytes: 7194477 num_examples: 6894 - name: test num_bytes: 2993752 num_examples: 3003 download_size: 12078412 dataset_size: 42629463 - config_name: wiqa_effect_with_label_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 29887682 num_examples: 29808 - name: validation num_bytes: 6603891 num_examples: 6894 - name: test num_bytes: 2736749 num_examples: 3003 download_size: 11641512 dataset_size: 39228322 - config_name: wiqa_effect_with_string_answer features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 32719442 num_examples: 29808 - name: validation num_bytes: 7258821 num_examples: 6894 - name: test num_bytes: 3024320 num_examples: 3003 download_size: 12120728 dataset_size: 43002583 - config_name: wiqa_what_is_the_final_step_of_the_following_process features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 22534752 num_examples: 29808 - name: validation num_bytes: 4960056 num_examples: 6894 - name: test num_bytes: 2018929 num_examples: 3003 download_size: 4993958 dataset_size: 29513737 - config_name: wiqa_what_is_the_missing_first_step features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 22948121 num_examples: 29808 - name: validation num_bytes: 5051961 num_examples: 6894 - name: test num_bytes: 2060388 num_examples: 3003 download_size: 5012113 dataset_size: 30060470 - config_name: wiqa_what_might_be_the_first_step_of_the_process features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 22471193 num_examples: 29808 - name: validation num_bytes: 4941657 num_examples: 6894 - name: test num_bytes: 2012340 num_examples: 3003 download_size: 4994981 dataset_size: 29425190 - config_name: wiqa_what_might_be_the_last_step_of_the_process features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 22415520 num_examples: 29808 - name: validation num_bytes: 4932480 num_examples: 6894 - name: test num_bytes: 2006917 num_examples: 3003 download_size: 4998002 dataset_size: 29354917 - config_name: wiqa_which_of_the_following_is_the_supposed_perturbation features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 38964516 num_examples: 29808 - name: validation num_bytes: 8703251 num_examples: 6894 - name: test num_bytes: 3649318 num_examples: 3003 download_size: 12726852 dataset_size: 51317085 - config_name: xsum_DOC_boils_down_to_simple_idea_that features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 671037016 num_examples: 204045 - name: validation num_bytes: 37260538 num_examples: 11332 - name: test num_bytes: 37363789 num_examples: 11334 download_size: 423515211 dataset_size: 745661343 - config_name: xsum_DOC_given_above_write_one_sentence features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 680219041 num_examples: 204045 - name: validation num_bytes: 37770478 num_examples: 11332 - name: test num_bytes: 37873819 num_examples: 11334 download_size: 425884310 dataset_size: 755863338 - config_name: xsum_DOC_how_would_you_rephrase_few_words features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 675117916 num_examples: 204045 - name: validation num_bytes: 37487178 num_examples: 11332 - name: test num_bytes: 37590469 num_examples: 11334 download_size: 424419611 dataset_size: 750195563 - config_name: xsum_DOC_tldr features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 661242856 num_examples: 204045 - name: validation num_bytes: 36716602 num_examples: 11332 - name: test num_bytes: 36819757 num_examples: 11334 download_size: 421356084 dataset_size: 734779215 - config_name: xsum_DOC_write_summary_of_above features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 674709826 num_examples: 204045 - name: validation num_bytes: 37464514 num_examples: 11332 - name: test num_bytes: 37567801 num_examples: 11334 download_size: 424257912 dataset_size: 749742141 - config_name: xsum_article_DOC_summary features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 662671171 num_examples: 204045 - name: validation num_bytes: 36795926 num_examples: 11332 - name: test num_bytes: 36899095 num_examples: 11334 download_size: 421436849 dataset_size: 736366192 - config_name: xsum_college_roommate_asked_DOC_so_I_recap features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 693890056 num_examples: 204045 - name: validation num_bytes: 38529722 num_examples: 11332 - name: test num_bytes: 38633197 num_examples: 11334 download_size: 428092027 dataset_size: 771052975 - config_name: xsum_read_below_DOC_write_abstract features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 692869831 num_examples: 204045 - name: validation num_bytes: 38473062 num_examples: 11332 - name: test num_bytes: 38576527 num_examples: 11334 download_size: 427949570 dataset_size: 769919420 - config_name: xsum_summarize_DOC features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 660834766 num_examples: 204045 - name: validation num_bytes: 36693938 num_examples: 11332 - name: test num_bytes: 36797089 num_examples: 11334 download_size: 420917086 dataset_size: 734325793 - config_name: xsum_summarize_this_DOC_summary features: - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 668996566 num_examples: 204045 - name: validation num_bytes: 37147218 num_examples: 11332 - name: test num_bytes: 37250449 num_examples: 11334 download_size: 423104781 dataset_size: 743394233 - config_name: yelp_review_full_based_on_that features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1031638858 num_examples: 650000 - name: test num_bytes: 79418916 num_examples: 50000 download_size: 556617412 dataset_size: 1111057774 - config_name: yelp_review_full_format_rating features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1019288862 num_examples: 650000 - name: test num_bytes: 78468916 num_examples: 50000 download_size: 556205049 dataset_size: 1097757778 - config_name: yelp_review_full_format_score features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1020718862 num_examples: 650000 - name: test num_bytes: 78578916 num_examples: 50000 download_size: 557789138 dataset_size: 1099297778 - config_name: yelp_review_full_format_star features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1014088862 num_examples: 650000 - name: test num_bytes: 78068916 num_examples: 50000 download_size: 555578441 dataset_size: 1092157778 - config_name: yelp_review_full_on_a_scale features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1035018858 num_examples: 650000 - name: test num_bytes: 79678916 num_examples: 50000 download_size: 557874177 dataset_size: 1114697774 - config_name: yelp_review_full_so_i_would features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1020588858 num_examples: 650000 - name: test num_bytes: 78568916 num_examples: 50000 download_size: 555669482 dataset_size: 1099157774 - config_name: yelp_review_full_this_place features: - name: answer_choices sequence: string - name: inputs sequence: int32 - name: inputs_pretokenized dtype: string - name: targets sequence: int32 - name: targets_pretokenized dtype: string splits: - name: train num_bytes: 1018638858 num_examples: 650000 - name: test num_bytes: 78418916 num_examples: 50000 download_size: 555640691 dataset_size: 1097057774 configs: - config_name: adversarial_qa_dbert_answer_the_following_q data_files: - split: train path: adversarial_qa_dbert_answer_the_following_q/train-* - split: validation path: adversarial_qa_dbert_answer_the_following_q/validation-* - config_name: adversarial_qa_dbert_based_on data_files: - split: train path: adversarial_qa_dbert_based_on/train-* - split: validation path: adversarial_qa_dbert_based_on/validation-* - config_name: adversarial_qa_dbert_generate_question data_files: - split: train path: adversarial_qa_dbert_generate_question/train-* - split: validation path: adversarial_qa_dbert_generate_question/validation-* - split: test path: adversarial_qa_dbert_generate_question/test-* - config_name: adversarial_qa_dbert_question_context_answer data_files: - split: train path: adversarial_qa_dbert_question_context_answer/train-* - split: validation path: adversarial_qa_dbert_question_context_answer/validation-* - config_name: adversarial_qa_dbert_tell_what_it_is data_files: - split: train path: adversarial_qa_dbert_tell_what_it_is/train-* - split: validation path: adversarial_qa_dbert_tell_what_it_is/validation-* - config_name: adversarial_qa_dbidaf_answer_the_following_q data_files: - split: train path: adversarial_qa_dbidaf_answer_the_following_q/train-* - split: validation path: adversarial_qa_dbidaf_answer_the_following_q/validation-* - config_name: adversarial_qa_dbidaf_based_on data_files: - split: train path: adversarial_qa_dbidaf_based_on/train-* - split: validation path: adversarial_qa_dbidaf_based_on/validation-* - config_name: adversarial_qa_dbidaf_generate_question data_files: - split: train path: adversarial_qa_dbidaf_generate_question/train-* - split: validation path: adversarial_qa_dbidaf_generate_question/validation-* - split: test path: adversarial_qa_dbidaf_generate_question/test-* - config_name: adversarial_qa_dbidaf_question_context_answer data_files: - split: train path: adversarial_qa_dbidaf_question_context_answer/train-* - split: validation path: adversarial_qa_dbidaf_question_context_answer/validation-* - config_name: adversarial_qa_dbidaf_tell_what_it_is data_files: - split: train path: adversarial_qa_dbidaf_tell_what_it_is/train-* - split: validation path: adversarial_qa_dbidaf_tell_what_it_is/validation-* - config_name: adversarial_qa_droberta_answer_the_following_q data_files: - split: train path: adversarial_qa_droberta_answer_the_following_q/train-* - split: validation path: adversarial_qa_droberta_answer_the_following_q/validation-* - config_name: adversarial_qa_droberta_based_on data_files: - split: train path: adversarial_qa_droberta_based_on/train-* - split: validation path: adversarial_qa_droberta_based_on/validation-* - config_name: adversarial_qa_droberta_generate_question data_files: - split: train path: adversarial_qa_droberta_generate_question/train-* - split: validation path: adversarial_qa_droberta_generate_question/validation-* - split: test path: adversarial_qa_droberta_generate_question/test-* - config_name: adversarial_qa_droberta_question_context_answer data_files: - split: train path: adversarial_qa_droberta_question_context_answer/train-* - split: validation path: adversarial_qa_droberta_question_context_answer/validation-* - config_name: adversarial_qa_droberta_tell_what_it_is data_files: - split: train path: adversarial_qa_droberta_tell_what_it_is/train-* - split: validation path: adversarial_qa_droberta_tell_what_it_is/validation-* - config_name: ag_news_classify data_files: - split: train path: ag_news_classify/train-* - split: test path: ag_news_classify/test-* - config_name: ag_news_classify_question_first data_files: - split: train path: ag_news_classify_question_first/train-* - split: test path: ag_news_classify_question_first/test-* - config_name: ag_news_classify_with_choices data_files: - split: train path: ag_news_classify_with_choices/train-* - split: test path: ag_news_classify_with_choices/test-* - config_name: ag_news_classify_with_choices_question_first data_files: - split: train path: ag_news_classify_with_choices_question_first/train-* - split: test path: ag_news_classify_with_choices_question_first/test-* - config_name: ag_news_recommend data_files: - split: train path: ag_news_recommend/train-* - split: test path: ag_news_recommend/test-* - config_name: ag_news_which_section data_files: - split: train path: ag_news_which_section/train-* - split: test path: ag_news_which_section/test-* - config_name: ag_news_which_section_choices data_files: - split: train path: ag_news_which_section_choices/train-* - split: test path: ag_news_which_section_choices/test-* - config_name: ai2_arc_ARC_Challenge_heres_a_problem data_files: - split: train path: ai2_arc_ARC_Challenge_heres_a_problem/train-* - split: validation path: ai2_arc_ARC_Challenge_heres_a_problem/validation-* - split: test path: ai2_arc_ARC_Challenge_heres_a_problem/test-* - config_name: ai2_arc_ARC_Challenge_i_am_hesitating data_files: - split: train path: ai2_arc_ARC_Challenge_i_am_hesitating/train-* - split: validation path: ai2_arc_ARC_Challenge_i_am_hesitating/validation-* - split: test path: ai2_arc_ARC_Challenge_i_am_hesitating/test-* - config_name: ai2_arc_ARC_Challenge_multiple_choice data_files: - split: train path: ai2_arc_ARC_Challenge_multiple_choice/train-* - split: validation path: ai2_arc_ARC_Challenge_multiple_choice/validation-* - split: test path: ai2_arc_ARC_Challenge_multiple_choice/test-* - config_name: ai2_arc_ARC_Challenge_pick_false_options data_files: - split: train path: ai2_arc_ARC_Challenge_pick_false_options/train-* - split: validation path: ai2_arc_ARC_Challenge_pick_false_options/validation-* - split: test path: ai2_arc_ARC_Challenge_pick_false_options/test-* - config_name: ai2_arc_ARC_Challenge_pick_the_most_correct_option data_files: - split: train path: ai2_arc_ARC_Challenge_pick_the_most_correct_option/train-* - split: validation path: ai2_arc_ARC_Challenge_pick_the_most_correct_option/validation-* - split: test path: ai2_arc_ARC_Challenge_pick_the_most_correct_option/test-* - config_name: ai2_arc_ARC_Challenge_qa_options data_files: - split: train path: ai2_arc_ARC_Challenge_qa_options/train-* - split: validation path: ai2_arc_ARC_Challenge_qa_options/validation-* - split: test path: ai2_arc_ARC_Challenge_qa_options/test-* - config_name: ai2_arc_ARC_Easy_heres_a_problem data_files: - split: train path: ai2_arc_ARC_Easy_heres_a_problem/train-* - split: validation path: ai2_arc_ARC_Easy_heres_a_problem/validation-* - split: test path: ai2_arc_ARC_Easy_heres_a_problem/test-* - config_name: ai2_arc_ARC_Easy_i_am_hesitating data_files: - split: train path: ai2_arc_ARC_Easy_i_am_hesitating/train-* - split: validation path: ai2_arc_ARC_Easy_i_am_hesitating/validation-* - split: test path: ai2_arc_ARC_Easy_i_am_hesitating/test-* - config_name: ai2_arc_ARC_Easy_multiple_choice data_files: - split: train path: ai2_arc_ARC_Easy_multiple_choice/train-* - split: validation path: ai2_arc_ARC_Easy_multiple_choice/validation-* - split: test path: ai2_arc_ARC_Easy_multiple_choice/test-* - config_name: ai2_arc_ARC_Easy_pick_false_options data_files: - split: train path: ai2_arc_ARC_Easy_pick_false_options/train-* - split: validation path: ai2_arc_ARC_Easy_pick_false_options/validation-* - split: test path: ai2_arc_ARC_Easy_pick_false_options/test-* - config_name: ai2_arc_ARC_Easy_pick_the_most_correct_option data_files: - split: train path: ai2_arc_ARC_Easy_pick_the_most_correct_option/train-* - split: validation path: ai2_arc_ARC_Easy_pick_the_most_correct_option/validation-* - split: test path: ai2_arc_ARC_Easy_pick_the_most_correct_option/test-* - config_name: ai2_arc_ARC_Easy_qa_options data_files: - split: train path: ai2_arc_ARC_Easy_qa_options/train-* - split: validation path: ai2_arc_ARC_Easy_qa_options/validation-* - split: test path: ai2_arc_ARC_Easy_qa_options/test-* - config_name: amazon_polarity_Is_this_product_review_positive data_files: - split: train path: amazon_polarity_Is_this_product_review_positive/train-* - split: test path: amazon_polarity_Is_this_product_review_positive/test-* - config_name: amazon_polarity_Is_this_review data_files: - split: train path: amazon_polarity_Is_this_review/train-* - split: test path: amazon_polarity_Is_this_review/test-* - config_name: amazon_polarity_Is_this_review_negative data_files: - split: train path: amazon_polarity_Is_this_review_negative/train-* - split: test path: amazon_polarity_Is_this_review_negative/test-* - config_name: amazon_polarity_User_recommend_this_product data_files: - split: train path: amazon_polarity_User_recommend_this_product/train-* - split: test path: amazon_polarity_User_recommend_this_product/test-* - config_name: amazon_polarity_convey_negative_or_positive_sentiment data_files: - split: train path: amazon_polarity_convey_negative_or_positive_sentiment/train-* - split: test path: amazon_polarity_convey_negative_or_positive_sentiment/test-* - config_name: amazon_polarity_flattering_or_not data_files: - split: train path: amazon_polarity_flattering_or_not/train-* - split: test path: amazon_polarity_flattering_or_not/test-* - config_name: amazon_polarity_negative_or_positive_tone data_files: - split: train path: amazon_polarity_negative_or_positive_tone/train-* - split: test path: amazon_polarity_negative_or_positive_tone/test-* - config_name: amazon_polarity_user_satisfied data_files: - split: train path: amazon_polarity_user_satisfied/train-* - split: test path: amazon_polarity_user_satisfied/test-* - config_name: amazon_polarity_would_you_buy data_files: - split: train path: amazon_polarity_would_you_buy/train-* - split: test path: amazon_polarity_would_you_buy/test-* - config_name: anli_GPT_3_style_r1 data_files: - split: train path: anli_GPT_3_style_r1/train-* - split: validation path: anli_GPT_3_style_r1/validation-* - split: test path: anli_GPT_3_style_r1/test-* - config_name: anli_GPT_3_style_r1_score_eval data_files: - split: train path: anli_GPT_3_style_r1_score_eval/train-* - split: validation path: anli_GPT_3_style_r1_score_eval/validation-* - split: test path: anli_GPT_3_style_r1_score_eval/test-* - config_name: anli_GPT_3_style_r2 data_files: - split: train path: anli_GPT_3_style_r2/train-* - split: validation path: anli_GPT_3_style_r2/validation-* - split: test path: anli_GPT_3_style_r2/test-* - config_name: anli_GPT_3_style_r2_score_eval data_files: - split: train path: anli_GPT_3_style_r2_score_eval/train-* - split: validation path: anli_GPT_3_style_r2_score_eval/validation-* - split: test path: anli_GPT_3_style_r2_score_eval/test-* - config_name: anli_GPT_3_style_r3 data_files: - split: train path: anli_GPT_3_style_r3/train-* - split: validation path: anli_GPT_3_style_r3/validation-* - split: test path: anli_GPT_3_style_r3/test-* - config_name: anli_GPT_3_style_r3_score_eval data_files: - split: train path: anli_GPT_3_style_r3_score_eval/train-* - split: validation path: anli_GPT_3_style_r3_score_eval/validation-* - split: test path: anli_GPT_3_style_r3_score_eval/test-* - config_name: anli_MNLI_crowdsource_r1 data_files: - split: train path: anli_MNLI_crowdsource_r1/train-* - split: validation path: anli_MNLI_crowdsource_r1/validation-* - split: test path: anli_MNLI_crowdsource_r1/test-* - config_name: anli_MNLI_crowdsource_r1_score_eval data_files: - split: train path: anli_MNLI_crowdsource_r1_score_eval/train-* - split: validation path: anli_MNLI_crowdsource_r1_score_eval/validation-* - split: test path: anli_MNLI_crowdsource_r1_score_eval/test-* - config_name: anli_MNLI_crowdsource_r2 data_files: - split: train path: anli_MNLI_crowdsource_r2/train-* - split: validation path: anli_MNLI_crowdsource_r2/validation-* - split: test path: anli_MNLI_crowdsource_r2/test-* - config_name: anli_MNLI_crowdsource_r2_score_eval data_files: - split: train path: anli_MNLI_crowdsource_r2_score_eval/train-* - split: validation path: anli_MNLI_crowdsource_r2_score_eval/validation-* - split: test path: anli_MNLI_crowdsource_r2_score_eval/test-* - config_name: anli_MNLI_crowdsource_r3 data_files: - split: train path: anli_MNLI_crowdsource_r3/train-* - split: validation path: anli_MNLI_crowdsource_r3/validation-* - split: test path: anli_MNLI_crowdsource_r3/test-* - config_name: anli_MNLI_crowdsource_r3_score_eval data_files: - split: train path: anli_MNLI_crowdsource_r3_score_eval/train-* - split: validation path: anli_MNLI_crowdsource_r3_score_eval/validation-* - split: test path: anli_MNLI_crowdsource_r3_score_eval/test-* - config_name: anli_always_sometimes_never_r1 data_files: - split: train path: anli_always_sometimes_never_r1/train-* - split: validation path: anli_always_sometimes_never_r1/validation-* - split: test path: anli_always_sometimes_never_r1/test-* - config_name: anli_always_sometimes_never_r1_score_eval data_files: - split: train path: anli_always_sometimes_never_r1_score_eval/train-* - split: validation path: anli_always_sometimes_never_r1_score_eval/validation-* - split: test path: anli_always_sometimes_never_r1_score_eval/test-* - config_name: anli_always_sometimes_never_r2 data_files: - split: train path: anli_always_sometimes_never_r2/train-* - split: validation path: anli_always_sometimes_never_r2/validation-* - split: test path: anli_always_sometimes_never_r2/test-* - config_name: anli_always_sometimes_never_r2_score_eval data_files: - split: train path: anli_always_sometimes_never_r2_score_eval/train-* - split: validation path: anli_always_sometimes_never_r2_score_eval/validation-* - split: test path: anli_always_sometimes_never_r2_score_eval/test-* - config_name: anli_always_sometimes_never_r3 data_files: - split: train path: anli_always_sometimes_never_r3/train-* - split: validation path: anli_always_sometimes_never_r3/validation-* - split: test path: anli_always_sometimes_never_r3/test-* - config_name: anli_always_sometimes_never_r3_score_eval data_files: - split: train path: anli_always_sometimes_never_r3_score_eval/train-* - split: validation path: anli_always_sometimes_never_r3_score_eval/validation-* - split: test path: anli_always_sometimes_never_r3_score_eval/test-* - config_name: anli_based_on_the_previous_passage_r1 data_files: - split: train path: anli_based_on_the_previous_passage_r1/train-* - split: validation path: anli_based_on_the_previous_passage_r1/validation-* - split: test path: anli_based_on_the_previous_passage_r1/test-* - config_name: anli_based_on_the_previous_passage_r1_score_eval data_files: - split: train path: anli_based_on_the_previous_passage_r1_score_eval/train-* - split: validation path: anli_based_on_the_previous_passage_r1_score_eval/validation-* - split: test path: anli_based_on_the_previous_passage_r1_score_eval/test-* - config_name: anli_based_on_the_previous_passage_r2 data_files: - split: train path: anli_based_on_the_previous_passage_r2/train-* - split: validation path: anli_based_on_the_previous_passage_r2/validation-* - split: test path: anli_based_on_the_previous_passage_r2/test-* - config_name: anli_based_on_the_previous_passage_r2_score_eval data_files: - split: train path: anli_based_on_the_previous_passage_r2_score_eval/train-* - split: validation path: anli_based_on_the_previous_passage_r2_score_eval/validation-* - split: test path: anli_based_on_the_previous_passage_r2_score_eval/test-* - config_name: anli_based_on_the_previous_passage_r3 data_files: - split: train path: anli_based_on_the_previous_passage_r3/train-* - split: validation path: anli_based_on_the_previous_passage_r3/validation-* - split: test path: anli_based_on_the_previous_passage_r3/test-* - config_name: anli_based_on_the_previous_passage_r3_score_eval data_files: - split: train path: anli_based_on_the_previous_passage_r3_score_eval/train-* - split: validation path: anli_based_on_the_previous_passage_r3_score_eval/validation-* - split: test path: anli_based_on_the_previous_passage_r3_score_eval/test-* - config_name: anli_can_we_infer_r1 data_files: - split: train path: anli_can_we_infer_r1/train-* - split: validation path: anli_can_we_infer_r1/validation-* - split: test path: anli_can_we_infer_r1/test-* - config_name: anli_can_we_infer_r1_score_eval data_files: - split: train path: anli_can_we_infer_r1_score_eval/train-* - split: validation path: anli_can_we_infer_r1_score_eval/validation-* - split: test path: anli_can_we_infer_r1_score_eval/test-* - config_name: anli_can_we_infer_r2 data_files: - split: train path: anli_can_we_infer_r2/train-* - split: validation path: anli_can_we_infer_r2/validation-* - split: test path: anli_can_we_infer_r2/test-* - config_name: anli_can_we_infer_r2_score_eval data_files: - split: train path: anli_can_we_infer_r2_score_eval/train-* - split: validation path: anli_can_we_infer_r2_score_eval/validation-* - split: test path: anli_can_we_infer_r2_score_eval/test-* - config_name: anli_can_we_infer_r3 data_files: - split: train path: anli_can_we_infer_r3/train-* - split: validation path: anli_can_we_infer_r3/validation-* - split: test path: anli_can_we_infer_r3/test-* - config_name: anli_can_we_infer_r3_score_eval data_files: - split: train path: anli_can_we_infer_r3_score_eval/train-* - split: validation path: anli_can_we_infer_r3_score_eval/validation-* - split: test path: anli_can_we_infer_r3_score_eval/test-* - config_name: anli_claim_true_false_inconclusive_r1 data_files: - split: train path: anli_claim_true_false_inconclusive_r1/train-* - split: validation path: anli_claim_true_false_inconclusive_r1/validation-* - split: test path: anli_claim_true_false_inconclusive_r1/test-* - config_name: anli_claim_true_false_inconclusive_r1_score_eval data_files: - split: train path: anli_claim_true_false_inconclusive_r1_score_eval/train-* - split: validation path: anli_claim_true_false_inconclusive_r1_score_eval/validation-* - split: test path: anli_claim_true_false_inconclusive_r1_score_eval/test-* - config_name: anli_claim_true_false_inconclusive_r2 data_files: - split: train path: anli_claim_true_false_inconclusive_r2/train-* - split: validation path: anli_claim_true_false_inconclusive_r2/validation-* - split: test path: anli_claim_true_false_inconclusive_r2/test-* - config_name: anli_claim_true_false_inconclusive_r2_score_eval data_files: - split: train path: anli_claim_true_false_inconclusive_r2_score_eval/train-* - split: validation path: anli_claim_true_false_inconclusive_r2_score_eval/validation-* - split: test path: anli_claim_true_false_inconclusive_r2_score_eval/test-* - config_name: anli_claim_true_false_inconclusive_r3 data_files: - split: train path: anli_claim_true_false_inconclusive_r3/train-* - split: validation path: anli_claim_true_false_inconclusive_r3/validation-* - split: test path: anli_claim_true_false_inconclusive_r3/test-* - config_name: anli_claim_true_false_inconclusive_r3_score_eval data_files: - split: train path: anli_claim_true_false_inconclusive_r3_score_eval/train-* - split: validation path: anli_claim_true_false_inconclusive_r3_score_eval/validation-* - split: test path: anli_claim_true_false_inconclusive_r3_score_eval/test-* - config_name: anli_consider_always_sometimes_never_r1 data_files: - split: train path: anli_consider_always_sometimes_never_r1/train-* - split: validation path: anli_consider_always_sometimes_never_r1/validation-* - split: test path: anli_consider_always_sometimes_never_r1/test-* - config_name: anli_consider_always_sometimes_never_r1_score_eval data_files: - split: train path: anli_consider_always_sometimes_never_r1_score_eval/train-* - split: validation path: anli_consider_always_sometimes_never_r1_score_eval/validation-* - split: test path: anli_consider_always_sometimes_never_r1_score_eval/test-* - config_name: anli_consider_always_sometimes_never_r2 data_files: - split: train path: anli_consider_always_sometimes_never_r2/train-* - split: validation path: anli_consider_always_sometimes_never_r2/validation-* - split: test path: anli_consider_always_sometimes_never_r2/test-* - config_name: anli_consider_always_sometimes_never_r2_score_eval data_files: - split: train path: anli_consider_always_sometimes_never_r2_score_eval/train-* - split: validation path: anli_consider_always_sometimes_never_r2_score_eval/validation-* - split: test path: anli_consider_always_sometimes_never_r2_score_eval/test-* - config_name: anli_consider_always_sometimes_never_r3 data_files: - split: train path: anli_consider_always_sometimes_never_r3/train-* - split: validation path: anli_consider_always_sometimes_never_r3/validation-* - split: test path: anli_consider_always_sometimes_never_r3/test-* - config_name: anli_consider_always_sometimes_never_r3_score_eval data_files: - split: train path: anli_consider_always_sometimes_never_r3_score_eval/train-* - split: validation path: anli_consider_always_sometimes_never_r3_score_eval/validation-* - split: test path: anli_consider_always_sometimes_never_r3_score_eval/test-* - config_name: anli_does_it_follow_that_r1 data_files: - split: train path: anli_does_it_follow_that_r1/train-* - split: validation path: anli_does_it_follow_that_r1/validation-* - split: test path: anli_does_it_follow_that_r1/test-* - config_name: anli_does_it_follow_that_r1_score_eval data_files: - split: train path: anli_does_it_follow_that_r1_score_eval/train-* - split: validation path: anli_does_it_follow_that_r1_score_eval/validation-* - split: test path: anli_does_it_follow_that_r1_score_eval/test-* - config_name: anli_does_it_follow_that_r2 data_files: - split: train path: anli_does_it_follow_that_r2/train-* - split: validation path: anli_does_it_follow_that_r2/validation-* - split: test path: anli_does_it_follow_that_r2/test-* - config_name: anli_does_it_follow_that_r2_score_eval data_files: - split: train path: anli_does_it_follow_that_r2_score_eval/train-* - split: validation path: anli_does_it_follow_that_r2_score_eval/validation-* - split: test path: anli_does_it_follow_that_r2_score_eval/test-* - config_name: anli_does_it_follow_that_r3 data_files: - split: train path: anli_does_it_follow_that_r3/train-* - split: validation path: anli_does_it_follow_that_r3/validation-* - split: test path: anli_does_it_follow_that_r3/test-* - config_name: anli_does_it_follow_that_r3_score_eval data_files: - split: train path: anli_does_it_follow_that_r3_score_eval/train-* - split: validation path: anli_does_it_follow_that_r3_score_eval/validation-* - split: test path: anli_does_it_follow_that_r3_score_eval/test-* - config_name: anli_does_this_imply_r1 data_files: - split: train path: anli_does_this_imply_r1/train-* - split: validation path: anli_does_this_imply_r1/validation-* - split: test path: anli_does_this_imply_r1/test-* - config_name: anli_does_this_imply_r1_score_eval data_files: - split: train path: anli_does_this_imply_r1_score_eval/train-* - split: validation path: anli_does_this_imply_r1_score_eval/validation-* - split: test path: anli_does_this_imply_r1_score_eval/test-* - config_name: anli_does_this_imply_r2 data_files: - split: train path: anli_does_this_imply_r2/train-* - split: validation path: anli_does_this_imply_r2/validation-* - split: test path: anli_does_this_imply_r2/test-* - config_name: anli_does_this_imply_r2_score_eval data_files: - split: train path: anli_does_this_imply_r2_score_eval/train-* - split: validation path: anli_does_this_imply_r2_score_eval/validation-* - split: test path: anli_does_this_imply_r2_score_eval/test-* - config_name: anli_does_this_imply_r3 data_files: - split: train path: anli_does_this_imply_r3/train-* - split: validation path: anli_does_this_imply_r3/validation-* - split: test path: anli_does_this_imply_r3/test-* - config_name: anli_does_this_imply_r3_score_eval data_files: - split: train path: anli_does_this_imply_r3_score_eval/train-* - split: validation path: anli_does_this_imply_r3_score_eval/validation-* - split: test path: anli_does_this_imply_r3_score_eval/test-* - config_name: anli_guaranteed_possible_impossible_r1 data_files: - split: train path: anli_guaranteed_possible_impossible_r1/train-* - split: validation path: anli_guaranteed_possible_impossible_r1/validation-* - split: test path: anli_guaranteed_possible_impossible_r1/test-* - config_name: anli_guaranteed_possible_impossible_r1_score_eval data_files: - split: train path: anli_guaranteed_possible_impossible_r1_score_eval/train-* - split: validation path: anli_guaranteed_possible_impossible_r1_score_eval/validation-* - split: test path: anli_guaranteed_possible_impossible_r1_score_eval/test-* - config_name: anli_guaranteed_possible_impossible_r2 data_files: - split: train path: anli_guaranteed_possible_impossible_r2/train-* - split: validation path: anli_guaranteed_possible_impossible_r2/validation-* - split: test path: anli_guaranteed_possible_impossible_r2/test-* - config_name: anli_guaranteed_possible_impossible_r2_score_eval data_files: - split: train path: anli_guaranteed_possible_impossible_r2_score_eval/train-* - split: validation path: anli_guaranteed_possible_impossible_r2_score_eval/validation-* - split: test path: anli_guaranteed_possible_impossible_r2_score_eval/test-* - config_name: anli_guaranteed_possible_impossible_r3 data_files: - split: train path: anli_guaranteed_possible_impossible_r3/train-* - split: validation path: anli_guaranteed_possible_impossible_r3/validation-* - split: test path: anli_guaranteed_possible_impossible_r3/test-* - config_name: anli_guaranteed_possible_impossible_r3_score_eval data_files: - split: train path: anli_guaranteed_possible_impossible_r3_score_eval/train-* - split: validation path: anli_guaranteed_possible_impossible_r3_score_eval/validation-* - split: test path: anli_guaranteed_possible_impossible_r3_score_eval/test-* - config_name: anli_guaranteed_true_r1 data_files: - split: train path: anli_guaranteed_true_r1/train-* - split: validation path: anli_guaranteed_true_r1/validation-* - split: test path: anli_guaranteed_true_r1/test-* - config_name: anli_guaranteed_true_r1_score_eval data_files: - split: train path: anli_guaranteed_true_r1_score_eval/train-* - split: validation path: anli_guaranteed_true_r1_score_eval/validation-* - split: test path: anli_guaranteed_true_r1_score_eval/test-* - config_name: anli_guaranteed_true_r2 data_files: - split: train path: anli_guaranteed_true_r2/train-* - split: validation path: anli_guaranteed_true_r2/validation-* - split: test path: anli_guaranteed_true_r2/test-* - config_name: anli_guaranteed_true_r2_score_eval data_files: - split: train path: anli_guaranteed_true_r2_score_eval/train-* - split: validation path: anli_guaranteed_true_r2_score_eval/validation-* - split: test path: anli_guaranteed_true_r2_score_eval/test-* - config_name: anli_guaranteed_true_r3 data_files: - split: train path: anli_guaranteed_true_r3/train-* - split: validation path: anli_guaranteed_true_r3/validation-* - split: test path: anli_guaranteed_true_r3/test-* - config_name: anli_guaranteed_true_r3_score_eval data_files: - split: train path: anli_guaranteed_true_r3_score_eval/train-* - split: validation path: anli_guaranteed_true_r3_score_eval/validation-* - split: test path: anli_guaranteed_true_r3_score_eval/test-* - config_name: anli_justified_in_saying_r1 data_files: - split: train path: anli_justified_in_saying_r1/train-* - split: validation path: anli_justified_in_saying_r1/validation-* - split: test path: anli_justified_in_saying_r1/test-* - config_name: anli_justified_in_saying_r1_score_eval data_files: - split: train path: anli_justified_in_saying_r1_score_eval/train-* - split: validation path: anli_justified_in_saying_r1_score_eval/validation-* - split: test path: anli_justified_in_saying_r1_score_eval/test-* - config_name: anli_justified_in_saying_r2 data_files: - split: train path: anli_justified_in_saying_r2/train-* - split: validation path: anli_justified_in_saying_r2/validation-* - split: test path: anli_justified_in_saying_r2/test-* - config_name: anli_justified_in_saying_r2_score_eval data_files: - split: train path: anli_justified_in_saying_r2_score_eval/train-* - split: validation path: anli_justified_in_saying_r2_score_eval/validation-* - split: test path: anli_justified_in_saying_r2_score_eval/test-* - config_name: anli_justified_in_saying_r3 data_files: - split: train path: anli_justified_in_saying_r3/train-* - split: validation path: anli_justified_in_saying_r3/validation-* - split: test path: anli_justified_in_saying_r3/test-* - config_name: anli_justified_in_saying_r3_score_eval data_files: - split: train path: anli_justified_in_saying_r3_score_eval/train-* - split: validation path: anli_justified_in_saying_r3_score_eval/validation-* - split: test path: anli_justified_in_saying_r3_score_eval/test-* - config_name: anli_must_be_true_r1 data_files: - split: train path: anli_must_be_true_r1/train-* - split: validation path: anli_must_be_true_r1/validation-* - split: test path: anli_must_be_true_r1/test-* - config_name: anli_must_be_true_r1_score_eval data_files: - split: train path: anli_must_be_true_r1_score_eval/train-* - split: validation path: anli_must_be_true_r1_score_eval/validation-* - split: test path: anli_must_be_true_r1_score_eval/test-* - config_name: anli_must_be_true_r2 data_files: - split: train path: anli_must_be_true_r2/train-* - split: validation path: anli_must_be_true_r2/validation-* - split: test path: anli_must_be_true_r2/test-* - config_name: anli_must_be_true_r2_score_eval data_files: - split: train path: anli_must_be_true_r2_score_eval/train-* - split: validation path: anli_must_be_true_r2_score_eval/validation-* - split: test path: anli_must_be_true_r2_score_eval/test-* - config_name: anli_must_be_true_r3 data_files: - split: train path: anli_must_be_true_r3/train-* - split: validation path: anli_must_be_true_r3/validation-* - split: test path: anli_must_be_true_r3/test-* - config_name: anli_must_be_true_r3_score_eval data_files: - split: train path: anli_must_be_true_r3_score_eval/train-* - split: validation path: anli_must_be_true_r3_score_eval/validation-* - split: test path: anli_must_be_true_r3_score_eval/test-* - config_name: anli_should_assume_r1 data_files: - split: train path: anli_should_assume_r1/train-* - split: validation path: anli_should_assume_r1/validation-* - split: test path: anli_should_assume_r1/test-* - config_name: anli_should_assume_r1_score_eval data_files: - split: train path: anli_should_assume_r1_score_eval/train-* - split: validation path: anli_should_assume_r1_score_eval/validation-* - split: test path: anli_should_assume_r1_score_eval/test-* - config_name: anli_should_assume_r2 data_files: - split: train path: anli_should_assume_r2/train-* - split: validation path: anli_should_assume_r2/validation-* - split: test path: anli_should_assume_r2/test-* - config_name: anli_should_assume_r2_score_eval data_files: - split: train path: anli_should_assume_r2_score_eval/train-* - split: validation path: anli_should_assume_r2_score_eval/validation-* - split: test path: anli_should_assume_r2_score_eval/test-* - config_name: anli_should_assume_r3 data_files: - split: train path: anli_should_assume_r3/train-* - split: validation path: anli_should_assume_r3/validation-* - split: test path: anli_should_assume_r3/test-* - config_name: anli_should_assume_r3_score_eval data_files: - split: train path: anli_should_assume_r3_score_eval/train-* - split: validation path: anli_should_assume_r3_score_eval/validation-* - split: test path: anli_should_assume_r3_score_eval/test-* - config_name: anli_take_the_following_as_truth_r1 data_files: - split: train path: anli_take_the_following_as_truth_r1/train-* - split: validation path: anli_take_the_following_as_truth_r1/validation-* - split: test path: anli_take_the_following_as_truth_r1/test-* - config_name: anli_take_the_following_as_truth_r1_score_eval data_files: - split: train path: anli_take_the_following_as_truth_r1_score_eval/train-* - split: validation path: anli_take_the_following_as_truth_r1_score_eval/validation-* - split: test path: anli_take_the_following_as_truth_r1_score_eval/test-* - config_name: anli_take_the_following_as_truth_r2 data_files: - split: train path: anli_take_the_following_as_truth_r2/train-* - split: validation path: anli_take_the_following_as_truth_r2/validation-* - split: test path: anli_take_the_following_as_truth_r2/test-* - config_name: anli_take_the_following_as_truth_r2_score_eval data_files: - split: train path: anli_take_the_following_as_truth_r2_score_eval/train-* - split: validation path: anli_take_the_following_as_truth_r2_score_eval/validation-* - split: test path: anli_take_the_following_as_truth_r2_score_eval/test-* - config_name: anli_take_the_following_as_truth_r3 data_files: - split: train path: anli_take_the_following_as_truth_r3/train-* - split: validation path: anli_take_the_following_as_truth_r3/validation-* - split: test path: anli_take_the_following_as_truth_r3/test-* - config_name: anli_take_the_following_as_truth_r3_score_eval data_files: - split: train path: anli_take_the_following_as_truth_r3_score_eval/train-* - split: validation path: anli_take_the_following_as_truth_r3_score_eval/validation-* - split: test path: anli_take_the_following_as_truth_r3_score_eval/test-* - config_name: app_reviews_categorize_rating_using_review data_files: - split: train path: app_reviews_categorize_rating_using_review/train-* - config_name: app_reviews_convert_to_rating data_files: - split: train path: app_reviews_convert_to_rating/train-* - config_name: app_reviews_convert_to_star_rating data_files: - split: train path: app_reviews_convert_to_star_rating/train-* - config_name: app_reviews_generate_review data_files: - split: train path: app_reviews_generate_review/train-* - config_name: cnn_dailymail_3.0.0_2_or_3_sentences data_files: - split: train path: cnn_dailymail_3.0.0_2_or_3_sentences/train-* - split: validation path: cnn_dailymail_3.0.0_2_or_3_sentences/validation-* - split: test path: cnn_dailymail_3.0.0_2_or_3_sentences/test-* - config_name: cnn_dailymail_3.0.0_generate_story data_files: - split: train path: cnn_dailymail_3.0.0_generate_story/train-* - split: validation path: cnn_dailymail_3.0.0_generate_story/validation-* - split: test path: cnn_dailymail_3.0.0_generate_story/test-* - config_name: cnn_dailymail_3.0.0_news_card_view data_files: - split: train path: cnn_dailymail_3.0.0_news_card_view/train-* - split: validation path: cnn_dailymail_3.0.0_news_card_view/validation-* - split: test path: cnn_dailymail_3.0.0_news_card_view/test-* - config_name: cnn_dailymail_3.0.0_news_stock data_files: - split: train path: cnn_dailymail_3.0.0_news_stock/train-* - split: validation path: cnn_dailymail_3.0.0_news_stock/validation-* - split: test path: cnn_dailymail_3.0.0_news_stock/test-* - config_name: cnn_dailymail_3.0.0_news_summary data_files: - split: train path: cnn_dailymail_3.0.0_news_summary/train-* - split: validation path: cnn_dailymail_3.0.0_news_summary/validation-* - split: test path: cnn_dailymail_3.0.0_news_summary/test-* - config_name: cnn_dailymail_3.0.0_spice_up_story data_files: - split: train path: cnn_dailymail_3.0.0_spice_up_story/train-* - split: validation path: cnn_dailymail_3.0.0_spice_up_story/validation-* - split: test path: cnn_dailymail_3.0.0_spice_up_story/test-* - config_name: cnn_dailymail_3.0.0_sum_in_brief data_files: - split: train path: cnn_dailymail_3.0.0_sum_in_brief/train-* - split: validation path: cnn_dailymail_3.0.0_sum_in_brief/validation-* - split: test path: cnn_dailymail_3.0.0_sum_in_brief/test-* - config_name: cnn_dailymail_3.0.0_tldr_summary data_files: - split: train path: cnn_dailymail_3.0.0_tldr_summary/train-* - split: validation path: cnn_dailymail_3.0.0_tldr_summary/validation-* - split: test path: cnn_dailymail_3.0.0_tldr_summary/test-* - config_name: cnn_dailymail_3.0.0_write_an_outline data_files: - split: train path: cnn_dailymail_3.0.0_write_an_outline/train-* - split: validation path: cnn_dailymail_3.0.0_write_an_outline/validation-* - split: test path: cnn_dailymail_3.0.0_write_an_outline/test-* - config_name: common_gen_Example_prompt data_files: - split: train path: common_gen_Example_prompt/train-* - split: validation path: common_gen_Example_prompt/validation-* - split: test path: common_gen_Example_prompt/test-* - config_name: common_gen_Given_concepts_type_1 data_files: - split: train path: common_gen_Given_concepts_type_1/train-* - split: validation path: common_gen_Given_concepts_type_1/validation-* - split: test path: common_gen_Given_concepts_type_1/test-* - config_name: common_gen_Given_concepts_type_2 data_files: - split: train path: common_gen_Given_concepts_type_2/train-* - split: validation path: common_gen_Given_concepts_type_2/validation-* - split: test path: common_gen_Given_concepts_type_2/test-* - config_name: common_gen_Put_together data_files: - split: train path: common_gen_Put_together/train-* - split: validation path: common_gen_Put_together/validation-* - split: test path: common_gen_Put_together/test-* - config_name: common_gen_choice_in_concept_centric_sentence_generation data_files: - split: train path: common_gen_choice_in_concept_centric_sentence_generation/train-* - split: validation path: common_gen_choice_in_concept_centric_sentence_generation/validation-* - split: test path: common_gen_choice_in_concept_centric_sentence_generation/test-* - config_name: common_gen_random_task_template_prompt data_files: - split: train path: common_gen_random_task_template_prompt/train-* - split: validation path: common_gen_random_task_template_prompt/validation-* - split: test path: common_gen_random_task_template_prompt/test-* - config_name: common_gen_sentence_to_concepts data_files: - split: train path: common_gen_sentence_to_concepts/train-* - split: validation path: common_gen_sentence_to_concepts/validation-* - split: test path: common_gen_sentence_to_concepts/test-* - config_name: common_gen_topic_to_sentence data_files: - split: train path: common_gen_topic_to_sentence/train-* - split: validation path: common_gen_topic_to_sentence/validation-* - split: test path: common_gen_topic_to_sentence/test-* - config_name: common_gen_topics_from_the_sentence data_files: - split: train path: common_gen_topics_from_the_sentence/train-* - split: validation path: common_gen_topics_from_the_sentence/validation-* - split: test path: common_gen_topics_from_the_sentence/test-* - config_name: cos_e_v1.11_aligned_with_common_sense data_files: - split: train path: cos_e_v1.11_aligned_with_common_sense/train-* - split: validation path: cos_e_v1.11_aligned_with_common_sense/validation-* - config_name: cos_e_v1.11_description_question_option_id data_files: - split: train path: cos_e_v1.11_description_question_option_id/train-* - split: validation path: cos_e_v1.11_description_question_option_id/validation-* - config_name: cos_e_v1.11_description_question_option_text data_files: - split: train path: cos_e_v1.11_description_question_option_text/train-* - split: validation path: cos_e_v1.11_description_question_option_text/validation-* - config_name: cos_e_v1.11_explain_why_human data_files: - split: train path: cos_e_v1.11_explain_why_human/train-* - split: validation path: cos_e_v1.11_explain_why_human/validation-* - config_name: cos_e_v1.11_generate_explanation_given_text data_files: - split: train path: cos_e_v1.11_generate_explanation_given_text/train-* - split: validation path: cos_e_v1.11_generate_explanation_given_text/validation-* - config_name: cos_e_v1.11_i_think data_files: - split: train path: cos_e_v1.11_i_think/train-* - split: validation path: cos_e_v1.11_i_think/validation-* - config_name: cos_e_v1.11_question_description_option_id data_files: - split: train path: cos_e_v1.11_question_description_option_id/train-* - split: validation path: cos_e_v1.11_question_description_option_id/validation-* - config_name: cos_e_v1.11_question_description_option_text data_files: - split: train path: cos_e_v1.11_question_description_option_text/train-* - split: validation path: cos_e_v1.11_question_description_option_text/validation-* - config_name: cos_e_v1.11_question_option_description_id data_files: - split: train path: cos_e_v1.11_question_option_description_id/train-* - split: validation path: cos_e_v1.11_question_option_description_id/validation-* - config_name: cos_e_v1.11_question_option_description_text data_files: - split: train path: cos_e_v1.11_question_option_description_text/train-* - split: validation path: cos_e_v1.11_question_option_description_text/validation-* - config_name: cos_e_v1.11_rationale data_files: - split: train path: cos_e_v1.11_rationale/train-* - split: validation path: cos_e_v1.11_rationale/validation-* - config_name: cosmos_qa_context_answer_to_question data_files: - split: train path: cosmos_qa_context_answer_to_question/train-* - split: validation path: cosmos_qa_context_answer_to_question/validation-* - split: test path: cosmos_qa_context_answer_to_question/test-* - config_name: cosmos_qa_context_description_question_answer_id data_files: - split: train path: cosmos_qa_context_description_question_answer_id/train-* - split: validation path: cosmos_qa_context_description_question_answer_id/validation-* - split: test path: cosmos_qa_context_description_question_answer_id/test-* - config_name: cosmos_qa_context_description_question_answer_text data_files: - split: train path: cosmos_qa_context_description_question_answer_text/train-* - split: validation path: cosmos_qa_context_description_question_answer_text/validation-* - split: test path: cosmos_qa_context_description_question_answer_text/test-* - config_name: cosmos_qa_context_description_question_text data_files: - split: train path: cosmos_qa_context_description_question_text/train-* - split: validation path: cosmos_qa_context_description_question_text/validation-* - split: test path: cosmos_qa_context_description_question_text/test-* - config_name: cosmos_qa_context_question_description_answer_id data_files: - split: train path: cosmos_qa_context_question_description_answer_id/train-* - split: validation path: cosmos_qa_context_question_description_answer_id/validation-* - split: test path: cosmos_qa_context_question_description_answer_id/test-* - config_name: cosmos_qa_context_question_description_answer_text data_files: - split: train path: cosmos_qa_context_question_description_answer_text/train-* - split: validation path: cosmos_qa_context_question_description_answer_text/validation-* - split: test path: cosmos_qa_context_question_description_answer_text/test-* - config_name: cosmos_qa_context_question_description_text data_files: - split: train path: cosmos_qa_context_question_description_text/train-* - split: validation path: cosmos_qa_context_question_description_text/validation-* - split: test path: cosmos_qa_context_question_description_text/test-* - config_name: cosmos_qa_description_context_question_answer_id data_files: - split: train path: cosmos_qa_description_context_question_answer_id/train-* - split: validation path: cosmos_qa_description_context_question_answer_id/validation-* - split: test path: cosmos_qa_description_context_question_answer_id/test-* - config_name: cosmos_qa_description_context_question_answer_text data_files: - split: train path: cosmos_qa_description_context_question_answer_text/train-* - split: validation path: cosmos_qa_description_context_question_answer_text/validation-* - split: test path: cosmos_qa_description_context_question_answer_text/test-* - config_name: cosmos_qa_description_context_question_text data_files: - split: train path: cosmos_qa_description_context_question_text/train-* - split: validation path: cosmos_qa_description_context_question_text/validation-* - split: test path: cosmos_qa_description_context_question_text/test-* - config_name: cosmos_qa_no_prompt_id data_files: - split: train path: cosmos_qa_no_prompt_id/train-* - split: validation path: cosmos_qa_no_prompt_id/validation-* - split: test path: cosmos_qa_no_prompt_id/test-* - config_name: cosmos_qa_no_prompt_text data_files: - split: train path: cosmos_qa_no_prompt_text/train-* - split: validation path: cosmos_qa_no_prompt_text/validation-* - split: test path: cosmos_qa_no_prompt_text/test-* - config_name: cosmos_qa_only_question_answer data_files: - split: train path: cosmos_qa_only_question_answer/train-* - split: validation path: cosmos_qa_only_question_answer/validation-* - split: test path: cosmos_qa_only_question_answer/test-* - config_name: dbpedia_14_given_a_choice_of_categories_ data_files: - split: train path: dbpedia_14_given_a_choice_of_categories_/train-* - split: test path: dbpedia_14_given_a_choice_of_categories_/test-* - config_name: dbpedia_14_given_a_list_of_category_what_does_the_title_belong_to data_files: - split: train path: dbpedia_14_given_a_list_of_category_what_does_the_title_belong_to/train-* - split: test path: dbpedia_14_given_a_list_of_category_what_does_the_title_belong_to/test-* - config_name: dbpedia_14_given_list_what_category_does_the_paragraph_belong_to data_files: - split: train path: dbpedia_14_given_list_what_category_does_the_paragraph_belong_to/train-* - split: test path: dbpedia_14_given_list_what_category_does_the_paragraph_belong_to/test-* - config_name: dbpedia_14_pick_one_category_for_the_following_text data_files: - split: train path: dbpedia_14_pick_one_category_for_the_following_text/train-* - split: test path: dbpedia_14_pick_one_category_for_the_following_text/test-* - config_name: dream_answer_to_dialogue data_files: - split: train path: dream_answer_to_dialogue/train-* - split: validation path: dream_answer_to_dialogue/validation-* - split: test path: dream_answer_to_dialogue/test-* - config_name: dream_baseline data_files: - split: train path: dream_baseline/train-* - split: validation path: dream_baseline/validation-* - split: test path: dream_baseline/test-* - config_name: dream_generate_first_utterance data_files: - split: train path: dream_generate_first_utterance/train-* - split: validation path: dream_generate_first_utterance/validation-* - split: test path: dream_generate_first_utterance/test-* - config_name: dream_generate_last_utterance data_files: - split: train path: dream_generate_last_utterance/train-* - split: validation path: dream_generate_last_utterance/validation-* - split: test path: dream_generate_last_utterance/test-* - config_name: dream_read_the_following_conversation_and_answer_the_question data_files: - split: train path: dream_read_the_following_conversation_and_answer_the_question/train-* - split: validation path: dream_read_the_following_conversation_and_answer_the_question/validation-* - split: test path: dream_read_the_following_conversation_and_answer_the_question/test-* - config_name: duorc_ParaphraseRC_answer_question data_files: - split: train path: duorc_ParaphraseRC_answer_question/train-* - split: validation path: duorc_ParaphraseRC_answer_question/validation-* - split: test path: duorc_ParaphraseRC_answer_question/test-* - config_name: duorc_ParaphraseRC_build_story_around_qa data_files: - split: train path: duorc_ParaphraseRC_build_story_around_qa/train-* - split: validation path: duorc_ParaphraseRC_build_story_around_qa/validation-* - split: test path: duorc_ParaphraseRC_build_story_around_qa/test-* - config_name: duorc_ParaphraseRC_decide_worth_it data_files: - split: train path: duorc_ParaphraseRC_decide_worth_it/train-* - split: validation path: duorc_ParaphraseRC_decide_worth_it/validation-* - split: test path: duorc_ParaphraseRC_decide_worth_it/test-* - config_name: duorc_ParaphraseRC_extract_answer data_files: - split: train path: duorc_ParaphraseRC_extract_answer/train-* - split: validation path: duorc_ParaphraseRC_extract_answer/validation-* - split: test path: duorc_ParaphraseRC_extract_answer/test-* - config_name: duorc_ParaphraseRC_generate_question data_files: - split: train path: duorc_ParaphraseRC_generate_question/train-* - split: validation path: duorc_ParaphraseRC_generate_question/validation-* - split: test path: duorc_ParaphraseRC_generate_question/test-* - config_name: duorc_ParaphraseRC_generate_question_by_answer data_files: - split: train path: duorc_ParaphraseRC_generate_question_by_answer/train-* - split: validation path: duorc_ParaphraseRC_generate_question_by_answer/validation-* - split: test path: duorc_ParaphraseRC_generate_question_by_answer/test-* - config_name: duorc_ParaphraseRC_movie_director data_files: - split: train path: duorc_ParaphraseRC_movie_director/train-* - split: validation path: duorc_ParaphraseRC_movie_director/validation-* - split: test path: duorc_ParaphraseRC_movie_director/test-* - config_name: duorc_ParaphraseRC_question_answering data_files: - split: train path: duorc_ParaphraseRC_question_answering/train-* - split: validation path: duorc_ParaphraseRC_question_answering/validation-* - split: test path: duorc_ParaphraseRC_question_answering/test-* - config_name: duorc_ParaphraseRC_title_generation data_files: - split: train path: duorc_ParaphraseRC_title_generation/train-* - split: validation path: duorc_ParaphraseRC_title_generation/validation-* - split: test path: duorc_ParaphraseRC_title_generation/test-* - config_name: duorc_SelfRC_answer_question data_files: - split: train path: duorc_SelfRC_answer_question/train-* - split: validation path: duorc_SelfRC_answer_question/validation-* - split: test path: duorc_SelfRC_answer_question/test-* - config_name: duorc_SelfRC_build_story_around_qa data_files: - split: train path: duorc_SelfRC_build_story_around_qa/train-* - split: validation path: duorc_SelfRC_build_story_around_qa/validation-* - split: test path: duorc_SelfRC_build_story_around_qa/test-* - config_name: duorc_SelfRC_decide_worth_it data_files: - split: train path: duorc_SelfRC_decide_worth_it/train-* - split: validation path: duorc_SelfRC_decide_worth_it/validation-* - split: test path: duorc_SelfRC_decide_worth_it/test-* - config_name: duorc_SelfRC_extract_answer data_files: - split: train path: duorc_SelfRC_extract_answer/train-* - split: validation path: duorc_SelfRC_extract_answer/validation-* - split: test path: duorc_SelfRC_extract_answer/test-* - config_name: duorc_SelfRC_generate_question data_files: - split: train path: duorc_SelfRC_generate_question/train-* - split: validation path: duorc_SelfRC_generate_question/validation-* - split: test path: duorc_SelfRC_generate_question/test-* - config_name: duorc_SelfRC_generate_question_by_answer data_files: - split: train path: duorc_SelfRC_generate_question_by_answer/train-* - split: validation path: duorc_SelfRC_generate_question_by_answer/validation-* - split: test path: duorc_SelfRC_generate_question_by_answer/test-* - config_name: duorc_SelfRC_movie_director data_files: - split: train path: duorc_SelfRC_movie_director/train-* - split: validation path: duorc_SelfRC_movie_director/validation-* - split: test path: duorc_SelfRC_movie_director/test-* - config_name: duorc_SelfRC_question_answering data_files: - split: train path: duorc_SelfRC_question_answering/train-* - split: validation path: duorc_SelfRC_question_answering/validation-* - split: test path: duorc_SelfRC_question_answering/test-* - config_name: duorc_SelfRC_title_generation data_files: - split: train path: duorc_SelfRC_title_generation/train-* - split: validation path: duorc_SelfRC_title_generation/validation-* - split: test path: duorc_SelfRC_title_generation/test-* - config_name: gigaword_TLDR data_files: - split: train path: gigaword_TLDR/train-* - split: validation path: gigaword_TLDR/validation-* - split: test path: gigaword_TLDR/test-* - config_name: gigaword_first_sentence_title data_files: - split: train path: gigaword_first_sentence_title/train-* - split: validation path: gigaword_first_sentence_title/validation-* - split: test path: gigaword_first_sentence_title/test-* - config_name: gigaword_generate_summary_for_this data_files: - split: train path: gigaword_generate_summary_for_this/train-* - split: validation path: gigaword_generate_summary_for_this/validation-* - split: test path: gigaword_generate_summary_for_this/test-* - config_name: gigaword_in_a_nutshell data_files: - split: train path: gigaword_in_a_nutshell/train-* - split: validation path: gigaword_in_a_nutshell/validation-* - split: test path: gigaword_in_a_nutshell/test-* - config_name: gigaword_make_a_title data_files: - split: train path: gigaword_make_a_title/train-* - split: validation path: gigaword_make_a_title/validation-* - split: test path: gigaword_make_a_title/test-* - config_name: gigaword_reverse_writing data_files: - split: train path: gigaword_reverse_writing/train-* - split: validation path: gigaword_reverse_writing/validation-* - split: test path: gigaword_reverse_writing/test-* - config_name: gigaword_write_a_title_for_this_sentence data_files: - split: train path: gigaword_write_a_title_for_this_sentence/train-* - split: validation path: gigaword_write_a_title_for_this_sentence/validation-* - split: test path: gigaword_write_a_title_for_this_sentence/test-* - config_name: gigaword_write_an_article data_files: - split: train path: gigaword_write_an_article/train-* - split: validation path: gigaword_write_an_article/validation-* - split: test path: gigaword_write_an_article/test-* - config_name: gigaword_write_its_sentence data_files: - split: train path: gigaword_write_its_sentence/train-* - split: validation path: gigaword_write_its_sentence/validation-* - split: test path: gigaword_write_its_sentence/test-* - config_name: glue_mrpc_equivalent data_files: - split: train path: glue_mrpc_equivalent/train-* - split: validation path: glue_mrpc_equivalent/validation-* - split: test path: glue_mrpc_equivalent/test-* - config_name: glue_mrpc_generate_paraphrase data_files: - split: train path: glue_mrpc_generate_paraphrase/train-* - split: validation path: glue_mrpc_generate_paraphrase/validation-* - split: test path: glue_mrpc_generate_paraphrase/test-* - config_name: glue_mrpc_generate_sentence data_files: - split: train path: glue_mrpc_generate_sentence/train-* - split: validation path: glue_mrpc_generate_sentence/validation-* - split: test path: glue_mrpc_generate_sentence/test-* - config_name: glue_mrpc_paraphrase data_files: - split: train path: glue_mrpc_paraphrase/train-* - split: validation path: glue_mrpc_paraphrase/validation-* - split: test path: glue_mrpc_paraphrase/test-* - config_name: glue_mrpc_replace data_files: - split: train path: glue_mrpc_replace/train-* - split: validation path: glue_mrpc_replace/validation-* - split: test path: glue_mrpc_replace/test-* - config_name: glue_mrpc_same_thing data_files: - split: train path: glue_mrpc_same_thing/train-* - split: validation path: glue_mrpc_same_thing/validation-* - split: test path: glue_mrpc_same_thing/test-* - config_name: glue_mrpc_want_to_know data_files: - split: train path: glue_mrpc_want_to_know/train-* - split: validation path: glue_mrpc_want_to_know/validation-* - split: test path: glue_mrpc_want_to_know/test-* - config_name: glue_qqp_answer data_files: - split: train path: glue_qqp_answer/train-* - split: validation path: glue_qqp_answer/validation-* - split: test path: glue_qqp_answer/test-* - config_name: glue_qqp_duplicate data_files: - split: train path: glue_qqp_duplicate/train-* - split: validation path: glue_qqp_duplicate/validation-* - split: test path: glue_qqp_duplicate/test-* - config_name: glue_qqp_duplicate_or_not data_files: - split: train path: glue_qqp_duplicate_or_not/train-* - split: validation path: glue_qqp_duplicate_or_not/validation-* - split: test path: glue_qqp_duplicate_or_not/test-* - config_name: glue_qqp_meaning data_files: - split: train path: glue_qqp_meaning/train-* - split: validation path: glue_qqp_meaning/validation-* - split: test path: glue_qqp_meaning/test-* - config_name: glue_qqp_quora data_files: - split: train path: glue_qqp_quora/train-* - split: validation path: glue_qqp_quora/validation-* - split: test path: glue_qqp_quora/test-* - config_name: glue_qqp_same_thing data_files: - split: train path: glue_qqp_same_thing/train-* - split: validation path: glue_qqp_same_thing/validation-* - split: test path: glue_qqp_same_thing/test-* - config_name: hellaswag_Appropriate_continuation_Yes_or_No data_files: - split: train path: hellaswag_Appropriate_continuation_Yes_or_No/train-* - split: validation path: hellaswag_Appropriate_continuation_Yes_or_No/validation-* - split: test path: hellaswag_Appropriate_continuation_Yes_or_No/test-* - config_name: hellaswag_Open_ended_completion data_files: - split: train path: hellaswag_Open_ended_completion/train-* - split: validation path: hellaswag_Open_ended_completion/validation-* - split: test path: hellaswag_Open_ended_completion/test-* - config_name: hellaswag_Open_ended_start data_files: - split: train path: hellaswag_Open_ended_start/train-* - split: validation path: hellaswag_Open_ended_start/validation-* - split: test path: hellaswag_Open_ended_start/test-* - config_name: hellaswag_Predict_ending_with_hint data_files: - split: train path: hellaswag_Predict_ending_with_hint/train-* - split: validation path: hellaswag_Predict_ending_with_hint/validation-* - split: test path: hellaswag_Predict_ending_with_hint/test-* - config_name: hellaswag_Predict_ending_with_hint_score_eval data_files: - split: train path: hellaswag_Predict_ending_with_hint_score_eval/train-* - split: validation path: hellaswag_Predict_ending_with_hint_score_eval/validation-* - split: test path: hellaswag_Predict_ending_with_hint_score_eval/test-* - config_name: hellaswag_Randomized_prompts_template data_files: - split: train path: hellaswag_Randomized_prompts_template/train-* - split: validation path: hellaswag_Randomized_prompts_template/validation-* - split: test path: hellaswag_Randomized_prompts_template/test-* - config_name: hellaswag_Randomized_prompts_template_score_eval data_files: - split: train path: hellaswag_Randomized_prompts_template_score_eval/train-* - split: validation path: hellaswag_Randomized_prompts_template_score_eval/validation-* - split: test path: hellaswag_Randomized_prompts_template_score_eval/test-* - config_name: hellaswag_Reversed_appropriate_continuation_Yes_or_No data_files: - split: train path: hellaswag_Reversed_appropriate_continuation_Yes_or_No/train-* - split: validation path: hellaswag_Reversed_appropriate_continuation_Yes_or_No/validation-* - split: test path: hellaswag_Reversed_appropriate_continuation_Yes_or_No/test-* - config_name: hellaswag_Topic_of_the_context data_files: - split: train path: hellaswag_Topic_of_the_context/train-* - split: validation path: hellaswag_Topic_of_the_context/validation-* - split: test path: hellaswag_Topic_of_the_context/test-* - config_name: hellaswag_Topic_without_the_ending_answer data_files: - split: train path: hellaswag_Topic_without_the_ending_answer/train-* - split: validation path: hellaswag_Topic_without_the_ending_answer/validation-* - split: test path: hellaswag_Topic_without_the_ending_answer/test-* - config_name: hellaswag_complete_first_then data_files: - split: train path: hellaswag_complete_first_then/train-* - split: validation path: hellaswag_complete_first_then/validation-* - split: test path: hellaswag_complete_first_then/test-* - config_name: hellaswag_complete_first_then_score_eval data_files: - split: train path: hellaswag_complete_first_then_score_eval/train-* - split: validation path: hellaswag_complete_first_then_score_eval/validation-* - split: test path: hellaswag_complete_first_then_score_eval/test-* - config_name: hellaswag_how_ends data_files: - split: train path: hellaswag_how_ends/train-* - split: validation path: hellaswag_how_ends/validation-* - split: test path: hellaswag_how_ends/test-* - config_name: hellaswag_if_begins_how_continues data_files: - split: train path: hellaswag_if_begins_how_continues/train-* - split: validation path: hellaswag_if_begins_how_continues/validation-* - split: test path: hellaswag_if_begins_how_continues/test-* - config_name: hellaswag_if_begins_how_continues_score_eval data_files: - split: train path: hellaswag_if_begins_how_continues_score_eval/train-* - split: validation path: hellaswag_if_begins_how_continues_score_eval/validation-* - split: test path: hellaswag_if_begins_how_continues_score_eval/test-* - config_name: imdb_Movie_Expressed_Sentiment data_files: - split: train path: imdb_Movie_Expressed_Sentiment/train-* - split: test path: imdb_Movie_Expressed_Sentiment/test-* - split: unsupervised path: imdb_Movie_Expressed_Sentiment/unsupervised-* - config_name: imdb_Movie_Expressed_Sentiment_2 data_files: - split: train path: imdb_Movie_Expressed_Sentiment_2/train-* - split: test path: imdb_Movie_Expressed_Sentiment_2/test-* - split: unsupervised path: imdb_Movie_Expressed_Sentiment_2/unsupervised-* - config_name: imdb_Negation_template_for_positive_and_negative data_files: - split: train path: imdb_Negation_template_for_positive_and_negative/train-* - split: test path: imdb_Negation_template_for_positive_and_negative/test-* - split: unsupervised path: imdb_Negation_template_for_positive_and_negative/unsupervised-* - config_name: imdb_Reviewer_Enjoyment data_files: - split: train path: imdb_Reviewer_Enjoyment/train-* - split: test path: imdb_Reviewer_Enjoyment/test-* - split: unsupervised path: imdb_Reviewer_Enjoyment/unsupervised-* - config_name: imdb_Reviewer_Enjoyment_Yes_No data_files: - split: train path: imdb_Reviewer_Enjoyment_Yes_No/train-* - split: test path: imdb_Reviewer_Enjoyment_Yes_No/test-* - split: unsupervised path: imdb_Reviewer_Enjoyment_Yes_No/unsupervised-* - config_name: imdb_Reviewer_Expressed_Sentiment data_files: - split: train path: imdb_Reviewer_Expressed_Sentiment/train-* - split: test path: imdb_Reviewer_Expressed_Sentiment/test-* - split: unsupervised path: imdb_Reviewer_Expressed_Sentiment/unsupervised-* - config_name: imdb_Reviewer_Opinion_bad_good_choices data_files: - split: train path: imdb_Reviewer_Opinion_bad_good_choices/train-* - split: test path: imdb_Reviewer_Opinion_bad_good_choices/test-* - split: unsupervised path: imdb_Reviewer_Opinion_bad_good_choices/unsupervised-* - config_name: imdb_Reviewer_Sentiment_Feeling data_files: - split: train path: imdb_Reviewer_Sentiment_Feeling/train-* - split: test path: imdb_Reviewer_Sentiment_Feeling/test-* - split: unsupervised path: imdb_Reviewer_Sentiment_Feeling/unsupervised-* - config_name: imdb_Sentiment_with_choices_ data_files: - split: train path: imdb_Sentiment_with_choices_/train-* - split: test path: imdb_Sentiment_with_choices_/test-* - split: unsupervised path: imdb_Sentiment_with_choices_/unsupervised-* - config_name: imdb_Text_Expressed_Sentiment data_files: - split: train path: imdb_Text_Expressed_Sentiment/train-* - split: test path: imdb_Text_Expressed_Sentiment/test-* - split: unsupervised path: imdb_Text_Expressed_Sentiment/unsupervised-* - config_name: imdb_Writer_Expressed_Sentiment data_files: - split: train path: imdb_Writer_Expressed_Sentiment/train-* - split: test path: imdb_Writer_Expressed_Sentiment/test-* - split: unsupervised path: imdb_Writer_Expressed_Sentiment/unsupervised-* - config_name: kilt_tasks_hotpotqa_combining_facts data_files: - split: train path: kilt_tasks_hotpotqa_combining_facts/train-* - split: validation path: kilt_tasks_hotpotqa_combining_facts/validation-* - config_name: kilt_tasks_hotpotqa_complex_question data_files: - split: train path: kilt_tasks_hotpotqa_complex_question/train-* - split: validation path: kilt_tasks_hotpotqa_complex_question/validation-* - config_name: kilt_tasks_hotpotqa_final_exam data_files: - split: train path: kilt_tasks_hotpotqa_final_exam/train-* - split: validation path: kilt_tasks_hotpotqa_final_exam/validation-* - config_name: kilt_tasks_hotpotqa_formulate data_files: - split: train path: kilt_tasks_hotpotqa_formulate/train-* - split: validation path: kilt_tasks_hotpotqa_formulate/validation-* - config_name: kilt_tasks_hotpotqa_straighforward_qa data_files: - split: train path: kilt_tasks_hotpotqa_straighforward_qa/train-* - split: validation path: kilt_tasks_hotpotqa_straighforward_qa/validation-* - config_name: multi_news_distill data_files: - split: train path: multi_news_distill/train-* - split: validation path: multi_news_distill/validation-* - split: test path: multi_news_distill/test-* - config_name: multi_news_expand_reverse_task_ data_files: - split: train path: multi_news_expand_reverse_task_/train-* - split: validation path: multi_news_expand_reverse_task_/validation-* - split: test path: multi_news_expand_reverse_task_/test-* - config_name: multi_news_summarize data_files: - split: train path: multi_news_summarize/train-* - split: validation path: multi_news_summarize/validation-* - split: test path: multi_news_summarize/test-* - config_name: multi_news_summary_scenario data_files: - split: train path: multi_news_summary_scenario/train-* - split: validation path: multi_news_summary_scenario/validation-* - split: test path: multi_news_summary_scenario/test-* - config_name: multi_news_synthesize data_files: - split: train path: multi_news_synthesize/train-* - split: validation path: multi_news_synthesize/validation-* - split: test path: multi_news_synthesize/test-* - config_name: multi_news_what_are_the_key_points data_files: - split: train path: multi_news_what_are_the_key_points/train-* - split: validation path: multi_news_what_are_the_key_points/validation-* - split: test path: multi_news_what_are_the_key_points/test-* - config_name: openbookqa_main_choices data_files: - split: train path: openbookqa_main_choices/train-* - split: validation path: openbookqa_main_choices/validation-* - split: test path: openbookqa_main_choices/test-* - config_name: openbookqa_main_choose_an_answer_with_options data_files: - split: train path: openbookqa_main_choose_an_answer_with_options/train-* - split: validation path: openbookqa_main_choose_an_answer_with_options/validation-* - split: test path: openbookqa_main_choose_an_answer_with_options/test-* - config_name: openbookqa_main_only_options data_files: - split: train path: openbookqa_main_only_options/train-* - split: validation path: openbookqa_main_only_options/validation-* - split: test path: openbookqa_main_only_options/test-* - config_name: openbookqa_main_pick_answer_with_options data_files: - split: train path: openbookqa_main_pick_answer_with_options/train-* - split: validation path: openbookqa_main_pick_answer_with_options/validation-* - split: test path: openbookqa_main_pick_answer_with_options/test-* - config_name: openbookqa_main_pick_using_id data_files: - split: train path: openbookqa_main_pick_using_id/train-* - split: validation path: openbookqa_main_pick_using_id/validation-* - split: test path: openbookqa_main_pick_using_id/test-* - config_name: openbookqa_main_which_correct data_files: - split: train path: openbookqa_main_which_correct/train-* - split: validation path: openbookqa_main_which_correct/validation-* - split: test path: openbookqa_main_which_correct/test-* - config_name: openbookqa_main_which_correct_inverse data_files: - split: train path: openbookqa_main_which_correct_inverse/train-* - split: validation path: openbookqa_main_which_correct_inverse/validation-* - split: test path: openbookqa_main_which_correct_inverse/test-* - config_name: paws_labeled_final_Concatenation data_files: - split: train path: paws_labeled_final_Concatenation/train-* - split: validation path: paws_labeled_final_Concatenation/validation-* - split: test path: paws_labeled_final_Concatenation/test-* - config_name: paws_labeled_final_Concatenation_no_label data_files: - split: train path: paws_labeled_final_Concatenation_no_label/train-* - split: validation path: paws_labeled_final_Concatenation_no_label/validation-* - split: test path: paws_labeled_final_Concatenation_no_label/test-* - config_name: paws_labeled_final_Meaning data_files: - split: train path: paws_labeled_final_Meaning/train-* - split: validation path: paws_labeled_final_Meaning/validation-* - split: test path: paws_labeled_final_Meaning/test-* - config_name: paws_labeled_final_Meaning_no_label data_files: - split: train path: paws_labeled_final_Meaning_no_label/train-* - split: validation path: paws_labeled_final_Meaning_no_label/validation-* - split: test path: paws_labeled_final_Meaning_no_label/test-* - config_name: paws_labeled_final_PAWS_ANLI_GPT3 data_files: - split: train path: paws_labeled_final_PAWS_ANLI_GPT3/train-* - split: validation path: paws_labeled_final_PAWS_ANLI_GPT3/validation-* - split: test path: paws_labeled_final_PAWS_ANLI_GPT3/test-* - config_name: paws_labeled_final_PAWS_ANLI_GPT3_no_label data_files: - split: train path: paws_labeled_final_PAWS_ANLI_GPT3_no_label/train-* - split: validation path: paws_labeled_final_PAWS_ANLI_GPT3_no_label/validation-* - split: test path: paws_labeled_final_PAWS_ANLI_GPT3_no_label/test-* - config_name: paws_labeled_final_Rewrite data_files: - split: train path: paws_labeled_final_Rewrite/train-* - split: validation path: paws_labeled_final_Rewrite/validation-* - split: test path: paws_labeled_final_Rewrite/test-* - config_name: paws_labeled_final_Rewrite_no_label data_files: - split: train path: paws_labeled_final_Rewrite_no_label/train-* - split: validation path: paws_labeled_final_Rewrite_no_label/validation-* - split: test path: paws_labeled_final_Rewrite_no_label/test-* - config_name: paws_labeled_final_context_question data_files: - split: train path: paws_labeled_final_context_question/train-* - split: validation path: paws_labeled_final_context_question/validation-* - split: test path: paws_labeled_final_context_question/test-* - config_name: paws_labeled_final_context_question_no_label data_files: - split: train path: paws_labeled_final_context_question_no_label/train-* - split: validation path: paws_labeled_final_context_question_no_label/validation-* - split: test path: paws_labeled_final_context_question_no_label/test-* - config_name: paws_labeled_final_paraphrase_task data_files: - split: train path: paws_labeled_final_paraphrase_task/train-* - split: validation path: paws_labeled_final_paraphrase_task/validation-* - split: test path: paws_labeled_final_paraphrase_task/test-* - config_name: paws_labeled_final_task_description_no_label data_files: - split: train path: paws_labeled_final_task_description_no_label/train-* - split: validation path: paws_labeled_final_task_description_no_label/validation-* - split: test path: paws_labeled_final_task_description_no_label/test-* - config_name: piqa_Correct_the_solution data_files: - split: train path: piqa_Correct_the_solution/train-* - split: validation path: piqa_Correct_the_solution/validation-* - split: test path: piqa_Correct_the_solution/test-* - config_name: piqa_Correct_the_solution_if_false_from_sol_1 data_files: - split: train path: piqa_Correct_the_solution_if_false_from_sol_1/train-* - split: validation path: piqa_Correct_the_solution_if_false_from_sol_1/validation-* - split: test path: piqa_Correct_the_solution_if_false_from_sol_1/test-* - config_name: piqa_Correct_the_solution_if_false_from_sol_2 data_files: - split: train path: piqa_Correct_the_solution_if_false_from_sol_2/train-* - split: validation path: piqa_Correct_the_solution_if_false_from_sol_2/validation-* - split: test path: piqa_Correct_the_solution_if_false_from_sol_2/test-* - config_name: piqa_Does_this_solution_make_sense_sol1 data_files: - split: train path: piqa_Does_this_solution_make_sense_sol1/train-* - split: validation path: piqa_Does_this_solution_make_sense_sol1/validation-* - split: test path: piqa_Does_this_solution_make_sense_sol1/test-* - config_name: piqa_Does_this_solution_make_sense_sol2 data_files: - split: train path: piqa_Does_this_solution_make_sense_sol2/train-* - split: validation path: piqa_Does_this_solution_make_sense_sol2/validation-* - split: test path: piqa_Does_this_solution_make_sense_sol2/test-* - config_name: piqa_choose_the_most_appropriate_solution data_files: - split: train path: piqa_choose_the_most_appropriate_solution/train-* - split: validation path: piqa_choose_the_most_appropriate_solution/validation-* - split: test path: piqa_choose_the_most_appropriate_solution/test-* - config_name: piqa_finish_sentence_with_correct_choice data_files: - split: train path: piqa_finish_sentence_with_correct_choice/train-* - split: validation path: piqa_finish_sentence_with_correct_choice/validation-* - split: test path: piqa_finish_sentence_with_correct_choice/test-* - config_name: piqa_no_prompt_needed data_files: - split: train path: piqa_no_prompt_needed/train-* - split: validation path: piqa_no_prompt_needed/validation-* - split: test path: piqa_no_prompt_needed/test-* - config_name: piqa_pick_correct_choice_index data_files: - split: train path: piqa_pick_correct_choice_index/train-* - split: validation path: piqa_pick_correct_choice_index/validation-* - split: test path: piqa_pick_correct_choice_index/test-* - config_name: piqa_pick_correct_choice_with_choice_given_before_goal data_files: - split: train path: piqa_pick_correct_choice_with_choice_given_before_goal/train-* - split: validation path: piqa_pick_correct_choice_with_choice_given_before_goal/validation-* - split: test path: piqa_pick_correct_choice_with_choice_given_before_goal/test-* - config_name: piqa_what_is_the_correct_ending data_files: - split: train path: piqa_what_is_the_correct_ending/train-* - split: validation path: piqa_what_is_the_correct_ending/validation-* - split: test path: piqa_what_is_the_correct_ending/test-* - config_name: qasc_is_correct_1 data_files: - split: train path: qasc_is_correct_1/train-* - split: validation path: qasc_is_correct_1/validation-* - split: test path: qasc_is_correct_1/test-* - config_name: qasc_is_correct_2 data_files: - split: train path: qasc_is_correct_2/train-* - split: validation path: qasc_is_correct_2/validation-* - split: test path: qasc_is_correct_2/test-* - config_name: qasc_qa_with_combined_facts_1 data_files: - split: train path: qasc_qa_with_combined_facts_1/train-* - split: validation path: qasc_qa_with_combined_facts_1/validation-* - split: test path: qasc_qa_with_combined_facts_1/test-* - config_name: qasc_qa_with_separated_facts_1 data_files: - split: train path: qasc_qa_with_separated_facts_1/train-* - split: validation path: qasc_qa_with_separated_facts_1/validation-* - split: test path: qasc_qa_with_separated_facts_1/test-* - config_name: qasc_qa_with_separated_facts_2 data_files: - split: train path: qasc_qa_with_separated_facts_2/train-* - split: validation path: qasc_qa_with_separated_facts_2/validation-* - split: test path: qasc_qa_with_separated_facts_2/test-* - config_name: qasc_qa_with_separated_facts_3 data_files: - split: train path: qasc_qa_with_separated_facts_3/train-* - split: validation path: qasc_qa_with_separated_facts_3/validation-* - split: test path: qasc_qa_with_separated_facts_3/test-* - config_name: qasc_qa_with_separated_facts_4 data_files: - split: train path: qasc_qa_with_separated_facts_4/train-* - split: validation path: qasc_qa_with_separated_facts_4/validation-* - split: test path: qasc_qa_with_separated_facts_4/test-* - config_name: qasc_qa_with_separated_facts_5 data_files: - split: train path: qasc_qa_with_separated_facts_5/train-* - split: validation path: qasc_qa_with_separated_facts_5/validation-* - split: test path: qasc_qa_with_separated_facts_5/test-* - config_name: quail_context_description_question_answer_id data_files: - split: train path: quail_context_description_question_answer_id/train-* - split: validation path: quail_context_description_question_answer_id/validation-* - split: challenge path: quail_context_description_question_answer_id/challenge-* - config_name: quail_context_description_question_answer_text data_files: - split: train path: quail_context_description_question_answer_text/train-* - split: validation path: quail_context_description_question_answer_text/validation-* - split: challenge path: quail_context_description_question_answer_text/challenge-* - config_name: quail_context_description_question_text data_files: - split: train path: quail_context_description_question_text/train-* - split: validation path: quail_context_description_question_text/validation-* - split: challenge path: quail_context_description_question_text/challenge-* - config_name: quail_context_question_answer_description_id data_files: - split: train path: quail_context_question_answer_description_id/train-* - split: validation path: quail_context_question_answer_description_id/validation-* - split: challenge path: quail_context_question_answer_description_id/challenge-* - config_name: quail_context_question_answer_description_text data_files: - split: train path: quail_context_question_answer_description_text/train-* - split: validation path: quail_context_question_answer_description_text/validation-* - split: challenge path: quail_context_question_answer_description_text/challenge-* - config_name: quail_context_question_description_answer_id data_files: - split: train path: quail_context_question_description_answer_id/train-* - split: validation path: quail_context_question_description_answer_id/validation-* - split: challenge path: quail_context_question_description_answer_id/challenge-* - config_name: quail_context_question_description_answer_text data_files: - split: train path: quail_context_question_description_answer_text/train-* - split: validation path: quail_context_question_description_answer_text/validation-* - split: challenge path: quail_context_question_description_answer_text/challenge-* - config_name: quail_context_question_description_text data_files: - split: train path: quail_context_question_description_text/train-* - split: validation path: quail_context_question_description_text/validation-* - split: challenge path: quail_context_question_description_text/challenge-* - config_name: quail_description_context_question_answer_id data_files: - split: train path: quail_description_context_question_answer_id/train-* - split: validation path: quail_description_context_question_answer_id/validation-* - split: challenge path: quail_description_context_question_answer_id/challenge-* - config_name: quail_description_context_question_answer_text data_files: - split: train path: quail_description_context_question_answer_text/train-* - split: validation path: quail_description_context_question_answer_text/validation-* - split: challenge path: quail_description_context_question_answer_text/challenge-* - config_name: quail_description_context_question_text data_files: - split: train path: quail_description_context_question_text/train-* - split: validation path: quail_description_context_question_text/validation-* - split: challenge path: quail_description_context_question_text/challenge-* - config_name: quail_no_prompt_id data_files: - split: train path: quail_no_prompt_id/train-* - split: validation path: quail_no_prompt_id/validation-* - split: challenge path: quail_no_prompt_id/challenge-* - config_name: quail_no_prompt_text data_files: - split: train path: quail_no_prompt_text/train-* - split: validation path: quail_no_prompt_text/validation-* - split: challenge path: quail_no_prompt_text/challenge-* - config_name: quarel_choose_between data_files: - split: train path: quarel_choose_between/train-* - split: validation path: quarel_choose_between/validation-* - split: test path: quarel_choose_between/test-* - config_name: quarel_do_not_use data_files: - split: train path: quarel_do_not_use/train-* - split: validation path: quarel_do_not_use/validation-* - split: test path: quarel_do_not_use/test-* - config_name: quarel_heres_a_story data_files: - split: train path: quarel_heres_a_story/train-* - split: validation path: quarel_heres_a_story/validation-* - split: test path: quarel_heres_a_story/test-* - config_name: quarel_logic_test data_files: - split: train path: quarel_logic_test/train-* - split: validation path: quarel_logic_test/validation-* - split: test path: quarel_logic_test/test-* - config_name: quarel_testing_students data_files: - split: train path: quarel_testing_students/train-* - split: validation path: quarel_testing_students/validation-* - split: test path: quarel_testing_students/test-* - config_name: quartz_answer_question_based_on data_files: - split: train path: quartz_answer_question_based_on/train-* - split: validation path: quartz_answer_question_based_on/validation-* - split: test path: quartz_answer_question_based_on/test-* - config_name: quartz_answer_question_below data_files: - split: train path: quartz_answer_question_below/train-* - split: validation path: quartz_answer_question_below/validation-* - split: test path: quartz_answer_question_below/test-* - config_name: quartz_given_the_fact_answer_the_q data_files: - split: train path: quartz_given_the_fact_answer_the_q/train-* - split: validation path: quartz_given_the_fact_answer_the_q/validation-* - split: test path: quartz_given_the_fact_answer_the_q/test-* - config_name: quartz_having_read_above_passage data_files: - split: train path: quartz_having_read_above_passage/train-* - split: validation path: quartz_having_read_above_passage/validation-* - split: test path: quartz_having_read_above_passage/test-* - config_name: quartz_paragraph_question_plain_concat data_files: - split: train path: quartz_paragraph_question_plain_concat/train-* - split: validation path: quartz_paragraph_question_plain_concat/validation-* - split: test path: quartz_paragraph_question_plain_concat/test-* - config_name: quartz_read_passage_below_choose data_files: - split: train path: quartz_read_passage_below_choose/train-* - split: validation path: quartz_read_passage_below_choose/validation-* - split: test path: quartz_read_passage_below_choose/test-* - config_name: quartz_use_info_from_paragraph_question data_files: - split: train path: quartz_use_info_from_paragraph_question/train-* - split: validation path: quartz_use_info_from_paragraph_question/validation-* - split: test path: quartz_use_info_from_paragraph_question/test-* - config_name: quartz_use_info_from_question_paragraph data_files: - split: train path: quartz_use_info_from_question_paragraph/train-* - split: validation path: quartz_use_info_from_question_paragraph/validation-* - split: test path: quartz_use_info_from_question_paragraph/test-* - config_name: quoref_Answer_Friend_Question data_files: - split: train path: quoref_Answer_Friend_Question/train-* - split: validation path: quoref_Answer_Friend_Question/validation-* - config_name: quoref_Answer_Question_Given_Context data_files: - split: train path: quoref_Answer_Question_Given_Context/train-* - split: validation path: quoref_Answer_Question_Given_Context/validation-* - config_name: quoref_Answer_Test data_files: - split: train path: quoref_Answer_Test/train-* - split: validation path: quoref_Answer_Test/validation-* - config_name: quoref_Context_Contains_Answer data_files: - split: train path: quoref_Context_Contains_Answer/train-* - split: validation path: quoref_Context_Contains_Answer/validation-* - config_name: quoref_Find_Answer data_files: - split: train path: quoref_Find_Answer/train-* - split: validation path: quoref_Find_Answer/validation-* - config_name: quoref_Found_Context_Online data_files: - split: train path: quoref_Found_Context_Online/train-* - split: validation path: quoref_Found_Context_Online/validation-* - config_name: quoref_Given_Context_Answer_Question data_files: - split: train path: quoref_Given_Context_Answer_Question/train-* - split: validation path: quoref_Given_Context_Answer_Question/validation-* - config_name: quoref_Guess_Answer data_files: - split: train path: quoref_Guess_Answer/train-* - split: validation path: quoref_Guess_Answer/validation-* - config_name: quoref_Guess_Title_For_Context data_files: - split: train path: quoref_Guess_Title_For_Context/train-* - split: validation path: quoref_Guess_Title_For_Context/validation-* - config_name: quoref_Read_And_Extract_ data_files: - split: train path: quoref_Read_And_Extract_/train-* - split: validation path: quoref_Read_And_Extract_/validation-* - config_name: quoref_What_Is_The_Answer data_files: - split: train path: quoref_What_Is_The_Answer/train-* - split: validation path: quoref_What_Is_The_Answer/validation-* - config_name: race_high_Is_this_the_right_answer data_files: - split: train path: race_high_Is_this_the_right_answer/train-* - split: validation path: race_high_Is_this_the_right_answer/validation-* - split: test path: race_high_Is_this_the_right_answer/test-* - config_name: race_high_Read_the_article_and_answer_the_question_no_option_ data_files: - split: train path: race_high_Read_the_article_and_answer_the_question_no_option_/train-* - split: validation path: race_high_Read_the_article_and_answer_the_question_no_option_/validation-* - split: test path: race_high_Read_the_article_and_answer_the_question_no_option_/test-* - config_name: race_high_Select_the_best_answer data_files: - split: train path: race_high_Select_the_best_answer/train-* - split: validation path: race_high_Select_the_best_answer/validation-* - split: test path: race_high_Select_the_best_answer/test-* - config_name: race_high_Select_the_best_answer_generate_span_ data_files: - split: train path: race_high_Select_the_best_answer_generate_span_/train-* - split: validation path: race_high_Select_the_best_answer_generate_span_/validation-* - split: test path: race_high_Select_the_best_answer_generate_span_/test-* - config_name: race_high_Select_the_best_answer_no_instructions_ data_files: - split: train path: race_high_Select_the_best_answer_no_instructions_/train-* - split: validation path: race_high_Select_the_best_answer_no_instructions_/validation-* - split: test path: race_high_Select_the_best_answer_no_instructions_/test-* - config_name: race_high_Taking_a_test data_files: - split: train path: race_high_Taking_a_test/train-* - split: validation path: race_high_Taking_a_test/validation-* - split: test path: race_high_Taking_a_test/test-* - config_name: race_high_Write_a_multi_choice_question_for_the_following_article data_files: - split: train path: race_high_Write_a_multi_choice_question_for_the_following_article/train-* - split: validation path: race_high_Write_a_multi_choice_question_for_the_following_article/validation-* - split: test path: race_high_Write_a_multi_choice_question_for_the_following_article/test-* - config_name: race_high_Write_a_multi_choice_question_options_given_ data_files: - split: train path: race_high_Write_a_multi_choice_question_options_given_/train-* - split: validation path: race_high_Write_a_multi_choice_question_options_given_/validation-* - split: test path: race_high_Write_a_multi_choice_question_options_given_/test-* - config_name: race_middle_Is_this_the_right_answer data_files: - split: train path: race_middle_Is_this_the_right_answer/train-* - split: validation path: race_middle_Is_this_the_right_answer/validation-* - split: test path: race_middle_Is_this_the_right_answer/test-* - config_name: race_middle_Read_the_article_and_answer_the_question_no_option_ data_files: - split: train path: race_middle_Read_the_article_and_answer_the_question_no_option_/train-* - split: validation path: race_middle_Read_the_article_and_answer_the_question_no_option_/validation-* - split: test path: race_middle_Read_the_article_and_answer_the_question_no_option_/test-* - config_name: race_middle_Select_the_best_answer data_files: - split: train path: race_middle_Select_the_best_answer/train-* - split: validation path: race_middle_Select_the_best_answer/validation-* - split: test path: race_middle_Select_the_best_answer/test-* - config_name: race_middle_Select_the_best_answer_generate_span_ data_files: - split: train path: race_middle_Select_the_best_answer_generate_span_/train-* - split: validation path: race_middle_Select_the_best_answer_generate_span_/validation-* - split: test path: race_middle_Select_the_best_answer_generate_span_/test-* - config_name: race_middle_Select_the_best_answer_no_instructions_ data_files: - split: train path: race_middle_Select_the_best_answer_no_instructions_/train-* - split: validation path: race_middle_Select_the_best_answer_no_instructions_/validation-* - split: test path: race_middle_Select_the_best_answer_no_instructions_/test-* - config_name: race_middle_Taking_a_test data_files: - split: train path: race_middle_Taking_a_test/train-* - split: validation path: race_middle_Taking_a_test/validation-* - split: test path: race_middle_Taking_a_test/test-* - config_name: race_middle_Write_a_multi_choice_question_for_the_following_article data_files: - split: train path: race_middle_Write_a_multi_choice_question_for_the_following_article/train-* - split: validation path: race_middle_Write_a_multi_choice_question_for_the_following_article/validation-* - split: test path: race_middle_Write_a_multi_choice_question_for_the_following_article/test-* - config_name: race_middle_Write_a_multi_choice_question_options_given_ data_files: - split: train path: race_middle_Write_a_multi_choice_question_options_given_/train-* - split: validation path: race_middle_Write_a_multi_choice_question_options_given_/validation-* - split: test path: race_middle_Write_a_multi_choice_question_options_given_/test-* - config_name: ropes_background_new_situation_answer data_files: - split: train path: ropes_background_new_situation_answer/train-* - split: validation path: ropes_background_new_situation_answer/validation-* - config_name: ropes_background_situation_middle data_files: - split: train path: ropes_background_situation_middle/train-* - split: validation path: ropes_background_situation_middle/validation-* - config_name: ropes_given_background_situation data_files: - split: train path: ropes_given_background_situation/train-* - split: validation path: ropes_given_background_situation/validation-* - config_name: ropes_new_situation_background_answer data_files: - split: train path: ropes_new_situation_background_answer/train-* - split: validation path: ropes_new_situation_background_answer/validation-* - config_name: ropes_plain_background_situation data_files: - split: train path: ropes_plain_background_situation/train-* - split: validation path: ropes_plain_background_situation/validation-* - config_name: ropes_plain_bottom_hint data_files: - split: train path: ropes_plain_bottom_hint/train-* - split: validation path: ropes_plain_bottom_hint/validation-* - config_name: ropes_plain_no_background data_files: - split: train path: ropes_plain_no_background/train-* - split: validation path: ropes_plain_no_background/validation-* - config_name: ropes_prompt_beginning data_files: - split: train path: ropes_prompt_beginning/train-* - split: validation path: ropes_prompt_beginning/validation-* - config_name: ropes_prompt_bottom_hint_beginning data_files: - split: train path: ropes_prompt_bottom_hint_beginning/train-* - split: validation path: ropes_prompt_bottom_hint_beginning/validation-* - config_name: ropes_prompt_bottom_no_hint data_files: - split: train path: ropes_prompt_bottom_no_hint/train-* - split: validation path: ropes_prompt_bottom_no_hint/validation-* - config_name: ropes_prompt_mix data_files: - split: train path: ropes_prompt_mix/train-* - split: validation path: ropes_prompt_mix/validation-* - config_name: ropes_read_background_situation data_files: - split: train path: ropes_read_background_situation/train-* - split: validation path: ropes_read_background_situation/validation-* - config_name: rotten_tomatoes_Movie_Expressed_Sentiment data_files: - split: train path: rotten_tomatoes_Movie_Expressed_Sentiment/train-* - split: validation path: rotten_tomatoes_Movie_Expressed_Sentiment/validation-* - split: test path: rotten_tomatoes_Movie_Expressed_Sentiment/test-* - config_name: rotten_tomatoes_Movie_Expressed_Sentiment_2 data_files: - split: train path: rotten_tomatoes_Movie_Expressed_Sentiment_2/train-* - split: validation path: rotten_tomatoes_Movie_Expressed_Sentiment_2/validation-* - split: test path: rotten_tomatoes_Movie_Expressed_Sentiment_2/test-* - config_name: rotten_tomatoes_Reviewer_Enjoyment data_files: - split: train path: rotten_tomatoes_Reviewer_Enjoyment/train-* - split: validation path: rotten_tomatoes_Reviewer_Enjoyment/validation-* - split: test path: rotten_tomatoes_Reviewer_Enjoyment/test-* - config_name: rotten_tomatoes_Reviewer_Enjoyment_Yes_No data_files: - split: train path: rotten_tomatoes_Reviewer_Enjoyment_Yes_No/train-* - split: validation path: rotten_tomatoes_Reviewer_Enjoyment_Yes_No/validation-* - split: test path: rotten_tomatoes_Reviewer_Enjoyment_Yes_No/test-* - config_name: rotten_tomatoes_Reviewer_Expressed_Sentiment data_files: - split: train path: rotten_tomatoes_Reviewer_Expressed_Sentiment/train-* - split: validation path: rotten_tomatoes_Reviewer_Expressed_Sentiment/validation-* - split: test path: rotten_tomatoes_Reviewer_Expressed_Sentiment/test-* - config_name: rotten_tomatoes_Reviewer_Opinion_bad_good_choices data_files: - split: train path: rotten_tomatoes_Reviewer_Opinion_bad_good_choices/train-* - split: validation path: rotten_tomatoes_Reviewer_Opinion_bad_good_choices/validation-* - split: test path: rotten_tomatoes_Reviewer_Opinion_bad_good_choices/test-* - config_name: rotten_tomatoes_Reviewer_Sentiment_Feeling data_files: - split: train path: rotten_tomatoes_Reviewer_Sentiment_Feeling/train-* - split: validation path: rotten_tomatoes_Reviewer_Sentiment_Feeling/validation-* - split: test path: rotten_tomatoes_Reviewer_Sentiment_Feeling/test-* - config_name: rotten_tomatoes_Sentiment_with_choices_ data_files: - split: train path: rotten_tomatoes_Sentiment_with_choices_/train-* - split: validation path: rotten_tomatoes_Sentiment_with_choices_/validation-* - split: test path: rotten_tomatoes_Sentiment_with_choices_/test-* - config_name: rotten_tomatoes_Text_Expressed_Sentiment data_files: - split: train path: rotten_tomatoes_Text_Expressed_Sentiment/train-* - split: validation path: rotten_tomatoes_Text_Expressed_Sentiment/validation-* - split: test path: rotten_tomatoes_Text_Expressed_Sentiment/test-* - config_name: rotten_tomatoes_Writer_Expressed_Sentiment data_files: - split: train path: rotten_tomatoes_Writer_Expressed_Sentiment/train-* - split: validation path: rotten_tomatoes_Writer_Expressed_Sentiment/validation-* - split: test path: rotten_tomatoes_Writer_Expressed_Sentiment/test-* - config_name: samsum_Generate_a_summary_for_this_dialogue data_files: - split: train path: samsum_Generate_a_summary_for_this_dialogue/train-* - split: validation path: samsum_Generate_a_summary_for_this_dialogue/validation-* - split: test path: samsum_Generate_a_summary_for_this_dialogue/test-* - config_name: samsum_Given_the_above_dialogue_write_a_summary data_files: - split: train path: samsum_Given_the_above_dialogue_write_a_summary/train-* - split: validation path: samsum_Given_the_above_dialogue_write_a_summary/validation-* - split: test path: samsum_Given_the_above_dialogue_write_a_summary/test-* - config_name: samsum_Sum_up_the_following_dialogue data_files: - split: train path: samsum_Sum_up_the_following_dialogue/train-* - split: validation path: samsum_Sum_up_the_following_dialogue/validation-* - split: test path: samsum_Sum_up_the_following_dialogue/test-* - config_name: samsum_Summarize_ data_files: - split: train path: samsum_Summarize_/train-* - split: validation path: samsum_Summarize_/validation-* - split: test path: samsum_Summarize_/test-* - config_name: samsum_Summarize_this_dialogue_ data_files: - split: train path: samsum_Summarize_this_dialogue_/train-* - split: validation path: samsum_Summarize_this_dialogue_/validation-* - split: test path: samsum_Summarize_this_dialogue_/test-* - config_name: samsum_To_sum_up_this_dialog data_files: - split: train path: samsum_To_sum_up_this_dialog/train-* - split: validation path: samsum_To_sum_up_this_dialog/validation-* - split: test path: samsum_To_sum_up_this_dialog/test-* - config_name: samsum_Write_a_dialogue_that_match_this_summary data_files: - split: train path: samsum_Write_a_dialogue_that_match_this_summary/train-* - split: validation path: samsum_Write_a_dialogue_that_match_this_summary/validation-* - split: test path: samsum_Write_a_dialogue_that_match_this_summary/test-* - config_name: sciq_Direct_Question data_files: - split: train path: sciq_Direct_Question/train-* - split: validation path: sciq_Direct_Question/validation-* - split: test path: sciq_Direct_Question/test-* - config_name: sciq_Direct_Question_Closed_Book_ data_files: - split: train path: sciq_Direct_Question_Closed_Book_/train-* - split: validation path: sciq_Direct_Question_Closed_Book_/validation-* - split: test path: sciq_Direct_Question_Closed_Book_/test-* - config_name: sciq_Multiple_Choice data_files: - split: train path: sciq_Multiple_Choice/train-* - split: validation path: sciq_Multiple_Choice/validation-* - split: test path: sciq_Multiple_Choice/test-* - config_name: sciq_Multiple_Choice_Closed_Book_ data_files: - split: train path: sciq_Multiple_Choice_Closed_Book_/train-* - split: validation path: sciq_Multiple_Choice_Closed_Book_/validation-* - split: test path: sciq_Multiple_Choice_Closed_Book_/test-* - config_name: sciq_Multiple_Choice_Question_First data_files: - split: train path: sciq_Multiple_Choice_Question_First/train-* - split: validation path: sciq_Multiple_Choice_Question_First/validation-* - split: test path: sciq_Multiple_Choice_Question_First/test-* - config_name: social_i_qa_Check_if_a_random_answer_is_valid_or_not data_files: - split: train path: social_i_qa_Check_if_a_random_answer_is_valid_or_not/train-* - split: validation path: social_i_qa_Check_if_a_random_answer_is_valid_or_not/validation-* - config_name: social_i_qa_Generate_answer data_files: - split: train path: social_i_qa_Generate_answer/train-* - split: validation path: social_i_qa_Generate_answer/validation-* - config_name: social_i_qa_Generate_the_question_from_the_answer data_files: - split: train path: social_i_qa_Generate_the_question_from_the_answer/train-* - split: validation path: social_i_qa_Generate_the_question_from_the_answer/validation-* - config_name: social_i_qa_I_was_wondering data_files: - split: train path: social_i_qa_I_was_wondering/train-* - split: validation path: social_i_qa_I_was_wondering/validation-* - config_name: social_i_qa_Show_choices_and_generate_answer data_files: - split: train path: social_i_qa_Show_choices_and_generate_answer/train-* - split: validation path: social_i_qa_Show_choices_and_generate_answer/validation-* - config_name: social_i_qa_Show_choices_and_generate_index data_files: - split: train path: social_i_qa_Show_choices_and_generate_index/train-* - split: validation path: social_i_qa_Show_choices_and_generate_index/validation-* - config_name: squad_v2_Jeopardy_with_Context data_files: - split: train path: squad_v2_Jeopardy_with_Context/train-* - split: validation path: squad_v2_Jeopardy_with_Context/validation-* - config_name: squad_v2_Jeopardy_without_Context data_files: - split: train path: squad_v2_Jeopardy_without_Context/train-* - split: validation path: squad_v2_Jeopardy_without_Context/validation-* - config_name: squad_v2_Questions_with_Context data_files: - split: train path: squad_v2_Questions_with_Context/train-* - split: validation path: squad_v2_Questions_with_Context/validation-* - config_name: squad_v2_Questions_with_Context_Without_Prompt_Keywords data_files: - split: train path: squad_v2_Questions_with_Context_Without_Prompt_Keywords/train-* - split: validation path: squad_v2_Questions_with_Context_Without_Prompt_Keywords/validation-* - config_name: squad_v2_Questions_with_Context_Without_Prompt_Keywords_unanswerable data_files: - split: train path: squad_v2_Questions_with_Context_Without_Prompt_Keywords_unanswerable/train-* - split: validation path: squad_v2_Questions_with_Context_Without_Prompt_Keywords_unanswerable/validation-* - config_name: squad_v2_Questions_with_Context_unanswerable data_files: - split: train path: squad_v2_Questions_with_Context_unanswerable/train-* - split: validation path: squad_v2_Questions_with_Context_unanswerable/validation-* - config_name: squad_v2_Topic_Prediction_Context data_files: - split: train path: squad_v2_Topic_Prediction_Context/train-* - split: validation path: squad_v2_Topic_Prediction_Context/validation-* - config_name: squad_v2_Topic_Prediction_Context_with_randomized_prompt_options data_files: - split: train path: squad_v2_Topic_Prediction_Context_with_randomized_prompt_options/train-* - split: validation path: squad_v2_Topic_Prediction_Context_with_randomized_prompt_options/validation-* - config_name: squad_v2_Topic_Prediction_Context_with_randomized_prompt_options_placed_in_the_end data_files: - split: train path: squad_v2_Topic_Prediction_Context_with_randomized_prompt_options_placed_in_the_end/train-* - split: validation path: squad_v2_Topic_Prediction_Context_with_randomized_prompt_options_placed_in_the_end/validation-* - config_name: squad_v2_Topic_Prediction_Question_and_Answer_Pair data_files: - split: train path: squad_v2_Topic_Prediction_Question_and_Answer_Pair/train-* - split: validation path: squad_v2_Topic_Prediction_Question_and_Answer_Pair/validation-* - config_name: squad_v2_Trivia data_files: - split: train path: squad_v2_Trivia/train-* - split: validation path: squad_v2_Trivia/validation-* - config_name: squad_v2_Unanwerable_question data_files: - split: train path: squad_v2_Unanwerable_question/train-* - split: validation path: squad_v2_Unanwerable_question/validation-* - config_name: super_glue_boolq_GPT_3_Style data_files: - split: train path: super_glue_boolq_GPT_3_Style/train-* - split: validation path: super_glue_boolq_GPT_3_Style/validation-* - split: test path: super_glue_boolq_GPT_3_Style/test-* - config_name: super_glue_boolq_I_wonder_ data_files: - split: train path: super_glue_boolq_I_wonder_/train-* - split: validation path: super_glue_boolq_I_wonder_/validation-* - split: test path: super_glue_boolq_I_wonder_/test-* - config_name: super_glue_boolq_after_reading data_files: - split: train path: super_glue_boolq_after_reading/train-* - split: validation path: super_glue_boolq_after_reading/validation-* - split: test path: super_glue_boolq_after_reading/test-* - config_name: super_glue_boolq_based_on_the_following_passage data_files: - split: train path: super_glue_boolq_based_on_the_following_passage/train-* - split: validation path: super_glue_boolq_based_on_the_following_passage/validation-* - split: test path: super_glue_boolq_based_on_the_following_passage/test-* - config_name: super_glue_boolq_based_on_the_previous_passage data_files: - split: train path: super_glue_boolq_based_on_the_previous_passage/train-* - split: validation path: super_glue_boolq_based_on_the_previous_passage/validation-* - split: test path: super_glue_boolq_based_on_the_previous_passage/test-* - config_name: super_glue_boolq_could_you_tell_me_ data_files: - split: train path: super_glue_boolq_could_you_tell_me_/train-* - split: validation path: super_glue_boolq_could_you_tell_me_/validation-* - split: test path: super_glue_boolq_could_you_tell_me_/test-* - config_name: super_glue_boolq_exam data_files: - split: train path: super_glue_boolq_exam/train-* - split: validation path: super_glue_boolq_exam/validation-* - split: test path: super_glue_boolq_exam/test-* - config_name: super_glue_boolq_exercise data_files: - split: train path: super_glue_boolq_exercise/train-* - split: validation path: super_glue_boolq_exercise/validation-* - split: test path: super_glue_boolq_exercise/test-* - config_name: super_glue_boolq_valid_binary data_files: - split: train path: super_glue_boolq_valid_binary/train-* - split: validation path: super_glue_boolq_valid_binary/validation-* - split: test path: super_glue_boolq_valid_binary/test-* - config_name: super_glue_boolq_yes_no_question data_files: - split: train path: super_glue_boolq_yes_no_question/train-* - split: validation path: super_glue_boolq_yes_no_question/validation-* - split: test path: super_glue_boolq_yes_no_question/test-* - config_name: super_glue_cb_GPT_3_style data_files: - split: train path: super_glue_cb_GPT_3_style/train-* - split: validation path: super_glue_cb_GPT_3_style/validation-* - split: test path: super_glue_cb_GPT_3_style/test-* - config_name: super_glue_cb_GPT_3_style_score_eval data_files: - split: train path: super_glue_cb_GPT_3_style_score_eval/train-* - split: validation path: super_glue_cb_GPT_3_style_score_eval/validation-* - split: test path: super_glue_cb_GPT_3_style_score_eval/test-* - config_name: super_glue_cb_MNLI_crowdsource data_files: - split: train path: super_glue_cb_MNLI_crowdsource/train-* - split: validation path: super_glue_cb_MNLI_crowdsource/validation-* - split: test path: super_glue_cb_MNLI_crowdsource/test-* - config_name: super_glue_cb_MNLI_crowdsource_score_eval data_files: - split: train path: super_glue_cb_MNLI_crowdsource_score_eval/train-* - split: validation path: super_glue_cb_MNLI_crowdsource_score_eval/validation-* - split: test path: super_glue_cb_MNLI_crowdsource_score_eval/test-* - config_name: super_glue_cb_always_sometimes_never data_files: - split: train path: super_glue_cb_always_sometimes_never/train-* - split: validation path: super_glue_cb_always_sometimes_never/validation-* - split: test path: super_glue_cb_always_sometimes_never/test-* - config_name: super_glue_cb_always_sometimes_never_score_eval data_files: - split: train path: super_glue_cb_always_sometimes_never_score_eval/train-* - split: validation path: super_glue_cb_always_sometimes_never_score_eval/validation-* - split: test path: super_glue_cb_always_sometimes_never_score_eval/test-* - config_name: super_glue_cb_based_on_the_previous_passage data_files: - split: train path: super_glue_cb_based_on_the_previous_passage/train-* - split: validation path: super_glue_cb_based_on_the_previous_passage/validation-* - split: test path: super_glue_cb_based_on_the_previous_passage/test-* - config_name: super_glue_cb_based_on_the_previous_passage_score_eval data_files: - split: train path: super_glue_cb_based_on_the_previous_passage_score_eval/train-* - split: validation path: super_glue_cb_based_on_the_previous_passage_score_eval/validation-* - split: test path: super_glue_cb_based_on_the_previous_passage_score_eval/test-* - config_name: super_glue_cb_can_we_infer data_files: - split: train path: super_glue_cb_can_we_infer/train-* - split: validation path: super_glue_cb_can_we_infer/validation-* - split: test path: super_glue_cb_can_we_infer/test-* - config_name: super_glue_cb_can_we_infer_score_eval data_files: - split: train path: super_glue_cb_can_we_infer_score_eval/train-* - split: validation path: super_glue_cb_can_we_infer_score_eval/validation-* - split: test path: super_glue_cb_can_we_infer_score_eval/test-* - config_name: super_glue_cb_claim_true_false_inconclusive data_files: - split: train path: super_glue_cb_claim_true_false_inconclusive/train-* - split: validation path: super_glue_cb_claim_true_false_inconclusive/validation-* - split: test path: super_glue_cb_claim_true_false_inconclusive/test-* - config_name: super_glue_cb_claim_true_false_inconclusive_score_eval data_files: - split: train path: super_glue_cb_claim_true_false_inconclusive_score_eval/train-* - split: validation path: super_glue_cb_claim_true_false_inconclusive_score_eval/validation-* - split: test path: super_glue_cb_claim_true_false_inconclusive_score_eval/test-* - config_name: super_glue_cb_consider_always_sometimes_never data_files: - split: train path: super_glue_cb_consider_always_sometimes_never/train-* - split: validation path: super_glue_cb_consider_always_sometimes_never/validation-* - split: test path: super_glue_cb_consider_always_sometimes_never/test-* - config_name: super_glue_cb_consider_always_sometimes_never_score_eval data_files: - split: train path: super_glue_cb_consider_always_sometimes_never_score_eval/train-* - split: validation path: super_glue_cb_consider_always_sometimes_never_score_eval/validation-* - split: test path: super_glue_cb_consider_always_sometimes_never_score_eval/test-* - config_name: super_glue_cb_does_it_follow_that data_files: - split: train path: super_glue_cb_does_it_follow_that/train-* - split: validation path: super_glue_cb_does_it_follow_that/validation-* - split: test path: super_glue_cb_does_it_follow_that/test-* - config_name: super_glue_cb_does_it_follow_that_score_eval data_files: - split: train path: super_glue_cb_does_it_follow_that_score_eval/train-* - split: validation path: super_glue_cb_does_it_follow_that_score_eval/validation-* - split: test path: super_glue_cb_does_it_follow_that_score_eval/test-* - config_name: super_glue_cb_does_this_imply data_files: - split: train path: super_glue_cb_does_this_imply/train-* - split: validation path: super_glue_cb_does_this_imply/validation-* - split: test path: super_glue_cb_does_this_imply/test-* - config_name: super_glue_cb_does_this_imply_score_eval data_files: - split: train path: super_glue_cb_does_this_imply_score_eval/train-* - split: validation path: super_glue_cb_does_this_imply_score_eval/validation-* - split: test path: super_glue_cb_does_this_imply_score_eval/test-* - config_name: super_glue_cb_guaranteed_possible_impossible data_files: - split: train path: super_glue_cb_guaranteed_possible_impossible/train-* - split: validation path: super_glue_cb_guaranteed_possible_impossible/validation-* - split: test path: super_glue_cb_guaranteed_possible_impossible/test-* - config_name: super_glue_cb_guaranteed_possible_impossible_score_eval data_files: - split: train path: super_glue_cb_guaranteed_possible_impossible_score_eval/train-* - split: validation path: super_glue_cb_guaranteed_possible_impossible_score_eval/validation-* - split: test path: super_glue_cb_guaranteed_possible_impossible_score_eval/test-* - config_name: super_glue_cb_guaranteed_true data_files: - split: train path: super_glue_cb_guaranteed_true/train-* - split: validation path: super_glue_cb_guaranteed_true/validation-* - split: test path: super_glue_cb_guaranteed_true/test-* - config_name: super_glue_cb_guaranteed_true_score_eval data_files: - split: train path: super_glue_cb_guaranteed_true_score_eval/train-* - split: validation path: super_glue_cb_guaranteed_true_score_eval/validation-* - split: test path: super_glue_cb_guaranteed_true_score_eval/test-* - config_name: super_glue_cb_justified_in_saying data_files: - split: train path: super_glue_cb_justified_in_saying/train-* - split: validation path: super_glue_cb_justified_in_saying/validation-* - split: test path: super_glue_cb_justified_in_saying/test-* - config_name: super_glue_cb_justified_in_saying_score_eval data_files: - split: train path: super_glue_cb_justified_in_saying_score_eval/train-* - split: validation path: super_glue_cb_justified_in_saying_score_eval/validation-* - split: test path: super_glue_cb_justified_in_saying_score_eval/test-* - config_name: super_glue_cb_must_be_true data_files: - split: train path: super_glue_cb_must_be_true/train-* - split: validation path: super_glue_cb_must_be_true/validation-* - split: test path: super_glue_cb_must_be_true/test-* - config_name: super_glue_cb_must_be_true_score_eval data_files: - split: train path: super_glue_cb_must_be_true_score_eval/train-* - split: validation path: super_glue_cb_must_be_true_score_eval/validation-* - split: test path: super_glue_cb_must_be_true_score_eval/test-* - config_name: super_glue_cb_should_assume data_files: - split: train path: super_glue_cb_should_assume/train-* - split: validation path: super_glue_cb_should_assume/validation-* - split: test path: super_glue_cb_should_assume/test-* - config_name: super_glue_cb_should_assume_score_eval data_files: - split: train path: super_glue_cb_should_assume_score_eval/train-* - split: validation path: super_glue_cb_should_assume_score_eval/validation-* - split: test path: super_glue_cb_should_assume_score_eval/test-* - config_name: super_glue_cb_take_the_following_as_truth data_files: - split: train path: super_glue_cb_take_the_following_as_truth/train-* - split: validation path: super_glue_cb_take_the_following_as_truth/validation-* - split: test path: super_glue_cb_take_the_following_as_truth/test-* - config_name: super_glue_cb_take_the_following_as_truth_score_eval data_files: - split: train path: super_glue_cb_take_the_following_as_truth_score_eval/train-* - split: validation path: super_glue_cb_take_the_following_as_truth_score_eval/validation-* - split: test path: super_glue_cb_take_the_following_as_truth_score_eval/test-* - config_name: super_glue_copa_C1_or_C2_premise_so_because_ data_files: - split: train path: super_glue_copa_C1_or_C2_premise_so_because_/train-* - split: validation path: super_glue_copa_C1_or_C2_premise_so_because_/validation-* - split: test path: super_glue_copa_C1_or_C2_premise_so_because_/test-* - config_name: super_glue_copa_C1_or_C2_premise_so_because__score_eval data_files: - split: train path: super_glue_copa_C1_or_C2_premise_so_because__score_eval/train-* - split: validation path: super_glue_copa_C1_or_C2_premise_so_because__score_eval/validation-* - split: test path: super_glue_copa_C1_or_C2_premise_so_because__score_eval/test-* - config_name: super_glue_copa__As_a_result_C1_or_C2_ data_files: - split: train path: super_glue_copa__As_a_result_C1_or_C2_/train-* - split: validation path: super_glue_copa__As_a_result_C1_or_C2_/validation-* - split: test path: super_glue_copa__As_a_result_C1_or_C2_/test-* - config_name: super_glue_copa__As_a_result_C1_or_C2__score_eval data_files: - split: train path: super_glue_copa__As_a_result_C1_or_C2__score_eval/train-* - split: validation path: super_glue_copa__As_a_result_C1_or_C2__score_eval/validation-* - split: test path: super_glue_copa__As_a_result_C1_or_C2__score_eval/test-* - config_name: super_glue_copa__What_could_happen_next_C1_or_C2_ data_files: - split: train path: super_glue_copa__What_could_happen_next_C1_or_C2_/train-* - split: validation path: super_glue_copa__What_could_happen_next_C1_or_C2_/validation-* - split: test path: super_glue_copa__What_could_happen_next_C1_or_C2_/test-* - config_name: super_glue_copa__What_could_happen_next_C1_or_C2__score_eval data_files: - split: train path: super_glue_copa__What_could_happen_next_C1_or_C2__score_eval/train-* - split: validation path: super_glue_copa__What_could_happen_next_C1_or_C2__score_eval/validation-* - split: test path: super_glue_copa__What_could_happen_next_C1_or_C2__score_eval/test-* - config_name: super_glue_copa__which_may_be_caused_by data_files: - split: train path: super_glue_copa__which_may_be_caused_by/train-* - split: validation path: super_glue_copa__which_may_be_caused_by/validation-* - split: test path: super_glue_copa__which_may_be_caused_by/test-* - config_name: super_glue_copa__which_may_be_caused_by_score_eval data_files: - split: train path: super_glue_copa__which_may_be_caused_by_score_eval/train-* - split: validation path: super_glue_copa__which_may_be_caused_by_score_eval/validation-* - split: test path: super_glue_copa__which_may_be_caused_by_score_eval/test-* - config_name: super_glue_copa__why_C1_or_C2 data_files: - split: train path: super_glue_copa__why_C1_or_C2/train-* - split: validation path: super_glue_copa__why_C1_or_C2/validation-* - split: test path: super_glue_copa__why_C1_or_C2/test-* - config_name: super_glue_copa__why_C1_or_C2_score_eval data_files: - split: train path: super_glue_copa__why_C1_or_C2_score_eval/train-* - split: validation path: super_glue_copa__why_C1_or_C2_score_eval/validation-* - split: test path: super_glue_copa__why_C1_or_C2_score_eval/test-* - config_name: super_glue_copa_best_option data_files: - split: train path: super_glue_copa_best_option/train-* - split: validation path: super_glue_copa_best_option/validation-* - split: test path: super_glue_copa_best_option/test-* - config_name: super_glue_copa_best_option_score_eval data_files: - split: train path: super_glue_copa_best_option_score_eval/train-* - split: validation path: super_glue_copa_best_option_score_eval/validation-* - split: test path: super_glue_copa_best_option_score_eval/test-* - config_name: super_glue_copa_cause_effect data_files: - split: train path: super_glue_copa_cause_effect/train-* - split: validation path: super_glue_copa_cause_effect/validation-* - split: test path: super_glue_copa_cause_effect/test-* - config_name: super_glue_copa_cause_effect_score_eval data_files: - split: train path: super_glue_copa_cause_effect_score_eval/train-* - split: validation path: super_glue_copa_cause_effect_score_eval/validation-* - split: test path: super_glue_copa_cause_effect_score_eval/test-* - config_name: super_glue_copa_choose data_files: - split: train path: super_glue_copa_choose/train-* - split: validation path: super_glue_copa_choose/validation-* - split: test path: super_glue_copa_choose/test-* - config_name: super_glue_copa_choose_score_eval data_files: - split: train path: super_glue_copa_choose_score_eval/train-* - split: validation path: super_glue_copa_choose_score_eval/validation-* - split: test path: super_glue_copa_choose_score_eval/test-* - config_name: super_glue_copa_exercise data_files: - split: train path: super_glue_copa_exercise/train-* - split: validation path: super_glue_copa_exercise/validation-* - split: test path: super_glue_copa_exercise/test-* - config_name: super_glue_copa_exercise_score_eval data_files: - split: train path: super_glue_copa_exercise_score_eval/train-* - split: validation path: super_glue_copa_exercise_score_eval/validation-* - split: test path: super_glue_copa_exercise_score_eval/test-* - config_name: super_glue_copa_i_am_hesitating data_files: - split: train path: super_glue_copa_i_am_hesitating/train-* - split: validation path: super_glue_copa_i_am_hesitating/validation-* - split: test path: super_glue_copa_i_am_hesitating/test-* - config_name: super_glue_copa_i_am_hesitating_score_eval data_files: - split: train path: super_glue_copa_i_am_hesitating_score_eval/train-* - split: validation path: super_glue_copa_i_am_hesitating_score_eval/validation-* - split: test path: super_glue_copa_i_am_hesitating_score_eval/test-* - config_name: super_glue_copa_more_likely data_files: - split: train path: super_glue_copa_more_likely/train-* - split: validation path: super_glue_copa_more_likely/validation-* - split: test path: super_glue_copa_more_likely/test-* - config_name: super_glue_copa_more_likely_score_eval data_files: - split: train path: super_glue_copa_more_likely_score_eval/train-* - split: validation path: super_glue_copa_more_likely_score_eval/validation-* - split: test path: super_glue_copa_more_likely_score_eval/test-* - config_name: super_glue_copa_plausible_alternatives data_files: - split: train path: super_glue_copa_plausible_alternatives/train-* - split: validation path: super_glue_copa_plausible_alternatives/validation-* - split: test path: super_glue_copa_plausible_alternatives/test-* - config_name: super_glue_copa_plausible_alternatives_score_eval data_files: - split: train path: super_glue_copa_plausible_alternatives_score_eval/train-* - split: validation path: super_glue_copa_plausible_alternatives_score_eval/validation-* - split: test path: super_glue_copa_plausible_alternatives_score_eval/test-* - config_name: super_glue_multirc_I_was_going_to_say_ data_files: - split: train path: super_glue_multirc_I_was_going_to_say_/train-* - split: validation path: super_glue_multirc_I_was_going_to_say_/validation-* - split: test path: super_glue_multirc_I_was_going_to_say_/test-* - config_name: super_glue_multirc_Would_it_be_good_to_answer_ data_files: - split: train path: super_glue_multirc_Would_it_be_good_to_answer_/train-* - split: validation path: super_glue_multirc_Would_it_be_good_to_answer_/validation-* - split: test path: super_glue_multirc_Would_it_be_good_to_answer_/test-* - config_name: super_glue_multirc_confirm data_files: - split: train path: super_glue_multirc_confirm/train-* - split: validation path: super_glue_multirc_confirm/validation-* - split: test path: super_glue_multirc_confirm/test-* - config_name: super_glue_multirc_correct data_files: - split: train path: super_glue_multirc_correct/train-* - split: validation path: super_glue_multirc_correct/validation-* - split: test path: super_glue_multirc_correct/test-* - config_name: super_glue_multirc_decide_valid data_files: - split: train path: super_glue_multirc_decide_valid/train-* - split: validation path: super_glue_multirc_decide_valid/validation-* - split: test path: super_glue_multirc_decide_valid/test-* - config_name: super_glue_multirc_found_this_answer data_files: - split: train path: super_glue_multirc_found_this_answer/train-* - split: validation path: super_glue_multirc_found_this_answer/validation-* - split: test path: super_glue_multirc_found_this_answer/test-* - config_name: super_glue_multirc_grading data_files: - split: train path: super_glue_multirc_grading/train-* - split: validation path: super_glue_multirc_grading/validation-* - split: test path: super_glue_multirc_grading/test-* - config_name: super_glue_multirc_is_a_correct_answer_ data_files: - split: train path: super_glue_multirc_is_a_correct_answer_/train-* - split: validation path: super_glue_multirc_is_a_correct_answer_/validation-* - split: test path: super_glue_multirc_is_a_correct_answer_/test-* - config_name: super_glue_multirc_is_the_correct_answer_ data_files: - split: train path: super_glue_multirc_is_the_correct_answer_/train-* - split: validation path: super_glue_multirc_is_the_correct_answer_/validation-* - split: test path: super_glue_multirc_is_the_correct_answer_/test-* - config_name: super_glue_multirc_paragraph_question_is_it_ data_files: - split: train path: super_glue_multirc_paragraph_question_is_it_/train-* - split: validation path: super_glue_multirc_paragraph_question_is_it_/validation-* - split: test path: super_glue_multirc_paragraph_question_is_it_/test-* - config_name: super_glue_record_Add_sentence_after_after_continuation_choices_ data_files: - split: train path: super_glue_record_Add_sentence_after_after_continuation_choices_/train-* - split: validation path: super_glue_record_Add_sentence_after_after_continuation_choices_/validation-* - split: test path: super_glue_record_Add_sentence_after_after_continuation_choices_/test-* - config_name: super_glue_record_Add_sentence_after_continuation_choices_ data_files: - split: train path: super_glue_record_Add_sentence_after_continuation_choices_/train-* - split: validation path: super_glue_record_Add_sentence_after_continuation_choices_/validation-* - split: test path: super_glue_record_Add_sentence_after_continuation_choices_/test-* - config_name: super_glue_record_Can_you_figure_out_ data_files: - split: train path: super_glue_record_Can_you_figure_out_/train-* - split: validation path: super_glue_record_Can_you_figure_out_/validation-* - split: test path: super_glue_record_Can_you_figure_out_/test-* - config_name: super_glue_record_GPT_3_style_continuation_choices_ data_files: - split: train path: super_glue_record_GPT_3_style_continuation_choices_/train-* - split: validation path: super_glue_record_GPT_3_style_continuation_choices_/validation-* - split: test path: super_glue_record_GPT_3_style_continuation_choices_/test-* - config_name: super_glue_record_GPT_3_style_summary_only_continuation_choices_ data_files: - split: train path: super_glue_record_GPT_3_style_summary_only_continuation_choices_/train-* - split: validation path: super_glue_record_GPT_3_style_summary_only_continuation_choices_/validation-* - split: test path: super_glue_record_GPT_3_style_summary_only_continuation_choices_/test-* - config_name: super_glue_record_GPT_3_style_with_labels_continuation_choices_ data_files: - split: train path: super_glue_record_GPT_3_style_with_labels_continuation_choices_/train-* - split: validation path: super_glue_record_GPT_3_style_with_labels_continuation_choices_/validation-* - split: test path: super_glue_record_GPT_3_style_with_labels_continuation_choices_/test-* - config_name: super_glue_record_GPT_3_style_with_labels_without_hyphens_continuation_choices_ data_files: - split: train path: super_glue_record_GPT_3_style_with_labels_without_hyphens_continuation_choices_/train-* - split: validation path: super_glue_record_GPT_3_style_with_labels_without_hyphens_continuation_choices_/validation-* - split: test path: super_glue_record_GPT_3_style_with_labels_without_hyphens_continuation_choices_/test-* - config_name: super_glue_record_GPT_3_style_without_hyphens_continuation_choices_ data_files: - split: train path: super_glue_record_GPT_3_style_without_hyphens_continuation_choices_/train-* - split: validation path: super_glue_record_GPT_3_style_without_hyphens_continuation_choices_/validation-* - split: test path: super_glue_record_GPT_3_style_without_hyphens_continuation_choices_/test-* - config_name: super_glue_record_In_the_question_above_the_placeholder_stands_for data_files: - split: train path: super_glue_record_In_the_question_above_the_placeholder_stands_for/train-* - split: validation path: super_glue_record_In_the_question_above_the_placeholder_stands_for/validation-* - split: test path: super_glue_record_In_the_question_above_the_placeholder_stands_for/test-* - config_name: super_glue_record_New_highlight_continuation_choices_ data_files: - split: train path: super_glue_record_New_highlight_continuation_choices_/train-* - split: validation path: super_glue_record_New_highlight_continuation_choices_/validation-* - split: test path: super_glue_record_New_highlight_continuation_choices_/test-* - config_name: super_glue_record_News_article_continuation_choices_ data_files: - split: train path: super_glue_record_News_article_continuation_choices_/train-* - split: validation path: super_glue_record_News_article_continuation_choices_/validation-* - split: test path: super_glue_record_News_article_continuation_choices_/test-* - config_name: super_glue_record_Summary_first_continuation_choices_ data_files: - split: train path: super_glue_record_Summary_first_continuation_choices_/train-* - split: validation path: super_glue_record_Summary_first_continuation_choices_/validation-* - split: test path: super_glue_record_Summary_first_continuation_choices_/test-* - config_name: super_glue_record_What_could_the_placeholder_be_ data_files: - split: train path: super_glue_record_What_could_the_placeholder_be_/train-* - split: validation path: super_glue_record_What_could_the_placeholder_be_/validation-* - split: test path: super_glue_record_What_could_the_placeholder_be_/test-* - config_name: super_glue_record_Which_one_is_the_placeholder_ data_files: - split: train path: super_glue_record_Which_one_is_the_placeholder_/train-* - split: validation path: super_glue_record_Which_one_is_the_placeholder_/validation-* - split: test path: super_glue_record_Which_one_is_the_placeholder_/test-* - config_name: super_glue_record_choose_between data_files: - split: train path: super_glue_record_choose_between/train-* - split: validation path: super_glue_record_choose_between/validation-* - split: test path: super_glue_record_choose_between/test-* - config_name: super_glue_record_corrupted data_files: - split: train path: super_glue_record_corrupted/train-* - split: validation path: super_glue_record_corrupted/validation-* - split: test path: super_glue_record_corrupted/test-* - config_name: super_glue_record_exercise data_files: - split: train path: super_glue_record_exercise/train-* - split: validation path: super_glue_record_exercise/validation-* - split: test path: super_glue_record_exercise/test-* - config_name: super_glue_record_pick_one_option data_files: - split: train path: super_glue_record_pick_one_option/train-* - split: validation path: super_glue_record_pick_one_option/validation-* - split: test path: super_glue_record_pick_one_option/test-* - config_name: super_glue_record_the_placeholder_refers_to_ data_files: - split: train path: super_glue_record_the_placeholder_refers_to_/train-* - split: validation path: super_glue_record_the_placeholder_refers_to_/validation-* - split: test path: super_glue_record_the_placeholder_refers_to_/test-* - config_name: super_glue_record_trying_to_decide data_files: - split: train path: super_glue_record_trying_to_decide/train-* - split: validation path: super_glue_record_trying_to_decide/validation-* - split: test path: super_glue_record_trying_to_decide/test-* - config_name: super_glue_rte_GPT_3_style data_files: - split: train path: super_glue_rte_GPT_3_style/train-* - split: validation path: super_glue_rte_GPT_3_style/validation-* - split: test path: super_glue_rte_GPT_3_style/test-* - config_name: super_glue_rte_GPT_3_style_score_eval data_files: - split: train path: super_glue_rte_GPT_3_style_score_eval/train-* - split: validation path: super_glue_rte_GPT_3_style_score_eval/validation-* - split: test path: super_glue_rte_GPT_3_style_score_eval/test-* - config_name: super_glue_rte_MNLI_crowdsource data_files: - split: train path: super_glue_rte_MNLI_crowdsource/train-* - split: validation path: super_glue_rte_MNLI_crowdsource/validation-* - split: test path: super_glue_rte_MNLI_crowdsource/test-* - config_name: super_glue_rte_MNLI_crowdsource_score_eval data_files: - split: train path: super_glue_rte_MNLI_crowdsource_score_eval/train-* - split: validation path: super_glue_rte_MNLI_crowdsource_score_eval/validation-* - split: test path: super_glue_rte_MNLI_crowdsource_score_eval/test-* - config_name: super_glue_rte_based_on_the_previous_passage data_files: - split: train path: super_glue_rte_based_on_the_previous_passage/train-* - split: validation path: super_glue_rte_based_on_the_previous_passage/validation-* - split: test path: super_glue_rte_based_on_the_previous_passage/test-* - config_name: super_glue_rte_based_on_the_previous_passage_score_eval data_files: - split: train path: super_glue_rte_based_on_the_previous_passage_score_eval/train-* - split: validation path: super_glue_rte_based_on_the_previous_passage_score_eval/validation-* - split: test path: super_glue_rte_based_on_the_previous_passage_score_eval/test-* - config_name: super_glue_rte_can_we_infer data_files: - split: train path: super_glue_rte_can_we_infer/train-* - split: validation path: super_glue_rte_can_we_infer/validation-* - split: test path: super_glue_rte_can_we_infer/test-* - config_name: super_glue_rte_can_we_infer_score_eval data_files: - split: train path: super_glue_rte_can_we_infer_score_eval/train-* - split: validation path: super_glue_rte_can_we_infer_score_eval/validation-* - split: test path: super_glue_rte_can_we_infer_score_eval/test-* - config_name: super_glue_rte_does_it_follow_that data_files: - split: train path: super_glue_rte_does_it_follow_that/train-* - split: validation path: super_glue_rte_does_it_follow_that/validation-* - split: test path: super_glue_rte_does_it_follow_that/test-* - config_name: super_glue_rte_does_it_follow_that_score_eval data_files: - split: train path: super_glue_rte_does_it_follow_that_score_eval/train-* - split: validation path: super_glue_rte_does_it_follow_that_score_eval/validation-* - split: test path: super_glue_rte_does_it_follow_that_score_eval/test-* - config_name: super_glue_rte_does_this_imply data_files: - split: train path: super_glue_rte_does_this_imply/train-* - split: validation path: super_glue_rte_does_this_imply/validation-* - split: test path: super_glue_rte_does_this_imply/test-* - config_name: super_glue_rte_does_this_imply_score_eval data_files: - split: train path: super_glue_rte_does_this_imply_score_eval/train-* - split: validation path: super_glue_rte_does_this_imply_score_eval/validation-* - split: test path: super_glue_rte_does_this_imply_score_eval/test-* - config_name: super_glue_rte_guaranteed_true data_files: - split: train path: super_glue_rte_guaranteed_true/train-* - split: validation path: super_glue_rte_guaranteed_true/validation-* - split: test path: super_glue_rte_guaranteed_true/test-* - config_name: super_glue_rte_guaranteed_true_score_eval data_files: - split: train path: super_glue_rte_guaranteed_true_score_eval/train-* - split: validation path: super_glue_rte_guaranteed_true_score_eval/validation-* - split: test path: super_glue_rte_guaranteed_true_score_eval/test-* - config_name: super_glue_rte_justified_in_saying data_files: - split: train path: super_glue_rte_justified_in_saying/train-* - split: validation path: super_glue_rte_justified_in_saying/validation-* - split: test path: super_glue_rte_justified_in_saying/test-* - config_name: super_glue_rte_justified_in_saying_score_eval data_files: - split: train path: super_glue_rte_justified_in_saying_score_eval/train-* - split: validation path: super_glue_rte_justified_in_saying_score_eval/validation-* - split: test path: super_glue_rte_justified_in_saying_score_eval/test-* - config_name: super_glue_rte_must_be_true data_files: - split: train path: super_glue_rte_must_be_true/train-* - split: validation path: super_glue_rte_must_be_true/validation-* - split: test path: super_glue_rte_must_be_true/test-* - config_name: super_glue_rte_must_be_true_score_eval data_files: - split: train path: super_glue_rte_must_be_true_score_eval/train-* - split: validation path: super_glue_rte_must_be_true_score_eval/validation-* - split: test path: super_glue_rte_must_be_true_score_eval/test-* - config_name: super_glue_rte_should_assume data_files: - split: train path: super_glue_rte_should_assume/train-* - split: validation path: super_glue_rte_should_assume/validation-* - split: test path: super_glue_rte_should_assume/test-* - config_name: super_glue_rte_should_assume_score_eval data_files: - split: train path: super_glue_rte_should_assume_score_eval/train-* - split: validation path: super_glue_rte_should_assume_score_eval/validation-* - split: test path: super_glue_rte_should_assume_score_eval/test-* - config_name: super_glue_wic_GPT_3_prompt data_files: - split: train path: super_glue_wic_GPT_3_prompt/train-* - split: validation path: super_glue_wic_GPT_3_prompt/validation-* - split: test path: super_glue_wic_GPT_3_prompt/test-* - config_name: super_glue_wic_GPT_3_prompt_score_eval data_files: - split: train path: super_glue_wic_GPT_3_prompt_score_eval/train-* - split: validation path: super_glue_wic_GPT_3_prompt_score_eval/validation-* - split: test path: super_glue_wic_GPT_3_prompt_score_eval/test-* - config_name: super_glue_wic_GPT_3_prompt_with_label data_files: - split: train path: super_glue_wic_GPT_3_prompt_with_label/train-* - split: validation path: super_glue_wic_GPT_3_prompt_with_label/validation-* - split: test path: super_glue_wic_GPT_3_prompt_with_label/test-* - config_name: super_glue_wic_GPT_3_prompt_with_label_score_eval data_files: - split: train path: super_glue_wic_GPT_3_prompt_with_label_score_eval/train-* - split: validation path: super_glue_wic_GPT_3_prompt_with_label_score_eval/validation-* - split: test path: super_glue_wic_GPT_3_prompt_with_label_score_eval/test-* - config_name: super_glue_wic_affirmation_true_or_false data_files: - split: train path: super_glue_wic_affirmation_true_or_false/train-* - split: validation path: super_glue_wic_affirmation_true_or_false/validation-* - split: test path: super_glue_wic_affirmation_true_or_false/test-* - config_name: super_glue_wic_affirmation_true_or_false_score_eval data_files: - split: train path: super_glue_wic_affirmation_true_or_false_score_eval/train-* - split: validation path: super_glue_wic_affirmation_true_or_false_score_eval/validation-* - split: test path: super_glue_wic_affirmation_true_or_false_score_eval/test-* - config_name: super_glue_wic_grammar_homework data_files: - split: train path: super_glue_wic_grammar_homework/train-* - split: validation path: super_glue_wic_grammar_homework/validation-* - split: test path: super_glue_wic_grammar_homework/test-* - config_name: super_glue_wic_grammar_homework_score_eval data_files: - split: train path: super_glue_wic_grammar_homework_score_eval/train-* - split: validation path: super_glue_wic_grammar_homework_score_eval/validation-* - split: test path: super_glue_wic_grammar_homework_score_eval/test-* - config_name: super_glue_wic_polysemous data_files: - split: train path: super_glue_wic_polysemous/train-* - split: validation path: super_glue_wic_polysemous/validation-* - split: test path: super_glue_wic_polysemous/test-* - config_name: super_glue_wic_polysemous_score_eval data_files: - split: train path: super_glue_wic_polysemous_score_eval/train-* - split: validation path: super_glue_wic_polysemous_score_eval/validation-* - split: test path: super_glue_wic_polysemous_score_eval/test-* - config_name: super_glue_wic_question_context data_files: - split: train path: super_glue_wic_question_context/train-* - split: validation path: super_glue_wic_question_context/validation-* - split: test path: super_glue_wic_question_context/test-* - config_name: super_glue_wic_question_context_meaning data_files: - split: train path: super_glue_wic_question_context_meaning/train-* - split: validation path: super_glue_wic_question_context_meaning/validation-* - split: test path: super_glue_wic_question_context_meaning/test-* - config_name: super_glue_wic_question_context_meaning_score_eval data_files: - split: train path: super_glue_wic_question_context_meaning_score_eval/train-* - split: validation path: super_glue_wic_question_context_meaning_score_eval/validation-* - split: test path: super_glue_wic_question_context_meaning_score_eval/test-* - config_name: super_glue_wic_question_context_meaning_with_label data_files: - split: train path: super_glue_wic_question_context_meaning_with_label/train-* - split: validation path: super_glue_wic_question_context_meaning_with_label/validation-* - split: test path: super_glue_wic_question_context_meaning_with_label/test-* - config_name: super_glue_wic_question_context_meaning_with_label_score_eval data_files: - split: train path: super_glue_wic_question_context_meaning_with_label_score_eval/train-* - split: validation path: super_glue_wic_question_context_meaning_with_label_score_eval/validation-* - split: test path: super_glue_wic_question_context_meaning_with_label_score_eval/test-* - config_name: super_glue_wic_question_context_score_eval data_files: - split: train path: super_glue_wic_question_context_score_eval/train-* - split: validation path: super_glue_wic_question_context_score_eval/validation-* - split: test path: super_glue_wic_question_context_score_eval/test-* - config_name: super_glue_wic_same_sense data_files: - split: train path: super_glue_wic_same_sense/train-* - split: validation path: super_glue_wic_same_sense/validation-* - split: test path: super_glue_wic_same_sense/test-* - config_name: super_glue_wic_same_sense_score_eval data_files: - split: train path: super_glue_wic_same_sense_score_eval/train-* - split: validation path: super_glue_wic_same_sense_score_eval/validation-* - split: test path: super_glue_wic_same_sense_score_eval/test-* - config_name: super_glue_wic_similar_sense data_files: - split: train path: super_glue_wic_similar_sense/train-* - split: validation path: super_glue_wic_similar_sense/validation-* - split: test path: super_glue_wic_similar_sense/test-* - config_name: super_glue_wic_similar_sense_score_eval data_files: - split: train path: super_glue_wic_similar_sense_score_eval/train-* - split: validation path: super_glue_wic_similar_sense_score_eval/validation-* - split: test path: super_glue_wic_similar_sense_score_eval/test-* - config_name: super_glue_wsc.fixed_GPT_3_Style data_files: - split: train path: super_glue_wsc.fixed_GPT_3_Style/train-* - split: validation path: super_glue_wsc.fixed_GPT_3_Style/validation-* - split: test path: super_glue_wsc.fixed_GPT_3_Style/test-* - config_name: super_glue_wsc.fixed_GPT_3_Style_score_eval data_files: - split: train path: super_glue_wsc.fixed_GPT_3_Style_score_eval/train-* - split: validation path: super_glue_wsc.fixed_GPT_3_Style_score_eval/validation-* - split: test path: super_glue_wsc.fixed_GPT_3_Style_score_eval/test-* - config_name: super_glue_wsc.fixed_I_think_they_mean data_files: - split: train path: super_glue_wsc.fixed_I_think_they_mean/train-* - split: validation path: super_glue_wsc.fixed_I_think_they_mean/validation-* - split: test path: super_glue_wsc.fixed_I_think_they_mean/test-* - config_name: super_glue_wsc.fixed_I_think_they_mean_score_eval data_files: - split: train path: super_glue_wsc.fixed_I_think_they_mean_score_eval/train-* - split: validation path: super_glue_wsc.fixed_I_think_they_mean_score_eval/validation-* - split: test path: super_glue_wsc.fixed_I_think_they_mean_score_eval/test-* - config_name: super_glue_wsc.fixed_Who_or_what_is_are data_files: - split: train path: super_glue_wsc.fixed_Who_or_what_is_are/train-* - split: validation path: super_glue_wsc.fixed_Who_or_what_is_are/validation-* - split: test path: super_glue_wsc.fixed_Who_or_what_is_are/test-* - config_name: super_glue_wsc.fixed_Who_or_what_is_are_score_eval data_files: - split: train path: super_glue_wsc.fixed_Who_or_what_is_are_score_eval/train-* - split: validation path: super_glue_wsc.fixed_Who_or_what_is_are_score_eval/validation-* - split: test path: super_glue_wsc.fixed_Who_or_what_is_are_score_eval/test-* - config_name: super_glue_wsc.fixed_by_p_they_mean data_files: - split: train path: super_glue_wsc.fixed_by_p_they_mean/train-* - split: validation path: super_glue_wsc.fixed_by_p_they_mean/validation-* - split: test path: super_glue_wsc.fixed_by_p_they_mean/test-* - config_name: super_glue_wsc.fixed_by_p_they_mean_score_eval data_files: - split: train path: super_glue_wsc.fixed_by_p_they_mean_score_eval/train-* - split: validation path: super_glue_wsc.fixed_by_p_they_mean_score_eval/validation-* - split: test path: super_glue_wsc.fixed_by_p_they_mean_score_eval/test-* - config_name: super_glue_wsc.fixed_does_p_stand_for data_files: - split: train path: super_glue_wsc.fixed_does_p_stand_for/train-* - split: validation path: super_glue_wsc.fixed_does_p_stand_for/validation-* - split: test path: super_glue_wsc.fixed_does_p_stand_for/test-* - config_name: super_glue_wsc.fixed_does_p_stand_for_score_eval data_files: - split: train path: super_glue_wsc.fixed_does_p_stand_for_score_eval/train-* - split: validation path: super_glue_wsc.fixed_does_p_stand_for_score_eval/validation-* - split: test path: super_glue_wsc.fixed_does_p_stand_for_score_eval/test-* - config_name: super_glue_wsc.fixed_does_the_pronoun_refer_to data_files: - split: train path: super_glue_wsc.fixed_does_the_pronoun_refer_to/train-* - split: validation path: super_glue_wsc.fixed_does_the_pronoun_refer_to/validation-* - split: test path: super_glue_wsc.fixed_does_the_pronoun_refer_to/test-* - config_name: super_glue_wsc.fixed_does_the_pronoun_refer_to_score_eval data_files: - split: train path: super_glue_wsc.fixed_does_the_pronoun_refer_to_score_eval/train-* - split: validation path: super_glue_wsc.fixed_does_the_pronoun_refer_to_score_eval/validation-* - split: test path: super_glue_wsc.fixed_does_the_pronoun_refer_to_score_eval/test-* - config_name: super_glue_wsc.fixed_in_other_words data_files: - split: train path: super_glue_wsc.fixed_in_other_words/train-* - split: validation path: super_glue_wsc.fixed_in_other_words/validation-* - split: test path: super_glue_wsc.fixed_in_other_words/test-* - config_name: super_glue_wsc.fixed_in_other_words_score_eval data_files: - split: train path: super_glue_wsc.fixed_in_other_words_score_eval/train-* - split: validation path: super_glue_wsc.fixed_in_other_words_score_eval/validation-* - split: test path: super_glue_wsc.fixed_in_other_words_score_eval/test-* - config_name: super_glue_wsc.fixed_p_is_are_r data_files: - split: train path: super_glue_wsc.fixed_p_is_are_r/train-* - split: validation path: super_glue_wsc.fixed_p_is_are_r/validation-* - split: test path: super_glue_wsc.fixed_p_is_are_r/test-* - config_name: super_glue_wsc.fixed_p_is_are_r_score_eval data_files: - split: train path: super_glue_wsc.fixed_p_is_are_r_score_eval/train-* - split: validation path: super_glue_wsc.fixed_p_is_are_r_score_eval/validation-* - split: test path: super_glue_wsc.fixed_p_is_are_r_score_eval/test-* - config_name: super_glue_wsc.fixed_replaced_with data_files: - split: train path: super_glue_wsc.fixed_replaced_with/train-* - split: validation path: super_glue_wsc.fixed_replaced_with/validation-* - split: test path: super_glue_wsc.fixed_replaced_with/test-* - config_name: super_glue_wsc.fixed_replaced_with_score_eval data_files: - split: train path: super_glue_wsc.fixed_replaced_with_score_eval/train-* - split: validation path: super_glue_wsc.fixed_replaced_with_score_eval/validation-* - split: test path: super_glue_wsc.fixed_replaced_with_score_eval/test-* - config_name: super_glue_wsc.fixed_the_pronoun_refers_to data_files: - split: train path: super_glue_wsc.fixed_the_pronoun_refers_to/train-* - split: validation path: super_glue_wsc.fixed_the_pronoun_refers_to/validation-* - split: test path: super_glue_wsc.fixed_the_pronoun_refers_to/test-* - config_name: super_glue_wsc.fixed_the_pronoun_refers_to_score_eval data_files: - split: train path: super_glue_wsc.fixed_the_pronoun_refers_to_score_eval/train-* - split: validation path: super_glue_wsc.fixed_the_pronoun_refers_to_score_eval/validation-* - split: test path: super_glue_wsc.fixed_the_pronoun_refers_to_score_eval/test-* - config_name: trec_fine_grained_ABBR data_files: - split: train path: trec_fine_grained_ABBR/train-* - split: test path: trec_fine_grained_ABBR/test-* - config_name: trec_fine_grained_ABBR_context_first data_files: - split: train path: trec_fine_grained_ABBR_context_first/train-* - split: test path: trec_fine_grained_ABBR_context_first/test-* - config_name: trec_fine_grained_DESC data_files: - split: train path: trec_fine_grained_DESC/train-* - split: test path: trec_fine_grained_DESC/test-* - config_name: trec_fine_grained_DESC_context_first data_files: - split: train path: trec_fine_grained_DESC_context_first/train-* - split: test path: trec_fine_grained_DESC_context_first/test-* - config_name: trec_fine_grained_ENTY data_files: - split: train path: trec_fine_grained_ENTY/train-* - split: test path: trec_fine_grained_ENTY/test-* - config_name: trec_fine_grained_HUM data_files: - split: train path: trec_fine_grained_HUM/train-* - split: test path: trec_fine_grained_HUM/test-* - config_name: trec_fine_grained_HUM_context_first data_files: - split: train path: trec_fine_grained_HUM_context_first/train-* - split: test path: trec_fine_grained_HUM_context_first/test-* - config_name: trec_fine_grained_LOC data_files: - split: train path: trec_fine_grained_LOC/train-* - split: test path: trec_fine_grained_LOC/test-* - config_name: trec_fine_grained_LOC_context_first data_files: - split: train path: trec_fine_grained_LOC_context_first/train-* - split: test path: trec_fine_grained_LOC_context_first/test-* - config_name: trec_fine_grained_NUM data_files: - split: train path: trec_fine_grained_NUM/train-* - split: test path: trec_fine_grained_NUM/test-* - config_name: trec_fine_grained_NUM_context_first data_files: - split: train path: trec_fine_grained_NUM_context_first/train-* - split: test path: trec_fine_grained_NUM_context_first/test-* - config_name: trec_fine_grained_open data_files: - split: train path: trec_fine_grained_open/train-* - split: test path: trec_fine_grained_open/test-* - config_name: trec_fine_grained_open_context_first data_files: - split: train path: trec_fine_grained_open_context_first/train-* - split: test path: trec_fine_grained_open_context_first/test-* - config_name: trec_pick_the_best_descriptor data_files: - split: train path: trec_pick_the_best_descriptor/train-* - split: test path: trec_pick_the_best_descriptor/test-* - config_name: trec_trec1 data_files: - split: train path: trec_trec1/train-* - split: test path: trec_trec1/test-* - config_name: trec_trec2 data_files: - split: train path: trec_trec2/train-* - split: test path: trec_trec2/test-* - config_name: trec_what_category_best_describe data_files: - split: train path: trec_what_category_best_describe/train-* - split: test path: trec_what_category_best_describe/test-* - config_name: trec_which_category_best_describes data_files: - split: train path: trec_which_category_best_describes/train-* - split: test path: trec_which_category_best_describes/test-* - config_name: trivia_qa_unfiltered_first_person_context data_files: - split: train path: trivia_qa_unfiltered_first_person_context/train-* - split: validation path: trivia_qa_unfiltered_first_person_context/validation-* - split: test path: trivia_qa_unfiltered_first_person_context/test-* - config_name: trivia_qa_unfiltered_formal_description data_files: - split: train path: trivia_qa_unfiltered_formal_description/train-* - split: validation path: trivia_qa_unfiltered_formal_description/validation-* - split: test path: trivia_qa_unfiltered_formal_description/test-* - config_name: trivia_qa_unfiltered_guess_question data_files: - split: train path: trivia_qa_unfiltered_guess_question/train-* - split: validation path: trivia_qa_unfiltered_guess_question/validation-* - config_name: trivia_qa_unfiltered_question_answer data_files: - split: train path: trivia_qa_unfiltered_question_answer/train-* - split: validation path: trivia_qa_unfiltered_question_answer/validation-* - split: test path: trivia_qa_unfiltered_question_answer/test-* - config_name: trivia_qa_unfiltered_question_with_instruction data_files: - split: train path: trivia_qa_unfiltered_question_with_instruction/train-* - split: validation path: trivia_qa_unfiltered_question_with_instruction/validation-* - split: test path: trivia_qa_unfiltered_question_with_instruction/test-* - config_name: web_questions_get_the_answer data_files: - split: train path: web_questions_get_the_answer/train-* - split: test path: web_questions_get_the_answer/test-* - config_name: web_questions_potential_correct_answer data_files: - split: train path: web_questions_potential_correct_answer/train-* - split: test path: web_questions_potential_correct_answer/test-* - config_name: web_questions_question_answer data_files: - split: train path: web_questions_question_answer/train-* - split: test path: web_questions_question_answer/test-* - config_name: web_questions_short_general_knowledge_q data_files: - split: train path: web_questions_short_general_knowledge_q/train-* - split: test path: web_questions_short_general_knowledge_q/test-* - config_name: web_questions_whats_the_answer data_files: - split: train path: web_questions_whats_the_answer/train-* - split: test path: web_questions_whats_the_answer/test-* - config_name: wiki_bio_comprehension data_files: - split: train path: wiki_bio_comprehension/train-* - split: test path: wiki_bio_comprehension/test-* - split: val path: wiki_bio_comprehension/val-* - config_name: wiki_bio_guess_person data_files: - split: train path: wiki_bio_guess_person/train-* - split: test path: wiki_bio_guess_person/test-* - split: val path: wiki_bio_guess_person/val-* - config_name: wiki_bio_key_content data_files: - split: train path: wiki_bio_key_content/train-* - split: test path: wiki_bio_key_content/test-* - split: val path: wiki_bio_key_content/val-* - config_name: wiki_bio_what_content data_files: - split: train path: wiki_bio_what_content/train-* - split: test path: wiki_bio_what_content/test-* - split: val path: wiki_bio_what_content/val-* - config_name: wiki_bio_who data_files: - split: train path: wiki_bio_who/train-* - split: test path: wiki_bio_who/test-* - split: val path: wiki_bio_who/val-* - config_name: wiki_hop_original_choose_best_object_affirmative_1 data_files: - split: train path: wiki_hop_original_choose_best_object_affirmative_1/train-* - split: validation path: wiki_hop_original_choose_best_object_affirmative_1/validation-* - config_name: wiki_hop_original_choose_best_object_affirmative_2 data_files: - split: train path: wiki_hop_original_choose_best_object_affirmative_2/train-* - split: validation path: wiki_hop_original_choose_best_object_affirmative_2/validation-* - config_name: wiki_hop_original_choose_best_object_affirmative_3 data_files: - split: train path: wiki_hop_original_choose_best_object_affirmative_3/train-* - split: validation path: wiki_hop_original_choose_best_object_affirmative_3/validation-* - config_name: wiki_hop_original_choose_best_object_interrogative_1 data_files: - split: train path: wiki_hop_original_choose_best_object_interrogative_1/train-* - split: validation path: wiki_hop_original_choose_best_object_interrogative_1/validation-* - config_name: wiki_hop_original_choose_best_object_interrogative_2 data_files: - split: train path: wiki_hop_original_choose_best_object_interrogative_2/train-* - split: validation path: wiki_hop_original_choose_best_object_interrogative_2/validation-* - config_name: wiki_hop_original_explain_relation data_files: - split: train path: wiki_hop_original_explain_relation/train-* - split: validation path: wiki_hop_original_explain_relation/validation-* - config_name: wiki_hop_original_generate_object data_files: - split: train path: wiki_hop_original_generate_object/train-* - split: validation path: wiki_hop_original_generate_object/validation-* - config_name: wiki_hop_original_generate_subject data_files: - split: train path: wiki_hop_original_generate_subject/train-* - split: validation path: wiki_hop_original_generate_subject/validation-* - config_name: wiki_hop_original_generate_subject_and_object data_files: - split: train path: wiki_hop_original_generate_subject_and_object/train-* - split: validation path: wiki_hop_original_generate_subject_and_object/validation-* - config_name: wiki_qa_Decide_good_answer data_files: - split: train path: wiki_qa_Decide_good_answer/train-* - split: validation path: wiki_qa_Decide_good_answer/validation-* - split: test path: wiki_qa_Decide_good_answer/test-* - config_name: wiki_qa_Direct_Answer_to_Question data_files: - split: train path: wiki_qa_Direct_Answer_to_Question/train-* - split: validation path: wiki_qa_Direct_Answer_to_Question/validation-* - split: test path: wiki_qa_Direct_Answer_to_Question/test-* - config_name: wiki_qa_Generate_Question_from_Topic data_files: - split: train path: wiki_qa_Generate_Question_from_Topic/train-* - split: validation path: wiki_qa_Generate_Question_from_Topic/validation-* - split: test path: wiki_qa_Generate_Question_from_Topic/test-* - config_name: wiki_qa_Is_This_True_ data_files: - split: train path: wiki_qa_Is_This_True_/train-* - split: validation path: wiki_qa_Is_This_True_/validation-* - split: test path: wiki_qa_Is_This_True_/test-* - config_name: wiki_qa_Jeopardy_style data_files: - split: train path: wiki_qa_Jeopardy_style/train-* - split: validation path: wiki_qa_Jeopardy_style/validation-* - split: test path: wiki_qa_Jeopardy_style/test-* - config_name: wiki_qa_Topic_Prediction_Answer_Only data_files: - split: train path: wiki_qa_Topic_Prediction_Answer_Only/train-* - split: validation path: wiki_qa_Topic_Prediction_Answer_Only/validation-* - split: test path: wiki_qa_Topic_Prediction_Answer_Only/test-* - config_name: wiki_qa_Topic_Prediction_Question_Only data_files: - split: train path: wiki_qa_Topic_Prediction_Question_Only/train-* - split: validation path: wiki_qa_Topic_Prediction_Question_Only/validation-* - split: test path: wiki_qa_Topic_Prediction_Question_Only/test-* - config_name: wiki_qa_Topic_Prediction_Question_and_Answer_Pair data_files: - split: train path: wiki_qa_Topic_Prediction_Question_and_Answer_Pair/train-* - split: validation path: wiki_qa_Topic_Prediction_Question_and_Answer_Pair/validation-* - split: test path: wiki_qa_Topic_Prediction_Question_and_Answer_Pair/test-* - config_name: wiki_qa_automatic_system data_files: - split: train path: wiki_qa_automatic_system/train-* - split: validation path: wiki_qa_automatic_system/validation-* - split: test path: wiki_qa_automatic_system/test-* - config_name: wiki_qa_exercise data_files: - split: train path: wiki_qa_exercise/train-* - split: validation path: wiki_qa_exercise/validation-* - split: test path: wiki_qa_exercise/test-* - config_name: wiki_qa_found_on_google data_files: - split: train path: wiki_qa_found_on_google/train-* - split: validation path: wiki_qa_found_on_google/validation-* - split: test path: wiki_qa_found_on_google/test-* - config_name: winogrande_winogrande_debiased_Replace data_files: - split: train path: winogrande_winogrande_debiased_Replace/train-* - split: validation path: winogrande_winogrande_debiased_Replace/validation-* - split: test path: winogrande_winogrande_debiased_Replace/test-* - config_name: winogrande_winogrande_debiased_Replace_score_eval data_files: - split: train path: winogrande_winogrande_debiased_Replace_score_eval/train-* - split: validation path: winogrande_winogrande_debiased_Replace_score_eval/validation-* - split: test path: winogrande_winogrande_debiased_Replace_score_eval/test-* - config_name: winogrande_winogrande_debiased_does_underscore_refer_to data_files: - split: train path: winogrande_winogrande_debiased_does_underscore_refer_to/train-* - split: validation path: winogrande_winogrande_debiased_does_underscore_refer_to/validation-* - split: test path: winogrande_winogrande_debiased_does_underscore_refer_to/test-* - config_name: winogrande_winogrande_debiased_does_underscore_refer_to_score_eval data_files: - split: train path: winogrande_winogrande_debiased_does_underscore_refer_to_score_eval/train-* - split: validation path: winogrande_winogrande_debiased_does_underscore_refer_to_score_eval/validation-* - split: test path: winogrande_winogrande_debiased_does_underscore_refer_to_score_eval/test-* - config_name: winogrande_winogrande_debiased_fill_in_the_blank data_files: - split: train path: winogrande_winogrande_debiased_fill_in_the_blank/train-* - split: validation path: winogrande_winogrande_debiased_fill_in_the_blank/validation-* - split: test path: winogrande_winogrande_debiased_fill_in_the_blank/test-* - config_name: winogrande_winogrande_debiased_fill_in_the_blank_score_eval data_files: - split: train path: winogrande_winogrande_debiased_fill_in_the_blank_score_eval/train-* - split: validation path: winogrande_winogrande_debiased_fill_in_the_blank_score_eval/validation-* - split: test path: winogrande_winogrande_debiased_fill_in_the_blank_score_eval/test-* - config_name: winogrande_winogrande_debiased_stand_for data_files: - split: train path: winogrande_winogrande_debiased_stand_for/train-* - split: validation path: winogrande_winogrande_debiased_stand_for/validation-* - split: test path: winogrande_winogrande_debiased_stand_for/test-* - config_name: winogrande_winogrande_debiased_stand_for_score_eval data_files: - split: train path: winogrande_winogrande_debiased_stand_for_score_eval/train-* - split: validation path: winogrande_winogrande_debiased_stand_for_score_eval/validation-* - split: test path: winogrande_winogrande_debiased_stand_for_score_eval/test-* - config_name: winogrande_winogrande_debiased_underscore_refer_to data_files: - split: train path: winogrande_winogrande_debiased_underscore_refer_to/train-* - split: validation path: winogrande_winogrande_debiased_underscore_refer_to/validation-* - split: test path: winogrande_winogrande_debiased_underscore_refer_to/test-* - config_name: winogrande_winogrande_debiased_underscore_refer_to_score_eval data_files: - split: train path: winogrande_winogrande_debiased_underscore_refer_to_score_eval/train-* - split: validation path: winogrande_winogrande_debiased_underscore_refer_to_score_eval/validation-* - split: test path: winogrande_winogrande_debiased_underscore_refer_to_score_eval/test-* - config_name: winogrande_winogrande_xl_Replace data_files: - split: train path: winogrande_winogrande_xl_Replace/train-* - split: validation path: winogrande_winogrande_xl_Replace/validation-* - split: test path: winogrande_winogrande_xl_Replace/test-* - config_name: winogrande_winogrande_xl_Replace_score_eval data_files: - split: train path: winogrande_winogrande_xl_Replace_score_eval/train-* - split: validation path: winogrande_winogrande_xl_Replace_score_eval/validation-* - split: test path: winogrande_winogrande_xl_Replace_score_eval/test-* - config_name: winogrande_winogrande_xl_does_underscore_refer_to data_files: - split: train path: winogrande_winogrande_xl_does_underscore_refer_to/train-* - split: validation path: winogrande_winogrande_xl_does_underscore_refer_to/validation-* - split: test path: winogrande_winogrande_xl_does_underscore_refer_to/test-* - config_name: winogrande_winogrande_xl_does_underscore_refer_to_score_eval data_files: - split: train path: winogrande_winogrande_xl_does_underscore_refer_to_score_eval/train-* - split: validation path: winogrande_winogrande_xl_does_underscore_refer_to_score_eval/validation-* - split: test path: winogrande_winogrande_xl_does_underscore_refer_to_score_eval/test-* - config_name: winogrande_winogrande_xl_fill_in_the_blank data_files: - split: train path: winogrande_winogrande_xl_fill_in_the_blank/train-* - split: validation path: winogrande_winogrande_xl_fill_in_the_blank/validation-* - split: test path: winogrande_winogrande_xl_fill_in_the_blank/test-* - config_name: winogrande_winogrande_xl_fill_in_the_blank_score_eval data_files: - split: train path: winogrande_winogrande_xl_fill_in_the_blank_score_eval/train-* - split: validation path: winogrande_winogrande_xl_fill_in_the_blank_score_eval/validation-* - split: test path: winogrande_winogrande_xl_fill_in_the_blank_score_eval/test-* - config_name: winogrande_winogrande_xl_stand_for data_files: - split: train path: winogrande_winogrande_xl_stand_for/train-* - split: validation path: winogrande_winogrande_xl_stand_for/validation-* - split: test path: winogrande_winogrande_xl_stand_for/test-* - config_name: winogrande_winogrande_xl_stand_for_score_eval data_files: - split: train path: winogrande_winogrande_xl_stand_for_score_eval/train-* - split: validation path: winogrande_winogrande_xl_stand_for_score_eval/validation-* - split: test path: winogrande_winogrande_xl_stand_for_score_eval/test-* - config_name: winogrande_winogrande_xl_underscore_refer_to data_files: - split: train path: winogrande_winogrande_xl_underscore_refer_to/train-* - split: validation path: winogrande_winogrande_xl_underscore_refer_to/validation-* - split: test path: winogrande_winogrande_xl_underscore_refer_to/test-* - config_name: winogrande_winogrande_xl_underscore_refer_to_score_eval data_files: - split: train path: winogrande_winogrande_xl_underscore_refer_to_score_eval/train-* - split: validation path: winogrande_winogrande_xl_underscore_refer_to_score_eval/validation-* - split: test path: winogrande_winogrande_xl_underscore_refer_to_score_eval/test-* - config_name: wiqa_does_the_supposed_perturbation_have_an_effect data_files: - split: train path: wiqa_does_the_supposed_perturbation_have_an_effect/train-* - split: validation path: wiqa_does_the_supposed_perturbation_have_an_effect/validation-* - split: test path: wiqa_does_the_supposed_perturbation_have_an_effect/test-* - config_name: wiqa_effect_with_label_answer data_files: - split: train path: wiqa_effect_with_label_answer/train-* - split: validation path: wiqa_effect_with_label_answer/validation-* - split: test path: wiqa_effect_with_label_answer/test-* - config_name: wiqa_effect_with_string_answer data_files: - split: train path: wiqa_effect_with_string_answer/train-* - split: validation path: wiqa_effect_with_string_answer/validation-* - split: test path: wiqa_effect_with_string_answer/test-* - config_name: wiqa_what_is_the_final_step_of_the_following_process data_files: - split: train path: wiqa_what_is_the_final_step_of_the_following_process/train-* - split: validation path: wiqa_what_is_the_final_step_of_the_following_process/validation-* - split: test path: wiqa_what_is_the_final_step_of_the_following_process/test-* - config_name: wiqa_what_is_the_missing_first_step data_files: - split: train path: wiqa_what_is_the_missing_first_step/train-* - split: validation path: wiqa_what_is_the_missing_first_step/validation-* - split: test path: wiqa_what_is_the_missing_first_step/test-* - config_name: wiqa_what_might_be_the_first_step_of_the_process data_files: - split: train path: wiqa_what_might_be_the_first_step_of_the_process/train-* - split: validation path: wiqa_what_might_be_the_first_step_of_the_process/validation-* - split: test path: wiqa_what_might_be_the_first_step_of_the_process/test-* - config_name: wiqa_what_might_be_the_last_step_of_the_process data_files: - split: train path: wiqa_what_might_be_the_last_step_of_the_process/train-* - split: validation path: wiqa_what_might_be_the_last_step_of_the_process/validation-* - split: test path: wiqa_what_might_be_the_last_step_of_the_process/test-* - config_name: wiqa_which_of_the_following_is_the_supposed_perturbation data_files: - split: train path: wiqa_which_of_the_following_is_the_supposed_perturbation/train-* - split: validation path: wiqa_which_of_the_following_is_the_supposed_perturbation/validation-* - split: test path: wiqa_which_of_the_following_is_the_supposed_perturbation/test-* - config_name: xsum_DOC_boils_down_to_simple_idea_that data_files: - split: train path: xsum_DOC_boils_down_to_simple_idea_that/train-* - split: validation path: xsum_DOC_boils_down_to_simple_idea_that/validation-* - split: test path: xsum_DOC_boils_down_to_simple_idea_that/test-* - config_name: xsum_DOC_given_above_write_one_sentence data_files: - split: train path: xsum_DOC_given_above_write_one_sentence/train-* - split: validation path: xsum_DOC_given_above_write_one_sentence/validation-* - split: test path: xsum_DOC_given_above_write_one_sentence/test-* - config_name: xsum_DOC_how_would_you_rephrase_few_words data_files: - split: train path: xsum_DOC_how_would_you_rephrase_few_words/train-* - split: validation path: xsum_DOC_how_would_you_rephrase_few_words/validation-* - split: test path: xsum_DOC_how_would_you_rephrase_few_words/test-* - config_name: xsum_DOC_tldr data_files: - split: train path: xsum_DOC_tldr/train-* - split: validation path: xsum_DOC_tldr/validation-* - split: test path: xsum_DOC_tldr/test-* - config_name: xsum_DOC_write_summary_of_above data_files: - split: train path: xsum_DOC_write_summary_of_above/train-* - split: validation path: xsum_DOC_write_summary_of_above/validation-* - split: test path: xsum_DOC_write_summary_of_above/test-* - config_name: xsum_article_DOC_summary data_files: - split: train path: xsum_article_DOC_summary/train-* - split: validation path: xsum_article_DOC_summary/validation-* - split: test path: xsum_article_DOC_summary/test-* - config_name: xsum_college_roommate_asked_DOC_so_I_recap data_files: - split: train path: xsum_college_roommate_asked_DOC_so_I_recap/train-* - split: validation path: xsum_college_roommate_asked_DOC_so_I_recap/validation-* - split: test path: xsum_college_roommate_asked_DOC_so_I_recap/test-* - config_name: xsum_read_below_DOC_write_abstract data_files: - split: train path: xsum_read_below_DOC_write_abstract/train-* - split: validation path: xsum_read_below_DOC_write_abstract/validation-* - split: test path: xsum_read_below_DOC_write_abstract/test-* - config_name: xsum_summarize_DOC data_files: - split: train path: xsum_summarize_DOC/train-* - split: validation path: xsum_summarize_DOC/validation-* - split: test path: xsum_summarize_DOC/test-* - config_name: xsum_summarize_this_DOC_summary data_files: - split: train path: xsum_summarize_this_DOC_summary/train-* - split: validation path: xsum_summarize_this_DOC_summary/validation-* - split: test path: xsum_summarize_this_DOC_summary/test-* - config_name: yelp_review_full_based_on_that data_files: - split: train path: yelp_review_full_based_on_that/train-* - split: test path: yelp_review_full_based_on_that/test-* - config_name: yelp_review_full_format_rating data_files: - split: train path: yelp_review_full_format_rating/train-* - split: test path: yelp_review_full_format_rating/test-* - config_name: yelp_review_full_format_score data_files: - split: train path: yelp_review_full_format_score/train-* - split: test path: yelp_review_full_format_score/test-* - config_name: yelp_review_full_format_star data_files: - split: train path: yelp_review_full_format_star/train-* - split: test path: yelp_review_full_format_star/test-* - config_name: yelp_review_full_on_a_scale data_files: - split: train path: yelp_review_full_on_a_scale/train-* - split: test path: yelp_review_full_on_a_scale/test-* - config_name: yelp_review_full_so_i_would data_files: - split: train path: yelp_review_full_so_i_would/train-* - split: test path: yelp_review_full_so_i_would/test-* - config_name: yelp_review_full_this_place data_files: - split: train path: yelp_review_full_this_place/train-* - split: test path: yelp_review_full_this_place/test-* --- # Dataset Card for P3 ## Table of Contents - [Table of Contents](#table-of-contents) - [Dataset Description](#dataset-description) - [Dataset Summary](#dataset-summary) - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards) - [Languages](#languages) - [Dataset Structure](#dataset-structure) - [Data Instances](#data-instances) - [Data Fields](#data-fields) - [Data Splits](#data-splits) - [Dataset Creation](#dataset-creation) - [Curation Rationale](#curation-rationale) - [Source Data](#source-data) - [Annotations](#annotations) - [Additional Information](#additional-information) - [Licensing Information](#licensing-information) - [Citation Information](#citation-information) - [Contributions](#contributions) ## Dataset Description - **Homepage:** https://bigscience.huggingface.co/promptsource - **Repository:** https://github.com/bigscience-workshop/promptsource/ - **Paper:** [Multitask Prompted Training Enables Zero-Shot Task Generalization](https://arxiv.org/abs/2110.08207) - **Point of Contact:** [Victor Sanh](mailto:victor@huggingface.co) ### Dataset Summary P3 (Public Pool of Prompts) is a collection of prompted English datasets covering a diverse set of NLP tasks. A prompt is the combination of an input template and a target template. The templates are functions mapping a data example into natural language for the input and target sequences. For example, in the case of an NLI dataset, the data example would include fields for *Premise, Hypothesis, Label*. An input template would be *If {Premise} is true, is it also true that {Hypothesis}?*, whereas a target template can be defined with the label choices *Choices[label]*. Here *Choices* is prompt-specific metadata that consists of the options *yes, maybe, no* corresponding to *label* being entailment (0), neutral (1) or contradiction (2). Prompts are collected using [Promptsource](https://github.com/bigscience-workshop/promptsource), an interface to interactively write prompts on datasets, and collect prompt-specific metadata such as evaluation metrics. As of October 13th, there are 2'000 prompts collected for 270+ data(sub)sets. The collection of prompts of P3 is publicly available on [Promptsource](https://github.com/bigscience-workshop/promptsource). To train [T0*](https://huggingface.co/bigscience/T0pp), we used a subset of the prompts available in Promptsource (see details [here](https://huggingface.co/bigscience/T0pp#training-data)). However, some of the prompts use `random.choice`, a method that selects uniformly at random an option in a list of valid possibilities. For reproducibility purposes, we release the collection of prompted examples used to train T0*. **The data available here are the materialized version of the prompted datasets used in [Multitask Prompted Training Enables Zero-Shot Task Generalization](https://arxiv.org/abs/2110.08207) which represent only a subset of the datasets for which there is at least one prompt in Promptsource.** ### Supported Tasks and Leaderboards The tasks represented in P3 cover a diverse set of NLP tasks including multiple-choice QA, sentiment analysis or natural language inference. We detail the full list of datasets in [Source Data](#source-data). ### Languages The data in P3 are in English (BCP-47 `en`). ## Dataset Structure ### Data Instances An example of "train" looks as follows: ```bash { 'answer_choices': ['safe', 'trolley'], 'inputs': [86, 8, 7142, 666, 6, 405, 8, 3, 834, 1518, 21, 1346, 42, 31682, 58, 37, 3, 929, 9, 3042, 63, 2765, 808, 8, 2045, 6448, 326, 13, 8, 31682, 11, 3, 24052, 135, 16, 8, 1346, 552, 8, 3, 834, 47, 6364, 5], 'inputs_pretokenized': 'In the sentence below, does the _ stand for safe or trolley?\nThe treasury workers took the gold bars off of the trolley and stacked them in the safe until the _ was empty.', 'targets': [31682, 1], 'targets_pretokenized': '\ntrolley' } ``` In the case of rank classification (letting the model select its the prediction the option with the highest log-likelihood), an example looks as follows: ```bash { 'idx': [5, 0], 'inputs': [86, 8, 7142, 666, 6, 405, 8, 3, 834, 1518, 21, 19454, 42, 22227, 58, 19454, 744, 31, 17, 2112, 4553, 17742, 7, 12, 1953, 6, 298, 22227, 966, 373, 405, 5, 3, 834, 19, 72, 952, 12, 619, 16, 3, 9, 17742, 3298, 5], 'inputs_pretokenized': "In the sentence below, does the _ stand for Kyle or Logan?\nKyle doesn't wear leg warmers to bed, while Logan almost always does. _ is more likely to live in a warmer climate.", 'is_correct': True, 'targets': [19454, 1], 'targets_pretokenized': 'Kyle', 'weight': 1.0 } ``` To check all the prompted examples, you can use the [Promptsource hosted tool](http://bigscience.huggingface.co/promptsource) and choose the `Prompted dataset viewer` mode in the left panel. ### Data Fields The data fields are the same among all splits: - `answer_choices`: the choices (in natural language) available to the model - `inputs_pretokenized`: the natural language input fed to the model - `targets_pretokenized`: the natural language target that the model has to generate - `inputs`: the tokenized input with [T5](https://huggingface.co/google/t5-v1_1-base)'s tokenizer - `targets`: the tokenized target with [T5](https://huggingface.co/google/t5-v1_1-base)'s tokenizer - `idx`: identifier of the (example, answer_option_id) in the case of rank classification - `weight`: a weight for the example produced by seqio (always set to 1.0 in practise) - `is_correct`: whether the (example, answer_option_id) is the correct one ### Data Splits The list of data splits and their respective sizes is very long. You'll find the whole list in this [file](https://huggingface.co/datasets/bigscience/P3/blob/main/tasks_splits_and_features.py). ## Dataset Creation ### Curation Rationale The Public Pool of Prompts relies on the Hugging Face Dataset library. Any public dataset in the Datasets library can be prompted. We select the datasets that have at least one subset in English and excluded datasets containing (predominantly) non-natural language examples. We conservatively decided not to prompt datasets that contain potentially harmful content (for instance, datasets built on social media content). However, we sometimes prompt datasets that are purposefully built to measure bias and fairness of trained models, and reserve these prompted datasets (the validation or test sets) for evaluation purposes. ### Source Data Here's the full list of the datasets present in the materialized version of P3: - Multiple-Choice QA - CommonsenseQA - DREAM - QUAIL - QuaRTz - Social IQA - WiQA - Cosmos - QASC - Quarel - SciQ - Wiki Hop - ARC - OpenBookQA - MultiRC - PIQA - RACE - HellaSwag - BoolQ - Extractive QA - Adversarial QA - Quoref - DuoRC - ROPES - SQuAD v2 - ReCoRD - Close-book QA - Hotpot QA - Wiki QA - Trivia QA - Web Questions - Structure-to-text - Common Gen - Wiki Bio - Sentiment - Amazon - App Reviews - IMDB - Rotten Tomatoes - Yelp - Summarization - CNN Daily Mail - Gigaword - MultiNews - SamSum - XSum - Topic Classification - AG News - DBPedia - TREC - Paraphrase Identification - MRPC - PAWS - QQP - Natural Language Inference - ANLI - CB - RTE - Coreference Resolution - WSC - Winogrande - Word Sense disambiguation - WiC - Sentence Completion - COPA - HellaSwag - Story Cloze ### Annotations The prompts available in Promptsource are collected as part of BigScience, one-year long research workshop on large multilingual models and datasets. 36 contributors affiliated with 24 institutions in 8 countries participated to the prompt collection. Contributors are in majority machine learning researchers or machine learning engineers. The main annotation guideline was that prompts needed to be grammatical and understandable by a native English speaker with no prior experience of the tasks. Additionally, prompts that required explicit counting or numerical indexing were removed in favor of natural language variants, e.g., instead of predicting indices of a span to extract (e.g. in extractive question answering), the model was expected to copy the span's text instead. With these minimal constraints, prompt writers were encouraged to use both formal and creative prompts and various orderings of the data. Most of the prompts correspond directly to a version of the original proposed task, although we also allowed prompts that permuted the original task (for instance, generating a document from its summary) or allowed for ambiguous output (for instance, not indicating a list of available choices). The full annotation given to the contributors can be found [here](https://github.com/bigscience-workshop/promptsource/blob/main/CONTRIBUTING.md). *Note to self: the link is currently being updated with the) ## Additional Information ### Licensing Information The dataset is released under Apache 2.0. ### Citation Information ```bibtex @misc{sanh2021multitask, title={Multitask Prompted Training Enables Zero-Shot Task Generalization}, author={Victor Sanh and Albert Webson and Colin Raffel and Stephen H. Bach and Lintang Sutawika and Zaid Alyafeai and Antoine Chaffin and Arnaud Stiegler and Teven Le Scao and Arun Raja and Manan Dey and M Saiful Bari and Canwen Xu and Urmish Thakker and Shanya Sharma Sharma and Eliza Szczechla and Taewoon Kim and Gunjan Chhablani and Nihal Nayak and Debajyoti Datta and Jonathan Chang and Mike Tian-Jian Jiang and Han Wang and Matteo Manica and Sheng Shen and Zheng Xin Yong and Harshit Pandey and Rachel Bawden and Thomas Wang and Trishala Neeraj and Jos Rozen and Abheesht Sharma and Andrea Santilli and Thibault Fevry and Jason Alan Fries and Ryan Teehan and Stella Biderman and Leo Gao and Tali Bers and Thomas Wolf and Alexander M. Rush}, year={2021}, eprint={2110.08207}, archivePrefix={arXiv}, primaryClass={cs.LG} } ``` ### Contributions Thanks to the contributors of [promptsource](https://github.com/bigscience-workshop/promptsource/graphs/contributors) for adding this dataset.
提供机构：
RanGu2025
5,000+
优质数据集
54 个
任务类型
进入经典数据集
关于我们
遇见数据集——让每个数据集都被发现，让每一次遇见都有价值。
数发科官网www.sfktec.com.cn
联系我们
youjian
selectdataset@iotsh.com.cn
商业合作
数据驱动未来，携手共赢发展
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作