LMentry
收藏OpenXLab2026-04-18 收录
下载链接:
https://openxlab.org.cn/datasets/OpenDataLab/LMentry
下载链接
链接失效反馈官方服务:
资源简介:
LMentry is specifically designed to providequick and interpretable insights into the capabilities and robustness of large language models. Our experiments reveal a wide variety of
failure cases that, while immediately obviousto humans, pose a considerable challenge forlarge language models, including OpenAI’s latest 175B-parameter instruction-tuned model,
TextDavinci002. LMentry complements contemporary evaluation approaches of large language models, providing a quick, automatic,and easy-to-run “unit test”, without resorting to large benchmark suites of complex tasks.
提供机构:
OpenDataLab
创建时间:
2024-04-30



