Etalon Evaluation Framework
收藏arXiv2025-09-30 收录
下载链接:
https://github.com/project-etalon/etalon
下载链接
链接失效反馈官方服务:
资源简介:
该数据集提供了一个全面的大语言模型推理系统性能评估框架,该框架使用了多种度量标准,包括一个新颖的流畅性指数。此外,该数据集还引入了一种新的度量方法,旨在反映大语言模型推理过程及其对实时用户体验影响的复杂性。该数据集的任务是对大语言模型推理系统的性能进行评估。
This dataset presents a comprehensive performance evaluation framework for large language model (LLM) inference systems, which leverages multiple metrics including a novel fluency index. Furthermore, this dataset introduces a new metric designed to capture the complexity of LLM inference processes and their impact on real-time user experience. The core task of this dataset is to evaluate the performance of LLM inference systems.
提供机构:
Project Etalon



