FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design
收藏DataCite Commons2025-01-03 更新2025-04-16 收录
下载链接:
https://service.tib.eu/ldmservice/dataset/1fc4f86e-19be-49e1-8a09-b9fffd004254
下载链接
链接失效反馈官方服务:
资源简介:
Six-bit quantization can effectively reduce the size of large language models and preserve the model quality consistently across varied applications.
提供机构:
TIB
创建时间:
2025-01-03



