stephantulkens/gooaq-query-mxbai-pooled
收藏资源简介:
Embedpress: mixedbread large on the Gooaq queries dataset 是基于 Gooaq 数据集的查询部分,使用 Mixedbread AI 的 mixedbread-ai/mxbai-embed-large-v1 模型进行嵌入。每个文档都被截断到前 510 个标记(模型的最大长度 -2 个特殊标记),然后进行嵌入,不使用任何指令。由于模型使用 Matryoshka Representation Learning 进行训练,因此这些嵌入可以安全地被截断。这些数据主要用于大规模的知识蒸馏。
Embedpress: mixedbread large on the Gooaq queries dataset is the query portion of the Gooaq dataset, embedded with mixedbread-ai/mxbai-embed-large-v1 from Mixedbread AI. Each document is truncated to the first 510 tokens (the models max length -2 special tokens) and then embedded, without using any instructions. As the model was trained using Matryoshka Representation Learning, these embeddings can safely be truncated. These are mainly useful for large-scale knowledge distillation.



