jc-detoxio/lmsys-chat-1m

LMSYS-Chat-1M是一个包含一百万个真实世界对话的大型数据集，这些对话涉及25种最先进的语言模型。数据集由210K个独特的IP地址在Vicuna demo和Chatbot Arena网站上从2023年4月至8月收集而成。每个样本包括一个对话ID、模型名称、对话文本、检测到的语言标签和OpenAI审查API标签。数据集还包括了隐私保护措施，如使用OpaquePrompts团队的技术来隐藏对话中的人名。该数据集可用于研究AI安全、内容审查、训练指令跟随模型、改进和评估LLM评估方法、模型选择和请求调度算法等。

LMSYS-Chat-1M is a large-scale dataset containing one million real-world conversations involving 25 state-of-the-art language models. The dataset was collected from 210K unique IP addresses on the Vicuna demo and Chatbot Arena website from April to August 2023. Each sample includes a conversation ID, model name, conversation text, detected language tag, and OpenAI moderation API tag. The dataset also includes privacy protection measures such as using the OpaquePrompts teams technology to redact names in conversations. The dataset can be used for researching AI safety, content moderation, training instruction-following models, improving and evaluating LLM evaluation methods, model selection, and request dispatching algorithms.