Fredithefish/ShareGPT-Unfiltered-RedPajama-Chat-format

该数据集是通过将alpaca-lora格式的ShareGPT数据集转换为RedPajama-Chat所需的格式而创建的。转换过程中使用了特定的脚本。需要注意的是，数据集中只包含了原始数据集中每段对话的第一个人类和GPT的文本。数据集的格式示例为：{text: <human>: hello
<bot>: Hello! How can I help you today?}。

This dataset was created by converting the ShareGPT dataset in alpaca-lora format to the format required by RedPajama-Chat. A dedicated script was utilized during the conversion process. It should be noted that this dataset only retains the first human and GPT conversation turns from each dialogue in the original dataset. The format example of the dataset is: {"text": "<human>: hello
<bot>: Hello! How can I help you today?"}

原始信息汇总

ShareGPT unfiltered dataset in RedPajama-Chat format

数据集来源与转换

• 原始数据集为The alpaca-lora formatted ShareGPT dataset。
• 通过脚本convert.py转换为RedPajama-Chat所需格式。

数据集内容限制

• 仅包含原始数据集中每个对话的前两个人类和GPT文本。

数据格式示例

json {"text": "<human>: hello <bot>: Hello! How can I help you today?"}