jondurbin/gutenberg-dpo-v0.1

---
license: cc-by-4.0
language:
- en
tags:
- dpo
pretty_name: Gutenberg DPO
size_categories:
- n<1K
---

# Gutenberg DPO


## Overview

This is a dataset meant to enhance novel writing capabilities of LLMs, by using public domain books from [Project Gutenberg](https://gutenberg.org/)

## Process

First, the each book is parsed, split into chapters, cleaned up from the original format (remove superfluous newlines, illustration tags, etc.).

Once we have chapters, an LLM is prompted with each chapter to create a synthetic prompt that would result in that chapter being written.
Each chapter has a summary created as well, so that the prompts for each chapter after the also include a summary of the previous chapter to provide additional context.

We then use the synthetic prompt with previous chapter summary to write the chapter with an LLM (llama-2-13b-chat, bagel-7b-v0.1, dolphin-2.2-34b).
The human written text, that is, the original chapter, is used as the "chosen" value, and the LLM written chapter is used as the rejected value.

## Books used

These books were chosen main because they appeared in the popular section on project gutenberg, and they function correctly with the chapterize library.

- Huckleberry Finn
- Treasure Island
- Anna Karenina
- Uncle Tom’s Cabin
- Wuthering Heights
- Madame Bovary
- The Turn of the Screw
- The War of the Worlds
- A Study in Scarlet
- Middlemarch
- Pride and Prejudice
- The Brothers Karamazov
- Through the Looking Glass
- Moby Dick
- Frankenstein
- A Tale of Two Cities

原始信息汇总

Gutenberg DPO 数据集概述

基本信息

• 许可证: cc-by-4.0
• 语言: 英语
• 标签: dpo
• 数据集大小: 小于1K

数据集目的

该数据集旨在通过使用Project Gutenberg的公共领域书籍，增强大型语言模型（LLMs）的小说写作能力。

数据处理流程

1. 解析与清洗: 每本书被解析并分割成章节，去除原始格式中的多余换行和插图标签等。
2. 生成合成提示: 使用LLM对每个章节生成一个合成提示，该提示能够引导LLM写出该章节。
3. 创建章节摘要: 为每个章节创建摘要，以便后续章节的提示中包含前一章节的摘要，提供额外上下文。
4. LLM写作: 使用合成提示和前一章节摘要，通过LLM（如llama-2-13b-chat, bagel-7b-v0.1, dolphin-2.2-34b）撰写章节。
5. 评估: 原始的人类写作章节作为“选择”值，而LLM写作的章节作为“拒绝”值。

使用的书籍

• Huckleberry Finn
• Treasure Island
• Anna Karenina
• Uncle Tom’s Cabin
• Wuthering Heights
• Madame Bovary
• The Turn of the Screw
• The War of the Worlds
• A Study in Scarlet
• Middlemarch
• Pride and Prejudice
• The Brothers Karamazov
• Through the Looking Glass
• Moby Dick
• Frankenstein
• A Tale of Two Cities

这些书籍主要因其出现在Project Gutenberg的流行部分，并且能与chapterize库正确配合而被选中。