LLM Starter Pack (Standard)

Mini data pack of pre-cleaned training data designed for training transformer models from scratch. Copyrighted data has been fully removed from the data set, which means that you are able to freely leverage this data to train models from scratch.

Dataset examples:

Dymas In Greek mythology, Dymas (Ancient Greek: Δύμας) is the name attributed to the following individuals: Dymas, a Mariandynian who warned the Argonauts about the cruelty of Amycus, king of the Bebrycians. Both Mariandynians and Bebrycians lived in northwestern Asia Minor. Dymas, a soldier who fought on the side of the Seven Against Thebes. He took part in the foot-race at Opheltes' funeral games in Nemea. Dymas was wounded in battle and killed himself when the enemy started questioning him. Dymas, a Dorian and the ancestor of the Dymanes. His father, Aegimius, adopted Heracles' son, Hyllas. Dymas and his brother, Pamphylus, submitted to Hyllas. Dymas, king of Phrygia and father of Hecuba. Dymas, perhaps the same as the first. According to Quintus Smyrnaeus this Dymas was the father of Meges, a Trojan whose sons fought at Troy. Dymas, an Aulian warrior, who came to fight at Troy under the leadership of Archesilaus. He died at the hands of Aeneas. Dymas, a Trojan soldier who fought with Aeneas and was killed at Troy. Dymas, was mentioned in Homer's Odyssey as a Phaeacian captain, whose daughter was a friend to the princess Nausicaa. References Category:Kings of Phrygia Category:Characters in Greek mythology Category:Dorian mythology

Dataset:
(raw_text, source)

搜集汇总

背景与挑战

背景概述

该数据集是经过版权清理的标准化训练数据包，适用于Transformer模型的从零训练，包含(raw_text, source)格式的多样化文本样本，如希腊神话条目等无版权内容。