Bunny-v1.0-data

# Bunny-v1.0 Dataset Card 📖 [Technical report](https://arxiv.org/abs/2402.11530) | 🤖 [Bunny-v1.0-3B](https://www.modelscope.cn/models/BAAI/Bunny-v1.0-3B) | 🏠 [Code](https://github.com/BAAI-DCAI/Bunny) | 🐰 [Demo](http://bunny.baai.ac.cn) Bunny is a family of lightweight multimodal models. Bunny-v1.0-data is the training dataset for Bunny-v1.0 series, including [Bunny-v1.0-3B](https://www.modelscope.cn/models/BAAI/Bunny-v1.0-3B/summary). ## Pretrain We use a high-quality coreset with less duplicates and more informative samples of LAION-2B built by [this work](https://github.com/BAAI-DCAI/Dataset-Pruning/tree/main/LAION). We randomly sample 2 million image-text pairs from the coreset and convert them to training format. The pretraining data and images can be found in `pretrain` folder. ## Finetune We build Bunny-695K by modifying [SVIT-mix-665K](https://arxiv.org/abs/2307.04087) for finetuning. The finetuning data can be found in `finetune` folder. ## Usage The images are packed into multiple packages. After downloading the images, run the following script to merge them into one: ```shell cat images.tar.gz.part-* > images.tar.gz ``` Then unpack the package with following command: ```shell tar -xvzf images.tar.gz ``` ## License The content of this project itself is licensed under the Apache license 2.0.# Bunny-v1.0 数据集卡片 📖 [技术报告](https://arxiv.org/abs/2402.11530) | 🤖 [Bunny-v1.0-3B](https://www.modelscope.cn/models/BAAI/Bunny-v1.0-3B) | 🏠 [代码](https://github.com/BAAI-DCAI/Bunny) | 🐰 [演示站点](http://bunny.baai.ac.cn) Bunny是一系列轻量级多模态模型。 Bunny-v1.0-data是Bunny-v1.0系列模型的训练数据集，涵盖[Bunny-v1.0-3B](https://www.modelscope.cn/models/BAAI/Bunny-v1.0-3B/summary)。 ## 预训练 我们采用由[此项工作](https://github.com/BAAI-DCAI/Dataset-Pruning/tree/main/LAION)构建的高质量LAION-2B (LAION-2B)核心子集，该子集重复样本更少、信息丰富度更高。我们从该核心子集中随机抽取200万张图像-文本对，并将其转换为训练格式。预训练数据与图像可在`pretrain`文件夹中获取。 ## 微调 我们通过修改[SVIT-mix-665K (SVIT-mix-665K)](https://arxiv.org/abs/2307.04087)构建了Bunny-695K数据集用于微调。微调数据可在`finetune`文件夹中获取。 ## 使用方法 图像被打包为多个分卷压缩包。下载完成后，执行以下脚本将分卷合并为单个压缩包： shell cat images.tar.gz.part-* > images.tar.gz 随后使用以下命令解压该压缩包： shell tar -xvzf images.tar.gz ## 许可协议 本项目内容采用Apache许可证2.0进行授权。

搜集汇总

背景与挑战

背景概述

Bunny-v1.0-data是Bunny-v1.0系列轻量级多模态模型的训练数据集，包含Bunny-v1.0-3B。该数据集由预训练和微调两部分组成，预训练数据源自LAION-2B的高质量核心集，微调数据基于修改的SVIT-mix-665K，总大小为88.87GB，遵循Apache 2.0许可证。