MAnfaal/TrainedModel
收藏Hugging Face2024-05-07 更新2024-06-12 收录
下载链接：
https://hf-mirror.com/datasets/MAnfaal/TrainedModel
下载链接
链接失效反馈官方服务：
资源简介：
---
license: other
library_name: peft
tags:
- llama-factory
- lora
- generated_from_trainer
base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
model-index:
- name: train_2024-05-05-10-57-50
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# train_2024-05-05-10-57-50
This model is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) on the Reseacrhed_data dataset.
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 2
- eval_batch_size: 8
- seed: 42
- gradient_accumulation_steps: 8
- total_train_batch_size: 16
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: cosine
- num_epochs: 2.0
- mixed_precision_training: Native AMP
### Training results
### Framework versions
- PEFT 0.10.0
- Transformers 4.40.1
- Pytorch 2.2.1+cu121
- Datasets 2.19.0
- Tokenizers 0.19.1
More information needed
提供机构：
MAnfaal
原始信息汇总
数据集概述
基本信息
- 许可证: other
- 库名称: peft
- 标签:
- llama-factory
- lora
- generated_from_trainer
- 基础模型: TinyLlama/TinyLlama-1.1B-Chat-v1.0
模型详情
- 模型名称: train_2024-05-05-10-57-50
- 描述: 该模型是对TinyLlama/TinyLlama-1.1B-Chat-v1.0的微调版本，使用Reseacrhed_data数据集进行训练。
训练参数
- 学习率: 2e-05
- 训练批次大小: 2
- 评估批次大小: 8
- 种子: 42
- 梯度累积步数: 8
- 总训练批次大小: 16
- 优化器: Adam，betas=(0.9,0.999)，epsilon=1e-08
- 学习率调度器类型: cosine
- 训练周期数: 2.0
- 混合精度训练: Native AMP
框架版本
- PEFT: 0.10.0
- Transformers: 4.40.1
- Pytorch: 2.2.1+cu121
- Datasets: 2.19.0
- Tokenizers: 0.19.1
