Tags: #pretraining
Large Language Model Training Tool
Hugging Face
6.7k
yangjianxin1/Firefly
Firefly is an open-source toolkit for efficient large language model training, supporting pre-training, instruction fine-tuning, and DPO with methods like LoRA and QLoRA.