Tags: #qlora
Large Language Model (LLM) Training Framework
6.6k
yangjianxin1/Firefly
Firefly is an open-source, all-in-one tool designed for efficient pre-training, instruction fine-tuning, and DPO of a wide range of mainstream large language models, optimized for resource-constrained environments.
LLM Fine-tuning Framework
3.7k
hiyouga/ChatGLM-Efficient-Tuning
An efficient framework for fine-tuning ChatGLM-6B and ChatGLM2-6B models using PEFT methods, including LoRA, QLoRA, and RLHF, with a Web UI.