OSS Alternative - Discover Top Open Source Alternatives to Popular Software

modelscope/ms-swift

A scalable and lightweight infrastructure for fine-tuning, inference, and deployment of over 1000 large language models (LLMs) and multimodal large language models (MLLMs) using advanced techniques.

Core Features

Supports 600+ text-only LLMs and 400+ multimodal LLMs with Day-0 updates.

Provides full-pipeline support for training, inference, evaluation, quantization, and deployment.

Integrates advanced training methods like PEFT, DPO, GRPO, and distributed parallelism.

Offers extensive memory optimization and multimodal training capabilities.

Compatible with diverse hardware, including GPUs, CPUs, and NPUs.

Quick Start

pip install ms-swift

Detailed Introduction

ms-swift is a comprehensive framework from the ModelScope community designed for the entire lifecycle of large language models and multimodal large models. It enables efficient training, inference, evaluation, quantization, and deployment for a vast array of models, supporting over 1000 different architectures. The framework incorporates cutting-edge training technologies, including various PEFT methods, reinforcement learning algorithms like GRPO, and advanced distributed training techniques. It also features robust memory optimization and multimodal data handling, making it a versatile tool for developing and deploying intelligent AI applications across diverse hardware environments.