Ecosystem & Stack: nvidia-gpus

SGLang is a high-performance serving framework for large language models and multimodal models, optimizing inference throughput and latency.

vLLM is a high-throughput and memory-efficient open-source library designed for fast and easy serving of large language models.

An open-source framework designed to make large AI model training and inference cheaper, faster, and more accessible through advanced distributed computing and memory optimization techniques.

VoxCPM2 is a tokenizer-free, 2B-parameter Text-to-Speech system supporting 30 languages, creative voice design, and controllable voice cloning with 48kHz studio-quality audio output.