Tags: #ai-acceleration
AI Inference Framework
Python
25.7k
sgl-project/sglang
A high-performance serving framework designed to accelerate inference for large language models and multimodal AI models.
A high-performance serving framework designed to accelerate inference for large language models and multimodal AI models.