Tags: #ai-toolkit

A high-performance inference and deployment toolkit for Large Language Models (LLMs) and Vision-Language Models (VLMs) based on PaddlePaddle.

A lightweight C++ toolkit for deploying over 100 diverse AI models with multiple inference engines.