Tags: #ai-toolkit
Machine Learning Deployment Toolkit
paddlepaddle
3.7k
PaddlePaddle/FastDeploy
A high-performance inference and deployment toolkit for Large Language Models (LLMs) and Vision-Language Models (VLMs) based on PaddlePaddle.
AI Inference Toolkit
mnn
4.4k
xlite-dev/lite.ai.toolkit
A lightweight C++ toolkit for deploying over 100 diverse AI models with multiple inference engines.