Tags: #on-device-inference
On-device AI Inference SDK
python
8.0k
NexaAI/nexa-sdk
A high-performance SDK enabling day-0 local inference of frontier LLMs and VLMs across diverse hardware (NPU, GPU, CPU) and platforms (PC, mobile, IoT) with minimal energy.