Tags: #low-memory
AI/ML Inference Library
c++
2.1k
vitoplantamura/OnnxStream
A lightweight C++ inference library designed to run large ONNX-based AI models like Stable Diffusion XL and Mistral 7B on resource-constrained devices with minimal memory footprint.