Tags: #hardware-acceleration

A high-performance Rust interface for hardware-accelerated machine learning inference and training with ONNX models, leveraging ONNX Runtime and pure-Rust backends.

AutoRound is an advanced quantization toolkit for Large Language Models (LLMs) and Vision-Language Models (VLMs), enabling high-accuracy, ultra-low-bit inference across diverse hardware.

A local AI API platform designed to run various AI models (vision, speech, language) on local hardware with an OpenAI-compatible API.