Tags: #ml-inference
Distributed AI & Data Serving Platform
Java
6.9k
vespa-engine/vespa
A powerful open-source platform for real-time AI inference, search, and data organization across vectors, tensors, text, and structured data at any scale.
Machine Learning Inference Library
Rust
2.2k
pykeio/ort
A high-performance Rust interface for hardware-accelerated machine learning inference and training with ONNX models, leveraging ONNX Runtime and pure-Rust backends.