Tags: #on-device-ai

A unified framework for building local, private, and secure enterprise RAG pipelines using small, specialized LLMs optimized for on-device and edge deployment.

LEANN is an innovative vector database enabling fast, accurate, and 100% private RAG on personal devices with 97% storage savings.

A production-ready toolkit enabling developers to integrate private, offline, and fast on-device AI capabilities like LLMs, speech-to-text, and text-to-speech into their applications across various platforms.

An open-source, on-device AI toolkit for real-time, low-latency speech-to-text, intent recognition, and text-to-speech across multiple platforms.

Parlor is an on-device, real-time multimodal AI that enables natural voice and vision conversations, running entirely on your local machine.

A high-performance local inference framework for running frontier multimodal AI models on various devices with minimal energy consumption.