AI SDK / On-device AI Toolkit
10.3k 2026-04-13

RunanywhereAI/runanywhere-sdks

A production-ready toolkit enabling developers to integrate private, offline, and fast on-device AI capabilities like LLMs, speech-to-text, and text-to-speech into their applications across various platforms.

Core Features

On-device LLM inference (Llama, Mistral, Qwen, SmolLM)
Whisper-powered Speech-to-Text transcription
Neural Text-to-Speech voice synthesis
Full Voice AI pipeline (STT → LLM → TTS)
Support for Image Generation and Visual Language Models

Quick Start

https://github.com/RunanywhereAI/runanywhere-sdks

Detailed Introduction

RunAnywhere is a comprehensive toolkit designed for developers to embed advanced AI functionalities directly into their applications, ensuring privacy, low latency, and robust offline operation. By leveraging on-device processing, it fundamentally eliminates the need for cloud-based AI services, thereby keeping all sensitive user data local and secure. It offers versatile SDKs for a wide array of platforms including mobile (iOS, Android, React Native, Flutter) and web, empowering developers to seamlessly build intelligent features such as conversational AI, sophisticated voice assistants, and advanced multimedia understanding without compromising user data or relying on external servers.

OSS Alternative

Explore the best open source alternatives to commercial software.

© 2026 OSS Alternative. hotgithub.com - All rights reserved.