Tags: #local-ai

Unsloth Studio is a web UI that enables efficient local training and inference of open-source large language models and other AI models with significant VRAM and speed optimizations.

SillyTavern is a locally installed, highly customizable user interface for interacting with various LLM and image generation APIs, empowering power users with extensive control over their AI interactions.

Run open-source large language models locally on your machine with a simple CLI, REST API, and client libraries.

An open-source, privacy-aware personal AI assistant designed for local operation and agentic task execution.

A terminal tool that detects your hardware and recommends optimal LLM models, providing performance benchmarks for local execution.

Operit AI is the first fully-featured AI assistant application for Android, offering powerful tool-calling, local model support, and a built-in Ubuntu 24 environment for advanced automation.

An open-source browser extension that integrates local AI models to provide web browsing assistance through a sidebar and a dedicated web UI.

Shimmy is a Python-free Rust inference server that provides a 100% OpenAI-compatible API for running local Large Language Models (LLMs) with zero dependencies.

A Node.js binding for llama.cpp, enabling local execution of large language models with advanced features like JSON schema enforcement and function calling.

A local AI API platform for running various AI models (vision, speech, language) on diverse hardware with an OpenAI-compatible API.

A Docker Compose template for quickly bootstrapping a self-hosted local AI and low-code development environment with integrated tools like Ollama, Supabase, and n8n.

OpenRecall is an open-source, privacy-first cross-platform alternative to proprietary digital memory solutions, allowing users to capture, search, and revisit their digital history locally.

A 100% local and private AI assistant that autonomously browses the web, writes code, and plans tasks, eliminating cloud dependencies and recurring costs.