Tags: #local-inference

Easily run, manage, and interact with open-source large language models locally on your machine.

An open-source AI engine that allows running various AI models (LLMs, vision, voice, image, video) locally on any hardware, including CPU-only, with drop-in API compatibility for commercial services.

A high-performance Go-based proxy for hot-swapping and managing multiple local generative AI models compatible with OpenAI and Anthropic APIs.

A cross-platform C#/.NET library for efficient local inference of large language models (LLMs) like LLaMA and LLAVA.

A locally hosted, open-source alternative to GitHub Copilot, enabling private and customizable AI-powered code generation on your own hardware.