OSS Alternative - Discover Top Open Source Alternatives to Popular Software

janhq/cortex.cpp

A local AI API platform for running various AI models (vision, speech, language) on diverse hardware with an OpenAI-compatible API.

Core Features

Local AI API for various models (vision, speech, language, tabular, action)

Multi-engine support (e.g., llama.cpp) and automatic hardware optimization (GPU detection)

OpenAI-compatible API for seamless integration

Command-line interface for model management (pull, run, ps, stop)

Cross-platform installers for Windows, macOS, and Linux

Quick Start

cortex start

Detailed Introduction

Cortex is an open-source local AI API platform designed to run various AI models, including vision, speech, and language, directly on local hardware. It aims to be the 'brain for robots,' offering cloud-optional capabilities. The platform supports multiple AI engines like llama.cpp, features automatic hardware optimization for GPUs (NVIDIA, AMD, Intel), and provides an OpenAI-compatible API for seamless integration into applications. Users can easily install, download, and manage models via a command-line interface, making advanced AI accessible for local development and deployment. Note: This specific repository is archived, with development having moved to menloresearch/llama.cpp.