OSS Alternative - Discover Top Open Source Alternatives to Popular Software

simonw/llm

A command-line tool and Python library to interact with various large language models, both remote APIs and local models.

Core Features

Run prompts from the command-line

Store prompts and responses in SQLite

Generate and store embeddings

Support for multiple LLM providers (OpenAI, Anthropic, Gemini, Llama, Ollama)

Interactive chat mode

Quick Start

pip install llm

Detailed Introduction

LLM is a versatile command-line interface and Python library designed to streamline interactions with a wide range of Large Language Models. It provides a unified way to access popular remote APIs such as OpenAI, Anthropic, and Google Gemini, while also supporting self-hosted models through plugins like Ollama. Key capabilities include executing prompts, logging conversations to SQLite, generating embeddings, and extracting structured content. This tool empowers developers and power users to seamlessly integrate LLM functionalities into their workflows, offering an efficient and consistent approach to leveraging AI.