CLI Tool and Python Library
11.5k 2026-04-04

simonw/llm

A command-line tool and Python library for interacting with various large language models, both remote APIs and local models.

Core Features

Run prompts from the command-line
Store prompts and responses in SQLite
Generate and store embeddings
Extract structured content from text and images
Support for OpenAI, Anthropic, Google Gemini, and local models via plugins

Quick Start

pip install llm

Detailed Introduction

LLM is a powerful command-line interface and Python library designed to streamline interactions with a diverse range of Large Language Models. It acts as a universal client, enabling users to send prompts to popular commercial APIs such as OpenAI, Anthropic's Claude, and Google's Gemini, while also supporting self-hosted models through extensible plugins like `llm-ollama`. Beyond basic text generation, LLM offers robust features including persistent logging of prompts and responses to SQLite, generation and storage of embeddings, structured content extraction, and the ability to grant models tool-execution capabilities, making it an essential toolkit for developers and researchers in the AI domain.

OSS Alternative

Explore the best open source alternatives to commercial software.

© 2026 OSS Alternative. hotgithub.com - All rights reserved.