OSS Alternative - Discover Top Open Source Alternatives to Popular Software

AlexsJones/llmfit

A terminal tool to identify LLM models that optimally run on your specific hardware by analyzing system specs and model characteristics.

Core Features

Automatic hardware detection (RAM, CPU, GPU, VRAM).

Scores models based on quality, speed, fit, and context dimensions.

Interactive TUI (default) and classic CLI modes.

Supports multi-GPU, MoE architectures, dynamic quantization, and local runtimes (Ollama, llama.cpp, MLX, LM Studio).

Advanced configuration for tuning and hardware simulation.

Quick Start

brew install llmfit

Detailed Introduction

llmfit is a powerful terminal utility designed to simplify the process of selecting large language models (LLMs) that are best suited for a user's local hardware. It intelligently detects system specifications, including RAM, CPU, and GPU, then evaluates hundreds of LLM models and providers. By scoring models across various dimensions like quality, speed, and hardware fit, llmfit helps users quickly identify which models will perform optimally on their machine, offering both an interactive TUI and a classic CLI for flexible usage. It also supports advanced features like hardware simulation and dynamic quantization selection.