AlexsJones/llmfit

llmfit is an advanced terminal utility designed to streamline the process of selecting and optimizing Large Language Models (LLMs) for local deployment. It intelligently analyzes your system's hardware specifications, including RAM, CPU, and GPU, then evaluates a vast array of LLM models and providers. The tool scores models across critical dimensions such as quality, speed, hardware compatibility, and context, ensuring users can identify models that will perform optimally on their specific machine. Furthermore, llmfit integrates community-contributed benchmarks, offering invaluable real-world performance data (tok/s, TTFT, VRAM) for diverse hardware configurations, empowering informed decisions before model acquisition or system upgrades.