Tags: #llm - OSS Alternative - Discover Top Open Source Alternatives to Popular Software

Tags: #llm

LLM Engineering Platform
ClickHouse
26.1k

langfuse/langfuse

An open-source LLM engineering platform providing observability, metrics, evaluations, and prompt management for developing and debugging AI applications.

AI/LLM Development Platform
Docker
139.1k

langgenius/dify

A production-ready platform designed for developing and deploying agentic AI applications and complex workflows.

Local AI Development Platform
python
62.9k

unslothai/unsloth

Unsloth Studio is a web UI that enables efficient local training and inference of open-source large language models and other AI models with significant VRAM and speed optimizations.

AI-powered Financial Analysis System
python
31.2k

ZhuLinsen/daily_stock_analysis

An LLM-driven system for automated daily stock analysis across A/H/US markets, providing decision dashboards and multi-channel notifications at no cost.

AI Agent Platform
Docker
76.6k

lobehub/lobehub

A comprehensive platform for building, deploying, and collaborating with AI agents, designed to enhance productivity and foster human-agent co-evolution.

Replaces:
Details
AI Agent Orchestration Platform
Python
63.7k

bytedance/deer-flow

DeerFlow is an open-source SuperAgent harness designed to research, code, and create by orchestrating sub-agents, memory, and sandboxes with extensible skills for long-horizon tasks.

AI Observability and MLOps Platform
Python
19.1k

comet-ml/opik

An open-source platform for comprehensive tracing, evaluation, and optimization of LLM applications, RAG systems, and agentic workflows.

AI Agent Memory Infrastructure
Node.js
13.9k

MemoriLabs/Memori

Memori provides an LLM-agnostic layer that transforms AI agent execution and conversations into structured, persistent memory for production systems.

AI Application Development Framework
typescript
23.7k

mastra-ai/mastra

A modern TypeScript framework for building, tuning, and scaling reliable AI-powered applications and autonomous agents.

AI Application Development Framework
python
134.8k

langchain-ai/langchain

LangChain is a framework for building robust LLM-powered applications and intelligent agents by chaining together interoperable components and third-party integrations.

Resource Collection & Guide
Node.js
4.1k

libukai/awesome-agent-skills

A comprehensive guide and curated collection of resources for Agent Skills, designed to help users quickly understand, implement, and manage AI agent capabilities.

AI Platform
Docker
29.2k

onyx-dot-app/onyx

An open-source AI platform offering an advanced, feature-rich chat interface compatible with all major LLMs, enabling RAG, web search, and custom agents.

CLI Tool
Node.js
23.8k

yamadashy/repomix

Repomix is a powerful CLI tool that packages entire code repositories into AI-friendly formats, optimized for Large Language Models (LLMs) and other AI tools.

AI Agent Development Framework
python
21.7k

langchain-ai/deepagents

Deep Agents is a batteries-included AI agent harness built with LangChain and LangGraph, offering out-of-the-box capabilities for planning, file system interaction, sub-agent delegation, and intelligent context management to tackle complex agentic tasks efficiently.

AI/LLM Development Framework
Go
10.9k

cloudwego/eino

A Golang framework for building sophisticated LLM and AI applications, inspired by LangChain and Google ADK.

AI Gateway / LLM API Management Platform
Python
44.7k

BerriAI/litellm

A unified open-source AI Gateway and Python SDK to call over 100 LLM APIs in an OpenAI-compatible format, offering features like cost tracking, load balancing, and guardrails.

LLM Development Framework
python
25.0k

deepset-ai/haystack

An open-source AI orchestration framework for building production-ready LLM applications with modular pipelines and agent workflows.

AI/ML Fine-tuning and Deployment Framework
Python
13.9k

modelscope/ms-swift

A scalable and lightweight infrastructure for fine-tuning, inference, and deployment of over 1000 large language models (LLMs) and multimodal large language models (MLLMs) using advanced techniques.

AI Application Development Platform
Docker
27.8k

labring/FastGPT

FastGPT is an LLM-powered platform for building AI agents and complex question-answering systems, offering out-of-the-box data processing, RAG, and visual workflow orchestration.

LLM Evaluation & Red Teaming Tool
Node.js
20.5k

promptfoo/promptfoo

A CLI and library for testing, evaluating, and red-teaming LLM applications to ensure security, reliability, and performance across various models.

AI Development Kit
Node.js
23.8k

vercel/ai

A provider-agnostic TypeScript toolkit for building AI-powered applications and agents with popular UI frameworks and runtimes.

AI Productivity Platform
59.0k

Mintplex-Labs/anything-llm

An all-in-one, privacy-first AI application for chatting with documents and automating workflows using AI agents, designed for easy local deployment.

Replaces:
Details
Machine Learning Library
transformers
21.0k

huggingface/peft

A state-of-the-art library for Parameter-Efficient Fine-Tuning (PEFT) of large pretrained models, drastically reducing computational and storage costs.

Conversational AI Framework
python
12.0k

Chainlit/chainlit

A Python framework for rapidly building and deploying production-ready conversational AI applications.

AI Development Tool
Node.js
53.9k

upstash/context7

Context7 provides up-to-date, version-specific code documentation directly to LLMs and AI code editors, eliminating outdated examples and hallucinations for more accurate code generation.

LLM Inference and Serving Engine
python
78.1k

vllm-project/vllm

vLLM is a high-throughput and memory-efficient open-source library designed for fast and easy serving of large language models.

AI Bot Development Platform
python
15.9k

langbot-app/LangBot

A production-grade, open-source platform for building and deploying AI-powered instant messaging bots across various chat platforms.

AI Knowledge Management Framework
14.0k

Tencent/WeKnora

An LLM-powered framework for deep document understanding, semantic retrieval, and context-aware Q&A, leveraging RAG and advanced reasoning agents for enterprise knowledge management.

AI Prompt Optimization Tool
Docker
27.6k

linshenkx/prompt-optimizer

A powerful AI prompt optimization tool that enhances AI output quality through intelligent, multi-model, and multi-platform prompt refinement.

AI Agent Platform & Development Framework
Python
31.7k

AstrBotDevs/AstrBot

AstrBot is an open-source, all-in-one AI agent chatbot platform and development framework that integrates with various instant messaging apps and LLMs, offering scalable conversational AI infrastructure.

AI Gateway
go
3.4k

looplj/axonhub

AxonHub is an open-source AI gateway that enables seamless integration with over 100 LLMs using any SDK, featuring built-in failover, load balancing, cost control, and end-to-end tracing.

Generative UI Framework
Node.js
3.7k

thesysdev/openui

An open standard and full-stack framework for building token-efficient, streaming-first generative UIs using a compact language and React runtime.

AI Agent Infrastructure Samples
python
2.5k

awslabs/amazon-bedrock-agentcore-samples

Amazon Bedrock AgentCore provides a framework-agnostic and model-agnostic infrastructure for securely deploying and operating advanced AI agents at scale, with this repository offering practical samples and tutorials.

RAG Engine
Docker
79.0k

infiniflow/ragflow

An open-source Retrieval-Augmented Generation (RAG) engine that integrates RAG with Agent capabilities to provide a superior context layer for Large Language Models (LLMs).

AI Memory Operating System
python
8.7k

MemTensor/MemOS

MemOS is an AI memory operating system designed for LLMs and AI agents, providing persistent, context-aware, and multi-modal memory for enhanced skill reuse and evolution across tasks.

Gen AI Agent Development Framework
Python
2.2k

datapizza-labs/datapizza-ai

A Python framework for building reliable, predictable, and observable Generative AI agents with minimal overhead.

Conversational AI Agent
python
4.7k

Mai-with-u/MaiBot

MaiBot is an LLM-based intelligent agent designed to be a human-like digital companion, prioritizing warmth, authenticity, and genuine connection over perfection or efficiency.

AI Agent Development Framework
jvm
3.4k

embabel/embabel-agent

A JVM-based framework for building intelligent agents that dynamically combine LLM interactions with custom code and domain models to achieve complex goals.

AI Multi-Agent Framework
Python
16.9k

camel-ai/camel

A multi-agent framework for studying emergent behaviors and scaling laws in AI systems through simulation and interaction.

AI Engineering Platform
Python
25.8k

mlflow/mlflow

An open-source AI engineering platform for debugging, evaluating, monitoring, and optimizing production-quality AI applications, including agents, LLMs, and ML models.

AI-powered Web Automation Platform
python
21.4k

Skyvern-AI/skyvern

Automates complex browser-based workflows using LLMs and computer vision, providing a resilient and adaptive solution for web interaction.

AI/ML Fine-tuning Framework
Python
70.8k

hiyouga/LlamaFactory

A unified and efficient framework for fine-tuning over 100 large language models (LLMs) and vision-language models (VLMs) with both CLI and Web UI.

Desktop AI Application
Node.js
42.2k

janhq/jan

Jan is an open-source, privacy-focused desktop application that allows users to run large language models (LLMs) locally and offline, serving as a powerful alternative to cloud-based AI services like ChatGPT.

Replaces:
Details
AI Agent Platform
Docker
20.8k

1Panel-dev/MaxKB

An open-source platform for building enterprise-grade AI agents, integrating RAG, robust workflows, and multi-modal capabilities to enhance smart Q&A and automate complex business scenarios.

Data Processing Library
python
14.6k

Unstructured-IO/unstructured

An open-source ETL solution for transforming complex documents into clean, structured data formats, optimized for language models.

Retrieval-Augmented Generation (RAG) Framework
Python
34.3k

HKUDS/LightRAG

LightRAG is a simple and fast framework for Retrieval-Augmented Generation, designed to enhance LLM performance with external knowledge.

Deep Learning Inference Engine
15.0k

alibaba/MNN

MNN is a blazing-fast, lightweight deep learning inference engine optimized for high-performance on-device AI and Large Language Models.

AI/ML Framework for Document Processing
python
48.9k

run-llama/llama_index

LlamaIndex is an open-source framework designed to build intelligent agentic applications by connecting Large Language Models (LLMs) with private or custom data sources, focusing on document understanding and OCR.

Local AI Model Server
Docker
170.0k

ollama/ollama

Run open-source large language models locally on your machine with a simple CLI, REST API, and client libraries.

AI Agent Framework
3.4k

aiming-lab/MetaClaw

An AI agent framework that enables continuous learning and evolution from live conversations, requiring no GPU for deployment.

AI Agent Development Framework
jdk
2.7k

agentscope-ai/agentscope-java

An agent-oriented programming framework for Java, enabling developers to build production-ready LLM-powered applications with intelligent agents, ReAct reasoning, and robust control mechanisms.

AI Agent Memory Layer
Docker
3.5k

MemMachine/MemMachine

An open-source, universal memory layer for AI agents, enabling persistent state management, learning, and recall across sessions for LLM-powered applications.

Neovim Plugin
neovim
6.5k

olimorris/codecompanion.nvim

Integrates Large Language Models (LLMs) and AI coding agents directly into Neovim for an enhanced, AI-powered development workflow.

AI-powered Knowledge Management System
docker
34.2k

khoj-ai/khoj

A self-hostable AI second brain that integrates with local/online LLMs to provide answers from your documents and the web, build custom agents, and automate research.

AI Framework
Python
57.3k

microsoft/autogen

A programming framework for building multi-agent AI applications that can operate autonomously or collaboratively with humans.

Generative Business Intelligence (GenBI) Agent
15.1k

Canner/WrenAI

Wren AI is an open-source GenBI agent that transforms natural language questions into accurate SQL, charts, and BI insights, powered by a semantic layer for data governance and trustworthiness.

LLM Fine-tuning Framework
11.8k

axolotl-ai-cloud/axolotl

A free and open-source framework designed for efficient fine-tuning of large language models.

Data Collection / Research Resource
14.5k

jujumilk3/leaked-system-prompts

A curated repository of leaked system prompts from various large language model (LLM) services, valuable for research and understanding LLM behavior.

Autonomous AI Agent for Creative Writing
Node.js
5.0k

Narcooo/inkos

An autonomous AI agent designed for novel writing, capable of generating, auditing, and revising stories across diverse genres, with human oversight.

AI Agent Platform & Desktop Application
Ollama
5.7k

ThinkInAIXYZ/deepchat

DeepChat is an open-source desktop AI agent platform that unifies multiple LLMs, tools, and agents, providing a seamless experience for both cloud and local AI models.

Replaces:
Details
AI Agent Memory Layer
Python
53.9k

mem0ai/mem0

Mem0 provides a universal, intelligent memory layer for AI agents, enabling personalized and context-rich interactions across various applications.

AI Retrieval Framework
Python
26.0k

VectifyAI/PageIndex

PageIndex is a vectorless, reasoning-based RAG system that builds hierarchical tree indexes for human-like, context-aware document retrieval, outperforming traditional vector-based methods.

AI Agent Development Platform
Node.js
14.7k

botpress/botpress

Botpress is an open-source platform designed for rapidly building, deploying, and managing next-generation AI chatbots and intelligent agents powered by large language models (LLMs) like OpenAI.

AI-Powered CLI Coding Assistant
LLM APIs
23.6k

charmbracelet/crush

A terminal-based agentic coding assistant that integrates with various LLMs and developer tools to streamline coding workflows.

LLM Chat Interface / Web Application
Node.js
10.7k

huggingface/chat-ui

An open-source SvelteKit web application providing a customizable chat interface for OpenAI-compatible Large Language Models, powering HuggingChat.

Replaces:
Details
AI Search Engine
Docker
33.9k

ItzCrazyKns/Vane

A privacy-focused, self-hosted AI answering engine that integrates local and cloud LLMs to deliver accurate, cited answers from diverse sources.

CLI Tool for LLM Hardware Optimization
rust
24.9k

AlexsJones/llmfit

A terminal tool that detects your hardware and recommends optimal LLM models, providing performance benchmarks for local execution.

AI Model Inference Serving Platform
Python
9.3k

xorbitsai/inference

A unified, production-ready inference API for deploying and serving open-source language, speech, and multimodal AI models on various infrastructures.

AI/ML Training Engine
python
5.1k

InternLM/xtuner

A next-generation training engine optimized for ultra-large Mixture-of-Experts (MoE) models, offering superior efficiency and scalability.

Educational Resource
Python
43.1k

datawhalechina/hello-agents

A comprehensive tutorial guiding users from foundational theories to practical implementation of AI-native intelligent agent systems.

AI/MLOps Platform
python
11.0k

wandb/wandb

An AI developer platform for tracking, visualizing, and managing machine learning models from experimentation to production.

AI/ML Framework, RAG Development Kit
python
14.9k

llmware-ai/llmware

A unified Python framework for building local, private, and secure enterprise RAG pipelines using small, specialized LLMs and a comprehensive model catalog.

AI-Powered Diagramming Web Application
Next.js
27.7k

DayuanJiang/next-ai-draw-io

A Next.js web application that integrates AI capabilities with draw.io diagrams, enabling creation, modification, and enhancement through natural language commands.

AI Inference Platform
Docker
46.1k

mudler/LocalAI

An open-source AI engine enabling local execution of various AI models (LLMs, vision, voice, image, video) on diverse hardware, including CPU-only setups.

Educational Code Repository
python
91.8k

rasbt/LLMs-from-scratch

An educational project providing step-by-step code to build a ChatGPT-like Large Language Model (LLM) from scratch using PyTorch.

AI Agent Interaction Control Framework
Python
18.0k

emcie-co/parlant

A production-ready framework for building controlled, consistent, and predictable customer-facing AI agent interactions with LLMs, optimized for context engineering.

Replaces:
Details
Machine Learning Compiler and LLM Deployment Engine
22.5k

mlc-ai/mlc-llm

A universal machine learning compiler and high-performance deployment engine for large language models, enabling native execution across diverse platforms.

AI/ML Embedding and Retrieval Toolkit
Hugging Face
11.6k

FlagOpen/FlagEmbedding

FlagEmbedding (BGE) is a comprehensive toolkit offering state-of-the-art embedding models for efficient search, Retrieval-Augmented Generation (RAG), and various multimodal AI applications.

AI Agent Memory Layer
Python
3.3k

memodb-io/Acontext

Acontext is an open-source skill memory layer for AI agents that automatically captures learnings from agent runs and stores them as readable, editable, and shareable skill files.

AI Agent Framework
docker
4.4k

icip-cas/PPTAgent

An agentic framework leveraging AI to autonomously generate and refine professional PowerPoint presentations with deep research integration and visual design capabilities.

AI Agent Framework & Developer Tool
Node.js
3.6k

campfirein/cipher

An open-source memory layer for AI coding agents, enhancing context, collaboration, and seamless integration across various IDEs and LLMs.

AI/ML Framework
32.5k

microsoft/graphrag

A modular graph-based Retrieval-Augmented Generation (RAG) system designed to extract structured data from unstructured text using LLMs to enhance reasoning on private data.

Enterprise AI Application Development Framework
Docker
5.2k

ageerle/ruoyi-ai

An enterprise-grade, all-in-one AI application development framework supporting multi-vendor LLM integration, secure knowledge bases, visual workflow orchestration, and intelligent agent deployment.

AI-Powered Web Automation Library
javascript
17.4k

alibaba/page-agent

An in-page JavaScript GUI agent that enables natural language control over web interfaces, streamlining complex workflows and enhancing web accessibility.

AI-powered Video Content Automation Tool
docker
8.9k

linyqh/NarratoAI

Leveraging AI models for one-click video commentary and editing, enabling efficient content creation.

Mobile Automation Protocol Server
Node.js
4.8k

mobile-next/mobile-mcp

A platform-agnostic Model Context Protocol (MCP) server enabling scalable mobile automation and development across iOS and Android devices, emulators, and simulators.

AI Agent Orchestration Framework
30.4k

langchain-ai/langgraph

A low-level orchestration framework for building, managing, and deploying resilient, stateful AI agents using a graph-based approach.

AI Model Utility
pytorch
20.5k

p-e-w/heretic

Heretic is an AI model utility that automatically removes censorship and safety alignment from transformer-based language models without requiring expensive post-training.

AI Customer Service Bot
python
7.3k

shaxiu/XianyuAutoAgent

An AI-powered customer service bot for Xianyu, offering 24/7 automated support, multi-expert decision-making, smart negotiation, and context-aware conversations.

Generative UI SDK
react
11.1k

tambo-ai/tambo

A fullstack React SDK for building AI agents that dynamically render user interfaces based on natural language input.

AI Agent / Data Science Automation Tool
Docker
4.1k

ruc-datalab/DeepAnalyze

DeepAnalyze is an agentic LLM that autonomously performs data science tasks, generating professional analysis reports with a single click.

AI-powered Video Subtitling Tool
python
14.2k

WEIFENG2333/VideoCaptioner

An AI-powered tool for comprehensive video subtitling, offering speech-to-text, intelligent segmentation, LLM-based optimization, translation, and video synthesis.

AI Development Framework
python
3.2k

GiovanniPasq/agentic-rag-for-dummies

A modular framework built with LangGraph for developing advanced Agentic RAG systems, offering both learning materials and an extensible architecture.

AI-driven Local Automation Assistant / Personal Data & Tool Hub
python
3.9k

yuruotong1/autoMate

An AI-driven local automation assistant that acts as a personal data warehouse and tool orchestrator for any LLM, enabling cross-vendor memory, file storage, and real-world actions.

AI Application Resource Collection
10.2k

Arindam200/awesome-ai-apps

A comprehensive collection of over 80 practical examples, tutorials, and recipes for building powerful LLM-powered applications.

AI Personalization Platform
python
17.8k

xming521/WeClone

A comprehensive platform enabling users to create personalized AI twins by fine-tuning Large Language Models with their unique chat history, capturing individual style and bringing digital selves to life.

LLM Application Development Framework
Rust
7.1k

0xPlaygrounds/rig

A Rust library designed for building scalable, modular, and ergonomic applications powered by Large Language Models.

AI-powered Desktop Automation Agent
python
2.8k

TurixAI/TuriX-CUA

TuriX empowers AI models to directly interact with and control your desktop, automating complex tasks across various applications with high accuracy.

AI/ML Financial Trading Framework
Docker
76.3k

TauricResearch/TradingAgents

A multi-agent LLM framework designed to simulate real-world trading firms, enabling collaborative evaluation and informed financial trading decisions.

Educational Platform
6.3k

luhengshiwo/LLMForEverybody

An accessible knowledge sharing platform for Large Language Models (LLMs), designed to help individuals understand complex concepts and excel in LLM-related job interviews.

LLM Development Library
jvm
11.8k

langchain4j/langchain4j

An idiomatic, open-source Java library simplifying the integration of Large Language Models (LLMs) into JVM applications with unified APIs and a comprehensive toolbox.

AI Agent Development Framework
python
7.8k

Upsonic/Upsonic

A Python framework for building autonomous and traditional AI agents, offering robust tools, prebuilt components, and integrated OCR capabilities.

AI-powered Web Scraping Library
Node.js
6.4k

mishushakov/llm-scraper

A TypeScript library that leverages Large Language Models to extract structured data from any webpage.

AI/ML Developer Resource
python
18.3k

meta-llama/llama-cookbook

An official guide and collection of recipes for building applications with the Llama model family, covering inference, fine-tuning, and RAG.

Curated Resource List
9.3k

kyrolabs/awesome-langchain

A comprehensive and curated list of tools, projects, and resources built around the rapidly evolving LangChain framework.

Educational Course
Python
28.2k

huggingface/agents-course

A comprehensive, free online course from Hugging Face designed to teach the fundamentals and advanced techniques of building AI agents.

Low-code AI Application Development Platform
lightllm
3.8k

LazyAGI/LazyLLM

LazyLLM simplifies the creation and iterative optimization of multi-agent large language model (LLM) applications with a low-code approach.

AI-powered Knowledge Graph Builder
Python
4.6k

neo4j-labs/llm-graph-builder

A powerful application that transforms diverse unstructured data sources into structured Neo4j Knowledge Graphs using Large Language Models (LLMs) and LangChain.

AI Agent Observability Platform
python
5.5k

AgentOps-AI/agentops

A Python SDK and platform providing comprehensive observability, monitoring, and evaluation tools for AI agents, from prototype to production.

Technical Guide
Python
6.6k

datawhalechina/all-in-rag

A comprehensive, full-stack guide to Retrieval Augmented Generation (RAG) technology for large language model application development, covering theory, practice, and engineering best practices.

Utility Library / CLI Tool
python
117.1k

microsoft/markitdown

A lightweight Python utility for converting diverse file formats and office documents into structured Markdown, optimized for Large Language Models (LLMs) and text analysis pipelines.

AI Agent Learning and Career Guide
langchain
4.2k

adongwanai/AgentGuide

A comprehensive, job-oriented guide for AI Agent development, covering core technologies, practical projects, and interview preparation for LLM-related roles.

Technical Tutorial Repository
python
27.0k

NirDiamant/RAG_Techniques

A repository showcasing various advanced Retrieval-Augmented Generation (RAG) techniques through detailed notebook tutorials.

LLM Application Development Framework
go
9.2k

tmc/langchaingo

LangChain Go is a powerful framework that simplifies building large language model (LLM) applications in Go, leveraging composability.

LLM Data Framework
Node.js
3.1k

run-llama/LlamaIndexTS

A data framework designed to integrate custom data with large language models in JavaScript/TypeScript environments.

AI Application Platform
Docker
4.4k

ragapp/ragapp

An enterprise-grade platform for easily deploying agentic RAG applications in your own cloud infrastructure, offering an alternative to hosted solutions like OpenAI's custom GPTs.

AI Application / RAG Pipeline Builder
python
6.5k

run-llama/rags

Build and customize RAG pipelines and chatbots over your data using natural language, powered by Streamlit.

AI Research Assistant
Docker
4.4k

LearningCircuit/local-deep-research

An AI-powered research assistant for deep, agentic research, supporting local and cloud LLMs, multiple search sources, and ensuring data privacy with local, encrypted storage.

AI Agent Development Framework
jvm
4.1k

JetBrains/koog

A Kotlin-based multiplatform framework for building predictable, fault-tolerant, and enterprise-ready AI agents with idiomatic JVM/Kotlin APIs.

AI-powered Desktop Financial Tool
Go
5.4k

ArvinLovegood/go-stock

An AI-powered cross-platform desktop application for stock analysis, offering market data, news, financial insights, and stock picking features across multiple global markets.

AI Search Application
Docker
8.8k

miurla/morphic

An AI-powered search engine with a generative UI, offering quick and adaptive search modes, multiple AI and search providers, and robust deployment options.

LLM API Client / SDK
ruby
3.9k

crmne/ruby_llm

A unified Ruby API to interact with various Large Language Models (LLMs) from different providers, simplifying AI integration into Ruby and Rails applications.

LLM Application Development Framework
Node.js
2.6k

ax-llm/ax

Ax is a TypeScript framework that simplifies building reliable AI applications by abstracting prompt engineering and LLM provider complexities, allowing developers to define inputs and outputs.

AI-powered Document Automation Tool
Docker
2.3k

icereed/paperless-gpt

An AI-powered add-on for paperless-ngx that leverages LLMs and advanced OCR to automate document title, tag, correspondent, and custom field generation, streamlining digital document management.

AI Agent Development Kit
python
5.7k

strands-agents/sdk-python

A Python SDK that simplifies the creation and deployment of AI agents using a model-driven approach, supporting diverse LLMs and advanced features.

On-device AI SDK / AI Toolkit
swift
10.3k

RunanywhereAI/runanywhere-sdks

A production-ready toolkit enabling developers to integrate private, offline, and fast on-device AI capabilities like LLMs, speech-to-text, and text-to-speech into their applications across various platforms.

AI Client Application
39.7k

chatboxai/chatbox

A powerful desktop client for various Large Language Models (LLMs) like ChatGPT and Claude, offering a unified interface across multiple platforms.

CLI Tool / AI Code Generator
openai
3.8k

gofireflyio/aiac

A command-line tool and library that generates Infrastructure-as-Code, configurations, and utilities using large language models.

Cognitive Memory Engine for LLMs
Python
4.0k

CaviraOSS/OpenMemory

A self-hosted, local-first cognitive memory engine providing real long-term memory for LLM applications and AI agents, distinct from RAG or vector databases.

LLM Integration Library
php
2.4k

prism-php/prism

A Laravel package providing a fluent interface to integrate and manage Large Language Models (LLMs) from various AI providers.

AI Infrastructure Tool
3.9k

vllm-project/semantic-router

A signal-driven intelligent router designed to optimize, secure, and adapt mixture-of-models for AI infrastructure across cloud, data center, and edge environments.

AI/ML Deployment Toolkit
python
3.7k

PaddlePaddle/FastDeploy

A high-performance inference and deployment toolkit for Large Language Models (LLMs) and Vision-Language Models (VLMs) based on PaddlePaddle.

LLM Inference Optimization Engine
vllm
8.1k

LMCache/LMCache

LMCache is an LLM serving engine extension designed to significantly reduce Time-To-First-Token (TTFT) and boost throughput by intelligently reusing KV caches across various storage tiers and serving instances.

Reinforcement Learning Framework
ray
9.4k

OpenRLHF/OpenRLHF

An easy-to-use, scalable, and high-performance open-source framework for Reinforcement Learning from Human Feedback (RLHF), leveraging Ray and vLLM for distributed training of LLMs and VLMs.

AI-powered Document Processing Platform
Python
5.2k

katanaml/sparrow

A production-ready platform for structured data extraction and instruction calling using ML, LLM, and Vision LLM technologies.

Local AI Model Management Proxy / API Gateway
Docker
3.6k

mostlygeek/llama-swap

llama-swap enables seamless hot-swapping and management of multiple local generative AI models, acting as a unified API gateway compatible with OpenAI and Anthropic standards.

AI Development Framework
5.5k

OpenBMB/UltraRAG

A low-code MCP framework for building complex and innovative RAG pipelines, standardizing components and enabling precise orchestration.

AI-powered Business Intelligence Platform
Python
2.1k

apconw/Aix-DB

Aix-DB is an intelligent data analysis system leveraging large language models and RAG technology to transform natural language queries into data insights and visualizations.

MLOps Platform
Python
5.4k

zenml-io/zenml

An open-source AI platform that unifies ML pipelines and agentic workflows, abstracting infrastructure complexity for ML/AI engineers.

AI System Prompt Data Repository
38.9k

asgeirtj/system_prompts_leaks

A comprehensive collection of extracted system prompts, messages, and developer instructions from leading AI chatbots and coding assistants.

AI Software Engineering Agent
python
3.9k

SWE-agent/mini-swe-agent

A radically simple yet highly performant AI agent for software engineering, capable of solving GitHub issues and assisting in command-line tasks.

LLM Application Framework
python
37.9k

chatchat-space/Langchain-Chatchat

An open-source, offline-deployable RAG and Agent application built with Langchain, supporting various LLMs for private, local knowledge base Q&A.

LLM Caching Library
Python
8.0k

zilliztech/GPTCache

A semantic caching library for LLM queries, designed to drastically cut API costs and accelerate response times.

Autonomous AI Agent Platform
Node.js
36.0k

reworkd/AgentGPT

Assemble, configure, and deploy autonomous AI Agents directly in your browser.

Technical Tutorial
Python
8.9k

liaokongVFX/LangChain-Chinese-Getting-Started-Guide

A comprehensive Chinese-language tutorial for LangChain, guiding developers to build powerful applications powered by large language models.

LLM Development Course
qdrant
3.4k

iusztinpaul/hands-on-llms

A hands-on course to learn LLMs, LLMOps, and vector databases by building, training, and deploying a real-time financial advisor LLM system.

AI Development Platform / Backend as a Service (BaaS)
Docker
5.4k

TaskingAI/TaskingAI

An open-source BaaS platform that unifies hundreds of LLM models and provides comprehensive tools for developing, deploying, and managing AI-native applications and LLM-based agents.

AI Development Library
python
3.8k

shroominic/codeinterpreter-api

An open-source Python library providing a LangChain-compatible implementation of the ChatGPT Code Interpreter for sandboxed code execution.

AI Chatbot Platform
Python
3.0k

rag-web-ui/rag-web-ui

An intelligent dialogue system leveraging RAG technology to build custom Q&A systems from diverse knowledge bases.

Mobile AI Chat Client
React Native
2.4k

Mobile-Artificial-Intelligence/maid

A free and open-source Android application for local and remote interaction with various large language models, offering features like on-device inference and API key integration.

AI/ML Testing and Evaluation Framework
5.3k

Giskard-AI/giskard-oss

An open-source Python library for comprehensive testing, evaluation, and red teaming of LLM agents and AI systems, designed for dynamic, multi-turn interactions.

Technical Guide & Knowledge Base
cloud computing
17.8k

stas00/ml-engineering

An open collection of methodologies, tools, and step-by-step instructions for successful training, fine-tuning, and inference of large language and multi-modal models.

RAG Development Framework
Docker
4.4k

truefoundry/cognita

A production-ready RAG framework that provides modular, API-driven components and a UI to streamline the deployment and management of Retrieval Augmented Generation applications.

AI/ML Development Tool
Python
2.6k

plexe-ai/plexe

Build machine learning models from natural language prompts using an AI-powered multi-agent system.

Educational Resource & LLM Development Framework
Python
4.9k

PacktPublishing/LLM-Engineers-Handbook

A comprehensive practical guide and accompanying code repository for LLM engineers, covering the full lifecycle of building, deploying, and monitoring advanced LLM and RAG applications on AWS with LLMOps best practices.

AI/MLOps Platform
kubernetes
5.0k

tencentmusic/cube-studio

An open-source, cloud-native, all-in-one MLOps platform designed for the full lifecycle management of machine learning, deep learning, and large language model development and deployment.

Deep Learning Library
python
8.2k

bitsandbytes-foundation/bitsandbytes

A PyTorch library enabling accessible large language models through k-bit quantization, significantly reducing memory consumption for both inference and training.

AI/ML Deep Learning Framework
Python
11.7k

ludwig-ai/ludwig

A low-code, declarative framework for building and deploying custom large language models (LLMs) and other deep neural networks with ease and efficiency.

AI Framework for Multi-Agent Systems
python
19.7k

camel-ai/owl

A cutting-edge framework for multi-agent collaboration to automate real-world tasks using AI.

AI Agent Framework
python
12.7k

xszyou/Fay

Fay is an AI agent framework designed to connect digital humans (2.5D, 3D, mobile, PC, web) and large language models (OpenAI compatible, DeepSeek) with various business systems.

Educational Resource Collection
jupyter-notebook
20.0k

AccumulateMore/CV

A comprehensive and curated collection of deep learning study notes, integrating content from leading educators like Andrew Ng, Li Mu, and TuDui, covering CV, NLP, and Large Language Models.

AI Agent Framework / R&D Automation Platform
python
12.6k

microsoft/RD-Agent

Automates data-driven AI R&D processes using AI agents, excelling in machine learning engineering tasks.

AI-powered Video Generation Tool
Python
56.1k

harry0703/MoneyPrinterTurbo

An AI-powered tool that generates high-definition short videos automatically from a given topic or keywords, including script, footage, subtitles, and background music.

AI-Powered Unity Development Tool
Unity
8.8k

CoplayDev/unity-mcp

Empowers AI assistants to directly interact with and automate tasks within the Unity Editor, streamlining game development workflows.

AI-powered Accounting Software
5.3k

vas3k/TaxHacker

A self-hosted AI accounting application that automates expense and income tracking for freelancers and small businesses using LLMs to analyze financial documents.

CLI Tool and Python Library
Python
11.7k

simonw/llm

A command-line tool and Python library to interact with various large language models, both remote APIs and local models.

AI Research Agent
8.1k

MiroMindAI/MiroThinker

An open-source deep research agent designed for complex research and prediction tasks, demonstrating state-of-the-art performance on various AI benchmarks.

Replaces:
Details
AI Agent / Developer Tool
43.6k

aaif-goose/goose

An open source, extensible AI agent that automates complex engineering tasks from start to finish, working locally with any LLM.

LLM Code Context Extraction Tool
Python
14.4k

coderamp-labs/gitingest

Gitingest transforms any Git repository into a structured, prompt-friendly text digest, optimized for large language models to understand codebases efficiently.

AI-powered Web Scraping Library
Python
23.4k

ScrapeGraphAI/Scrapegraph-ai

A Python library that leverages LLMs and graph logic to simplify web scraping and data extraction from various sources.

Personal AI Assistant Platform
python
40.8k

HKUDS/nanobot

An ultra-lightweight, open-source personal AI agent platform designed for efficiency and broad compatibility across various LLM providers and communication channels.

Educational Resource Repository
python
7.4k

NirDiamant/Prompt_Engineering

A comprehensive GitHub repository offering 22 hands-on Jupyter Notebook tutorials on prompt engineering techniques, from basic to advanced, for leveraging large language models.

CLI Productivity Tool
Python
12.0k

TheR1D/shell_gpt

A command-line tool powered by AI large language models to quickly generate shell commands, code snippets, and documentation, significantly boosting developer productivity.

Python Library for Information Extraction
python
36.2k

google/langextract

A Python library leveraging LLMs to extract structured information from unstructured text with precise source grounding and interactive visualization.

AI-Powered Research Application
Node.js
4.6k

u14app/deep-research

An AI-powered web application for generating comprehensive, privacy-focused deep research reports using various LLMs and web search.

AI Agent Framework
Python
10.2k

livekit/agents

A framework for building realtime, programmable voice AI agents that can see, hear, and understand.

Resource Collection
8.2k

WangRongsheng/awesome-LLM-resources

A comprehensive, continuously updated collection of the best resources for Large Language Models (LLMs), covering various aspects from data processing to advanced applications.

AI Inference Engine
WebGPU
17.8k

mlc-ai/web-llm

A high-performance, in-browser LLM inference engine with OpenAI API compatibility, leveraging WebGPU for local, private AI.

AI Agent Plugin
Claude Code
48.3k

JuliusBrussee/caveman

A plugin that dramatically reduces LLM token usage by making AI agents communicate in a concise, 'caveman-like' style, while preserving full technical accuracy.

AI Software Development Tool
Python
33.8k

Pythagora-io/gpt-pilot

GPT Pilot is an AI developer companion designed to build complete, production-ready applications, automating up to 95% of the coding process with human oversight.

Curated Resource List
19.6k

cheahjs/free-llm-api-resources

A comprehensive list of free and trial-based LLM inference resources accessible via API.

AI Memory Library
Python
3.1k

plastic-labs/honcho

An open-source memory library and managed service for building stateful AI agents that learn and adapt over time.

AI Application Development Framework
node.js
5.9k

genkit-ai/genkit

A Google-built open-source framework simplifying the development and deployment of full-stack AI applications across JavaScript, Go, and Python.

AI-powered Knowledge Base Tool
TiDB
2.8k

pingcap/autoflow

An open-source, graph RAG-based conversational knowledge base tool built with TiDB Serverless Vector Storage, offering intelligent search and instant answers.

Context-Aware AI Productivity Assistant
Electron
5.3k

volcengine/MineContext

MineContext is an open-source, proactive context-aware AI partner that enhances productivity by understanding your digital world and delivering timely insights.

AI Application Development Framework
docker
59.9k

pathwaycom/llm-app

A framework providing ready-to-deploy templates for building scalable, high-accuracy RAG and AI enterprise search applications with live data synchronization.

AI Development Tutorial
java
2.2k

liyupi/yu-ai-agent

A comprehensive AI development tutorial using Spring Boot 3 and Spring AI to build AI applications and autonomous agents, enhancing developers' AI skills and career competitiveness.

AI-powered Knowledge Management and Search Platform
Python
7.8k

zilliztech/deep-searcher

DeepSearcher is an open-source platform that leverages LLMs and vector databases to enable deep research, intelligent Q&A, and comprehensive reporting on private enterprise data.

Replaces:
Details
Educational Course / MLOps Tutorial
Python
4.3k

decodingai-magazine/llm-twin-course

A free, hands-on course to build a production-ready LLM & RAG system, including a personalized AI replica, applying LLMOps best practices.

AI/ML Toolkit
langchain
2.5k

athina-ai/rag-cookbooks

A comprehensive repository offering practical implementations and evaluation guidance for advanced and agentic Retrieval-Augmented Generation (RAG) techniques.

AI Data Curation Toolkit
NVIDIA NeMo
1.5k

NVIDIA-NeMo/Curator

A GPU-accelerated, scalable toolkit for multimodal data preprocessing and curation, designed to train better AI models faster.

LLM Training Framework
python
2.2k

AI-Hypercomputer/maxtext

A high-performance, scalable JAX-based open-source library for training large language models on Google Cloud TPUs and GPUs.

MLOps Platform
Python
9.2k

oumi-ai/oumi

An end-to-end platform for fine-tuning, evaluating, and deploying open-source Large Language Models (LLMs) and Vision Language Models (VLMs).

LLM Dataset Generation and Evaluation Platform
14.1k

ConardLi/easy-dataset

Easy Dataset is a powerful application for creating high-quality datasets for LLM fine-tuning, RAG, and model evaluation, featuring intelligent document processing and a comprehensive evaluation system.

AI Development Platform
Docker
4.9k

h2oai/h2o-llmstudio

A no-code GUI and framework for easily fine-tuning state-of-the-art large language models (LLMs).

AI/ML Data Curation Library
python
1.7k

bespokelabsai/curator

A Python library for generating and curating high-quality synthetic data for AI model training and structured data extraction.

AI Software Development Agent
Docker
3.5k

smallcloudai/refact

An open-source AI Agent that automates end-to-end software engineering tasks by integrating with developer tools, planning, executing, and iterating for successful results.

AI Text-to-Speech System
Python
20.8k

FunAudioLLM/CosyVoice

CosyVoice is an advanced multi-lingual large language model-based text-to-speech system offering state-of-the-art voice generation, cloning, and full-stack deployment capabilities.

Technical Book
4.5k

LLMBook-zh/LLMBook-zh.github.io

A comprehensive Chinese technical book on Large Language Models, offering a systematic framework and roadmap for beginners with a deep learning background, authored by leading experts.

LLM Fine-tuning Toolkit
huggingface-transformers
2.9k

ashishpatel26/LLM-Finetuning

A collection of guides and code for efficiently fine-tuning large language models using PEFT (LoRA) and Hugging Face transformers.

LLM Fine-tuning Hub
2.0k

eosphoros-ai/DB-GPT-Hub

A specialized hub providing models, datasets, and fine-tuning techniques to enhance Large Language Models' performance in Text-to-SQL, Text-to-NLU, and Text-to-GQL tasks.

LLM Optimization Toolkit
huggingface
1.1k

ModelCloud/GPTQModel

A toolkit for quantizing (compressing) Large Language Models (LLMs) with hardware acceleration across various GPUs and CPUs, integrating with popular inference frameworks.

Large Language Model (LLM) Training Framework
6.6k

yangjianxin1/Firefly

Firefly is an open-source, all-in-one tool designed for efficient pre-training, instruction fine-tuning, and DPO of a wide range of mainstream large language models, optimized for resource-constrained environments.

Large Language Model Finetuning Solution
Python
3.8k

mymusise/ChatGLM-Tuning

A cost-effective solution for finetuning ChatGLM-6B with LoRA, enabling personalized large language models.

Replaces:
Details
LLM Fine-tuning Framework
3.7k

hiyouga/ChatGLM-Efficient-Tuning

An efficient framework for fine-tuning ChatGLM-6B and ChatGLM2-6B models using PEFT methods, including LoRA, QLoRA, and RLHF, with a Web UI.

AI/ML Research Platform
4.9k

transformerlab/transformerlab-app

An open-source platform designed for AI researchers to unify fragmented ML tooling, enabling seamless training, evaluation, and scaling of models from local hardware to GPU clusters.

Educational Tutorial
linux
30.2k

datawhalechina/self-llm

A comprehensive Linux-based guide for beginners to quickly fine-tune and deploy open-source LLMs and MLLMs, tailored for Chinese learners.

Large Language Model (LLM) Project
python
18.9k

ymcui/Chinese-LLaMA-Alpaca

An open-source project providing Chinese LLaMA and instruction-tuned Alpaca large language models, optimized for Chinese NLP and local deployment on CPU/GPU.

Machine Learning Library
Python
13.5k

microsoft/LoRA

A Python library implementing LoRA (Low-Rank Adaptation) to efficiently fine-tune large language models by significantly reducing trainable parameters and storage requirements.

Open-source Large Language Model Framework
Hugging Face
8.3k

LianjiaTech/BELLE

BELLE is an open-source project dedicated to fostering the development of Chinese conversational large language models, aiming to make LLMs accessible to everyone.

Replaces:
Details
AI Research Project
huggingface
2.7k

JIA-Lab-research/LongLoRA

LongLoRA is an efficient fine-tuning method and associated models/datasets designed to extend the context window of Large Language Models (LLMs) for processing longer inputs.

Large Language Model (LLM)
Python
2.5k

wenge-research/YAYI

YaYi is an open-source Chinese Large Language Model, built on LLaMA 2 & BLOOM, designed for secure, reliable, and domain-specific applications through extensive instruction tuning.

Educational Resource / Technical Textbook
python
1.8k

natolambert/rlhf-book

A comprehensive open-source textbook and code repository dedicated to Reinforcement Learning from Human Feedback (RLHF) and post-training language models.

Reinforcement Learning Framework for AI Agents
gpu
5.2k

Gen-Verse/OpenClaw-RL

An asynchronous reinforcement learning framework enabling personalized AI agent training through natural language conversations and scalable real-world deployments.

AI/ML Data Generation Framework
python
3.2k

argilla-io/distilabel

Distilabel is a framework for generating synthetic data and AI feedback, enabling engineers to build fast, reliable, and scalable AI pipelines based on verified research.

AI/ML Training Framework
python
4.7k

PKU-Alignment/align-anything

A modular framework for aligning any-modality large models with human intentions and values using various fine-tuning and reinforcement learning methods.

AI/ML Research Framework
Hugging Face
1.6k

PKU-Alignment/safe-rlhf

A modular open-source framework for training constrained value-aligned Large Language Models (LLMs) using Safe Reinforcement Learning from Human Feedback (RLHF).

Large Language Model Series
python
7.2k

InternLM/InternLM

A series of high-performance, cost-effective open-source large language models (LLMs) designed for general-purpose usage and advanced reasoning.

Data Labeling and Annotation Platform
Docker
1.2k

xtreme1-io/xtreme1

An all-in-one open-source platform for multimodal data labeling and annotation, supporting 3D LiDAR, image, and LLM training data with AI-fueled tools.

Research Resource & Survey
12.2k

RUCAIBox/LLMSurvey

A comprehensive collection of papers and resources on Large Language Models, based on an authoritative survey paper.

Open-Source Large Language Model & Chatbot Platform
37.4k

LAION-AI/Open-Assistant

An open-source, chat-based large language model project aimed at democratizing access to powerful AI assistants through community-driven data collection.

Replaces:
Details
LLM Alignment Framework
Python
1.4k

OpenLMLab/MOSS-RLHF

An open-source framework providing code, models, and insights for stable Reinforcement Learning from Human Feedback (RLHF) training in Large Language Models, focusing on the PPO algorithm and reward modeling.

Curated Resource Collection
5.8k

promptslab/Awesome-Prompt-Engineering

A comprehensive, hand-curated collection of resources for Prompt Engineering and Context Engineering, specifically for Large Language Models.

Prompt Engineering Resource Hub
7.8k

ai-boost/awesome-prompts

A comprehensive curated collection of prompts, frameworks, and research papers for advanced prompt engineering and LLM interaction.

AI System Prompt Repository
25.8k

elder-plinius/CL4R1T4S

A public repository of leaked and extracted system prompts from major AI models and agents, promoting transparency and observability in AI systems.

LLM Output Structuring Library
python
13.8k

dottxt-ai/outlines

Outlines is a Python library that guarantees structured outputs from Large Language Models (LLMs) during generation, eliminating the need for post-processing and ensuring data validity.

CLI Tool & Context Engineering Platform
Rust
7.3k

mufeedvh/code2prompt

A powerful CLI tool and ecosystem to convert entire codebases into structured, token-counted prompts for Large Language Models.

AI Research & Resource Hub
3.4k

DSXiangLi/DecryptPrompt

A comprehensive open-source project summarizing research papers, models, datasets, and applications in Prompt Engineering, Large Language Models (LLMs), and AIGC.

AI Agent Platform
Python
6.8k

AI4Finance-Foundation/FinRobot

An open-source AI agent platform leveraging large language models for automated financial analysis, investment research, and algorithmic trading.

LLM Orchestration Library / NLP Framework
Python 3.9+
4.6k

promptslab/Promptify

A Python library for structured NLP tasks using LLMs, offering Pydantic outputs, multi-provider support, and built-in evaluation.

AI Inference Optimization Proxy
Python
3.5k

algorithmicsuperintelligence/optillm

OptiLLM is an OpenAI API-compatible inference proxy that uses 20+ state-of-the-art techniques to significantly boost LLM accuracy and performance on reasoning tasks without requiring any training.

Educational Resource & Guide
74.0k

dair-ai/Prompt-Engineering-Guide

A comprehensive, open-source guide and resource hub for prompt engineering, context engineering, RAG, and AI Agents, designed to help developers and researchers master LLM interactions.

CLI Tool / Content Automation
Python
3.4k

SamurAIGPT/AI-Youtube-Shorts-Generator

An AI-powered Python tool that automatically generates engaging YouTube Shorts from long-form videos by identifying viral-worthy moments and vertically cropping them.

AI Utility / Prompt Engineering Tool
python
3.7k

Hunyuan-PromptEnhancer/PromptEnhancer

A prompt rewriting tool that refines user prompts into clearer, structured versions to enhance the quality of text-to-image generation and image-to-image editing.

Speech AI Framework
python
17.2k

NVIDIA-NeMo/NeMo

A scalable generative AI framework for researchers and developers focused on Large Language Models, Multimodal, and Speech AI (ASR, TTS).

AI-powered Video Localization and Dubbing Tool
9.9k

krillinai/KrillinAI

An AI-powered tool for one-click video translation and dubbing across 100 languages, optimized for major social media platforms.

AI/ML Inference Serving Framework
Hugging Face
4.6k

vllm-project/vllm-omni

A framework for efficient, fast, and cheap serving of omni-modality (text, image, video, audio) AI models.

AI/ML Synthetic Data Generation Framework
Python
1.6k

NVIDIA-NeMo/DataDesigner

A flexible framework by NVIDIA NeMo for generating high-quality synthetic datasets with diverse distributions, meaningful correlations, and robust validation.

Deep Learning Library
pytorch
1.9k

kyegomez/BitNet

A PyTorch implementation of BitNet, enabling highly efficient 1-bit transformers for large language models.

AI Model Fine-tuning Framework
HuggingFace
1.8k

2U1/Qwen-VL-Series-Finetune

An open-source implementation for efficiently fine-tuning Alibaba Cloud's Qwen-VL series of multimodal large language models using HuggingFace and Liger-Kernel.

AI Optimization Library
python
1.0k

intel/auto-round

AutoRound is an advanced quantization toolkit for Large Language Models (LLMs) and Vision-Language Models (VLMs), enabling high-accuracy, ultra-low-bit inference across diverse hardware.

Offline AI Application / Mobile & Desktop AI Suite
android
1.6k

alichherawalla/off-grid-mobile-ai

A privacy-first, offline AI suite for mobile and desktop, enabling chat, image generation, vision AI, and more without internet access.

AI/ML Library
Node.js
2.0k

withcatai/node-llama-cpp

A Node.js binding for llama.cpp, enabling local execution of large language models with advanced features like JSON schema enforcement and function calling.

CLI Tool
Ollama
1.8k

sammcj/gollama

A TUI (Text User Interface) tool for macOS and Linux to efficiently manage Ollama large language models.

AI/LLM Interface
Gradio
15.3k

GaiZhenbiao/ChuanhuChatGPT

A feature-rich web GUI for ChatGPT and various LLMs, offering advanced functionalities like agents, file-based QA, web search, and finetuning with a refined user experience.

Replaces:
Details
UI Component Library
Docker
3.1k

CommandCodeAI/langui

An open-source collection of beautifully designed Tailwind CSS components specifically crafted for building user interfaces for AI, GPT, and LLM projects.

RAG Optimization Framework
python
4.7k

Marker-Inc-Korea/AutoRAG

An open-source framework that automates the evaluation and optimization of Retrieval-Augmented Generation (RAG) pipelines using AutoML-style automation for specific datasets.

API and AI Gateway
docker
43.3k

Kong/kong

A high-performance, extensible API and AI Gateway for orchestrating microservices, LLM, and MCP traffic.

AI Workflow Platform
Node.js
6.6k

julep-ai/julep

An open-source, serverless platform for building and deploying complex, agent-based AI workflows with persistent memory and tool orchestration.

AI Agent Development Platform
typescript
1.1k

inkeep/agents

A versatile platform for building and deploying AI agents and multi-agent workflows using a no-code visual builder or a TypeScript SDK, featuring full 2-way synchronization.

AI Assistant Plugin
sqlite
2.0k

rohitg00/pro-workflow

Pro Workflow enhances AI coding assistants like Claude Code with self-correcting memory, enabling them to learn from corrections and improve over time, significantly reducing repetitive guidance.

AI/ML Database Extension
Postgres
6.8k

postgresml/postgresml

PostgresML integrates machine learning and AI capabilities, including LLMs and vector search, directly into PostgreSQL, leveraging GPUs for high-performance in-database inference.

AI Model Security Tool
python
3.5k

sentient-agi/OML-1.0-Fingerprinting

A framework for embedding secret cryptographic fingerprints into Large Language Models (LLMs) via fine-tuning to verify ownership and prevent unauthorized use.

Large Language Model Finetuning Toolkit
DeepSpeed
2.8k

liucongg/ChatGLM-Finetuning

A toolkit for finetuning ChatGLM series models (ChatGLM-6B, ChatGLM2-6B, ChatGLM3-6B) using various methods like Freeze, Lora, P-tuning, and full parameter training for downstream NLP tasks.

LLM Fine-tuning Platform
pytorch
2.8k

PhoebusSi/Alpaca-CoT

A unified platform simplifying instruction-tuning for Large Language Models by integrating diverse data, LLMs, and parameter-efficient methods.

AI Model Compilation
2.0k

chenking2020/FindTheChatGPTer

A curated directory of open-source alternatives to ChatGPT and GPT-4, encompassing text and multimodal large language models, designed to assist users in navigating the AI landscape.

Agentic Workflow Framework
nodejs
4.9k

FellouAI/eko

A production-ready JavaScript framework for building reliable agentic workflows with natural language, supporting both computer and browser environments.

Technical Notes Collection
6.2k

swyxio/ai-notes

A curated collection of notes and resources for software engineers to quickly get up to speed on new AI developments, focusing on generative AI and large language models.

LLM Experimentation and Evaluation Tool
Python
3.0k

hegelai/prompttools

An open-source, self-hostable toolkit for testing, experimenting with, and evaluating prompts, large language models (LLMs), and vector databases.

Educational Resource Collection
5.4k

ashishps1/learn-ai-engineering

A comprehensive, curated collection of free resources for learning AI, Machine Learning, LLMs, and AI Engineering from scratch.

AI Prompt Design Framework
11.9k

langgptai/LangGPT

LangGPT is a structured, reusable prompt design framework that transforms chaotic prompt engineering into a systematic, template-based methodology for creating high-quality prompts for Large Language Models.

AI-powered Text-to-Speech System
Python
6.1k

canopyai/Orpheus-TTS

Orpheus TTS is a state-of-the-art open-source text-to-speech system built on a Llama-3b backbone, aiming to generate human-sounding, emotionally rich speech with low latency.

AI-powered Live Streaming Sales Assistant Platform
docker
3.7k

PeterH0323/Streamer-Sales

Streamer-Sales is an AI large language model designed for live streaming sales, generating compelling product descriptions and integrating advanced features like digital human generation, RAG, TTS, ASR, and Agent capabilities.

AI-powered Technical Assistance Framework
2.5k

InternLM/HuixiangDou

An LLM-based professional knowledge assistant designed to provide accurate technical support in group chat scenarios without message flooding.

AI/LLM Reasoning Library
Python
4.6k

kyegomez/tree-of-thoughts

A plug-and-play Python library implementing the Tree of Thoughts algorithm to significantly enhance Large Language Model reasoning capabilities.

Research Resource Collection
3.6k

atfortes/Awesome-LLM-Reasoning

A meticulously curated collection of academic papers and resources focused on enhancing and understanding the reasoning abilities of Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs).

AI Model / Research Project
2.5k

X-PLUG/mPLUG-Owl

A family of powerful multi-modal large language models (MLLMs) designed to advance AI's understanding and generation capabilities across various data types.

AI Toolkit / LLM Proxy
Python
66.2k

xtekky/gpt4free

GPT4Free (g4f) is a community-driven project that aggregates various free and accessible LLM providers, offering a unified API, clients, and GUI for flexible AI model interaction.

LLM Inference Library
dotnet
3.7k

SciSharp/LLamaSharp

A C#/.NET library for efficient local execution of Large Language Models (LLMs) like LLaMA and LLAVA, leveraging llama.cpp.

LLM Chat Client Application
flutter
2.5k

Chevey339/kelivo

A versatile Flutter-based LLM chat client supporting multiple AI providers and platforms with a modern design.

AI Agent Application Framework
.net-core
3.1k

SciSharp/BotSharp

BotSharp is an open-source .NET framework for building sophisticated AI multi-agent applications, enabling seamless integration of Large Language Models into enterprise business systems.

LLM Framework
Python
10.6k

The-Pocket/PocketFlow

A minimalist, 100-line LLM framework designed for building AI agents and workflows with zero bloat and maximum expressiveness.

Self-hosted Private AI Workspace
Docker
3.8k

claraverse-space/ClaraVerse

ClaraVerse is an open-source, privacy-focused AI ecosystem designed to replace commercial AI services by allowing users to host their own LLMs, keys, and compute, offering a unified workspace across desktop and mobile.

Self-hosted AI Development Environment
Docker
3.7k

coleam00/local-ai-packaged

A Docker Compose template for quickly bootstrapping a self-hosted local AI and low-code development environment with integrated tools like Ollama, Supabase, and n8n.

AI Development Environment Template
Docker
14.7k

n8n-io/self-hosted-ai-starter-kit

An open-source Docker Compose template for quickly setting up a secure, self-hosted AI and low-code development environment.

Browser Extension
12.8k

nanobrowser/nanobrowser

An open-source Chrome extension for AI-powered web automation, enabling multi-agent workflows with user-provided LLM API keys as a free alternative to commercial solutions.

Interview Preparation Guide
3.6k

WeThinkIn/AIGC-Interview-Book

An ultimate interview guide for AIGC/LLM/AI Agent algorithm and development engineers, covering core AI knowledge and practical experience.

On-device AI Inference SDK
python
8.0k

NexaAI/nexa-sdk

A high-performance SDK enabling day-0 local inference of frontier LLMs and VLMs across diverse hardware (NPU, GPU, CPU) and platforms (PC, mobile, IoT) with minimal energy.

Cross-platform AI Client Application
Flutter
6.9k

mylxsw/aidea

An open-source, cross-platform application integrating mainstream large language models and image generation models for unified AI interaction.

Awesome List / Resource Collection
4.8k

nichtdax/awesome-totally-open-chatgpt

A curated list of truly open-source alternatives to ChatGPT, featuring instruction-finetuned language models for chat.

Replaces:
Details
Emacs Package
Emacs
3.3k

karthink/gptel

A simple, extensible Emacs client for interacting with various Large Language Models directly within the editor.

Replaces:
Details
Embedded AI Assistant
ESP-IDF
5.4k

memovai/mimiclaw

MimiClaw transforms a $5 ESP32-S3 chip into a personal AI assistant, offering Telegram integration, local memory, and ultra-low power consumption without a traditional OS.

Online Educational Platform
2.3k

LearnPrompt/LearnPrompt

A permanently free and open-source AIGC course platform covering prompt engineering, generative AI tools like ChatGPT, Midjourney, Stable Diffusion, and advanced topics such as LLM fine-tuning and AI agents.

AI Software Engineer Agent
python
19.5k

stitionai/devika

An open-source AI agent that acts as a software engineer, capable of understanding instructions, planning, researching, and writing code to build software.

Replaces:
Details
Multimodal AI Model Suite
HuggingFace
10.0k

OpenGVLab/InternVL

A pioneering open-source multimodal large language model family aiming to match or exceed commercial models like GPT-4o/GPT-5 in performance.

AI Development Resource Repository
51.3k

shanraisshan/claude-code-best-practice

A comprehensive repository of best practices and implementation examples for developing with Claude Code's agentic engineering features.

AI Agent Backend Template
FastAPI
2.2k

wassim249/fastapi-langgraph-agent-production-ready-template

A production-ready FastAPI template for building scalable and secure AI agent applications with LangGraph, handling common infrastructure challenges.

Context Development Platform
Docker
2.0k

trustgraph-ai/trustgraph

A graph-native platform for storing, enriching, and retrieving structured knowledge to power AI applications and intelligent agents.

AI Video Editing Agent
python
2.0k

FireRedTeam/FireRed-OpenStoryline

FireRed-OpenStoryline is an AI video editing agent that transforms manual editing into intention-driven directing through natural language interaction and LLM-powered planning.

CLI Tool for AI Agent Memory Management
Node.js
4.7k

campfirein/byterover-cli

ByteRover CLI provides AI coding agents with persistent, structured memory, enabling developers to curate, version, and share project knowledge across tools and teams.

AI Agent Infrastructure Samples
python
2.7k

awslabs/agentcore-samples

Amazon Bedrock AgentCore provides a framework-agnostic and model-agnostic infrastructure for securely deploying and operating advanced AI agents at scale, with this repository offering practical samples and tutorials.

AI Runtime
24.3k

mozilla-ai/llamafile

Distribute and run LLMs with a single file, no installation required.

Terminal AI Client
sqlite
2.4k

ggozad/oterm

A terminal client for interacting with Ollama and other LLM providers, offering a simple UI and persistent chat sessions.

LLM CLI & Workflow Automation Tool
Python
3.7k

llm-workflow-engine/llm-workflow-engine

A powerful command-line interface and workflow manager designed to streamline interaction with various Large Language Models, including ChatGPT and GPT-4.

Replaces:
Details
AI Prompt Engineering Framework
6.4k

NeoVertex1/SuperPrompt

A sophisticated prompt engineering framework designed to guide LLMs, particularly Claude, into deeper, more novel, and "outside-the-box" thinking using holographic metadata and structured reasoning tags.

AI-powered Software Engineering Agent
python
19.1k

SWE-agent/SWE-agent

An AI agent that autonomously fixes GitHub issues, finds cybersecurity vulnerabilities, and performs coding tasks using large language models.

LLM Application Development Library
python
4.1k

SylphAI-Inc/AdalFlow

AdalFlow is a PyTorch-like open-source library designed to build and automatically optimize large language model (LLM) applications, from chatbots and RAG systems to complex AI agents.

Python Library
Ollama
9.9k

ollama/ollama-python

A Python library providing the easiest way to integrate Python 3.8+ projects with Ollama for local and cloud LLM interactions.

On-device AI Inference SDK
python
8.0k

qualcomm/nexa-sdk

A high-performance SDK enabling day-0 local inference of frontier LLMs and VLMs across diverse hardware (NPU, GPU, CPU) and platforms (PC, mobile, IoT) with minimal energy.

Large Language Model (LLM) Development Toolkit
Python
13.3k

Lightning-AI/litgpt

A high-performance, no-abstraction toolkit providing recipes for pretraining, finetuning, and deploying over 20 large language models at scale.

Curated List / Resource Collection
5.1k

mahseema/awesome-ai-tools

A comprehensive, curated list of top Artificial Intelligence tools, covering various categories from generative AI to LLMs and specialized applications.

Multimodal AI Model
24.8k

haotian-liu/LLaVA

An open-source large language and vision assistant (LLaVA) that achieves GPT-4V level multimodal capabilities through visual instruction tuning.

Replaces:
Details
Deep Learning Architecture Library
PyTorch
3.1k

microsoft/torchscale

A PyTorch library providing advanced foundation architectures to efficiently and effectively scale Transformers for large language models and general-purpose AI.

Curated Resource List
4.5k

luban-agi/Awesome-AIGC-Tutorials

A comprehensive, curated collection of tutorials and resources for Artificial Intelligence Generated Content (AIGC), encompassing Large Language Models, AI Painting, and related AI fields.

LLM-powered Data Processing Framework
Python
3.7k

ucbepic/docetl

DocETL is an agentic LLM-powered framework designed for building and executing complex data processing and ETL pipelines, especially for documents.

AI Development Library
Node.js
8.7k

microsoft/TypeChat

A library that simplifies building robust natural language interfaces by leveraging types for schema-driven LLM interactions, replacing complex prompt engineering.

RAG Platform
Python
25.4k

Cinnamon/kotaemon

An open-source, customizable RAG UI and framework for secure, multi-modal document Q&A with various LLM support.

Replaces:
Details
AI Agent Context Management Framework
Python
9.6k

cocoindex-io/cocoindex

CocoIndex is an incremental data indexing framework that provides continuously fresh context from diverse enterprise data sources for AI agents and LLM applications.

Interactive AI VTuber Companion Application
Docker
7.7k

Open-LLM-VTuber/Open-LLM-VTuber

An open-source, cross-platform AI companion featuring real-time voice interaction, visual perception, and a Live2D avatar, running entirely offline.

AI Routing Library
python
3.5k

aurelio-labs/semantic-router

A superfast decision-making layer for LLMs and AI agents that routes requests based on semantic meaning, bypassing slow LLM generations.

OSS Alternative

Explore the best open source alternatives to commercial software.

© 2026 OSS Alternative. hotgithub.com - All rights reserved.