Ecosystem & Stack: python

An open-source LLM engineering platform for developing, monitoring, evaluating, and debugging AI applications.

An LLM-driven intelligent stock analysis system providing automated daily insights, decision dashboards, and multi-channel notifications for A/H/US markets at zero operational cost.

An open-source MCP server connecting AI agents, IDEs, and applications to enterprise databases for data interaction, schema exploration, and code generation.

A unified framework for scaling AI and Python applications from a laptop to a cluster, providing a distributed runtime and AI libraries.

An AI-driven development platform providing an SDK, CLI, GUI, and cloud services to build, run, and scale autonomous software agents for various development tasks.

OpenViking is an open-source context database designed for AI Agents, unifying memory, resources, and skills management through a file system paradigm for hierarchical context delivery and self-evolving capabilities.

DeerFlow is an open-source super agent harness designed to research, code, and create by orchestrating sub-agents, memory, and sandboxes to tackle complex, long-horizon tasks.

An open-source platform for debugging, evaluating, and monitoring LLM applications, RAG systems, and agentic workflows from prototype to production.

Memori provides SQL-native, LLM-agnostic memory infrastructure for AI agents, transforming execution and conversation into structured, persistent state.

LangChain is an agent engineering platform and framework for building LLM-powered applications by chaining interoperable components and integrating diverse data sources.

Agno is a comprehensive platform for building, running, and managing scalable, production-ready agentic software, addressing the unique challenges of AI agent deployment.

MindsDB is an open-source AI analytics query engine that enables AI agents to directly query and analyze live data from various sources without ETL, facilitating natural language interaction and semantic search.

An open-source Python framework for building real-time, voice-first, and multimodal conversational AI agents with ultra-low latency.

A Python library designed to simplify the processing and parsing of diverse document formats, preparing them for seamless integration with generative AI ecosystems.

An adaptive Python web scraping framework designed to handle everything from single requests to full-scale crawls, featuring anti-bot bypass and self-healing parsers.

A toolkit enabling Spec-Driven Development by transforming executable specifications directly into working software, accelerating high-quality software delivery.

A framework for orchestrating role-playing, autonomous AI agents to collaboratively tackle complex tasks.

An open-source vector database designed as data infrastructure for AI applications, simplifying embedding management and semantic search.

A Python SDK and AI Gateway unifying access to 100+ LLM APIs in an OpenAI-compatible format, offering cost tracking, load balancing, and guardrails.

An open-source AI orchestration framework for building production-ready LLM applications with modular pipelines and agent workflows.

A comprehensive framework from ModelScope for efficiently fine-tuning, evaluating, and deploying over 1000 large language models and multimodal large models using advanced techniques.

A Python agent framework built by the Pydantic team to quickly and confidently develop production-grade Generative AI applications with a focus on type safety and observability.

Test, evaluate, and red-team your LLM applications to ensure security, reliability, and optimal performance across various models.

A high-performance serving framework designed to accelerate inference for large language models and multimodal AI models.

A Python framework for rapidly building and deploying production-ready conversational AI applications.

A high-throughput and memory-efficient open-source engine designed for fast, easy, and cost-effective serving of large language models.

A lightweight, powerful Python framework for building and orchestrating multi-agent LLM workflows, supporting various LLMs and offering features like tools, guardrails, and tracing.

A production-grade, open-source platform for building and deploying intelligent, agentic instant messaging bots across various chat platforms.

AstrBot is an open-source, all-in-one agent chatbot platform that integrates AI capabilities with various instant messaging applications, providing scalable conversational AI infrastructure.

Provides sample code, notebooks, and resources for building and managing generative AI workflows on Google Cloud using Vertex AI and Gemini.

ReMe is a memory management framework for AI agents, addressing limited context windows and stateless sessions by providing persistent, automatically refined memory.

A collection of samples and tutorials for deploying and operating scalable, secure, and framework-agnostic AI agents using Amazon Bedrock AgentCore.

An AI memory operating system for LLM and agent systems, enabling persistent skill memory for cross-task reuse and evolution.

MaiBot is an LLM-based intelligent agent designed to be a human-like digital companion, prioritizing warmth, authenticity, and genuine connection over perfection or efficiency.

AstronRPA is an open-source, enterprise-grade RPA desktop application that enables low-code/no-code automation of desktop and web processes, deeply integrating with AI agents.

An open-source multi-agent framework dedicated to researching the scaling laws of AI agents and facilitating large-scale agent system development.

An open-source AI engineering platform for managing the complete lifecycle of AI applications, including agents, LLMs, and ML models, from debugging and evaluation to monitoring and optimization.

Composio provides SDKs for Python and TypeScript to empower developers to build AI agents by offering access to 1000+ toolkits, tool search, context management, and authentication.

Automates complex browser-based workflows using LLMs and computer vision, providing a resilient and adaptive solution for web interaction.

A unified and efficient framework for fine-tuning over 100 large language models (LLMs) and vision-language models (VLMs) with both CLI and Web UI.

An open-source financial data platform that integrates diverse data sources and exposes them to analysts, quants, and AI agents.

An open-source knowledge engine designed to build personalized and dynamic memory for AI agents with minimal code.

A deep learning framework that simplifies PyTorch development by automating boilerplate engineering code, enabling scalable training from CPU to multi-node GPUs with minimal code changes.

A comprehensive system for optimizing the performance, security, and development of AI agent harnesses across various LLM platforms.

A high-performance, cloud-native vector database built for scalable Approximate Nearest Neighbor (ANN) search and AI applications.

An open-source platform for building enterprise-grade AI agents, integrating RAG, workflows, and tool-use for intelligent Q&A and complex business scenarios.

An open-source ETL solution for transforming complex documents into clean, structured data formats, optimized for language models.

A Python framework and cloud service designed to empower AI agents to interact with and automate tasks on websites.

LightRAG is a simple and fast Retrieval-Augmented Generation (RAG) system designed for efficient and scalable knowledge retrieval and generation with Large Language Models.

LlamaIndex is an open-source framework for building agentic applications, specializing in document processing, OCR, parsing, and indexing to empower LLMs.

An all-in-one AI framework for semantic search, LLM orchestration, and language model workflows, built around an embeddings database.

A Python library for building and deploying high-performance AI model inference APIs and multi-model serving systems with ease.

Easily run, manage, and interact with open-source large language models locally on your machine.

Clawith is an open-source multi-agent collaboration platform that equips AI agents with persistent identities, long-term memory, and dedicated workspaces, enabling them to operate as autonomous digital employees within teams.

Open-source infrastructure for building, training, and evaluating AI agents that can control full desktops across various operating systems.

A personal AI agent in your terminal that automates tasks like coding, terminal operations, and web browsing using local tools.

An open-source framework for training multi-step LLM agents using reinforcement learning (GRPO) to learn from experience, offering a serverless RL training service.

An open-source, universal memory layer for AI agents, enabling persistent learning, storage, and recall of information across sessions to transform stateless agents into context-aware assistants.

An open-source, code-first Python framework for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

An open-source infrastructure providing secure, isolated cloud sandboxes for executing AI-generated code with developer-friendly SDKs.

A production-ready, pre-trained Time Series Foundation Model for accurate forecasting and anomaly detection across various domains with minimal code.

A programming framework for creating multi-agent AI applications that can act autonomously or work alongside humans.

An open-source simulator providing a flexible platform and digital assets for autonomous driving research, development, and validation.

A free and open-source framework designed for efficient and flexible fine-tuning of large language models.

A lightweight, multi-platform AI assistant framework powered by large language models, capable of autonomous task planning, tool use, and continuous learning, deployable as a personal AI or enterprise digital employee.

A human-centric Python framework for building, managing, and deploying real-life AI/ML systems from rapid prototyping to reliable production.

An open-source, privacy-aware personal AI assistant designed for local operation and agentic task execution.

Mem0 is a universal memory layer that enhances AI agents with intelligent, personalized, and scalable long-term memory capabilities.

An enterprise-ready, model-agnostic SDK for building, orchestrating, and deploying intelligent AI agents and multi-agent systems.

An industrial-strength Python library for advanced Natural Language Processing, designed for building real-world applications.

A unified, production-ready inference API for effortlessly deploying and serving open-source language, speech, and multimodal AI models across various environments.

Edict is an AI multi-agent orchestration system inspired by ancient imperial governance, offering institutional review, real-time observability, and task intervention for reliable complex task execution.

Operit AI is the first fully-featured, independently running AI assistant application for Android, offering powerful tool-calling, deep search, and automation capabilities.

An AI-driven platform that transforms research papers, text, or topics into editable scientific figures, technical diagrams, and presentation slides with universal file support.

A comprehensive tutorial guiding users from foundational principles to practical implementation of AI-native agent systems.

An AI developer platform for tracking, visualizing, and managing machine learning models from experimentation to production.

iii unifies diverse backend tools like API frameworks, task queues, and schedulers into a single engine with Function, Trigger, and Worker primitives, simplifying distributed backend development.

A unified framework for building local, private, and secure enterprise RAG pipelines using small, specialized LLMs optimized for on-device and edge deployment.

A comprehensive, step-by-step guide and codebase for building a ChatGPT-like Large Language Model from scratch using PyTorch.

A framework for building controlled, consistent, and predictable customer-facing AI agent interactions using LLMs.

A universal viewer for neural network, deep learning, and machine learning models, supporting a wide array of formats.

A command-line tool and VS Code extension for data versioning, ML experiment tracking, and reproducible machine learning pipelines.

Acontext is an open-source skill memory layer for AI agents, enabling them to learn from experiences and store knowledge as readable, shareable skill files.

Trigger.dev is an open-source platform for building and deploying durable, long-running AI agents and workflows in TypeScript, offering features like retries, queues, and elastic scaling without serverless timeouts.

An industry-leading open-source platform for advanced face manipulation, offering powerful features for deepfake creation and processing.

A lightweight Python library for building modular, asynchronous, and composable AI pipelines, enabling efficient, parallel, and multimodal content processing for Generative AI applications.

An open standard and format for machine learning models, enabling interoperability across AI frameworks and streamlining the path from research to production.

An AI-powered tool that automates video commentary and editing, offering a one-stop solution for scriptwriting, automated video editing, voiceover, and subtitle generation to boost efficient content creation.

A low-level orchestration framework for building resilient, stateful, and long-running language agents using a graph-based approach.

A tool for automatically removing censorship and safety alignment from transformer-based language models without expensive post-training.

A flexible CLI-first framework for building, evaluating, and interacting with sophisticated AI agents and workflows, offering comprehensive LLM support and advanced debugging features.

An AI-powered 24/7 customer service bot for Xianyu, featuring multi-agent decision-making, smart negotiation, and context-aware conversations.

An open-source, enterprise-grade AI Cloud OS providing a knowledge base and a comprehensive management platform for AI models (MCP) and agents (A2A), complete with admin UI, user management, and SSO.

An AI-powered tool for comprehensive video subtitling, including speech recognition, optimization, translation, and video synthesis.

A modular framework for building advanced Agentic RAG systems using LangGraph, featuring intelligent query processing, conversation memory, and human-in-the-loop clarification.

An AI-driven local automation assistant that uses natural language to control computers and learns from user demonstrations.

LEANN is an innovative vector database enabling fast, accurate, and 100% private RAG on personal devices with 97% storage savings.

A comprehensive platform for creating personalized AI digital twins by fine-tuning large language models with your chat history.

An open-source AI agent that automates complex desktop actions and tasks across applications through natural language commands.

An open-source framework enabling organizations to build highly customizable, secure, and asynchronous internal coding agents, mirroring the capabilities of elite tech companies.

Pinpoint is an open-source APM tool designed for large-scale distributed systems, offering real-time monitoring and code-level visibility to identify performance bottlenecks.

A collection of samples and tutorials for deploying and operating scalable, secure, and framework-agnostic AI agents using Amazon Bedrock AgentCore.

A security scanner for AI agents, MCP servers, and agent skills, detecting prompt injections and other vulnerabilities.

OSWorld is a comprehensive benchmarking platform designed to evaluate multimodal AI agents on open-ended tasks within real computer environments.

An enterprise-grade, production-ready framework for orchestrating complex multi-agent systems, designed for scalable AI applications and seamless integration.

An open-source platform for comprehensive AI/ML model observability, evaluation, and debugging.

A lightweight Python library that makes Anthropic Model Context Protocol (MCP) tools compatible with LangChain and LangGraph.

A comprehensive guide and collection of recipes for building with the Llama model family, covering inference, fine-tuning, RAG, and end-to-end use cases.

A comprehensive online course from Hugging Face designed to teach the fundamentals and advanced concepts of building AI agents using LLMs and popular frameworks.

A low-code development tool for building and iteratively optimizing multi-agent LLM applications with agility and efficiency.

Argilla is a collaboration tool for AI engineers and domain experts to build and maintain high-quality datasets for various AI models, from NLP to LLMs and multimodal systems.

Transforms diverse unstructured data into structured Neo4j Knowledge Graphs using Large Language Models (LLMs) and LangChain.

A Python SDK and platform for comprehensive observability, monitoring, and cost management of AI agents and LLM applications.

A comprehensive, full-stack guide to Retrieval-Augmented Generation (RAG) technology, covering theory, practice, and engineering best practices for building LLM applications.

A beginner-friendly tutorial for LLM application development, focusing on building a personal knowledge base assistant using cloud services.

A Streamlit app to build and query custom Retrieval-Augmented Generation (RAG) pipelines over your data using natural language.

An AI-powered research assistant for deep, agentic research, emphasizing local control, privacy, and multi-source information synthesis.

A model-driven Python SDK for rapidly building and deploying AI agents, from simple assistants to complex autonomous workflows, with minimal code.

OpenMemory is a self-hosted, local-first cognitive memory engine providing real long-term memory for LLM applications and AI agents, distinct from RAG or vector databases.

RamaLama simplifies the local serving and production inference of AI models from any source by leveraging familiar container patterns, eliminating complex host system configurations.

A KVCache-centric disaggregated architecture for high-performance LLM serving, powering leading AI services.

Sparrow is a production-ready platform for structured data extraction and instruction calling from various documents and images using ML, LLM, and Vision LLM technologies.

A comprehensive open-source library providing AI agents with the skills to autonomously conduct the entire AI research lifecycle, from ideation to paper writing.

An educational course for systems engineers to learn LLM inference serving on Apple Silicon by building a simplified vLLM-like system with MLX from scratch.

A comprehensive, curated list of research papers and associated code for optimizing Large Language Model (LLM) and Vision Language Model (VLM) inference.

An open lakehouse format designed for multimodal AI, offering high-performance vector search, lightning-fast random access, and robust data versioning capabilities.

A robust open-source platform for programmatically authoring, scheduling, and monitoring data workflows.

A Python framework for building reproducible, maintainable, and modular data engineering and data science pipelines using software engineering best practices.

A unified system to run, manage, and scale AI workloads efficiently across any infrastructure, including Kubernetes, Slurm, and over 20 cloud providers, optimizing cost and resource availability.

DataChain is a Python-based AI-data warehouse for transforming, analyzing, and versioning unstructured multimodal data like video, audio, PDFs, and images.

An open-source Python library for evaluating, testing, and monitoring ML and LLM systems across experiments and production environments.

Dynamic, resilient open-source orchestrator for building scalable and reproducible data and ML pipelines on Kubernetes.

An open-source, modern-design AI training tracking and visualization tool that integrates with 50+ mainstream frameworks, simplifying experiment management for AI teams.

A Python library empowering data scientists and ML engineers to rapidly build and deploy production-ready data and AI-driven web applications.

An open-source, multi-type data labeling and annotation tool designed to prepare and improve datasets for machine learning models.

Kubeflow Pipelines is a Kubernetes-native platform for building, deploying, and managing end-to-end machine learning workflows.

ZenML is an open-source AI platform that unifies ML/AI workflows from pipelines to agents, abstracting infrastructure complexity and integrating existing tools.

A collection of Jupyter notebooks and a new Python SDK demonstrating how to build, train, and deploy machine learning models on Amazon SageMaker.

Accelerates the development and deployment of production-ready AI agents on Google Cloud with pre-built templates, CI/CD, evaluation, and observability.

A comprehensive MLOps platform for managing, orchestrating, and scaling the entire machine learning and deep learning lifecycle.

An open-source tool designed to log, compare, and observe machine learning training runs and AI metadata with an intuitive UI and programmatic API.

A Python library for building modular, testable, and self-documenting data transformation DAGs with built-in lineage and metadata tracking.

An open-source feature store that streamlines the management and serving of features for AI/ML models, ensuring consistency between training and inference.

A powerful open-source framework for data teams to define, validate, and document data quality expectations, ensuring data reliability.

A cloud-native data pipeline orchestrator designed for the development, production, and observation of data assets, featuring integrated lineage, observability, and a declarative programming model.

A radically simple yet highly performant AI agent for software engineering, capable of solving GitHub issues and assisting in command-line tasks.

An open-source, offline-deployable RAG and Agent application built with Langchain, supporting various local and online Large Language Models for knowledge-based Q&A.

A semantic cache library for Large Language Models (LLMs) designed to significantly reduce API costs and accelerate response times.

A browser-based platform enabling users to assemble, configure, and deploy autonomous AI agents to achieve custom goals.

A comprehensive Chinese-language guide to getting started with LangChain, enabling developers to build powerful applications powered by large language models.

An open-source Backend as a Service (BaaS) platform for developing, deploying, and managing LLM-based AI agents and applications.

An open-source LangChain implementation of the ChatGPT Code Interpreter, enabling sandboxed Python code execution for LLM applications.

An intelligent dialogue system leveraging RAG technology to build Q&A services based on your custom knowledge base.

An AI-powered tool that automatically generates comprehensive, interactive wikis and documentation for GitHub, GitLab, and BitBucket repositories.

An open-source Python library for comprehensive evaluation, testing, and red teaming of LLM agents and agentic systems.

ClearML is an open-source MLOps/LLMOps solution that streamlines the entire AI workflow, from experiment management and data versioning to pipeline orchestration and model serving.

A general-purpose workflow orchestrator providing a fully managed workflow-as-a-service for data and ML pipelines at scale.

Build machine learning models from natural language prompts using an AI-powered agentic approach.

A comprehensive educational platform for mastering the development, deployment, and iteration of production-grade machine learning applications.

A comprehensive practical guide and accompanying codebase for building, deploying, and monitoring advanced LLM and RAG applications on AWS, emphasizing LLMOps best practices.

A versatile framework designed to train and optimize AI agents from any existing framework with minimal code changes, leveraging advanced algorithms like Reinforcement Learning.

Deep Lake is an AI data runtime and database optimized for deep learning, offering multimodal data storage, querying, vector search, and streaming for LLM and deep learning applications.

A PyTorch library enabling accessible large language models by dramatically reducing memory consumption through k-bit quantization for both inference and training.

Ludwig is a low-code, declarative deep learning framework designed to simplify the building, training, and deployment of custom AI models, including LLMs and neural networks.

Deep-Live-Cam enables real-time face swapping and one-click video deepfakes using just a single image, designed for creative AI media generation.

A platform for building stateful AI agents equipped with advanced memory, enabling them to learn and self-improve over time.

A cutting-edge framework for multi-agent collaboration, enabling optimized workforce learning and robust real-world task automation.

Fay is an AI agent framework designed to connect digital humans (2.5D, 3D, mobile, PC, web) and large language models (OpenAI compatible, DeepSeek) with various business systems.

An optimized LLM inference server for Apple Silicon, featuring continuous batching, tiered KV caching, and macOS menu bar management for efficient local AI.

An AI agent platform designed to automate high-value research and development processes for data and models, driving data-driven AI.

Connects AI assistants like Claude and Cursor directly to the Unity Editor, empowering LLMs to automate game development tasks.

SimpleMem provides an efficient, lifelong, and multimodal memory solution for LLM agents, featuring semantic lossless compression and retrieval.

A comprehensive repository offering practical implementations of over 17 state-of-the-art AI agent architectures using LangChain and LangGraph.

OpenVINO is an open-source toolkit designed to optimize and deploy deep learning models for efficient AI inference across diverse hardware platforms, from edge to cloud.

A command-line tool and Python library for interacting with various large language models, both remote APIs and local models.

An open-source course teaching how to build a production-ready Second Brain AI assistant leveraging LLMs, RAG, agents, and LLMOps for personal knowledge management.

A comprehensive 12-week, 24-lesson curriculum designed to introduce beginners to the fundamentals of Artificial Intelligence.

A comprehensive repository offering C++ and Python code examples for computer vision, deep learning, and AI research, complementing articles on LearnOpenCV.com.

An AI-powered custom node for ComfyUI that automates workflow building, debugging, and optimization, significantly enhancing AIGC development efficiency.

A Python library that leverages LLMs and graph logic to simplify web scraping and data extraction from various sources.

A comprehensive toolkit providing best practices and implementations for building, evaluating, and operationalizing recommendation systems.

Colossal-AI makes training and deploying large AI models cheaper, faster, and more accessible through advanced distributed training techniques.

A local, open-source AI memory system designed to store every AI conversation verbatim and organize it for highly efficient semantic retrieval, achieving top benchmark scores.

An ultra-lightweight, open-source personal AI agent platform designed for efficiency and broad compatibility across various LLM providers and communication channels.

A lightweight, multi-platform AI assistant framework powered by large language models, capable of autonomous task planning, tool use, and continuous learning, deployable as a personal AI or enterprise digital employee.

An open-source framework that organizes AI prompts by real-world tasks to solve AI integration challenges and augment human capabilities.

QwenPaw is a personal, extensible AI assistant platform designed for local or cloud deployment, offering data privacy, multi-agent collaboration, and broad multi-channel integration.

A comprehensive repository offering 22 hands-on Jupyter Notebook tutorials on prompt engineering techniques for leveraging large language models.

An AI agent that automates the creation of permissionless integrations by reverse-engineering platforms' internal APIs from browser network requests.

A Python library leveraging LLMs to extract structured information from unstructured text with precise source grounding and interactive visualization.

UFO³ is a multi-device agent orchestration framework that enables complex, cross-platform automation and workflow management by coordinating intelligent agents.

A comprehensive framework for building real-time, programmable, multi-modal voice AI agents capable of seeing, hearing, and understanding.

A secure, fast, and extensible general-purpose sandbox runtime platform for AI agents, offering multi-language SDKs and flexible deployment.

A lightweight, dark-themed web interface for Hermes Agent, offering full CLI parity and persistent memory for autonomous AI tasks.

A lightweight library providing a vast hub of ready-to-use datasets and efficient tools for data manipulation in AI and machine learning workflows.

GPT Pilot is an AI developer companion designed to build complete, production-ready applications, automating up to 95% of the coding process with human oversight.

An ultra-compact 7B parameter AI agent designed by Microsoft to automate multi-step computer tasks through visual perception and direct interface interaction.

An open-source, embedded retrieval library and multimodal AI lakehouse designed for fast, scalable vector search and data management in AI/ML applications.

An open-source memory library and managed service for building stateful AI agents that learn and adapt over time.

An open-source, multi-language framework by Google for rapidly building and deploying production-ready AI-powered applications.

An AI-native database optimized for LLM applications, offering incredibly fast hybrid search across dense vectors, sparse vectors, tensors, and full-text data.

A unified, open-source enterprise data warehouse built in Rust, offering analytics, vector search, and full-text search, specifically designed for AI agents with secure Python UDF sandboxes.

A proactive, context-aware AI assistant that enhances productivity by understanding your digital environment and proactively delivering insights.

An open-source platform leveraging LLMs and vector databases to enable deep research, intelligent Q&A, and comprehensive reporting on private enterprise data.

Towhee is a cutting-edge framework designed to simplify and accelerate neural data processing pipelines, particularly for unstructured multimodal data and LLM orchestration.

A Python library for representing, transmitting, storing, and retrieving multimodal data, designed for AI applications.

A free, hands-on course teaching how to build and deploy production-ready LLM and RAG systems, including a personalized 'LLM Twin', using LLMOps best practices.

A high-performance, scalable JAX-based open-source library for training large language models on Google Cloud TPUs and GPUs.

An end-to-end platform for fine-tuning, evaluating, and deploying open-source Large Language Models (LLMs) and Vision Language Models (VLMs).

A vendor-agnostic unified control plane for GPU provisioning and orchestration across clouds, Kubernetes, and on-prem for AI/ML workloads.

A comprehensive, one-stop solution for training various Diffusion models, offering extensive features for fine-tuning, dataset preparation, and model management.

A streamlined tool to accelerate the fine-tuning process for multimodal models like Florence-2, PaliGemma 2, and Qwen2.5-VL.