Tags: #performance

An open-source, real-time infrastructure monitoring platform providing instant, per-second insights with zero configuration and AI-powered anomaly detection.

vLLM is a high-throughput and memory-efficient open-source library designed for fast and easy serving of large language models.

LMCache is an LLM serving engine extension designed to significantly reduce Time-To-First-Token (TTFT) and boost throughput by intelligently reusing KV caches across various storage tiers and serving instances.

A portable, open-source operating system for AI agents, offering near-zero cold starts and significantly lower costs compared to traditional sandboxes, powered by WebAssembly and V8 isolates.

Nunchaku is a high-performance AI inference engine that optimizes 4-bit neural networks, especially diffusion models, for faster and more memory-efficient execution.

A fast, dependency-free Git hook manager built in Rust, designed as a drop-in alternative to pre-commit with enhanced performance and features.

A simple, fast, and user-friendly command-line tool for finding files, offering an intuitive alternative to the traditional 'find' utility.

A fast, open-source, and cost-efficient search database designed as a powerful alternative and drop-in replacement for Elasticsearch.

A fast, lightweight, and battle-tested alternative to traditional Virtual DOM libraries, leveraging template literals for efficient UI rendering.

A modular, high-performance web user interface for Stable Diffusion, emphasizing accessible powertools and extensibility for both beginners and advanced users.

Empowers AI coding agents with full control and inspection capabilities over a live Chrome browser using DevTools.