Tags: #ai-infrastructure

Memori provides SQL-native, LLM-agnostic memory infrastructure for AI agents, transforming execution and conversation into structured, persistent state.

AReaL is a scalable and flexible asynchronous reinforcement learning infrastructure designed to bridge foundation model training with modern LLM-based agent applications.

A full-stack AI Red Teaming platform for comprehensive security risk self-examination across AI ecosystems, including LLM jailbreak evaluation and infrastructure vulnerability scanning.

XTuner V1 is a next-generation training engine specifically designed for ultra-large-scale Mixture-of-Experts (MoE) models, offering superior efficiency and scalability.

LMCache is an LLM serving engine extension designed to significantly reduce Time-To-First-Token (TTFT) and boost throughput, especially for long-context scenarios, by intelligently reusing KV caches.

A vendor-agnostic unified control plane for GPU provisioning and orchestration across clouds, Kubernetes, and on-prem for AI/ML workloads.

A multi-LoRA inference server designed to efficiently serve thousands of fine-tuned Large Language Models on a single GPU, drastically cutting serving costs while maintaining high throughput and low latency.

An end-to-end AI infrastructure platform for data, model, and pipeline orchestration, designed to streamline the development of versatile AI-first applications.