Tags: #llm-optimization
CLI Utility / Developer Tool
Rust
35.6k
rtk-ai/rtk
A high-performance CLI proxy that significantly reduces LLM token consumption for common development commands.
AI/Deep Learning Optimization Framework
NVIDIA GPUs
41.4k
hpcaitech/ColossalAI
An open-source framework designed to make large AI model training and inference cheaper, faster, and more accessible through advanced distributed computing and memory optimization techniques.
Replaces:
Details