Ecosystem & Stack: mlx

A terminal tool that detects your hardware and recommends optimal LLM models, providing performance benchmarks for local execution.

A production-ready platform for structured data extraction and instruction calling using ML, LLM, and Vision LLM technologies.

A hands-on course for systems engineers to build an efficient LLM inference serving system from scratch on Apple Silicon using MLX, mimicking vLLM's core techniques.

A Kubernetes-native platform for scalable distributed AI model training and LLM fine-tuning across various frameworks.