Tags: #benchmarking

A terminal tool that detects your hardware and recommends optimal LLM models, providing performance benchmarks for local execution.

OSWorld is a benchmark and environment for evaluating multimodal AI agents on open-ended tasks within real computer operating systems.

A unified, reproducible, and efficient multimodal evaluation toolkit for large language models across text, image, video, and audio tasks.