Ecosystem & Stack: apache-arrow

An open lakehouse format for multimodal AI, offering high-performance random access, vector indexing, and data versioning.

A lightweight library providing one-line dataloaders and efficient pre-processing tools for a vast hub of AI datasets, supporting various ML frameworks.

Vortex is a next-generation, high-performance, and extensible open-source columnar file format and toolkit designed for blazing-fast data processing and storage, especially with object storage.

DORA is a high-performance, 100% Rust framework for building real-time, low-latency, and distributed AI-based robotic applications using a dataflow-oriented architecture.