vortex-data/vortex

Vortex is an advanced, open-source columnar file format and toolkit engineered for unparalleled performance in data processing, particularly for systems backed by object storage. It offers significantly faster read and write operations compared to modern alternatives like Apache Parquet, while maintaining similar compression ratios. Its extensible architecture allows for flexible encoding, type, and compression strategies, coupled with seamless zero-copy integration with Apache Arrow. As a Linux Foundation project, Vortex provides a robust, high-performance foundation for building next-generation data systems.