vortex-data/vortex

Vortex is an advanced, open-source columnar file format and toolkit under the Linux Foundation, engineered for unparalleled performance in data processing. It offers significantly faster read and write operations compared to modern Apache Parquet, while maintaining similar compression ratios. Its extensible architecture allows for custom encoding, compression, and layout strategies, with seamless zero-copy integration with Apache Arrow. Vortex is ideal for building high-performance data systems, especially those backed by object storage, providing a robust foundation for analytics and data engineering workflows.