Vaex

Vaex is a high-performance Python library designed for working with large tabular datasets (dataframes) that do not fit into memory. It allows for fast, efficient exploration, visualization, and machine learning with out-of-core algorithms, optimizing resource use and minimizing development time. This tool is ideal for data scientists and ML engineers needing to process massive datasets without requiring large clusters or distributed systems.