Vaex

Vaex is an open-source Python library and platform designed for fast, memory-efficient, and scalable big data analytics and machine learning. It enables data scientists and analysts to efficiently explore, visualize, and model very large datasets—starting at 100GB—directly from their laptops, without the need for clusters or specialized hardware. Vaex offers seamless integration with the Python data science stack, supports out-of-core computations, and easily scales from prototype to production with single-command deployment on various cloud platforms.