"Koalas" provides the #Pandas #dataframes API on top of Apache #SPARK for #exploratory-data-analysis with better #performance #toread
on 02024-12-12"Dask" is another distributed #dataframes system that “uses #Pandas under the hood” for #exploratory-data-analysis with better #performance #toread
on 02024-12-12"Modin" scales #Pandas notebooks across clusters for #exploratory-data-analysis with better #performance #toread #dataframes
on 02024-12-12"Polars" is a #dataframes system similar to #Pandas but with up to 30× faster performance and IIRC a nicer API, available in not just Python but also Rust and node.js
on 02024-11-22a #dataframes system for lazy computing on data in #Arrow or HDF5 files: “Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀 (...) #Vaex uses memory mapping, zero memory copy policy and lazy computations for best performance (no memory wasted).”
on 02024-11-22