Consider to avoid force_materialization
call in to_pandas
function
#5269
Labels
Internals
Internal modin functionality
P3
Very minor bugs, or features we can hopefully add some day.
Performance 🚀
Performance related issues and pull requests.
force_materialization
function takes dataframes from storage, merges them into one and puts them back into storage. The step at which the object is put back into storage can be avoided, resulting in a performance boost. However, this can significantly complicateto_pandas
function , so when implementing it someone needs to understand whether the resulting performance gain is worth the increased code complexity. Originally found in #4776 (comment)The text was updated successfully, but these errors were encountered: