Transpose operator inevitably triggers lazy dtypes
metadata computation.
#3725
Labels
Backport 🔙
Issues that need to be backported to previous release(s)
Performance 🚀
Performance related issues and pull requests.
Doing
df.T
triggersdtypes
property access and so its computation, even if it has been delayed by settingmodin_frame._dtypes = None
:modin/modin/core/dataframe/pandas/dataframe/dataframe.py
Lines 2269 to 2272 in a80cb3b
Data types computation may take up to several seconds for wide frames, we should avoid it when possible.
BTW
df.T
is a part of the reduction operations flow (columnarization atSeries
constructor), so it's generally slowing down every reduction method.The text was updated successfully, but these errors were encountered: