You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Even if the input files are not cloud-typed files, or spark.rapids.sql.format.orc/parquet.reader.type is set to COALECING, we still can't get coalescing reading. Instead, multithreaded reading will be used.
The root cause is the default value of queryUsesInputFile which is always true. so the condition canUseCoalesceFilesReader will always be false.
Describe the bug
Even if the input files are not cloud-typed files, or
spark.rapids.sql.format.orc/parquet.reader.type
is set to COALECING, we still can't get coalescing reading. Instead, multithreaded reading will be used.The root cause is the default value of queryUsesInputFile which is always true. so the condition
canUseCoalesceFilesReader
will always be false.Steps/Code to reproduce bug
Using the coalesce multi-file
. But in fact, the log isUsing the multi-threaded multi-file
The text was updated successfully, but these errors were encountered: