Skip to content

Commit

Permalink
Preserve records batch order when SchemaCastScanExec is involved (#70)
Browse files Browse the repository at this point in the history
Co-authored-by: Sergei Grebnov <sergei.grebnov@gmail.com>
  • Loading branch information
phillipleblanc and sgrebnov authored Oct 15, 2024
1 parent e1084a9 commit e1d3aa0
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions datafusion-federation/src/schema_cast/mod.rs
Original file line number Diff line number Diff line change
Expand Up @@ -69,6 +69,12 @@ impl ExecutionPlan for SchemaCastScanExec {
vec![&self.input]
}

/// Prevents the introduction of additional `RepartitionExec` and processing input in parallel.
/// This guarantees that the input is processed as a single stream, preserving the order of the data.
fn benefits_from_input_partitioning(&self) -> Vec<bool> {
vec![false]
}

fn with_new_children(
self: Arc<Self>,
children: Vec<Arc<dyn ExecutionPlan>>,
Expand Down

0 comments on commit e1d3aa0

Please sign in to comment.