Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DataSink additions #7778

Merged
merged 8 commits into from
Oct 10, 2023
Merged

DataSink additions #7778

merged 8 commits into from
Oct 10, 2023

Conversation

Dandandan
Copy link
Contributor

@Dandandan Dandandan commented Oct 9, 2023

Which issue does this PR close?

Closes #7779

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

@github-actions github-actions bot added the core Core DataFusion crate label Oct 9, 2023
@Dandandan Dandandan changed the title File sink additions DataSink additions Oct 9, 2023
/// resolved) for all available partitions, the set of metrics
/// should be complete. If this function is called prior to
/// `execute()` new metrics may appear in subsequent calls.
fn metrics(&self) -> Option<MetricsSet>;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🤔 I wonder if there is value in making some sort of End to End example for this feature (so we don't accidentally break it in the future0

datafusion/physical-plan/src/insert.rs Outdated Show resolved Hide resolved
datafusion/physical-plan/src/insert.rs Outdated Show resolved Hide resolved
Dandandan and others added 4 commits October 10, 2023 09:29
@Dandandan Dandandan merged commit d2cc4d2 into apache:main Oct 10, 2023
22 checks passed

/// Returns the metrics of the underlying [DataSink]
pub fn metrics(&self) -> Option<MetricsSet> {
self.sink.metrics()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ahh this was the wrong place, it should be in impl ExecutionPlan for FileSinkExec

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core Core DataFusion crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add as_any and metrics to DataSink trait
3 participants