-
Notifications
You must be signed in to change notification settings - Fork 590
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(stream): add append_only in proto stream node #2020
Conversation
Codecov Report
@@ Coverage Diff @@
## main #2020 +/- ##
=======================================
Coverage 70.65% 70.65%
=======================================
Files 629 629
Lines 80967 80987 +20
=======================================
+ Hits 57208 57223 +15
- Misses 23759 23764 +5
Flags with carried forward coverage won't be shown. Click here to find out more.
📣 Codecov can now indicate which changes are the most critical in Pull Requests. Learn more |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Rest LGTM
@@ -581,6 +582,7 @@ where | |||
fields: chain_node.upstream_fields.clone(), | |||
operator_id: merge_node.operator_id, | |||
identity: "MergeExecutor".to_string(), | |||
append_only: stream_node.append_only, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we determine append_only
of upstream node solely from the StreamTableScan
's append_only
property?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I saw that append_only
of StreamTableScan
is always false
... So I think we can follow the append_only
property given by frontend for now. If there's issue after we implement the full append-only inference, let's fix it later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In fact I think the information should be in the catalog of the mv...
@@ -164,6 +165,7 @@ impl StreamTableScan { | |||
} else { | |||
"".into() | |||
}, | |||
append_only: false, // TODO |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should be self.append_only
?
@@ -127,6 +127,7 @@ impl StreamTableScan { | |||
pk_indices: pk_indices.clone(), | |||
input: vec![], | |||
fields: vec![], // TODO: fill this later | |||
append_only: true, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
For L117 (MergeNode), also should be self.append_only
?
What's changed and what's your intention?
add append_only in proto stream node
Checklist
Refer to a related PR or issue link (optional)