Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature][Doris] Support multi-table source read #7895

Merged
merged 8 commits into from
Oct 25, 2024

Conversation

happyboy1024
Copy link
Contributor

Purpose of this pull request

Support Doris multi read and close #5731

Does this PR introduce any user-facing change?

How was this patch tested?

Check list

@@ -16,6 +16,7 @@
- [x] [schema projection](../../concept/connector-v2-features.md)
- [x] [parallelism](../../concept/connector-v2-features.md)
- [x] [support user-defined split](../../concept/connector-v2-features.md)
- [x] [support multiple table read](../../concept/connector-v2-features.md)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

update cn docs

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

update cn docs

done.

Copy link
Member

@Hisoka-X Hisoka-X left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM except one minior problem. Thanks @happyboy1024 !

DorisSourceTable dorisSourceTable =
tables.get(TablePath.of(partition.getDatabase(), partition.getTable()));
if (dorisSourceTable == null) {
return;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should throw exception.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should throw exception.
Do we need to terminate directly here? Or do we add the warn log output, what do you think?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

An exception should be thrown because if there is no bug with the connector, it should never be null

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

An exception should be thrown because if there is no bug with the connector, it should never be null

Ok, I see what you mean. I'll adjust. thx

Copy link
Member

@Hisoka-X Hisoka-X left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM if ci passes. Thanks @happyboy1024 !

@hailin0
Copy link
Member

hailin0 commented Oct 25, 2024

waiting for ci passed

@hailin0 hailin0 merged commit 10c37ac into apache:dev Oct 25, 2024
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature][Doris] Support multi-table source read
3 participants