Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[hostfix][hive] add HIVe table check and correct function #1425

Merged
merged 2 commits into from
Dec 4, 2022
Merged

[hostfix][hive] add HIVe table check and correct function #1425

merged 2 commits into from
Dec 4, 2022

Conversation

conghe2402
Copy link
Contributor

Purpose of this pull request

add function to try to transform a valid format of hive table name from source table name that is not compatible with hive specification.

conghe2402
conghe2402 commented Dec 2, 2022
View reviewed changes
Copy link
Contributor Author

@conghe2402 conghe2402 left a comment •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

场景：
从源库同步，由于源库比如oracle 这种 表名规范是可以带其他特殊字符的，但是hive 并不能支持，所以会导致同步失败。
例如：oracle源表名： C##8889df.ORDDCM_ANON_AT ，任务启动后，写数据时会创建 C##8889df.ORDDCM_ANON_AT 表，提交到hive会导致 解析失败。

@FlechazoW FlechazoW merged commit 1c9c789 into DTStack:master Dec 4, 2022
ll076110 pushed a commit that referenced this pull request Mar 3, 2023
@conghe2402
[Improve][Hive] Add Hive table check and correct function (#1425)
f3372f8 
(cherry picked from commit 1c9c789)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@conghe2402 @FlechazoW