Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/sink canal protocol #649

Merged
merged 15 commits into from
Jun 16, 2020

Conversation

oscar-zyh
Copy link
Contributor

@oscar-zyh oscar-zyh commented Jun 12, 2020

What problem does this PR solve?

support canal protocol in mqSink
https://github.com/pingcap/ticdc/issues/607

What is changed and how it works?

implements the EventBatchEncoder interface by CanalEventBatchEncoder

Tests

  • Manual test (add detailed scripts or steps below)

Release note

  • support canal protocol in mq sink

@CLAassistant
Copy link

CLAassistant commented Jun 12, 2020

CLA assistant check
All committers have signed the CLA.

@zier-one zier-one added component/sink Sink component. enhancement status/ptal Could you please take a look? labels Jun 12, 2020
@zier-one
Copy link
Contributor

/run-integration-tests

cdc/sink/codec/interface.go Show resolved Hide resolved
cdc/sink/codec/interface.go Show resolved Hide resolved
cdc/sink/codec/canal.go Show resolved Hide resolved
@codecov-commenter
Copy link

codecov-commenter commented Jun 15, 2020

Codecov Report

Merging #649 into master will increase coverage by 0.5254%.
The diff coverage is 45.8904%.

@@               Coverage Diff                @@
##             master       #649        +/-   ##
================================================
+ Coverage   32.4923%   33.0177%   +0.5254%     
================================================
  Files            84         87         +3     
  Lines          8482       8768       +286     
================================================
+ Hits           2756       2895       +139     
- Misses         5512       5646       +134     
- Partials        214        227        +13     

@zier-one zier-one added this to the v4.0.2 milestone Jun 15, 2020
@@ -0,0 +1,154 @@
syntax = "proto3";
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you add Alibaba Apache-2.0 license header?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@@ -0,0 +1,230 @@
syntax = "proto3";
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you add Alibaba Apache-2.0 license header?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add warning log for unsupported EventBatchEncoder protocol
reorder the imports in cdc/sink/codec/interface.go
Copy link
Contributor

@zier-one zier-one left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@zier-one zier-one added the LGT1 label Jun 16, 2020
@zier-one
Copy link
Contributor

/run-integration-tests

@oscar-zyh
Copy link
Contributor Author

/run-integration-tests

Copy link
Contributor

@amyangfei amyangfei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@amyangfei amyangfei added LGT2 and removed LGT1 labels Jun 16, 2020
@zier-one zier-one merged commit 546e225 into pingcap:master Jun 16, 2020
@oscar-zyh oscar-zyh deleted the feature/sink-canal-protocol branch June 17, 2020 02:11
@oscar-zyh oscar-zyh restored the feature/sink-canal-protocol branch June 17, 2020 02:12
5kbpers pushed a commit to 5kbpers/ticdc that referenced this pull request Aug 24, 2020
@oscar-zyh oscar-zyh deleted the feature/sink-canal-protocol branch September 22, 2020 07:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/sink Sink component. status/ptal Could you please take a look?
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants