[Feature][Connector-V2] new connecotor of Elasticsearch source(#2553) #2554
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
No problem |
531651225
reviewed
Sep 3, 2022
Comment on lines
52
to
57
| sink { | ||
| Console {} | ||
|
|
||
| # If you would like to get more information about how to configure seatunnel and see full list of sink plugins, | ||
| # please go to https://seatunnel.apache.org/docs/category/sink-v2 | ||
| } |
There was a problem hiding this comment.
How to use use Assert sink to check datatype or combine source and sink into one test like #2499 ?
hailin0
reviewed
Sep 3, 2022
Comment on lines
56
to
57
| Container.ExecResult sinkEsResult = executeSeaTunnelFlinkJob("/elasticsearch/fakesource_to_elasticsearch.conf"); | ||
| Assertions.assertEquals(0, sinkEsResult.getExitCode()); |
There was a problem hiding this comment.
This is not a duplicate.You need a had docs index before source from elasticsearch.
There was a problem hiding this comment.
Duplicate with FakeSourceToElasticsearchIT.java testcase?
| } | ||
|
|
||
| @Test | ||
| public void testFakeSourceToConsoleSink() throws IOException, InterruptedException { |
There was a problem hiding this comment.
rename to testElasticsearchSourceToConsoleSink?
added 7 commits
September 3, 2022 22:41
Hisoka-X
reviewed
Sep 5, 2022
| @@ -0,0 +1,58 @@ | |||
| # Elasticsearch | |||
|
|
|||
| ## Description | |||
There was a problem hiding this comment.
Please update doc to match new format, reference: #2625
* [Improve][build] Improved scope of maven-shade-plugin * Excludes log dependencies in maven-shade-plugin * common/base module need skip shading * common/base module need skip shading
* fix the e2e exec error in win10-os,because line separator.
Co-authored-by: CalvinKirs <kirs@apache.org> Co-authored-by: Zongwen Li <zongwen.li.tech@gmail.com>
…#2639) * [Bug] fix flink-start didn't load plugins/${pluginName}/lib/* Co-authored-by: laglangyue <laglangyue@qq.com>
* [Connector-V2][JDBC-connector] Add DM source and sink connector
* [Improve][e2e] flink container only copy required connector jars * rename flink-e2e-common * remove useless imported * [Improve][e2e] flink sql container refactoring * remove useless imported * remove useless * [Improve][e2e] spark container only copy required connector jars * change for code review * Use e2e-common module directly * checkstyle * code format
…odule (apache#2702) * [Improve][build] The e2e module don't depend on the connector*-dist module * fix connector type error * fix flink sql
* [build] Change the packing mode of seatunnel connectors * change the activation mode Use '!' can cause '<activeByDefault>true' failed * simple starter code * fix starter jar output file name
* [Feature][Connector-V2] Add mongodb connecter sink * Add license header * Add spark mongodb sink e2e * Add spark mongodb sink e2e * Fix * Fix * Fix
…pache#2711) * [Bug][Connector-V2-e2e] Fix jackson dependency conflict * [Bug][Connector-V2-spark-examples] Fix jackson dependency conflict
…e#2715) * [Bug]fix path split exception in win10,not check file existed * improve code Co-authored-by: laglangyue <laglangyue@qq.com>
* [Improve][e2e] Improved e2e start sleep * update * update * fix 2675
…ton pattern (apache#2706) * remove singleton pattern for SeaTunnelContext * rename SeaTunnelContext to JobContext and fix checkstyle * fix checkstyle * put the constructor on top
* [Starter] [Core] Modify connector v2 starter and remove spark/flink in seatunnel-core-starter
…pache#2637) * [hotfix] data,time,timestamp convert for spark * fxi the instant convert * revert to nullable field value * Update exception info * Update exception info Co-authored-by: laglangyue <laglangyue@qq.com> Co-authored-by: Zongwen Li <zongwen.li.tech@gmail.com>
…ure (apache#2701) * [Improve][Connector-V2] Refactor hdfs file sink codes
* Fix SeaTunnelRow convert to json format error * Rename `bootstrap.server` to `bootstrap.servers` in kafka source config * Remove `kafka.` prefix in sink producer configuration key
* [Feature][Connector-V2] Add iceberg source connector Co-authored-by: wanghailin <wanghaiin@apache.org>
* [Feat][UI] Update task service in the project. * [Feat][UI] Update task service in the project.
…l into dev-20220820 � Conflicts: � seatunnel-connectors-v2/connector-elasticsearch/src/java/org/apache/seatunnel/connectors/seatunnel/elasticsearch/client/EsRestClient.java � seatunnel-connectors-v2/connector-elasticsearch/src/main/java/org/apache/seatunnel/connectors/seatunnel/elasticsearch/sink/ElasticsearchSinkWriter.java � seatunnel-e2e/seatunnel-flink-connector-v2-e2e/pom.xml � seatunnel-e2e/seatunnel-spark-connector-v2-e2e/pom.xml
|
Replace with #2821, so I will close this pr. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Purpose of this pull request
close #2553
Check list
New License Guide