[ST-Engine][Starter] Add seatunnel own engine starter and e2e #2690

Hisoka-X · 2022-09-08T13:59:51Z

Purpose of this pull request

Check list

Code changed are covered with tests, or it does not need tests for reason:
If any new Jar binary package adding in your PR, please add License Notice according
New License Guide
If necessary, please update the documentation to describe the new feature. https://github.com/apache/incubator-seatunnel/tree/dev/docs

…ency and bug fixed.

# Conflicts: # seatunnel-core/seatunnel-flink-starter/src/main/java/org/apache/seatunnel/core/starter/flink/config/FlinkApiConfigChecker.java # seatunnel-core/seatunnel-starter/src/main/java/org/apache/seatunnel/core/starter/seatunnel/SeaTunnel.java # seatunnel-core/seatunnel-starter/src/main/java/org/apache/seatunnel/core/starter/seatunnel/args/ExecutionModeConverter.java # seatunnel-core/seatunnel-starter/src/main/java/org/apache/seatunnel/core/starter/seatunnel/args/SeaTunnelCommandArgs.java # seatunnel-core/seatunnel-starter/src/main/java/org/apache/seatunnel/core/starter/seatunnel/command/SeaTunnelApiConfValidateCommand.java # seatunnel-core/seatunnel-starter/src/main/java/org/apache/seatunnel/core/starter/seatunnel/command/SeaTunnelApiTaskExecuteCommand.java # seatunnel-core/seatunnel-starter/src/main/java/org/apache/seatunnel/core/starter/seatunnel/command/SeaTunnelCommandBuilder.java # seatunnel-core/seatunnel-starter/src/main/java/org/apache/seatunnel/core/starter/seatunnel/config/SeaTunnelApiConfigChecker.java

# Conflicts: # seatunnel-core/seatunnel-starter/src/main/java/org/apache/seatunnel/core/starter/seatunnel/SeaTunnel.java # seatunnel-core/seatunnel-starter/src/main/java/org/apache/seatunnel/core/starter/seatunnel/args/ExecutionModeConverter.java # seatunnel-core/seatunnel-starter/src/main/java/org/apache/seatunnel/core/starter/seatunnel/args/ServerCommandArgs.java # seatunnel-core/seatunnel-starter/src/main/java/org/apache/seatunnel/core/starter/seatunnel/command/SeaTunnelApiConfValidateCommand.java # seatunnel-core/seatunnel-starter/src/main/java/org/apache/seatunnel/core/starter/seatunnel/command/SeaTunnelApiTaskExecuteCommand.java # seatunnel-core/seatunnel-starter/src/main/java/org/apache/seatunnel/core/starter/seatunnel/command/SeaTunnelCommandBuilder.java # seatunnel-core/seatunnel-starter/src/main/java/org/apache/seatunnel/core/starter/seatunnel/config/SeaTunnelApiConfigChecker.java # seatunnel-examples/seatunnel-engine-examples/pom.xml # seatunnel-examples/seatunnel-engine-examples/src/main/java/org/apache/seatunnel/example/engine/SeaTunnelEngineExample.java

...nk-starter/src/main/java/org/apache/seatunnel/core/starter/flink/utils/CommandLineUtils.java

...tunnel-spark-starter/src/main/java/org/apache/seatunnel/core/starter/spark/SparkStarter.java

seatunnel-e2e/seatunnel-engine-e2e/pom.xml

...ine-e2e/seatunnel-engine-connector-console-e2e/src/test/resources/fakesource_to_console.conf

seatunnel-engine/seatunnel-engine-client/pom.xml

# Conflicts: # seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/task/flow/SinkFlowLifeCycle.java

ashulin

Can you split this into two PR? Since this involves a lot of non-engine modules, I would expect the changes to the starter module to be committed to the dev branch first.

seatunnel-core/README.md

Hisoka-X · 2022-09-14T04:18:48Z

Can you split this into two PR? Since this involves a lot of non-engine modules, I would expect the changes to the starter module to be committed to the dev branch first.

OK

EricJoy2048 · 2022-09-14T10:51:52Z

Can you split this into two PR? Since this involves a lot of non-engine modules, I would expect the changes to the starter module to be committed to the dev branch first.

OK

#2726 has been merged.

# Conflicts: # seatunnel-core/seatunnel-flink-starter/src/main/java/org/apache/seatunnel/core/starter/flink/execution/FlinkExecution.java # seatunnel-core/seatunnel-spark-starter/src/main/java/org/apache/seatunnel/core/starter/spark/execution/SparkExecution.java

# Conflicts: # seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/task/operation/sink/SinkPrepareCommitOperation.java

Hisoka-X added 15 commits September 6, 2022 17:26

[Engine][Example] Add seatunnel example module

b41ad33

[Engine][Example] Add seatunnel e2e module

c174877

[Engine] [Core] Add seatunnel engine example

581f576

[Engine] [Core] Add seatunnel engine example

4798825

[Engine] [Core] Add seatunnel engine starter

ff0f019

[Engine] [Example] Add random cluster name when use local mode

2531fd2

[Engine] [Starter] Remove SeaTunnel engine Starter spark/flink depend…

e259eab

…ency and bug fixed.

[Engine] [Example] Fix review

015118a

[Engine] [Starter] Add seatunnel cluster and client entrance

eac73f9

Merge branch 'st-engine-e2e' into st-engine-starter

0ace7eb

[Engine] [Starter] Add seatunnel engine e2e

bcb7659

[Engine] [Starter] Add seatunnel engine e2e

882f0a5

[Engine] [Starter] Add seatunnel engine e2e

51e176b

Hisoka-X requested review from ashulin, EricJoy2048 and CalvinKirs September 8, 2022 14:09

CalvinKirs added test Zeta labels Sep 9, 2022

Hisoka-X added 2 commits September 9, 2022 10:04

[Engine] [Starter] add miss class file

b130542

[Engine] [Starter] fix ci problems

a326c5b

hailin0 reviewed Sep 9, 2022

View reviewed changes

Hisoka-X added 7 commits September 9, 2022 12:53

[Engine] [Starter] rename e2e module

00bc32e

[Engine] [Starter] fix license

1f34c74

[Engine] [Starter] fix license

f51c633

[Engine] [E2E] Change shell name in test container

8e6d641

[Engine] [E2E] Fix ci problems

122ae8b

Merge branch 'st-engine' into st-engine-starter

9efca4b

# Conflicts: # seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/task/flow/SinkFlowLifeCycle.java

Merge branch 'st-engine' into st-engine-starter

0dd52e6

[Engine] [Committer] Add committer classloader

702da46

ashulin reviewed Sep 14, 2022

View reviewed changes

EricJoy2048 reviewed Sep 14, 2022

View reviewed changes

seatunnel-core/README.md Outdated Show resolved Hide resolved

seatunnel-core/README.md Show resolved Hide resolved

Hisoka-X mentioned this pull request Sep 14, 2022

[Starter] [Core] Modify connector v2 starter #2726

Merged

3 tasks

Hisoka-X added 4 commits September 14, 2022 20:10

[Starter] [Core] Change README.md

cbc70de

[Starter] [Core] Resolved conflict

23680c9

Merge branch 'st-engine' into st-engine-starter

cf23e12

# Conflicts: # seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/task/operation/sink/SinkPrepareCommitOperation.java

EricJoy2048 merged commit c0ba069 into apache:st-engine Sep 15, 2022

Hisoka-X deleted the st-engine-starter branch September 20, 2022 09:37

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[ST-Engine][Starter] Add seatunnel own engine starter and e2e #2690

[ST-Engine][Starter] Add seatunnel own engine starter and e2e #2690

Hisoka-X commented Sep 8, 2022

ashulin left a comment

Hisoka-X commented Sep 14, 2022

EricJoy2048 commented Sep 14, 2022

[ST-Engine][Starter] Add seatunnel own engine starter and e2e #2690

[ST-Engine][Starter] Add seatunnel own engine starter and e2e #2690

Conversation

Hisoka-X commented Sep 8, 2022

Purpose of this pull request

Check list

ashulin left a comment

Choose a reason for hiding this comment

Hisoka-X commented Sep 14, 2022

EricJoy2048 commented Sep 14, 2022