Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Core][Starter] When use cluster mode, but starter app root dir also should same as client mode. #2141

Merged
merged 2 commits into from
Jul 14, 2022

Conversation

Hisoka-X
Copy link
Member

@Hisoka-X Hisoka-X commented Jul 6, 2022

Purpose of this pull request

When use cluster mode, but starter app root dir also should same as client mode. If not, will

➜  target git:(dev-plugin-root-dir) ✗ ./apache-seatunnel-incubating-2.1.3-SNAPSHOT/bin/start-seatunnel-spark.sh --config ./apache-seatunnel-incubating-2.1.3-SNAPSHOT/config/spark.batch.conf.template -e cluster -m local
log4j:WARN No appenders could be found for logger (org.apache.seatunnel.core.base.utils.CompressionUtils).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Exception in thread "main" java.nio.file.NoSuchFileException: plugins
        at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
        at sun.nio.fs.UnixFileAttributeViews$Basic.readAttributes(UnixFileAttributeViews.java:55)
        at sun.nio.fs.UnixFileSystemProvider.readAttributes(UnixFileSystemProvider.java:144)
        at java.nio.file.Files.readAttributes(Files.java:1737)
        at java.nio.file.FileTreeWalker.getAttributes(FileTreeWalker.java:219)
        at java.nio.file.FileTreeWalker.visit(FileTreeWalker.java:276)
        at java.nio.file.FileTreeWalker.walk(FileTreeWalker.java:322)
        at java.nio.file.Files.walkFileTree(Files.java:2662)
        at java.nio.file.Files.walkFileTree(Files.java:2742)
        at org.apache.seatunnel.core.base.utils.CompressionUtils.tarGzip(CompressionUtils.java:66)
        at org.apache.seatunnel.core.spark.SparkStarter$ClusterModeSparkStarter.buildCommands(SparkStarter.java:411)
        at org.apache.seatunnel.core.spark.SparkStarter.main(SparkStarter.java:107)

Check list

@Hisoka-X Hisoka-X merged commit d8d74f8 into apache:dev Jul 14, 2022
Hisoka-X pushed a commit that referenced this pull request Jul 26, 2022
* [Bug] [seatunnel-core] Failed to get APP_DIR path bug fixed (#2165)
[Core][Starter] When use cluster mode, but starter app root dir also should same as client mode. (#2141)
[bug]fix commandArgs -t(--check) conflict with flink deployment t… (#2174)
[Core][Starter] Change jar connector load logic (#2193)
[Core]Add plugin discovery module (#1881)
Upgrade common-collecions4 to 4.4
Upgrade common-codec to 1.13

* add plugin discover module

* Add SeaTunnel API module

* fix license check error

* ignore 403 deadlink check

* move plugin-mapping.properties to root path

* Revert "move plugin-mapping.properties to root path"

This reverts commit 372968e.

* add fake-stream config

Co-authored-by: Wenjun Ruan <wenjun@apache.org>
@Hisoka-X Hisoka-X deleted the dev-plugin-root-dir branch August 2, 2022 07:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants