You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
And it fails with error message related to ServiceAccount:
Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. pods \"sparktest-driver\" is forbidden: error looking up service account default/spark: serviceaccount \"spark\" not found.
And there is no flags in spark submit spark used to configure ServiceAccount:
$ bin/arena submit spark --help
Submit a common spark application job.
Usage:
arena submit sparkjob [flags]
Aliases:
sparkjob, spark
Flags:
-a, --annotation stringArray the annotations, usage: "--annotation=key=value" or "--annotation key=value"
--driver-cpu-request int cpu request for driver pod (default 1)
--driver-memory-request string memory request for driver pod (min is 500m) (default "500m")
--executor-cpu-request int cpu request for executor pod (default 1)
--executor-memory-request string memory request for executor pod (min is 500m) (default "500m")
-h, --help help for sparkjob
--image string the docker image name of training job (default "registry.aliyuncs.com/acs/spark:v2.4.0")
--jar string jar path in image (default "local:///opt/spark/examples/jars/spark-examples_2.11-2.4.0.jar")
-l, --label stringArray specify the label
--main-class string main class of your jar (default "org.apache.spark.examples.SparkPi")
--name string override name
--replicas int the executor's number to run the distributed training. (default 1)
The text was updated successfully, but these errors were encountered:
I tried to submit Spark training job, refering Submit a distributed spark job - Arena Documentation.
And it fails with error message related to ServiceAccount:
And there is no flags in
spark submit spark
used to configure ServiceAccount:The text was updated successfully, but these errors were encountered: