Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update pythonVersion to fix example #1284

Merged
merged 1 commit into from
Jun 30, 2021
Merged

Conversation

stratus
Copy link
Contributor

@stratus stratus commented Jun 20, 2021

spark 3.1.1 (specified in image) doesn't work with Python 2.
This change updates pythonVersion from 2 to 3.

spark 3.1.1 (specified in image) doesn't work with Python 2. 
This change updates pythonVersion from 2 to 3.
@stratus
Copy link
Contributor Author

stratus commented Jun 20, 2021

FWIW, I've tested this on a Mac as follows (w/o the sed call I'd get the python version related error):

kind create cluster --name spark-foo
kubectl cluster-info --context kind-spark-foo

git clone https://github.com/GoogleCloudPlatform/spark-on-k8s-operator
cd spark-on-k8s-operator
sed -i '' 's/pythonVersion: "2"/pythonVersion: "3"/' examples/spark-py-pi.yaml

helm repo add spark-operator https://googlecloudplatform.github.io/spark-on-k8s-operator
helm install my-release spark-operator/spark-operator
--namespace spark-operator --create-namespace
--set webhook.enable=true --set image.tag=latest

kubectl apply -f manifest/spark-rbac.yaml
kubectl apply -f examples/spark-py-pi.yaml

@liyinan926 liyinan926 merged commit 1777590 into kubeflow:master Jun 30, 2021
jbhalodia-slack pushed a commit to jbhalodia-slack/spark-operator that referenced this pull request Oct 4, 2024
spark 3.1.1 (specified in image) doesn't work with Python 2. 
This change updates pythonVersion from 2 to 3.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants