Skip to content
This repository has been archived by the owner on Nov 22, 2024. It is now read-only.

Remove the obsolete custom spark operator from the docs #1003

Merged
merged 1 commit into from
Mar 23, 2021
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -40,8 +40,7 @@ metricsPrefix: ""
resyncInterval: 30
webhookPort: 8080
sparkJobNamespace: ""
operatorImageName: "lightbend/sparkoperator"
operatorVersion: "{cloudflow-version}-cloudflow-spark-2.4.5-1.1.2-scala-2.12"
operatorVersion: latest
---
kind: Service
apiVersion: v1
Expand All @@ -52,18 +51,16 @@ metadata:
spec:
selector:
app.kubernetes.io/name: sparkoperator
app.kubernetes.io/version: {cloudflow-version}-cloudflow-spark-2.4.5-1.1.2-scala-2.12
EOF
----

Now we can install the Spark operator using Helm. Note that we use a specific version of the Spark operator Helm chart.

[source,shell script,subs="attributes"]
----
helm install spark-operator incubator/sparkoperator \
--namespace cloudflow \
helm upgrade -i spark-operator incubator/sparkoperator \
--values="spark-values.yaml" \
--version "0.6.7"
--namespace cloudflow
----

[IMPORTANT]
Expand Down Expand Up @@ -123,7 +120,7 @@ spec:
- "-c"
- |
apk update && apk add wget
wget -q -O /bin/kubectl https://storage.googleapis.com/kubernetes-release/release/v1.16.12/bin/linux/amd64/kubectl && chmod 755 /bin/kubectl
wget -q -O /bin/kubectl https://storage.googleapis.com/kubernetes-release/release/v1.19.6/bin/linux/amd64/kubectl && chmod 755 /bin/kubectl
NAME="spark-operator-sparkoperator"
API_VERSION=$(kubectl get deployment -n cloudflow $NAME -o jsonpath='{.apiVersion}')
UUID=$(kubectl get deployment -n cloudflow $NAME -o jsonpath='{.metadata.uid}')
Expand Down