Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Charts for IRSA support with Helm #601

Merged
merged 19 commits into from
Mar 14, 2023
Merged

Charts for IRSA support with Helm #601

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
e2ae7bc
kustomize manifests for irsa
ryansteakley Feb 24, 2023
a4ee6eb
Merge remote-tracking branch 'upstream' into kustomize-irsa-manifest
ryansteakley Feb 28, 2023
f91e853
add service-account yaml
ryansteakley Mar 2, 2023
e470a68
Merge remote-tracking branch 'upstream/main' into kustomize-irsa-mani…
ryansteakley Mar 2, 2023
b96fea3
add helm files for irsa and first draft for installation script changes
ryansteakley Mar 3, 2023
64354f7
run black
ryansteakley Mar 3, 2023
f993d4e
refactor and stage changes for helm charts for all static s3 login va…
ryansteakley Mar 6, 2023
4730b47
remove helm generated output
ryansteakley Mar 6, 2023
af403b8
update makefile
ryansteakley Mar 6, 2023
0a610e4
add deployment options
ryansteakley Mar 6, 2023
1c7f95c
remove unused
ryansteakley Mar 6, 2023
96ccafb
change dummy value to helm values to allow for easier conversion for …
ryansteakley Mar 10, 2023
d39dd74
merge upstream/main
ryansteakley Mar 13, 2023
16b8af7
delete unncessary files and revert python version in make
ryansteakley Mar 13, 2023
43d01a7
update setup pipelines to truncate oidc_role_name
ryansteakley Mar 13, 2023
261d38a
update names
ryansteakley Mar 13, 2023
6d9a667
update install configs
ryansteakley Mar 13, 2023
efd26da
remove extra file
ryansteakley Mar 14, 2023
5105829
truncate role name
ryansteakley Mar 14, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions Makefile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -98,6 +98,11 @@ bootstrap-pipelines: verify-cluster-variables connect-to-eks-cluster
yq e '.cluster.region=env(CLUSTER_REGION)' -i tests/e2e/utils/pipelines/config.yaml
cd tests/e2e && PYTHONPATH=.. python3.8 utils/pipelines/setup_pipelines_irsa.py

bootstrap-pipelines: verify-cluster-variables connect-to-eks-cluster
yq e '.cluster.name=env(CLUSTER_NAME)' -i tests/e2e/utils/pipelines/config.yaml
yq e '.cluster.region=env(CLUSTER_REGION)' -i tests/e2e/utils/pipelines/config.yaml
cd tests/e2e && PYTHONPATH=.. python3.8 utils/pipelines/setup_pipelines_irsa.py

cleanup-ack-req: verify-cluster-variables
yq e '.cluster.name=env(CLUSTER_NAME)' -i tests/e2e/utils/ack_sm_controller_bootstrap/config.yaml
yq e '.cluster.region=env(CLUSTER_REGION)' -i tests/e2e/utils/ack_sm_controller_bootstrap/config.yaml
Expand Down
2 changes: 1 addition & 1 deletion awsconfigs/apps/pipeline/s3/service-account.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,4 +4,4 @@ metadata:
name: ml-pipeline
namespace: kubeflow
annotations:
eks.amazonaws.com/role-arn: '{{ .Values.irsa.roleName }}'
eks.amazonaws.com/role-arn: '{{ .Values.irsa.roleArn }}'
6 changes: 6 additions & 0 deletions charts/apps/kubeflow-pipelines/rds-s3-static/Chart.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
apiVersion: v2
appVersion: 2.0.0-alpha.6
description: A Helm chart for Kubernetes
name: kubeflow-pipelines
type: application
version: 0.2.0
39 changes: 39 additions & 0 deletions ...nes/rds-s3-static/crds/clusterworkflowtemplates.argoproj.io-CustomResourceDefinition.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
2023/03/05 23:26:52 well-defined vars that were never replaced: kfp-app-name,kfp-app-version
apiVersion: apiextensions.k8s.io/v1
kind: CustomResourceDefinition
metadata:
labels:
application-crd-id: kubeflow-pipelines
name: clusterworkflowtemplates.argoproj.io
spec:
group: argoproj.io
names:
kind: ClusterWorkflowTemplate
listKind: ClusterWorkflowTemplateList
plural: clusterworkflowtemplates
shortNames:
- clusterwftmpl
- cwft
singular: clusterworkflowtemplate
scope: Cluster
versions:
- name: v1alpha1
schema:
openAPIV3Schema:
properties:
apiVersion:
type: string
kind:
type: string
metadata:
type: object
spec:
type: object
x-kubernetes-map-type: atomic
x-kubernetes-preserve-unknown-fields: true
required:
- metadata
- spec
type: object
served: true
storage: true
251 changes: 251 additions & 0 deletions ...s-s3-static/crds/compositecontrollers.metacontroller.k8s.io-CustomResourceDefinition.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,251 @@
apiVersion: apiextensions.k8s.io/v1
kind: CustomResourceDefinition
metadata:
annotations:
api-approved.kubernetes.io: unapproved, request not yet submitted
labels:
application-crd-id: kubeflow-pipelines
kustomize.component: metacontroller
name: compositecontrollers.metacontroller.k8s.io
spec:
group: metacontroller.k8s.io
names:
kind: CompositeController
listKind: CompositeControllerList
plural: compositecontrollers
shortNames:
- cc
- cctl
singular: compositecontroller
scope: Cluster
versions:
- name: v1alpha1
schema:
openAPIV3Schema:
properties:
apiVersion:
description: 'APIVersion defines the versioned schema of this representation
of an object. Servers should convert recognized schemas to the latest
internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources'
type: string
kind:
description: 'Kind is a string value representing the REST resource this
object represents. Servers may infer this from the endpoint the client
submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds'
type: string
metadata:
type: object
spec:
properties:
childResources:
items:
properties:
apiVersion:
type: string
resource:
type: string
updateStrategy:
properties:
method:
type: string
statusChecks:
properties:
conditions:
items:
properties:
reason:
type: string
status:
type: string
type:
type: string
required:
- type
type: object
type: array
type: object
type: object
required:
- apiVersion
- resource
type: object
type: array
generateSelector:
type: boolean
hooks:
properties:
customize:
properties:
webhook:
properties:
path:
type: string
service:
properties:
name:
type: string
namespace:
type: string
port:
format: int32
type: integer
protocol:
type: string
required:
- name
- namespace
type: object
timeout:
type: string
url:
type: string
type: object
type: object
finalize:
properties:
webhook:
properties:
path:
type: string
service:
properties:
name:
type: string
namespace:
type: string
port:
format: int32
type: integer
protocol:
type: string
required:
- name
- namespace
type: object
timeout:
type: string
url:
type: string
type: object
type: object
postUpdateChild:
properties:
webhook:
properties:
path:
type: string
service:
properties:
name:
type: string
namespace:
type: string
port:
format: int32
type: integer
protocol:
type: string
required:
- name
- namespace
type: object
timeout:
type: string
url:
type: string
type: object
type: object
preUpdateChild:
properties:
webhook:
properties:
path:
type: string
service:
properties:
name:
type: string
namespace:
type: string
port:
format: int32
type: integer
protocol:
type: string
required:
- name
- namespace
type: object
timeout:
type: string
url:
type: string
type: object
type: object
sync:
properties:
webhook:
properties:
path:
type: string
service:
properties:
name:
type: string
namespace:
type: string
port:
format: int32
type: integer
protocol:
type: string
required:
- name
- namespace
type: object
timeout:
type: string
url:
type: string
type: object
type: object
type: object
parentResource:
properties:
apiVersion:
type: string
resource:
type: string
revisionHistory:
properties:
fieldPaths:
items:
type: string
type: array
type: object
required:
- apiVersion
- resource
type: object
resyncPeriodSeconds:
format: int32
type: integer
required:
- parentResource
type: object
status:
type: object
required:
- metadata
- spec
type: object
served: true
storage: true
subresources:
status: {}
status:
acceptedNames:
kind: ''
plural: ''
conditions: []
storedVersions: []
67 changes: 67 additions & 0 deletions ...ds-s3-static/crds/controllerrevisions.metacontroller.k8s.io-CustomResourceDefinition.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,67 @@
apiVersion: apiextensions.k8s.io/v1
kind: CustomResourceDefinition
metadata:
annotations:
api-approved.kubernetes.io: unapproved, request not yet submitted
labels:
application-crd-id: kubeflow-pipelines
kustomize.component: metacontroller
name: controllerrevisions.metacontroller.k8s.io
spec:
group: metacontroller.k8s.io
names:
kind: ControllerRevision
listKind: ControllerRevisionList
plural: controllerrevisions
singular: controllerrevision
scope: Namespaced
versions:
- name: v1alpha1
schema:
openAPIV3Schema:
properties:
apiVersion:
description: 'APIVersion defines the versioned schema of this representation
of an object. Servers should convert recognized schemas to the latest
internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources'
type: string
children:
items:
properties:
apiGroup:
type: string
kind:
type: string
names:
items:
type: string
type: array
required:
- apiGroup
- kind
- names
type: object
type: array
kind:
description: 'Kind is a string value representing the REST resource this
object represents. Servers may infer this from the endpoint the client
submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds'
type: string
metadata:
type: object
parentPatch:
type: object
required:
- metadata
- parentPatch
type: object
served: true
storage: true
subresources:
status: {}
status:
acceptedNames:
kind: ''
plural: ''
conditions: []
storedVersions: []
Loading