Feature 1.6 upgrade (#99)

* releasing: Add WG-Notebooks leads to release owners (#5777)

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>

* Specify commonLabels for tensorboard-controller (#5780)

* Remove jlewi as an approver (#5786)

Removing myself as an owner. This should lead to better auto-assignment of code reviews.

* Update notebook server base images (#5804)

* Update second layer docker images to new tags and some python deps (#5809)

* Update image tags and python packages in pytorch and tensorflow full dockerfiles (#5817)

* Add CI format checks for the Jupyter web app (#5811)

* jwa(front): Add npm rule for checking the format

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* ci: Add common tasks for format checks

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* ci(jwa): Add format check tasks

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(back): Fix formatting

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): Fix formatting

Run `npm run format:write` on frontend

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): Include prettier in package.json

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(docker): Don't copy node_modules in Dockerfile

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps: Add global dockerignore file

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa: Remove unused dockerignore file

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(make): Don't include dockerignore and cleanup

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* initial notebook server images README.md (#5818)

* tensorboard-controller: Fix scheduling unbound PVCs (#5819)

When the TB controller attempts to schedule a RWO PVC it checks its
accessModes in the PVC status. The controller panics if the list is
empty.

This commit adds a check to ensure the list is not empty.

Signed-off-by: Ilias Katsakioris <elikatsis@arrikto.com>

* Fix profile-controller CRD pruning issue (#5822)

* api: Add marker for preserving unknown fields in Plugins

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>

* manifests: Regenerate manifests

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>

* Remove Logo Trademarks from the Jupyter Web App and make logos configurable (#5823)

* rebase: Make logos configurable in configmap and remove trademark references

Rebased to remove the changes to the package-lock.json

* review: add suggested changes and add image group section to README

* Make notebook limits configurable with a multiplication factor (#5815)

* Make notebook limits configurable with a multiplication factor

* Make limits configurable under advanced section

* run prettier to format frontend code

* fix formatting and add rounding in backend

* Return error if limit is smaller than request

* Allow disabling limitFactor by setting it to none

* review: remove camelCase in python backend

* fix: update spawner_ui_config.yaml in manifests directory

* review: fix setting limits backend

* review: remove unnecessary check from backend

* notebook-servers: Update JupyterLab and add Git Extension (#5846)

* chore: Add comment to reference RStudio license. (#5884)

* CI/CD: add kustomize build tests (#5919)

* Add CI format checks for the Volumes web app (#5820)

* vwa(front): Add npm script to check the formatting

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(front): Update the package-lock.json

Run `npm install` to bring the package-lock.json up to date

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(front): Fix formatting

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(back): Fix formatting

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(docker): Remove unused dockerignore file

We have created a global dockerignore file for all the web apps in the
parent dir.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(docker): Don't copy node_modules in dockerfile

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(make): Don't include dockerignore

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* ci(vwa): Add format check tasks

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(docker): Copy only necessary files for build

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* review: Use docker context instead of cd ..

Don't use a `cd ..` and copy dockerignore files back and forth. Instead
we should use the Docker context and the global dockerignore file we
have for all the web apps.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* tensorboard-controller: fix binding issue (#5925)

* JWA: Don't override assets with logos ConfigMap (#5942)

* jwa(front): Add static logos in the app

The app does not contain the logos' svgs in its source code/static
files. This results in the icons to not show when developing locally.

This commit adds the svgs found in the logos ConfigMap to the static
files of the app as well.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): Change logos fetch url

Change the URLs of the logos from `static/assets/*` to
`static/assets/logos`.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(manifests): Don't override assets with logos

Mount the ConfigMap under the `static/assets/logos` directory to not
override the contents of the entire assets dir.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Make it possible to add Namespaced menu items (#5871)

* Make it possible to add Namespaced menu items

* Reduce the nesting levels

* FIX The number of gpu must be set as string in Kubernetes/Openshift (#5891)

* Update form.py

* Update form.py

* Update form-default.component.ts

* fix whitespace issue

* feat(jupyter): add fonts as assets to service (#5691)

* cwa(front): Ignore font files in assets

* feat(jupyter): add fonts as assets to service

* CRUD: fonts in common

* CWA: Remove link to css file

* jwa(front): Remove font assets from jupyter

Co-authored-by: Wendy Gaultier <wvgaultier@gmail.com>

* Update base notebook for Renovate compatibility (#5955)

* Update base notebook for Renovate compatibility

* Separate kubectl and S6 arch

* Update jupyter, rstudio and vs code notebook images + allow rstudio in iframe (#5961)

* Update jupyter, rstudio and vs code notebook images

* Remove sed and use substring removal

* Make menu bar scrollable again (#5964)

* [fix]: Make jupyter-web-app parse workspace volume MountPath (#5952)

* [fix]: Make jupyter-web-app parse workspace volume MountPath

- workspace volume path was fixed with "/home/jovyan"
- it should be enable to parse from jupyter-web-app-config's data

* change parsing key correctly

* Remove the f-strings in the Jupyter web app's backend (#5680)

* Notebook servers: Add explanation about kernel not connecting (#5920)

* fix(profile-controller): KNative probes (#5848)

Knative control-plane components need to probe certain paths of Knative
Pods, in order to function correctly. These paths are:
- /healthz
- /metrics
- /ready
- /wait-for-drain

For this reason, we extend the Profile Controller to apply an Istio
AuthorizationPolicy that allows traffic to these HTTP paths for Pods in
user namespaces, as per Knative's instructions:
https://knative.dev/docs/serving/istio-authorization/#allowing-access-from-system-pods-by-paths

This only fixes requests through the public ingress. Cluster-internal
traffic and predictor-transformer use-cases are not supported yet. We
continue discussing these in kubeflow#5965.

Refs kubeflow#5965
Refs kubeflow/kfserving#1558

Signed-off-by: Yurii Komar <subreptivus@gmail.com>

* feat(jupyter): Support hiding image registry/tag (#5681)

* feat(jupyter): Support hiding image registry/tag

* feat(jupyter): Support hiding VSCode/RStudio images registry/tag

* rebasing onto upstream master

* fix: formatting with prettier and set default hideRegistry=true

* fix: move hideRegistry and hideTag from spawnerFormDefaults.image

* fix whitespace

* add tooltip for images

Co-authored-by: JessicaBarh <jessicabarhoma@gmail.com>

* Update dockerfiles and make compatible with Renovate (#5968)

* Update dockerfiles and make compatible with Renovate

* Set memory for jupyter pytorch to the same as jupyter tensorflow

* Update protobuf

* Remove conda version and use substring expansion

* Update SQLAlchemy

* Update dill

* Create OWNERS file in .github folder for Renovate config + workflows (#5983)

* Extend deadline for PyTorch image building (#5991)

* Allow user to add/delete labels to user namespace using ConfigMap. Fix #5712 (#5761)

The profile-controller applies a hardcoded list of labels to Profile
namespaces. Make this list of labels configurable with a ConfigMap. The
new list of steps for the profile-controller is:

1. **(new)** Profile-controller starts and reads the file given by the
   `--namespace-labels-path` CLI flag (defaults to
   `/etc/profile-controller/namespace-labels.yaml`). This file contains
   a YAML dict of label key/values to add to each Profile namespace.
2. Profile-controller creates namespace.
3. Profile-controller merges existing namespace labels with given
   labels. A given label is applied ONLY if it doesn't exist already.
4. **(new)** If a given label value is empty (``), remove the label from
   the namespace if it already exists.

We are using a ConfigMap instead of a plain CLI flag, so that users can
change the list of labels without restarting the profile-controller.

Closes #5712

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>

Co-authored-by: James Liu <jamxl@google.com>

Co-authored-by: Yannis Zarkadas <yanniszark@arrikto.com>

* Update last batch of notebook server Dockerfiles (#5997)

* Update spawner_ui_config.yaml with new tags (#5998)

* Update images in spawner_ui_config.yaml

* Update manifest image tags

* CRUD web apps:  i18n (#5880)

* feat(jupyter): add modules for translations

* feat(jupyter): fix path for translations + add GPU translations

* feat(jupyter): add translations

* feat(jupyter): add translations to form-default

* feat(jupyter): add translations to affinity/tolerations

* feat(jupyter): add translations to Image Pull Policy

* feat(jupyter): remove imports from app.module.ts + fix translations

* web-apps(front): add TranslationModule to common for jupyter

* Implement i18n for jupyter frontend
- Including common components needed
- Refactor translation file

* web-apps(front): add i18n to messages from backend
Status tooltip text
Snackbar message

* web-apps(front): volumes and tensorboards i18n ini
Add the i18n feature for the other 2 projects

* feat(volume): add translations for volume

* feat(jupyter): refactor asset file

* Update asset files for all folders

* feat(tensorboards): add i18n
Update all asset files

* cwa: add new translations

* cwa: Add README documentation

* fix: formatting with prettier

* Fix tests

* Fix python format

* remove comment

Co-authored-by: saffaalvi <alvi118@uwindsor.ca>
Co-authored-by: Jose-Matsuda <tongster789@gmail.com>

* Remove deprecated JWA (#5959)

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Sync spawner yaml from source to manifests (#5999)

* notebooks: Add additional PGP server for RStudio package validation (#6010)

* Change PGP server for RStudio validation to pgp.surfnet.nl

* Add as secondary keyserver

* Add support for ServiceAccountName and AutomountServiceAccountName to admission-webhook (#5939)

* WA: Use relative paths for fetching translation files (#6034)

* jwa(front): Use relative path for i18n json

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(front): Use relative path for i18n json

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa(front): Use relative path for i18n json

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Update CRUD web apps from Angular 8 to Angular 12 (#6004)

* common: update angular core and cli to 9

ng update @angular/core@9 @angular/cli@9

* common: update material, cdk and cdk-experimental to 9

ng update @angular/cdk@9 @angular/material@9 @angular/cdk-experimental@9

* common: remove entryComponents and replace TestBed.get with TestBed.inject

Edit files manually

* common: make compatible with Angular 9

Edit files manually

* common: update fontawesome to 0.6.0

npm i @fortawesome/angular-fontawesome@0.6.0

* update kubeflow-common project dependencies

* common: add @angular/localize

ng add @angular/localize

* jupyter: update angular core and cli 8

ng update @angular/core@8 @angular/cli@8

* jupyter: update angular core and cli to 9

ng update @angular/core@9 @angular/cli@9

* jupyter: update material, cdk and cdk-experimental to 9

ng update @angular/cdk@9 @angular/material@9 @angular/cdk-experimental@9

* jupyter: remove entryComponents

Edit file manually

* jupyter: update fontawesome to 0.6.0

npm i @fortawesome/angular-fontawesome@0.6.0

* jupyter: add @angular/localize

ng add @angular/localize

* tensorboards: update angular core and cli to 9

ng update @angular/core@9 @angular/cli@9

* tensorboards: update material, cdk and cdk-experimental to 9

ng update @angular/cdk@9 @angular/material@9 @angular/cdk-experimental@9

* tensorboards: remove entryComponents and replace TestBed.get with TestBed.inje…

Edit files manually

* tensorboards: update fontawesome to 0.6.0

npm i @fortawesome/angular-fontawesome@0.6.0

* tensorboards: add @angular/localize

ng add @angular/localize

* Fix tensorboards-web-app run-dev in makefile

Edit file manually

* volumes: update angular core and cli to 9

ng update @angular/core@9 @angular/cli@9

* volumes: update material, cdk and cdk-experimental to 9

ng update @angular/cdk@9 @angular/material@9 @angular/cdk-experimental@9

* volumes: remove entryComponents and replace TestBed.get with TestBe…

Edit files manually

* volumes: update fontawesome to 0.6.0

npm i @fortawesome/angular-fontawesome@0.6.0

* volumes: add @angular/localize

ng add @angular/localize

* common: update angular core and cli to 10

ng update @angular/core@10 @angular/cli@10 --force

* common: update material, cdk and cdk-experimental to 10

ng update @angular/cdk@10 @angular/material@10 @angular/cdk-experimental@10

* update kubeflow-common project dependencies

Edit file manually

* common: update fontawesome to 0.7.0

npm i @fortawesome/angular-fontawesome@0.7.0

* common: fix font location

Edit file manually

* jupyter: update angular-fontawesome to 0.7.0

npm i @fortawesome/angular-fontawesome@0.7.0

* jupyter: update angular core and cli to 10

ng update @angular/core@10 @angular/cli@10

* jupyter: update material, cdk and cdk-experimental to 10

ng update @angular/cdk@10 @angular/material@10 @angular/cdk-experimental@10

* tensorboards: update angular-fontawesome to 0.7.0

npm i @fortawesome/angular-fontawesome@0.7.0

* tensorboards: update angular core and cli to 10

ng update @angular/core@10 @angular/cli@10

* tensorboards: update material, cdk and cdk-experimental to 10

ng update @angular/cdk@10 @angular/material@10 @angular/cdk-experimental@10

* volumes: update angular-fontawesome to 0.7.0

npm i @fortawesome/angular-fontawesome@0.7.0

* volumes: update angular core and cli to 10

ng update @angular/core@10 @angular/cli@10

* volumes: update material, cdk and cdk-experimental to 10

ng update @angular/cdk@10 @angular/material@10 @angular/cdk-experimental@10

* common: update angular-fontawesome to 0.8.2

npm i @fortawesome/angular-fontawesome@0.8.2

* common: update codelyzer to 6.0.2

npm i codelyzer@6.0.2

* common: install @angular-devkit/core@11

npm install --save-dev @angular-devkit/core@11

* common: update angular core and cli to 11

ng update @angular/core@11 @angular/cli@11

* common: update material, cdk and cdk-experimental to 11

ng update @angular/cdk@11 @angular/material@11 @angular/cdk-experimental@11

* update kubeflow-common project dependencies

Edit file manually

* jupyter: update angular-fontawesome to 0.8.2

npm i @fortawesome/angular-fontawesome@0.8.2

* jupyter: update codelyzer to 6.0.2

npm i codelyzer@6.0.2

* jupyter: update angular core and cli to 11

ng update @angular/core@11 @angular/cli@11

* jupyter: update material, cdk and cdk-experimental to 11

ng update @angular/cdk@11 @angular/material@11 @angular/cdk-experimental@11

* tensorboards: update angular-fontawesome to 0.8.2

npm i @fortawesome/angular-fontawesome@0.8.2

* tensorboards: update codelyzer to 6.0.2

npm i codelyzer@6.0.2

* tensorboards: update angular core and cli to 11

ng update @angular/core@11 @angular/cli@11

* tensorboards: update material, cdk and cdk-experimental to 11

ng update @angular/cdk@11 @angular/material@11 @angular/cdk-experimental@11

* volumes: update angular-fontawesome to 0.8.2

npm i @fortawesome/angular-fontawesome@0.8.2

* volumes: update codelyzer to 6.0.2

npm i codelyzer@6.0.2

* volumes: update angular core and cli to 11

ng update @angular/core@11 @angular/cli@11

* volumes: update material, cdk and cdk-experimental to 11

ng update @angular/cdk@11 @angular/material@11 @angular/cdk-experimental@11

* common: Fix CI failure

* jupyter: npm run format:write

npm run format:write

* volumes: npm run format:write

npm run format:write

* tensorboards: manually run prettier

prettier --write 'src/**/*.{js,ts,html,scss,css}'

* common: Fix MockComponent entryComponents for CI

Manually edit file

* common: update angular-fontawesome to 0.9.0

npm i @fortawesome/angular-fontawesome@0.9.0

* common: update angular core and cli to 12

ng update @angular/core@12 @angular/cli@12

* common: update material, cdk and cdk-experimental to 12

ng update @angular/cdk@12 @angular/material@12 @angular/cdk-experimental@12

* update kubeflow-common project dependencies

Edit file manually

* common: fix Intl.DateTimeFormatOptions

Edit file manually. Type of defaultDateOptions and defaultTimeOptions needs to explicitly be set to Intl.DateTimeFormatOptions.

* jupyter: update angular-fontawesome to 0.9.0

npm i @fortawesome/angular-fontawesome@0.9.0

* jupyter: update codelyzer to 6.0.2

npm i codelyzer@6.0.2

* jupyter: update angular core and cli to 12

ng update @angular/core@12 @angular/cli@12

* jupyter: update material, cdk and cdk-experimental to 12

ng update @angular/cdk@12 @angular/material@12 @angular/cdk-experimental@12

* tensorboards: update angular-fontawesome to 0.9.0

npm i @fortawesome/angular-fontawesome@0.9.0

* tensorboards: update angular core and cli to 12

ng update @angular/core@12 @angular/cli@12

* tensorboards: update material, cdk and cdk-experimental to 12

ng update @angular/cdk@12 @angular/material@12 @angular/cdk-experimental@12

* volumes: update angular-fontawesome to 0.9.0

npm i @fortawesome/angular-fontawesome@0.9.0

* volumes: update angular core and cli to 12

ng update @angular/core@12 @angular/cli@12

* volumes: update material, cdk and cdk-experimental to 12

ng update @angular/cdk@12 @angular/material@12 @angular/cdk-experimental@12

* common: update and audit packages

npm update && npm audit fix && npm i lodash-es@4.17.21 && npm i material-icons@0.7.3

* jupyter: update and audit packages

npm update && npm audit fix && npm i material-icons@0.7.3

* tensorboards: update and audit packages

npm update && npm audit fix && npm i material-icons@0.7.3

* volumes: update and audit packages

npm update && npm audit fix && npm i material-icons@0.7.3

* jupyter: npm run format:write

npm run format:write

* lists roadmap in reverse chronological order (#6055)

Signed-off-by: Malini Bhandaru <mbhandaru@vmware.com>

* Correct missing predicates in controller watches. Fixes #5326 (#5873)

Co-authored-by: Filinto Duran <fduran@d2iq.com>

* fix(web-apps): Use Angular's i18n proposed implementation (#6065)

* jwa(front): Add i18n for french in angular.json

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): Add i18n rules in package.json

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): i18n FormImage

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): i18n FormAdvancedOptions

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): i18n FormAffinityTolerations

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): i18n FormConfigurations

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): i18n FormCpuRam

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): i18n FormDataVolumes

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): i18n FormGpus

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): i18n FromName

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): i18n FormWorkspaceVolume

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): i18n Volume

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): i18n BackendService

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): Add localize to peerDependencies

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): Import $localize in library

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): i18n RokService

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): i18n Form

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): i18n BackendService

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): i18n ConfirmDialog

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): i18n Index

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): i18n ResourceTable

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): i18n SnackBar

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): i18n Form

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-app(front): i18n NameNamespaceSelector

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): Remove ngx-translate

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): i18n App

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): Remove ngx-translate from package.json

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(back): Don't parse keys in status

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(back): Revert backend messages

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): Update translation language files

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(back): Don't parse keys in status

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(front): Add i18n for french in angular.json

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(front): Add i18n rules in package.json

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(front): i18n Form

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(front): i18n Index

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(front): i18n BackendService

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(front): i18n App

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(front): Remove ngx-translate from package.json

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(front): i18n Form

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(front): Update translation language files

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa(back): Revert backend messages

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa(front): Add i18n rules in package.json

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa(front): Add i18n for french in angular.json

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa(front): i18n Index

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa(front): i18n BackendService

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa(front): i18n App

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa(front): Update translation language files

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa(front): Remove ngx-translate from package.json

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* wa: Update READMEs

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): Add localize when testing

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* [CentralDashboard] Add entry for Models web app (#6085)

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Interact with the namespace selector (#5995)

* Interact with the namespace selector

* Use namespace given as an argument

* Keep the index of selected item

* fix(jwa): Fix limits calculation when limitFactor is none (#6058)

* jwa(front): Don't allow NaN values in limits

The UI should always catch a NaN value and don't add it in the form.
Currently this is the case for the cpu/memory limits.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): Limits should not be changed if dirty

If the user has manually edited the limits fields then the UI should not
try to automatically calculate them again, using the limitFactors.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Fix NaN in Kubeflow Notebooks (#6092)

* Fix NaN in Kubeflow Notebooks

* add a validation check for NaN values

* fix: validation check if value is None

* lint: fix line length

* add section for 1.4; small updates for 1.3 section (#6082)

* add section for 1.4; small updates for 1.3 section

* refer to training operators consistently; add link to Notebooks roadmap.

* address @Bobgy feedback regarding Kubeflow Pipelines portions of 1.4 roadmap

* Remove virtualservice timeout to prevent websocket disconnect (#6126)

In the existing version, the 'timeout: 300s' added to the notebook's virtual service would cause websockets to disconnect at the 5 minute mark, causing the Jupyter Notebook web terminal function to hang. This is described in https://github.com/kubeflow/kubeflow/issues/6124.

* fix(admission-webhook): attach namespace to pod request if pod does not have it (#6052)

* fix(admission-webhook): attach namespace to pod request if pod does not have it

* Apply suggestions from code review

Add more explicit logs

Co-authored-by: Erhan Kesken <ekesken@users.noreply.github.com>

* Add more explicit log

Co-authored-by: Erhan Kesken <ekesken@users.noreply.github.com>

Co-authored-by: Erhan Kesken <ekesken@users.noreply.github.com>

* Fix notebook base image gpg keys (#6138)

* update links for new testing infra (#6144)

* Add more root OWNERS (#6146)

* Improve README for example-notebook-servers (#6165)

* jwa(front): Don't disable vendors with no GPUs (#6171)

JWA should not block users from selecting GPUs if the current cluster
nodes do not have any GPUs attached to them. We've seen users that have
autoscaled nodegroups for GPUs, so a GPU node will be added to the
cluster once a Pod has requested it.

Refs: arrikto/dev#1484

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Bump Golang version in PodDefaults, TensorBoard Controller and KFAM to 1.17 (#6180)

* kfam: Upgrade go to 1.17

Update to a more recent docker image that has a newer version of
openssl.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* poddefaults: Upgrade go to 1.17

Update to a more recent docker image that has a newer version of
openssl.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* tensorboards: Upgrade go to 1.17

Update to a more recent docker image that has a newer version of
openssl.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Update Notebooks README regarding custom packages (#6176)

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Fix reference to PodPreset as PodDefault (#6184)

* fix: tensorboard-controller is killed due to out of memory (#6148)

* Update manager.yaml

* Update manager.yaml

* fix(web-apps): Use relative path for --deploy-url build. #5566 (#6206)

* fix(web-apps): Use relative path for --base-href build

* volume web app should use volume base-href

* Document for cutting Kubeflow website release. (#6198)

* Document for cutting Kubeflow website release.

* Update docs_dev/releasing.md

Co-authored-by: Shannon Bradshaw <shannon.bradshaw@arrikto.com>

* Update docs_dev/releasing.md

Co-authored-by: Shannon Bradshaw <shannon.bradshaw@arrikto.com>

* address comment

* canonical name

Co-authored-by: Shannon Bradshaw <shannon.bradshaw@arrikto.com>

* Change namespace label for Katib metrics collector injection (#6225)

* fix(backend): tensorboard-controller does not work because of missing permissions (#6216)

* add(web-apps): i18n Fr translations (#6122)

* chore(docs): It's better to refer to the cli documents, not repo's readme (#6239)

* fix(docs): Fix the 404 K8s docs link (#6236)

* nit: typo in README.md (#6211)

* web-apps(front) : change error msg for min (#6193)

* Centraldashboard/add uncaughtexception handler (#6203)

* Central dashboard - Add global uncaught exception handler

* fix comments

* Fix(frontend): Upgrade ts node to v4 (#6242)

* Upgrade ts-node to v10

* Update lock

* admission-webhook-manifests: Update the cert manager from v1alpha2 to v1 (#6230)

* Short term updates to Published Kubeflow Roadmap (#6248)

3 changes - Add info on Kubeflow 1.5 and 1.4.1.   Update roadmap to show that Kubeflow 1.4 was delivered.

* Upgrade the google cloud monitoring node.js client (#6210)

* Upgrade the google cloud monitoring node.js client

* Update package-lock.json

* Upgrade TypeScript to v4

* Update package-lock.json

* run tslint

* fix dashboard sending malformed headers to kfam (#6186)

* correct typo - track to tracked (#6264)

corrected typo "track" to "tracked"

* centraldashboard: Update node and use latest-stable (#6260)

Change the tests to NOT fetch Chromium from the Edge branch, which is develop,
but instead use latest-stable. We saw that edge can have problems from times to
times.

In the same commit we also update the node version to fix CVEs with the current
v12.18.3 version that we had.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Tell user to select a namespace to access namespaced menu item (#6181)

* Fix unnecessary updates of istio AuthorizationPolicy (#6269)

* Introduce a basic proposals flow for more advanced features (#6272)

* Introduce a proposals dir for Notebooks

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Move the proposals dir under components

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Secure access to KFAM (#6077)

* fix(notebooks) make culling work with multi-user (#5128) (#5980)

* JWA: Very basic E2E tests to run locally (#6005)

* web-apps(front): Add test attrs selectors

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): Update gitignore for cypress files

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): Install cypress & npm scripts for e2e

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(e2e): Add first cypress tests

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa: Update the README for e2e instructions

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* chore: remove Bobgy from OWNERS

* frontend: Use responsive tables instead of cards (#6316)

* jwa(front): Make ng lint work by ignoring e2e/tsconfig.json

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Tasos Alexiou <tasos@arrikto.com>

* web-apps(front): Make the table responsive

We introduced all of our changes in the underlying TableComponent. This
component can then be either used independently or inside a material
card.

The changes we did in that component are:
1. Create Output() emitters, since this component can be used directly
2. The config object for a Table row now supports a `style` prop for
   defining the list of CSS styles to be applied
2. Remove the truncate classes (small, medium, large) and only have
   a boolean value. The user can define the width directly now via the
   `style` property in the row's config
3. Modify the classes for aligning contents right and left

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Tasos Alexiou <tasos@arrikto.com>

* web-apps(front): Add table paginator

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Tasos Alexiou <tasos@arrikto.com>

* web-apps(front): Add padding to titlebar text

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Tasos Alexiou <tasos@arrikto.com>

* web-apps(front): Use bigger font for toolbar title

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Tasos Alexiou <tasos@arrikto.com>

* jwa(front): Use responsive table and toolbar

We refactor both the index and form pages of the app to:
1. Add a top row toolbar with the title of the app and the button to
   create a new Notebook
2. Replace the card with a responsive table that shows the items. The
   component also has a paginator

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Tasos Alexiou <tasos@arrikto.com>

* vwa(front): Use responsive table and toolbar

This commit:
1. Adds a toolbar at the top of the index page with the title of the app
   and the button to create a new volume
2. Replaces the card with a responsive table

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Tasos Alexiou <tasos@arrikto.com>

* twa(front): Use responsive table and toolbar

This commit:
1. Adds a toolbar at the top of the index page with the title of the app
   and a button to create a new TensorBoard instance
2. Replaces the card with a resopnsive table

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Tasos Alexiou <tasos@arrikto.com>

* fix the format

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* wa(front): Add npm script for running unit tests in docker

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* fix unit tests failing

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Don't use asterisk in Dockerfiles (#6318)

* wa(docker): Don't copy node_modules

To ensure Kaniko is not copying stale node_moduels folders, even though
we have a dockerignore file, we are explicitly only copying the source
code.

We have seen the build system with Kaniko to fail, due to NFS stale
instances with files in node_modules and expect that this is the root
cause.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa: Update makefile to use global dockerignore

The dockerfile for TWA was copying over the local dockerignore. This was
overriding the global one we had for all the web apps.

This commit updates the Makefile of the app to use the global
dockerignore that all the apps should use.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Bump log4js from 6.3.0 to 6.4.1 in /components/crud-web-apps/common/frontend/kubeflow-common-lib (#6309)

Bumps [log4js](https://github.com/log4js-node/log4js-node) from 6.3.0 to 6.4.1.
- [Release notes](https://github.com/log4js-node/log4js-node/releases)
- [Changelog](https://github.com/log4js-node/log4js-node/blob/master/CHANGELOG.md)
- [Commits](https://github.com/log4js-node/log4js-node/compare/v6.3.0...v6.4.1)

---
updated-dependencies:
- dependency-name: log4js
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump postcss from 7.0.16 to 7.0.39 in /components/centraldashboard (#6308)

Bumps [postcss](https://github.com/postcss/postcss) from 7.0.16 to 7.0.39.
- [Release notes](https://github.com/postcss/postcss/releases)
- [Changelog](https://github.com/postcss/postcss/blob/7.0.39/CHANGELOG.md)
- [Commits](https://github.com/postcss/postcss/compare/7.0.16...7.0.39)

---
updated-dependencies:
- dependency-name: postcss
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump log4js from 6.3.0 to 6.4.1 in /components/crud-web-apps/tensorboards/frontend (#6311)

Bumps [log4js](https://github.com/log4js-node/log4js-node) from 6.3.0 to 6.4.1.
- [Release notes](https://github.com/log4js-node/log4js-node/releases)
- [Changelog](https://github.com/log4js-node/log4js-node/blob/master/CHANGELOG.md)
- [Commits](https://github.com/log4js-node/log4js-node/compare/v6.3.0...v6.4.1)

---
updated-dependencies:
- dependency-name: log4js
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump log4js from 6.3.0 to 6.4.1 in /components/crud-web-apps/volumes/frontend (#6310)

Bumps [log4js](https://github.com/log4js-node/log4js-node) from 6.3.0 to 6.4.1.
- [Release notes](https://github.com/log4js-node/log4js-node/releases)
- [Changelog](https://github.com/log4js-node/log4js-node/blob/master/CHANGELOG.md)
- [Commits](https://github.com/log4js-node/log4js-node/compare/v6.3.0...v6.4.1)

---
updated-dependencies:
- dependency-name: log4js
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump log4js from 6.3.0 to 6.4.1 in /components/crud-web-apps/jupyter/frontend (#6312)

Bumps [log4js](https://github.com/log4js-node/log4js-node) from 6.3.0 to 6.4.1.
- [Release notes](https://github.com/log4js-node/log4js-node/releases)
- [Changelog](https://github.com/log4js-node/log4js-node/blob/master/CHANGELOG.md)
- [Commits](https://github.com/log4js-node/log4js-node/compare/v6.3.0...v6.4.1)

---
updated-dependencies:
- dependency-name: log4js
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Update images for the 1.5 rc0 release (#6319)

* Update the releasing version tag

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Run automated script for updating versions

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Fix(manifests): Upgrade rbac.authorization.k8s.io from v1beta1 to v1 (#6261)

* proposal: Extend Notebook Controller to expose idleness for Jupyter (#6295)

* proposal: Extend Notebook Controller to expose idleness for Jupyter (#6270)

Provide a design doc as a proposal for extending Notebook Controller to
expose idleness for Jupyter. Our proposal is in markdown format and follows
the guidelines of the kubeflow/components/proposal/README.md guide.

You can view the #6270 issue in the following link:
https://github.com/kubeflow/kubeflow/issues/6270

Signed-off-by: Athanasios Markou <athamark@arrikto.com>

* review: change the title of the proposal

Change the title of the proposal to only include the
proposed new feature. The new title of the proposal
will now be "Expose Idleness Information for Jupyter
Notebooks".

* review: rename the proposal markdown file

We want to give a more specific name to the markdown
which contains the proposal. Since this proposal
emphasizes on a feature regarding the Jupyter Notebooks,
the new name will be:

20220121-jupyter-notebook-idleness.md

* Synchronize jupyter-web-application role with clusterrole (#6241)

* Update role.yaml

* Update role.yaml

* Update cluster-role.yaml

* Kubeflow Roadmap update - with 1.5 details (#6266)

* Kubeflow Roadmap update - with 1.5 details

These proposed changes include: identifying that 1.4.1 has been delivered, provides themes for 1.5 and provides details of major features in 1.5 by working group.   This is an initial proposal that needs review by the working group leads.

* correct formatting in KFP features

Moved KFP features under KFP Control Flow doc

* updating KFP section

updating KFP references with updates from KFP team

* Updated the 1.5 release date to March

updated the 1.5 release date to March

* Update ROADMAP.md

change Hyperparameter leader election to Katib leader election

Co-authored-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Update ROADMAP.md

improve description and details of feature for metrics collector

Co-authored-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Update Katib description for Early stopping in 1.5

updating with Andrey's suggestion (but without the world proper).   * Validation for Early Stopping algorithm settings helps users to proper reduce model overfitting

Co-authored-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* notebooks: Extend Notebook Controller to expose idleness for Jupyter (#6297)

* notebooks: Update image's tag in make

Modify Makefile to update properly the TAG
based on the git TAG.

Signed-off-by: Athanasios Markou <athamark@arrikto.com>
Reviewed-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* notebooks: Expose last-activity

Extend the notebook-controller to:
* cull idle Notebook Servers based on their new `last-activity`
  annotation
* expose the last activity of each Notebook Server as an annotation
  on the metadata of the corresponding CR object

Modify notebook_controller.go to:
* update the Last Activity of each Notebook Server that has a
  Running pod
* delete the Last Activity Annotation for every Notebook Server
  that does not have a Running pod

Extend culler.go to:
* perform culling based on the new `last-activity` annotation and
  not based on the `/api/status` endpoint.
* update the last activity of a Notebook Server, based on the
  kernels' execution states.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Athanasios Markou <athamark@arrikto.com>

* notebooks: Introduce a DEV env var

We introduce a DEV ENV var to allow admins
develop and test on their local machine their
custom Notebook Controller.
We provide information and instructions inside
the components/notebook-controller/README.md.

Signed-off-by: Athanasios Markou <athamark@arrikto.com>
Reviewed-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* notebooks: Add unit tests for last-activity

* Introduce new tests for allKernelsAreIdle()
* Extend the tests for NotebookIsIdle() and for
  NotebookNeedsCulling().

Signed-off-by: Athanasios Markou <athamark@arrikto.com>
Reviewed-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* review: UpdateNotebookLastActivityAnnotation()

Ensure that UpdateNotebookLastActivityAnnotation() does not return
"true". This function should not return any value.

Signed-off-by: Athanasios Markou <athamark@arrikto.com>

* jwa: Rework the Storage API of the web app (#6321)

* wa(back): Add helper for deserializing JSON obj

In some cases we might need to construct Python k8s lib objects from the
JSONs that are provided by clients. I.e. the UI will be sending a PVC
object in json format, so the backend will need to create the
corresponding client.V1PersistentVolumeClaim object and submit it.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Ilias Katsakioris <elikatsis@arrikto.com>

* wa(back): Serialization helper

Add helper function for converting a k8s-client object into a dict that
can be sent as an HTTP response.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Ilias Katsakioris <elikatsis@arrikto.com>

* wa(back): Add dry run to Notebooks and PVCs

The backend will need to be able to create objects with dry-run, in
order to ensure they are valid. The backend will need to check that both
the Notebook and the PVCs can be created beforehand.

This way we avoid the scenario where we create PVCs but the Notebook
fails to be created, and the PVCs are never garbage collected.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Ilias Katsakioris <elikatsis@arrikto.com>

* wa(back): Update kubernetes to 0.17

In order to support dry-run we must use the 0.17 version of the Python
k8s client.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Ilias Katsakioris <elikatsis@arrikto.com>

* wa(back): Extend api module to patch pvcs

The backend will need to be able to PATCH PVCs in order to set the
ownerReference to the Notebook that mounts the PVCs.

Ref: arrikto/dev/issues/386#issuecomment-856700392

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Ilias Katsakioris <elikatsis@arrikto.com>

* jwa(back): Work with new Volumes API

The backend API should not add any more layers of abstractions on top of
the K8s API. The backend should expect the client/UI to be sending the
entire PVC spec of a new PVC.

Refs: arrikto/dev/issues/386

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Ilias Katsakioris <elikatsis@arrikto.com>

* jwa(back): Add unittests for new volumes API

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Ilias Katsakioris <elikatsis@arrikto.com>

* jwa(back): Extend the PVC info returned

We want to show both the access mode and size of the existing PVCs, when
a user clicks on the dropdown to select which PVC to mount.

The backend will need to provide this information to the frontend. We
don't want to send the K8s list of PVCs since this will result in a lot
of unnecessary data to be sent.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Ilias Katsakioris <elikatsis@arrikto.com>

* jwa(front): Add proxy config for Rok

When developing the Rok flavor locally we will need to be able to open
the Rok chooser. This can be done by using Angular/webpack proxy to
bring the exposed rok service and the app under the same domain.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Tasos Alexiou <tasos@arrikto.com>

* jwa(front): Remove card from form

The form of the app should not be a big card, but a normal form.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Tasos Alexiou <tasos@arrikto.com>

* jwa(front): Install AceModule for yaml editing

Install AceModule to allow users to edit yamls of objects.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Tasos Alexiou <tasos@arrikto.com>

* wa(front): Change the styling of form sections

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Tasos Alexiou <tasos@arrikto.com>

* jwa(front): Create common volume components

Component for:
* New PVC and configuring its spec
* Attaching an existing PVC in a Notebook

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Tasos Alexiou <tasos@arrikto.com>

* jwa(front): Update Rok form for new Volume API

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Tasos Alexiou <tasos@arrikto.com>

* jwa(front): Mark inputs as dirty when restoring Lab

When the UI autofills the form with values from a JupyterLab snapshot
then it should mark the touched fields as dirty. This way if a field has
errors the UI will make that input red.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Tasos Alexiou <tasos@arrikto.com>

* jwa: Update ConfigMap in manifests

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): Fix format errors

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* profiles: Update the permissions for notebook idleness (#6335)

Extend the Profiles Controller to give permissions to Notebooks
controller for making GET requests to notebook's /api/kernels endpoint.

Refs https://github.com/kubeflow/kubeflow/blob/master/components/proposals/20220121-jupyter-notebook-idleness.md

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* notebooks: Graceful handling of events (#6338)

* notebooks: Handle events gracefully

The controller is not exiting the reconciliation loop after it has
re-emitted a Pod/STS Event as a Notebook Event. This results in the
controller to later on try and GET a Notebook with the name of the Event
that triggered the reconciliation loop.

The controller should exit the reconciliation function once it has
emitted the event.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* notebooks: Don't reconcile on deleted events

We don't want to trigger the reconciliation function when an event gets
deleted.

If a Notebook would be deleted then the underlying events would
be deleted as well, which results in the reconcile function to get
triggered and try to GET Events and Notebooks with the name of the
deleted event.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* notebooks: Fix endless restarts (#6341)

* notebooks: Update notebook if timestamp changed

We don't want to be updating the spec of the notebook if the timestamp
hasn't changed, since this will lead to constant updates and
reconciliation loops.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* notebooks: Use a deep-copy of the notebook spec

The controller should use a deep-copy of the notebook spec when
calculating the spec for the StatefulSet. If not then we could
update the notebook object without wanting it, since the spec could have
been changed when calculating the STS spec.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* notebooks: Add prefix env var only if missing

The controller should be setting OR updating the NB_PREFIX env var.
Previously it would always blindly append it to the spec, which could
result in double entries for the same env var.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* releasing: Update tags for v1.5.0-rc.1 (#6343)

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* fix error comparison between pointer and pointer in "CopyStatefulSetFields" (#6195)

error comparison between pointer and pointer in "CopyStatefulSetFields"

* [bugfix]: update unsupported links to latest pages (#6192)

* centraldashboard: Add KServe overlay (#6383)

Configure the dashboard to use the KServe app instead of the KFServing
0.6.1 one.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* notebooks: Don't reconcile on Events deletion (#6391)

The controller should not trigger the reconcile loop when an Event is
deleted. Previously the controller would run the reconciliation loop on
any event deletion.

This commit updates it to not run the loop for ANY event.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* releasing: Create v1.5.0-rc.2 images (#6394)

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* release: Images for the 1.5.0 tag (#6398)

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* added env for app secure cookies (#6395)

* build(deps): bump github.com/gogo/protobuf from 1.1.1 to 1.3.2 in /components/tensorboard-controller (#6424)

Bumps [github.com/gogo/protobuf](https://github.com/gogo/protobuf) from 1.1.1 to 1.3.2.
- [Release notes](https://github.com/gogo/protobuf/releases)
- [Commits](https://github.com/gogo/protobuf/compare/v1.1.1...v1.3.2)

---
updated-dependencies:
- dependency-name: github.com/gogo/protobuf
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump notebook from 6.4.0 to 6.4.10 in /components/example-notebook-servers/jupyter (#6431)

Bumps [notebook](http://jupyter.org) from 6.4.0 to 6.4.10.

---
updated-dependencies:
- dependency-name: notebook
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump minimist from 1.2.5 to 1.2.6 in /components/crud-web-apps/tensorboards/frontend (#6417)

Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6.
- [Release notes](https://github.com/substack/minimist/releases)
- [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6)

---
updated-dependencies:
- dependency-name: minimist
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump minimist from 1.2.5 to 1.2.6 in /components/crud-web-apps/jupyter/frontend (#6429)

Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6.
- [Release notes](https://github.com/substack/minimist/releases)
- [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6)

---
updated-dependencies:
- dependency-name: minimist
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump follow-redirects from 1.14.1 to 1.14.8 in /components/crud-web-apps/tensorboards/frontend (#6357)

Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.1 to 1.14.8.
- [Release notes](https://github.com/follow-redirects/follow-redirects/releases)
- [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.1...v1.14.8)

---
updated-dependencies:
- dependency-name: follow-redirects
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump ajv from 6.10.2 to 6.12.6 in /components/crud-web-apps/volumes/frontend (#6358)

Bumps [ajv](https://github.com/ajv-validator/ajv) from 6.10.2 to 6.12.6.
- [Release notes](https://github.com/ajv-validator/ajv/releases)
- [Commits](https://github.com/ajv-validator/ajv/compare/v6.10.2...v6.12.6)

---
updated-dependencies:
- dependency-name: ajv
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump ajv from 6.10.2 to 6.12.6 in /components/crud-web-apps/jupyter/frontend (#6359)

Bumps [ajv](https://github.com/ajv-validator/ajv) from 6.10.2 to 6.12.6.
- [Release notes](https://github.com/ajv-validator/ajv/releases)
- [Commits](https://github.com/ajv-validator/ajv/compare/v6.10.2...v6.12.6)

---
updated-dependencies:
- dependency-name: ajv
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump lodash-es from 4.17.11 to 4.17.21 in /components/crud-web-apps/tensorboards/frontend (#6402)

Bumps [lodash-es](https://github.com/lodash/lodash) from 4.17.11 to 4.17.21.
- [Release notes](https://github.com/lodash/lodash/releases)
- [Commits](https://github.com/lodash/lodash/compare/4.17.11...4.17.21)

---
updated-dependencies:
- dependency-name: lodash-es
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump minimist from 1.2.5 to 1.2.6 in /components/crud-web-apps/common/frontend/kubeflow-common-lib (#6416)

Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6.
- [Release notes](https://github.com/substack/minimist/releases)
- [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6)

---
updated-dependencies:
- dependency-name: minimist
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump minimist from 1.2.5 to 1.2.6 in /components/crud-web-apps/volumes/frontend (#6423)

Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6.
- [Release notes](https://github.com/substack/minimist/releases)
- [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6)

---
updated-dependencies:
- dependency-name: minimist
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump undefsafe from 2.0.2 to 2.0.5 in /components/centraldashboard (#6342)

Bumps [undefsafe](https://github.com/remy/undefsafe) from 2.0.2 to 2.0.5.
- [Release notes](https://github.com/remy/undefsafe/releases)
- [Commits](https://github.com/remy/undefsafe/compare/v2.0.2...v2.0.5)

---
updated-dependencies:
- dependency-name: undefsafe
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump url-parse from 1.5.1 to 1.5.10 in /components/crud-web-apps/common/frontend/kubeflow-common-lib (#6378)

Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.1 to 1.5.10.
- [Release notes](https://github.com/unshiftio/url-parse/releases)
- [Commits](https://github.com/unshiftio/url-parse/compare/1.5.1...1.5.10)

---
updated-dependencies:
- dependency-name: url-parse
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump url-parse from 1.5.1 to 1.5.10 in /components/crud-web-apps/tensorboards/frontend (#6379)

Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.1 to 1.5.10.
- [Release notes](https://github.com/unshiftio/url-parse/releases)
- [Commits](https://github.com/unshiftio/url-parse/compare/1.5.1...1.5.10)

---
updated-dependencies:
- dependency-name: url-parse
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps-dev): bump karma from 6.3.4 to 6.3.16 in /components/crud-web-apps/common/frontend/kubeflow-common-lib (#6386)

Bumps [karma](https://github.com/karma-runner/karma) from 6.3.4 to 6.3.16.
- [Release notes](https://github.com/karma-runner/karma/releases)
- [Changelog](https://github.com/karma-runner/karma/blob/master/CHANGELOG.md)
- [Commits](https://github.com/karma-runner/karma/compare/v6.3.4...v6.3.16)

---
updated-dependencies:
- dependency-name: karma
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps-dev): bump karma from 6.3.4 to 6.3.16 in /components/crud-web-apps/tensorboards/frontend (#6387)

Bumps [karma](https://github.com/karma-runner/karma) from 6.3.4 to 6.3.16.
- [Release notes](https://github.com/karma-runner/karma/releases)
- [Changelog](https://github.com/karma-runner/karma/blob/master/CHANGELOG.md)
- [Commits](https://github.com/karma-runner/karma/compare/v6.3.4...v6.3.16)

---
updated-dependencies:
- dependency-name: karma
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump moment from 2.24.0 to 2.29.2 in /components/centraldashboard (#6432)

Bumps [moment](https://github.com/moment/moment) from 2.24.0 to 2.29.2.
- [Release notes](https://github.com/moment/moment/releases)
- [Changelog](https://github.com/moment/moment/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/moment/moment/compare/2.24.0...2.29.2)

---
updated-dependencies:
- dependency-name: moment
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump url-parse from 1.5.1 to 1.5.10 in /components/crud-web-apps/volumes/frontend (#6380)

Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.1 to 1.5.10.
- [Release notes](https://github.com/unshiftio/url-parse/releases)
- [Commits](https://github.com/unshiftio/url-parse/compare/1.5.1...1.5.10)

---
updated-dependencies:
- dependency-name: url-parse
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump url-parse from 1.4.7 to 1.5.10 in /components/centraldashboard (#6377)

Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.4.7 to 1.5.10.
- [Release notes](https://github.com/unshiftio/url-parse/releases)
- [Commits](https://github.com/unshiftio/url-parse/compare/1.4.7...1.5.10)

---
updated-dependencies:
- dependency-name: url-parse
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps-dev): bump karma from 6.3.4 to 6.3.16 in /components/crud-web-apps/volumes/frontend (#6388)

Bumps [karma](https://github.com/karma-runner/karma) from 6.3.4 to 6.3.16.
- [Release notes](https://github.com/karma-runner/karma/releases)
- [Changelog](https://github.com/karma-runner/karma/blob/master/CHANGELOG.md)
- [Commits](https://github.com/karma-runner/karma/compare/v6.3.4...v6.3.16)

---
updated-dependencies:
- dependency-name: karma
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps-dev): bump karma from 6.3.4 to 6.3.16 in /components/crud-web-apps/jupyter/frontend (#6389)

Bumps [karma](https://github.com/karma-runner/karma) from 6.3.4 to 6.3.16.
- [Release notes](https://github.com/karma-runner/karma/releases)
- [Changelog](https://github.com/karma-runner/karma/blob/master/CHANGELOG.md)
- [Commits](https://github.com/karma-runner/karma/compare/v6.3.4...v6.3.16)

---
updated-dependencies:
- dependency-name: karma
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump follow-redirects from 1.14.1 to 1.14.9 in /components/crud-web-apps/jupyter/frontend (#6441)

Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.1 to 1.14.9.
- [Release notes](https://github.com/follow-redirects/follow-redirects/releases)
- [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.1...v1.14.9)

---
updated-dependencies:
- dependency-name: follow-redirects
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump nanoid from 3.1.23 to 3.3.2 in /components/crud-web-apps/common/frontend/kubeflow-common-lib (#6437)

Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.23 to 3.3.2.
- [Release notes](https://github.com/ai/nanoid/releases)
- [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md)
- [Commits](https://github.com/ai/nanoid/compare/3.1.23.…

OWNERS

@@ -1,5 +1,6 @@
 # We want to rely on fine grained OWNERs files.
 # Approvers listed here is just a backup in case someone is out.
 approvers:
-  - Bobgy
-  - pdmack
+- pdmack
+- james-jwu
+- zijianjoy

README.md

@@ -18,10 +18,9 @@ The Kubeflow community is organized into working groups (WGs) with associated re
 * [Training](https://github.com/kubeflow/community/tree/master/wg-training)
 
 ## Quick Links
-* [Prow test dashboard](https://k8s-testgrid.appspot.com/sig-big-data)
-* [Prow jobs dashboard](https://prow.k8s.io/?repo=kubeflow%2Fkubeflow)
+* [Prow jobs dashboard](http://prow.kubeflow-testing.com)
 * [PR Dashboard](https://k8s-gubernator.appspot.com/pr)
-* [Argo UI for E2E tests](http://testing-argo.kubeflow.org)
+* [Argo UI for E2E tests](https://argo.kubeflow-testing.com)
 
 ## Get Involved
 Please refer to the [Community](https://www.kubeflow.org/docs/about/community/) page.

ROADMAP.md

@@ -1,6 +1,102 @@
 # Kubeflow Roadmap
 
-## Kubeflow 1.4 Release, Due: September 2021
+## Kubeflow 1.6 Release, Due: July 2022
+* Kubeflow 1.6 [milestones and timelines](https://github.com/kubeflow/community/pull/558)
+
+#### Themes
+* Kubernetes 1.22 support
+
+### Major Features from each Working Group (note: Individual WG versions are independent of Kubeflow's)
+
+#### Kubeflow Pipelines
+* V2 Preview: Support running pipeline in Argo-agnostic approach
+* New DAG visualization based on Pipeline Template and MLMD
+* SDK to change from `kfp.v2` to `kfp`
+* KFP SDK CLI [design](https://docs.google.com/document/d/1Z79ebKaf3hjyadSRsme1Qo7F-Tqu4qM1cyKuLeu2PgA/edit#heading=h.x9snb54sjlu9)
+
+#### Katib
+* Support for Population based training
+* Support JSON format for Metrics Collector
+* UI Enhancement to add a separate page for Trials and show Trial logs
+
+#### Training Operator
+* PyTorch elastic training enhancements
+* Elastic scheduling with Volcano support
+* MPI Operator v2
+
+#### Notebooks, Central Dashboard, Web Apps, Manifest
+* Sorting and filtering support for the web apps
+* Expose Notebook idleness information in the JWA
+
+#### KServe
+* Knative 1.0 support and certified for KServe Serverless installation
+* KServe 0.9 SDK with ModelServer API name changes and improvement for CloudEvent support
+* New ServingRuntime and ClusterServingRuntime CRDs
+* New ModelSpec in InferenceServices
+* ModelMesh updates include support for multi-namespace reconciliation
+
+#### Detailed features, bug fixes and enhancements will be identified in the Working Group Roadmaps
+
+* [Training Operators](https://github.com/kubeflow/common/blob/master/ROADMAP.md)
+* [KFServing](https://github.com/kubeflow/kfserving/blob/master/ROADMAP.md)
+* [Katib](https://github.com/kubeflow/katib/blob/master/ROADMAP.md)
+* [Kubeflow Pipelines](https://github.com/kubeflow/pipelines/blob/master/ROADMAP.md)
+* [Notebooks, Central Dashboard](https://docs.google.com/document/d/1YtSWRhdhyOgd6ZQcWLM38TGDy2H_EhXjr8U5lUi37_I/edit)
+
+
+## Kubeflow 1.5 Release, Delivered: March 2022
+* Kubeflow 1.5 [milestones and timeline](https://github.com/kubeflow/community/pull/538)
+
+### Themes
+* Switching to [Emissary executor](https://www.kubeflow.org/docs/components/pipelines/installation/choose-executor/#emissary-executor) enables Kubeflow Pipelines deployment on Kubernetes >= v1.20, which runs on containerd runtime instead of Docker runtime
+* Improve model accuracy and reduce overfitting, especially with hyper parameter tuning
+* Simplify operations and optimize utilization (including spot instance use cases for distributed training) 
+* More consistent user experience - UI appearance, features and naming
+* Improved documentation, tutorials and examples
+* Stretch - Support for K8s 1.22 and associated dependencies (cert mgr, istio)
+
+### Major Features from each Working Group (note: Individual WG versions are independent of Kubeflow's)
+
+#### Kubeflow Pipelines, v1.8
+* Switching to [Emissary executor](https://www.kubeflow.org/docs/components/pipelines/installation/choose-executor/#emissary-executor) enables Kubeflow Pipelines deployment on Kubernetes >= v1.20, which runs on containerd runtime instead of Docker runtime.
+
+#### Katib, v0.13 
+* Katib controller leader election for HA operations and faster recovery
+* Validation for Early Stopping algorithm settings helps users to reduce model overfitting
+* Improve SDK, AWS CI, parameter settings across frameworks (goptuna, optuna, hyperopt) 
+* Update namespace label for Metrics Collector injection (note - breaking change)
+
+#### Training Operator, v1.3
+* Elastic Training for PyTorch, restarts pod rather than whole job, supports spot instances
+* MPI addition to Unified training operator 
+* Python SDK supported on PyPI 
+
+#### Notebooks, Central Dashboard, Web Apps, Manifest, v1.5 
+* Exposing notebook idleness parameters, reduces infra used on idle notebooks
+* UI consistency between web apps along with frontend pagination, and remove cards and user responsive tables
+* Support for dark mode
+* More options to define PVC specification
+
+#### KServe, v0.7
+* KFServing is rebranded to [KServe](https://github.com/kserve)
+* [ModelMesh](https://github.com/kserve/modelmesh-serving) joins KServe 
+* Triton model serving runtime defaults to v21.09
+* (Alpha feature) Raw kubernetes deployment support, Istio/Knative dependency is now optional
+
+#### Detailed features, bug fixes and enhancements are identified in the Working Group Roadmaps
+
+* [Training Operators](https://github.com/kubeflow/common/blob/master/ROADMAP.md)
+* [KFServing](https://github.com/kubeflow/kfserving/blob/master/ROADMAP.md)
+* [Katib](https://github.com/kubeflow/katib/blob/master/ROADMAP.md)
+* [Kubeflow Pipelines](https://github.com/kubeflow/pipelines/blob/master/ROADMAP.md)
+* [Notebooks](https://github.com/kubeflow/kubeflow/issues/5978)
+
+
+## Kubeflow 1.4.1 Release, Delivered: December 2021
+* The need for a patch release was triggered by [#2082](https://github.com/kubeflow/manifests/issues/2082)
+* 1.4.1 Tracking issue: [2084](https://github.com/kubeflow/manifests/issues/2082)
+
+## Kubeflow 1.4 Release, Delivered: October 2021
 
 ### Themes and Major Features
 

components/Makefile

@@ -0,0 +1,46 @@
+REGISTRY ?= kubeflownotebookswg
+TAG ?= $(shell git describe --tags --always --dirty)
+
+build-all:
+	@echo "\nBuilding KFAM image...\n"
+	make docker-build -C access-management 
+
+	@echo "\nBuilding Admission-webhook image...\n"
+	make docker-build -C admission-webhook
+
+	@echo "\nBuilding Centraldashboard image...\n"
+	make docker-build -C centraldashboard
+
+	@echo "\nBuilding Jupyter-Web-App image...\n"
+	make docker-build -C crud-web-apps/jupyter
+
+	@echo "\nBuilding Tensorboard-Web-App image...\n"
+	make docker-build -C crud-web-apps/tensorboards
+
+	@echo "\nBuilding Volumes-Web-App image...\n"
+	make docker-build -C crud-web-apps/volumes
+
+	@echo "\nBuilding Notebook-controller image...\n"
+	make docker-build -C notebook-controller
+
+	@echo "\nBuilding Profile-controller image...\n"
+	make docker-build -C profile-controller
+
+	@echo "\nBuilding tensorboard-controller image...\n"
+	make docker-build -C tensorboard-controller
+
+	@echo "\nBuilding notebook-server images...\n"
+	make docker-build-all -C example-notebook-servers
+
+	@echo "\nAll images of prv-kubeflow-kubeflow repo have been built successfully!\n"
+
+push-all:	
+	for img in kfam admission-webhook centraldashboard jupyter-web-app tensorboards-web-app volumes-web-app notebook-controller profile-controller \
+	tensorboard-controller ; do \
+		docker tag $$img:$(TAG) ${REGISTRY}/$$img:${TAG} ; \
+		docker push ${REGISTRY}/$$img:${TAG} ; \
+	done
+
+	make docker-push-all -C example-notebook-servers TAG=${TAG} REGISTRY=${REGISTRY}
+
+	@echo "\nAll images have been succesfully retaged and pushed with registry: ${REGISTRY} and tag: ${TAG}...\n"

components/access-management/Makefile

@@ -1,30 +1,24 @@
 REGISTRY_PROJECT ?= kubeflow-dev
-GOLANG_VERSION ?= 1.12
-GCLOUD_PROJECT ?= kubeflow-images-public
-IMG ?= gcr.io/$(GCLOUD_PROJECT)/kfam
 PROJECT ?= kubeflow-dev
-TAG ?= $(eval TAG := $(shell date +v%Y%m%d)-$(shell git describe --tags --always --dirty)-$(shell git diff | shasum -a256 | cut -c -6))$(TAG)
+GO_SWAGGER_URL ?= https://github.com/go-swagger/go-swagger/releases/download/v0.21.0/swagger_linux_amd64
 
-CHANGED_FILES := $(shell git diff-files --relative=components/centraldashboard)
+GIT_VERSION := $(shell git describe --tags --always --dirty)
 
-ifeq ($(strip $(CHANGED_FILES)),)
-# Changed files is empty; not dirty
-# Don't include --dirty because it could be dirty if files outside the ones we care
-# about changed.
-GIT_VERSION := $(shell git describe --tags --long)
-else
-GIT_VERSION := $(shell git describe --tags --long)-dirty-$(shell git diff | shasum -a256 | cut -c -6)
-endif
+IMG ?= kfam
+TAG ?= $(GIT_VERSION)
 
-build:
-	docker build -t $(IMG):$(TAG) .
+generate-go-client: bin/swagger
+	bin/swagger generate client -f api/swagger.yaml -t api/go_client
+
+bin/swagger:
+	mkdir -p bin
+	wget -O bin/swagger '$(GO_SWAGGER_URL)'
+	chmod +x bin/swagger
 
-build-gcb:
-	gcloud --project=$(PROJECT) \
-		builds submit \
-		--machine-type=n1-highcpu-32 \
-		--substitutions=_GIT_VERSION=$(GIT_VERSION),_REGISTRY=$(REGISTRY_PROJECT) \
-		--config=cloudbuild.yaml .
+docker-build:
+	docker build -t $(IMG):$(TAG) .
 
-push: build
+docker-push: 
 	docker push $(IMG):$(TAG)
+
+image: docker-build docker-push 

components/access-management/README.md

@@ -8,7 +8,7 @@ The goal is to support multi-tenancy kubeflow cluster / services.
 ### Profile
 - Profile contains owner which refers to a k8s user.
 - Profile will create a namespace with same name and make profile owner the namespace owner.
-- Profile will create necessary k8s resources to enable owner access to kubeflow servuces under multi-tenancy mode.
+- Profile will create necessary k8s resources to enable owner access to kubeflow services under multi-tenancy mode.
 - After the namespace is created, the owner can grant access to additional users or groups using the API or by creating RBAC roles & bindings directly.
 - Delete profile will delete namespace and other k8s resources owned by this profile.
 

components/admission-webhook/Makefile

@@ -1,11 +1,17 @@
 # Image URL to use all building/pushing image targets
-IMG ?= gcr.io/kubeflow-images-public/admission-webhook
-TAG ?= $(eval TAG := $(shell date +v%Y%m%d)-$(shell git describe --tags --always --dirty)-$(shell git diff | shasum -a256 | cut -c -6))$(TAG)
-GOLANG_VERSION ?= 1.12
+IMG ?= admission-webhook
+TAG ?= $(shell git describe --tags --always --dirty)
 
 build:
 	go build -gcflags 'all=-N -l' -o bin/webhook .
 
-build-gcr:
-	docker build -t $(IMG):$(TAG) .
-	@echo Built $(IMG):$(TAG)
+docker-build:
+	docker build -t ${IMG}:${TAG} -f Dockerfile .
+
+docker-push: 
+	docker push ${IMG}:${TAG}
+
+image: docker-build docker-push
+
+docker-push:
+	docker push ${IMG}:${TAG}

components/admission-webhook/README.md

@@ -1,8 +1,8 @@
 ## Goal
 We need a way to inject common data (env vars, volumes) to pods (e.g. notebooks).
 See [issue](https://github.com/kubeflow/kubeflow/issues/2641).
-K8s has [PodPreset](https://kubernetes.io/docs/concepts/workloads/pods/podpreset/) resource with similar use-case, however it is in alpha. 
-K8s [admission-controller](https://godoc.org/k8s.io/api/admissionregistration/v1beta1#MutatingWebhookConfiguration) and CRD can be used to implement PodPreset as done in [here](https://github.com/jpeeler/podpreset-crd).
+K8s has [PodPreset](https://v1-19.docs.kubernetes.io/docs/concepts/workloads/pods/podpreset/) resource with similar use-case, however it is in alpha. 
+K8s [admission-controller](https://godoc.org/k8s.io/api/admissionregistration/v1#MutatingWebhookConfiguration) and CRD can be used to implement PodPreset as done in [here](https://github.com/jpeeler/podpreset-crd).
 We borrowed this PodPreset implementation, customize it for Kubeflow and rename it to PodDefault to avoid confusion.  
 The code is not directly used as Kubeflow's use case for PodDefault controller is slightly different. 
 In fact, PodDefault in Kubeflow is defined as CRD without the  custom controller (as opposed to [here](https://github.com/jpeeler/podpreset-crd)).
@@ -13,7 +13,7 @@ Here is the workflow on how this is used in Kubeflow:
 1. Users create  PodDefault manifests which describe additional runtime requirements (i.e., volume, volumeMounts, environment variables) to be injected  into a Pod at creation time.
 PodDefaults use label selectors to specify the Pods to which a given PodDefault applies.
 PodDefaults are namespace scope, i.e., they can be applied/viewed in the namespace.  
-As an example, the following manifest declares a PodPrest in `kubeflow` namespace to add the secret ```gcp-secret``` in to pods in the given namespace. 
+As an example, the following manifest declares a `PodDefault` in the `kubeflow` namespace to add the secret ```gcp-secret``` in to pods in the given namespace. 
 
 ```
 apiVersion: "kubeflow.org/v1alpha1"
@@ -48,11 +48,11 @@ For the above PodDefault, when a pod creation request comes which has the label
 to the pod as described in the PodDefault spec.
 
 ## Webhook Configuration
-Define a [MutatingWebhookConfiguration](https://godoc.org/k8s.io/api/admissionregistration/v1beta1#MutatingWebhookConfiguration),
+Define a [MutatingWebhookConfiguration](https://godoc.org/k8s.io/api/admissionregistration/v1#MutatingWebhookConfiguration),
 for example:
 
 ```
-apiVersion: admissionregistration.k8s.io/v1beta1
+apiVersion: admissionregistration.k8s.io/v1
 kind: MutatingWebhookConfiguration
 metadata:
   name: gcp-cred-webhook
@@ -75,17 +75,24 @@ This specifies
 1. When there is a pod being created (see `rules`),
 1. call the webhook service `gcp-cred-webhook.default` at path `/add-cred` (see `clientConfig`)
 
+### admissionregistration.k8s.io/v1 default failurePolicy
+In adopting `admissionregistration.k8s.io/v1` for the `MutatingWebhookConfiguration` we accept the default value
+for `failurePolicy` to be `Fail` per [documentation](https://kubernetes.io/docs/reference/access-authn-authz/extensible-admission-controllers/#failure-policy). Upon testing this default feature it was discovered if the `AdmissionWebhook`'s `mutating-webhook-configuration` failed to mutate a pod then the pod would fail to start, its associated `Deployment` or `StatefulSet` would continually attempt to create the pod until the process that created the pod was terminated. Furthermore, any pod that is targeted by the `AdmissionWebhook` for mutation was effected and will fail to start if there are configuration collisions or some other issue, already running pods are not effected by this policy. Again, only pods created after the policy change may be effected.
+
+Engineers should be mindful of this setting as it was also noted these failures can persist beyond the `timeoutSeconds` parameter that
+is by default set to `10` seconds in the `v1` API. For example, a `StatefulSet`s attempted to create notebook pods
+despite its API request getting rejected by the `mutating-webhook-configuration`. Please refer to kubernetes documentation to read up on
+the `failurePolicy: Ignore` parameter as this was the default value in `v1beta1`.
 
 ### Webhook implementation
 The webhook should be a server that can handle request coming from the configured path (`/add-cred` in the above).
-The request and response types are both [AdmissionReview](https://godoc.org/k8s.io/api/admission/v1beta1#AdmissionReview)
+The request and response types are both [AdmissionReview](https://godoc.org/k8s.io/api/admission/v1#AdmissionReview)
 
 ## Reference
-1. [K8S PodPreset](https://kubernetes.io/docs/concepts/workloads/pods/podpreset)
+1. [K8S PodPreset](https://v1-19.docs.kubernetes.io/docs/concepts/workloads/pods/podpreset/)
 1. https://github.com/jpeeler/podpreset-crd
 1. https://kubernetes.io/docs/reference/access-authn-authz/extensible-admission-controllers/
 1. https://github.com/kubernetes/kubernetes/tree/v1.13.0/test/images/webhook
 1. https://github.com/morvencao/kube-mutating-webhook-tutorial
 1. How to self sign: [link](https://github.com/kubernetes/kubectl/issues/86)
 1. What to put for caBundle: [issue](https://github.com/kubernetes/kubernetes/issues/61171)
-

components/admission-webhook/config.go

@@ -17,11 +17,13 @@ limitations under the License.
 package main
 
 import (
+	"context"
 	"crypto/tls"
 
 	"sigs.k8s.io/controller-runtime/pkg/client"
 
 	"k8s.io/klog"
+	"sigs.k8s.io/controller-runtime/pkg/certwatcher"
 	"sigs.k8s.io/controller-runtime/pkg/client/config"
 )
 
@@ -39,12 +41,19 @@ func getCrdClient() client.Client {
 }
 
 func configTLS(config Config) *tls.Config {
-	sCert, err := tls.LoadX509KeyPair(config.CertFile, config.KeyFile)
+	certWatcher, err := certwatcher.New(config.CertFile, config.KeyFile)
 	if err != nil {
 		klog.Fatalf("config=%#v Error: %v", config, err)
 	}
+
+	go func() {
+		if err := certWatcher.Start(context.TODO()); err != nil {
+			klog.Fatalf("config=%#v Error: %v", config, err)
+		}
+	}()
+
 	return &tls.Config{
-		Certificates: []tls.Certificate{sCert},
+		GetCertificate: certWatcher.GetCertificate,
 		// TODO: uses mutual tls after we agree on what cert the apiserver should use.
 		//ClientAuth: tls.RequireAndVerifyClientCert,
 	}