[EPIC] Kubeflow Upgrade Planning v1.3.1

[sylus]

Overview

This manifests folder exactly matches the upstream Kubeflow Manifests repository in its naming and folder hierarchy.

• Kubeflow Manifests

Note: We are pushing all of the work into the main branch for aaw-kubeflow-manifests.

Post Deploy Tasks

• Pipelines: Check the Cluster Roles are sufficient for Pipelines + Argo Workflow (Archive, Delete, Run, Experiments)
• Profiles: Check the new Access Management KFAM works without our KFAM adjustments

Common

Component	Local Manifests Path	Upstream	Issue	AAW Sign-off	CNS Sign-off
kubeflow-namespace	common/kubeflow-namespace	v1.3.1	#112	✅	✅
kubeflow-roles	common/kubeflow-roles	v1.3.1	#113	✅	✅
oidc-authservice	common/oidc-authservice	v1.3.1	#115	✅	✅
kubeflow-knative	common/knative	v1.3.1	#122	✅	✅

Apps

Component	Local Manifests Path	Upstream	Issue	AAW Sign-off	CNS Sign-off
central-dashboard	apps/centraldashboard	v1.3.1	#116	✅	✅
jupyter-web-apps	apps/jupyter-web-app	v1.3.1	#114	✅	✅
katib	apps/katib	v1.3.1	#117	✅	✅
kfserving	apps/kfserving	v1.3.1	#118	✅	✅
pipeline	apps/pipeline	v1.3.1	#119	✅	✅
profiles	apps/profiles	v1.3.1	#123	✅	✅
notebook-controller	apps/notebook-controller	v1.3.1	#126	✅	✅
pytorch-job	apps/pytorch-job	v1.3.1	#133	✅	✅
mpi-job	apps/mpi-job	v1.3.1	#134	✅	✅
tf-training	apps/tf-training	v1.3.1	#137	✅	✅
mxnet-job	apps/mxnet-job	v1.3.1	#136	✅	✅

Contrib

Component	Local Manifests Path	Upstream	Issue	AAW Sign-off	CNS Sign-off
spark-operator	apps/spark-operator	v1.3.1	#126	✅	✅
metacontroller	contrib/metacontroller	v1.3.1	#120	✅	✅
seldon	contrib/seldon	v1.3.1	#124	✅	✅

Containers

We provide our own Kubeflow Notebooks that are updated continuously:

• k8scc01covidacr.azurecr.io/rstudio:<sha>
• k8scc01covidacr.azurecr.io/jupyterlab-cpu:<sha>
• k8scc01covidacr.azurecr.io/jupyterlab-pytorch:<sha>
• k8scc01covidacr.azurecr.io/jupyterlab-tensorflow:<sha>
• k8scc01covidacr.azurecr.io/remote-desktop:<sha>

The following are the Kubeflow components we override in order to add features such as i18n and improved performance:

Container	Kubeflow Component	Comparison	AAW Sign-off	CNS Sign-off
oidc-authservice	oidc-authservice	N/A	✅	✅
centraldashboard	centraldashboard	Diff	✅	✅
jupyter-apis	jupyter-web-app	N/A	✅	✅
kubeflow-pipelines	ml-pipeline/frontend	Diff	✅	✅