[EPIC] Path to Kubeflow 1.7

[Jose-Matsuda]

1.7 has released lets do a roadmap.

• Investigate what needs to be done for kubeflow 1.7 update #1635
• KF 1.7: Investigate new features in 1.7  #1637
• Investigate / plan out tickets for the crud-web-apps portion of the rebase We have made the decision to stick with updating our backend for now, as we dont want to wait.
• Plan out tickets for central dashboard

Kubeflow Central Dashboard

• KF 1.7: Rebase onto 1.7 centraldashboard kubeflow#135
• KF1.7 Central dashboard local testing #1716
• StatCan/aaw-private#96
• KF1.7 Central dashboard Fix i18n #1718
• https://github.com/StatCan/aaw-private/issues/97
• KF 1.7 Fix tests (Tests all seemed to pass so no fixing required)
• KF 1.7 Central Dashboard merge into stc-master kubeflow#143
• KF 1.7 fix workflows
• Test Central Dashboard in dev

Jupyter-apis

• Evaluate Jupyter-apis backend for KF1.7 jupyter-apis#216
• Implement jupyter-apis backend changes for KF1.7 jupyter-apis#225
• Update jupyter-apis frontend - General to KF 1.7 jupyter-apis#230
• Update jupyter-apis common Folder frontend to KF1.7 jupyter-apis#226
• Add jupyter-apis Notebook-page frontend to KF1.7 jupyter-apis#229
• Add Volumes Details Page to KF1.7 jupyter-apis#231
• Investigate difficulty and length jupyter-apis common frontend to KF1.7 jupyter-apis#217
• Update jupyter-apis index frontend to KF1.7 jupyter-apis#218
• Update jupyter-apis form frontend to KF1.7 jupyter-apis#219
• Investigate Volumes folder for KF1.7 #1707
• Update frontend Volumes components for KF1.7 #1706

once jupyter-apis is functional

• Fix the javascript tests following KF1.7 jupyter-apis#245
• Update jupyter-apis cypress tests to KF1.7 jupyter-apis#220
• Update jupyter-apis i18n to KF1.7 jupyter-apis#221
• Evaluate the new crud-web-apps workflow files for KF1.7 jupyter-apis#240
• Implement the new workflows jupyter-apis#244
• StatCan/aaw-private#98

Test and Debugging

• Debug local upgraded KF1.7 jupyter-apis jupyter-apis#237
• Testing Jupyter-apis 1.7 on Dev jupyter-apis#252
• Fixing Jupyter-apis 1.7 issues from dev testing jupyter-apis#254

Other

Some of these are comments that were thought while doing rebasing

• make sure the volume and kubecost table are properly intergrated (mainly in config.ts and index-default.ts under the jupyter index component)
• tslint.json: We had this file already, but there is now a eslintrc.json. We might want to delete the file once we confirm that it works (file is deleted and the linting still works. tslint is deprecated and it is recommended to use eslint)
• karma.conf.js : Will need to confirm if the Karma tests are still useful and work. If the Files and proxies need to be more specific to our folder structures.
• Deploy either locally, or on dev (relies on kubernetes 1.24)
• [Epic] KF 1.7 Update manifests #1638
• KF1.7 Deploy manifest to dev  #1729
• Test and document kubeflow 1.7 on dev
• Prepare for kubeflow 1.7 to prod
• Verify why the metrics file is not working with more recent package.json fixes. We had to comment out a path
• Fix(contrib): knative manifest aaw-kubeflow-manifests#363

Decisions to take

• Do we want to get our icons back? They were removed from the form pages
• Decide if we use tensorboard (probably not)

---

TODO in the future (maybe 1.8)

• Investigate jupyter-apis Possible multi-threading issue w/Jupyter Web App (kubernetes-client/python) kubeflow/notebooks#114. May want to deploy this on our cluster without any customizations to test things out.
• Revisit the kubecost table UI. The common Table component got updated to have filtering. We don't need filtering and pagination on the kubecost table since it only has one row at all times.

---

Old stuff

• [Epic] K8s 1.22 / Kubeflow 1.6 #1337

[Jose-Matsuda]

Crud-web-apps / Jupyter-apis Tasks

Note that we may be looking at moving to just the StatCan/kubeflow repo especially if the backend fix mentioned solves our problems / we don't need to maintain jupyter-apis. I do feel like this part of the 1.7 upgrade should wait until we have tested the possible performance enhancements, as we don't want to rebase on top of jupyter-apis only to find out we didnt need to.

Given that the release cadence of kubeflow seems to be every half year (and they don't seem to do patch releases) we would probably need to wait until October for 1.8.0 until the proposed backend fix has been added to an official release. We can choose to just pick that pr up and add it to our kubeflow branch and test it in the meantime if we want to.

---

Older information

• Upgrade Jupyter apis to v1.6.0 jupyter-apis#132
• [Epic] Upgrade JWA 1.6 Commits to Redo jupyter-apis#131 <-- may just need to take this, and then add on top of it (as in any commits / customizations made after our rebase to 1.6)

---

Task List

• placeholder rebase related commits 1 (basically the fix-1.6 issues)
• ...

[Jose-Matsuda]

Centraldashboard

Should probably see how much customization there was, as we may not need to break this out into an epic. There was custom work done by the team since the 1.6 rebase but I don't think it should be too bad, especially since we're moving up a minor version anyways.

Upon talking with Bryan, who did the 1.6 rebase, we've agreed that this sort of ticket would be difficult to split out into smaller subtasks, and it's possibly really just a big ticket for one person to chew through.

---

Older Information

PR from 1.4 -> 1.6
Also this PR from Rohan --> CVE fix.

---

• KF 1.7: Rebase onto 1.7 centraldashboard kubeflow#135

[Souheil-Yazji]

Stale