Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor code generation for Kubeflow Pipelines #2986

Closed
ptitzler opened this issue Oct 26, 2022 · 2 comments · Fixed by #2993
Closed

Refactor code generation for Kubeflow Pipelines #2986

ptitzler opened this issue Oct 26, 2022 · 2 comments · Fixed by #2993
Assignees
Labels
kind:enhancement New feature or request platform: pipeline-Kubeflow Related to usage of Kubeflow Pipelines as pipeline runtime sizing: M
Milestone

Comments

@ptitzler
Copy link
Member

Is your feature request related to a problem? Please describe.

  • Refactor the Kubeflow Pipelines processor to generate Python DSL as intermediary output format
  • Expose the generated DSL in the export wizard in addition to the already support static configuration file (YAML)

Additional context

  • The changes have no impact on regular users because the changes are completely transparent.
  • Advanced users will be able to customize the generated Python DSL, if desired.
  • With these changes in place, support for pipeline parameters can be added.
@ptitzler ptitzler added kind:enhancement New feature or request platform: pipeline-Kubeflow Related to usage of Kubeflow Pipelines as pipeline runtime sizing: M labels Oct 26, 2022
@ptitzler ptitzler added this to the 3.13.0 milestone Oct 26, 2022
@ptitzler ptitzler self-assigned this Oct 26, 2022
@dvaldivia
Copy link

Exposing the kubeflow inout parameters for a component is highly desirable, so pipelines can be hooked into AutoML, I think even a simpler approach would be to expose add support for populating a component parameter inputs from kubeflow itself, just like we have a dropdown today for "put a string, read file, read output" we should have a "read from kubeflow" or similar

@ptitzler
Copy link
Member Author

Perhaps I am misunderstanding your comment, but pipeline parameters will enable users to do that, as outlined here. The motivation section in the linked doc includes a screen capture of how pipeline parameters are exposed in the Kubeflow Central dashboard.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind:enhancement New feature or request platform: pipeline-Kubeflow Related to usage of Kubeflow Pipelines as pipeline runtime sizing: M
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants