-
Notifications
You must be signed in to change notification settings - Fork 113
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Refactor Namespace Pipelines #1897
Conversation
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
package/kedro_viz/data_access/repositories/modular_pipelines.py
Outdated
Show resolved
Hide resolved
package/kedro_viz/data_access/repositories/modular_pipelines.py
Outdated
Show resolved
Hide resolved
package/kedro_viz/data_access/repositories/modular_pipelines.py
Outdated
Show resolved
Hide resolved
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
…aft/refactor-mod-pipe Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Giving final approval after having reviewed and approved all the sub PRs.
Signed-off-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM 👍 ... adding release note on the refactor and the bug fix should be great. Thank you @rashidakanchwala
Description
Resolves #1899 , #1814
Development notes
To ease review process for - #1897 , created the below PRs
QA notes
Example modular pipeline tree:
Current issues in constructing the modular pipeline tree:
Incorrect rendering of nodes :
Issues raised by users -
viz
#1814How does this PR resolve the issues:
Core parts that changed:
populate_tree
,add_children
,_add_datasets_as_children
,_add_children_to_parent_pipeline
to ModularPipelinesRepository. (Thanks to @rashidakanchwala)populate_tree
to resolve the construction ofmodular_pipelines_tree
for the registered pipelineadd_children
and other helper functionsCode Flow doc:
Please find further information at Refactor_Modular_Pipelines.docx
Modular Pipelines UI Rendering:
UseCase 1: When a modular pipeline output (dataset_3) is used as an input to another function of the same modular pipeline.
Before:
After:
UseCase 2: When a nested modular pipeline output (dataset_3) is used as an input to the outer modular pipeline
Before:
After:
UseCase 3: When a nested modular pipeline output (dataset_3) is used as an input to the outer modular pipeline and also used as an input to another external modular pipeline
Before:
After:
UseCase 4: When an output of a namespace function (using node namespaces) (dataset_7, dataset_9) is an input to another function in the same namespace
Before:
After:
UseCase 5: When an output of a nested modular pipeline (model_inputs) is an input to another nested modular pipeline
Before:
After:
UseCase 6: Nested namespace pipelines with single input (input_to_processing) and single output (output_from_processing)
Before:
After:
Modular Pipelines expand and collapse in action:
Before:
UseCase 1-4:
UseCase 5-6:
After:
UseCase 1-4:
UseCase 5-6:
Checklist
RELEASE.md
file