fix: Fix infinite loop when running Pipeline

[silvanocerza]

Related Issues

• fixes eternal loop when optionally branching with join component #8059

Proposed Changes:

This changes a bit the internal run logic in two ways:

Components that have variadic input and not greedy will be put in the waiting_queue when outputs are distributed, previously they would have been put in the run_queue. This will prevent them from running before they're supposed to.

It also changes which Components we remove from the run_queue and waiting_queue when a Component produces only parts of its output, like the ConditionalRouter. Now we remove from the queues Components that directly would have received that output, but also their descendants. This prevents the Pipeline to get stuck in a loop waiting for inputs for Components that will never receive it.

How did you test it?

I added a new Pipeline in the behavioural tests similar to the one reported in the above issue and updated another test.

Notes for the reviewer

N/A

Checklist

• I have read the contributors guidelines and the code of conduct
• I have updated the related issue with new insights and changes
• I added unit tests and updated the docstrings
• I've used one of the conventional commit types for my PR title: fix:, feat:, build:, chore:, ci:, docs:, style:, refactor:, perf:, test:.
• I documented my code
• I ran pre-commit hooks and fixed any issue

[coveralls]

Pull Request Test Coverage Report for Build 10160706977

Details

• 0 of 0 changed or added relevant lines in 0 files are covered.
• 3 unchanged lines in 1 file lost coverage.
• Overall coverage decreased (-0.007%) to 90.052%

---

Files with Coverage Reduction	New Missed Lines	%
core/pipeline/base.py	3	92.46%

Totals
Change from base Build 10159517084:	-0.007%
Covered Lines:	6816
Relevant Lines:	7569

---

💛 - Coveralls

[HAODONG717]

I encountered the same problem, and your solution resolved my issue. Thank you very much!