Error: Collection was modified; enumeration operation may not execute

[Sr1983]

Hi,
we have encountered the error "Collection was modified; enumeration operation may not execute" during the last 2 day (never happened till now).

The error is related to the Synapse Pipeline "Consolidation_OneEntity", activity "Switch - Copy Staging to data - Copy Parquet".

In previous github repository was reported the same error yesterday:
microsoft/bc2adls#138

Have you got any idea to solve the issue? It happen randomly on different entity (apparently without a logic).

[Bertverbeek4PS]

Is there maybe data that is deleted?

[Sr1983]

Hi thank you for yuor answer; we don't have any evidence about data deleted. It's really strange because we are using the pipeline from 3 month and this issue never happened.
In the other post, the user says the he solved, removing the entity and adding it again.
Is it possible?

[Bertverbeek4PS]

In pull request:
#14
There is a change of paritioning in the dataflow.
If you import that change and run it again.