[BUG] CI - Same Suites running in multiple shards

[felipepessoto]

Bug

Which Delta project/connector is this regarding?

• Spark
• Standalone
• Flink
• Kernel
• Other (fill in here)

Describe the problem

Some Suites - I believe anything in sparkGroup except spark runs in all the shards. For example, DeltaSharingFileIndexSuite:

Steps to reproduce

https://github.com/delta-io/delta/actions/runs/18921696779/job/54019227874?pr=5415

Observed results

Expected results

Run in only one shard

Further details

Probably because TestParallelization.settings is only set at Spark module

Environment information

• Delta Lake version:
• Spark version:
• Scala version:

Willingness to contribute

The Delta Lake Community encourages bug fix contributions. Would you or another member of your organization be willing to contribute a fix for this bug to the Delta Lake code base?

• Yes. I can contribute a fix for this bug independently.
• Yes. I would be willing to contribute a fix for this bug with guidance from the Delta Lake community.
• No. I cannot contribute a bug fix at this time.