Unskip test_work_stealing_on_scaling_up

[jrbourbeau]

Let's try unskipping test_work_stealing_on_scaling_up since a possible fix has been deployed on Coiled (xref #336 (comment))

Closes #336

[jrbourbeau]

Okay, looks like we're still running into issues with test_work_stealing_on_scaling_up. We're seeing

  +-------------+----------+-----------+----------+
  | Package     | client   | scheduler | workers  |
  +-------------+----------+-----------+----------+
  | dask        | 2022.9.1 | 2022.6.0  | 2022.6.0 |
  | distributed | 2022.9.1 | 2022.6.0  | 2022.6.0 |
  +-------------+----------+-----------+----------+

in CI still. cc @ntabris @shughes-uk for visibility

[shughes-uk]

I’ll put this at the top of my list to look at.

…

On Mon, Sep 19, 2022 at 12:30 PM James Bourbeau ***@***.***> wrote: Okay, looks like we're still running into issues with test_work_stealing_on_scaling_up. We're seeing +-------------+----------+-----------+----------+ | Package | client | scheduler | workers | +-------------+----------+-----------+----------+ | dask | 2022.9.1 | 2022.6.0 | 2022.6.0 | | distributed | 2022.9.1 | 2022.6.0 | 2022.6.0 | +-------------+----------+-----------+----------+ in CI still. cc @ntabris <https://github.com/ntabris> @shughes-uk <https://github.com/shughes-uk> for visibility — Reply to this email directly, view it on GitHub <#351 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAEFQS4KWNJXFYZM3HXXQYTV7C5OXANCNFSM6AAAAAAQQHFBJM> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[ian-r-rose]

Here is the relevant run: https://github.com/coiled/coiled-runtime/actions/runs/3083687439/jobs/4984924644

[shughes-uk]

Package sync seems to be not enabled?

  with Cluster(
        name=test_name_uuid,
        n_workers=1,
        worker_vm_types=["t3.medium"],
        scheduler_vm_types=["t3.xlarge"],
        wait_for_workers=True,
    ) as cluster:

[ian-r-rose]

Hah, right you are! Seems like it got caught up in a merge issue. I'll push here to verify

[jrbourbeau]

Thanks @ian-r-rose. I totally missed that.

@shughes-uk what are your thoughts on adding a package_sync config value to coiled? That way we could easily say "Coiled, please always use package sync"

[shughes-uk]

Thanks @ian-r-rose. I totally missed that.

@shughes-uk what are your thoughts on adding a package_sync config value to coiled? That way we could easily say "Coiled, please always use package sync"

Seems reasonable, i'll add it to the todo list