AttributeError when spinning up Coiled clusters with distributed==2021.12.0

[avriiil]

What happened:
Coiled cluster fails to spin up with AttributeError: can't set Attribute, full traceback below.

In [2]: coiled.Cluster()
---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
<ipython-input-2-9d94fb376ce0> in <module>
----> 1 coiled.Cluster()

~/mambaforge/envs/snowflake/lib/python3.9/site-packages/coiled/cluster.py in __init__(self, name, n_workers, configuration, software, worker_cpu, worker_gpu, worker_gpu_type, worker_memory, worker_class, worker_options, worker_vm_types, scheduler_cpu, scheduler_memory, scheduler_class, scheduler_options, scheduler_vm_types, asynchronous, cloud, account, shutdown_on_close, use_scheduler_public_ip, backend_options, credentials, timeout, environ, protocol)
    337         # `.scheduler_comm` will not have been assigned to the object's instance
    338         # yet
--> 339         super().__init__(asynchronous)
    340
    341         self.cloud: Cloud[IsAsynchronous] = cloud or Cloud.current(

~/mambaforge/envs/snowflake/lib/python3.9/site-packages/distributed/deploy/cluster.py in __init__(self, asynchronous, loop, quiet, name, scheduler_sync_interval)
     63     ):
     64         self._loop_runner = LoopRunner(loop=loop, asynchronous=asynchronous)
---> 65         self.loop = self._loop_runner.loop
     66
     67         self.scheduler_info = {"workers": {}}

AttributeError: can't set attribute

What you expected to happen:
Coiled cluster to spin up.

Minimal Complete Verifiable Example:

import coiled

coiled.Cluster()

Anything else we need to know?:
Error is resolved by downgrading dask and distributed to 2021.11.2

Environment:

• Dask version: 2021.12.0
• Python version: 3.9.7
• Operating System: macOS
• Install method (conda, pip, source): conda

[jrbourbeau]

Thanks for opening @rrpelgrim. I'm able to reproduce the issue. #5531 is where the relevant change in distributed was introduced. I'm in touch with folks on the Coiled side now to determine if this is something that should be fixed in distributed or coiled. Will keep this issue posted...