Release 2022.10.1 #283

jrbourbeau · 2022-10-25T16:36:22Z


Release version	2022.10.1
Planned release date	2022-10-28
Status	On-track
Release manager	@jrbourbeau

Best effort

Try to close before the release but will not block the release

Blocker

Issues that would cause us to block and postpone the release if not fixed

Dashboard plot sizing issue with bokeh=3 distributed#7173 (noting that this is no longer a blocker, even though the issue is still open as we've added temporary workarounds for bokeh=3 compatibility -- see the PRs linked in Release 2022.10.1 #283 (comment))
...

Comments

cc @ian-r-rose @fjetter @quasiben @jakirkham

The text was updated successfully, but these errors were encountered:

douglasdavis · 2022-10-25T17:04:47Z

Digging a bit with the CLI issue..

After installing dask and distributed with conda-forge

If I run python -m dask...

$ python -m dask

shows what we want:

Usage: python -m dask [OPTIONS] COMMAND [ARGS]...

  Dask command line interface.

Options:
  --version   Show the version and exit.
  -h, --help  Show this message and exit.

Commands:
  docs       Open Dask documentation (https://docs.dask.org/) in a web browser.
  info       Information about your dask installation.
  scheduler  Launch a distributed scheduler.
  ssh        Launch a distributed cluster over SSH.
  worker     Launch a distributed worker attached to an existing SCHEDULER.

but

$ dask

shows

Usage: dask [OPTIONS] COMMAND [ARGS]...

  Dask command line interface.

Options:
  --version   Show the version and exit.
  -h, --help  Show this message and exit.

Commands:
  docs  Open Dask documentation (https://docs.dask.org/) in a web browser.
  info  Information about your dask installation.

$ python -m dask is running dask.__main__:main while $ dask is running dask.cli:cli. (note the pip(setuptools) installation uses dask.__main__:main). I think the conda-forge entry point should be dask.__main__:main

douglasdavis · 2022-10-25T17:09:03Z

~~Opened a PR conda-forge/dask-feedstock#200~~ fixed in dask-core-feedstock!

jakirkham · 2022-10-25T21:01:31Z

Thanks all for helping dig into the CLI issues! 🙏

Given the pain around that, would like to propose hardening the Click requirement in Dask going forward ( dask/dask#9595 ). Ideally would like to include that in this release

jrbourbeau · 2022-10-27T21:22:22Z

I've opened this issue around requiring python<3.11 dask/dask#9605. If folks have thoughts on the topic I'd appreciate feedback on that issue.

jrbourbeau · 2022-10-28T14:50:50Z

We haven't quite gotten dask/distributed#5648 over the finish line yet, so I'm going to push up PRs to put an upper bound of bokeh < 3 for dask and distributed given that we know there are compatibility issues with the bokeh=3 release scheduled to come out later today (cc @fjetter @crusaderky)

mrocklin · 2022-10-28T14:55:21Z

@gjoseph92 @fjetter are we turning on task queuing on the scheduler by default in this release?

gjoseph92 · 2022-10-28T15:07:09Z

No, it won't be ready in time. See dask/distributed#7213.

jrbourbeau · 2022-10-28T15:25:06Z

bokeh < 3 PRs:

gjoseph92 · 2022-10-28T20:33:17Z

@jrbourbeau not critical, but could be good to get dask/distributed#7224 in if CI passes and you have time to review.

jrbourbeau · 2022-10-28T21:21:47Z

Ah, sorry @gjoseph92 I need to start pushing out the release. Unfortunately I think that one will have to get in in the next release

gjoseph92 · 2022-10-28T21:42:38Z

No worries, queuing is still behind a feature flag so it's not too big of a deal.

jrbourbeau · 2022-10-28T21:52:57Z

2022.10.1 is out on PyPI and conda-forge PRs are open:

jrbourbeau · 2022-10-29T02:30:24Z

Alright, PyPI and conda-forge packages are released.

We ran into a problem building the Python 3.8 dask-notebook image over in dask-docker (xref dask/dask-docker#255) due to an issue in the underlying jupyter/base-notebook notebook (xref jupyter/docker-stacks#1810). I've attempted a couple of possible fixes, but haven't gotten those build to work yet. I've proposed a temporary workaround in dask/dask-docker#256 where we drop Python 3.8 builds. This is a possible workaround, but admittedly feels a bit heavy handed. I'm on PTO next week -- @jacobtomlinson @jakirkham @charlesbluca could I ask you to handle docker images for this release by either finding an actual fix, or by merging the PR that temporarily drops Python 3.8 builds?

jakirkham · 2022-10-29T08:53:20Z

FWIW commented on the upstream (Jupyter) issue.

mrocklin · 2022-10-31T14:57:32Z

Heads up: dask/dask#9609 Does anyone here have time to investigate what happened here with Bokeh? It appears that we're affecting Airflow negatively.

…

On Sat, Oct 29, 2022 at 3:53 AM jakirkham ***@***.***> wrote: FWIW commented on the upstream (Jupyter) issue. — Reply to this email directly, view it on GitHub <#283 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AACKZTFYPEGQJAQRJA6DSWLWFTQYXANCNFSM6AAAAAAROE5LGY> . You are receiving this because you commented.Message ID: ***@***.***>

mrocklin · 2022-10-31T15:47:34Z

Pushing out a hotfix #284

If there is anything I should know folks should jump in very soon.

ian-r-rose · 2022-10-31T15:54:06Z

There isn't anything I'm aware of that would prevent a hotfix, though dask/distributed#7224 is a non-trivial change. Perhaps @gjoseph92 can comment on whether it's likely to be an issue (I suspect he'd be fine with it)

jrbourbeau · 2022-10-31T15:55:39Z

I think @gjoseph92 is comfortable including that change has he asked for it to be included in the 2022.10.1 release, but it just didn't make it in time (xref #283 (comment))

EDIT: queuing is also still behind a feature flag, so I think it's safe to move forward with that change included

mrocklin · 2022-10-31T16:02:20Z

I've already chatted with @gjoseph92 and he confirmed.

I've yanked this release from PyPI. Can someone (maybe @jakirkham) help with yanking from conda-forge channels?

charlesbluca · 2022-10-31T19:29:06Z

could I ask you to handle docker images for this release by either finding an actual fix, or by merging the PR that temporarily drops Python 3.8 builds?

Any opposition to unblocking the 3.8 Docker builds locally with dask/dask-docker#257 until the upstream issue is resolved? This would involve patching the impacted Jupyter dockerfile, which could get hairy in the long run, but it doesn't seem like CI is running very often on dask-docker for this to be an issue.

jakirkham · 2022-10-31T19:30:57Z

Would follow these steps for marking packages broken in conda-forge. Unfortunately I don't have bandwidth for this atm

charlesbluca · 2022-10-31T19:45:23Z

Thanks @jakirkham! Opened up conda-forge/admin-requests#504 to request the packages be marked as broken

jakirkham · 2022-10-31T19:47:06Z

As to Jupyter docker-stacks, outlined a path forward in comment ( jupyter/docker-stacks#1810 (comment) ). If anyone has bandwidth to try, should be a couple line change

jakirkham · 2022-11-02T18:51:22Z

Updating this thread, Charles' workaround was merged yesterday. Mamba released 1.0.0 early today. This subsequently fixed Jupyter docker-stacks ( jupyter/docker-stacks#1810 (comment) ). With that fixed, Charles reverted the workaround ( dask/dask-docker#260 ).

Edit: Also merged Charles PR yesterday to mark conda-forge packages broken.

jakirkham · 2022-11-02T18:53:02Z

Sounds like there is nothing more to do here. So going to close this out, but please feel free to reopen if I've missed something.

Thanks all! 🙏

jrbourbeau added the release label Oct 25, 2022

jrbourbeau mentioned this issue Oct 28, 2022

Temporarily restrict bokeh<3 dask/dask#9607

Merged

jrbourbeau mentioned this issue Oct 28, 2022

Temporarily restrict bokeh<3 dask/distributed#7219

Merged

jakirkham closed this as completed Nov 2, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Release 2022.10.1 #283

Release 2022.10.1 #283

jrbourbeau commented Oct 25, 2022 •

edited

Loading

douglasdavis commented Oct 25, 2022 •

edited

Loading

douglasdavis commented Oct 25, 2022 •

edited

Loading

jakirkham commented Oct 25, 2022

jrbourbeau commented Oct 27, 2022

jrbourbeau commented Oct 28, 2022

mrocklin commented Oct 28, 2022

gjoseph92 commented Oct 28, 2022

jrbourbeau commented Oct 28, 2022 •

edited

Loading

gjoseph92 commented Oct 28, 2022

jrbourbeau commented Oct 28, 2022

gjoseph92 commented Oct 28, 2022

jrbourbeau commented Oct 28, 2022 •

edited

Loading

jrbourbeau commented Oct 29, 2022 •

edited

Loading

jakirkham commented Oct 29, 2022

mrocklin commented Oct 31, 2022 via email

mrocklin commented Oct 31, 2022

ian-r-rose commented Oct 31, 2022

jrbourbeau commented Oct 31, 2022 •

edited

Loading

mrocklin commented Oct 31, 2022

charlesbluca commented Oct 31, 2022

jakirkham commented Oct 31, 2022

charlesbluca commented Oct 31, 2022

jakirkham commented Oct 31, 2022

jakirkham commented Nov 2, 2022 •

edited

Loading

jakirkham commented Nov 2, 2022

Release 2022.10.1 #283

Release 2022.10.1 #283

Comments

jrbourbeau commented Oct 25, 2022 • edited Loading

Best effort

Blocker

Comments

douglasdavis commented Oct 25, 2022 • edited Loading

douglasdavis commented Oct 25, 2022 • edited Loading

jakirkham commented Oct 25, 2022

jrbourbeau commented Oct 27, 2022

jrbourbeau commented Oct 28, 2022

mrocklin commented Oct 28, 2022

gjoseph92 commented Oct 28, 2022

jrbourbeau commented Oct 28, 2022 • edited Loading

gjoseph92 commented Oct 28, 2022

jrbourbeau commented Oct 28, 2022

gjoseph92 commented Oct 28, 2022

jrbourbeau commented Oct 28, 2022 • edited Loading

jrbourbeau commented Oct 29, 2022 • edited Loading

jakirkham commented Oct 29, 2022

mrocklin commented Oct 31, 2022 via email

mrocklin commented Oct 31, 2022

ian-r-rose commented Oct 31, 2022

jrbourbeau commented Oct 31, 2022 • edited Loading

mrocklin commented Oct 31, 2022

charlesbluca commented Oct 31, 2022

jakirkham commented Oct 31, 2022

charlesbluca commented Oct 31, 2022

jakirkham commented Oct 31, 2022

jakirkham commented Nov 2, 2022 • edited Loading

jakirkham commented Nov 2, 2022

jrbourbeau commented Oct 25, 2022 •

edited

Loading

douglasdavis commented Oct 25, 2022 •

edited

Loading

douglasdavis commented Oct 25, 2022 •

edited

Loading

jrbourbeau commented Oct 28, 2022 •

edited

Loading

jrbourbeau commented Oct 28, 2022 •

edited

Loading

jrbourbeau commented Oct 29, 2022 •

edited

Loading

jrbourbeau commented Oct 31, 2022 •

edited

Loading

jakirkham commented Nov 2, 2022 •

edited

Loading