[Discourse] Is it possible to map coroutines in a dask bag?

[github-actions]

I was wondering if it is possible to map async functions onto a dask bag, something like:

import dask.bag as bag

async def sqr(n):
    return n**2

bag.from_sequence(range(10)).map(square).compute()

The above script will raise the f…

---

Would you like to know more?

Read the full article on the following website:

https://dask.discourse.group/t/is-it-possible-to-map-coroutines-in-a-dask-bag/174

[ian-r-rose]

I think the answer here is no. But it could! I think that client.submit/map can handle async functions, as of recently, and it would be reasonable to want collections to also support it.

A good response to this could

1. Answer the question
2. Link to the PR adding async support to Client.{submit,map}, which could be interesting
3. Encourage the user to open an issue with a feature request

[scharlottej13]

@pavithraes code snippet we worked on:

from dask.distributed import Client
client = await Client(asynchronous=True)

def sqr(n):
    return n**2

futures = client.map(sqr, range(10))
result = await client.gather(futures)

[pavithraes]

Link to the PR adding async support to Client.{submit,map}, which could be interesting

@ian-r-rose Is this the PR: dask/distributed#5151?

[ian-r-rose]

@ian-r-rose Is this the PR: dask/distributed#5151?

Yes, that's the one! It's actually a bit more general than I had remembered. Were you able to check the current state of what works with async user-submitted functions and what does not?

[pavithraes]

Were you able to check the current state of what works with async user-submitted functions and what does not?

We did a quick search through dask/dask and the docs, and see anything outside of client submit/map :/

[ian-r-rose]

We did a quick search through dask/dask and the docs, and see anything outside of client submit/map :/

Sounds good, I think it's worth following up with the question asker

[pavithraes]

Thanks, Ian!

Followed up!

[pavithraes]

They opened an issue on dask/dask, closing this as resolved.