Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add pipes; add async and iterative maps #6

Open
mmckerns opened this issue Jul 3, 2014 · 3 comments
Open

add pipes; add async and iterative maps #6

mmckerns opened this issue Jul 3, 2014 · 3 comments

Comments

@mmckerns
Copy link
Member

mmckerns commented Jul 3, 2014

needs async and blocking pipes, and upon that can build async and iterative maps

@mmckerns
Copy link
Member Author

mmckerns commented Jun 1, 2015

async map should be "easy", just don't block on the appearance of the results file. iterative maps are a bit nastier. Iterative is more difficult because the scheduler file is returned only when the job is finished -- so there seem to be two routes to implement this: (1) add some form of wrapper to print to stdout or a file and then capture the output and send it back to the caller, or (2) split the map into several smaller jobs (inside a job 'reservation' block) and catch the job files as they come back.

@fzimmermann89
Copy link

Hi, is there any progress on adding async map?

@mmckerns
Copy link
Member Author

mmckerns commented May 4, 2020

@fzimmermann89: Unfortunately, not yet. I keep meaning to get to this issue, but it keeps getting bumped.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants