Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

allow individual task times for workflow tasks or specfem executables #238

Open
bch0w opened this issue Nov 19, 2024 · 0 comments
Open

allow individual task times for workflow tasks or specfem executables #238

bch0w opened this issue Nov 19, 2024 · 0 comments

Comments

@bch0w
Copy link
Member

bch0w commented Nov 19, 2024

Currently there is only one tasktime that submits the walltime for a given job (e.g., forward simulation, smoothing). This value is not uniform for all tasks (e.g., adjoint simulation is longer than fwd), so we end up needing a maximum time required. Usually this is the smoothing code, or adjoint simulations. It would be useful to be able to set longer task times for tasks which take a long time (e.g,. gaussian smoothing takes 5--10x longer than forward simulations), or maybe do away with task times altogether? I think some clusters require it, or base their job priorities on it, so it's probably important. Some simple architecture would be to set tasktime as a dictionary, with one 'default' value and then if the User wants to override, they can match function names from Workflow.task_list() to new task times based on how long they expect that function to take.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

1 participant