Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

exp queue: monitor queue status #7590

Closed
3 tasks done
Tracked by #7592
pmrowla opened this issue Apr 19, 2022 · 3 comments
Closed
3 tasks done
Tracked by #7592

exp queue: monitor queue status #7590

pmrowla opened this issue Apr 19, 2022 · 3 comments
Assignees
Labels
A: experiments Related to dvc exp ui user interface / interaction

Comments

@pmrowla
Copy link
Contributor

pmrowla commented Apr 19, 2022

Support monitoring queue status and viewing output of running experiments

  • dvc queue status
  • dvc queue attach
  • dvc queue logs

Optional/under discussion:

Remove queued exps from exp show by default and implement exp show --queue option to include queued exps in the table

@pmrowla pmrowla added ui user interface / interaction A: experiments Related to dvc exp labels Apr 19, 2022
@pmrowla pmrowla mentioned this issue Apr 19, 2022
4 tasks
@karajan1001 karajan1001 added this to DVC May 17, 2022
@karajan1001 karajan1001 moved this to Backlog in DVC May 17, 2022
@karajan1001 karajan1001 moved this from Backlog to Review In Progress in DVC May 17, 2022
@karajan1001 karajan1001 self-assigned this May 17, 2022
karajan1001 added a commit to karajan1001/dvc that referenced this issue May 26, 2022
fix: iterative#7590
1. Add two new command `queue status` and `queue attach`
2. Add unit test for the CLI
3. Make `Running` exps can be found by `get_queue_entry_by_names`
pmrowla pushed a commit that referenced this issue May 27, 2022
fix: #7590
1. Add two new command `queue status` and `queue attach`
2. Add unit test for the CLI
3. Make `Running` exps can be found by `get_queue_entry_by_names`
pmrowla pushed a commit that referenced this issue Jun 2, 2022
fix: #7590
1. Add two new command `queue status` and `queue attach`
2. Add unit test for the CLI
3. Make `Running` exps can be found by `get_queue_entry_by_names`
@dberenbaum
Copy link
Collaborator

dberenbaum commented Jun 2, 2022

Does this include how to deal with failed experiments? We need the ability to see which experiments failed instead of having them "disappear."

Sorry for changing requirements here, but can dvc queue attach show all output up to the current point instead of streaming only new output? This would also be really useful for completed and failed experiments. Otherwise, I think it's hard to see what's happening in the experiments, and we may need a separate command like dvc queue log.

Edit: Looking some more, I think dvc queue logs is actually a more necessary command than dvc queue attach. There's no interaction during an experiment, so directly attaching doesn't add that much value.

@dberenbaum
Copy link
Collaborator

dvc queue status feedback (besides showing failed experiments as mentioned above):

  • Need a way to show completed experiments and to connect them to the experiment name/rev.
  • Can dvc queue status show short revs instead of the long ones?
  • Nice to have: can we show the time when the experiment actually started running?

dberenbaum pushed a commit that referenced this issue Jun 13, 2022
fix: #7590
1. Add two new command `queue status` and `queue attach`
2. Add unit test for the CLI
3. Make `Running` exps can be found by `get_queue_entry_by_names`
pmrowla pushed a commit that referenced this issue Jun 14, 2022
fix: #7590
1. Add two new command `queue status` and `queue attach`
2. Add unit test for the CLI
3. Make `Running` exps can be found by `get_queue_entry_by_names`
pmrowla pushed a commit that referenced this issue Jul 5, 2022
fix: #7590
1. Add two new command `queue status` and `queue attach`
2. Add unit test for the CLI
3. Make `Running` exps can be found by `get_queue_entry_by_names`
@karajan1001
Copy link
Contributor

close as all of the features had been implemented

Repository owner moved this from Review In Progress to Done in DVC Jul 5, 2022
pmrowla pushed a commit that referenced this issue Jul 6, 2022
fix: #7590
1. Add two new command `queue status` and `queue attach`
2. Add unit test for the CLI
3. Make `Running` exps can be found by `get_queue_entry_by_names`
pmrowla pushed a commit that referenced this issue Jul 11, 2022
fix: #7590
1. Add two new command `queue status` and `queue attach`
2. Add unit test for the CLI
3. Make `Running` exps can be found by `get_queue_entry_by_names`
pmrowla pushed a commit that referenced this issue Jul 12, 2022
fix: #7590
1. Add two new command `queue status` and `queue attach`
2. Add unit test for the CLI
3. Make `Running` exps can be found by `get_queue_entry_by_names`
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A: experiments Related to dvc exp ui user interface / interaction
Projects
No open projects
Archived in project
Development

No branches or pull requests

3 participants