Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

exp show: incorrect errors #8029

Closed
mattseddon opened this issue Jul 20, 2022 · 2 comments
Closed

exp show: incorrect errors #8029

mattseddon opened this issue Jul 20, 2022 · 2 comments
Labels
A: experiments Related to dvc exp product: VSCode Integration with VSCode extension

Comments

@mattseddon
Copy link
Member

Bug Report

Description

We are currently working on displaying experiment errors in the extension (iterative/vscode-dvc#1636). I have discovered that the msg/type fields in exp show errors shown at the file level can be incorrect. E.g

      "metrics": {
          "training_metrics.json": {
            "error": {
              "type": "YAMLFileCorruptedError",
              "msg": "unable to read: 'training_metrics.json', YAML file structure is corrupted"
            }
          }
        }

In the above example, training_metrics.json is not a YAML file.

Reproduce

  1. open any project that has a JSON metrics file
  2. corrupt the JSON in one of the metrics files.
  3. run exp show --show-json

Expected

A more general FileCorruptedError would be good.

Environment information

Output of dvc doctor:

$ dvc doctor
DVC version: 2.11.0 (pip)
---------------------------------
Platform: Python 3.8.9 on macOS-12.2.1-arm64-arm-64bit
Supports:
        webhdfs (fsspec = 2022.5.0),
        http (aiohttp = 3.8.1, aiohttp-retry = 2.5.1),
        https (aiohttp = 3.8.1, aiohttp-retry = 2.5.1),
        s3 (s3fs = 2022.5.0, boto3 = 1.21.21)
Cache types: reflink, hardlink, symlink
Cache directory: apfs on /dev/disk3s1s1
Caches: local
Remotes: https
Workspace directory: apfs on /dev/disk3s1s1
Repo: dvc (subdir), git

Additional Information (if any):

The approach that we are currently running with in the extension is to highlight any experiments that have errors and show the actual error message in a tooltip on hover. For us, a more general message would definitely work.

@mattseddon mattseddon added product: VSCode Integration with VSCode extension A: experiments Related to dvc exp bug labels Jul 20, 2022
@skshetry
Copy link
Member

skshetry commented Jul 20, 2022

@mattseddon, can you check with the latest version please?

@mattseddon
Copy link
Member Author

Resolved with 2.13.0 👍🏻.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A: experiments Related to dvc exp product: VSCode Integration with VSCode extension
Projects
None yet
Development

No branches or pull requests

2 participants