Skip to content

Conversation

seisman
Copy link
Member

@seisman seisman commented Sep 7, 2025

dvc pull started to fail recently with errors like:

2025-09-07 01:23:24,119 DEBUG: v3.63.0 (pip), CPython 3.11.13 on Linux-6.11.0-1018-azure-x86_64-with-glibc2.39
2025-09-07 01:23:24,119 DEBUG: command: /home/runner/work/pygmt/pygmt/.venv/bin/dvc pull --no-run-cache --verbose
2025-09-07 01:23:26,142 DEBUG: Preparing to transfer data from 'https://dagshub.com/GenericMappingTools/pygmt.dvc/files/md5' to '/home/runner/work/pygmt/pygmt/.dvc/cache/files/md5'
2025-09-07 01:23:26,142 DEBUG: Preparing to collect status from '/home/runner/work/pygmt/pygmt/.dvc/cache/files/md5'
2025-09-07 01:23:26,142 DEBUG: Collecting status from '/home/runner/work/pygmt/pygmt/.dvc/cache/files/md5'
2025-09-07 01:23:26,144 DEBUG: Preparing to collect status from 'https://dagshub.com/GenericMappingTools/pygmt.dvc/files/md5'
2025-09-07 01:23:26,144 DEBUG: Collecting status from 'https://dagshub.com/GenericMappingTools/pygmt.dvc/files/md5'
2025-09-07 01:23:26,144 DEBUG: Querying 172 oids via object_exists
2025-09-07 01:23:26,881 WARNING: Some of the cache files do not exist neither locally nor on remote. Missing cache files:
md5: b73351d7d37e5d56fbcab6d46132026a
md5: e4bc1a90f4f25220fe759cdb0a709db8

I still don't know why it failed suddenly, but it turns out that we can fix the dvc issue via an access token.

@seisman seisman added this to the 0.17.0 milestone Sep 7, 2025
@seisman seisman added maintenance Boring but important stuff for the core devs needs review This PR has higher priority and needs review. run/test-gmt-dev Trigger the GMT Dev Tests workflow in PR labels Sep 7, 2025
@seisman seisman requested a review from Copilot September 7, 2025 13:09
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR addresses DVC (Data Version Control) failures when accessing the DagsHub repository by implementing token-based authentication. The recent failures were occurring when trying to pull baseline image data from the remote repository.

  • Configures DVC remote access with an authentication token for all CI workflows
  • Updates four GitHub Actions workflow files to use the DAGSHUB_TOKEN secret
  • Modifies the DVC remote URL to include token authentication before pulling data

Reviewed Changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 4 comments.

File Description
.github/workflows/release-baseline-images.yml Adds token authentication for DVC remote before pulling baseline images
.github/workflows/dvc-diff.yml Configures DVC remote with token and adds environment variable
.github/workflows/ci_tests_dev.yaml Updates development CI to use authenticated DVC remote access
.github/workflows/ci_tests.yaml Updates main CI to use authenticated DVC remote access

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@seisman seisman added final review call This PR requires final review and approval from a second reviewer and removed needs review This PR has higher priority and needs review. run/test-gmt-dev Trigger the GMT Dev Tests workflow in PR labels Sep 7, 2025
Copy link
Member

@weiji14 weiji14 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cheers for figuring this out! Pity that we can't access things publicly now.

@weiji14 weiji14 merged commit c0403aa into main Sep 7, 2025
28 of 31 checks passed
@weiji14 weiji14 deleted the dvc/debug branch September 7, 2025 22:09
@seisman seisman removed the final review call This PR requires final review and approval from a second reviewer label Sep 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

maintenance Boring but important stuff for the core devs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants