Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow for gbasf2 projects with multiple output sub<xy> directories #122

Merged

Commits on Sep 14, 2021

  1. Allow for gbasf2 projects with multiple output sub<xy> directories

    Before that, the assumption was that all outputs are saved in a final sub00
    directory. But from gbasf2 release v5r1p3 to be released on 2021-09-16, jobs
    with many outputs (> 1000) can have outputs in additional subxy directories.
    
    This means that when downloading, we will also get multiple sub<xy> directories in
    the download. However, currently, the b2luigi user expects that all downloaded
    file names will be in a common directory, so after a completed download, we move
    the contents of all sub* directories into the final output directory.
    
    We can then still cross-check that the download was complete by replace sub<xy>
    with a wildcard when doing the remote gb2_ds_list command
    
    See #80
    meliache committed Sep 14, 2021
    Configuration menu
    Copy the full SHA
    3e0d062 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2021

  1. Configuration menu
    Copy the full SHA
    614e918 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c7a7573 View commit details
    Browse the repository at this point in the history
  3. Make wildcard for sub<xy> in dataset query more specific

    Instead of "/*/" for matching different sub<xy> directories, use "/sub*/", to
    prevent other subdirectories from being matched (even if that should never
    happen, better safe than sorry)
    meliache committed Sep 15, 2021
    Configuration menu
    Copy the full SHA
    486f357 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    b543220 View commit details
    Browse the repository at this point in the history