Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add caching and create outputs as symlinks #1

Open
wants to merge 5 commits into
base: main
Choose a base branch
from

Commits on Apr 11, 2024

  1. Configuration menu
    Copy the full SHA
    95feed5 View commit details
    Browse the repository at this point in the history
  2. Add cache based on request hash

    Alter the download_cds command to download files to a user specified
    cache directory where files are named after
    `get_json_sem_hash(request)`. The `RequestEntry` class is introduce to
    keep the data necessary for producing the hash collected.
    
    Output according to `filename_spec` are created using symlinks to the
    cache.
    
    Main motivation for this is to allow multiple projects that might
    have overlapping data to re-use previously downloaded requests.
    petermcevoy committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    a28ea36 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    6287d88 View commit details
    Browse the repository at this point in the history
  4. Split download_cds into subcommands

    The mutually exclusive options to download_cds are split into click
    subcommands:
    - download
    - list-files
    - list-dangling
    petermcevoy committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    f03beb7 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2024

  1. Configuration menu
    Copy the full SHA
    9dbfaa9 View commit details
    Browse the repository at this point in the history