Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fdgc file cannot be retrieved from a requester-pays S3 Bucket url #6

Open
philvarner opened this issue Mar 29, 2022 · 0 comments
Open

Comments

@philvarner
Copy link

philvarner commented Mar 29, 2022

I would expect this to be supported for specifying the fgdc file:

export AWS_REQUEST_PAYER='requester'
stac naip create-item --fgdc s3://naip-analytic/va/2018/60cm/fgdc/37077/m_3707763_se_18_060_20180825.txt \
  VA 2018 s3://naip-analytic/va/2018/60cm/rgbir_cog/37077/m_3707763_se_18_060_20180825.tif \
  json-dest/

however, this fails because the code to read the fgdc txt file doesn't set the requester pays flag on the request, so it returns an access denied message. This is behavior inherited from the pystac io, but it's not really necessary to use that, since we're not retrieving a stac file.

Approach:

  1. Use fsspec to retrieve instead of StacIO
  2. allow enable of requester pays https://s3fs.readthedocs.io/en/latest/#requester-pays-buckets
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant