Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Database down #9

Open
nng555 opened this issue Apr 3, 2023 · 9 comments
Open

Database down #9

nng555 opened this issue Apr 3, 2023 · 9 comments

Comments

@nng555
Copy link

nng555 commented Apr 3, 2023

Hello,

It seems the database endpoint for datasets and models is currently down. (e.g. https://vasa.millennium.berkeley.edu:9000/robustness-eval/datasets/DvAR9QjMvf_data.bytes)

@ludwigschmidt
Copy link
Collaborator

Sorry, we had to migrate to a new server! This should work again in a day or two, we're completing the migration right now.

@nng555
Copy link
Author

nng555 commented Apr 10, 2023

Great, please let me know when the migrations is complete!

@rtaori
Copy link
Collaborator

rtaori commented Apr 10, 2023

Btw, the temporary solution in #8 might work for you for now in case you only need the eval data (and not dataset/model bytes)

@nng555
Copy link
Author

nng555 commented Apr 11, 2023

Unfortunately I'm looking to so some analysis on the model and datasets themselves so I need access to both dataset/model bytes.

@nng555
Copy link
Author

nng555 commented Apr 11, 2023

Is it possible to get any kind of ETA on when server migration might be finished? I'm trying to run these models for some additional rebuttal results and want to assuage my reviewers and ask for more time 😬

@rtaori
Copy link
Collaborator

rtaori commented Apr 12, 2023

Ah really sorry about this, not sure if we can get a reliable ETA. Unfortunately sounds like it might take some time :/
So most of the model checkpoint and dataset bytes are actually stored in google cloud. With the local DB patch referenced above, you should be able to download this data fine. But there are some objects that are stored on the berkeley server that won't be available until after the migration

@nng555
Copy link
Author

nng555 commented Apr 12, 2023

I tried that patch and was still unable to get anything downloaded since its hitting the s3 cache and not google drive (is there any way extract the cloud links directly?). I'm trying to use the following datasets:

  • imagenetv2-matched-frequency-format-val
  • objectnet-1.0-beta
  • imagenet-vid-robust
  • val-on-ytbb-robust-classes(?)
  • val-on-imagenet-a-classes

@nng555
Copy link
Author

nng555 commented Apr 12, 2023

Ah figured it out, just had to change the client in s3_utils.py to google on line 81. Not sure why it wasn't trying to google client by default when the s3 client failed...

@rtaori
Copy link
Collaborator

rtaori commented Apr 12, 2023

Ah I see! Thanks for discovering this bug - sounds like it's in the key_exists function? I guess what we should do here is first try get_s3_client_vasa, if that fails, use get_s3_client_google. Do you mind submitting a PR for the fix?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants