Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Migrate to new S3 Bucket for Example Data #322

Closed
7 tasks done
ckunki opened this issue Aug 22, 2024 · 1 comment
Closed
7 tasks done

Migrate to new S3 Bucket for Example Data #322

ckunki opened this issue Aug 22, 2024 · 1 comment
Assignees
@ckunki
Labels
task

Comments

@ckunki
Copy link
Contributor

ckunki commented Aug 22, 2024 •
edited
Loading

In the past @ahsimb created an experimental bucket called us-flight-info.
Now, after implementing ticket #301, the AI Lab supports creating a new s3 Bucket "Example Data".

The current ticket requests to

  • update the URL in the related IBIS notebook: flight_utils.ipynb and
  • copy the files from the old bucket to the new one, and
  • Finally delete the old bucket:
    • Disable related Cloudfront distribution
    • Delete related Cloudfront distribution
    • Delete Origin Access Control of CF Distribution
    • Empty the bucket, i.e. delete all contained folders and files
    • Delete the bucket

Currently we decided to move the files into a subfolder

  • <URL>/ai_lab/flight-info/
  • E.g. <URL>/ai_lab/flight-info/US_AIRLINES.csv
@ckunki ckunki self-assigned this Aug 22, 2024
@ckunki ckunki added task documentation User guides, tutorials, specifications and removed task documentation User guides, tutorials, specifications labels Aug 22, 2024
ckunki added a commit that referenced this issue Aug 23, 2024
@ckunki
#322: Made URL in IBIS notebook point to new example data bucket
560d103
@ckunki ckunki mentioned this issue Aug 23, 2024
Merged
tkilias added a commit that referenced this issue Aug 25, 2024
@ckunki @tkilias
#308, #298, #318. #322: Updated and cleanup dependencies, re-enable …
c18369d 
…tests, move ibis notebook to new download URL, (#319)

* #308: Updated Dependencies of Jupyter Environment and pyproject.toml
* #298: Fixed vulnerabilities 
* #322: Made URL in IBIS notebook point to a new example data bucket
* #318: Re-enabled tests for cloud storage notebook

* Updated version constraint for stopwatch
* Replaced GitHub dependency in file test_dependencies.txt for notebook tests by PyPI dependency.
* Fixed CloudFormation lint tests
* Fixed name of docker registry in integration test to satisfy legal names for docker registries.
* Updated changes file
* Changed version to 3.0.0
* Fixed cloud storage notebook test
* Fixed cloud_store_config.ipynb temporarily by correctly reimplement bfs_utils.put_file


---------

Co-authored-by: Torsten Kilias <torsten.kilias@exasol.com>
@tkilias tkilias closed this as completed Aug 25, 2024
@tkilias tkilias reopened this Aug 26, 2024
@redcatbear
Copy link

This is merged already. @tkilias will remove the S3 bucket when ready.

@ckunki ckunki closed this as completed Sep 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ckunki ckunki

Labels
task
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@redcatbear @tkilias @ckunki