Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Note: great showcase of official statistics data hosted as parquet files #10

Open
e-kotov opened this issue Jun 25, 2024 · 1 comment
Open
Labels

Comments

@e-kotov
Copy link
Member

e-kotov commented Jun 25, 2024

https://observablehq.com/@fil/insee-parquet

This is a great showcase and argument for advocating to re-host the origin-destination data as parquet.

Meanwhile, I tested a few data repositories, such as Zenodo, Harvard Dataverse, OSF, Figshare. None provide a good way to access a parquet file. One has to use their API and download the whole file to work with it. Does not seem to be possible to query them.

@e-kotov e-kotov added the note label Jun 25, 2024
@Robinlovelace
Copy link
Collaborator

Very interesting, seems like Amazon S3 is a bit of a standard, I wonder how much hosting would cost. We could add some mechanism to limit the rate e.g. API key/password.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants