Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update combined_parquet data for ingestion #17

Open
zacdezgeo opened this issue Jul 24, 2024 · 0 comments
Open

Update combined_parquet data for ingestion #17

zacdezgeo opened this issue Jul 24, 2024 · 0 comments
Assignees
@bpstewar
Labels
enhancement New feature or request

Comments

@zacdezgeo
Copy link
Collaborator

@bpstewar planned on modifying the data pipeline used to generate the combined dataset ingested into our database.

The two scripts I added for creating the combined_population.parquet are:

  1. https://github.com/worldbank/DECAT_Space2Stats/blob/review/population-parquet/src/combine_population_data.py: to pivot the data and combine into a single file
  2. https://github.com/worldbank/DECAT_Space2Stats/blob/review/population-parquet/src/add_total_pop.py: to add total counts

We should also close #7 as part of this effort.
@zacdezgeo zacdezgeo added the enhancement New feature or request label Jul 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@bpstewar bpstewar

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@bpstewar @zacdezgeo