Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🔨 migrate population explorer #4095

Draft
wants to merge 33 commits into
base: master
Choose a base branch
from

Conversation

lucasrodes
Copy link
Member

@lucasrodes lucasrodes commented Mar 10, 2025

Some fixes on the way:

  • BUG(expand_config): all views were being created, even if we filtered only to a subset of dimensions.
  • BUG(explorers): The order of dimension choices was not respected in the final explorer presentation.
  • BUG(explorers): All widgets are being rendered as dropdowns
  • BUG(explorers): Ordering of dimensions and dimension choices in the final explorer presentation is not respected:
    • The order of the dimensions is set based on the ordering of columns.
    • The order of dimension choices is set based on how views appear in grapher table. That is, if first view has dimension sex=Female, that'll be the first choice shown for the dimension.

At the moment: working on create_explorer and .save

@owidbot
Copy link
Contributor

owidbot commented Mar 10, 2025

Quick links (staging server):

Site Dev Site Preview Admin Wizard Docs

Login: ssh owid@staging-site-refactor-migrate-population

chart-diff: ✅ No charts for review.
data-diff: ❌ Found differences
= Dataset garden/cdc/latest/measles_cases
  = Table measles_cases
    ~ Column cases (changed metadata)
-       -     date_accessed: '2025-03-11'
        ?                              ^
+       +     date_accessed: '2025-03-10'
        ?                              ^
    ~ Column outbreaks_n (changed metadata)
-       -     date_accessed: '2025-03-11'
        ?                              ^
+       +     date_accessed: '2025-03-10'
        ?                              ^
    ~ Column states_with_cases (changed metadata)
-       -     date_accessed: '2025-03-11'
        ?                              ^
+       +     date_accessed: '2025-03-10'
        ?                              ^
= Dataset garden/health/latest/measles_long_run
  = Table measles_long_run
    ~ Column case_rate (changed metadata)
-       -     date_accessed: '2025-03-11'
        ?                              ^
+       +     date_accessed: '2025-03-10'
        ?                              ^
    ~ Column case_rate_static (changed metadata)
-       -     date_accessed: '2025-03-11'
        ?                              ^
+       +     date_accessed: '2025-03-10'
        ?                              ^
    ~ Column cases (changed metadata)
-       -     date_accessed: '2025-03-11'
        ?                              ^
+       +     date_accessed: '2025-03-10'
        ?                              ^
    ~ Column cases_static (changed metadata)
-       -     date_accessed: '2025-03-11'
        ?                              ^
+       +     date_accessed: '2025-03-10'
        ?                              ^
= Dataset garden/poverty_inequality/2025-01-22/inequality_comparison
  = Table inequality_comparison
  = Table inequality_comparison_analysis
⚠ Error: Cannot run datadiff for an index of such size.
= Dataset garden/who/2024-12-10/vaccination_coverage
  = Table vaccination_coverage
    ~ Column coverage (changed metadata)
-       -   newborns
+       +   newborns who receive one dose of the Bacille Calmette-Guérin (BCG) vaccine
-       -   one-year-olds
+       +   one-year-olds who receive one dose of combined diphtheria, tetanus toxoid and pertussis- containing vaccine (DTP1)
-       -   one-year-olds
+       +   one-year-olds who receive three doses of combined diphtheria, tetanus toxoid and pertussis- containing vaccine (DTP3)
-       -   one-year-olds
+       +   one-year-olds who receive the first dose of measles-containing vaccine (MCV1)
-       -   one-year-olds
+       +   one-year-olds who receive the third dose of either oral or inactivated polio vaccine (POL3)
-       -   one-year-olds
+       +   one-year-olds who receive one dose of rubella-containing vaccine (RCV1)
-       -   one-year-olds
+       +   one-year-olds who receive three doses of Hepatitis B containing vaccine (HEPB3)
-       -   one-year-olds
+       +   one-year-olds who receive three doses of Haemophilus influenzae type b containing vaccine (HIB3)
-       -   newborns
+       +   newborns who receive a hepatitis B vaccine dose within the first 24 hours of delivery (HEPB_BD)
-       -   children
+       +   children who receive two doses of measles-containing vaccine as per the national schedule (MCV2)
-       -   one-year-olds
+       +   one-year-olds who receive the final recommended dose (2nd or 3rd) of rotavirus vaccine (ROTAC)
-       -   one-year-olds
+       +   one-year-olds who receive the pneumococcal conjugate vaccine 3rd dose (PCV3)
-       -   one-year-olds
+       +   one-year-olds who receive their first dose of inactivated polio containing vaccine (IPV1)
-       -   one-year-olds
+       +   one-year-olds who receive their second dose of inactivated polio containing vaccine (IPV2)
-       -   one-year-olds
+       +   one-year-olds who receive one dose of yellow fever vaccine (YFV)
-       -   two year olds
+       +   two year olds who have received the second dose measles-containing vaccine (MCV2X2)
-       -   one-year-olds
-       -   <%- endif %> who have received <% if antigen == "BCG" %>
-       -   one dose of the Bacille Calmette-Guérin (BCG) vaccine
-       -   <%- elif antigen == "DTPCV1" %>
-       -   one dose of combined diphtheria, tetanus toxoid and pertussis-containing vaccine (DTP1)
-       -   <%- elif antigen == "DTPCV3" %>
-       -   three doses of combined diphtheria, tetanus toxoid and pertussis-containing vaccine (DTP3)
-       -   <%- elif antigen == "MCV1" %>
-       -   their first dose of measles-containing vaccine (MCV1)
-       -   <%- elif antigen == "POL3" %>
-       -   their third dose of either oral or inactivated polio vaccine (POL3)
-       -   <%- elif antigen == "RCV1" %>
-       -   one dose of rubella-containing vaccine (RCV1)
-       -   <%- elif antigen == "HEPB3" %>
-       -   three doses of Hepatitis B containing vaccine (HEPB3)
-       -   <%- elif antigen == "HIB3" %>
-       -   three doses of Haemophilus influenzae type b containing vaccine (HIB3)
-       -   <%- elif antigen == "HEPB_BD" %>
-       -   a hepatitis B vaccine dose within the first 24 hours of delivery (HEPB_BD)
-       -   <%- elif antigen == "MCV2" %>
-       -   two doses of measles-containing vaccine as per the national schedule (MCV2)
-       -   <%- elif antigen == "ROTAC" %>
-       -   their final recommended dose (2nd or 3rd) of rotavirus vaccine (ROTAC)
-       -   <%- elif antigen == "PCV3" %>
-       -   their pneumococcal conjugate vaccine 3rd dose (PCV3)
-       -   <%- elif antigen == "IPV1" %>
-       -   their first dose of inactivated polio containing vaccine (IPV1)
-       -   <%- elif antigen == "IPV2" %>
-       -   their second dose of inactivated polio containing vaccine (IPV2)
-       -   <%- elif antigen == "YFV" %>
-       -   one dose of yellow fever vaccine (YFV)
-       -   <%- elif antigen == "MCV2X2" %>
-       -   their second dose measles-containing vaccine (MCV2X2)
-       -   <%- elif antigen == "MENA_C" %>
-       -   their last dose of meningococcal A conjugate vaccine (MENA_C)
        ?      --
+       +   one-year-olds who receive the last dose of meningococcal A conjugate vaccine (MENA_C)
        ?  ++++++++++++++++++++++++++
-       -   newborns
+       +   newborns who receive one dose of the Bacille Calmette-Guérin (BCG) vaccine
-       -   one-year-olds
+       +   one-year-olds who receive one dose of combined diphtheria, tetanus toxoid and pertussis- containing vaccine (DTP1)
-       -   one-year-olds
+       +   one-year-olds who receive three doses of combined diphtheria, tetanus toxoid and pertussis- containing vaccine (DTP3)
-       -   one-year-olds
+       +   one-year-olds who receive the first dose of measles-containing vaccine (MCV1)
-       -   one-year-olds
+       +   one-year-olds who receive the third dose of either oral or inactivated polio vaccine (POL3)
-       -   one-year-olds
+       +   one-year-olds who receive one dose of rubella-containing vaccine (RCV1)
-       -   one-year-olds
+       +   one-year-olds who receive three doses of Hepatitis B containing vaccine (HEPB3)
-       -   one-year-olds
+       +   one-year-olds who receive three doses of Haemophilus influenzae type b containing vaccine (HIB3)
-       -   newborns
+       +   newborns who receive a hepatitis B vaccine dose within the first 24 hours of delivery (HEPB_BD)
-       -   children
+       +   children who receive two doses of measles-containing vaccine as per the national schedule (MCV2)
-       -   one-year-olds
+       +   one-year-olds who receive the final recommended dose (2nd or 3rd) of rotavirus vaccine (ROTAC)
-       -   one-year-olds
+       +   one-year-olds who receive the pneumococcal conjugate vaccine 3rd dose (PCV3)
-       -   one-year-olds
+       +   one-year-olds who receive their first dose of inactivated polio containing vaccine (IPV1)
-       -   one-year-olds
+       +   one-year-olds who receive their second dose of inactivated polio containing vaccine (IPV2)
-       -   one-year-olds
+       +   one-year-olds who receive one dose of yellow fever vaccine (YFV)
-       -   two year olds
+       +   two year olds who have received the second dose measles-containing vaccine (MCV2X2)
-       -   one-year-olds
-       -   <%- endif %> who have received <% if antigen == "BCG" %>
-       -   one dose of the Bacille Calmette-Guérin (BCG) vaccine
-       -   <%- elif antigen == "DTPCV1" %>
-       -   one dose of combined diphtheria, tetanus toxoid and pertussis-containing vaccine (DTP1)
-       -   <%- elif antigen == "DTPCV3" %>
-       -   three doses of combined diphtheria, tetanus toxoid and pertussis-containing vaccine (DTP3)
-       -   <%- elif antigen == "MCV1" %>
-       -   their first dose of measles-containing vaccine (MCV1)
-       -   <%- elif antigen == "POL3" %>
-       -   their third dose of either oral or inactivated polio vaccine (POL3)
-       -   <%- elif antigen == "RCV1" %>
-       -   one dose of rubella-containing vaccine (RCV1)
-       -   <%- elif antigen == "HEPB3" %>
-       -   three doses of Hepatitis B containing vaccine (HEPB3)
-       -   <%- elif antigen == "HIB3" %>
-       -   three doses of Haemophilus influenzae type b containing vaccine (HIB3)
-       -   <%- elif antigen == "HEPB_BD" %>
-       -   a hepatitis B vaccine dose within the first 24 hours of delivery (HEPB_BD)
-       -   <%- elif antigen == "MCV2" %>
-       -   two doses of measles-containing vaccine as per the national schedule (MCV2)
-       -   <%- elif antigen == "ROTAC" %>
-       -   their final recommended dose (2nd or 3rd) of rotavirus vaccine (ROTAC)
-       -   <%- elif antigen == "PCV3" %>
-       -   their pneumococcal conjugate vaccine 3rd dose (PCV3)
-       -   <%- elif antigen == "IPV1" %>
-       -   their first dose of inactivated polio containing vaccine (IPV1)
-       -   <%- elif antigen == "IPV2" %>
-       -   their second dose of inactivated polio containing vaccine (IPV2)
-       -   <%- elif antigen == "YFV" %>
-       -   one dose of yellow fever vaccine (YFV)
-       -   <%- elif antigen == "MCV2X2" %>
-       -   their second dose measles-containing vaccine (MCV2X2)
-       -   <%- elif antigen == "MENA_C" %>
-       -   their last dose of meningococcal A conjugate vaccine (MENA_C)
        ?      --
+       +   one-year-olds who receive the last dose of meningococcal A conjugate vaccine (MENA_C)
        ?  ++++++++++++++++++++++++++
-       -     This data includes estimates for all WHO Member States, including those that did not report 2023 data. For non-reporting countries, estimates were extrapolated from the last point informed by empirical data.
        ?       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     The current release of the data includes estimates for WHO Member States, including those that did not report 2023 data. For these non-reporting countries, estimates were extrapolated from the last point informed by empirical data.
        ?       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^                                                                       ++++++
-       -     To calculate global and regional average, values are extrapolated from 2022 for non-reporting countries. Non-reporting countries represent approximately 5% of the 2023 cohort.
        ?     ^^^^  - ---                      ^      -------
+       +     Values for global and regional coverages are extrapolated from 2022 for non-reporting countries. Non-reporting countries represent approximately 5% of the global 2023 cohort.
        ?     ^    +++++                     ^^                                                                                                                         +++++++
-       -     These estimates are based on quantitative data: 1) Country reported coverage data (official and administrative coverage) and 2) Survey coverage (from survey final reports, and complying with minimum set of quality criteria), and are informed by contextual information (e.g., stock-outs, changes in schedule, and other relevant information where available and appropriate). These estimates are affected by the availability and quality of the underlying data.
        ?                                                                                                                                     ^^^^^^^^^^^^^^^                                                                                                                                                                                                                                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     These estimates are based on quantitative data: 1) Country reported coverage data (official and administrative coverage) and 2) survey coverage (from survey final reports, and complying with minimum set of quality criteria), and are informed by contextual information (e.g., stock-outs, changes in schedule, and other relevant information where available and appropriate). As such, these estimates are affected by the availability and quality of the underlying data.
        ?                                                                                                                                     ^^^^^^^^^^^^^^^                                                                                                                                                                                                                                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     In countries where the national schedule recommends their first dose measles vaccine at 12 months or later based on the epidemiology of disease in the country, these estimates reflect the percentage of children who received their first dose of measles vaccine as recommended.
        ?                                                                                                                                                                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     In countries where the national schedule recommends their first dose measles vaccine at 12 months or later based on the epidemiology of disease in the country, coverage estimates reflect the percentage of children who received their first dose of measles vaccine as recommended.
        ?                                                                                                                                                                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     originUrl: https://ourworldindata.org/vaccination
-       -     map:
-       -       time: latest
-       -       colorScale:
-       -         baseColorScheme: YlGnBu
-       -         binningStrategy: manual
-       -         customNumericValues:
-       -           - 20
-       -           - 40
-       -           - 60
-       -           - 80
-       -           - 100
-   - Column unvaccinated
-   - Column vaccinated
+ + Table number_of_newborns
+   + Column vaccinated_newborns
+   + Column unvaccinated_newborns
+ + Table number_of_one_year_olds
+   + Column vaccinated_one_year_olds
+   + Column unvaccinated_one_year_olds


Legend: +New  ~Modified  -Removed  =Identical  Details
Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet

Automatically updated datasets matching weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk are not included

Edited: 2025-03-11 11:23:27 UTC
Execution time: 166.08 seconds

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants