Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

🔨 Anomalist performance #3447

Merged
merged 5 commits into from
Oct 22, 2024
Merged

🔨 Anomalist performance #3447

merged 5 commits into from
Oct 22, 2024

Conversation

Marigold
Copy link
Collaborator

@Marigold Marigold commented Oct 21, 2024 •
edited
Loading

  • Add function variable_data_df_from_catalog that loads data from catalog instead of R2
    • This is orders of magnitude faster (especially for huge datasets), but I haven't tested it much
    • There's no fallback to R2
  • Add envs ANOMALIST_MAX_TIME and ANOMALIST_N_JOBS which have higher values on the staging server
  • When using CLI, use new datasets by default (e.g. etl anomalist --anomaly-types gp_outlier --force)

@owidbot
Copy link
Contributor

owidbot commented Oct 21, 2024 •
edited
Loading

Quick links (staging server):

Site Admin Wizard

Login: ssh owid@staging-site-anomalist-performance

chart-diff: ✅ No charts for review.
data-diff: ❌ Found differences 
= Dataset garden/wb/2024-10-07/world_bank_pip
  = Table income_consumption_2017_poverty_gap_index_2000
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_2017_decile9_thr
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table consumption_2017_decile7_share
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_consumption_2017_polarization
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table consumption_2017_decile1_avg
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_consumption_2017_total_shortfall_50_median
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_2017_headcount_ratio_3000
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_2017_total_shortfall_365
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table consumption_2017_poverty_gap_index_50_median
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_consumption_2017_total_shortfall_4000
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_2017_income_gap_ratio_60_median
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table consumption_2017_decile9_share
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_2017_headcount_ratio_365
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_2017_avg_shortfall_685
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_2017_median
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table consumption_2017_total_shortfall_50_median
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table consumption_2017_total_shortfall_40_median
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_2017_poverty_gap_index_685
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_2017_headcount_ratio_4000
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_2017_avg_shortfall_60_median
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_2017_income_gap_ratio_40_median
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_consumption_2017_total_shortfall_2000
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table consumption_2017_spl
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_consumption_2017_total_shortfall_100
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table consumption_2017_decile8_thr
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table consumption_2017_mean
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_2017_headcount_685
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table consumption_2017_median
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table consumption_2017_decile10_share
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_consumption_2017_headcount_60_median
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_2017_income_gap_ratio_1000
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table income_consumption_2017_total_shortfall_40_median
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_3 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_4 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_5 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_6 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_7 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column income_spell_8 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
  = Table consumption_2017_top1_share
    ~ Column consumption_spell_1 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       -     Arabia'
    ~ Column consumption_spell_2 (changed metadata)
-       -   entityAnnotationsMap: 'Other high income countries (PIP): e.g. US, Western Europe, Australia, Japan, South Korea and Saudi
-       

...diff too long, truncated...

Automatically updated datasets matching weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk are not included

Edited: 2024-10-22 08:13:23 UTC
Execution time: 115.65 seconds

@Marigold Marigold force-pushed the anomalist-performance branch from 1b48419 to 1c01dd9 Compare October 22, 2024 07:56
@Marigold Marigold requested a review from pabloarosado October 22, 2024 08:10
pabloarosado
pabloarosado approved these changes Oct 22, 2024
View reviewed changes
Copy link
Contributor

@pabloarosado pabloarosado left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks good! But I think it makes sense to fallback to R2 if the dataset does not exist locally. Think of the case that Anomalist is used on a separate grapher dataset (not one of the new ones the user is working on). Those variables may not exist locally.

@Marigold
Copy link
Collaborator Author

Think of the case that Anomalist is used on a separate grapher dataset (not one of the new ones the user is working on). Those variables may not exist locally.

I'm afraid that falling back to getting variables from R2 would be confusing. Loading a large dataset from R2 takes minutes as opposed to seconds when loading it from local catalog. It'd be confusing to see UI frozen without knowing what's going on. We'd have to signal that we're using fallback in the UI. Staging servers have a complete catalog, so this would only happen locally - in which case it's better to rebuild the dataset in my opinion.

Anyway, I'd keep it as it is now, but if we run into this problem, I'm happy to add the fallback.

@Marigold Marigold merged commit e1eb471 into master Oct 22, 2024
11 checks passed
@Marigold Marigold deleted the anomalist-performance branch October 22, 2024 09:23
@lucasrodes lucasrodes mentioned this pull request Nov 4, 2024
Closed
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@pabloarosado pabloarosado pabloarosado approved these changes

Assignees

@Marigold Marigold

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@Marigold @owidbot @pabloarosado