Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

✨ anomalist: GP support, refactor functions, add dfReduced #3416

Merged
merged 8 commits into from
Oct 16, 2024

Conversation

lucasrodes
Copy link
Member

@lucasrodes lucasrodes commented Oct 16, 2024

  • Add dfReduced: This avoids loading dfScore in memory, and instead dfReduced, which is significantly lighter.
  • Abstract logic to generate a single dataframe into one function.
  • Support Gaussian Processes

@owidbot
Copy link
Contributor

owidbot commented Oct 16, 2024

Quick links (staging server):

Site Admin Wizard

Login: ssh owid@staging-site-anomalist-nits

chart-diff: ✅ No charts for review.
data-diff: ❌ Found differences
= Dataset garden/oecd/2024-08-21/official_development_assistance
  = Table dac2a
  = Table official_development_assistance
    ~ Column capital_subscriptions_deposits (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column capital_subscriptions_deposits_recipient (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column development_food_aid_recipient (changed metadata)
-       -   Food aid is categorized and reported in terms of its uses and modes of supply. In terms of the use of food aid, three categories are distinguished: programme food aid is supplied as a resource transfer providing balance of payments (BoP) or budgetary support; project food aid is usually provided to support specific poverty alleviation and disaster prevention activities, targeted on specific beneficiary groups or areas; relief food aid is targeted on, and freely distributed to, victims of natural or man-made disasters. In practice, there has been a blurring of the distinctions between different categories of use, especially in an emergency, crisis situation. The other main approach to distinguish food aid is by looking at its sources or modes of supply: direct transfers, including all food aid originating from a donor country; food aid purchases or exchanges in one developing country for use as food aid in another country; and, local purchases, procured in a country and used as food aid in the same country.
        ?                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +   Food aid is categorised and reported in terms of its uses and modes of supply. In terms of the use of food aid, three categories are distinguished: programme food aid is supplied as a resource transfer providing balance of payments (BoP) or budgetary support; project food aid is usually provided to support specific poverty alleviation and disaster prevention activities, targeted on specific beneficiary groups or areas; relief food aid is targeted on, and freely distributed to, victims of natural or man-made disasters. In practice, there has been a blurring of the distinctions between different categories of use, especially in an emergency, crisis situation. The other main approach to distinguish food aid is by looking at its sources or modes of supply: direct transfers, including all food aid originating from a donor country; food aid purchases or exchanges in one developing country for use as food aid in another country; and, local purchases, procured in a country and used as food aid in the same country.
        ?                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     In terms of its use, food aid can be subdivided into three categories: program food aid (budgetary support), project food aid (targeted poverty alleviation and disaster prevention) and relief food aid (targeted to victims of disasters). It can also be classified by modes of supply in direct transfers, food aid purchases or local purchases.
+       +     In terms of its use, food aid can be subdivided into three categories: program food aid (budgetary support), project food aid (targeted poverty alleviation and disaster prevention) and relief food aid (targeted to victims of disasters). It can also be classified by modes of suppply in direct transfers, food aid purchases or local purchases.
        ?                                                                                                                                                                                                                                                                                          +
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column development_food_aid_recipient_per_capita (changed metadata)
-       -   Food aid is categorized and reported in terms of its uses and modes of supply. In terms of the use of food aid, three categories are distinguished: programme food aid is supplied as a resource transfer providing balance of payments (BoP) or budgetary support; project food aid is usually provided to support specific poverty alleviation and disaster prevention activities, targeted on specific beneficiary groups or areas; relief food aid is targeted on, and freely distributed to, victims of natural or man-made disasters. In practice, there has been a blurring of the distinctions between different categories of use, especially in an emergency, crisis situation. The other main approach to distinguish food aid is by looking at its sources or modes of supply: direct transfers, including all food aid originating from a donor country; food aid purchases or exchanges in one developing country for use as food aid in another country; and, local purchases, procured in a country and used as food aid in the same country.
        ?                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +   Food aid is categorised and reported in terms of its uses and modes of supply. In terms of the use of food aid, three categories are distinguished: programme food aid is supplied as a resource transfer providing balance of payments (BoP) or budgetary support; project food aid is usually provided to support specific poverty alleviation and disaster prevention activities, targeted on specific beneficiary groups or areas; relief food aid is targeted on, and freely distributed to, victims of natural or man-made disasters. In practice, there has been a blurring of the distinctions between different categories of use, especially in an emergency, crisis situation. The other main approach to distinguish food aid is by looking at its sources or modes of supply: direct transfers, including all food aid originating from a donor country; food aid purchases or exchanges in one developing country for use as food aid in another country; and, local purchases, procured in a country and used as food aid in the same country.
        ?                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     In terms of its use, food aid can be subdivided into three categories: program food aid (budgetary support), project food aid (targeted poverty alleviation and disaster prevention) and relief food aid (targeted to victims of disasters). It can also be classified by modes of supply in direct transfers, food aid purchases or local purchases.
+       +     In terms of its use, food aid can be subdivided into three categories: program food aid (budgetary support), project food aid (targeted poverty alleviation and disaster prevention) and relief food aid (targeted to victims of disasters). It can also be classified by modes of suppply in direct transfers, food aid purchases or local purchases.
        ?                                                                                                                                                                                                                                                                                          +
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
-       -   We calculated this indicator by dividing by the population of the recipient country. We use a long-run population dataset (https://ourworldindata.org/population-sources).
        ?                                                                                                                                ^^^^^^^^
+       +   We calculated this indicator by dividing by the population of the recipient country. We use a long-run population dataset (https://ourworldindata.org/population-sources).
        ?                                                                                                                                ^^^^^^^
    ~ Column flows_net_disbursements (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column flows_share_gni_grant_equivalents (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column flows_share_gni_net_disbursements (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column grants (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column grants_recipient (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column grants_recipient_per_capita (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
-       -   We calculated this indicator by dividing by the population of the recipient country. We use a long-run population dataset (https://ourworldindata.org/population-sources).
        ?                                                                                                                                ^^^^^^^^
+       +   We calculated this indicator by dividing by the population of the recipient country. We use a long-run population dataset (https://ourworldindata.org/population-sources).
        ?                                                                                                                                ^^^^^^^
    ~ Column humanitarian_aid_recipient (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column humanitarian_aid_recipient_per_capita (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
-       -   We calculated this indicator by dividing by the population of the recipient country. We use a long-run population dataset (https://ourworldindata.org/population-sources).
        ?                                                                                                                                ^^^^^^^^
+       +   We calculated this indicator by dividing by the population of the recipient country. We use a long-run population dataset (https://ourworldindata.org/population-sources).
        ?                                                                                                                                ^^^^^^^
    ~ Column i_oda_net_disbursements (changed metadata)
-       -   [Official development assistance (ODA)](#dod:oda) is defined as government aid designed to promote the economic development and welfare of developing countries. Grants by private voluntary agencies and non-government organizations (NGOs) are defined as transfers for development made by private voluntary agencies and NGOs in cash, goods or services for which no payment is required. Monetary aid is estimated as net disbursements. This data is expressed in US dollars. It is adjusted for inflation.
        ?                                                                                                                                                                                                                                  ^^^^^^^
+       +   [Official development assistance (ODA)](#dod:oda) is defined as government aid designed to promote the economic development and welfare of developing countries. Grants by private voluntary agencies and non-government organisations (NGOs) are defined as transfers for development made by private voluntary agencies and NGOs in cash, goods or services for which no payment is required. Monetary aid is estimated as net disbursements. This data is expressed in US dollars. It is adjusted for inflation.
        ?                                                                                                                                                                                                                                  ^^^^^^^
-       -   Grants by private voluntary agencies and non-government organizations (NGOs) are defined as transfers for development made by private voluntary agencies and NGOs in cash, goods or services for which no payment is required.
        ?                                                                 ^^^^^^^
+       +   Grants by private voluntary agencies and non-government organisations (NGOs) are defined as transfers for development made by private voluntary agencies and NGOs in cash, goods or services for which no payment is required.
        ?                                                                 ^^^^^^^
-       -   The private sector comprises private corporations, households and non-profit institutions serving households. Development funding from the private sector is becoming more significant. This includes private foundations, which play an increasing role in funding development and in finding innovative ways to promote it; non-government organizations; and the for-profit private sector.
        ?                                                                                                                                                                                                                                                                                                                                                      ^
+       +   The private sector comprises private corporations, households and non-profit institutions serving households. Development funding from the private sector is becoming more significant. This includes private foundations, which play an increasing role in funding development and in finding innovative ways to promote it; non-government organisations; and the for-profit private sector.
        ?                                                                                                                                                                                                                                                                                                                                                      ^
-       -     The private sector comprises private corporations, households and non-profit institutions serving households. Development funding from the private sector is becoming more significant. This includes private foundations, which play an increasing role in funding development and in finding innovative ways to promote it; non-government organizations; and the for-profit private sector.
        ?                                                                                                                                                                                                                                                                                                                                                        ^
+       +     The private sector comprises private corporations, households and non-profit institutions serving households. Development funding from the private sector is becoming more significant. This includes private foundations, which play an increasing role in funding development and in finding innovative ways to promote it; non-government organisations; and the for-profit private sector.
        ?                                                                                                                                                                                                                                                                                                                                                        ^
-       -     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) maintains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) mantains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
-       -   We have combined net disbursements aid data from the [DAC1: Flows by donor (ODA+OOF+Private) dataset](https://data-explorer.oecd.org/vis?fs[0]=Topic%2C1%7CDevelopment%23DEV%23%7COfficial%20Development%20Assistance%20%28ODA%29%23DEV_ODA%23&pg=0&fc=Topic&bp=true&snb=20&df=dsDisseminateFinalDMZ&df=DSD_DAC1%40DF_DAC1&df=OECD.DCD.FSD&df=1.2&dq=DAC...1140%2B1160..Q.&lom=LASTNPERIODS&lo=10&to[TIME_PERIOD]=false) with the [DAC2A: Aid (ODA) disbursements to countries and regions dataset](https://data-explorer.oecd.org/vis?fs[0]=Topic%2C1%7CDevelopment%23DEV%23%7COfficial%20Development%20Assistance%20%28ODA%29%23DEV_ODA%23&pg=0&fc=Topic&bp=true&snb=20&df=dsDisseminateFinalDMZ&df=DSD_DAC2%40DF_DAC2A&df=OECD.DCD.FSD&df=1.1&dq=.DPGC.206.USD.Q&lom=LASTNPERIODS&lo=5&to[TIME_PERIOD]=false) to add aid given by multilateral organizations and grants given by private foundations.
        ?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               ^^^^^
+       +   We have combined net disbursements aid data from the [DAC1: Flows by donor (ODA+OOF+Private) dataset](https://data-explorer.oecd.org/vis?fs[0]=Topic%2C1%7CDevelopment%23DEV%23%7COfficial%20Development%20Assistance%20%28ODA%29%23DEV_ODA%23&pg=0&fc=Topic&bp=true&snb=20&df=dsDisseminateFinalDMZ&df=DSD_DAC1%40DF_DAC1&df=OECD.DCD.FSD&df=1.2&dq=DAC...1140%2B1160..Q.&lom=LASTNPERIODS&lo=10&to[TIME_PERIOD]=false) with the [DAC2A: Aid (ODA) disbursements to countries and regions dataset](https://data-explorer.oecd.org/vis?fs[0]=Topic%2C1%7CDevelopment%23DEV%23%7COfficial%20Development%20Assistance%20%28ODA%29%23DEV_ODA%23&pg=0&fc=Topic&bp=true&snb=20&df=dsDisseminateFinalDMZ&df=DSD_DAC2%40DF_DAC2A&df=OECD.DCD.FSD&df=1.1&dq=.DPGC.206.USD.Q&lom=LASTNPERIODS&lo=5&to[TIME_PERIOD]=false) to add aid given by multilateral organizations and grants given by private organizations.
        ?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               ^^^^^^^
    ~ Column i_oda_net_disbursements_per_capita (changed metadata)
-       -     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) maintains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) mantains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column i_oda_net_disbursements_share_gni (changed metadata)
-       -     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) maintains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) mantains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column ii_oof_net_disbursements (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column iii_officially_supported_export_credits_net_disbursements (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column iv_private_flows_market_terms_net_disbursements (changed metadata)
-       -   Private flows are financial flows for development at market terms financed out of private sector resources (changes in holdings of private, long-term assets held by residents of the reporting country) and private grants (grants by non-government organizations, net of subsidies received from the official sector). Private capital flows can be divided into: foreign direct investment; portfolio equity (the buying and selling of stocks and shares); remittances sent home by migrants; and private sector borrowing.
        ?                                                                                                                                                                                                                                                               ^
+       +   Private flows are financial flows for development at market terms financed out of private sector resources (changes in holdings of private, long-term assets held by residents of the reporting country) and private grants (grants by non-government organisations, net of subsidies received from the official sector). Private capital flows can be divided into: foreign direct investment; portfolio equity (the buying and selling of stocks and shares); remittances sent home by migrants; and private sector borrowing.
        ?                                                                                                                                                                                                                                                               ^
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column loans (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column loans_recipient (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column loans_recipient_per_capita (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
-       -   We calculated this indicator by dividing by the population of the recipient country. We use a long-run population dataset (https://ourworldindata.org/population-sources).
        ?                                                                                                                                ^^^^^^^^
+       +   We calculated this indicator by dividing by the population of the recipient country. We use a long-run population dataset (https://ourworldindata.org/population-sources).
        ?                                                                                                                                ^^^^^^^
    ~ Column oda_bilateral_2_net_disbursements (changed metadata)
-       -     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) maintains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) mantains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column oda_bilateral_grant_equivalents (changed metadata, changed data)
-       -     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) maintains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) mantains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs

        ~ Changed values: 72 / 131986 (0.05%)
                      country  year donor sector  oda_bilateral_grant_equivalents -  oda_bilateral_grant_equivalents +
                      Finland  2017   NaN    NaN                                NaN                       6.319630e+08
          G7 countries (OECD)  2017   NaN    NaN                                NaN                       6.572722e+10
                      Germany  2015   NaN    NaN                                NaN                       1.346798e+10
                       Greece  2017   NaN    NaN                                NaN                       8.611626e+07
                  New Zealand  2017   NaN    NaN                                NaN                       3.809874e+08
    ~ Column oda_by_sector (changed metadata)
-       -     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) maintains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) mantains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column oda_grant_equivalents (changed metadata, changed data)
-       -     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) maintains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) mantains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs

        ~ Changed values: 108 / 131986 (0.08%)
            country  year donor sector  oda_grant_equivalents -  oda_grant_equivalents +
          Australia  2017   NaN    NaN                      NaN             3329338880.0
             Canada  2016   NaN    NaN                      NaN             4992513024.0
            Denmark  2015   NaN    NaN                      NaN             2881250560.0
             Poland  2015   NaN    NaN                      NaN              486992576.0
           Slovakia  2015   NaN    NaN                      NaN               96470208.0
    ~ Column oda_grant_equivalents_per_capita (changed metadata, changed data)
-       -     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) maintains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) mantains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs

        ~ Changed values: 98 / 131986 (0.07%)
            country  year donor sector  oda_grant_equivalents_per_capita -  oda_grant_equivalents_per_capita +
          Australia  2017   NaN    NaN                                 NaN                          133.173553
            Denmark  2017   NaN    NaN                                 NaN                          462.676941
              Japan  2017   NaN    NaN                                 NaN                          104.299614
             Norway  2015   NaN    NaN                                 NaN                         1094.871582
              Spain  2016   NaN    NaN                                 NaN                          105.436790
    ~ Column oda_grant_equivalents_share_gni (changed metadata, changed data)
-       -     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) maintains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) mantains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs

        ~ Changed values: 99 / 131986 (0.08%)
            country  year donor sector  oda_grant_equivalents_share_gni -  oda_grant_equivalents_share_gni +
          Australia  2017   NaN    NaN                                NaN                           0.231997
            Denmark  2017   NaN    NaN                                NaN                           0.741308
              Japan  2017   NaN    NaN                                NaN                           0.302537
           Slovakia  2015   NaN    NaN                                NaN                           0.102281
              Spain  2017   NaN    NaN                                NaN                           0.194847
    ~ Column oda_multilateral_2_net_disbursements (changed metadata)
-       -     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) maintains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) mantains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column oda_multilateral_grant_equivalents (changed metadata, changed data)
-       -     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) maintains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) mantains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs

        ~ Changed values: 71 / 131986 (0.05%)
                      country  year donor sector  oda_multilateral_grant_equivalents -  oda_multilateral_grant_equivalents +
                      Finland  2017   NaN    NaN                                   NaN                          5.134759e+08
          G7 countries (OECD)  2017   NaN    NaN                                   NaN                          1.263545e+10
                      Germany  2015   NaN    NaN                                   NaN                          4.295527e+09
                       Greece  2017   NaN    NaN                                   NaN                          2.329116e+08
                  New Zealand  2017   NaN    NaN                                   NaN                          8.134570e+07
    ~ Column oda_recipient (changed metadata)
-       -     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) maintains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) mantains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column oda_recipient_per_capita (changed metadata)
-       -     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) maintains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) mantains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
-       -   We calculated this indicator by dividing by the population of the recipient country. We use a long-run population dataset (https://ourworldindata.org/population-sources).
        ?                                                                                                                                ^^^^^^^^
+       +   We calculated this indicator by dividing by the population of the recipient country. We use a long-run population dataset (https://ourworldindata.org/population-sources).
        ?                                                                                                                                ^^^^^^^
    ~ Column oda_share_gni_recipient (changed metadata)
-       -     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) maintains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+       +     The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) mantains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in (https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
        ?                                                                                                                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column recoveries (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column recoveries_recipient (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column technical_cooperation_recipient (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
    ~ Column technical_cooperation_recipient_per_capita (changed metadata)
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
-       -   We calculated this indicator by dividing by the population of the recipient country. We use a long-run population dataset (https://ourworldindata.org/population-sources).
        ?                                                                                                                                ^^^^^^^^
+       +   We calculated this indicator by dividing by the population of the recipient country. We use a long-run population dataset (https://ourworldindata.org/population-sources).
        ?                                                                                                                                ^^^^^^^
    ~ Column v_net_private_grants_net_disbursements (changed metadata)
-       -   Grants by private voluntary agencies and non-government organizations (NGOs) are defined as transfers for development made by private voluntary agencies and NGOs in cash, goods or services for which no payment is required. Monetary aid is estimated as net disbursements. This data is expressed in US dollars. It is adjusted for inflation.
        ?                                                                 ^^^^^^^
+       +   Grants by private voluntary agencies and non-government organisations (NGOs) are defined as transfers for development made by private voluntary agencies and NGOs in cash, goods or services for which no payment is required. Monetary aid is estimated as net disbursements. This data is expressed in US dollars. It is adjusted for inflation.
        ?                                                                 ^^^^^^^
-       -   Grants by private voluntary agencies and non-government organizations (NGOs) are defined as transfers for development made by private voluntary agencies and NGOs in cash, goods or services for which no payment is required.
        ?                                                                 ^^^^^^^
+       +   Grants by private voluntary agencies and non-government organisations (NGOs) are defined as transfers for development made by private voluntary agencies and NGOs in cash, goods or services for which no payment is required.
        ?                                                                 ^^^^^^^
-       -   The private sector comprises private corporations, households and non-profit institutions serving households. Development funding from the private sector is becoming more significant. This includes private foundations, which play an increasing role in funding development and in finding innovative ways to promote it; non-government organizations; and the for-profit private sector.
        ?                                                                                                                                                                                                                                                                                                                                                      ^
+       +   The private sector comprises private corporations, households and non-profit institutions serving households. Development funding from the private sector is becoming more significant. This includes private foundations, which play an increasing role in funding development and in finding innovative ways to promote it; non-government organisations; and the for-profit private sector.
        ?                                                                                                                                                                                                                                                                                                                                                      ^
-       -     The private sector comprises private corporations, households and non-profit institutions serving households. Development funding from the private sector is becoming more significant. This includes private foundations, which play an increasing role in funding development and in finding innovative ways to promote it; non-government organizations; and the for-profit private sector.
        ?                                                                                                                                                                                                                                                                                                                                                        ^
+       +     The private sector comprises private corporations, households and non-profit institutions serving households. Development funding from the private sector is becoming more significant. This includes private foundations, which play an increasing role in funding development and in finding innovative ways to promote it; non-government organisations; and the for-profit private sector.
        ?                                                                                                                                                                                                                                                                                                                                                        ^
-       -     Private donors: Private foundations reporting aid data
+       +     Private donors: Private voluntary agencies and NGOs
= Dataset garden/wb/2024-10-07/world_bank_pip
  = Table income_2017_total_shortfall_60_median
    ~ Column income_spell_1 (changed metadata)
-       -   - |-
-       -     Regional and global estimates are extrapolated up until the year of the data release using GDP growth estimates and forecasts. For more details about the methodology, please refer to the [World Bank PIP documentation](https://datanalytics.worldbank.org/PIP-Methodology/lineupestimates.html#nowcasts).
    ~ Column income_spell_2 (changed metadata)
-       -   - |-
-       -     Regional and global estimates are extrapolated up until the year of the data release using GDP growth estimates and forecasts. For more details about the methodology, please refer to the [World Bank PIP documentation](https://datanalytics.worldbank.org/PIP-Methodology/lineupestimates.html#nowcasts).
    ~ Column income_spell_3 (changed metadata)
-       -   - |-
-       -     Regional and global estimates are extrapolated up until the year of the data release using GDP growth estimates and forecasts. For more details about the methodology, please refer to the [World Bank PIP documentation](https://datanalytics.worldbank.org/PI

...diff too long, truncated...

Automatically updated datasets matching weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk are not included

Edited: 2024-10-16 13:27:36 UTC
Execution time: 122.52 seconds

@lucasrodes lucasrodes changed the title ✨ anomalist: nits ✨ anomalist: GP support, refactor functions, add dfReduced Oct 16, 2024
@lucasrodes lucasrodes marked this pull request as ready for review October 16, 2024 13:22
@lucasrodes lucasrodes merged commit fe3027b into wizard-anomalist Oct 16, 2024
8 checks passed
@lucasrodes lucasrodes deleted the anomalist-nits branch October 16, 2024 13:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants