02_python/2683@awel-kanton-zuerich.ipynb

{"cells": [{"cell_type": "markdown", "id": "db7f08c1", "metadata": {}, "source": ["## Open Government Data, provided by **Canton Zurich**\n", "*Autogenerated Python starter code for data set with identifier* **2683@awel-kanton-zuerich**"]}, {"cell_type": "markdown", "id": "164c4327", "metadata": {}, "source": ["## Dataset\n", "# **Treibhausgasemissionen im Kanton Z\u00fcrich**"]}, {"cell_type": "markdown", "id": "46d13c8b-4ac3-4e2f-940f-0c14ec5b7c0d", "metadata": {}, "source": ["## Description\n", "\n", "Emissionen der wichtigsten Klimagase (CO2, CH4, N2O und synthetische Gase) im Kanton Z\u00fcrich.\nDie aufgef\u00fchrten Treibhausgasemissionen sind als CO2-\u00c4quivalente in Tonnen pro Jahr ausgewiesen und nach dem Territorialprinzip bilanziert. Das bedeutet, dass alle innerhalb des Kantons Z\u00fcrich anfallenden Emissionen f\u00fcr die Bilanz ber\u00fccksichtigt werden. \nDie Emissionen liegen als j\u00e4hrliche Zeitreihe ab 1990 vor. Sie werden zudem f\u00fcr die f\u00fcnf Hauptgruppen 'Abwasser und Abfall', 'Landwirtschaft', 'Verkehr', 'Industrie' und 'Geb\u00e4ude' ausgewiesen. Bei Bedarf k\u00f6nnen sie auf differenziertere Untergruppen verfeinert werden.\nDie Emissionsdaten stammen haupts\u00e4chlich aus der j\u00e4hrlich nachgef\u00fchrten kantonalen Bilanzierung mittels 'Ecospeed Region'. Die Emissionen aus dem Geb\u00e4udebereich stammen aus der zweij\u00e4hrlichen Berichterstattung zu den 'CO2-Emissionen aus dem Geb\u00e4udepark' zuhanden des Bundes.\nUm die Entwicklung der Treibhausgasemissionen m\u00f6glichst zeitnah sichtbar zu machen, wurde die Erstellungsmethodik 2024 leicht \u00fcberarbeitet. Dies hat zur Folge, dass sich die Emissionsdaten auch f\u00fcr zur\u00fcckliegende Jahre leicht ge\u00e4ndert haben. Zuk\u00fcnftig ist eine j\u00e4hrliche Datennachf\u00fchrung und -aktualisierung vorgesehen.\nDetailliertere Angaben zu den Daten sind als eigene Ressource 'Datenbeschreibung Treibhausgasemissionen im Kanton Z\u00fcrich' verlinkt."]}, {"cell_type": "markdown", "id": "cad813bb-c986-4bb4-b52b-f78bb608086f", "metadata": {}, "source": ["## Data set links\n", "\n", "[Direct data shop link for dataset](https://www.zh.ch/de/politik-staat/statistik-daten/datenkatalog.html#/datasets/2683@awel-kanton-zuerich)"]}, {"cell_type": "markdown", "id": "9d4813e9", "metadata": {}, "source": ["## Metadata\n", "- **Issued** `2024-08-21T12:40:30`\n- **Modified** `2024-12-04T15:15:30`\n- **Startdate** `1990-01-01`\n- **Enddate** `2022-12-31`\n- **Theme** `['http://publications.europa.eu/resource/authority/data-theme/ENVI']`\n- **Keyword** `['klima', 'emissionen', 'ogd']`\n- **Publisher** `['Amt f\u00fcr Abfall, Wasser, Energie und Luft des Kantons Z\u00fcrich']`\n- **Landingpage** `https://www.zh.ch/de/umwelt-tiere/klima/klimakarte-daten.html`\n"]}, {"cell_type": "markdown", "id": "8a857d65", "metadata": {"jp-MarkdownHeadingCollapsed": true, "tags": []}, "source": ["## Imports and helper functions"]}, {"cell_type": "code", "execution_count": null, "id": "93b39602-1c1e-46d2-ae70-1716b1481e9b", "metadata": {"tags": []}, "outputs": [], "source": ["%matplotlib inline\n", "import matplotlib.pyplot as plt\n", "plt.style.use('ggplot')\n", "\n", "params = {\n", "    'text.color': (0.25, 0.25, 0.25),\n", "    'figure.figsize': [18, 6],\n", "   }\n", "\n", "plt.rcParams.update(params)\n", "\n", "import pandas as pd "]}, {"cell_type": "code", "execution_count": null, "id": "aa6611d7-e1c0-40a7-b0ff-601a8ef8439b", "metadata": {"tags": []}, "outputs": [], "source": ["# helper function for reading datasets with proper separator\n", "def get_dataset(url):\n", "    if url[-3:] != \"csv\":\n", "        print(\"The data set URL has no proper 'csv' extension. Reading the dataset might not have worked as expected.\\nPlease check the dataset link and adjust pandas' read_csv() parameters accordingly.\")\n", "    data = pd.read_csv(url, sep=\",\", on_bad_lines='warn', encoding_errors='ignore', low_memory=False)\n", "    # if dataframe only has one column or less the data is not comma separated, use \";\" instead\n", "    if data.shape[1] <= 1:\n", "        data = pd.read_csv(url, sep=';', on_bad_lines='warn', encoding_errors='ignore', low_memory=False)\n", "        if data.shape[1] <= 1:\n", "            print(\"The data wasn't imported properly. Very likely the correct separator couldn't be found.\\nPlease check the dataset manually and adjust the code.\")\n", "    return data"]}, {"cell_type": "markdown", "id": "02ce518f", "metadata": {}, "source": ["## Load data\n", "\n", "- The dataset has **`1` distribution(s)** in CSV format.\n", "- All available CSV distributions are listed below and can be read into a pandas dataframe."]}, {"cell_type": "code", "execution_count": null, "id": "0", "metadata": {"tags": []}, "outputs": [], "source": "# Distribution 0\n# Ktzhdistid               : 5504\n# Title                    : Treibhausgasemissionen im Kanton Z\u00fcrich ab 1990\n# Description              : Emissionen der wichtigsten Klimagase (CO2, CH4, N2O und synthetische Gase) im Kanton Z\u00fcrich. Die aufgef\u00fchrten Treibhausgasemissionen sind nach dem Territorialprinzip bilanziert und werden als CO2-\u00c4quivalente in Tonnen pro Jahr ausgewiesen. Die Emissionen liegen als j\u00e4hrliche Zeitreihe ab 1990 vor. Mehr Informationen zum Inhalt der Daten sind in der Ressource \"Datenbeschreibung Treibhausgasemissionen im Kanton Z\u00fcrich\" enthalten.\n# Issued                   : 2024-08-21T12:40:30\n# Modified                 : 2024-08-23T16:45:37\n\ndf = get_dataset('https://www.web.statistik.zh.ch/ogd/daten/ressourcen/KTZH_00002683_00005504.csv')\n\n"}, {"cell_type": "markdown", "id": "4ce1f78f", "metadata": {}, "source": ["## Analyze data"]}, {"cell_type": "code", "execution_count": null, "id": "3e3dab86", "metadata": {}, "outputs": [], "source": ["# drop columns that have no values\n", "df.dropna(how='all', axis=1, inplace=True)"]}, {"cell_type": "code", "execution_count": null, "id": "841bd8d2", "metadata": {}, "outputs": [], "source": ["print(f'The dataset has {df.shape[0]:,.0f} rows (observations) and {df.shape[1]:,.0f} columns (variables).')\n", "print(f'There seem to be {df.duplicated().sum()} exact duplicates in the data.')"]}, {"cell_type": "code", "execution_count": null, "id": "75e73c96", "metadata": {}, "outputs": [], "source": ["df.info(memory_usage='deep', verbose=True)"]}, {"cell_type": "code", "execution_count": null, "id": "02f3df4d", "metadata": {}, "outputs": [], "source": ["df.head()"]}, {"cell_type": "code", "execution_count": null, "id": "a0d7d898", "metadata": {}, "outputs": [], "source": ["# display a small random sample transposed in order to see all variables\n", "df.sample(3).T"]}, {"cell_type": "code", "execution_count": null, "id": "786806dd", "metadata": {}, "outputs": [], "source": ["# describe non-numerical features\n", "try:\n", "    with pd.option_context('display.float_format', '{:,.2f}'.format):\n", "        display(df.describe(exclude='number'))\n", "except:\n", "    print(\"No categorical data in dataset.\")"]}, {"cell_type": "code", "execution_count": null, "id": "e744a6b6", "metadata": {}, "outputs": [], "source": ["# describe numerical features\n", "try:\n", "    with pd.option_context('display.float_format', '{:,.2f}'.format):\n", "        display(df.describe(include='number'))\n", "except:\n", "    print(\"No numercial data in dataset.\")"]}, {"cell_type": "code", "execution_count": null, "id": "7a65d95d", "metadata": {}, "outputs": [], "source": ["# check missing values with missingno\n", "# https://github.com/ResidentMario/missingno\n", "import missingno as msno\n", "msno.matrix(df, labels=True, sort='descending');"]}, {"cell_type": "code", "execution_count": null, "id": "fcc604b7", "metadata": {}, "outputs": [], "source": ["# plot a histogram for each numerical feature\n", "try:\n", "    df.hist(bins=25, rwidth=.9)\n", "    plt.tight_layout()\n", "    plt.show()\n", "except:\n", "    print(\"No numercial data to plot.\") "]}, {"cell_type": "code", "execution_count": null, "id": "e13cc6eb", "metadata": {}, "outputs": [], "source": ["# continue your code here..."]}, {"cell_type": "code", "execution_count": null, "id": "18886378", "metadata": {}, "outputs": [], "source": []}, {"cell_type": "code", "execution_count": null, "id": "59fce071", "metadata": {}, "outputs": [], "source": []}, {"cell_type": "code", "execution_count": null, "id": "f42f25aa", "metadata": {}, "outputs": [], "source": []}, {"cell_type": "markdown", "id": "c6b87d83", "metadata": {}, "source": ["**Contact**: Amt f\u00fcr Abfall, Wasser, Energie und Luft des Kantons Z\u00fcrich | Abteilung Luft, Klima und Strahlung | gian-marco.alt@bd.zh.ch"]}], "metadata": {"kernelspec": {"display_name": "Python 3 (ipykernel)", "language": "python", "name": "python3"}, "language_info": {"codemirror_mode": {"name": "ipython", "version": 3}, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.8.15"}}, "nbformat": 4, "nbformat_minor": 5}