Notebooks/Regressão_Linear_03.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Pré-processamento : Adequação dos tipos de dados(int, float, str...)  \n",
    "Considerando o grande volume de dados disponível em diversas aplicações, com frequência os conjuntos de dados não possuirão uma qualidade boa o suficiente para a extração de conhecimento novo, útil e relevante por algoritmos de Machine Learning.\n",
    "\n",
    "As principais causas de baixa qualidade de dados incluem a ocorrência de atributos irrelevantes, valores ausentes ou redundantes. \n",
    "\n",
    "[LINK DA VIDEO AULA](https://player.vimeo.com/video/342748334)\n",
    "\n",
    "[LINK DATASET](https://www.kaggle.com/city-of-seattle/sea-building-energy-benchmarking)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 106,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import numpy as np\n",
    "pd.set_option('display.max_columns', 47)\n",
    "dados = pd.read_csv(\"/home/gab/Curso_ML/Exercicios/Datasets/building_energy_benchmarking.csv\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 107,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>OSEBuildingID</th>\n",
       "      <th>DataYear</th>\n",
       "      <th>BuildingType</th>\n",
       "      <th>PrimaryPropertyType</th>\n",
       "      <th>PropertyName</th>\n",
       "      <th>TaxParcelIdentificationNumber</th>\n",
       "      <th>Location</th>\n",
       "      <th>CouncilDistrictCode</th>\n",
       "      <th>Neighborhood</th>\n",
       "      <th>YearBuilt</th>\n",
       "      <th>NumberofBuildings</th>\n",
       "      <th>NumberofFloors</th>\n",
       "      <th>PropertyGFATotal</th>\n",
       "      <th>PropertyGFAParking</th>\n",
       "      <th>PropertyGFABuilding(s)</th>\n",
       "      <th>ListOfAllPropertyUseTypes</th>\n",
       "      <th>LargestPropertyUseType</th>\n",
       "      <th>LargestPropertyUseTypeGFA</th>\n",
       "      <th>SecondLargestPropertyUseType</th>\n",
       "      <th>SecondLargestPropertyUseTypeGFA</th>\n",
       "      <th>ThirdLargestPropertyUseType</th>\n",
       "      <th>ThirdLargestPropertyUseTypeGFA</th>\n",
       "      <th>YearsENERGYSTARCertified</th>\n",
       "      <th>ENERGYSTARScore</th>\n",
       "      <th>SiteEUI(kBtu/sf)</th>\n",
       "      <th>SiteEUIWN(kBtu/sf)</th>\n",
       "      <th>SourceEUI(kBtu/sf)</th>\n",
       "      <th>SourceEUIWN(kBtu/sf)</th>\n",
       "      <th>SiteEnergyUse(kBtu)</th>\n",
       "      <th>SiteEnergyUseWN(kBtu)</th>\n",
       "      <th>SteamUse(kBtu)</th>\n",
       "      <th>Electricity(kWh)</th>\n",
       "      <th>Electricity(kBtu)</th>\n",
       "      <th>NaturalGas(therms)</th>\n",
       "      <th>NaturalGas(kBtu)</th>\n",
       "      <th>OtherFuelUse(kBtu)</th>\n",
       "      <th>GHGEmissions(MetricTonsCO2e)</th>\n",
       "      <th>GHGEmissionsIntensity(kgCO2e/ft2)</th>\n",
       "      <th>DefaultData</th>\n",
       "      <th>Comment</th>\n",
       "      <th>ComplianceStatus</th>\n",
       "      <th>Outlier</th>\n",
       "      <th>2010 Census Tracts</th>\n",
       "      <th>Seattle Police Department Micro Community Policing Plan Areas</th>\n",
       "      <th>City Council Districts</th>\n",
       "      <th>SPD Beats</th>\n",
       "      <th>Zip Codes</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>2015</td>\n",
       "      <td>NonResidential</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>MAYFLOWER PARK HOTEL</td>\n",
       "      <td>659000030</td>\n",
       "      <td>{'latitude': '47.61219025', 'longitude': '-122...</td>\n",
       "      <td>7</td>\n",
       "      <td>DOWNTOWN</td>\n",
       "      <td>1927</td>\n",
       "      <td>1</td>\n",
       "      <td>12.0</td>\n",
       "      <td>88434</td>\n",
       "      <td>0</td>\n",
       "      <td>88434</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>88434.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>65.0</td>\n",
       "      <td>78.9</td>\n",
       "      <td>80.3</td>\n",
       "      <td>173.5</td>\n",
       "      <td>175.1</td>\n",
       "      <td>6981428.0</td>\n",
       "      <td>7097539.0</td>\n",
       "      <td>2023032.0</td>\n",
       "      <td>1080307.0</td>\n",
       "      <td>3686160.0</td>\n",
       "      <td>12724.0</td>\n",
       "      <td>1272388.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>249.43</td>\n",
       "      <td>2.64</td>\n",
       "      <td>No</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Compliant</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>14.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>31.0</td>\n",
       "      <td>18081</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>2015</td>\n",
       "      <td>NonResidential</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>PARAMOUNT HOTEL</td>\n",
       "      <td>659000220</td>\n",
       "      <td>{'latitude': '47.61310583', 'longitude': '-122...</td>\n",
       "      <td>7</td>\n",
       "      <td>DOWNTOWN</td>\n",
       "      <td>1996</td>\n",
       "      <td>1</td>\n",
       "      <td>11.0</td>\n",
       "      <td>103566</td>\n",
       "      <td>15064</td>\n",
       "      <td>88502</td>\n",
       "      <td>Hotel, Parking, Restaurant</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>83880.0</td>\n",
       "      <td>Parking</td>\n",
       "      <td>15064.0</td>\n",
       "      <td>Restaurant</td>\n",
       "      <td>4622.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>51.0</td>\n",
       "      <td>94.4</td>\n",
       "      <td>99.0</td>\n",
       "      <td>191.3</td>\n",
       "      <td>195.2</td>\n",
       "      <td>8354235.0</td>\n",
       "      <td>8765788.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1144563.0</td>\n",
       "      <td>3905411.0</td>\n",
       "      <td>44490.0</td>\n",
       "      <td>4448985.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>263.51</td>\n",
       "      <td>2.38</td>\n",
       "      <td>No</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Compliant</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>14.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>31.0</td>\n",
       "      <td>18081</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3</td>\n",
       "      <td>2015</td>\n",
       "      <td>NonResidential</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>WESTIN HOTEL</td>\n",
       "      <td>659000475</td>\n",
       "      <td>{'latitude': '47.61334897', 'longitude': '-122...</td>\n",
       "      <td>7</td>\n",
       "      <td>DOWNTOWN</td>\n",
       "      <td>1969</td>\n",
       "      <td>1</td>\n",
       "      <td>41.0</td>\n",
       "      <td>961990</td>\n",
       "      <td>0</td>\n",
       "      <td>961990</td>\n",
       "      <td>Hotel, Parking, Swimming Pool</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>757243.0</td>\n",
       "      <td>Parking</td>\n",
       "      <td>100000.0</td>\n",
       "      <td>Swimming Pool</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>18.0</td>\n",
       "      <td>96.6</td>\n",
       "      <td>99.7</td>\n",
       "      <td>242.7</td>\n",
       "      <td>246.5</td>\n",
       "      <td>73130656.0</td>\n",
       "      <td>75506272.0</td>\n",
       "      <td>19660404.0</td>\n",
       "      <td>14583930.0</td>\n",
       "      <td>49762435.0</td>\n",
       "      <td>37099.0</td>\n",
       "      <td>3709900.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2061.48</td>\n",
       "      <td>1.92</td>\n",
       "      <td>Yes</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Compliant</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>56.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>31.0</td>\n",
       "      <td>18081</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>5</td>\n",
       "      <td>2015</td>\n",
       "      <td>NonResidential</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>HOTEL MAX</td>\n",
       "      <td>659000640</td>\n",
       "      <td>{'latitude': '47.61421585', 'longitude': '-122...</td>\n",
       "      <td>7</td>\n",
       "      <td>DOWNTOWN</td>\n",
       "      <td>1926</td>\n",
       "      <td>1</td>\n",
       "      <td>10.0</td>\n",
       "      <td>61320</td>\n",
       "      <td>0</td>\n",
       "      <td>61320</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>61320.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1.0</td>\n",
       "      <td>460.4</td>\n",
       "      <td>462.5</td>\n",
       "      <td>636.3</td>\n",
       "      <td>643.2</td>\n",
       "      <td>28229320.0</td>\n",
       "      <td>28363444.0</td>\n",
       "      <td>23458518.0</td>\n",
       "      <td>811521.0</td>\n",
       "      <td>2769023.0</td>\n",
       "      <td>20019.0</td>\n",
       "      <td>2001894.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1936.34</td>\n",
       "      <td>31.38</td>\n",
       "      <td>No</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Compliant</td>\n",
       "      <td>High Outlier</td>\n",
       "      <td>NaN</td>\n",
       "      <td>56.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>31.0</td>\n",
       "      <td>18081</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>8</td>\n",
       "      <td>2015</td>\n",
       "      <td>NonResidential</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>WARWICK SEATTLE HOTEL</td>\n",
       "      <td>659000970</td>\n",
       "      <td>{'latitude': '47.6137544', 'longitude': '-122....</td>\n",
       "      <td>7</td>\n",
       "      <td>DOWNTOWN</td>\n",
       "      <td>1980</td>\n",
       "      <td>1</td>\n",
       "      <td>18.0</td>\n",
       "      <td>119890</td>\n",
       "      <td>12460</td>\n",
       "      <td>107430</td>\n",
       "      <td>Hotel, Parking, Swimming Pool</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>123445.0</td>\n",
       "      <td>Parking</td>\n",
       "      <td>68009.0</td>\n",
       "      <td>Swimming Pool</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>67.0</td>\n",
       "      <td>120.1</td>\n",
       "      <td>122.1</td>\n",
       "      <td>228.8</td>\n",
       "      <td>227.1</td>\n",
       "      <td>14829099.0</td>\n",
       "      <td>15078243.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1777841.0</td>\n",
       "      <td>6066245.0</td>\n",
       "      <td>87631.0</td>\n",
       "      <td>8763105.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>507.70</td>\n",
       "      <td>4.02</td>\n",
       "      <td>No</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Compliant</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>56.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>31.0</td>\n",
       "      <td>19576</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   OSEBuildingID  DataYear    BuildingType PrimaryPropertyType  \\\n",
       "0              1      2015  NonResidential               Hotel   \n",
       "1              2      2015  NonResidential               Hotel   \n",
       "2              3      2015  NonResidential               Hotel   \n",
       "3              5      2015  NonResidential               Hotel   \n",
       "4              8      2015  NonResidential               Hotel   \n",
       "\n",
       "            PropertyName TaxParcelIdentificationNumber  \\\n",
       "0   MAYFLOWER PARK HOTEL                     659000030   \n",
       "1        PARAMOUNT HOTEL                     659000220   \n",
       "2           WESTIN HOTEL                     659000475   \n",
       "3              HOTEL MAX                     659000640   \n",
       "4  WARWICK SEATTLE HOTEL                     659000970   \n",
       "\n",
       "                                            Location  CouncilDistrictCode  \\\n",
       "0  {'latitude': '47.61219025', 'longitude': '-122...                    7   \n",
       "1  {'latitude': '47.61310583', 'longitude': '-122...                    7   \n",
       "2  {'latitude': '47.61334897', 'longitude': '-122...                    7   \n",
       "3  {'latitude': '47.61421585', 'longitude': '-122...                    7   \n",
       "4  {'latitude': '47.6137544', 'longitude': '-122....                    7   \n",
       "\n",
       "  Neighborhood  YearBuilt  NumberofBuildings  NumberofFloors  \\\n",
       "0     DOWNTOWN       1927                  1            12.0   \n",
       "1     DOWNTOWN       1996                  1            11.0   \n",
       "2     DOWNTOWN       1969                  1            41.0   \n",
       "3     DOWNTOWN       1926                  1            10.0   \n",
       "4     DOWNTOWN       1980                  1            18.0   \n",
       "\n",
       "   PropertyGFATotal  PropertyGFAParking  PropertyGFABuilding(s)  \\\n",
       "0             88434                   0                   88434   \n",
       "1            103566               15064                   88502   \n",
       "2            961990                   0                  961990   \n",
       "3             61320                   0                   61320   \n",
       "4            119890               12460                  107430   \n",
       "\n",
       "       ListOfAllPropertyUseTypes LargestPropertyUseType  \\\n",
       "0                          Hotel                  Hotel   \n",
       "1     Hotel, Parking, Restaurant                  Hotel   \n",
       "2  Hotel, Parking, Swimming Pool                  Hotel   \n",
       "3                          Hotel                  Hotel   \n",
       "4  Hotel, Parking, Swimming Pool                  Hotel   \n",
       "\n",
       "   LargestPropertyUseTypeGFA SecondLargestPropertyUseType  \\\n",
       "0                    88434.0                          NaN   \n",
       "1                    83880.0                      Parking   \n",
       "2                   757243.0                      Parking   \n",
       "3                    61320.0                          NaN   \n",
       "4                   123445.0                      Parking   \n",
       "\n",
       "   SecondLargestPropertyUseTypeGFA ThirdLargestPropertyUseType  \\\n",
       "0                              NaN                         NaN   \n",
       "1                          15064.0                  Restaurant   \n",
       "2                         100000.0               Swimming Pool   \n",
       "3                              NaN                         NaN   \n",
       "4                          68009.0               Swimming Pool   \n",
       "\n",
       "   ThirdLargestPropertyUseTypeGFA YearsENERGYSTARCertified  ENERGYSTARScore  \\\n",
       "0                             NaN                      NaN             65.0   \n",
       "1                          4622.0                      NaN             51.0   \n",
       "2                             0.0                      NaN             18.0   \n",
       "3                             NaN                      NaN              1.0   \n",
       "4                             0.0                      NaN             67.0   \n",
       "\n",
       "   SiteEUI(kBtu/sf)  SiteEUIWN(kBtu/sf)  SourceEUI(kBtu/sf)  \\\n",
       "0              78.9                80.3               173.5   \n",
       "1              94.4                99.0               191.3   \n",
       "2              96.6                99.7               242.7   \n",
       "3             460.4               462.5               636.3   \n",
       "4             120.1               122.1               228.8   \n",
       "\n",
       "   SourceEUIWN(kBtu/sf)  SiteEnergyUse(kBtu)  SiteEnergyUseWN(kBtu)  \\\n",
       "0                 175.1            6981428.0              7097539.0   \n",
       "1                 195.2            8354235.0              8765788.0   \n",
       "2                 246.5           73130656.0             75506272.0   \n",
       "3                 643.2           28229320.0             28363444.0   \n",
       "4                 227.1           14829099.0             15078243.0   \n",
       "\n",
       "   SteamUse(kBtu)  Electricity(kWh)  Electricity(kBtu)  NaturalGas(therms)  \\\n",
       "0       2023032.0         1080307.0          3686160.0             12724.0   \n",
       "1             0.0         1144563.0          3905411.0             44490.0   \n",
       "2      19660404.0        14583930.0         49762435.0             37099.0   \n",
       "3      23458518.0          811521.0          2769023.0             20019.0   \n",
       "4             0.0         1777841.0          6066245.0             87631.0   \n",
       "\n",
       "   NaturalGas(kBtu)  OtherFuelUse(kBtu)  GHGEmissions(MetricTonsCO2e)  \\\n",
       "0         1272388.0                 0.0                        249.43   \n",
       "1         4448985.0                 0.0                        263.51   \n",
       "2         3709900.0                 0.0                       2061.48   \n",
       "3         2001894.0                 0.0                       1936.34   \n",
       "4         8763105.0                 0.0                        507.70   \n",
       "\n",
       "   GHGEmissionsIntensity(kgCO2e/ft2) DefaultData Comment ComplianceStatus  \\\n",
       "0                               2.64          No     NaN        Compliant   \n",
       "1                               2.38          No     NaN        Compliant   \n",
       "2                               1.92         Yes     NaN        Compliant   \n",
       "3                              31.38          No     NaN        Compliant   \n",
       "4                               4.02          No     NaN        Compliant   \n",
       "\n",
       "        Outlier  2010 Census Tracts  \\\n",
       "0           NaN                 NaN   \n",
       "1           NaN                 NaN   \n",
       "2           NaN                 NaN   \n",
       "3  High Outlier                 NaN   \n",
       "4           NaN                 NaN   \n",
       "\n",
       "   Seattle Police Department Micro Community Policing Plan Areas  \\\n",
       "0                                               14.0               \n",
       "1                                               14.0               \n",
       "2                                               56.0               \n",
       "3                                               56.0               \n",
       "4                                               56.0               \n",
       "\n",
       "   City Council Districts  SPD Beats  Zip Codes  \n",
       "0                     NaN       31.0      18081  \n",
       "1                     NaN       31.0      18081  \n",
       "2                     NaN       31.0      18081  \n",
       "3                     NaN       31.0      18081  \n",
       "4                     NaN       31.0      19576  "
      ]
     },
     "execution_count": 107,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "dados.head()\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 108,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "OSEBuildingID                                                      int64\n",
       "DataYear                                                           int64\n",
       "BuildingType                                                      object\n",
       "PrimaryPropertyType                                               object\n",
       "PropertyName                                                      object\n",
       "TaxParcelIdentificationNumber                                     object\n",
       "Location                                                          object\n",
       "CouncilDistrictCode                                                int64\n",
       "Neighborhood                                                      object\n",
       "YearBuilt                                                          int64\n",
       "NumberofBuildings                                                  int64\n",
       "NumberofFloors                                                   float64\n",
       "PropertyGFATotal                                                   int64\n",
       "PropertyGFAParking                                                 int64\n",
       "PropertyGFABuilding(s)                                             int64\n",
       "ListOfAllPropertyUseTypes                                         object\n",
       "LargestPropertyUseType                                            object\n",
       "LargestPropertyUseTypeGFA                                        float64\n",
       "SecondLargestPropertyUseType                                      object\n",
       "SecondLargestPropertyUseTypeGFA                                  float64\n",
       "ThirdLargestPropertyUseType                                       object\n",
       "ThirdLargestPropertyUseTypeGFA                                   float64\n",
       "YearsENERGYSTARCertified                                          object\n",
       "ENERGYSTARScore                                                  float64\n",
       "SiteEUI(kBtu/sf)                                                 float64\n",
       "SiteEUIWN(kBtu/sf)                                               float64\n",
       "SourceEUI(kBtu/sf)                                               float64\n",
       "SourceEUIWN(kBtu/sf)                                             float64\n",
       "SiteEnergyUse(kBtu)                                              float64\n",
       "SiteEnergyUseWN(kBtu)                                            float64\n",
       "SteamUse(kBtu)                                                   float64\n",
       "Electricity(kWh)                                                 float64\n",
       "Electricity(kBtu)                                                float64\n",
       "NaturalGas(therms)                                               float64\n",
       "NaturalGas(kBtu)                                                 float64\n",
       "OtherFuelUse(kBtu)                                               float64\n",
       "GHGEmissions(MetricTonsCO2e)                                     float64\n",
       "GHGEmissionsIntensity(kgCO2e/ft2)                                float64\n",
       "DefaultData                                                       object\n",
       "Comment                                                           object\n",
       "ComplianceStatus                                                  object\n",
       "Outlier                                                           object\n",
       "2010 Census Tracts                                               float64\n",
       "Seattle Police Department Micro Community Policing Plan Areas    float64\n",
       "City Council Districts                                           float64\n",
       "SPD Beats                                                        float64\n",
       "Zip Codes                                                          int64\n",
       "dtype: object"
      ]
     },
     "execution_count": 108,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Verificando os tipos de dados.\n",
    "dados.dtypes"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Alterando o tipo do dado.\n",
    "\n",
    "Para mudar o tipo do dado basta alterar a columa selecionando chamando a função `astype()` e alterando dentro dela para o tipo desejado, sendo ele qualquer tipo suportado pelo python como `float64`, `int64`,`object`ou `str`.\n",
    "\n",
    "Como pode ser observado no exemplo a baixo onde eu alterei a coluna **CouncilDistrictCode** de `int`para `object`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 109,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Alterando o tipo do dado.\n",
    "# exemplo de utilização:\n",
    "dados[\"CouncilDistrictCode\"] = dados[\"CouncilDistrictCode\"].astype(object)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Pré-Processamento: Dados missing"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 110,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Para descobrir quais dados são faltantes\n",
    "enulo = dados.isnull()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 111,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "OSEBuildingID                                                       0\n",
      "DataYear                                                            0\n",
      "BuildingType                                                        0\n",
      "PrimaryPropertyType                                                 0\n",
      "PropertyName                                                        0\n",
      "TaxParcelIdentificationNumber                                       2\n",
      "Location                                                            0\n",
      "CouncilDistrictCode                                                 0\n",
      "Neighborhood                                                        0\n",
      "YearBuilt                                                           0\n",
      "NumberofBuildings                                                   0\n",
      "NumberofFloors                                                      8\n",
      "PropertyGFATotal                                                    0\n",
      "PropertyGFAParking                                                  0\n",
      "PropertyGFABuilding(s)                                              0\n",
      "ListOfAllPropertyUseTypes                                         127\n",
      "LargestPropertyUseType                                            136\n",
      "LargestPropertyUseTypeGFA                                         136\n",
      "SecondLargestPropertyUseType                                     1781\n",
      "SecondLargestPropertyUseTypeGFA                                  1781\n",
      "ThirdLargestPropertyUseType                                      2780\n",
      "ThirdLargestPropertyUseTypeGFA                                   2780\n",
      "YearsENERGYSTARCertified                                         3230\n",
      "ENERGYSTARScore                                                   780\n",
      "SiteEUI(kBtu/sf)                                                   10\n",
      "SiteEUIWN(kBtu/sf)                                                 10\n",
      "SourceEUI(kBtu/sf)                                                 10\n",
      "SourceEUIWN(kBtu/sf)                                               10\n",
      "SiteEnergyUse(kBtu)                                                10\n",
      "SiteEnergyUseWN(kBtu)                                              10\n",
      "SteamUse(kBtu)                                                     10\n",
      "Electricity(kWh)                                                   10\n",
      "Electricity(kBtu)                                                  10\n",
      "NaturalGas(therms)                                                 10\n",
      "NaturalGas(kBtu)                                                   10\n",
      "OtherFuelUse(kBtu)                                                 10\n",
      "GHGEmissions(MetricTonsCO2e)                                       10\n",
      "GHGEmissionsIntensity(kgCO2e/ft2)                                  10\n",
      "DefaultData                                                         1\n",
      "Comment                                                          3327\n",
      "ComplianceStatus                                                    0\n",
      "Outlier                                                          3256\n",
      "2010 Census Tracts                                               3116\n",
      "Seattle Police Department Micro Community Policing Plan Areas       2\n",
      "City Council Districts                                           3127\n",
      "SPD Beats                                                           2\n",
      "Zip Codes                                                           0\n",
      "dtype: int64\n"
     ]
    }
   ],
   "source": [
    "# Dados que estão faltando por coluna \n",
    "faltante = dados.isnull().sum()\n",
    "print(faltante)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 112,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Porcentagem de dados que estão faltando por coluna \n",
    "faltantes_percentual = (dados.isnull().sum() / len(dados[\"SecondLargestPropertyUseTypeGFA\"]))*100"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 113,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "OSEBuildingID                                                     0.000000\n",
      "DataYear                                                          0.000000\n",
      "BuildingType                                                      0.000000\n",
      "PrimaryPropertyType                                               0.000000\n",
      "PropertyName                                                      0.000000\n",
      "TaxParcelIdentificationNumber                                     0.059880\n",
      "Location                                                          0.000000\n",
      "CouncilDistrictCode                                               0.000000\n",
      "Neighborhood                                                      0.000000\n",
      "YearBuilt                                                         0.000000\n",
      "NumberofBuildings                                                 0.000000\n",
      "NumberofFloors                                                    0.239521\n",
      "PropertyGFATotal                                                  0.000000\n",
      "PropertyGFAParking                                                0.000000\n",
      "PropertyGFABuilding(s)                                            0.000000\n",
      "ListOfAllPropertyUseTypes                                         3.802395\n",
      "LargestPropertyUseType                                            4.071856\n",
      "LargestPropertyUseTypeGFA                                         4.071856\n",
      "SecondLargestPropertyUseType                                     53.323353\n",
      "SecondLargestPropertyUseTypeGFA                                  53.323353\n",
      "ThirdLargestPropertyUseType                                      83.233533\n",
      "ThirdLargestPropertyUseTypeGFA                                   83.233533\n",
      "YearsENERGYSTARCertified                                         96.706587\n",
      "ENERGYSTARScore                                                  23.353293\n",
      "SiteEUI(kBtu/sf)                                                  0.299401\n",
      "SiteEUIWN(kBtu/sf)                                                0.299401\n",
      "SourceEUI(kBtu/sf)                                                0.299401\n",
      "SourceEUIWN(kBtu/sf)                                              0.299401\n",
      "SiteEnergyUse(kBtu)                                               0.299401\n",
      "SiteEnergyUseWN(kBtu)                                             0.299401\n",
      "SteamUse(kBtu)                                                    0.299401\n",
      "Electricity(kWh)                                                  0.299401\n",
      "Electricity(kBtu)                                                 0.299401\n",
      "NaturalGas(therms)                                                0.299401\n",
      "NaturalGas(kBtu)                                                  0.299401\n",
      "OtherFuelUse(kBtu)                                                0.299401\n",
      "GHGEmissions(MetricTonsCO2e)                                      0.299401\n",
      "GHGEmissionsIntensity(kgCO2e/ft2)                                 0.299401\n",
      "DefaultData                                                       0.029940\n",
      "Comment                                                          99.610778\n",
      "ComplianceStatus                                                  0.000000\n",
      "Outlier                                                          97.485030\n",
      "2010 Census Tracts                                               93.293413\n",
      "Seattle Police Department Micro Community Policing Plan Areas     0.059880\n",
      "City Council Districts                                           93.622754\n",
      "SPD Beats                                                         0.059880\n",
      "Zip Codes                                                         0.000000\n",
      "dtype: float64\n"
     ]
    }
   ],
   "source": [
    "print(faltantes_percentual)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 114,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Apagando Colunas com Dados Vazios ou Irrelevante\n",
    "\n",
    "Colunas_inuteis  = [\"City Council Districts\", \"YearsENERGYSTARCertified\",\n",
    "                   \"ThirdLargestPropertyUseType\", \"ThirdLargestPropertyUseTypeGFA\",\n",
    "                   \"Comment\", \"Outlier\", \"2010 Census Tracts\"]\n",
    "\n",
    "for Colunas in Colunas_inuteis:\n",
    "    dados.drop(Colunas, inplace=True, axis=1)\n",
    "    "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 115,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(3340, 40)"
      ]
     },
     "execution_count": 115,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "dados.shape # Verificando a quantidade de colunas atualizadas"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 116,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>OSEBuildingID</th>\n",
       "      <th>DataYear</th>\n",
       "      <th>BuildingType</th>\n",
       "      <th>PrimaryPropertyType</th>\n",
       "      <th>PropertyName</th>\n",
       "      <th>TaxParcelIdentificationNumber</th>\n",
       "      <th>Location</th>\n",
       "      <th>CouncilDistrictCode</th>\n",
       "      <th>Neighborhood</th>\n",
       "      <th>YearBuilt</th>\n",
       "      <th>NumberofBuildings</th>\n",
       "      <th>NumberofFloors</th>\n",
       "      <th>PropertyGFATotal</th>\n",
       "      <th>PropertyGFAParking</th>\n",
       "      <th>PropertyGFABuilding(s)</th>\n",
       "      <th>ListOfAllPropertyUseTypes</th>\n",
       "      <th>LargestPropertyUseType</th>\n",
       "      <th>LargestPropertyUseTypeGFA</th>\n",
       "      <th>SecondLargestPropertyUseType</th>\n",
       "      <th>SecondLargestPropertyUseTypeGFA</th>\n",
       "      <th>ENERGYSTARScore</th>\n",
       "      <th>SiteEUI(kBtu/sf)</th>\n",
       "      <th>SiteEUIWN(kBtu/sf)</th>\n",
       "      <th>SourceEUI(kBtu/sf)</th>\n",
       "      <th>SourceEUIWN(kBtu/sf)</th>\n",
       "      <th>SiteEnergyUse(kBtu)</th>\n",
       "      <th>SiteEnergyUseWN(kBtu)</th>\n",
       "      <th>SteamUse(kBtu)</th>\n",
       "      <th>Electricity(kWh)</th>\n",
       "      <th>Electricity(kBtu)</th>\n",
       "      <th>NaturalGas(therms)</th>\n",
       "      <th>NaturalGas(kBtu)</th>\n",
       "      <th>OtherFuelUse(kBtu)</th>\n",
       "      <th>GHGEmissions(MetricTonsCO2e)</th>\n",
       "      <th>GHGEmissionsIntensity(kgCO2e/ft2)</th>\n",
       "      <th>DefaultData</th>\n",
       "      <th>ComplianceStatus</th>\n",
       "      <th>Seattle Police Department Micro Community Policing Plan Areas</th>\n",
       "      <th>SPD Beats</th>\n",
       "      <th>Zip Codes</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>2015</td>\n",
       "      <td>NonResidential</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>MAYFLOWER PARK HOTEL</td>\n",
       "      <td>659000030</td>\n",
       "      <td>{'latitude': '47.61219025', 'longitude': '-122...</td>\n",
       "      <td>7</td>\n",
       "      <td>DOWNTOWN</td>\n",
       "      <td>1927</td>\n",
       "      <td>1</td>\n",
       "      <td>12.0</td>\n",
       "      <td>88434</td>\n",
       "      <td>0</td>\n",
       "      <td>88434</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>88434.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>65.0</td>\n",
       "      <td>78.9</td>\n",
       "      <td>80.3</td>\n",
       "      <td>173.5</td>\n",
       "      <td>175.1</td>\n",
       "      <td>6981428.0</td>\n",
       "      <td>7097539.0</td>\n",
       "      <td>2023032.0</td>\n",
       "      <td>1080307.0</td>\n",
       "      <td>3686160.0</td>\n",
       "      <td>12724.0</td>\n",
       "      <td>1272388.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>249.43</td>\n",
       "      <td>2.64</td>\n",
       "      <td>No</td>\n",
       "      <td>Compliant</td>\n",
       "      <td>14.0</td>\n",
       "      <td>31.0</td>\n",
       "      <td>18081</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>2015</td>\n",
       "      <td>NonResidential</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>PARAMOUNT HOTEL</td>\n",
       "      <td>659000220</td>\n",
       "      <td>{'latitude': '47.61310583', 'longitude': '-122...</td>\n",
       "      <td>7</td>\n",
       "      <td>DOWNTOWN</td>\n",
       "      <td>1996</td>\n",
       "      <td>1</td>\n",
       "      <td>11.0</td>\n",
       "      <td>103566</td>\n",
       "      <td>15064</td>\n",
       "      <td>88502</td>\n",
       "      <td>Hotel, Parking, Restaurant</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>83880.0</td>\n",
       "      <td>Parking</td>\n",
       "      <td>15064.0</td>\n",
       "      <td>51.0</td>\n",
       "      <td>94.4</td>\n",
       "      <td>99.0</td>\n",
       "      <td>191.3</td>\n",
       "      <td>195.2</td>\n",
       "      <td>8354235.0</td>\n",
       "      <td>8765788.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1144563.0</td>\n",
       "      <td>3905411.0</td>\n",
       "      <td>44490.0</td>\n",
       "      <td>4448985.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>263.51</td>\n",
       "      <td>2.38</td>\n",
       "      <td>No</td>\n",
       "      <td>Compliant</td>\n",
       "      <td>14.0</td>\n",
       "      <td>31.0</td>\n",
       "      <td>18081</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3</td>\n",
       "      <td>2015</td>\n",
       "      <td>NonResidential</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>WESTIN HOTEL</td>\n",
       "      <td>659000475</td>\n",
       "      <td>{'latitude': '47.61334897', 'longitude': '-122...</td>\n",
       "      <td>7</td>\n",
       "      <td>DOWNTOWN</td>\n",
       "      <td>1969</td>\n",
       "      <td>1</td>\n",
       "      <td>41.0</td>\n",
       "      <td>961990</td>\n",
       "      <td>0</td>\n",
       "      <td>961990</td>\n",
       "      <td>Hotel, Parking, Swimming Pool</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>757243.0</td>\n",
       "      <td>Parking</td>\n",
       "      <td>100000.0</td>\n",
       "      <td>18.0</td>\n",
       "      <td>96.6</td>\n",
       "      <td>99.7</td>\n",
       "      <td>242.7</td>\n",
       "      <td>246.5</td>\n",
       "      <td>73130656.0</td>\n",
       "      <td>75506272.0</td>\n",
       "      <td>19660404.0</td>\n",
       "      <td>14583930.0</td>\n",
       "      <td>49762435.0</td>\n",
       "      <td>37099.0</td>\n",
       "      <td>3709900.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2061.48</td>\n",
       "      <td>1.92</td>\n",
       "      <td>Yes</td>\n",
       "      <td>Compliant</td>\n",
       "      <td>56.0</td>\n",
       "      <td>31.0</td>\n",
       "      <td>18081</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>5</td>\n",
       "      <td>2015</td>\n",
       "      <td>NonResidential</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>HOTEL MAX</td>\n",
       "      <td>659000640</td>\n",
       "      <td>{'latitude': '47.61421585', 'longitude': '-122...</td>\n",
       "      <td>7</td>\n",
       "      <td>DOWNTOWN</td>\n",
       "      <td>1926</td>\n",
       "      <td>1</td>\n",
       "      <td>10.0</td>\n",
       "      <td>61320</td>\n",
       "      <td>0</td>\n",
       "      <td>61320</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>61320.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1.0</td>\n",
       "      <td>460.4</td>\n",
       "      <td>462.5</td>\n",
       "      <td>636.3</td>\n",
       "      <td>643.2</td>\n",
       "      <td>28229320.0</td>\n",
       "      <td>28363444.0</td>\n",
       "      <td>23458518.0</td>\n",
       "      <td>811521.0</td>\n",
       "      <td>2769023.0</td>\n",
       "      <td>20019.0</td>\n",
       "      <td>2001894.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1936.34</td>\n",
       "      <td>31.38</td>\n",
       "      <td>No</td>\n",
       "      <td>Compliant</td>\n",
       "      <td>56.0</td>\n",
       "      <td>31.0</td>\n",
       "      <td>18081</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>8</td>\n",
       "      <td>2015</td>\n",
       "      <td>NonResidential</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>WARWICK SEATTLE HOTEL</td>\n",
       "      <td>659000970</td>\n",
       "      <td>{'latitude': '47.6137544', 'longitude': '-122....</td>\n",
       "      <td>7</td>\n",
       "      <td>DOWNTOWN</td>\n",
       "      <td>1980</td>\n",
       "      <td>1</td>\n",
       "      <td>18.0</td>\n",
       "      <td>119890</td>\n",
       "      <td>12460</td>\n",
       "      <td>107430</td>\n",
       "      <td>Hotel, Parking, Swimming Pool</td>\n",
       "      <td>Hotel</td>\n",
       "      <td>123445.0</td>\n",
       "      <td>Parking</td>\n",
       "      <td>68009.0</td>\n",
       "      <td>67.0</td>\n",
       "      <td>120.1</td>\n",
       "      <td>122.1</td>\n",
       "      <td>228.8</td>\n",
       "      <td>227.1</td>\n",
       "      <td>14829099.0</td>\n",
       "      <td>15078243.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1777841.0</td>\n",
       "      <td>6066245.0</td>\n",
       "      <td>87631.0</td>\n",
       "      <td>8763105.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>507.70</td>\n",
       "      <td>4.02</td>\n",
       "      <td>No</td>\n",
       "      <td>Compliant</td>\n",
       "      <td>56.0</td>\n",
       "      <td>31.0</td>\n",
       "      <td>19576</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   OSEBuildingID  DataYear    BuildingType PrimaryPropertyType  \\\n",
       "0              1      2015  NonResidential               Hotel   \n",
       "1              2      2015  NonResidential               Hotel   \n",
       "2              3      2015  NonResidential               Hotel   \n",
       "3              5      2015  NonResidential               Hotel   \n",
       "4              8      2015  NonResidential               Hotel   \n",
       "\n",
       "            PropertyName TaxParcelIdentificationNumber  \\\n",
       "0   MAYFLOWER PARK HOTEL                     659000030   \n",
       "1        PARAMOUNT HOTEL                     659000220   \n",
       "2           WESTIN HOTEL                     659000475   \n",
       "3              HOTEL MAX                     659000640   \n",
       "4  WARWICK SEATTLE HOTEL                     659000970   \n",
       "\n",
       "                                            Location CouncilDistrictCode  \\\n",
       "0  {'latitude': '47.61219025', 'longitude': '-122...                   7   \n",
       "1  {'latitude': '47.61310583', 'longitude': '-122...                   7   \n",
       "2  {'latitude': '47.61334897', 'longitude': '-122...                   7   \n",
       "3  {'latitude': '47.61421585', 'longitude': '-122...                   7   \n",
       "4  {'latitude': '47.6137544', 'longitude': '-122....                   7   \n",
       "\n",
       "  Neighborhood  YearBuilt  NumberofBuildings  NumberofFloors  \\\n",
       "0     DOWNTOWN       1927                  1            12.0   \n",
       "1     DOWNTOWN       1996                  1            11.0   \n",
       "2     DOWNTOWN       1969                  1            41.0   \n",
       "3     DOWNTOWN       1926                  1            10.0   \n",
       "4     DOWNTOWN       1980                  1            18.0   \n",
       "\n",
       "   PropertyGFATotal  PropertyGFAParking  PropertyGFABuilding(s)  \\\n",
       "0             88434                   0                   88434   \n",
       "1            103566               15064                   88502   \n",
       "2            961990                   0                  961990   \n",
       "3             61320                   0                   61320   \n",
       "4            119890               12460                  107430   \n",
       "\n",
       "       ListOfAllPropertyUseTypes LargestPropertyUseType  \\\n",
       "0                          Hotel                  Hotel   \n",
       "1     Hotel, Parking, Restaurant                  Hotel   \n",
       "2  Hotel, Parking, Swimming Pool                  Hotel   \n",
       "3                          Hotel                  Hotel   \n",
       "4  Hotel, Parking, Swimming Pool                  Hotel   \n",
       "\n",
       "   LargestPropertyUseTypeGFA SecondLargestPropertyUseType  \\\n",
       "0                    88434.0                          NaN   \n",
       "1                    83880.0                      Parking   \n",
       "2                   757243.0                      Parking   \n",
       "3                    61320.0                          NaN   \n",
       "4                   123445.0                      Parking   \n",
       "\n",
       "   SecondLargestPropertyUseTypeGFA  ENERGYSTARScore  SiteEUI(kBtu/sf)  \\\n",
       "0                              NaN             65.0              78.9   \n",
       "1                          15064.0             51.0              94.4   \n",
       "2                         100000.0             18.0              96.6   \n",
       "3                              NaN              1.0             460.4   \n",
       "4                          68009.0             67.0             120.1   \n",
       "\n",
       "   SiteEUIWN(kBtu/sf)  SourceEUI(kBtu/sf)  SourceEUIWN(kBtu/sf)  \\\n",
       "0                80.3               173.5                 175.1   \n",
       "1                99.0               191.3                 195.2   \n",
       "2                99.7               242.7                 246.5   \n",
       "3               462.5               636.3                 643.2   \n",
       "4               122.1               228.8                 227.1   \n",
       "\n",
       "   SiteEnergyUse(kBtu)  SiteEnergyUseWN(kBtu)  SteamUse(kBtu)  \\\n",
       "0            6981428.0              7097539.0       2023032.0   \n",
       "1            8354235.0              8765788.0             0.0   \n",
       "2           73130656.0             75506272.0      19660404.0   \n",
       "3           28229320.0             28363444.0      23458518.0   \n",
       "4           14829099.0             15078243.0             0.0   \n",
       "\n",
       "   Electricity(kWh)  Electricity(kBtu)  NaturalGas(therms)  NaturalGas(kBtu)  \\\n",
       "0         1080307.0          3686160.0             12724.0         1272388.0   \n",
       "1         1144563.0          3905411.0             44490.0         4448985.0   \n",
       "2        14583930.0         49762435.0             37099.0         3709900.0   \n",
       "3          811521.0          2769023.0             20019.0         2001894.0   \n",
       "4         1777841.0          6066245.0             87631.0         8763105.0   \n",
       "\n",
       "   OtherFuelUse(kBtu)  GHGEmissions(MetricTonsCO2e)  \\\n",
       "0                 0.0                        249.43   \n",
       "1                 0.0                        263.51   \n",
       "2                 0.0                       2061.48   \n",
       "3                 0.0                       1936.34   \n",
       "4                 0.0                        507.70   \n",
       "\n",
       "   GHGEmissionsIntensity(kgCO2e/ft2) DefaultData ComplianceStatus  \\\n",
       "0                               2.64          No        Compliant   \n",
       "1                               2.38          No        Compliant   \n",
       "2                               1.92         Yes        Compliant   \n",
       "3                              31.38          No        Compliant   \n",
       "4                               4.02          No        Compliant   \n",
       "\n",
       "   Seattle Police Department Micro Community Policing Plan Areas  SPD Beats  \\\n",
       "0                                               14.0                   31.0   \n",
       "1                                               14.0                   31.0   \n",
       "2                                               56.0                   31.0   \n",
       "3                                               56.0                   31.0   \n",
       "4                                               56.0                   31.0   \n",
       "\n",
       "   Zip Codes  \n",
       "0      18081  \n",
       "1      18081  \n",
       "2      18081  \n",
       "3      18081  \n",
       "4      19576  "
      ]
     },
     "execution_count": 116,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "dados.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 118,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Substituindo os dados faltantes por álgum valor\n",
    "# em Eletricity(kwh) Eu substitui pela médias dos valores dentro da coluna\n",
    "dados[\"Electricity(kWh)\"].fillna(dados[\"Electricity(kWh)\"].mean(), inplace=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 122,
   "metadata": {},
   "outputs": [],
   "source": [
    "# ENERGYSTARScore todos os dados que estiverem faltando será substituido pela mediana\n",
    "dados[\"ENERGYSTARScore\"].fillna(dados[\"ENERGYSTARScore\"].median(), inplace=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 130,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "3340"
      ]
     },
     "execution_count": 130,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Verificando o tamanho dos dados\n",
    "len(dados[\"ENERGYSTARScore\"])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 132,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0"
      ]
     },
     "execution_count": 132,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Verificando se os dados faltantes foram preenchidos\n",
    "verificando_ = dados[\"ENERGYSTARScore\"].isnull().sum()\n",
    "verificando_"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 133,
   "metadata": {},
   "outputs": [],
   "source": [
    "# ok Exercício finalizado."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}