It contains the docker environment with the next features:
-
PostgreSQL + PostGIS
-
Jupyter
- Python 3.10
- Packages:
- notebook
- matplotlib
- seaborn
- numpy
- ipyvizzu
- plotly
- selenium
- webdriver-manager
- psycopg2-binary
- SQLAlchemy
- powerbiclient
ih-data-powerbi
├─ .dockerignore
├─ .gitignore
├─ data
│ ├─ csv
│ │ ├─ ccaa_renta.csv
│ │ ├─ paro_ok.csv
│ │ ├─ provincias_renta.csv
│ │ ├─ votos_ccaa_ok.csv
│ │ ├─ votos_mesa_ok.csv
│ │ ├─ votos_municipios_ok.csv
│ │ └─ votos_province_ok.csv
│ ├─ df_mesas.csv
│ ├─ df_municipios.csv
│ ├─ df_provincias.csv
│ ├─ excel.ods
│ ├─ geojson
│ │ ├─ ccaa.csv
│ │ ├─ ccaa_geojson.sql
│ │ ├─ municipios_geojson.sql
│ │ └─ provincias_geojson.sql
│ ├─ gis_layers.qgz
│ └─ upload_geojson.sh
├─ docker-compose.yml
├─ jupyter
│ ├─ Dockerfile
│ ├─ extract.ipynb
│ ├─ extract_R.ipynb
│ ├─ load.ipynb
│ └─ transform.ipynb
├─ powerbi
│ ├─ 2019_Elections.pbix
└─ postgres
├─ Dockerfile
├─ db.sql
NOTE: to install this environment both docker and docker-compose are required
- Clone the repository using git
git clone https://github.com/iaguerri/ih-data-powerbi.git-
Move to the main repository's folder
-
Build with docker-compose build
docker-compose build- Start the corresponding containers with docker-compose up
docker-compose up -d- Access the link to access Jupyter within the notebooks directory
To access the database through pgadmin use the config_file.env with the data found in the docker-compose.yml file
etl_server="localhost"
port="5432"
etl_dbname="postgres"
user="postgres"
pwd="postgres"
NOTE: It should be located inside
data
To access the database through psql:
- Open a new terminal in the postgres container
docker exec -it ih-data-powerbi-postgres-1 /bin/bash- Initialize db with psql with user postgres
psql -U postgres
