This project provides a client application to interact with the MSCI API for retrieving and managing ESG data. It handles database connections, data scraping, transformation, and insertion into MSSQL databases, with data exportable as CSV.
- MSSQL database connection
- Custom scraper engine for data retrieval
- Data transformation and insertion
- Docker setup for easy deployment
- Clone the repo and navigate to the directory.
- Install dependencies via
pip install -r requirements.txt
. - Set up environment variables in
.env
(based on.env.sample
). - Update credentials (App ID, Client ID, Client Secret, MSSQL details).
- Run the application with
docker build -t msci-esg .
anddocker run msci-esg
, or usepython main.py
.
client/
- Scraper engine and API clientconfig/
- Logger and app settingsdatabase/
- Database connections and data insertiontransformer/
- Data transformation logicmain.py
- Application entry point