Skip to content

A scalable data warehouse that will host the vehicle trajectory data extracted by analyzing footage taken by swarm drones and static roadside cameras, using the Extract Load Transform (ELT) framework using DBT to help analytic engineers in the city traffic department setup transformation workflows on a need basis.

License

Notifications You must be signed in to change notification settings

meriab21/Data-warehouse

Repository files navigation

Table of content

Overview

ELT

The purpose of this week’s challenge is to build a data engineering data warehouse should take into account future needs, organise data such that a number of downstream projects query the data efficiently. You should use the Extract Load Transform (ELT) framework using DBT.

Install

git clone https://github.com/meriab21/Data-warehouse
cd Data-watehouse
pip install -r requirements.txt
 cd airflow 
 
 docker-compose up airflow-init

 docker-compose up

Data

Data can be found here

Tech-Stack

Tech Stack used in this project

Description

Building a scalable data warehouse that will host the vehicle trajectory data extracted by analysing footage taken by swarm drones and static roadside cameras. The data warehouse should take into account future needs, organise data such that a number of downstream projects query the data efficiently. You should use the Extract Load Transform (ELT) framework using DBT.

Author

Show your support

Give a ⭐ if you like this project!

About

A scalable data warehouse that will host the vehicle trajectory data extracted by analyzing footage taken by swarm drones and static roadside cameras, using the Extract Load Transform (ELT) framework using DBT to help analytic engineers in the city traffic department setup transformation workflows on a need basis.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published