dbt-demos

Demonstrations of DBT

About

This repository has a collection of DBT (data build tool) demos. Each demo, although technically could be sourced within a common project, they are kept separate dbt projects for simplicity of demonstrating different functionality across different platforms.

Postgres (WIP)

This demo is tied to another git repo. That project must be installed and running in order to use this one.

This demo is a WIP.

Snowflake Metadata (WIP)

This demo is just for fun. Please use it to further explore the metadata within a single snowflake database.

This demo is a WIP.

Snowflake TPC-H

Snowflake comes along with various sample datasets. This specific scenario aims to

1. Join up the Customer, Nation and Region tables
   1. Compute the average account balance by part and supplier
   2. Compute the average account balance by nation
2. Join up the Supplier, Part and PartSupp tables
   1. Compute the average supply cost and average available quantity per part
3. Join the aggregation tables back to the fine grained tables for both cases above
4. Join up the aggregation tables into a single analytics view

All tables before the aggregations are marked ephemeral. When the aggregations are joined back up, then the results are materialized as tables. The final model results in view (analytics_view).

Running DBT

From root execute the following:

To Test:

pipenv install
pipenv update
(cd snowflake_tpc_demo && pipenv test)

To Build:

pipenv install
pipenv update
(cd snowflake_tpc_demo && pipenv build)

To Build and Serve Documentation

pipenv install
pipenv update
(cd snowflake_tpc_demo && pipenv build_and_serve)

To Build and RUN:

pipenv install
pipenv update
(cd snowflake_tpc_demo && pipenv build_and_run)