dbt-athena

Warning: this adapter still has rough edges.

Installation

This plugin can be installed via pip:

$ pip install git+https://github.com/Dandandan/dbt-athena.git

Configuring your profile

A dbt profile can be configured to run against Presto using the following configuration:

Option	Description	Required?	Example
s3_staging_dir	The location where Athena stores meta info	Required	s3://bucket/staging
database	Specify the database to build models into	Required	`awscatalog`
schema	Specify the schema to build models into	Required	`dbt_drew`
region_name	Specify in which AWS region it should connect	Required	`eu-west-1`
threads	How many threads dbt should use	Optional(default=`1`)	`8`

Example profiles.yml entry:

my-athena-db:
  target: awscatalog
  outputs:
    awscatalog:
      type: athena
      database: awscatalog
      schema: dbt_dbanin
      region_name: eu-west-1
      threads: 8

Usage Notes

Supported Functionality

Due to the nature of Athena, not all core dbt functionality is supported. The following features of dbt are not implemented on Presto:

Archival
Incremental models

If you are interested in helping to add support for this functionality in dbt on Presto, please open an issue!

Known issues:

Quoting is not supported

Reporting bugs and contributing code

Want to report a bug or request a feature? Let us know on Slack, or open an issue.

Code of Conduct

Everyone interacting in the dbt project's codebases, issue trackers, chat rooms, and mailing lists is expected to follow the PyPA Code of Conduct.

License

advincze/dbt-athena

ErrorLooks like something went wrong!

About

Resources

License

Uh oh!

Stars

Watchers

Forks

Releases

Packages 0

Languages

Error
Looks like something went wrong!

Packages