dbt-spark Changelog

This file provides a full account of all changes to dbt-spark.
Changes are listed under the (pre)release in which they first appear. Subsequent releases include changes from previous releases.
"Breaking changes" listed under a version may require action from end users or external maintainers when upgrading to that version.
Do not edit this file directly. This file is auto-generated using changie. For details on how to document a change, see the contributing guide

dbt-spark 1.0.2 - December 20, 2022

Features

backport changie to 1.0.latest (#417, #426)

Under the Hood

fix post new release tox issues around passenv and allowlist_externals (#547, #547)

dbt-spark 1.0.1 - April 19, 2022

Fixes

Closes the connection properly (#280, #285)
Make internal macros use macro dispatch to be overridable in child adapters (#319, #320)

Under the hood

Configure insert_overwrite models to use parquet (#301)

Contributors

@ueshin (#285, #320)

dbt-spark 1.0.0 - December 3, 2021

Features

Add support for Apache Hudi (hudi file format) which supports incremental merge strategies (#187, #210)

Fixes

Incremental materialization corrected to respect full_refresh config, by using should_full_refresh() macro (#260, #262)

Under the hood

Refactor seed macros: remove duplicated code from dbt-core, and provide clearer logging of SQL parameters that differ by connection method (#249, #250)
Replace sample_profiles.yml with profile_template.yml, for use with new dbt init (#247)
Remove official support for python 3.6, which is reaching end of life on December 23, 2021 (dbt-core#4134, #253)
Add support for structured logging (#251)

Contributors

@grindheim (#262)
@vingov (#210)

Previous Releases

For information on prior releases of dbt-spark prior to 1.0.0 please see