Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added partition by in lag tests #146

Merged
merged 6 commits into from
Mar 7, 2022

Conversation

Lucasthenoob
Copy link
Contributor

Problem:

Not possible to put partition by parameters in the following tests:

Changes:

  • Added an optional parameter which allow to partition by.
  • Updated the README.MD with accordingly

Please let me know if there is anything

@clausherther
Copy link
Contributor

Thanks @Lucasthenoob! Will look over this over the weekend.

@clausherther clausherther self-requested a review February 26, 2022 16:13
Copy link
Contributor

@clausherther clausherther left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Couple of changes re: partition column parameters.
Also, we'll need a test that actually uses these partitions in https://github.com/calogica/dbt-expectations/blob/main/integration_tests/models/schema_tests/schema.yml
I can help you with that if you've never done integration tests on dbt packages. Thanks!

README.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
@Lucasthenoob
Copy link
Contributor Author

It should be good now.
Sorry I don't have dbt installed on my personal computer.
I validated the test is working on my other one but I could not test the second commit: data creation and test implementation

Copy link
Contributor

@clausherther clausherther left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I made a few changes myself to help get this over the finish line. Hope that works for you!

@clausherther clausherther merged commit 13eb72c into calogica:main Mar 7, 2022
clausherther added a commit that referenced this pull request Apr 4, 2022
…y_n_datepart` (#141)

* implement exclusion_condition (#1)

* move exclusion_condition to closing statement

* Update README.md

* Create expect_column_set_to_be_unique_case_insensitive.sql (#138)

* Create expect_column_set_to_be_unique_case_insensitive.sql

* adjusting consistent casing test and documentation

* adjusting formatting and adding integration test

* Fix formatting

* Formatting updates

* adjusting Readme and adding test instance

* Fix spelling

Co-authored-by: clausherther <claus@calogica.com>

* Change check for data date out of range to use timestamp (#145)

* Update CHANGELOG.md

* Update CHANGELOG.md

* Update CHANGELOG.md

* Added partition by in lag tests (#146)

* Added partition by parameter

* Added documentation

* Modified the test to accept list instead of string

* created data and implemented tests

* corrected test in yml

* Update formatting, test data and test macro

Co-authored-by: clausherther <claus@calogica.com>

* Update CHANGELOG.md

* Update CHANGELOG.md

* Fix emails.sql (#153)

* Adds test for column presence (#149)

* add test for column not to exist

* Update expect_table_columns_not_to_contain_set.sql

* Update README.md

* name change and inner joined

* update readme

* update test

* Fix expect_row_values_to_have_recent_data issues on bigquery (#147)

* Add datetime and timestamp test columns

* Convert all evals to timestamps

* Add datatypes

* Update schema tests

* Update CHANGELOG.md

* Update README.md

* Add pre-commit config (#156)

* Add github actions workflow (#159)

* Add github workflow

* Remove pre-commit

* Add .circleci/config.yml (#161)

* Add .circleci/config.yml

* Remove github action

* Update postgres test

* Add dbt install

* Add env variables

* Install dbt dependencies

* Empty postgres password

* Upgrade postgres image

* Update connection settings

* Fix postgres profile

* Move profiles

* Add BigQuery run

* Fix job name

* Update key path

* Update config

* Update schema

* Add Snowflake tests

* Update profile

* Add back postgres

* Show group_by columns in validation errors for column increasing test (#158)

* Show group_by columns in validation errors for column increasing test

* Add github actions workflow (#159)

* Add github workflow

* Remove pre-commit

* Show group_by columns in validation errors for column increasing test

* Add .circleci/config.yml (#161)

* Add .circleci/config.yml

* Remove github action

* Update postgres test

* Add dbt install

* Add env variables

* Install dbt dependencies

* Empty postgres password

* Upgrade postgres image

* Update connection settings

* Fix postgres profile

* Move profiles

* Add BigQuery run

* Fix job name

* Update key path

* Update config

* Update schema

* Add Snowflake tests

* Update profile

* Add back postgres

* Show group_by columns in validation errors for column increasing test

* Jinja whitespace update (to force CI)

Co-authored-by: Claus Herther <claus@calogica.com>

* implement exclusion_condition (#1)

* move exclusion_condition to closing statement

* Update README.md

* Add integration test

Co-authored-by: agusfigueroa-htg <77272542+agusfigueroa-htg@users.noreply.github.com>
Co-authored-by: clausherther <claus@calogica.com>
Co-authored-by: Josh Jones <josh.jones@accenture.com>
Co-authored-by: Lucas Larbodiere <62683844+Lucasthenoob@users.noreply.github.com>
Co-authored-by: Randy Caddell <64412616+rcaddell@users.noreply.github.com>
Co-authored-by: dluftspring <daniel.luftspring@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants