Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Had an issue upgrading dbt-artifact to 2.6.0 #397

Closed
ajonesINQ opened this issue Oct 19, 2023 · 4 comments
Closed

[Bug] Had an issue upgrading dbt-artifact to 2.6.0 #397

ajonesINQ opened this issue Oct 19, 2023 · 4 comments
Labels
bug Something isn't working

Comments

@ajonesINQ
Copy link

ajonesINQ commented Oct 19, 2023

Overview

Tried upgrading dbt-artifacts from 2.4 to 2.6. the upgrade was successful, however after our job ran the artifact was not able to be uploaded to bigquery as the query was too long.

How to reproduce

Expected behaviour

We would expect the artifact data to be uploaded to bigquery and the job not to fail

Screenshots

job_fail_for_issue

Environment

Results of running dbt --version:
dbt=1.6.5

# Add the results here

Please paste the contents of your packages.yml file here:

packages:
  ------------------------------------------------------------
  Invoke dbt Command
------------------------------------------------------------
dbt deps

05:00:49  Running with dbt=1.6.5
05:00:49  Installing dbt-labs/dbt_utils
05:00:49  Installed from version 1.1.1
05:00:49  Installing calogica/dbt_expectations
05:00:50  Installed from version 0.10.0
05:00:50  Installing dbt-labs/codegen
05:00:50  Installed from version 0.11.0
05:00:50  Installing data-mie/dbt_profiler
05:00:50  Installed from version 0.8.1
05:00:50  Installing dbt-labs/dbt_project_evaluator
@ajonesINQ ajonesINQ added the bug Something isn't working label Oct 19, 2023
@glsdown
Copy link
Contributor

glsdown commented Oct 20, 2023

Hello. As noted in #369 we added a new feature in 2.6.0 which will hopefully help here. In a previous release, we added an additional all_results column which contained a JSON object of all results for people to be able to do their own analysis on. However, this increased the query size dramatically, which is why these issues started arising.

In the latest release, I've added a variable that will stop this behaviour to reduce the query size. Please can you try adding the following as a variable in your dbt_project.yml file and see if that resolves it?

vars:
  dbt_artifacts_exclude_all_results: true

@jared-rimmer
Copy link
Member

@ajonesINQ are you still seeing this issue after implementing the above?

@data-modeler
Copy link

I came here with the same problem and adding the variable solved the problem for me. Thanks!

@ajonesINQ
Copy link
Author

So sorry thought I commented on this ages ago the above did resolve my issue. thank you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants