Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add retry logic for model creation #726

Closed
drewbanin opened this issue Apr 6, 2018 · 5 comments
Closed

Add retry logic for model creation #726

drewbanin opened this issue Apr 6, 2018 · 5 comments
Assignees
Labels

Comments

@drewbanin
Copy link
Contributor

BQ can sometimes return 503 errors. Or, things like "dropped by a concurrent transaction" can occur on Redshift. Should dbt retry these models?

@codingisforlosers
Copy link

codingisforlosers commented Apr 6, 2018

Other error that pops up ocassionally is:

404 GET https://www.googleapis.com/bigquery/v2/projects/project-id/datasets/dataset/tables?pageToken=table: Not found: Token table

@cmcarthur
Copy link
Member

  • Bigquery only
  • Ignore the 503 case for now
  • For the 404 case, when a table is created, it isn't always readable right away. There's some delay before you can query it. So after creating a table, poll until the table becomes available or time out.

@cmcarthur cmcarthur self-assigned this Jul 5, 2018
Copy link
Member

this may not be related to dependencies downstream, could perhaps be a bug with create or replace view

@cmcarthur
Copy link
Member

fixed in #835, will be out in the next dbt version!

@bbrewington
Copy link

@cmcarthur now that this issue is closed, should this TODO be cleaned up? https://github.com/dbt-labs/dbt-bigquery/blob/8ef193a7ebe477f6fbbb01f8996851838f6bd441/dbt/adapters/bigquery/impl.py#L243-L250

(pinging you directly b/c wasn't sure if you would get notified since this is closed)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants