show table extended in {{relation.shema}} like * fails

[rahulgoyal2987]

Is this a new bug in dbt-spark?

• I believe this is a new bug in dbt-spark
• I have searched the existing issues, and I could not find an existing issue for this bug

Current Behavior

show table extended in {{relation.shema}} like * fails if any other dbt model is running on {{relation.shema}} same time.

Expected Behavior

Please change show table extended in {{relation.schema}} like '*' with below implementation to avoid parallel running model issue in same database.
for table in spark.catalog.listTables({{relation.schema}}):
spark.sql("show table extended in {{relation.schema}} like '{table.name}'")

Steps To Reproduce

Run two model parallel in same database

Relevant log output

No response

Environment

- OS: AWS EMR image
- Python: 3.11
- dbt-core: 1.0.0
- dbt-spark: 1.0.0

Additional Context

No response

[amychen1776]

Hello @rahulgoyal2987 , you're currently on a EOL supported dbt core version. Could you update to 1.8 for both core and adapters and let me know if you're still experiencing this issue? We have made some significant changes with our metadata queries since 1.0.

[luisarce83]

@amychen1776 we have dbt-core=1.8.1 and we still have the problem.
Can you help us in the follow issue: #228.
Thank you.

[amychen1776]

@luisarce83 thank you for the update! I'm realizing the issue here if you're trying to run parallel runs on the same objects. dbt currently does not support this and we currently have no plans to change this. Because of this - I'm going to close this issue for now.