google_bigquery_table doesn't support PARQUET format

[dantswain]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment
• If an issue is assigned to the "modular-magician" user, it is either in the process of being autogenerated, or is planned to be autogenerated soon. If an issue is assigned to a user, that user is claiming responsibility for the issue. If an issue is assigned to "hashibot", a community member has claimed the issue already.

Terraform Version

Terraform v0.12.18
+ provider.google v3.2.0
+ provider.google-beta v3.2.0  # have tried with and without this

Affected Resource(s)

• google_bigquery_table

Terraform Configuration Files

resource "google_bigquery_table" "some_table" {
  provider = google-beta // doesn't matter if this is present or not, same error
  dataset_id = "some_dataset"
  table_id = "some_table"

  external_data_configuration {
    autodetect  = true
    source_format = "PARQUET"
    source_uris = [
      "gs://somebucket.somecompany.com/*"
    ]
  }
}

Expected Behavior

Should be able to create a table from a bucket with parquet data. This works from the UI.

Actual Behavior

I get an error:

Error: expected external_data_configuration.0.source_format to be one of [CSV GOOGLE_SHEETS NEWLINE_DELIMITED_JSON AVRO DATSTORE_BACKUP], got PARQUET

I have tried this both with and without the beta provider.

Steps to Reproduce

1. terraform apply

References

Parquet is listed as supported: https://cloud.google.com/bigquery/external-data-cloud-storage
Furthermore, I've gotten this working with the cloud console UI.

[venkykuberan]

Hi @dantswain ,
Thank you for filing the issue. Currently provider isn't supporting the "PARQUET" source format, we will add it to feature list to work on it soon.

[megan07]

Thanks @dantswain for opening this issue. It's been closed with GoogleCloudPlatform/magic-modules#2832 and will be released shortly.

[ghost]

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.

If you feel this issue should be reopened, we encourage creating a new issue linking back to this one for added context. If you feel I made an error 🤖 🙉 , please reach out to my human friends 👉 hashibot-feedback@hashicorp.com. Thanks!