High Query Cost using Bigquery TABLE_STORAGE

[ayush-shah]

We have identified the issue related to Bigquery profiling over table storage for fetching the system level tags like no. of rows, sizeInBytes, creation time, col names and col count.

Instead of using table storage from information schema which can be huge, we can use __TABLES__ to get metadata for that table.

ref: https://openmetadata.slack.com/archives/C02B6955S4S/p1702021485941039