MINOR - generic profiler optimization for sampling and BQ

[TeddyCr]

Describe your changes:

• Fixes High Query Cost using Bigquery TABLE_STORAGE #14433 - we'll keep the current method as a fall back in case table metadata cannot be access from __TABLES__
• Limit sampling to only the column being profiled (should improve execution and limit cost for columnar database)
• Default to 1 DAY for BQ partitioned tables

Type of change:

• Bug fix
• Improvement
• New feature
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• Documentation

Checklist:

• I have read the CONTRIBUTING document.
• My PR title is Fixes <issue-number>: <short explanation>
• I have commented on my code, particularly in hard-to-understand areas.
• For JSON Schema changes: I updated the migration scripts or explained why it is not needed.

[github-actions]

The Python checkstyle failed.

Please run make py_format and py_format_check in the root of your repository and commit the changes to this PR.
You can also use pre-commit to automate the Python code formatting.

You can install the pre-commit hooks with make install_test precommit_install.

[sonarqubecloud]

Quality Gate passed for 'open-metadata-ingestion'

Kudos, no new issues were introduced!

0 New issues
0 Security Hotspots
29.2% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud