Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐛 Source tiktok-marketing: fix include deleted option #44048

Conversation

aldogonzalez8
Copy link
Contributor

@aldogonzalez8 aldogonzalez8 commented Aug 14, 2024

What

This is related to https://github.com/airbytehq/oncall/issues/5205

According to documentation and @tolik0 investigation, now the "filters," param was changed to "filtering." Also, it won't ignore the incorrect "field_name" when filtering as it used to do, so it needs to pass the correct one for each data level.

image

How

Update yaml to use filtering when available and required.

Review guide

  1. airbyte-integrations/connectors/source-tiktok-marketing/source_tiktok_marketing/manifest.yaml: changes removing filters and adding filtering param with correct field_name.
  2. airbyte-integrations/connectors/source-tiktok-marketing/unit_tests/integration/test_reports_hourly.py: new testing for filtering when include_deleted is true in config.

User Impact

When fetching streams ad_groups_reports_daily and ads_reports_daily from TikTok Marketing connector and putting "Include deleted data in reports" toggle on the user get the deleted ad_groups and ads (respectively).

Can this PR be safely reverted and rolled back?

  • YES 💚
  • NO ❌

@aldogonzalez8 aldogonzalez8 self-assigned this Aug 14, 2024
Copy link

vercel bot commented Aug 14, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
airbyte-docs ⬜️ Ignored (Inspect) Visit Preview Aug 16, 2024 5:01pm

Copy link
Contributor

@girarda girarda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

change looks reasonable and aligned with the API doc you pointed to 🚢

@@ -343,6 +343,42 @@ def test_read_with_state(self, http_mocker: HttpMocker):
{"cursor": {"stat_time_hour": self.cursor}, "partition": {"advertiser_id": self.advertiser_id, "parent_slice": {}}}
]

@HttpMocker()
def test_read_with_include_deleted(self, http_mocker: HttpMocker):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks for all the tests 🐟

@aldogonzalez8 aldogonzalez8 merged commit 526bdee into master Aug 19, 2024
34 checks passed
@aldogonzalez8 aldogonzalez8 deleted the aldogonzalez8/source/tik-tok-marketing/fix-include-deleted branch August 19, 2024 14:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues area/documentation Improvements or additions to documentation connectors/source/tiktok-marketing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants