Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🎉 Source TikTok Marketing - Add country_code and platform audience reports #22134

Merged
merged 20 commits into from
Apr 5, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
6b58001
Source TikTok Marketing - Add country_code and platform audience reports
roisinbolt Jan 31, 2023
b144022
update README and acceptance-test-config
roisinbolt Jan 31, 2023
94aef46
Merge branch 'master' into roisin-tiktok-basicreport-non-temp-id-dim-…
roisinbolt Jan 31, 2023
3250a66
Update bootstrap.md
roisinbolt Jan 31, 2023
c666a5e
Merge branch 'roisin-tiktok-basicreport-non-temp-id-dim-split' of git…
roisinbolt Jan 31, 2023
4a6c508
update extend statement/
roisinbolt Feb 16, 2023
bccc773
Merge remote-tracking branch 'upstream/master' into roisin-tiktok-bas…
roisinbolt Mar 30, 2023
5f060c3
resolve flake test
roisinbolt Mar 31, 2023
0acf84b
update source stream length for prod+staging
roisinbolt Mar 31, 2023
415558f
Merge remote-tracking branch 'upstream/master' into roisin-tiktok-bas…
roisinbolt Apr 4, 2023
cc9635f
declare new streams in empty_streams
roisinbolt Apr 4, 2023
29b12a6
empty_streams for prod_config_with_day_granularity
roisinbolt Apr 4, 2023
d305d67
change empty_streams to specify daily granularity
roisinbolt Apr 4, 2023
659c43e
add extra empty_streams for acceptance tests
roisinbolt Apr 4, 2023
c8bc475
airbyte.version=2.0.6
roisinbolt Apr 4, 2023
75af14c
Merge branch 'master' into roisin-tiktok-basicreport-non-temp-id-dim-…
bazarnov Apr 4, 2023
fa984f2
Merge branch 'roisin-tiktok-basicreport-non-temp-id-dim-split' of git…
roisinbolt Apr 5, 2023
86bfe40
Update docs/integrations/sources/tiktok-marketing.md
roisinbolt Apr 5, 2023
347bea7
Merge branch 'master' into roisin-tiktok-basicreport-non-temp-id-dim-…
bazarnov Apr 5, 2023
de0e185
auto-bump connector version
octavia-squidington-iii Apr 5, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -2069,7 +2069,7 @@
- name: TikTok Marketing
sourceDefinitionId: 4bfac00d-ce15-44ff-95b9-9e3c3e8fbd35
dockerRepository: airbyte/source-tiktok-marketing
dockerImageTag: 2.0.5
dockerImageTag: 2.0.6
documentationUrl: https://docs.airbyte.com/integrations/sources/tiktok-marketing
icon: tiktok.svg
sourceType: api
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -15580,7 +15580,7 @@
supportsNormalization: false
supportsDBT: false
supported_destination_sync_modes: []
- dockerImage: "airbyte/source-tiktok-marketing:2.0.5"
- dockerImage: "airbyte/source-tiktok-marketing:2.0.6"
spec:
documentationUrl: "https://docs.airbyte.com/integrations/sources/tiktok-marketing"
changelogUrl: "https://docs.airbyte.com/integrations/sources/tiktok-marketing"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -32,5 +32,5 @@ COPY source_tiktok_marketing ./source_tiktok_marketing
ENV AIRBYTE_ENTRYPOINT "python /airbyte/integration_code/main.py"
ENTRYPOINT ["python", "/airbyte/integration_code/main.py"]

LABEL io.airbyte.version=2.0.5
LABEL io.airbyte.version=2.0.6
LABEL io.airbyte.name=airbyte/source-tiktok-marketing
Original file line number Diff line number Diff line change
Expand Up @@ -55,6 +55,54 @@ acceptance_tests:
bypass_reason: "Tested with daily granularity."
- name: campaigns_reports_hourly
bypass_reason: "Tested with daily granularity."
- name: ad_group_audience_reports_by_country
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: campaigns_audience_reports
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ads_audience_reports_by_country
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: advertisers_audience_reports_by_country
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: advertisers_audience_reports_by_platform
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ads_audience_reports_by_platform
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: campaigns_audience_reports_by_platform
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ad_group_audience_reports_by_platform
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: campaigns_audience_reports_daily
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: advertisers_audience_reports_by_country_daily
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ads_audience_reports_by_country_daily
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: campaigns_audience_reports_by_platform_daily
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ad_group_audience_reports_by_platform_daily
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ad_group_audience_reports_by_country_daily
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: advertisers_audience_reports_by_platform_daily
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ads_audience_reports_by_platform_daily
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: campaigns_audience_reports_hourly
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: advertisers_audience_reports_by_country_hourly
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ads_audience_reports_by_country_hourly
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: campaigns_audience_reports_by_platform_hourly
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ad_group_audience_reports_by_platform_hourly
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ad_group_audience_reports_by_country_hourly
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: advertisers_audience_reports_by_platform_hourly
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ads_audience_reports_by_platform_hourly
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
# Old style streams with granularity config (for < 0.1.13)
# Note: not needed to be tested separately in full and incremental tests, because code of
# these streams is called directly in new style streams
Expand All @@ -77,6 +125,54 @@ acceptance_tests:
bypass_reason: "This stream is tested on the new style config."
- name: campaigns
bypass_reason: "This stream is tested on the new style config."
- name: ad_group_audience_reports_by_country
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: campaigns_audience_reports
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ads_audience_reports_by_country
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: advertisers_audience_reports_by_country
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: advertisers_audience_reports_by_platform
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ads_audience_reports_by_platform
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: campaigns_audience_reports_by_platform
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ad_group_audience_reports_by_platform
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: campaigns_audience_reports_daily
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: advertisers_audience_reports_by_country_daily
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ads_audience_reports_by_country_daily
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: campaigns_audience_reports_by_platform_daily
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ad_group_audience_reports_by_platform_daily
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ad_group_audience_reports_by_country_daily
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: advertisers_audience_reports_by_platform_daily
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ads_audience_reports_by_platform_daily
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: campaigns_audience_reports_hourly
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: advertisers_audience_reports_by_country_hourly
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ads_audience_reports_by_country_hourly
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: campaigns_audience_reports_by_platform_hourly
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ad_group_audience_reports_by_platform_hourly
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ad_group_audience_reports_by_country_hourly
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: advertisers_audience_reports_by_platform_hourly
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
- name: ads_audience_reports_by_platform_hourly
bypass_reason: "Stream is added by the Contributor. We should seed the sandbox later on."
fail_on_extra_columns: false
full_refresh:
tests:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -40,11 +40,17 @@ As cursor field this connector uses "modify_time" values. But endpoints don't pr
- AdsReportsDaily(Daily, AdsReports)
- AdsReportsLifetime(Lifetime, AdsReports)
streams:
* campaigns_audience_reports_daily
* campaigns_audience_reports_by_country_daily
* campaigns_audience_reports_by_platform_daily
* campaigns_reports_daily
* advertisers_audience_reports_daily
* advertisers_audience_reports_by_country_daily
* advertisers_audience_reports_by_platform_daily
* advertisers_reports_daily
* ad_group_audience_reports_daily
* ad_group_audience_reports_by_country_daily
* ad_group_audience_reports_by_platform_daily
* ads_reports_lifetime
* advertiser_ids
* campaigns_reports_lifetime
Expand All @@ -54,6 +60,8 @@ As cursor field this connector uses "modify_time" values. But endpoints don't pr
* advertisers_reports_lifetime
* ads_reports_daily
* ads_audience_reports_daily
* ads_audience_reports_by_country_daily
* ads_audience_reports_by_platform_daily
* ads_reports_hourly
* ad_groups_reports_hourly
* advertisers_reports_hourly
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -90,6 +90,90 @@
"stream_descriptor": { "name": "ad_group_audience_reports" }
}
},
{
"type": "STREAM",
"stream": {
"stream_state": {
"stat_time_day": "2030-01-01",
"dimensions": { "stat_time_day": "2030-01-01" }
},
"stream_descriptor": {
"name": "campaigns_audience_reports"
}
}
},
{
"type": "STREAM",
"stream": {
"stream_state": {
"stat_time_day": "2030-01-01",
"dimensions": { "stat_time_day": "2030-01-01" }
},
"stream_descriptor": { "name": "ads_audience_reports_by_platform" }
}
},
{
"type": "STREAM",
"stream": {
"stream_state": {
"stat_time_day": "2030-01-01",
"dimensions": { "stat_time_day": "2030-01-01" }
},
"stream_descriptor": { "name": "advertisers_audience_reports_by_platform" }
}
},
{
"type": "STREAM",
"stream": {
"stream_state": {
"stat_time_day": "2030-01-01",
"dimensions": { "stat_time_day": "2030-01-01" }
},
"stream_descriptor": { "name": "ad_group_audience_reports_by_platform" }
}
},
{
"type": "STREAM",
"stream": {
"stream_state": {
"stat_time_day": "2030-01-01",
"dimensions": { "stat_time_day": "2030-01-01" }
},
"stream_descriptor": {
"name": "campaigns_audience_reports_by_platform"
}
}
},
{
"type": "STREAM",
"stream": {
"stream_state": {
"stat_time_day": "2030-01-01",
"dimensions": { "stat_time_day": "2030-01-01" }
},
"stream_descriptor": { "name": "ads_audience_reports_by_country" }
}
},
{
"type": "STREAM",
"stream": {
"stream_state": {
"stat_time_day": "2030-01-01",
"dimensions": { "stat_time_day": "2030-01-01" }
},
"stream_descriptor": { "name": "advertisers_audience_reports_by_country" }
}
},
{
"type": "STREAM",
"stream": {
"stream_state": {
"stat_time_day": "2030-01-01",
"dimensions": { "stat_time_day": "2030-01-01" }
},
"stream_descriptor": { "name": "ad_group_audience_reports_by_country" }
}
},
{
"type": "STREAM",
"stream": {
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -51,10 +51,58 @@
"stat_time_day": "2030-01-01"
}
},
"campaigns_audience_reports": {
"stat_time_day": "2030-01-01",
"dimensions": {
"stat_time_day": "2030-01-01"
}
},
"ads_audience_reports_by_country": {
"stat_time_day": "2030-01-01",
"dimensions": {
"stat_time_day": "2030-01-01"
}
},
"advertisers_audience_reports_by_country": {
"stat_time_day": "2030-01-01",
"dimensions": {
"stat_time_day": "2030-01-01"
}
},
"ad_group_audience_reports_by_country": {
"stat_time_day": "2030-01-01",
"dimensions": {
"stat_time_day": "2030-01-01"
}
},
"campaigns_audience_reports_by_country": {
"stat_time_day": "2030-01-01",
"dimensions": {
"stat_time_day": "2030-01-01"
}
},
"ads_audience_reports_by_platform": {
"stat_time_day": "2030-01-01",
"dimensions": {
"stat_time_day": "2030-01-01"
}
},
"advertisers_audience_reports_by_platform": {
"stat_time_day": "2030-01-01",
"dimensions": {
"stat_time_day": "2030-01-01"
}
},
"ad_group_audience_reports_by_platform": {
"stat_time_day": "2030-01-01",
"dimensions": {
"stat_time_day": "2030-01-01"
}
},
"campaigns_audience_reports_by_platform": {
"stat_time_day": "2030-01-01",
"dimensions": {
"stat_time_day": "2030-01-01"
}
}
}
Original file line number Diff line number Diff line change
Expand Up @@ -115,6 +115,20 @@
"source_defined_cursor": true,
"default_cursor_field": ["stat_time_day"]
},
{
"name": "advertisers_audience_reports_by_country_daily",
"json_schema": {},
"supported_sync_modes": ["full_refresh", "incremental"],
"source_defined_cursor": true,
"default_cursor_field": ["stat_time_day"]
},
{
"name": "advertisers_audience_reports_by_platform_daily",
"json_schema": {},
"supported_sync_modes": ["full_refresh", "incremental"],
"source_defined_cursor": true,
"default_cursor_field": ["stat_time_day"]
},
{
"name": "advertisers_audience_reports_lifetime",
"json_schema": {},
Expand All @@ -127,19 +141,61 @@
"source_defined_cursor": true,
"default_cursor_field": ["stat_time_day"]
},
{
"name": "ads_audience_reports_by_country_daily",
"json_schema": {},
"supported_sync_modes": ["full_refresh", "incremental"],
"source_defined_cursor": true,
"default_cursor_field": ["stat_time_day"]
},
{
"name": "ads_audience_reports_by_platform_daily",
"json_schema": {},
"supported_sync_modes": ["full_refresh", "incremental"],
"source_defined_cursor": true,
"default_cursor_field": ["stat_time_day"]
},
{
"name": "ad_group_audience_reports_daily",
"json_schema": {},
"supported_sync_modes": ["full_refresh", "incremental"],
"source_defined_cursor": true,
"default_cursor_field": ["stat_time_day"]
},
{
"name": "ad_group_audience_reports_by_country_daily",
"json_schema": {},
"supported_sync_modes": ["full_refresh", "incremental"],
"source_defined_cursor": true,
"default_cursor_field": ["stat_time_day"]
},
{
"name": "ad_group_audience_reports_by_platform_daily",
"json_schema": {},
"supported_sync_modes": ["full_refresh", "incremental"],
"source_defined_cursor": true,
"default_cursor_field": ["stat_time_day"]
},
{
"name": "campaigns_audience_reports_daily",
"json_schema": {},
"supported_sync_modes": ["full_refresh", "incremental"],
"source_defined_cursor": true,
"default_cursor_field": ["stat_time_day"]
},
{
"name": "campaigns_audience_reports_by_country_daily",
"json_schema": {},
"supported_sync_modes": ["full_refresh", "incremental"],
"source_defined_cursor": true,
"default_cursor_field": ["stat_time_day"]
},
{
"name": "campaigns_audience_reports_by_platform_daily",
"json_schema": {},
"supported_sync_modes": ["full_refresh", "incremental"],
"source_defined_cursor": true,
"default_cursor_field": ["stat_time_day"]
}
]
}
Expand Down
Loading