Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

V0.40.18 #36

Merged
merged 499 commits into from
Nov 10, 2022
Merged
Changes from 1 commit
Commits
Show all changes
499 commits
Select commit Hold shift + click to select a range
d6ce20f
Fix broken link to config in .env comment (#18287)
josephkmh Oct 21, 2022
cf28f7a
Add message migration to discover schema (#18205)
gosusnp Oct 21, 2022
b347829
upgrade commons-text to 1.10.0 (#18275)
edgao Oct 21, 2022
76acfb8
[low-code] Propagate options to InterpolatedRequestInputProvider (#18…
girarda Oct 21, 2022
f71fe5a
Add message translation to GetSpec (#18130)
gosusnp Oct 21, 2022
0abc5f6
only rm file if it exists (#18310)
pmossman Oct 21, 2022
0c5e6ba
remove extra check (#10554)
cgardens Oct 21, 2022
e1c220a
Google ads: Upgrade CDK to incorporate config error handling (#18309)
girarda Oct 21, 2022
ccdbbfc
:tada: Source Linkedin Ads - for adDirectSponsoredContents stream ski…
midavadim Oct 21, 2022
5082ebf
Add SchemaChange to WebBackendConnectionRead object (#17969)
alovew Oct 21, 2022
85e93cb
Destinations BigQuery and GCS: update docs about bucket encryption (#…
edgao Oct 21, 2022
73336ff
Bump Airbyte version from 0.40.16 to 0.40.17 (#18316)
octavia-squidington-iii Oct 21, 2022
cc41385
Updates `getPrivateKeyPair` to throw exception when private key pair …
ryankfu Oct 21, 2022
f080d4d
🎉 New Source: xkcd [python cdk] (#18049)
sarafonseca-123 Oct 22, 2022
e7bf365
Source pinterest: Fix type of `start_date` (#18285)
grubberr Oct 22, 2022
69092ed
requester = MagicMock(use_cache=False) (#18289)
grubberr Oct 22, 2022
710c432
fix Connector Base build (#18351)
alafanechere Oct 24, 2022
a7fd147
SAT: new `test_strictness_level` field in config (#18218)
alafanechere Oct 24, 2022
f06bd40
🪟 🐛 Fixed static <ConditionSection /> width (#18233)
dizel852 Oct 24, 2022
5e302e0
🎉 Source Shopify: update API version to `2022-10` (#18298)
bazarnov Oct 24, 2022
51cfebc
Update airbyte-db reference (#18368)
xpuska513 Oct 24, 2022
3524a8a
🪟 🐛 Load global CSS in storybook (#18353)
josephkmh Oct 24, 2022
f61a420
Bump helm chart version reference to 0.40.33 (#18371)
github-actions[bot] Oct 24, 2022
08eb62d
enable support for publishing datadog metrics from a local environmen…
colesnodgrass Oct 24, 2022
2a2639a
Simplify the OSS documentation deploy system (#2670) (#18377)
tkorenko Oct 24, 2022
74defd1
fix: add task to list all dependencies (#18304)
Oct 24, 2022
b23565e
remove useless json_size metric (#18247)
colesnodgrass Oct 24, 2022
5ab81e6
🎉Destination-elasticsearch: added custom sertificate support (#18177)
etsybaev Oct 24, 2022
6b5587d
update spotbugs to latest (#18208)
colesnodgrass Oct 24, 2022
80e7780
Source Jira - Pagination fix on jira users stream (#16944)
antonioneto-hotmart Oct 24, 2022
9763cbc
🎉 Source Google Ads: Add fields to the campaign stream 🚨 (#18069)
mutt-santiago-stachuk Oct 24, 2022
a3c00fa
fixed check-style (#18390)
etsybaev Oct 24, 2022
1ee4ea7
Readded xkcd to source def yaml (#18386)
marcosmarxm Oct 24, 2022
ef08d88
Trace errors in orchestrator workers (#18381)
jdpgrailsdev Oct 24, 2022
384aabb
Source Shopify: add unit tests (#17944)
arsenlosenko Oct 24, 2022
d77f913
Export python type information for airbyte-cdk (#18387)
nipunn1313 Oct 24, 2022
75493f9
Fix error highlight of select boxes (#18396)
timroes Oct 24, 2022
25292b7
Source Hubspot: update `contacts` scope in docs (#18380)
grubberr Oct 24, 2022
4b93a9b
remove extra ' in version (#18400)
colesnodgrass Oct 24, 2022
1ee02d4
Improve listSourcesForWorkspace route (#18207)
malikdiarra Oct 24, 2022
ce88962
🪟 🐛 Fix additional buttons for connection creation (#18372)
dizel852 Oct 24, 2022
a714175
Change port for acceptance test destination db (#18391)
terencecho Oct 24, 2022
7ec6779
Bmoric/update connection list with breaking (#18125)
benmoriceau Oct 24, 2022
cdac71f
Generate connector builder api client (#18274)
lmossman Oct 24, 2022
182f2c6
:window: :wrench: Generify connector documentation layout into resiza…
lmossman Oct 25, 2022
e933de0
SAT: declare `bypass_reason` in `acceptance-test-config.yml` (#18364)
alafanechere Oct 25, 2022
848046a
Source Iterable - better processing of 401 and 429 errors (#18292)
davydov-d Oct 25, 2022
01d84d4
🐛 Source Asana: fix request-cache test (#18375)
artem1205 Oct 25, 2022
17ed198
🐛 Source Freshdesk: fix test; update CDK (#18389)
artem1205 Oct 25, 2022
4a61e6a
Update cdk-speedrun.md (#18416)
pinikeizman Oct 25, 2022
f4fdb38
Update README.md
Amruta-Ranade Oct 25, 2022
0b460f5
Update Facebook-marketing.md with warning about ongoing setup issue (…
tybernstein Oct 25, 2022
80f2ad8
Source Greenhouse: extend users stream schema (#18154)
davydov-d Oct 25, 2022
86cb666
🐛 Source Hubspot: update CDK; fix expected test result according to 0…
artem1205 Oct 25, 2022
b323ccd
Additional worker APM tracing (#18427)
jdpgrailsdev Oct 25, 2022
25e7a37
Publish new CDK version with typehints exported (#18398)
sherifnada Oct 25, 2022
62eb6b6
Extract the AttemptApi out of the ConfigurationApi (#18406)
benmoriceau Oct 25, 2022
b050e7b
🐛 Source Salesforce: update CDK; fix test supported_sync_modes is req…
artem1205 Oct 25, 2022
316cdd8
:window: :wrench: Introduce useAuthentication hook (#17965)
timroes Oct 25, 2022
fc2cebc
Update: aws ec2 deployment guide (#18360)
Terieyenike Oct 25, 2022
c8943f2
Updated Deploy on GCP Doc (#18286)
PragatiVerma18 Oct 25, 2022
0c37753
Updated deploying Airbyte on Azure section (#18331)
sblaizerwize Oct 25, 2022
2aa3322
feat: deploy airbyte on kubernetes doc (#18339)
Jagrutiti Oct 25, 2022
9e666e7
New Source: Zoom [low-code CDK] (#18179)
subhamX Oct 25, 2022
260e89f
🐛 Source SurveyMonkey: fix expected test result according to 0.2.2 up…
artem1205 Oct 25, 2022
0539099
Update postgres.md (#18432)
wfouche Oct 25, 2022
47f77f1
Update README.md
Amruta-Ranade Oct 25, 2022
0865c62
SAT: make all tests mandatory when `test_strictness_level` == `high` …
alafanechere Oct 25, 2022
066f19b
Refactor SourceHandler:buildSourceRead function (#18430)
malikdiarra Oct 25, 2022
56df057
Make YouTube login button Google styled (#18443)
timroes Oct 25, 2022
f83fd5b
Edited Notion Doc (#18405)
sophia-wiley Oct 25, 2022
726d3bd
SAT: enforce `bypass_reason` declaration on `empty_streams` when `tes…
alafanechere Oct 25, 2022
434a556
Fix the tag in openAPI (#18445)
benmoriceau Oct 25, 2022
21431f6
use api to do jobpersistence query (#18308)
xiaohansong Oct 25, 2022
30a8d17
RefreshSchema Activity (#18388)
alovew Oct 25, 2022
b0a8e54
Follow-up fix for SSHExceptions (#18383)
akashkulk Oct 25, 2022
c466878
Refactor the buildDestinationRead function (#18446)
malikdiarra Oct 25, 2022
9b57d97
🐛 Fix S3 destination integration tests to use bucket path (#18031)
N-o-Z Oct 25, 2022
ba21d90
fix formatting + imports (#18457)
edgao Oct 25, 2022
5361f14
RefreshSchema method on RefreshSchema activity (#18460)
alovew Oct 26, 2022
96dfa87
🐛 Source Tiktok Marketing: fix test timeout (#18433)
artem1205 Oct 26, 2022
3fd3cf6
Postgres Source : updated docs for CDC setup (#18291)
VitaliiMaltsev Oct 26, 2022
79f2118
Source postgres: disable allow and prefer ssl modes in CDC mode (#18…
sashaNeshcheret Oct 26, 2022
1417552
Source Twilio: implement slicing (#18423)
davydov-d Oct 26, 2022
d32cec8
Fix broken table in the docs (#18466)
macmv Oct 26, 2022
f38df66
🎉 New Connector: Clockify [python cdk] (#17767)
RobLucchi Oct 26, 2022
418e238
Optimize listDestinationsForWorkspace route (#18456)
malikdiarra Oct 26, 2022
2f9ab62
Add new streams table components (#18262)
edmundito Oct 26, 2022
10ecccc
add basic auth for Lever (#17996)
alexchouraki Oct 26, 2022
0daeb8d
🐛 Source File: fix check method (#18481)
artem1205 Oct 26, 2022
5d326a3
Make script both Unix/Linux and OSX compatible (#18493)
jdpgrailsdev Oct 26, 2022
657f997
Update to latest Temporal SDK release (#18492)
jdpgrailsdev Oct 26, 2022
a3a6c4b
Trace launcher worker run method (#18441)
jdpgrailsdev Oct 26, 2022
1aa2079
Bmoric/extract connection api (#18409)
benmoriceau Oct 26, 2022
4fdd09b
🎉 New Source: Auth0 [python cdk] (#18338)
YiyangLi Oct 26, 2022
f90ffb0
Destination Redshift: handle empty s3 bucket_path (#18434)
edgao Oct 26, 2022
a25dc47
Use Google business mails by default for login (#18462)
timroes Oct 26, 2022
5222093
support custom error messaging for error response + retryable errors …
brianjlai Oct 26, 2022
1d2df97
Alternate way to view temp/CSV files on Windows. (#18482)
AndyTwiss Oct 26, 2022
0423007
docs: fix link reference (#18503)
dijonkitchen Oct 26, 2022
77e4a51
🐛Destination-elasticsearch: enforce ssl connection on cloud (#18341)
etsybaev Oct 26, 2022
d693b2c
Bmoric/extract destination api (#18502)
benmoriceau Oct 26, 2022
9e612b0
bump to v15.0 (#18467)
girarda Oct 26, 2022
5d4b564
Persist geography updates (#18501)
pmossman Oct 26, 2022
cd33eff
Add SSH tunnel for MongoDB Destination (#18280)
ryankfu Oct 26, 2022
05b7399
Improve performance of the operation that retrieve all connector for …
malikdiarra Oct 26, 2022
84c7ff9
🎉 New Source: News API (#18301)
isaacharrisholt Oct 27, 2022
b4461d3
🐛 Source Hubspot: acceptance fix (#18498)
artem1205 Oct 27, 2022
a520e60
🎉 New Source: Workable (low-code SDK) (#18033)
delenamalan Oct 27, 2022
4117f9d
source-airtable: improve discovery logic (#18491)
alafanechere Oct 27, 2022
0f4ef13
🎉 Destination Meilisearch: migrating to python and fix integration (…
cirdes Oct 27, 2022
91a10da
🐛 Source File: add retry logic for `Connection reset by peer - 104` e…
bazarnov Oct 27, 2022
64479d0
🪟 🐛 Split Heading and Text components (#17992)
josephkmh Oct 27, 2022
48f8d38
🐛 Source Facebook Marketing: increase timeout (#18536)
artem1205 Oct 27, 2022
b91fab1
Bmoric/extract db migration api (#18459)
benmoriceau Oct 27, 2022
5f63618
🪟 Apply default sync mode logic to new streams (#18451)
teallarson Oct 27, 2022
66dc673
Bmoric/extract destination definition api (#18515)
benmoriceau Oct 27, 2022
9cd25ff
🪟 🎨 Add `PillSelect` UI component (#18376)
edmundito Oct 27, 2022
abb7efd
extract destination definition specification api (#18521)
benmoriceau Oct 27, 2022
8d8ac78
Restore docs build (#18551)
tkorenko Oct 27, 2022
426fe04
add authentication info to local development guide (#18509)
erohmensing Oct 27, 2022
22a3fce
🪟 🐛 Fix UI issues in connection streams table (#18544)
edmundito Oct 27, 2022
a9a2bd4
Simplify the OSS documentation deploy system (#2670) (#18436)
tkorenko Oct 27, 2022
2ff16df
Simplify the OSS documentation deploy system (#2670) (#18448)
tkorenko Oct 27, 2022
d1fb5a2
Source Iterable: distinguish 401 from empty stream (#18537)
davydov-d Oct 27, 2022
61c67ba
Databricks destination: introduce personal staging location (#18557)
tuliren Oct 27, 2022
d2911e5
Ensure that restart delay is set before any other activity is execute…
jdpgrailsdev Oct 27, 2022
96ff923
🎉 New Source: ActiveCampaign (#18335)
dainiussa Oct 27, 2022
e2fe272
normalization: Fix failing mypy checks (#18534)
alafanechere Oct 27, 2022
e32a641
Use Protocol Versions in Syncs (#18324)
gosusnp Oct 27, 2022
1514522
🪟 🎉 Client-side validation of cron expressions <= 1 hr for cloud (#1…
josephkmh Oct 27, 2022
1ddc8c6
Lowcode connectors: Fix few issues with stream slicers (#18529)
girarda Oct 27, 2022
aea4c53
Protocol change: Define a set of well-known data types (#17486)
edgao Oct 27, 2022
13b4a26
🎉 New Source: Coin API (#18302)
isaacharrisholt Oct 27, 2022
b9c8aa4
🎉 New Source: TVMaze Schedule (#18333)
isaacharrisholt Oct 27, 2022
57068e3
🎉 New Source: MailerLite (#18336)
rytismi Oct 28, 2022
a6974a7
🎉 New Source: Nasa APOD [python cdk] (#18394)
Xabilahu Oct 28, 2022
9126dc2
Add missing generated python files (#18580)
evantahler Oct 28, 2022
157ed1a
🎉 New Source - Lokalise [low-code SDK] (#18522)
delenamalan Oct 28, 2022
815cb8d
🎉 New Source: Oura (#18224)
isaacharrisholt Oct 28, 2022
4e96895
🎉 New Source: Ashby (#18334)
elliottrabac Oct 28, 2022
c1ac786
🎉 New Source - Sonar Cloud (#18475)
haithem-souala Oct 28, 2022
c469ea8
🎉 New source: SFTP Bulk [python cdk] (#17691)
henriblancke Oct 28, 2022
bea6edd
🎉 New Source: Mailjet Mail API (#18332)
haithem-souala Oct 28, 2022
4ff8bdb
Sonar Cloud: add to source spec and publish connector (#18584)
marcosmarxm Oct 28, 2022
b238e2a
Source Mailjet Mail: publish connector and additional format (#18586)
marcosmarxm Oct 28, 2022
6dd52d0
Implement Connector Builder testing panel (first iteration) (#18449)
lmossman Oct 28, 2022
592a785
Source: Google Search Console: validate custom_reports.dimension (#18…
grubberr Oct 28, 2022
c25ac8a
SAT: make `expect_records` mandatory in `high` `test_strictness_level…
alafanechere Oct 28, 2022
d9acf47
🎉 New destination: Yugabytedb (#18039)
itaseskii Oct 28, 2022
726102c
fix worker volumeMounts (#18604)
xpuska513 Oct 28, 2022
0e2361d
🎉 New Source: RD Station Marketing [python cdk] (#18348)
sarafonseca-123 Oct 28, 2022
d840a8a
Simplify the OSS documentation deploy system (#2670) (#18598)
tkorenko Oct 28, 2022
b71ec08
improved the digitalocean deployment guide (#18566)
ikeadeoyin Oct 28, 2022
67c078d
fixed failed build (#18610)
dizel852 Oct 28, 2022
8766372
🎉 New Source: ConvertKit (#18455)
dainiussa Oct 28, 2022
3036dda
🎉New Source: Google Webfonts [low-code cdk] (#18496)
btkcodedev Oct 28, 2022
d711781
Clean up build.gradle. (#18555)
davinchia Oct 28, 2022
c219dab
🎉 New Destination: Typesense (#18349)
cirdes Oct 28, 2022
683a3a3
🎉 New Source: Waiteraid [low-code cdk] (#18165)
Oct 28, 2022
3275832
Replace `recipesLink` link with `tutorialsLink` (#18616)
evantahler Oct 28, 2022
02459e8
Protocol Change: `AirbyteControlMessage.ConnectorConfig` (#17907)
evantahler Oct 28, 2022
e3aadbf
Remove workflow version check (#18613)
jdpgrailsdev Oct 28, 2022
44d78bc
Improved the Oracle cloud deployment guide (#18615)
victor-cody Oct 28, 2022
cd1f492
🐛 Lowcode: ListStreamSlicer and SubstreamSlicer should get the stream…
girarda Oct 28, 2022
c5d5ef3
Add versioning logging (#18618)
gosusnp Oct 28, 2022
e39f882
Bmoric/extract healt api (#18523)
benmoriceau Oct 28, 2022
63c024b
Fix ConfiguredCatalog for Resets (#18625)
gosusnp Oct 28, 2022
5e5a5e3
:tada: New Source: Mailjet SMS (#18345)
haithem-souala Oct 28, 2022
85e6792
More comprehensive temporal error message (#18608)
benmoriceau Oct 28, 2022
6cd991b
:tada: New Connector: Zendesk Sell [python cdk] (#17888)
alexchouraki Oct 28, 2022
8a1f3e4
Source Mailjet SMS: publish PR and add source def (#18620)
marcosmarxm Oct 28, 2022
cd03c04
Add endpoint to retrieve manifest template (#18578)
lmossman Oct 29, 2022
6a40ac5
Source S3: use AirbyteTracedException (#18602)
davydov-d Oct 29, 2022
9e62614
Fix source spec diff (#18645)
gosusnp Oct 29, 2022
df35c1e
Rename maxCursor and add comment (#18570)
tuliren Oct 30, 2022
a0f01ad
ami-0d648081937c75a73 -> ami-06cf12549e3d9c522 (#18667)
grubberr Oct 30, 2022
7a632fb
🐛 Source Google Analytics (Universal Analytics): add `Custom Reports…
bazarnov Oct 31, 2022
373b6f7
🪟 🐛 Fix trailing whitespace and ending with a forward slash transform…
dizel852 Oct 31, 2022
5b9f564
🎉 New Source: Omnisend (#18577)
dainiussa Oct 31, 2022
96ebd96
Added a note about chained dbt transformations (#18678)
mickaelandrieu Oct 31, 2022
3b44baf
Source metabase: allow using only https urls (#18607)
davydov-d Oct 31, 2022
db5a149
🪟 🎉 Add sync mode, primary key, cursor select components to new strea…
edmundito Oct 31, 2022
fda55bf
Source Intercom: change airbyte-cdk version to 0.2 (#18681)
roman-yermilov-gl Oct 31, 2022
2099a74
feat: Add airbyte-cron Helm chart (#18542)
perangel Oct 31, 2022
49622e7
fix: Typo in semver format for chart (#18686)
perangel Oct 31, 2022
a2bd577
🐛 Source Amplitude: fix empty `series` for `AverageSessionLength` str…
bazarnov Oct 31, 2022
5f7bfb9
Destination Redis: TLS support (#18358)
suhomud Oct 31, 2022
926a26a
Remove duplicate paragraph (#18662)
scottleechua Oct 31, 2022
d0521e7
Simplify the job persistence method. (#18698)
davinchia Oct 31, 2022
5d13856
chore: Add airbyte-cron chart to .bumpversion.cfg (#18688)
perangel Oct 31, 2022
2108143
fix helm release workflow (#18716)
xpuska513 Oct 31, 2022
bf06dec
AMI change: ami-0f23be2f917510c26 -> ami-005924fb76f7477ce (#18689)
grubberr Oct 31, 2022
f095459
Remove unused test script. (#18715)
davinchia Oct 31, 2022
fa37148
ci: replace set-output with new github actions syntax (#18691)
cuyk Oct 31, 2022
2d4f443
Sources postgres, mysql, alloydb: encode database name (#18538)
sashaNeshcheret Oct 31, 2022
dc326b4
Source Prestashop: prevent users from using http url (#18599)
grubberr Oct 31, 2022
0c18333
add nonBreakingChangePreference and notifySchemaChanges (#18636)
alovew Oct 31, 2022
cb785bc
Changes docs deploy failures to show up in #docs (#18738)
supertopher Oct 31, 2022
ae1a499
Green house docs (#18314)
digambar-t7 Nov 1, 2022
5ce7ffd
Resurfaces hidden cloud connectors within UI (#18748)
ryankfu Nov 1, 2022
04d84ce
Update helpers functions in subcharts (#18757)
xpuska513 Nov 1, 2022
3741014
Update chart.yaml to reference right subchart (#18718)
xpuska513 Nov 1, 2022
093a294
🎉 New Destination: Heap Analytics [python cdk] (#18530)
YiyangLi Nov 1, 2022
7722316
Source Salesforce: add get_error_display_message for ConnectionError …
grubberr Nov 1, 2022
065fef0
fix helm release workflow (#18776)
xpuska513 Nov 1, 2022
9ab4d07
Update to latest Micronaut release (#18774)
jdpgrailsdev Nov 1, 2022
4cb42a9
fix cron resources spec (#18778)
xpuska513 Nov 1, 2022
4e12c13
ci: use oldgithub actions notation for output in publish-helm-charts …
cuyk Nov 1, 2022
385ab7e
improve connector dependency github action (#18480)
erohmensing Nov 1, 2022
8cf5464
🐛 Add a drop table hook to drop scd tables in case of overwrite sync …
grishick Nov 1, 2022
6a2ef97
Move components to `components/common` (#18728)
edmundito Nov 1, 2022
0ee9306
🎉 New Source: Public APIs [python CDK] (#18471)
andresbravog Nov 1, 2022
aff9963
🎉 New Source: Coinmarketcap [low-code CDK] (#18565)
haithem-souala Nov 1, 2022
354db21
Filter Temporal exit errors from traces (#18777)
jdpgrailsdev Nov 1, 2022
978128a
Fix adjust.md header
sherifnada Nov 1, 2022
e7ae961
Mark/update notification settings design (#18159)
Nov 1, 2022
7d558c9
query to include data plane attributes (#18531)
xiaohansong Nov 1, 2022
5d34b4e
Fix unit tests in source relational db (#18789)
tuliren Nov 1, 2022
dc15f56
ci: use custom test-reporter action to upload job results (#18004)
Nov 1, 2022
af7da95
Correct coinmarket spec (#18790)
marcosmarxm Nov 1, 2022
6af9804
Parameterize test_empty_streams and test_stream_with_1_airbyte_column…
grishick Nov 1, 2022
88bbb5d
🐛 Source Facebook Marketing: reduce request limit after specific erro…
artem1205 Nov 1, 2022
b5adaef
[charts/airbyte-cron] Cleanup env vars (#18787)
perangel Nov 1, 2022
b14bd05
Use equalsIgnoreCase (#18810)
jdpgrailsdev Nov 1, 2022
66da2fc
Bump helm chart version reference to 0.40.40 (#18815)
github-actions[bot] Nov 1, 2022
bc09083
🐛Destination Google Sheets: Fix empty headers list (#18729)
lazebnyi Nov 1, 2022
e45aec3
🐛Source Exchange Rates: Fix handling error during check connection (#…
lazebnyi Nov 1, 2022
7b9a097
Add normalization changelog and bump normalization version in platfor…
grishick Nov 1, 2022
ebb9126
Remove ConfigPersistence usage from SecretsMigrator (#18747)
cgardens Nov 1, 2022
c9988c4
remove config persistence from seeding logic (#18749)
cgardens Nov 1, 2022
20ab047
Remove the bulk actions from ConfigPersistence (#18800)
cgardens Nov 1, 2022
87a0a2a
hide ConfigPersistence inside ConfigRepository to discourage use (#18…
cgardens Nov 1, 2022
1167d35
ci: add job and run id to test reports (#18832)
Nov 2, 2022
b299688
Bump Airbyte version from 0.40.17 to 0.40.18 (#18827)
octavia-squidington-iii Nov 2, 2022
578f40a
🪟🔧 Remove styled components (round 1) (#18766)
josephkmh Nov 2, 2022
02095d2
fixed acceptance tests (#18699)
darynaishchenko Nov 2, 2022
23a7a07
🪟🔧 Reactor Breadcrumbs component to use anchors (#18764)
josephkmh Nov 2, 2022
968fc69
increase test timeout for some webapp tests to prevent flakes (#18807)
mfsiega-airbyte Nov 2, 2022
4b2d65f
Remove "Filters and Segments" from Google Analytics v4 (#18508)
tybernstein Nov 2, 2022
016907e
Add notes about EU OAUth (#18835)
YowanR Nov 2, 2022
2379876
🪟🐛 Fix: visual regression in ConnectorIcon (#18849)
josephkmh Nov 2, 2022
5424099
Add links to demo page (#18828)
timroes Nov 2, 2022
0a37a8d
mysql-source:fix tinyint unsigned handling (#18619)
subodh1810 Nov 2, 2022
4ddd414
:window: :tada: Allow environment specific sections in docs (#18829)
timroes Nov 2, 2022
b77d039
ci: replace GITHUB_OUTPUT with GITHUB_ENV on multiline variables (#18…
cuyk Nov 2, 2022
7c2c701
Add connection ID to span (#18852)
jdpgrailsdev Nov 2, 2022
fbe16d1
edited connector docs (#18855)
Amruta-Ranade Nov 2, 2022
a44c841
:window: :wrench: Upgrade husky to 8.0.1 (#18719)
timroes Nov 2, 2022
61bc0b8
Merge tag 'v0.40.18' into v0.40.18
am6010 Nov 9, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
🎉 Source Shopify: update API version to 2022-10 (airbytehq#18298)
  • Loading branch information
bazarnov authored Oct 24, 2022

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
commit 5e302e0a8a9a47a95dd9e80841ff075ea926d55d
Original file line number Diff line number Diff line change
@@ -983,7 +983,7 @@
- name: Shopify
sourceDefinitionId: 9da77001-af33-4bcd-be46-6252bf9342b9
dockerRepository: airbyte/source-shopify
dockerImageTag: 0.1.39
dockerImageTag: 0.2.0
documentationUrl: https://docs.airbyte.com/integrations/sources/shopify
icon: shopify.svg
sourceType: api
Original file line number Diff line number Diff line change
@@ -10197,7 +10197,7 @@
supportsNormalization: false
supportsDBT: false
supported_destination_sync_modes: []
- dockerImage: "airbyte/source-shopify:0.1.39"
- dockerImage: "airbyte/source-shopify:0.2.0"
spec:
documentationUrl: "https://docs.airbyte.com/integrations/sources/shopify"
connectionSpecification:
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-shopify/Dockerfile
Original file line number Diff line number Diff line change
@@ -28,5 +28,5 @@ COPY source_shopify ./source_shopify
ENV AIRBYTE_ENTRYPOINT "python /airbyte/integration_code/main.py"
ENTRYPOINT ["python", "/airbyte/integration_code/main.py"]

LABEL io.airbyte.version=0.1.39
LABEL io.airbyte.version=0.2.0
LABEL io.airbyte.name=airbyte/source-shopify
Original file line number Diff line number Diff line change
@@ -17,26 +17,21 @@ tests:
status: "failed"
discovery:
- config_path: "secrets/config.json"
backward_compatibility_tests_config:
disable_for_version: "0.1.38"
- config_path: "secrets/config_old.json"
backward_compatibility_tests_config:
disable_for_version: "0.1.38"
- config_path: "secrets/config_oauth.json"
backward_compatibility_tests_config:
disable_for_version: "0.1.38"
basic_read:
- config_path: "secrets/config.json"
configured_catalog_path: "integration_tests/configured_catalog.json"
timeout_seconds: 3600
timeout_seconds: 7200
# some streams hold data only for some time, therefore certain streams could be empty while sync.
# 'abandoned_checkouts' stream holds data up to 1 month.
empty_streams: ["abandoned_checkouts", "balance_transactions"]
incremental:
- config_path: "secrets/config.json"
configured_catalog_path: "integration_tests/configured_catalog.json"
future_state_path: "integration_tests/abnormal_state.json"
timeout_seconds: 3600
full_refresh:
- config_path: "secrets/config.json"
configured_catalog_path: "integration_tests/configured_catalog.json"
timeout_seconds: 3600
timeout_seconds: 7200
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": ["null", "object"],
"additionalProperties": true,
"properties": {
"note_attributes": {
"type": ["null", "array"],
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": "object",
"additionalProperties": true,
"properties": {
"id": {
"type": ["null", "integer"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": ["null", "object"],
"additionalProperties": true,
"properties": {
"id": {
"type": "integer"
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": "object",
"additionalProperties": true,
"properties": {
"commentable": {
"type": ["null", "string"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": "object",
"additionalProperties": true,
"properties": {
"id": {
"type": ["null", "integer"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": "object",
"additionalProperties": true,
"properties": {
"id": {
"type": ["null", "integer"]
Original file line number Diff line number Diff line change
@@ -57,5 +57,6 @@
"type": ["null", "string"]
}
},
"additionalProperties": true,
"type": ["null", "object"]
}
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": ["null", "object"],
"additionalProperties": true,
"properties": {
"last_order_name": {
"type": ["null", "string"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": "object",
"additionalProperties": true,
"properties": {
"id": {
"type": ["null", "integer"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": ["null", "object"],
"additionalProperties": true,
"properties": {
"id": {
"type": ["null", "integer"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": "object",
"additionalProperties": true,
"properties": {
"assigned_location_id": {
"type": ["null", "integer"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": "object",
"additionalProperties": true,
"properties": {
"created_at": {
"type": ["null", "string"],
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": "object",
"additionalProperties": true,
"properties": {
"id": {
"type": ["null", "integer"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": "object",
"additionalProperties": true,
"properties": {
"id": {
"type": ["null", "string"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": "object",
"additionalProperties": true,
"properties": {
"active": {
"type": ["null", "boolean"]
Original file line number Diff line number Diff line change
@@ -42,5 +42,6 @@
"type": ["null", "string"]
}
},
"additionalProperties": true,
"type": ["null", "object"]
}
Original file line number Diff line number Diff line change
@@ -39,5 +39,6 @@
"type": ["null", "string"]
}
},
"additionalProperties": true,
"type": ["null", "object"]
}
Original file line number Diff line number Diff line change
@@ -39,5 +39,6 @@
"type": ["null", "string"]
}
},
"additionalProperties": true,
"type": ["null", "object"]
}
Original file line number Diff line number Diff line change
@@ -42,5 +42,6 @@
"type": ["null", "string"]
}
},
"additionalProperties": true,
"type": ["null", "object"]
}
Original file line number Diff line number Diff line change
@@ -42,5 +42,6 @@
"type": ["null", "string"]
}
},
"additionalProperties": true,
"type": ["null", "object"]
}
Original file line number Diff line number Diff line change
@@ -42,5 +42,6 @@
"type": ["null", "string"]
}
},
"additionalProperties": true,
"type": ["null", "object"]
}
Original file line number Diff line number Diff line change
@@ -42,5 +42,6 @@
"type": ["null", "string"]
}
},
"additionalProperties": true,
"type": ["null", "object"]
}
Original file line number Diff line number Diff line change
@@ -42,5 +42,6 @@
"type": ["null", "string"]
}
},
"additionalProperties": true,
"type": ["null", "object"]
}
Original file line number Diff line number Diff line change
@@ -42,5 +42,6 @@
"type": ["null", "string"]
}
},
"additionalProperties": true,
"type": ["null", "object"]
}
Original file line number Diff line number Diff line change
@@ -42,5 +42,6 @@
"type": ["null", "string"]
}
},
"additionalProperties": true,
"type": ["null", "object"]
}
Original file line number Diff line number Diff line change
@@ -42,5 +42,6 @@
"type": ["null", "string"]
}
},
"additionalProperties": true,
"type": ["null", "object"]
}
Original file line number Diff line number Diff line change
@@ -42,5 +42,6 @@
"type": ["null", "string"]
}
},
"additionalProperties": true,
"type": ["null", "object"]
}
Original file line number Diff line number Diff line change
@@ -42,5 +42,6 @@
"type": ["null", "string"]
}
},
"additionalProperties": true,
"type": ["null", "object"]
}
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": "object",
"additionalProperties": true,
"properties": {
"order_id": {
"type": ["null", "integer"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": "object",
"additionalProperties": true,
"properties": {
"id": {
"type": ["null", "integer"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": "object",
"additionalProperties": true,
"properties": {
"id": {
"type": ["null", "integer"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": "object",
"additionalProperties": true,
"properties": {
"author": {
"type": ["null", "string"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": ["null", "object"],
"additionalProperties": true,
"properties": {
"allocation_method": {
"type": ["null", "string"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": ["null", "object"],
"additionalProperties": true,
"properties": {
"created_at": {
"type": ["null", "string"],
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": ["null", "object"],
"additionalProperties": true,
"properties": {
"id": {
"type": ["null", "integer"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": ["object", "null"],
"additionalProperties": true,
"properties": {
"published_at": {
"type": ["null", "string"],
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": ["null", "object"],
"additionalProperties": true,
"properties": {
"address1": {
"type": ["null", "string"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": ["null", "object"],
"additionalProperties": true,
"properties": {
"id": {
"type": ["null", "integer"]
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"type": "object",
"additionalProperties": true,
"properties": {
"id": {
"type": ["null", "integer"]
Original file line number Diff line number Diff line change
@@ -96,5 +96,6 @@
"type": ["null", "string"]
}
},
"additionalProperties": true,
"type": ["null", "object"]
}
Original file line number Diff line number Diff line change
@@ -22,7 +22,7 @@

class ShopifyStream(HttpStream, ABC):
# Latest Stable Release
api_version = "2021-07"
api_version = "2022-10"
# Page size
limit = 250
# Define primary key as sort key for full_refresh, or very first sync for incremental_refresh
@@ -67,26 +67,27 @@ def request_params(self, next_page_token: Mapping[str, Any] = None, **kwargs) ->

@limiter.balance_rate_limit()
def parse_response(self, response: requests.Response, **kwargs) -> Iterable[Mapping]:
json_response = response.json() or {}
records = json_response.get(self.data_field, []) if self.data_field is not None else json_response
# transform method was implemented according to issue 4841
# Shopify API returns price fields as a string and it should be converted to number
# this solution designed to convert string into number, but in future can be modified for general purpose
if isinstance(records, dict):
# for cases when we have a single record as dict
# add shop_url to the record to make querying easy
records["shop_url"] = self.config["shop"]
yield self._transformer.transform(records)
else:
# for other cases
for record in records:
if response.status_code is requests.codes.OK:
json_response = response.json()
records = json_response.get(self.data_field, []) if self.data_field is not None else json_response
# transform method was implemented according to issue 4841
# Shopify API returns price fields as a string and it should be converted to number
# this solution designed to convert string into number, but in future can be modified for general purpose
if isinstance(records, dict):
# for cases when we have a single record as dict
# add shop_url to the record to make querying easy
record["shop_url"] = self.config["shop"]
yield self._transformer.transform(record)
records["shop_url"] = self.config["shop"]
yield self._transformer.transform(records)
else:
# for other cases
for record in records:
# add shop_url to the record to make querying easy
record["shop_url"] = self.config["shop"]
yield self._transformer.transform(record)

def should_retry(self, response: requests.Response) -> bool:
if response.status_code == 404:
self.logger.warn(f"Stream `{self.name}` is not available, skipping.")
self.logger.warn(f"Stream `{self.name}` is not available, skipping...")
setattr(self, "raise_on_http_errors", False)
return False
return super().should_retry(response)
1 change: 1 addition & 0 deletions docs/integrations/sources/shopify.md
Original file line number Diff line number Diff line change
@@ -145,6 +145,7 @@ This is expected when the connector hits the 429 - Rate Limit Exceeded HTTP Erro

| Version | Date | Pull Request | Subject |
|:--------|:-----------|:----------------------------------------------------------|:----------------------------------------------------------------------------------------------------------|
| 0.2.0 | 2022-10-21 | [18298](https://github.com/airbytehq/airbyte/pull/18298) | Updated API version to the `2022-10`, make stream schemas backward cpmpatible |
| 0.1.39 | 2022-10-13 | [17962](https://github.com/airbytehq/airbyte/pull/17962) | Add metafield streams; support for nested list streams |
| 0.1.38 | 2022-10-10 | [17777](https://github.com/airbytehq/airbyte/pull/17777) | Fixed `404` for configured streams, fix missing `cursor` error for old records |
| 0.1.37 | 2022-04-30 | [12500](https://github.com/airbytehq/airbyte/pull/12500) | Improve input configuration copy |