Source Amazon Ads: fix bug with handling: "Report date is too far in the past." #20662
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
octavia-squidington-iv
added
area/connectors
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
octavia-squidington-iv
added
the
area/documentation
|
/test connector=connectors/source-amazon-ads
Build PassedTest summary info: |
girarda
reviewed
Dec 20, 2022
...ions/connectors/source-amazon-ads/source_amazon_ads/streams/report_streams/report_streams.py
Show resolved
Hide resolved
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
|
/test connector=connectors/source-amazon-ads
Build PassedTest summary info: |
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
girarda
approved these changes
Dec 22, 2022
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
|
/test connector=connectors/source-amazon-ads
Build PassedTest summary info: |
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
|
/test connector=connectors/source-amazon-ads
|
|
/publish connector=connectors/source-amazon-ads
if you have connectors that successfully published but failed definition generation, follow step 4 here |
octavia-squidington-iii
temporarily deployed
to
more-secrets
GitHub Actions
Inactive
octavia-squidington-iii
temporarily deployed
to
more-secrets
GitHub Actions
Inactive
14 tasks
supertopher
added a commit
that referenced
this pull request
Jan 6, 2023
…the past." (partial revert of #20662) (#21082) * Revert "Source Amazon Ads: fix bug with handling: "Report date is too far in the past." (#20662)" This reverts commit ec99595. * fix Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * revert master Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * revert to master Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * bump 0.1.27 Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * fix Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * amazon-ads.md updated Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * amazon-ads.md updated Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * auto-bump connector version Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> Co-authored-by: Augustin <augustin@airbyte.io> Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com> Co-authored-by: Topher Lubaway <asimplechris@gmail.com>
This was referenced Jan 6, 2023
jbfbell
pushed a commit
that referenced
this pull request
Jan 13, 2023
…the past." (partial revert of #20662) (#21082) * Revert "Source Amazon Ads: fix bug with handling: "Report date is too far in the past." (#20662)" This reverts commit ec99595. * fix Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * revert master Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * revert to master Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * bump 0.1.27 Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * fix Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * amazon-ads.md updated Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * amazon-ads.md updated Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * auto-bump connector version Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> Co-authored-by: Augustin <augustin@airbyte.io> Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com> Co-authored-by: Topher Lubaway <asimplechris@gmail.com>
lgomezm
added a commit
to calixa-io/airbyte
that referenced
this pull request
Jan 17, 2023
* 🪟 🧹 Use custom arrow icon in the new Streams Table (#20678)
* update icon used in streams table and its headers
* wrap in arrowCell div
* Store SQLs for Java source test datasets (#20955)
* Only add definitions updater cron when enabled (#20838)
* Only add definitions updater cron when enabled
* Remove unused property
* build: added script that match github user to slack user/added action/changed workflow with user mentioning (#20815)
* Add cancelled status icon (#20774)
* Add cancelled state and update error to use crossicon instead of fontawesome
* Update cancelled icon to use fontawesome minus
* Show cancelled icon in connections job list and list table
* Update snapshots
* Remove Transfer title from card in replication settings when new table is enabled (#20762)
* Use the new get out of date connectors endpoint (#20155)
* Add /v1/web_backend/check_updates
* Add constant for fallback cases
* Uses the new get out of date connectors endpoint
* Move connector service to its own file. Invalidate count on version change.
* Better upgrade all functionality
* Cleanup
Co-authored-by: Jimmy Ma <jimmy@airbyte.io>
* OSS changes to support acceptance test on data plane (#20853)
* addlog
* fix applicaion.yml
* remove logging
* var name for boolean
* test setup
* test
* more fix for testing
* self review
* remove unrelated changes
* remove unwanted cdk changes
* more clean ups
* Fix copySecrets for top level oneOfs (#20848)
* Remove configRepo dependencies (#20690)
* Use ConnectionApi to fetch source ID (#20670)
* Improve performance of list connection operations (#20264)
* Enable source/destination filtering in /web_backend/connection/list
* Add tests on connection filtering
* Remove redundant DB call
* Make some methods static to avoid sneaky db calls
* Minor refactor
* Small refactoring + add filtering by source for catalog fetch events
* Add comment
* Trim WebBackendConnectionList response payload
* fix build errors
* Remove requests to list_by_workspace and list_latest
* Add sourcedefid and destdefid to source/dest snippets read
* fixed sourceDefinitionId and destinationDefinitionId
* Fix webbackend handler tests
Co-authored-by: Volodymyr Petrov <volodymyr.s.petrov@globallogic.com>
Co-authored-by: KC <krishna@airbyte.io>
* Add BOOLEAN to Redshift keywords (#20421)
* pass workspace id to sync workflow and use it to selectively enable field selection (#20589)
* pass workspace id to sync workflow and use it to selectively enable field selection
* fix tests around workspace id in job creation
* make sure field selection environment variables get passed through properly
* clean up handling around field selection flags
* debug logging for field selection
* properly handle empty field selection feature flag
* fix pmd
* actually fix pmd
* Source Sentry: add incremental sync (#20709)
* Source Sentry: add incremental sync
* Source Sentry: fix test config
* Source Sentry: bump version; update docs
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Expected Records to `.jsonl` format (#20850)
* Expected Records to `.jsonl` format
* fix formatting template
* remove endline
* update templates
* Update docs/connector-development/testing-connectors/source-acceptance-tests-reference.md
Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
* Randomize namespace to avoid false successes (#20775)
* add randomization to namespace testing
* formatting
* Source Facebook Marketing: fix OC 1040 (#20736)
* Source Facebook Marketing: fix OC 1040
* Source Facebook Marketing: docs update; bump version
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* 🎉 Source LinkedIn-Ads: update SAT to `high` strictness level (#20964)
* source-postgres-cdc: allow LSN to be acknowledged after sync (#20469)
* WIP
* fix issues
* fix test
* format
* more tests
* one more test
* make lsn_commit_behaviour not required
* update expected spec
* update expected spec
* update expected spec
* PR comments
* PR comments
* upgrade version
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Source Jira: Fixed pagination for streams `issue_remote_links`, `sprints` (#20859)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
* source-postgres: enable SAT high test strictness level (#20549)
* Map number(integer) into an integer rather than a float (#20730)
* Fix failing test
* Bigquery-denormalized update spec plus destination_definitions.yaml to fix integration tests
* sanity
* Update version number and release note
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* 🪟🎉 Connector builder UI: User inputs, request options, authentication, pagination, slicing (#20809)
* improve some types
* improve further
* clean up a bit more
* refactor loading state
* move loading state up
* remove isLoading references
* remove unused props and make fetch connector error work
* remove special component for name
* remove top level state for unifinished flows
* start removing uiwidget
* Update airbyte-webapp/src/views/Connector/ConnectorCard/ConnectorCard.module.scss
Co-authored-by: Tim Roes <tim@airbyte.io>
* remove undefined option for selected id
* remove unused prop
* fix types
* remove uiwidget state
* clean up
* adjust comment
* handle errors in a nice way
* do not respect default on oneOf fields
* rename to formblock
* reduce re-renders
* pass error to secure inputs
* simplify and improve styling
* align top
* code review
* remove comment
* review comments
* rename file
* be strict about boolean values
* add example
* track form error in error boundary
* review comments
* handle unexpected cases better
* enrich error with connector id
* 🪟🎉 Add copy stream button (#20577)
* add copy stream button
* review comments
* rename prop
* 🪟🎉 Connector builder: Integrate connector form for test input (#20385)
* move connector builder components into the same shared components/connectorBuilder directory
* move diff over from poc branch
* save current progress
* add modal for adding streams
* focus stream after adding and reset button style
* add reset confirm modal and select view on add
* style global config and streams buttons
* styling improvements
* handle long stream names better
* pull in connector manifest schema directly
* add box shadows to resizable panels
* upgrade orval and use connector manifest schema directly
* remove airbyte protocol from connector builder api spec
* generate python models from openapi change
* fix position of yaml toggle
* handle no stream case with better looking message
* group global fields into single object and fix console error
* confirmation modal on toggling dirty form + cleanup
* fix connector name display
* undo change to manifest schema
* remove commented code
* remove unnecessary change
* fix spacing
* use shadow mixin for connector img
* add comment about connector img
* change onSubmit to no-op
* remove console log
* clean up styling
* simplify sidebar to remove StreamSelectButton component
* swap colors of toggle
* move FormikPatch to src/core/form
* move types up to connectorBuilder/ level
* use grid display for ui yaml toggle button
* use spread instead of setting array index directly
* add intl in missing places
* pull connector manifest schema in through separate openapi spec
* use correct intl string id
* throttle setting json manifest in yaml editor
* use button prop instead of manually styling
* consolidate AddStreamButton styles
* fix sidebar flex styles
* use specific flex properties instead of flex
* clean up download and reset button styles
* use row-reverse for yaml editor download button
* fix stream selector styles to remove margins
* give connector setup guide panel same corner and shadow styles
* remove blur from page display
* set view to stream when selected in test panel
* add placeholder when stream name is empty
* switch to index-based stream selection to preserve testing panel selected stream on rename
* handle empty name in stream selector
* make connector form work in connector builder
* fix small stuff
* add warning label
* review comments
* adjust translation
Co-authored-by: lmossman <lake@airbyte.io>
* use request_body_json instead of request_body_data
* :window: :art: Move `Add` button into the line of Connector Builder key value list fields (#20699)
* move add button into line
* add stories for empty with control, and content + control
* change button name to Control
* 🪟🎉 Connector builder: Allow defining inputs (#20431)
* move connector builder components into the same shared components/connectorBuilder directory
* move diff over from poc branch
* save current progress
* add modal for adding streams
* focus stream after adding and reset button style
* add reset confirm modal and select view on add
* style global config and streams buttons
* styling improvements
* handle long stream names better
* pull in connector manifest schema directly
* add box shadows to resizable panels
* upgrade orval and use connector manifest schema directly
* remove airbyte protocol from connector builder api spec
* generate python models from openapi change
* fix position of yaml toggle
* handle no stream case with better looking message
* group global fields into single object and fix console error
* confirmation modal on toggling dirty form + cleanup
* fix connector name display
* undo change to manifest schema
* remove commented code
* remove unnecessary change
* fix spacing
* use shadow mixin for connector img
* add comment about connector img
* change onSubmit to no-op
* remove console log
* clean up styling
* simplify sidebar to remove StreamSelectButton component
* swap colors of toggle
* move FormikPatch to src/core/form
* move types up to connectorBuilder/ level
* use grid display for ui yaml toggle button
* use spread instead of setting array index directly
* add intl in missing places
* pull connector manifest schema in through separate openapi spec
* use correct intl string id
* throttle setting json manifest in yaml editor
* use button prop instead of manually styling
* consolidate AddStreamButton styles
* fix sidebar flex styles
* use specific flex properties instead of flex
* clean up download and reset button styles
* use row-reverse for yaml editor download button
* fix stream selector styles to remove margins
* give connector setup guide panel same corner and shadow styles
* remove blur from page display
* set view to stream when selected in test panel
* add placeholder when stream name is empty
* switch to index-based stream selection to preserve testing panel selected stream on rename
* handle empty name in stream selector
* make connector form work in connector builder
* wip
* fix small stuff
* add basic input UI
* user inputs
* make most of inputs configuration work
* fix a bunch of stuff
* handle unknown config types
* add warning label
* fix label
* fix some styling
* review comments
* improve state management and error handling
* handle stored form values that don't contain new fields properly
* Update airbyte-webapp/src/locales/en.json
Co-authored-by: Lake Mossman <lake@airbyte.io>
* Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx
Co-authored-by: Lake Mossman <lake@airbyte.io>
* inputs editing weirdness
* input form reset
* using the Label component
* 🪟🎉 Connector builder authentication (#20645)
* allow auth configuration
* check for conflicts with the inferred inputs
* fix invisible inputs
* reduce redundancy and hide advanced input options for inferred inputs
* unnecessary validation
* typo
* unnecessary effect hook
* build spec even for invalid forms but do not update stream list
* fix keys
* 🪟🎉 Connector builder: Session token and oauth authentication (#20712)
* session token and oauth authentication
* fill in session token variable
* typos
* make sure validation error does not go away
* 🪟🎉 Connector builder: Always validate inputs form (#20664)
* validate user input outside of form
* review comments
Co-authored-by: lmossman <lake@airbyte.io>
Co-authored-by: lmossman <lake@airbyte.io>
* fix merge conflict with dropdown prop being renamed to control
* [Connector Builder] Add paginator (#20698)
* move connector builder components into the same shared components/connectorBuilder directory
* move diff over from poc branch
* save current progress
* add modal for adding streams
* focus stream after adding and reset button style
* add reset confirm modal and select view on add
* style global config and streams buttons
* styling improvements
* handle long stream names better
* pull in connector manifest schema directly
* add box shadows to resizable panels
* upgrade orval and use connector manifest schema directly
* remove airbyte protocol from connector builder api spec
* generate python models from openapi change
* fix position of yaml toggle
* handle no stream case with better looking message
* group global fields into single object and fix console error
* confirmation modal on toggling dirty form + cleanup
* fix connector name display
* undo change to manifest schema
* remove commented code
* remove unnecessary change
* fix spacing
* use shadow mixin for connector img
* add comment about connector img
* change onSubmit to no-op
* remove console log
* clean up styling
* simplify sidebar to remove StreamSelectButton component
* swap colors of toggle
* move FormikPatch to src/core/form
* move types up to connectorBuilder/ level
* use grid display for ui yaml toggle button
* use spread instead of setting array index directly
* add intl in missing places
* pull connector manifest schema in through separate openapi spec
* use correct intl string id
* throttle setting json manifest in yaml editor
* use button prop instead of manually styling
* consolidate AddStreamButton styles
* fix sidebar flex styles
* use specific flex properties instead of flex
* clean up download and reset button styles
* use row-reverse for yaml editor download button
* fix stream selector styles to remove margins
* give connector setup guide panel same corner and shadow styles
* remove blur from page display
* set view to stream when selected in test panel
* add placeholder when stream name is empty
* switch to index-based stream selection to preserve testing panel selected stream on rename
* handle empty name in stream selector
* make connector form work in connector builder
* wip
* fix small stuff
* add basic input UI
* user inputs
* make most of inputs configuration work
* fix a bunch of stuff
* handle unknown config types
* add warning label
* fix label
* fix some styling
* review comments
* improve state management and error handling
* allow auth configuration
* check for conflicts with the inferred inputs
* fix invisible inputs
* handle stored form values that don't contain new fields properly
* session token and oauth authentication
* fill in session token variable
* fix merge of default values
* add primaryKey and cursorField to builder types, and consolidate default valeues to types.ts
* add cursor and primary key fields to ui
* save
* add page size and token option inputs
* fixes after rebase
* add pagination
* fix pagination types
* handle empty field_name better
* Update airbyte-webapp/src/locales/en.json
Co-authored-by: Lake Mossman <lake@airbyte.io>
* Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx
Co-authored-by: Lake Mossman <lake@airbyte.io>
* inputs editing weirdness
* input form reset
* using the Label component
* reduce redundancy and hide advanced input options for inferred inputs
* unnecessary validation
* typo
* unnecessary effect hook
* build spec even for invalid forms but do not update stream list
* typos
* make sure validation error does not go away
* make primary key and cursor optional, and reorder
* save toggle group progress
* fix style of toggle label
* handle empty values better
* fix page size/token option field validation and rendering
* handle cursor pagination page size option correctly
Co-authored-by: Joe Reuter <joe@airbyte.io>
* [Connector Builder] Add stream slicer (#20748)
* move connector builder components into the same shared components/connectorBuilder directory
* move diff over from poc branch
* save current progress
* add modal for adding streams
* focus stream after adding and reset button style
* add reset confirm modal and select view on add
* style global config and streams buttons
* styling improvements
* handle long stream names better
* pull in connector manifest schema directly
* add box shadows to resizable panels
* upgrade orval and use connector manifest schema directly
* remove airbyte protocol from connector builder api spec
* generate python models from openapi change
* fix position of yaml toggle
* handle no stream case with better looking message
* group global fields into single object and fix console error
* confirmation modal on toggling dirty form + cleanup
* fix connector name display
* undo change to manifest schema
* remove commented code
* remove unnecessary change
* fix spacing
* use shadow mixin for connector img
* add comment about connector img
* change onSubmit to no-op
* remove console log
* clean up styling
* simplify sidebar to remove StreamSelectButton component
* swap colors of toggle
* move FormikPatch to src/core/form
* move types up to connectorBuilder/ level
* use grid display for ui yaml toggle button
* use spread instead of setting array index directly
* add intl in missing places
* pull connector manifest schema in through separate openapi spec
* use correct intl string id
* throttle setting json manifest in yaml editor
* use button prop instead of manually styling
* consolidate AddStreamButton styles
* fix sidebar flex styles
* use specific flex properties instead of flex
* clean up download and reset button styles
* use row-reverse for yaml editor download button
* fix stream selector styles to remove margins
* give connector setup guide panel same corner and shadow styles
* remove blur from page display
* set view to stream when selected in test panel
* add placeholder when stream name is empty
* switch to index-based stream selection to preserve testing panel selected stream on rename
* handle empty name in stream selector
* make connector form work in connector builder
* wip
* fix small stuff
* add basic input UI
* user inputs
* make most of inputs configuration work
* fix a bunch of stuff
* handle unknown config types
* add warning label
* fix label
* fix some styling
* review comments
* improve state management and error handling
* allow auth configuration
* check for conflicts with the inferred inputs
* fix invisible inputs
* handle stored form values that don't contain new fields properly
* session token and oauth authentication
* fill in session token variable
* fix merge of default values
* add primaryKey and cursorField to builder types, and consolidate default valeues to types.ts
* add cursor and primary key fields to ui
* save
* add page size and token option inputs
* fixes after rebase
* add pagination
* fix pagination types
* handle empty field_name better
* Update airbyte-webapp/src/locales/en.json
Co-authored-by: Lake Mossman <lake@airbyte.io>
* Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx
Co-authored-by: Lake Mossman <lake@airbyte.io>
* inputs editing weirdness
* input form reset
* using the Label component
* reduce redundancy and hide advanced input options for inferred inputs
* unnecessary validation
* typo
* unnecessary effect hook
* build spec even for invalid forms but do not update stream list
* typos
* make sure validation error does not go away
* make primary key and cursor optional, and reorder
* save toggle group progress
* fix style of toggle label
* handle empty values better
* fix page size/token option field validation and rendering
* handle cursor pagination page size option correctly
* save stream slicer progress
* finish stream slicer
* fix stream slicer fields and validation
Co-authored-by: Joe Reuter <joe@airbyte.io>
* debounce form builder values update to reduce load
* 🪟🔧 Connector builder: use new lowcode manifest (#20715)
* use new manifest yaml
* Update airbyte-webapp/src/components/connectorBuilder/types.ts
Co-authored-by: Lake Mossman <lake@airbyte.io>
* use updated manifest types
Co-authored-by: Lake Mossman <lake@airbyte.io>
* debounce validation as well
* akways show stream test button in error state if there are errors
* fix type of oauth input
* add validation schema for add stream form
* validate all views on test click
* add type to prevent console warning
Co-authored-by: Tim Roes <tim@airbyte.io>
Co-authored-by: lmossman <lake@airbyte.io>
* 🪟🎉 Connector form: Respect `default` value for oneOf properties (#20588)
* improve some types
* improve further
* clean up a bit more
* refactor loading state
* move loading state up
* remove isLoading references
* remove unused props and make fetch connector error work
* remove special component for name
* remove top level state for unifinished flows
* start removing uiwidget
* Update airbyte-webapp/src/views/Connector/ConnectorCard/ConnectorCard.module.scss
Co-authored-by: Tim Roes <tim@airbyte.io>
* remove undefined option for selected id
* remove unused prop
* fix types
* remove uiwidget state
* clean up
* adjust comment
* handle errors in a nice way
* do not respect default on oneOf fields
* rename to formblock
* reduce re-renders
* pass error to secure inputs
* simplify and improve styling
* align top
* code review
* remove comment
* review comments
* rename file
* be strict about boolean values
* add example
* track form error in error boundary
* review comments
* handle unexpected cases better
* respect default value for oneOf properties
* enrich error with connector id
* rename prop
Co-authored-by: Tim Roes <tim@airbyte.io>
* 🎉 Source Zendesk Chat: update SAT to high strictness (#21011)
* Source Facebook Pages: fix tests; data is not permanent (#20925)
* Source Facebook Pages: fix tests; data is not permanent
* Source Facebook Pages: fix tests
* Source Google Analytics UA: fix check connection (#20858)
* Source Google Analytics UA: fix check connection
* Source Google Analytics UA: docs update
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Source Snapchat Marketing: permission error (#20865)
* Source Snapchat Marketing: permission error
* Source Snapchat Marketing: add test; docs update
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* 🐛 Source Netsuite: fix early adopter issues (#19798)
* 🪟 🧹 Remove <StartWithDestination /> Component (#20943)
Removing code related to this experiment as it didn't have any impact
* 🪟🧹 Introduce flex component (#20944)
* 🪟 🐛 Show correct page header for creating connection from connector page (#20986)
* fix check for titleId
* cleanup
* use dark-blue (#20980)
* Revert "build: added script that match github user to slack user/added action/changed workflow with user mentioning (#20815)" (#21018)
This reverts commit 31f96cef76be8cecf134ef9b47f08523750f1b23.
* cleanup PULL_REQUEST_TEMPLATE directory (#19774)
* remove redundant style for "Cancel" button (#20752)
* 🪟 🎨 Aligns Switch design according to the latest Figma updates (#20629)
* Aligns Switch design according to the latest Figma updates
* Updates snapshots tests, after adding aria-checked property for switch input; Adds mixed UI state for Switch component
* Source Amazon Ads: fix bug with handling: "Report date is too far in the past." (#20662)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
* 🪟 🐛 Connection Name styles match other fields on Connection create (#20377)
* use our default styles
* update snapshots
* fix from merge conflict
* fix scroll issue on webhook form
* Revert "fix scroll issue on webhook form"
This reverts commit 08a8d95201c34f0b369f51b3a565deee07912f3b.
* Properly triggers a change to the form values object so Formik knows it's dirty (#21021)
* Source File: Fix special characters bug (#21012)
* Source File: Fix special characters bug
* Source File: bump version; update docs
* Source File: update SSH credentials in unit tests
* Source File: bump version (secure)
* Source File: update resources manually
* Source Monday: fix schema loader; delete old files (#20996)
* Source Monday: fix schema loader; delete old files
* Source Monday: fix schema loader; delete old files
* Source Monday: fix tests
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Source Salesforce: fix tests (#20927)
* Source Salesforce: fix tests
* Source Salesforce: update expected records
* Source Salesforce: update expected records
* Source Salesforce: update docs; bump version
* Source Salesforce: update acceptance test reason
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* 🪟 🐛 🧹 Fix issues with Button component (#20737)
* Disable button in loading state
* Remove defaultProps from Button and clean up some prop handling
* Remove config repo dependency for getStatus (#21033)
* Source Facebook Pages: fix tests (#21017)
* Source Facebook Pages: fix tests
* Source Facebook Pages: Add Error handler
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Revert "Update to Micronaut 3.8.0 (#20716)" (#21039)
This reverts commit a28f93747ffb7c8ad9e30a4a90ceada9d0d7dc0e.
* Update action filters to include deps.toml (#21040)
* :window: :art: Connector Builder UI: Rename offset pagination fields (#20998)
* improve some types
* improve further
* clean up a bit more
* refactor loading state
* move loading state up
* remove isLoading references
* remove unused props and make fetch connector error work
* remove special component for name
* remove top level state for unifinished flows
* start removing uiwidget
* Update airbyte-webapp/src/views/Connector/ConnectorCard/ConnectorCard.module.scss
Co-authored-by: Tim Roes <tim@airbyte.io>
* remove undefined option for selected id
* remove unused prop
* fix types
* remove uiwidget state
* clean up
* adjust comment
* handle errors in a nice way
* do not respect default on oneOf fields
* rename to formblock
* reduce re-renders
* pass error to secure inputs
* simplify and improve styling
* align top
* code review
* remove comment
* review comments
* rename file
* be strict about boolean values
* add example
* track form error in error boundary
* review comments
* handle unexpected cases better
* enrich error with connector id
* 🪟🎉 Add copy stream button (#20577)
* add copy stream button
* review comments
* rename prop
* 🪟🎉 Connector builder: Integrate connector form for test input (#20385)
* move connector builder components into the same shared components/connectorBuilder directory
* move diff over from poc branch
* save current progress
* add modal for adding streams
* focus stream after adding and reset button style
* add reset confirm modal and select view on add
* style global config and streams buttons
* styling improvements
* handle long stream names better
* pull in connector manifest schema directly
* add box shadows to resizable panels
* upgrade orval and use connector manifest schema directly
* remove airbyte protocol from connector builder api spec
* generate python models from openapi change
* fix position of yaml toggle
* handle no stream case with better looking message
* group global fields into single object and fix console error
* confirmation modal on toggling dirty form + cleanup
* fix connector name display
* undo change to manifest schema
* remove commented code
* remove unnecessary change
* fix spacing
* use shadow mixin for connector img
* add comment about connector img
* change onSubmit to no-op
* remove console log
* clean up styling
* simplify sidebar to remove StreamSelectButton component
* swap colors of toggle
* move FormikPatch to src/core/form
* move types up to connectorBuilder/ level
* use grid display for ui yaml toggle button
* use spread instead of setting array index directly
* add intl in missing places
* pull connector manifest schema in through separate openapi spec
* use correct intl string id
* throttle setting json manifest in yaml editor
* use button prop instead of manually styling
* consolidate AddStreamButton styles
* fix sidebar flex styles
* use specific flex properties instead of flex
* clean up download and reset button styles
* use row-reverse for yaml editor download button
* fix stream selector styles to remove margins
* give connector setup guide panel same corner and shadow styles
* remove blur from page display
* set view to stream when selected in test panel
* add placeholder when stream name is empty
* switch to index-based stream selection to preserve testing panel selected stream on rename
* handle empty name in stream selector
* make connector form work in connector builder
* fix small stuff
* add warning label
* review comments
* adjust translation
Co-authored-by: lmossman <lake@airbyte.io>
* use request_body_json instead of request_body_data
* :window: :art: Move `Add` button into the line of Connector Builder key value list fields (#20699)
* move add button into line
* add stories for empty with control, and content + control
* change button name to Control
* 🪟🎉 Connector builder: Allow defining inputs (#20431)
* move connector builder components into the same shared components/connectorBuilder directory
* move diff over from poc branch
* save current progress
* add modal for adding streams
* focus stream after adding and reset button style
* add reset confirm modal and select view on add
* style global config and streams buttons
* styling improvements
* handle long stream names better
* pull in connector manifest schema directly
* add box shadows to resizable panels
* upgrade orval and use connector manifest schema directly
* remove airbyte protocol from connector builder api spec
* generate python models from openapi change
* fix position of yaml toggle
* handle no stream case with better looking message
* group global fields into single object and fix console error
* confirmation modal on toggling dirty form + cleanup
* fix connector name display
* undo change to manifest schema
* remove commented code
* remove unnecessary change
* fix spacing
* use shadow mixin for connector img
* add comment about connector img
* change onSubmit to no-op
* remove console log
* clean up styling
* simplify sidebar to remove StreamSelectButton component
* swap colors of toggle
* move FormikPatch to src/core/form
* move types up to connectorBuilder/ level
* use grid display for ui yaml toggle button
* use spread instead of setting array index directly
* add intl in missing places
* pull connector manifest schema in through separate openapi spec
* use correct intl string id
* throttle setting json manifest in yaml editor
* use button prop instead of manually styling
* consolidate AddStreamButton styles
* fix sidebar flex styles
* use specific flex properties instead of flex
* clean up download and reset button styles
* use row-reverse for yaml editor download button
* fix stream selector styles to remove margins
* give connector setup guide panel same corner and shadow styles
* remove blur from page display
* set view to stream when selected in test panel
* add placeholder when stream name is empty
* switch to index-based stream selection to preserve testing panel selected stream on rename
* handle empty name in stream selector
* make connector form work in connector builder
* wip
* fix small stuff
* add basic input UI
* user inputs
* make most of inputs configuration work
* fix a bunch of stuff
* handle unknown config types
* add warning label
* fix label
* fix some styling
* review comments
* improve state management and error handling
* handle stored form values that don't contain new fields properly
* Update airbyte-webapp/src/locales/en.json
Co-authored-by: Lake Mossman <lake@airbyte.io>
* Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx
Co-authored-by: Lake Mossman <lake@airbyte.io>
* inputs editing weirdness
* input form reset
* using the Label component
* 🪟🎉 Connector builder authentication (#20645)
* allow auth configuration
* check for conflicts with the inferred inputs
* fix invisible inputs
* reduce redundancy and hide advanced input options for inferred inputs
* unnecessary validation
* typo
* unnecessary effect hook
* build spec even for invalid forms but do not update stream list
* fix keys
* 🪟🎉 Connector builder: Session token and oauth authentication (#20712)
* session token and oauth authentication
* fill in session token variable
* typos
* make sure validation error does not go away
* 🪟🎉 Connector builder: Always validate inputs form (#20664)
* validate user input outside of form
* review comments
Co-authored-by: lmossman <lake@airbyte.io>
Co-authored-by: lmossman <lake@airbyte.io>
* fix merge conflict with dropdown prop being renamed to control
* [Connector Builder] Add paginator (#20698)
* move connector builder components into the same shared components/connectorBuilder directory
* move diff over from poc branch
* save current progress
* add modal for adding streams
* focus stream after adding and reset button style
* add reset confirm modal and select view on add
* style global config and streams buttons
* styling improvements
* handle long stream names better
* pull in connector manifest schema directly
* add box shadows to resizable panels
* upgrade orval and use connector manifest schema directly
* remove airbyte protocol from connector builder api spec
* generate python models from openapi change
* fix position of yaml toggle
* handle no stream case with better looking message
* group global fields into single object and fix console error
* confirmation modal on toggling dirty form + cleanup
* fix connector name display
* undo change to manifest schema
* remove commented code
* remove unnecessary change
* fix spacing
* use shadow mixin for connector img
* add comment about connector img
* change onSubmit to no-op
* remove console log
* clean up styling
* simplify sidebar to remove StreamSelectButton component
* swap colors of toggle
* move FormikPatch to src/core/form
* move types up to connectorBuilder/ level
* use grid display for ui yaml toggle button
* use spread instead of setting array index directly
* add intl in missing places
* pull connector manifest schema in through separate openapi spec
* use correct intl string id
* throttle setting json manifest in yaml editor
* use button prop instead of manually styling
* consolidate AddStreamButton styles
* fix sidebar flex styles
* use specific flex properties instead of flex
* clean up download and reset button styles
* use row-reverse for yaml editor download button
* fix stream selector styles to remove margins
* give connector setup guide panel same corner and shadow styles
* remove blur from page display
* set view to stream when selected in test panel
* add placeholder when stream name is empty
* switch to index-based stream selection to preserve testing panel selected stream on rename
* handle empty name in stream selector
* make connector form work in connector builder
* wip
* fix small stuff
* add basic input UI
* user inputs
* make most of inputs configuration work
* fix a bunch of stuff
* handle unknown config types
* add warning label
* fix label
* fix some styling
* review comments
* improve state management and error handling
* allow auth configuration
* check for conflicts with the inferred inputs
* fix invisible inputs
* handle stored form values that don't contain new fields properly
* session token and oauth authentication
* fill in session token variable
* fix merge of default values
* add primaryKey and cursorField to builder types, and consolidate default valeues to types.ts
* add cursor and primary key fields to ui
* save
* add page size and token option inputs
* fixes after rebase
* add pagination
* fix pagination types
* handle empty field_name better
* Update airbyte-webapp/src/locales/en.json
Co-authored-by: Lake Mossman <lake@airbyte.io>
* Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx
Co-authored-by: Lake Mossman <lake@airbyte.io>
* inputs editing weirdness
* input form reset
* using the Label component
* reduce redundancy and hide advanced input options for inferred inputs
* unnecessary validation
* typo
* unnecessary effect hook
* build spec even for invalid forms but do not update stream list
* typos
* make sure validation error does not go away
* make primary key and cursor optional, and reorder
* save toggle group progress
* fix style of toggle label
* handle empty values better
* fix page size/token option field validation and rendering
* handle cursor pagination page size option correctly
Co-authored-by: Joe Reuter <joe@airbyte.io>
* [Connector Builder] Add stream slicer (#20748)
* move connector builder components into the same shared components/connectorBuilder directory
* move diff over from poc branch
* save current progress
* add modal for adding streams
* focus stream after adding and reset button style
* add reset confirm modal and select view on add
* style global config and streams buttons
* styling improvements
* handle long stream names better
* pull in connector manifest schema directly
* add box shadows to resizable panels
* upgrade orval and use connector manifest schema directly
* remove airbyte protocol from connector builder api spec
* generate python models from openapi change
* fix position of yaml toggle
* handle no stream case with better looking message
* group global fields into single object and fix console error
* confirmation modal on toggling dirty form + cleanup
* fix connector name display
* undo change to manifest schema
* remove commented code
* remove unnecessary change
* fix spacing
* use shadow mixin for connector img
* add comment about connector img
* change onSubmit to no-op
* remove console log
* clean up styling
* simplify sidebar to remove StreamSelectButton component
* swap colors of toggle
* move FormikPatch to src/core/form
* move types up to connectorBuilder/ level
* use grid display for ui yaml toggle button
* use spread instead of setting array index directly
* add intl in missing places
* pull connector manifest schema in through separate openapi spec
* use correct intl string id
* throttle setting json manifest in yaml editor
* use button prop instead of manually styling
* consolidate AddStreamButton styles
* fix sidebar flex styles
* use specific flex properties instead of flex
* clean up download and reset button styles
* use row-reverse for yaml editor download button
* fix stream selector styles to remove margins
* give connector setup guide panel same corner and shadow styles
* remove blur from page display
* set view to stream when selected in test panel
* add placeholder when stream name is empty
* switch to index-based stream selection to preserve testing panel selected stream on rename
* handle empty name in stream selector
* make connector form work in connector builder
* wip
* fix small stuff
* add basic input UI
* user inputs
* make most of inputs configuration work
* fix a bunch of stuff
* handle unknown config types
* add warning label
* fix label
* fix some styling
* review comments
* improve state management and error handling
* allow auth configuration
* check for conflicts with the inferred inputs
* fix invisible inputs
* handle stored form values that don't contain new fields properly
* session token and oauth authentication
* fill in session token variable
* fix merge of default values
* add primaryKey and cursorField to builder types, and consolidate default valeues to types.ts
* add cursor and primary key fields to ui
* save
* add page size and token option inputs
* fixes after rebase
* add pagination
* fix pagination types
* handle empty field_name better
* Update airbyte-webapp/src/locales/en.json
Co-authored-by: Lake Mossman <lake@airbyte.io>
* Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx
Co-authored-by: Lake Mossman <lake@airbyte.io>
* inputs editing weirdness
* input form reset
* using the Label component
* reduce redundancy and hide advanced input options for inferred inputs
* unnecessary validation
* typo
* unnecessary effect hook
* build spec even for invalid forms but do not update stream list
* typos
* make sure validation error does not go away
* make primary key and cursor optional, and reorder
* save toggle group progress
* fix style of toggle label
* handle empty values better
* fix page size/token option field validation and rendering
* handle cursor pagination page size option correctly
* save stream slicer progress
* finish stream slicer
* fix stream slicer fields and validation
Co-authored-by: Joe Reuter <joe@airbyte.io>
* debounce form builder values update to reduce load
* 🪟🔧 Connector builder: use new lowcode manifest (#20715)
* use new manifest yaml
* Update airbyte-webapp/src/components/connectorBuilder/types.ts
Co-authored-by: Lake Mossman <lake@airbyte.io>
* use updated manifest types
Co-authored-by: Lake Mossman <lake@airbyte.io>
* debounce validation as well
* akways show stream test button in error state if there are errors
* fix type of oauth input
* add validation schema for add stream form
* validate all views on test click
* use more relevant names for the fields in pagination section
Co-authored-by: Joe Reuter <joe@airbyte.io>
Co-authored-by: Tim Roes <tim@airbyte.io>
* remove config repository from config fetch activity impl scheduling (#20908)
* Remove config repository from config fetch activity impl for scheduling data
* Refactor code to avoid missing check (#21046)
* New Desination: Heap Analytics [python cdk] (#20785)
- implement a heap client to load data via the server-side API:
https://developers.heap.io/reference/server-side-apis-overview
- the connector supports a generic data source, and the api_type
determines the output schema. The output schema is dynamic.
- users pick the columns that will be loaded to the destination
- Consequently, each configured catalog only includes one stream
* 📝 Add warning for working with local files and Docker Desktop (`/tmp` and `/private`) (#21004)
* 🪟🎉 Connector builder: Add copy to/from stream buttons (#20816)
Adds buttons to copy pagination and slicing settings between streams
* Source Harvest: skip FORBIDDEN for EstimateItemCategories stream (#20810)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
* 🪟🎉 Connector builder: Add manual schema (#20862)
* improve some types
* improve further
* clean up a bit more
* refactor loading state
* move loading state up
* remove isLoading references
* remove unused props and make fetch connector error work
* remove special component for name
* remove top level state for unifinished flows
* start removing uiwidget
* Update airbyte-webapp/src/views/Connector/ConnectorCard/ConnectorCard.module.scss
Co-authored-by: Tim Roes <tim@airbyte.io>
* remove undefined option for selected id
* remove unused prop
* fix types
* remove uiwidget state
* clean up
* adjust comment
* handle errors in a nice way
* do not respect default on oneOf fields
* rename to formblock
* reduce re-renders
* pass error to secure inputs
* simplify and improve styling
* align top
* code review
* remove comment
* review comments
* rename file
* be strict about boolean values
* add example
* track form error in error boundary
* review comments
* handle unexpected cases better
* enrich error with connector id
* 🪟🎉 Add copy stream button (#20577)
* add copy stream button
* review comments
* rename prop
* 🪟🎉 Connector builder: Integrate connector form for test input (#20385)
* move connector builder components into the same shared components/connectorBuilder directory
* move diff over from poc branch
* save current progress
* add modal for adding streams
* focus stream after adding and reset button style
* add reset confirm modal and select view on add
* style global config and streams buttons
* styling improvements
* handle long stream names better
* pull in connector manifest schema directly
* add box shadows to resizable panels
* upgrade orval and use connector manifest schema directly
* remove airbyte protocol from connector builder api spec
* generate python models from openapi change
* fix position of yaml toggle
* handle no stream case with better looking message
* group global fields into single object and fix console error
* confirmation modal on toggling dirty form + cleanup
* fix connector name display
* undo change to manifest schema
* remove commented code
* remove unnecessary change
* fix spacing
* use shadow mixin for connector img
* add comment about connector img
* change onSubmit to no-op
* remove console log
* clean up styling
* simplify sidebar to remove StreamSelectButton component
* swap colors of toggle
* move FormikPatch to src/core/form
* move types up to connectorBuilder/ level
* use grid display for ui yaml toggle button
* use spread instead of setting array index directly
* add intl in missing places
* pull connector manifest schema in through separate openapi spec
* use correct intl string id
* throttle setting json manifest in yaml editor
* use button prop instead of manually styling
* consolidate AddStreamButton styles
* fix sidebar flex styles
* use specific flex properties instead of flex
* clean up download and reset button styles
* use row-reverse for yaml editor download button
* fix stream selector styles to remove margins
* give connector setup guide panel same corner and shadow styles
* remove blur from page display
* set view to stream when selected in test panel
* add placeholder when stream name is empty
* switch to index-based stream selection to preserve testing panel selected stream on rename
* handle empty name in stream selector
* make connector form work in connector builder
* fix small stuff
* add warning label
* review comments
* adjust translation
Co-authored-by: lmossman <lake@airbyte.io>
* use request_body_json instead of request_body_data
* :window: :art: Move `Add` button into the line of Connector Builder key value list fields (#20699)
* move add button into line
* add stories for empty with control, and content + control
* change button name to Control
* 🪟🎉 Connector builder: Allow defining inputs (#20431)
* move connector builder components into the same shared components/connectorBuilder directory
* move diff over from poc branch
* save current progress
* add modal for adding streams
* focus stream after adding and reset button style
* add reset confirm modal and select view on add
* style global config and streams buttons
* styling improvements
* handle long stream names better
* pull in connector manifest schema directly
* add box shadows to resizable panels
* upgrade orval and use connector manifest schema directly
* remove airbyte protocol from connector builder api spec
* generate python models from openapi change
* fix position of yaml toggle
* handle no stream case with better looking message
* group global fields into single object and fix console error
* confirmation modal on toggling dirty form + cleanup
* fix connector name display
* undo change to manifest schema
* remove commented code
* remove unnecessary change
* fix spacing
* use shadow mixin for connector img
* add comment about connector img
* change onSubmit to no-op
* remove console log
* clean up styling
* simplify sidebar to remove StreamSelectButton component
* swap colors of toggle
* move FormikPatch to src/core/form
* move types up to connectorBuilder/ level
* use grid display for ui yaml toggle button
* use spread instead of setting array index directly
* add intl in missing places
* pull connector manifest schema in through separate openapi spec
* use correct intl string id
* throttle setting json manifest in yaml editor
* use button prop instead of manually styling
* consolidate AddStreamButton styles
* fix sidebar flex styles
* use specific flex properties instead of flex
* clean up download and reset button styles
* use row-reverse for yaml editor download button
* fix stream selector styles to remove margins
* give connector setup guide panel same corner and shadow styles
* remove blur from page display
* set view to stream when selected in test panel
* add placeholder when stream name is empty
* switch to index-based stream selection to preserve testing panel selected stream on rename
* handle empty name in stream selector
* make connector form work in connector builder
* wip
* fix small stuff
* add basic input UI
* user inputs
* make most of inputs configuration work
* fix a bunch of stuff
* handle unknown config types
* add warning label
* fix label
* fix some styling
* review comments
* improve state management and error handling
* handle stored form values that don't contain new fields properly
* Update airbyte-webapp/src/locales/en.json
Co-authored-by: Lake Mossman <lake@airbyte.io>
* Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx
Co-authored-by: Lake Mossman <lake@airbyte.io>
* inputs editing weirdness
* input form reset
* using the Label component
* 🪟🎉 Connector builder authentication (#20645)
* allow auth configuration
* check for conflicts with the inferred inputs
* fix invisible inputs
* reduce redundancy and hide advanced input options for inferred inputs
* unnecessary validation
* typo
* unnecessary effect hook
* build spec even for invalid forms but do not update stream list
* fix keys
* 🪟🎉 Connector builder: Session token and oauth authentication (#20712)
* session token and oauth authentication
* fill in session token variable
* typos
* make sure validation error does not go away
* 🪟🎉 Connector builder: Always validate inputs form (#20664)
* validate user input outside of form
* review comments
Co-authored-by: lmossman <lake@airbyte.io>
Co-authored-by: lmossman <lake@airbyte.io>
* fix merge conflict with dropdown prop being renamed to control
* [Connector Builder] Add paginator (#20698)
* move connector builder components into the same shared components/connectorBuilder directory
* move diff over from poc branch
* save current progress
* add modal for adding streams
* focus stream after adding and reset button style
* add reset confirm modal and select view on add
* style global config and streams buttons
* styling improvements
* handle long stream names better
* pull in connector manifest schema directly
* add box shadows to resizable panels
* upgrade orval and use connector manifest schema directly
* remove airbyte protocol from connector builder api spec
* generate python models from openapi change
* fix position of yaml toggle
* handle no stream case with better looking message
* group global fields into single object and fix console error
* confirmation modal on toggling dirty form + cleanup
* fix connector name display
* undo change to manifest schema
* remove commented code
* remove unnecessary change
* fix spacing
* use shadow mixin for connector img
* add comment about connector img
* change onSubmit to no-op
* remove console log
* clean up styling
* simplify sidebar to remove StreamSelectButton component
* swap colors of toggle
* move FormikPatch to src/core/form
* move types up to connectorBuilder/ level
* use grid display for ui yaml toggle button
* use spread instead of setting array index directly
* add intl in missing places
* pull connector manifest schema in through separate openapi spec
* use correct intl string id
* throttle setting json manifest in yaml editor
* use button prop instead of manually styling
* consolidate AddStreamButton styles
* fix sidebar flex styles
* use specific flex properties instead of flex
* clean up download and reset button styles
* use row-reverse for yaml editor download button
* fix stream selector styles to remove margins
* give connector setup guide panel same corner and shadow styles
* remove blur from page display
* set view to stream when selected in test panel
* add placeholder when stream name is empty
* switch to index-based stream selection to preserve testing panel selected stream on rename
* handle empty name in stream selector
* make connector form work in connector builder
* wip
* fix small stuff
* add basic input UI
* user inputs
* make most of inputs configuration work
* fix a bunch of stuff
* handle unknown config types
* add warning label
* fix label
* fix some styling
* review comments
* improve state management and error handling
* allow auth configuration
* check for conflicts with the inferred inputs
* fix invisible inputs
* handle stored form values that don't contain new fields properly
* session token and oauth authentication
* fill in session token variable
* fix merge of default values
* add primaryKey and cursorField to builder types, and consolidate default valeues to types.ts
* add cursor and primary key fields to ui
* save
* add page size and token option inputs
* fixes after rebase
* add pagination
* fix pagination types
* handle empty field_name better
* Update airbyte-webapp/src/locales/en.json
Co-authored-by: Lake Mossman <lake@airbyte.io>
* Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx
Co-authored-by: Lake Mossman <lake@airbyte.io>
* inputs editing weirdness
* input form reset
* using the Label component
* reduce redundancy and hide advanced input options for inferred inputs
* unnecessary validation
* typo
* unnecessary effect hook
* build spec even for invalid forms but do not update stream list
* typos
* make sure validation error does not go away
* make primary key and cursor optional, and reorder
* save toggle group progress
* fix style of toggle label
* handle empty values better
* fix page size/token option field validation and rendering
* handle cursor pagination page size option correctly
Co-authored-by: Joe Reuter <joe@airbyte.io>
* [Connector Builder] Add stream slicer (#20748)
* move connector builder components into the same shared components/connectorBuilder directory
* move diff over from poc branch
* save current progress
* add modal for adding streams
* focus stream after adding and reset button style
* add reset confirm modal and select view on add
* style global config and streams buttons
* styling improvements
* handle long stream names better
* pull in connector manifest schema directly
* add box shadows to resizable panels
* upgrade orval and use connector manifest schema directly
* remove airbyte protocol from connector builder api spec
* generate python models from openapi change
* fix position of yaml toggle
* handle no stream case with better looking message
* group global fields into single object and fix console error
* confirmation modal on toggling dirty form + cleanup
* fix connector name display
* undo change to manifest schema
* remove commented code
* remove unnecessary change
* fix spacing
* use shadow mixin for connector img
* add comment about connector img
* change onSubmit to no-op
* remove console log
* clean up styling
* simplify sidebar to remove StreamSelectButton component
* swap colors of toggle
* move FormikPatch to src/core/form
* move types up to connectorBuilder/ level
* use grid display for ui yaml toggle button
* use spread instead of setting array index directly
* add intl in missing places
* pull connector manifest schema in through separate openapi spec
* use correct intl string id
* throttle setting json manifest in yaml editor
* use button prop instead of manually styling
* consolidate AddStreamButton styles
* fix sidebar flex styles
* use specific flex properties instead of flex
* clean up download and reset button styles
* use row-reverse for yaml editor download button
* fix stream selector styles to remove margins
* give connector setup guide panel same corner and shadow styles
* remove blur from page display
* set view to stream when selected in test panel
* add placeholder when stream name is empty
* switch to index-based stream selection to preserve testing panel selected stream on rename
* handle empty name in stream selector
* make connector form work in connector builder
* wip
* fix small stuff
* add basic input UI
* user inputs
* make most of inputs configuration work
* fix a bunch of stuff
* handle unknown config types
* add warning label
* fix label
* fix some styling
* review comments
* improve state management and error handling
* allow auth configuration
* check for conflicts with the inferred inputs
* fix invisible inputs
* handle stored form values that don't contain new fields properly
* session token and oauth authentication
* fill in session token variable
* fix merge of default values
* add primaryKey and cursorField to builder types, and consolidate default valeues to types.ts
* add cursor and primary key fields to ui
* save
* add page size and token option inputs
* fixes after rebase
* add pagination
* fix pagination types
* handle empty field_name better
* Update airbyte-webapp/src/locales/en.json
Co-authored-by: Lake Mossman <lake@airbyte.io>
* Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx
Co-authored-by: Lake Mossman <lake@airbyte.io>
* inputs editing weirdness
* input form reset
* using the Label component
* reduce redundancy and hide advanced input options for inferred inputs
* unnecessary validation
* typo
* unnecessary effect hook
* build spec even for invalid forms but do not update stream list
* typos
* make sure validation error does not go away
* make primary key and cursor optional, and reorder
* save toggle group progress
* fix style of toggle label
* handle empty values better
* fix page size/token option field validation and rendering
* handle cursor pagination page size option correctly
* save stream slicer progress
* finish stream slicer
* fix stream slicer fields and validation
Co-authored-by: Joe Reuter <joe@airbyte.io>
* debounce form builder values update to reduce load
* 🪟🔧 Connector builder: use new lowcode manifest (#20715)
* use new manifest yaml
* Update airbyte-webapp/src/components/connectorBuilder/types.ts
Co-authored-by: Lake Mossman <lake@airbyte.io>
* use updated manifest types
Co-authored-by: Lake Mossman <lake@airbyte.io>
* add manual schema
* make buttons not submit the form accidentally
* debounce validation as well
* akways show stream test button in error state if there are errors
* fix type of oauth input
* add validation schema for add stream form
* validate all views on test click
* add type to prevent console warning
* improve error indicator
* make schema editor take up full height (#21000)
* prevent resizing card when error message is shown or hidden
* Revert "improve error indicator"
This reverts commit abb9c0ba96a1f795964261289b16b6f21f06871e.
Co-authored-by: Tim Roes <tim@airbyte.io>
Co-authored-by: lmossman <lake@airbyte.io>
* 🪟🎨 Connector builder: Always show inputs button (#20817)
Always show inputs button in connector builder UI
* Source Salesforce: remove ActivityMetric stream (#20886)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
* Source google ads: retry transient errors (#20855)
Co-authored-by: Baz <oleksandr.bazarnov@globallogic.com>
* connector-templates: fix typo in `acceptance-test-config.yml.hbs` (#21056)
* Utilize React-Lazy for Code Splitting (#20605)
* Top level lazy loading
* Lazyloading for Datepicker
* Cleanup export
* Better datepicker lazy loading
* Sources routes lazy loaded
* More connection page optimization
* Cloud pass
* Joseph code review
* Source Facebook Marketing: Remove extra properties (#21057)
* Source Facebook Marketing: Remove extra properties
* Source Facebook Marketing: Docs update
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Common Jsons: add flag to apply flatten to arrays (#20993)
* add flag to apply flatten to arrays
* add additional unit test cases for array flattening
* add backward compatibility function
* bump dest-redshift version and add changelog
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Adam Bloom <adam-bloom@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Davin Chia <davinchia@gmail.com>
* Source CoinAPI - add quote stream to coin api (#20600)
* feat: add quote stream to coin api
* fix: restore configured_catalog.json
* docs: updated changelog with quotes stream
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Source AlphaVantage - add quote stream to alpha-v…
jbfbell
added a commit
that referenced
this pull request
Jan 23, 2023
* refactor checks * Add Auth Error Checks * rebase from master * some weird versioning issue * 🪟🎉 Connector builder: Substream slicer and cartesian slicer (#20861) * improve some types * improve further * clean up a bit more * refactor loading state * move loading state up * remove isLoading references * remove unused props and make fetch connector error work * remove special component for name * remove top level state for unifinished flows * start removing uiwidget * Update airbyte-webapp/src/views/Connector/ConnectorCard/ConnectorCard.module.scss Co-authored-by: Tim Roes <tim@airbyte.io> * remove undefined option for selected id * remove unused prop * fix types * remove uiwidget state * clean up * adjust comment * handle errors in a nice way * do not respect default on oneOf fields * rename to formblock * reduce re-renders * pass error to secure inputs * simplify and improve styling * align top * code review * remove comment * review comments * rename file * be strict about boolean values * add example * track form error in error boundary * review comments * handle unexpected cases better * enrich error with connector id * 🪟🎉 Add copy stream button (#20577) * add copy stream button * review comments * rename prop * 🪟🎉 Connector builder: Integrate connector form for test input (#20385) * move connector builder components into the same shared components/connectorBuilder directory * move diff over from poc branch * save current progress * add modal for adding streams * focus stream after adding and reset button style * add reset confirm modal and select view on add * style global config and streams buttons * styling improvements * handle long stream names better * pull in connector manifest schema directly * add box shadows to resizable panels * upgrade orval and use connector manifest schema directly * remove airbyte protocol from connector builder api spec * generate python models from openapi change * fix position of yaml toggle * handle no stream case with better looking message * group global fields into single object and fix console error * confirmation modal on toggling dirty form + cleanup * fix connector name display * undo change to manifest schema * remove commented code * remove unnecessary change * fix spacing * use shadow mixin for connector img * add comment about connector img * change onSubmit to no-op * remove console log * clean up styling * simplify sidebar to remove StreamSelectButton component * swap colors of toggle * move FormikPatch to src/core/form * move types up to connectorBuilder/ level * use grid display for ui yaml toggle button * use spread instead of setting array index directly * add intl in missing places * pull connector manifest schema in through separate openapi spec * use correct intl string id * throttle setting json manifest in yaml editor * use button prop instead of manually styling * consolidate AddStreamButton styles * fix sidebar flex styles * use specific flex properties instead of flex * clean up download and reset button styles * use row-reverse for yaml editor download button * fix stream selector styles to remove margins * give connector setup guide panel same corner and shadow styles * remove blur from page display * set view to stream when selected in test panel * add placeholder when stream name is empty * switch to index-based stream selection to preserve testing panel selected stream on rename * handle empty name in stream selector * make connector form work in connector builder * fix small stuff * add warning label * review comments * adjust translation Co-authored-by: lmossman <lake@airbyte.io> * use request_body_json instead of request_body_data * :window: :art: Move `Add` button into the line of Connector Builder key value list fields (#20699) * move add button into line * add stories for empty with control, and content + control * change button name to Control * 🪟🎉 Connector builder: Allow defining inputs (#20431) * move connector builder components into the same shared components/connectorBuilder directory * move diff over from poc branch * save current progress * add modal for adding streams * focus stream after adding and reset button style * add reset confirm modal and select view on add * style global config and streams buttons * styling improvements * handle long stream names better * pull in connector manifest schema directly * add box shadows to resizable panels * upgrade orval and use connector manifest schema directly * remove airbyte protocol from connector builder api spec * generate python models from openapi change * fix position of yaml toggle * handle no stream case with better looking message * group global fields into single object and fix console error * confirmation modal on toggling dirty form + cleanup * fix connector name display * undo change to manifest schema * remove commented code * remove unnecessary change * fix spacing * use shadow mixin for connector img * add comment about connector img * change onSubmit to no-op * remove console log * clean up styling * simplify sidebar to remove StreamSelectButton component * swap colors of toggle * move FormikPatch to src/core/form * move types up to connectorBuilder/ level * use grid display for ui yaml toggle button * use spread instead of setting array index directly * add intl in missing places * pull connector manifest schema in through separate openapi spec * use correct intl string id * throttle setting json manifest in yaml editor * use button prop instead of manually styling * consolidate AddStreamButton styles * fix sidebar flex styles * use specific flex properties instead of flex * clean up download and reset button styles * use row-reverse for yaml editor download button * fix stream selector styles to remove margins * give connector setup guide panel same corner and shadow styles * remove blur from page display * set view to stream when selected in test panel * add placeholder when stream name is empty * switch to index-based stream selection to preserve testing panel selected stream on rename * handle empty name in stream selector * make connector form work in connector builder * wip * fix small stuff * add basic input UI * user inputs * make most of inputs configuration work * fix a bunch of stuff * handle unknown config types * add warning label * fix label * fix some styling * review comments * improve state management and error handling * handle stored form values that don't contain new fields properly * Update airbyte-webapp/src/locales/en.json Co-authored-by: Lake Mossman <lake@airbyte.io> * Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx Co-authored-by: Lake Mossman <lake@airbyte.io> * inputs editing weirdness * input form reset * using the Label component * 🪟🎉 Connector builder authentication (#20645) * allow auth configuration * check for conflicts with the inferred inputs * fix invisible inputs * reduce redundancy and hide advanced input options for inferred inputs * unnecessary validation * typo * unnecessary effect hook * build spec even for invalid forms but do not update stream list * fix keys * 🪟🎉 Connector builder: Session token and oauth authentication (#20712) * session token and oauth authentication * fill in session token variable * typos * make sure validation error does not go away * 🪟🎉 Connector builder: Always validate inputs form (#20664) * validate user input outside of form * review comments Co-authored-by: lmossman <lake@airbyte.io> Co-authored-by: lmossman <lake@airbyte.io> * fix merge conflict with dropdown prop being renamed to control * [Connector Builder] Add paginator (#20698) * move connector builder components into the same shared components/connectorBuilder directory * move diff over from poc branch * save current progress * add modal for adding streams * focus stream after adding and reset button style * add reset confirm modal and select view on add * style global config and streams buttons * styling improvements * handle long stream names better * pull in connector manifest schema directly * add box shadows to resizable panels * upgrade orval and use connector manifest schema directly * remove airbyte protocol from connector builder api spec * generate python models from openapi change * fix position of yaml toggle * handle no stream case with better looking message * group global fields into single object and fix console error * confirmation modal on toggling dirty form + cleanup * fix connector name display * undo change to manifest schema * remove commented code * remove unnecessary change * fix spacing * use shadow mixin for connector img * add comment about connector img * change onSubmit to no-op * remove console log * clean up styling * simplify sidebar to remove StreamSelectButton component * swap colors of toggle * move FormikPatch to src/core/form * move types up to connectorBuilder/ level * use grid display for ui yaml toggle button * use spread instead of setting array index directly * add intl in missing places * pull connector manifest schema in through separate openapi spec * use correct intl string id * throttle setting json manifest in yaml editor * use button prop instead of manually styling * consolidate AddStreamButton styles * fix sidebar flex styles * use specific flex properties instead of flex * clean up download and reset button styles * use row-reverse for yaml editor download button * fix stream selector styles to remove margins * give connector setup guide panel same corner and shadow styles * remove blur from page display * set view to stream when selected in test panel * add placeholder when stream name is empty * switch to index-based stream selection to preserve testing panel selected stream on rename * handle empty name in stream selector * make connector form work in connector builder * wip * fix small stuff * add basic input UI * user inputs * make most of inputs configuration work * fix a bunch of stuff * handle unknown config types * add warning label * fix label * fix some styling * review comments * improve state management and error handling * allow auth configuration * check for conflicts with the inferred inputs * fix invisible inputs * handle stored form values that don't contain new fields properly * session token and oauth authentication * fill in session token variable * fix merge of default values * add primaryKey and cursorField to builder types, and consolidate default valeues to types.ts * add cursor and primary key fields to ui * save * add page size and token option inputs * fixes after rebase * add pagination * fix pagination types * handle empty field_name better * Update airbyte-webapp/src/locales/en.json Co-authored-by: Lake Mossman <lake@airbyte.io> * Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx Co-authored-by: Lake Mossman <lake@airbyte.io> * inputs editing weirdness * input form reset * using the Label component * reduce redundancy and hide advanced input options for inferred inputs * unnecessary validation * typo * unnecessary effect hook * build spec even for invalid forms but do not update stream list * typos * make sure validation error does not go away * make primary key and cursor optional, and reorder * save toggle group progress * fix style of toggle label * handle empty values better * fix page size/token option field validation and rendering * handle cursor pagination page size option correctly Co-authored-by: Joe Reuter <joe@airbyte.io> * [Connector Builder] Add stream slicer (#20748) * move connector builder components into the same shared components/connectorBuilder directory * move diff over from poc branch * save current progress * add modal for adding streams * focus stream after adding and reset button style * add reset confirm modal and select view on add * style global config and streams buttons * styling improvements * handle long stream names better * pull in connector manifest schema directly * add box shadows to resizable panels * upgrade orval and use connector manifest schema directly * remove airbyte protocol from connector builder api spec * generate python models from openapi change * fix position of yaml toggle * handle no stream case with better looking message * group global fields into single object and fix console error * confirmation modal on toggling dirty form + cleanup * fix connector name display * undo change to manifest schema * remove commented code * remove unnecessary change * fix spacing * use shadow mixin for connector img * add comment about connector img * change onSubmit to no-op * remove console log * clean up styling * simplify sidebar to remove StreamSelectButton component * swap colors of toggle * move FormikPatch to src/core/form * move types up to connectorBuilder/ level * use grid display for ui yaml toggle button * use spread instead of setting array index directly * add intl in missing places * pull connector manifest schema in through separate openapi spec * use correct intl string id * throttle setting json manifest in yaml editor * use button prop instead of manually styling * consolidate AddStreamButton styles * fix sidebar flex styles * use specific flex properties instead of flex * clean up download and reset button styles * use row-reverse for yaml editor download button * fix stream selector styles to remove margins * give connector setup guide panel same corner and shadow styles * remove blur from page display * set view to stream when selected in test panel * add placeholder when stream name is empty * switch to index-based stream selection to preserve testing panel selected stream on rename * handle empty name in stream selector * make connector form work in connector builder * wip * fix small stuff * add basic input UI * user inputs * make most of inputs configuration work * fix a bunch of stuff * handle unknown config types * add warning label * fix label * fix some styling * review comments * improve state management and error handling * allow auth configuration * check for conflicts with the inferred inputs * fix invisible inputs * handle stored form values that don't contain new fields properly * session token and oauth authentication * fill in session token variable * fix merge of default values * add primaryKey and cursorField to builder types, and consolidate default valeues to types.ts * add cursor and primary key fields to ui * save * add page size and token option inputs * fixes after rebase * add pagination * fix pagination types * handle empty field_name better * Update airbyte-webapp/src/locales/en.json Co-authored-by: Lake Mossman <lake@airbyte.io> * Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx Co-authored-by: Lake Mossman <lake@airbyte.io> * inputs editing weirdness * input form reset * using the Label component * reduce redundancy and hide advanced input options for inferred inputs * unnecessary validation * typo * unnecessary effect hook * build spec even for invalid forms but do not update stream list * typos * make sure validation error does not go away * make primary key and cursor optional, and reorder * save toggle group progress * fix style of toggle label * handle empty values better * fix page size/token option field validation and rendering * handle cursor pagination page size option correctly * save stream slicer progress * finish stream slicer * fix stream slicer fields and validation Co-authored-by: Joe Reuter <joe@airbyte.io> * debounce form builder values update to reduce load * 🪟🔧 Connector builder: use new lowcode manifest (#20715) * use new manifest yaml * Update airbyte-webapp/src/components/connectorBuilder/types.ts Co-authored-by: Lake Mossman <lake@airbyte.io> * use updated manifest types Co-authored-by: Lake Mossman <lake@airbyte.io> * add substream slicer * add substream and cartesian slicer * debounce validation as well * akways show stream test button in error state if there are errors * fix type of oauth input * add validation schema for add stream form * validate all views on test click * add type to prevent console warning * do not allow path for substream slicer request option * do not show request option for substream slicer * rewrite stream slice field tooltip Co-authored-by: Tim Roes <tim@airbyte.io> Co-authored-by: lmossman <lake@airbyte.io> * 🪟🔧 Connector builder: Performance improvements (#20620) * improve some types * improve further * clean up a bit more * refactor loading state * move loading state up * remove isLoading references * remove unused props and make fetch connector error work * remove special component for name * remove top level state for unifinished flows * start removing uiwidget * Update airbyte-webapp/src/views/Connector/ConnectorCard/ConnectorCard.module.scss Co-authored-by: Tim Roes <tim@airbyte.io> * remove undefined option for selected id * remove unused prop * fix types * remove uiwidget state * clean up * adjust comment * handle errors in a nice way * do not respect default on oneOf fields * rename to formblock * reduce re-renders * pass error to secure inputs * simplify and improve styling * align top * code review * remove comment * review comments * rename file * be strict about boolean values * add example * track form error in error boundary * review comments * handle unexpected cases better * speed up some bits * more changes * enrich error with connector id * 🪟🎉 Add copy stream button (#20577) * add copy stream button * review comments * rename prop * 🪟🎉 Connector builder: Integrate connector form for test input (#20385) * move connector builder components into the same shared components/connectorBuilder directory * move diff over from poc branch * save current progress * add modal for adding streams * focus stream after adding and reset button style * add reset confirm modal and select view on add * style global config and streams buttons * styling improvements * handle long stream names better * pull in connector manifest schema directly * add box shadows to resizable panels * upgrade orval and use connector manifest schema directly * remove airbyte protocol from connector builder api spec * generate python models from openapi change * fix position of yaml toggle * handle no stream case with better looking message * group global fields into single object and fix console error * confirmation modal on toggling dirty form + cleanup * fix connector name display * undo change to manifest schema * remove commented code * remove unnecessary change * fix spacing * use shadow mixin for connector img * add comment about connector img * change onSubmit to no-op * remove console log * clean up styling * simplify sidebar to remove StreamSelectButton component * swap colors of toggle * move FormikPatch to src/core/form * move types up to connectorBuilder/ level * use grid display for ui yaml toggle button * use spread instead of setting array index directly * add intl in missing places * pull connector manifest schema in through separate openapi spec * use correct intl string id * throttle setting json manifest in yaml editor * use button prop instead of manually styling * consolidate AddStreamButton styles * fix sidebar flex styles * use specific flex properties instead of flex * clean up download and reset button styles * use row-reverse for yaml editor download button * fix stream selector styles to remove margins * give connector setup guide panel same corner and shadow styles * remove blur from page display * set view to stream when selected in test panel * add placeholder when stream name is empty * switch to index-based stream selection to preserve testing panel selected stream on rename * handle empty name in stream selector * make connector form work in connector builder * fix small stuff * add warning label * review comments * adjust translation Co-authored-by: lmossman <lake@airbyte.io> * use request_body_json instead of request_body_data * :window: :art: Move `Add` button into the line of Connector Builder key value list fields (#20699) * move add button into line * add stories for empty with control, and content + control * change button name to Control * 🪟🎉 Connector builder: Allow defining inputs (#20431) * move connector builder components into the same shared components/connectorBuilder directory * move diff over from poc branch * save current progress * add modal for adding streams * focus stream after adding and reset button style * add reset confirm modal and select view on add * style global config and streams buttons * styling improvements * handle long stream names better * pull in connector manifest schema directly * add box shadows to resizable panels * upgrade orval and use connector manifest schema directly * remove airbyte protocol from connector builder api spec * generate python models from openapi change * fix position of yaml toggle * handle no stream case with better looking message * group global fields into single object and fix console error * confirmation modal on toggling dirty form + cleanup * fix connector name display * undo change to manifest schema * remove commented code * remove unnecessary change * fix spacing * use shadow mixin for connector img * add comment about connector img * change onSubmit to no-op * remove console log * clean up styling * simplify sidebar to remove StreamSelectButton component * swap colors of toggle * move FormikPatch to src/core/form * move types up to connectorBuilder/ level * use grid display for ui yaml toggle button * use spread instead of setting array index directly * add intl in missing places * pull connector manifest schema in through separate openapi spec * use correct intl string id * throttle setting json manifest in yaml editor * use button prop instead of manually styling * consolidate AddStreamButton styles * fix sidebar flex styles * use specific flex properties instead of flex * clean up download and reset button styles * use row-reverse for yaml editor download button * fix stream selector styles to remove margins * give connector setup guide panel same corner and shadow styles * remove blur from page display * set view to stream when selected in test panel * add placeholder when stream name is empty * switch to index-based stream selection to preserve testing panel selected stream on rename * handle empty name in stream selector * make connector form work in connector builder * wip * fix small stuff * add basic input UI * user inputs * make most of inputs configuration work * fix a bunch of stuff * handle unknown config types * add warning label * fix label * fix some styling * review comments * improve state management and error handling * handle stored form values that don't contain new fields properly * Update airbyte-webapp/src/locales/en.json Co-authored-by: Lake Mossman <lake@airbyte.io> * Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx Co-authored-by: Lake Mossman <lake@airbyte.io> * inputs editing weirdness * input form reset * using the Label component * 🪟🎉 Connector builder authentication (#20645) * allow auth configuration * check for conflicts with the inferred inputs * fix invisible inputs * reduce redundancy and hide advanced input options for inferred inputs * unnecessary validation * typo * unnecessary effect hook * build spec even for invalid forms but do not update stream list * fix keys * 🪟🎉 Connector builder: Session token and oauth authentication (#20712) * session token and oauth authentication * fill in session token variable * typos * make sure validation error does not go away * 🪟🎉 Connector builder: Always validate inputs form (#20664) * validate user input outside of form * review comments Co-authored-by: lmossman <lake@airbyte.io> Co-authored-by: lmossman <lake@airbyte.io> * fix merge conflict with dropdown prop being renamed to control * [Connector Builder] Add paginator (#20698) * move connector builder components into the same shared components/connectorBuilder directory * move diff over from poc branch * save current progress * add modal for adding streams * focus stream after adding and reset button style * add reset confirm modal and select view on add * style global config and streams buttons * styling improvements * handle long stream names better * pull in connector manifest schema directly * add box shadows to resizable panels * upgrade orval and use connector manifest schema directly * remove airbyte protocol from connector builder api spec * generate python models from openapi change * fix position of yaml toggle * handle no stream case with better looking message * group global fields into single object and fix console error * confirmation modal on toggling dirty form + cleanup * fix connector name display * undo change to manifest schema * remove commented code * remove unnecessary change * fix spacing * use shadow mixin for connector img * add comment about connector img * change onSubmit to no-op * remove console log * clean up styling * simplify sidebar to remove StreamSelectButton component * swap colors of toggle * move FormikPatch to src/core/form * move types up to connectorBuilder/ level * use grid display for ui yaml toggle button * use spread instead of setting array index directly * add intl in missing places * pull connector manifest schema in through separate openapi spec * use correct intl string id * throttle setting json manifest in yaml editor * use button prop instead of manually styling * consolidate AddStreamButton styles * fix sidebar flex styles * use specific flex properties instead of flex * clean up download and reset button styles * use row-reverse for yaml editor download button * fix stream selector styles to remove margins * give connector setup guide panel same corner and shadow styles * remove blur from page display * set view to stream when selected in test panel * add placeholder when stream name is empty * switch to index-based stream selection to preserve testing panel selected stream on rename * handle empty name in stream selector * make connector form work in connector builder * wip * fix small stuff * add basic input UI * user inputs * make most of inputs configuration work * fix a bunch of stuff * handle unknown config types * add warning label * fix label * fix some styling * review comments * improve state management and error handling * allow auth configuration * check for conflicts with the inferred inputs * fix invisible inputs * handle stored form values that don't contain new fields properly * session token and oauth authentication * fill in session token variable * fix merge of default values * add primaryKey and cursorField to builder types, and consolidate default valeues to types.ts * add cursor and primary key fields to ui * save * add page size and token option inputs * fixes after rebase * add pagination * fix pagination types * handle empty field_name better * Update airbyte-webapp/src/locales/en.json Co-authored-by: Lake Mossman <lake@airbyte.io> * Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx Co-authored-by: Lake Mossman <lake@airbyte.io> * inputs editing weirdness * input form reset * using the Label component * reduce redundancy and hide advanced input options for inferred inputs * unnecessary validation * typo * unnecessary effect hook * build spec even for invalid forms but do not update stream list * typos * make sure validation error does not go away * make primary key and cursor optional, and reorder * save toggle group progress * fix style of toggle label * handle empty values better * fix page size/token option field validation and rendering * handle cursor pagination page size option correctly Co-authored-by: Joe Reuter <joe@airbyte.io> * [Connector Builder] Add stream slicer (#20748) * move connector builder components into the same shared components/connectorBuilder directory * move diff over from poc branch * save current progress * add modal for adding streams * focus stream after adding and reset button style * add reset confirm modal and select view on add * style global config and streams buttons * styling improvements * handle long stream names better * pull in connector manifest schema directly * add box shadows to resizable panels * upgrade orval and use connector manifest schema directly * remove airbyte protocol from connector builder api spec * generate python models from openapi change * fix position of yaml toggle * handle no stream case with better looking message * group global fields into single object and fix console error * confirmation modal on toggling dirty form + cleanup * fix connector name display * undo change to manifest schema * remove commented code * remove unnecessary change * fix spacing * use shadow mixin for connector img * add comment about connector img * change onSubmit to no-op * remove console log * clean up styling * simplify sidebar to remove StreamSelectButton component * swap colors of toggle * move FormikPatch to src/core/form * move types up to connectorBuilder/ level * use grid display for ui yaml toggle button * use spread instead of setting array index directly * add intl in missing places * pull connector manifest schema in through separate openapi spec * use correct intl string id * throttle setting json manifest in yaml editor * use button prop instead of manually styling * consolidate AddStreamButton styles * fix sidebar flex styles * use specific flex properties instead of flex * clean up download and reset button styles * use row-reverse for yaml editor download button * fix stream selector styles to remove margins * give connector setup guide panel same corner and shadow styles * remove blur from page display * set view to stream when selected in test panel * add placeholder when stream name is empty * switch to index-based stream selection to preserve testing panel selected stream on rename * handle empty name in stream selector * make connector form work in connector builder * wip * fix small stuff * add basic input UI * user inputs * make most of inputs configuration work * fix a bunch of stuff * handle unknown config types * add warning label * fix label * fix some styling * review comments * improve state management and error handling * allow auth configuration * check for conflicts with the inferred inputs * fix invisible inputs * handle stored form values that don't contain new fields properly * session token and oauth authentication * fill in session token variable * fix merge of default values * add primaryKey and cursorField to builder types, and consolidate default valeues to types.ts * add cursor and primary key fields to ui * save * add page size and token option inputs * fixes after rebase * add pagination * fix pagination types * handle empty field_name better * Update airbyte-webapp/src/locales/en.json Co-authored-by: Lake Mossman <lake@airbyte.io> * Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx Co-authored-by: Lake Mossman <lake@airbyte.io> * inputs editing weirdness * input form reset * using the Label component * reduce redundancy and hide advanced input options for inferred inputs * unnecessary validation * typo * unnecessary effect hook * build spec even for invalid forms but do not update stream list * typos * make sure validation error does not go away * make primary key and cursor optional, and reorder * save toggle group progress * fix style of toggle label * handle empty values better * fix page size/token option field validation and rendering * handle cursor pagination page size option correctly * save stream slicer progress * finish stream slicer * fix stream slicer fields and validation Co-authored-by: Joe Reuter <joe@airbyte.io> * debounce form builder values update to reduce load * 🪟🔧 Connector builder: use new lowcode manifest (#20715) * use new manifest yaml * Update airbyte-webapp/src/components/connectorBuilder/types.ts Co-authored-by: Lake Mossman <lake@airbyte.io> * use updated manifest types Co-authored-by: Lake Mossman <lake@airbyte.io> * debounce validation as well * akways show stream test button in error state if there are errors * fix type of oauth input * review comments * fix more * add validation schema for add stream form * validate all views on test click * add type to prevent console warning * review comment * make sure testing state and form state stay consistent * improve builder errors * remove test state from streamconfig view * remove console log * remove unnecessary positive index check Co-authored-by: Tim Roes <tim@airbyte.io> Co-authored-by: lmossman <lake@airbyte.io> * Remove workspace helper from fetchConfigActivity (#21048) * Remove workspace helper and replace with workspaceApi * Publish new version of destination-redshift (#21083) * Update changelog * auto-bump connector version Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com> * Progress Bar Read APIs (#20937) Follow up PR to #20787 . Make stats available to the read apis so these are available to the webapp. After this, all that is left is writing these stats as the job progresses. Add the required logic in JobHistoryHandler.java. Took the chance to also rename our internal Attempt models field from id to attemptNumber to better reflect that the field stores not the row's database id, but the job's attempt number. Most of the files changes here are due to that rename. * Rm temporal version (#21045) * Rm temporal version * Remove temporal version * Update the replayed workflow * Format * Fix pmd * 🪟🎉 Connector builder: Available inputs dropdown (#20983) * improve some types * improve further * clean up a bit more * refactor loading state * move loading state up * remove isLoading references * remove unused props and make fetch connector error work * remove special component for name * remove top level state for unifinished flows * start removing uiwidget * Update airbyte-webapp/src/views/Connector/ConnectorCard/ConnectorCard.module.scss Co-authored-by: Tim Roes <tim@airbyte.io> * remove undefined option for selected id * remove unused prop * fix types * remove uiwidget state * clean up * adjust comment * handle errors in a nice way * do not respect default on oneOf fields * rename to formblock * reduce re-renders * pass error to secure inputs * simplify and improve styling * align top * code review * remove comment * review comments * rename file * be strict about boolean values * add example * track form error in error boundary * review comments * handle unexpected cases better * enrich error with connector id * 🪟🎉 Add copy stream button (#20577) * add copy stream button * review comments * rename prop * 🪟🎉 Connector builder: Integrate connector form for test input (#20385) * move connector builder components into the same shared components/connectorBuilder directory * move diff over from poc branch * save current progress * add modal for adding streams * focus stream after adding and reset button style * add reset confirm modal and select view on add * style global config and streams buttons * styling improvements * handle long stream names better * pull in connector manifest schema directly * add box shadows to resizable panels * upgrade orval and use connector manifest schema directly * remove airbyte protocol from connector builder api spec * generate python models from openapi change * fix position of yaml toggle * handle no stream case with better looking message * group global fields into single object and fix console error * confirmation modal on toggling dirty form + cleanup * fix connector name display * undo change to manifest schema * remove commented code * remove unnecessary change * fix spacing * use shadow mixin for connector img * add comment about connector img * change onSubmit to no-op * remove console log * clean up styling * simplify sidebar to remove StreamSelectButton component * swap colors of toggle * move FormikPatch to src/core/form * move types up to connectorBuilder/ level * use grid display for ui yaml toggle button * use spread instead of setting array index directly * add intl in missing places * pull connector manifest schema in through separate openapi spec * use correct intl string id * throttle setting json manifest in yaml editor * use button prop instead of manually styling * consolidate AddStreamButton styles * fix sidebar flex styles * use specific flex properties instead of flex * clean up download and reset button styles * use row-reverse for yaml editor download button * fix stream selector styles to remove margins * give connector setup guide panel same corner and shadow styles * remove blur from page display * set view to stream when selected in test panel * add placeholder when stream name is empty * switch to index-based stream selection to preserve testing panel selected stream on rename * handle empty name in stream selector * make connector form work in connector builder * fix small stuff * add warning label * review comments * adjust translation Co-authored-by: lmossman <lake@airbyte.io> * use request_body_json instead of request_body_data * :window: :art: Move `Add` button into the line of Connector Builder key value list fields (#20699) * move add button into line * add stories for empty with control, and content + control * change button name to Control * 🪟🎉 Connector builder: Allow defining inputs (#20431) * move connector builder components into the same shared components/connectorBuilder directory * move diff over from poc branch * save current progress * add modal for adding streams * focus stream after adding and reset button style * add reset confirm modal and select view on add * style global config and streams buttons * styling improvements * handle long stream names better * pull in connector manifest schema directly * add box shadows to resizable panels * upgrade orval and use connector manifest schema directly * remove airbyte protocol from connector builder api spec * generate python models from openapi change * fix position of yaml toggle * handle no stream case with better looking message * group global fields into single object and fix console error * confirmation modal on toggling dirty form + cleanup * fix connector name display * undo change to manifest schema * remove commented code * remove unnecessary change * fix spacing * use shadow mixin for connector img * add comment about connector img * change onSubmit to no-op * remove console log * clean up styling * simplify sidebar to remove StreamSelectButton component * swap colors of toggle * move FormikPatch to src/core/form * move types up to connectorBuilder/ level * use grid display for ui yaml toggle button * use spread instead of setting array index directly * add intl in missing places * pull connector manifest schema in through separate openapi spec * use correct intl string id * throttle setting json manifest in yaml editor * use button prop instead of manually styling * consolidate AddStreamButton styles * fix sidebar flex styles * use specific flex properties instead of flex * clean up download and reset button styles * use row-reverse for yaml editor download button * fix stream selector styles to remove margins * give connector setup guide panel same corner and shadow styles * remove blur from page display * set view to stream when selected in test panel * add placeholder when stream name is empty * switch to index-based stream selection to preserve testing panel selected stream on rename * handle empty name in stream selector * make connector form work in connector builder * wip * fix small stuff * add basic input UI * user inputs * make most of inputs configuration work * fix a bunch of stuff * handle unknown config types * add warning label * fix label * fix some styling * review comments * improve state management and error handling * handle stored form values that don't contain new fields properly * Update airbyte-webapp/src/locales/en.json Co-authored-by: Lake Mossman <lake@airbyte.io> * Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx Co-authored-by: Lake Mossman <lake@airbyte.io> * inputs editing weirdness * input form reset * using the Label component * 🪟🎉 Connector builder authentication (#20645) * allow auth configuration * check for conflicts with the inferred inputs * fix invisible inputs * reduce redundancy and hide advanced input options for inferred inputs * unnecessary validation * typo * unnecessary effect hook * build spec even for invalid forms but do not update stream list * fix keys * 🪟🎉 Connector builder: Session token and oauth authentication (#20712) * session token and oauth authentication * fill in session token variable * typos * make sure validation error does not go away * 🪟🎉 Connector builder: Always validate inputs form (#20664) * validate user input outside of form * review comments Co-authored-by: lmossman <lake@airbyte.io> Co-authored-by: lmossman <lake@airbyte.io> * fix merge conflict with dropdown prop being renamed to control * [Connector Builder] Add paginator (#20698) * move connector builder components into the same shared components/connectorBuilder directory * move diff over from poc branch * save current progress * add modal for adding streams * focus stream after adding and reset button style * add reset confirm modal and select view on add * style global config and streams buttons * styling improvements * handle long stream names better * pull in connector manifest schema directly * add box shadows to resizable panels * upgrade orval and use connector manifest schema directly * remove airbyte protocol from connector builder api spec * generate python models from openapi change * fix position of yaml toggle * handle no stream case with better looking message * group global fields into single object and fix console error * confirmation modal on toggling dirty form + cleanup * fix connector name display * undo change to manifest schema * remove commented code * remove unnecessary change * fix spacing * use shadow mixin for connector img * add comment about connector img * change onSubmit to no-op * remove console log * clean up styling * simplify sidebar to remove StreamSelectButton component * swap colors of toggle * move FormikPatch to src/core/form * move types up to connectorBuilder/ level * use grid display for ui yaml toggle button * use spread instead of setting array index directly * add intl in missing places * pull connector manifest schema in through separate openapi spec * use correct intl string id * throttle setting json manifest in yaml editor * use button prop instead of manually styling * consolidate AddStreamButton styles * fix sidebar flex styles * use specific flex properties instead of flex * clean up download and reset button styles * use row-reverse for yaml editor download button * fix stream selector styles to remove margins * give connector setup guide panel same corner and shadow styles * remove blur from page display * set view to stream when selected in test panel * add placeholder when stream name is empty * switch to index-based stream selection to preserve testing panel selected stream on rename * handle empty name in stream selector * make connector form work in connector builder * wip * fix small stuff * add basic input UI * user inputs * make most of inputs configuration work * fix a bunch of stuff * handle unknown config types * add warning label * fix label * fix some styling * review comments * improve state management and error handling * allow auth configuration * check for conflicts with the inferred inputs * fix invisible inputs * handle stored form values that don't contain new fields properly * session token and oauth authentication * fill in session token variable * fix merge of default values * add primaryKey and cursorField to builder types, and consolidate default valeues to types.ts * add cursor and primary key fields to ui * save * add page size and token option inputs * fixes after rebase * add pagination * fix pagination types * handle empty field_name better * Update airbyte-webapp/src/locales/en.json Co-authored-by: Lake Mossman <lake@airbyte.io> * Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx Co-authored-by: Lake Mossman <lake@airbyte.io> * inputs editing weirdness * input form reset * using the Label component * reduce redundancy and hide advanced input options for inferred inputs * unnecessary validation * typo * unnecessary effect hook * build spec even for invalid forms but do not update stream list * typos * make sure validation error does not go away * make primary key and cursor optional, and reorder * save toggle group progress * fix style of toggle label * handle empty values better * fix page size/token option field validation and rendering * handle cursor pagination page size option correctly Co-authored-by: Joe Reuter <joe@airbyte.io> * [Connector Builder] Add stream slicer (#20748) * move connector builder components into the same shared components/connectorBuilder directory * move diff over from poc branch * save current progress * add modal for adding streams * focus stream after adding and reset button style * add reset confirm modal and select view on add * style global config and streams buttons * styling improvements * handle long stream names better * pull in connector manifest schema directly * add box shadows to resizable panels * upgrade orval and use connector manifest schema directly * remove airbyte protocol from connector builder api spec * generate python models from openapi change * fix position of yaml toggle * handle no stream case with better looking message * group global fields into single object and fix console error * confirmation modal on toggling dirty form + cleanup * fix connector name display * undo change to manifest schema * remove commented code * remove unnecessary change * fix spacing * use shadow mixin for connector img * add comment about connector img * change onSubmit to no-op * remove console log * clean up styling * simplify sidebar to remove StreamSelectButton component * swap colors of toggle * move FormikPatch to src/core/form * move types up to connectorBuilder/ level * use grid display for ui yaml toggle button * use spread instead of setting array index directly * add intl in missing places * pull connector manifest schema in through separate openapi spec * use correct intl string id * throttle setting json manifest in yaml editor * use button prop instead of manually styling * consolidate AddStreamButton styles * fix sidebar flex styles * use specific flex properties instead of flex * clean up download and reset button styles * use row-reverse for yaml editor download button * fix stream selector styles to remove margins * give connector setup guide panel same corner and shadow styles * remove blur from page display * set view to stream when selected in test panel * add placeholder when stream name is empty * switch to index-based stream selection to preserve testing panel selected stream on rename * handle empty name in stream selector * make connector form work in connector builder * wip * fix small stuff * add basic input UI * user inputs * make most of inputs configuration work * fix a bunch of stuff * handle unknown config types * add warning label * fix label * fix some styling * review comments * improve state management and error handling * allow auth configuration * check for conflicts with the inferred inputs * fix invisible inputs * handle stored form values that don't contain new fields properly * session token and oauth authentication * fill in session token variable * fix merge of default values * add primaryKey and cursorField to builder types, and consolidate default valeues to types.ts * add cursor and primary key fields to ui * save * add page size and token option inputs * fixes after rebase * add pagination * fix pagination types * handle empty field_name better * Update airbyte-webapp/src/locales/en.json Co-authored-by: Lake Mossman <lake@airbyte.io> * Update airbyte-webapp/src/components/connectorBuilder/Builder/InputsView.tsx Co-authored-by: Lake Mossman <lake@airbyte.io> * inputs editing weirdness * input form reset * using the Label component * reduce redundancy and hide advanced input options for inferred inputs * unnecessary validation * typo * unnecessary effect hook * build spec even for invalid forms but do not update stream list * typos * make sure validation error does not go away * make primary key and cursor optional, and reorder * save toggle group progress * fix style of toggle label * handle empty values better * fix page size/token option field validation and rendering * handle cursor pagination page size option correctly * save stream slicer progress * finish stream slicer * fix stream slicer fields and validation Co-authored-by: Joe Reuter <joe@airbyte.io> * debounce form builder values update to reduce load * 🪟🔧 Connector builder: use new lowcode manifest (#20715) * use new manifest yaml * Update airbyte-webapp/src/components/connectorBuilder/types.ts Co-authored-by: Lake Mossman <lake@airbyte.io> * use updated manifest types Co-authored-by: Lake Mossman <lake@airbyte.io> * debounce validation as well * akways show stream test button in error state if there are errors * fix type of oauth input * available inputs dropdown * add validation schema for add stream form * validate all views on test click * add type to prevent console warning * improve styling * make sure padding is set correctly * make sure focus is set right * comment * use correct state hook * add tooltip to user input button and fix wording for new user input option Co-authored-by: Tim Roes <tim@airbyte.io> Co-authored-by: lmossman <lake@airbyte.io> * Fixed appstore docs link (#21098) * fill in all default values on switch (#21059) * 🐛Source Freshdesk: Fix schema types (#20416) * Fix schema types * Updated version * Updated acceptance tests * auto-bump connector version Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com> * CDK: Add schema inferrer class (#20941) * fix stuff * Update schema_inferrer.py * Update schema_inferrer.py * bump version * review comments * code style * fix formatting * improve tests * Source Facebook Marketing: Docs update (#21105) * Source Amazon Ads: fix bug with handling: "Report date is too far in the past." (partial revert of #20662) (#21082) * Revert "Source Amazon Ads: fix bug with handling: "Report date is too far in the past." (#20662)" This reverts commit ec995959f7af3574cd7a6a5e63d2c2aaf3118183. * fix Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * revert master Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * revert to master Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * bump 0.1.27 Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * fix Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * amazon-ads.md updated Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * amazon-ads.md updated Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> * auto-bump connector version Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com> Co-authored-by: Augustin <augustin@airbyte.io> Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com> Co-authored-by: Topher Lubaway <asimplechris@gmail.com> * Revert "Progress Bar Read APIs (#20937)" (#21115) Breaks when there is no config present https://github.com/airbytehq/airbyte/issues/21112 This reverts commit 3a2b0405c425562ba5fa8bfe3f5a4646c165591a. * Remove unneeded margin top and bottom (#21111) * feat(Platform): update actor configuration when receiving control messages from connectors during sync (#19811) * track latest config message * pass new config as part of outputs * persist new config * persist config as the messages come through, dont set output * clean up old implementation * accept control messages for destinations * get api client from micronaut * mask instance-wide oauth params when updating configs * defaultreplicationworker tests * formatting * tests for source/destination handlers * rm todo * refactor test a bit to fix pmd * fix pmd * fix test * add PersistConfigHelperTest * update message tracker comment * fix pmd * format * move ApiClientBeanFactory to commons-worker, use in container-orchestrator * pull out config updating to separate methods * add jitter * rename PersistConfigHelper -> UpdateConnectorConfigHelper, docs * fix exception type * fmt * move message type check into runnable * formatting * pass api client env vars to container orchestrator * pass micronaut envs to container orchestrator * print stacktrace for debugging * different api host for container orchestrator * fix default env var * format * fix errors after merge * set source and destination actor id as part of the sync input * fix: get destination definition * fix null ptr * remove "actor" from naming * fix missing change from rename * revert ContainerOrchestratorConfigBeanFactory changes * inject sourceapi/destinationapi directly rather than airbyteapiclient * UpdateConnectorConfigHelper -> ConnectorConfigUpdater * rm log * fix test * dont fail on config update error * pass id, not full config to runnables/accept control message * add new config required for api client * add test file * fix test compatibility * mount data plane credentials secret to container orchestrator (#20724) * mount data plane credentials secret to container orchestrator * rm copy-pasta * properly handle empty strings * set env vars like before * use the right config vars * 🐛Source Looker: Fix schema transformation issue (#20182) * Fix schema transformation issue * Updated PR number * Added unittest * Add a test case that uses the recursion * Unhide from cloud * Bumed seed version * [ISSUE #20322] add datetime_granularity logic to DatetimeStreamSlicer… (#20717) * [ISSUE #20322] add datetime_granularity logic to DatetimeStreamSlicer and migrate duration to ISO8601 * [ISSUE #20322] fix tests * [ISSUE #20322] code review based on clnoll's comments and fixed tests * [ISSUE #20322] fix flake8 error * [ISSUE #20322] fix source tests * [ISSUE #20322] fixing yet another error in source * [ISSUE #20322] code review * [ISSUE #20322] adding new sources using datetime slicer * [ISSUE #20322] fixing source-datascope and increasing version * [ISSUE #20322] regenerate component schema * [ISSUE #20322] fixing source-datascope * [ISSUE #20322] extra field error * Source Slack: update schema; data from openapi spec (#20767) * Source Slack: update schema; data from openapi spec * Source Slack: Docs update * Source Slack: Update schema * Source Slack: Update schema (timestamp returned in POSIX time) * Source Slack: Disable backward compatibility test for discovery * auto-bump connector version Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com> * make sure name is rendered in first position (#21101) * Source Github: Raise Error if no organizations or repos are available (#21084) * Source Github: Raise Error if no organizations or repos are available * Source GitHub: Update docs; bump version * Source GitHub: Add test * Source GitHub: Exclude empty streams * auto-bump connector version Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com> * Convert the server to micronaut (#19194) * Extract Operation API * Extract scheduler API * Format * extract source api * Extract source definition api * Add path * Extract State API * extract webbackend api * extract webbackend api * extract workspace api * Extract source definition specification api * Remove configuration API * tmp * Checkstyle * tmp * tmp * Inject but don't resolve Bean * tmp * Tmp * fix build * TMP * Tmp * Clean up * better thread pool * Change port to 8080 * Fix port * Rm unused * Cors filter * Format * rename * Tmp * Config based * Rm health controller ref * tmp * Pool size * Mock healthcheck * Revert "Mock healthcheck" This reverts commit 466677636bda96bed7bbfd354a59abc38ff1e315. * Revert "Revert "Mock healthcheck"" This reverts commit 267094ae149f3c077bdba6f71646d99655ce81a0. * Restore health check * Tmp * format * Rm deprecated * Fix PMD * Tmp * Fix proxy test * Remove useless annotation * set auto commit as false * Clean up and PR comments * Bmoric/convert attempt micronaut (#19847) * tmp * Fix build * tmp * Tmp * tmp * tmp * Tmp * tmp * tmp * Clean up * Comments and banner * Non related files * rm tmp * Fix build * Format * Hit the micronaut server directly * micronaut OperationApiController (#20270) * micronaut OperationApiController * pass micronaut client to OperationApi * Bmoric/convert connection micronaut (#20211) * tmp * Fix build * tmp * Tmp * tmp * tmp * Tmp * tmp * tmp * Clean up * tmp * Convert Connection Api Controller * PR Comments * convert openapiapicontroller to micronaut (#20258) * convert openapiapicontroller to micronaut * merge health/openapi locations into one entry * Fix build * Format * Remove media type * Format Co-authored-by: Cole Snodgrass <cole@airbyte.io> * Bmoric/convert destination controller micronaut (#20269) * tmp * Fix build * tmp * Tmp * tmp * tmp * Tmp * tmp * tmp * Clean up * tmp * Convert Connection Api Controller * Tmp * PR Comments * convert openapiapicontroller to micronaut (#20258) * convert openapiapicontroller to micronaut * merge health/openapi locations into one entry * Fix bean * Add JsonSchemaValidator as a Bean * Fix build * Format * Format * Test fix * Pr comments * Remove media type * Format * Remove media type * Format * format * Add missing airbyte api client Co-authored-by: Cole Snodgrass <cole@airbyte.io> * Bmoric/convert destination definition controller micronaut (#20277) * tmp * Fix build * tmp * Tmp * tmp * tmp * Tmp * tmp * tmp * Clean up * tmp * Convert Connection Api Controller * Tmp * PR Comments * convert openapiapicontroller to micronaut (#20258) * convert openapiapicontroller to micronaut * merge health/openapi locations into one entry * Fix bean * Add JsonSchemaValidator as a Bean * Fix build * Format * Format * Test fix * Pr comments * Remove media type * Format * Remove media type * Format * Remove media type * Format * api client * missing annotation * format Co-authored-by: Cole Snodgrass <cole@airbyte.io> * convert StateApiController to Micronaut (#20329) * convert to micronaut * nginx updates * format * Move dest oauth to micronaut (#20318) * tmp * Fix build * tmp * Tmp * tmp * tmp * Tmp * tmp * tmp * Clean up * tmp * Convert Connection Api Controller * PR Comments * convert openapiapicontroller to micronaut (#20258) * convert openapiapicontroller to micronaut * merge health/openapi locations into one entry * Fix build * Format * Remove media type * Format * Move dest oauth to micronaut * Pr comments * format Co-authored-by: Cole Snodgrass <cole@airbyte.io> * Bmoric/convert source micronaut (#20334) * tmp * Fix build * tmp * Tmp * tmp * tmp * Tmp * tmp * tmp * Clean up * tmp * Convert Connection Api Controller * PR Comments * convert openapiapicontroller to micronaut (#20258) * convert openapiapicontroller to micronaut * merge health/openapi locations into one entry * Fix build * Format * Remove media type * Format * Tmp * tmp * Build * missing bean * format Co-authored-by: Cole Snodgrass <cole@airbyte.io> * Migrate to micronaut (#20339) * Migrate source to micronaut * convert SchedulerApiController to Micronaut (#20337) * wip; SchedulerApiController * remove @Named * remove @Singleton * add back todo message * Bmoric/convert source definition micronaut (#20338) * tmp * Fix build * tmp * Tmp * tmp * tmp * Tmp * tmp * tmp * Clean up * tmp * Convert Connection Api Controller * PR Comments * convert openapiapicontroller to micronaut (#20258) * convert openapiapicontroller to micronaut * merge health/openapi locations into one entry * Fix build * Format * Remove media type * Format * Tmp * tmp * Build * missing bean * Tmp * Add Beans * fix Bean * Add passthrough * Clean up * Missing path * FIx typo * Fix conflicts * for mat Co-authored-by: Cole Snodgrass <cole@airbyte.io> * update SourceOauthApiController to Micronaut (#20386) * convert SourceOauthApiController to Micronaut * remove SourceOauthApi reference * convert WorkspaceApiController to micronaut (#20214) * wip; broken * convert WorkspaceApiController to micronaut * remove test controller * format * format * add @Body to SourceOauthApiContr…
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Signed-off-by: Sergey Chvalyuk grubberr@gmail.com
What
Try to fix this oncalls
https://github.com/airbytehq/oncall/issues/1211
https://github.com/airbytehq/oncall/issues/1256
start_date.Description of "Start Date" - checking low boundary and shifting.
Checking low boundary (for UX only)
Connector checks "Start Date" low boundary only for good customer UX experience.
The connector generates an error on the "check" command if the
start datethat the customer entered will be more than 60 days + 1 day in the past. We need this additional day because there is no strict boundary. We can have one AmazonAds account with multiple profiles which operate in different timezones.Shifting
start_dateand skipping the "60 days" errorFor internal operation connector does not need to check low boundary.
It shifts
start_dateand ignore "60 days" error if needed:start datetrying to avoid the "60 days" error taking into account each profile timezone.a. calculating start date for profile-1 and profile-2 - shifting
start_dateif neededb. processing profile-1 during some long time.
c. processing profile-2 got a "60 days" error because (b) took a pretty long time and the boundary was already violated.
For case (2) we can still catch the "60 days" error and all we can do just ignore it and continue to process the next day.
Pre-merge Checklist
Expand the relevant checklist and delete the others.
Updating a connector
Community member or Airbyter
airbyte_secret./gradlew :airbyte-integrations:connectors:<name>:integrationTest.README.mdbootstrap.md. See description and examplesdocs/integrations/<source or destination>/<name>.mdincluding changelog. See changelog exampleAirbyter
If this is a community PR, the Airbyte engineer reviewing this PR is responsible for the below items.
/test connector=connectors/<name>command is passing/publishcommand described here