Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update low-code connectors using last_records #36409

Closed
wants to merge 15 commits into from

Conversation

girarda
Copy link
Contributor

@girarda girarda commented Mar 22, 2024

What

Update connectors to use last_record instead of last_records, which is being deprecated by #36408

Copy link

vercel bot commented Mar 22, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Apr 4, 2024 6:32pm

@@ -1,185 +1,5 @@
{
"streams": [
{
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FIX:ME undo this change

@@ -55,7 +55,7 @@ definitions:
type: "DefaultPaginator"
pagination_strategy:
type: "CursorPagination"
cursor_value: "{{ last_records['meta', 'pagination', 'next_offset'] }}"
cursor_value: "{{ last_record['meta', 'pagination', 'next_offset'] }}"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CATs are failing on master too.

I'm also not sure how this can work on master since last_records should be an array, not an object

@@ -53,7 +53,7 @@ definitions:
type: "DefaultPaginator"
pagination_strategy:
type: "CursorPagination"
cursor_value: "{{ last_records['href'] }}"
cursor_value: "{{ last_record['href'] }}"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

confirmed CATs pass

Uploading Screenshot 2024-03-25 at 1.57.08 PM.png…

@@ -33,7 +33,7 @@ definitions:
type: "DefaultPaginator"
pagination_strategy:
type: "CursorPagination"
cursor_value: "{{ last_records['next'] }}"
cursor_value: "{{ last_record['next'] }}"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

confirmed CATs pass
Screenshot 2024-03-25 at 2 13 06 PM

@@ -12,7 +12,6 @@
TEST_REQUIREMENTS = [
"pytest~=6.2",
"pytest-mock~=3.6.1",
"connector-acceptance-test",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this library isn't needed by the connector

@@ -28,7 +28,7 @@ definitions:
type: "DefaultPaginator"
pagination_strategy:
type: "CursorPagination"
cursor_value: "{{ last_records[-1]['scrollId'] }}"
cursor_value: "{{ last_record['scrollId'] }}"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Confirmed CATs pass

Screenshot 2024-03-25 at 2 26 35 PM

@@ -39,7 +39,7 @@ definitions:
type: "DefaultPaginator"
pagination_strategy:
type: "CursorPagination"
cursor_value: "{{ last_records['paging', 'next'] }}"
cursor_value: "{{ last_record['paging', 'next'] }}"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Confirmed CATs pass
Screenshot 2024-03-25 at 2 42 30 PM

@@ -24,7 +24,7 @@ definitions:
type: DefaultPaginator
pagination_strategy:
type: "CursorPagination"
cursor_value: "{{ last_records[-1]['key'] }}"
cursor_value: "{{ last_record['key'] }}"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tests don't pass on master

@girarda girarda marked this pull request as ready for review March 28, 2024 00:29
@octavia-squidington-iv octavia-squidington-iv requested a review from a team March 28, 2024 00:30
@octavia-squidington-iv octavia-squidington-iv requested a review from a team March 28, 2024 00:30
Base automatically changed from alex/replace_last_records_from_paginators to master April 2, 2024 17:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants