-
Notifications
You must be signed in to change notification settings - Fork 4.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
🐛 Source Github: add custom pagination size for large streams #9664
🐛 Source Github: add custom pagination size for large streams #9664
Conversation
/test connector=connectors/source-github
|
…urochkin/add-custom-pagination-size-for-large-streams
/publish connector=connectors/source-github
|
Bug-fix Request
Fixes https://github.com/airbytehq/oncall/issues/75*
Reason
Reduced pagination size for heavily loaded streams, as this can be a problem for reading these streams using the API (the case was in the PR #4708 where the page size values were already reduced for large streams).
I also added a parameter to the specification that allows the user to configure this parameter depending on the degree of load of his repositories
Confirmation
Described above
How does the code change in the PR fix the issue?
Described above
Recommended reading order
x.java
y.python
🚨 User Impact 🚨
Are there any breaking changes? What is the end result perceived by the user? If yes, please merge this PR with the 🚨🚨 emoji so changelog authors can further highlight this if needed.
Pre-merge Checklist
Community member or Airbyter
airbyte_secret
./gradlew :airbyte-integrations:connectors:<name>:integrationTest
.README.md
bootstrap.md
. See description and examplesdocs/integrations/<source or destination>/<name>.md
including changelog. See changelog exampleAirbyter
If this is a community PR, the Airbyte engineer reviewing this PR is responsible for the below items.
/test connector=connectors/<name>
command is passing./publish
command described here