Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add an attempt to read from the cache for Regular Mode API #182

Merged
merged 4 commits into from
Dec 9, 2022

Conversation

ArturT
Copy link
Member

@ArturT ArturT commented Nov 22, 2022

Add an attempt to read from the cache for Regular Mode API.

This way, we can read the test suite split from the cache, and there is no need to send test_files in the request payload from the knapsack_pro gem for all parallel CI nodes.
This allows using Regular Mode with a large test suite (many thousands of test files across hundreds of parallel CI nodes) because requests from parallel CI nodes are fast. There is a limited number of slow requests with a big list of test files in the request payload.

related PRs

related old PR

This PR is inspired by the improvement made for Queue Mode:

ArturT added a commit that referenced this pull request Nov 23, 2022
This way, we can read the test suite split from the cache, and there is no need to send test_files in the request payload from the knapsack_pro gem for all parallel CI nodes.
This allows using Regular Mode with a large test suite (many thousands of test files across hundreds of parallel CI nodes) because requests from parallel CI nodes are fast. There is a limited number of slow requests with a big list of test files in the request payload.

#182

Commits:

Add an attempt to read from cache for Regular Mode

add CI build ID in the Regular Mode request

improve language and be more explicit

Fix integration specs for Regular Mode and refresh VCR cassettes

Update CHANGELOG.md
@ArturT ArturT force-pushed the regular-mode-improvement branch from 88069ed to 854b642 Compare November 23, 2022 21:50
ArturT added a commit that referenced this pull request Nov 23, 2022
This way, we can read the test suite split from the cache, and there is no need to send test_files in the request payload from the knapsack_pro gem for all parallel CI nodes.
This allows using Regular Mode with a large test suite (many thousands of test files across hundreds of parallel CI nodes) because requests from parallel CI nodes are fast. There is a limited number of slow requests with a big list of test files in the request payload.

#182

Commits:

Add an attempt to read from cache for Regular Mode

add CI build ID in the Regular Mode request

improve language and be more explicit

Fix integration specs for Regular Mode and refresh VCR cassettes

Update CHANGELOG.md
@ArturT ArturT force-pushed the regular-mode-improvement branch from 854b642 to 37818cc Compare November 23, 2022 21:55
@ArturT ArturT requested a review from shadre November 23, 2022 22:00
Copy link
Member

@shadre shadre left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Details in the PR for the API.

This way, we can read the test suite split from the cache, and there is no need to send test_files in the request payload from the knapsack_pro gem for all parallel CI nodes.
This allows using Regular Mode with a large test suite (many thousands of test files across hundreds of parallel CI nodes) because requests from parallel CI nodes are fast. There is a limited number of slow requests with a big list of test files in the request payload.

#182

Commits:

Add an attempt to read from cache for Regular Mode

add CI build ID in the Regular Mode request

improve language and be more explicit

Fix integration specs for Regular Mode and refresh VCR cassettes

Update CHANGELOG.md
@ArturT ArturT force-pushed the regular-mode-improvement branch from 37818cc to 92b38c4 Compare December 6, 2022 11:32
@ArturT ArturT requested a review from shadre December 8, 2022 23:24
Copy link
Member

@shadre shadre left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀

@ArturT ArturT merged commit 4f5b1e3 into master Dec 9, 2022
@ArturT ArturT deleted the regular-mode-improvement branch December 9, 2022 14:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants