Scan queue update #50
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Jono Yang <jyang@nexb.com>
* Update ScannableURI-related code such that it works on the latest version of scancode.io Signed-off-by: Jono Yang <jyang@nexb.com>
Signed-off-by: Jono Yang <jyang@nexb.com>
* Create new test to generate scancode.io API responses for tests Signed-off-by: Jono Yang <jyang@nexb.com>
* Properly associate package to ScannableURI Signed-off-by: Jono Yang <jyang@nexb.com>
* Hash URI with SHA1 and use the value as the name of the project on scancode.io because of scancode.io project name length limit
* Update create_structure_fingerprint to account when child.size is None
* Update ScannableURIManager.get_scannables() to get scannables with wip_dates
* Limit scan requests to 3 by default to avoid overwhelming scancode.io server
Signed-off-by: Jono Yang <jyang@nexb.com>
* Update Makefile for running scan queue Signed-off-by: Jono Yang <jyang@nexb.com>
Signed-off-by: Jono Yang <jyang@nexb.com>
Signed-off-by: Jono Yang <jyang@nexb.com>
Signed-off-by: Jono Yang <jyang@nexb.com>
* Update index_package_files to not use VirtualCodebase Signed-off-by: Jono Yang <jyang@nexb.com>
* Remove the word "test" from the method names of ScanCodeIOAPIHelperFunctionTest
* Revert default seeder to npm
Signed-off-by: Jono Yang <jyang@nexb.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR updates the scan queue implemented by
request_scansandprocess_scanshas been updated to work with the latest version of scancode.io. Scancode.io pipelines related to matching have been created and added to matchcode-toolkit. New test function has been created to regenerate scancode.io API responses for the scan queue API tests.