-
Notifications
You must be signed in to change notification settings - Fork 1.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
chore(test): Integrate LDBC Tests into CI Workflow #8367
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Add token
@anurags92 - you can mark a WIP PR as |
879d3a2
to
87ffb54
Compare
- Add a different workflow for ldbc tests
819e685
to
e8c1c5a
Compare
@@ -832,6 +903,9 @@ func run() error { | |||
if *suite == "load" || *suite == "all" { | |||
downloadDataFiles() | |||
} | |||
if *suite == "ldbc" || *suite == "all" { | |||
downloadLDBCFiles() |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is this an expensive operation? If testing locally, maybe it should check for the existence of the LDBC files in downloadLDBCFiles
?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It does have a flag downloadResources
which when passed as false
will not download the resources again. This is used in load-tests
as well.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
PR looks good @anurags92 - only small nitpick, we made some changes to the workflow files (some cleanup). You can see the setup here.
Main differences:
- Get Go version from .go-version file
- Use
make docker-image
instead ofmake image-local
(which automatically builds Dgraph binary, no need to callmake dgraph
separately, and no architecture specific arguments given)
desc := tt.Tag | ||
// TODO(anurag): IC06 and IC10 have non-deterministic results because of dataset. | ||
// Find a way to modify the queries to include them in the tests | ||
if desc == "IC06" || desc == "IC10" { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Query IC06
and IC10
can have multiple correct answers based on the indexing. Will have to modify the queries to get deterministic results. Added a TODO
.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Look good. Go ahead and merge it.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Approve.
PR integrates LDBC tests as a CI/CD workflow.
Query descriptions can be found at https://ldbcouncil.org/ldbc_snb_docs/ldbc-snb-specification.pdf