-
Notifications
You must be signed in to change notification settings - Fork 110
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remove redundant/superseded Everest tests #8954
Remove redundant/superseded Everest tests #8954
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #8954 +/- ##
==========================================
- Coverage 91.56% 91.55% -0.01%
==========================================
Files 344 345 +1
Lines 21295 21302 +7
==========================================
+ Hits 19499 19504 +5
- Misses 1796 1798 +2
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
ab0e94a
to
9100a86
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
One question, otherwise good.
CONFIG_FILE_MINIMAL = "config_minimal.yml" | ||
CONFIG_FILE_IN_CONSTR = "config_in_constr.yml" | ||
CONFIG_FILE_OUT_CONSTR = "config_out_constr.yml" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could you check if these files are used in some other test, and if not, remove them?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think they are (only) used in the documentation of Everest as examples for slowly building up the complexity of using Everest (at least the minimal one is for sure, maybe the in_constr and out_constr aren't)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
But in the documentation are they explicitly referring to the file location? Because they used to be in an examples
folder, but that has now become test-data
, and we should not have anything there that is not used. The documentation should not refer to test-data
.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sorry you are right, they are making their own ('everest_config.yml') which happens to look exactly the same as the 'config_minimal.yml'. We can delete them I guess, and also clean up the associated 'jobs' I suppose?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes, please do. However, the associated jobs might be used by other tests. You will find out when the tests fail...
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The job (DISTANCE3) for in- and output constraint was used in other tests. Also, config_minimal was used in quite a lot of other tests too, so we need to keep the config file.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You will also need to squash the two commits into a single one.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good. Can you squash into a single commit?
f417ffb
to
493701d
Compare
Issue
Resolves #8858
Approach
It seems, after investigating, that both the test_math_func_multiobj and test_math_func_advanced cover all the functionality of the other tests. The only exception, perhaps, is in the part of the config_minimal test where we test if the following parameter is ignored when no constraints are provided in the config file: "constraint_tolerance: 0.1 # To test that it is ignored.". We could keep the minimal test and remove only the other two for this reason? But it might seem like a stretch.
(Screenshot of new behavior in GUI if applicable)
git rebase -i main --exec 'pytest tests/ert/unit_tests -n logical -m "not integration_test"'
)When applicable