-
Notifications
You must be signed in to change notification settings - Fork 52
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add benchmarks endpoints to Orion Web API #996
Merged
bouthilx
merged 32 commits into
Epistimio:develop
from
notoraptor:feature/benchmark_webapi_rebased
Dec 1, 2022
Merged
Add benchmarks endpoints to Orion Web API #996
bouthilx
merged 32 commits into
Epistimio:develop
from
notoraptor:feature/benchmark_webapi_rebased
Dec 1, 2022
Commits on Nov 30, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 39acaa9 - Browse repository at this point
Copy the full SHA 39acaa9View commit details -
Lazy build of Benchmark study and analysis filters
Why: Building the benchmark object (setup_experiments in particular) can be quite expensive (>60s). When we only want to execute one particular analysis, the build does a lot of useless fetch on the storage. The experiments should be built only when they are needed. Relatedly, the analysis method should allow selecting specific study. How: Only call setup_experiments on study when we try to access `study.get_experiments()`. The task_ids which seemed useless are removed from `experiments_info` as well.
Configuration menu - View commit details
-
Copy full SHA for b37c3c4 - Browse repository at this point
Copy the full SHA b37c3c4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 87dda11 - Browse repository at this point
Copy the full SHA 87dda11View commit details -
Remove Benchmark {algorithm: algo, deterministic:}
Why: The interface is bloated and difficult to memorise. One of the reason we decided to go this way is that we previously needed to instantiate an algo to access its attributes. We can now use algo_factory.get_class() to have the class object only and access the class attributes. Thanks to this we can now simply set deterministic as a class attribute for the algorithms and it simplifies the interface of the benchmark. Algorithms have deterministic set to False by default since they generally have sources of variations.
Configuration menu - View commit details
-
Copy full SHA for 2233d96 - Browse repository at this point
Copy the full SHA 2233d96View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7f1f75a - Browse repository at this point
Copy the full SHA 7f1f75aView commit details -
Configuration menu - View commit details
-
Copy full SHA for c9ade74 - Browse repository at this point
Copy the full SHA c9ade74View commit details -
- Add gunicorn settings from YAML to Gunicon app - increase gunicorn timeout to 300 seconds
Configuration menu - View commit details
-
Copy full SHA for 6b0314b - Browse repository at this point
Copy the full SHA 6b0314bView commit details -
Configuration menu - View commit details
-
Copy full SHA for b1c0f4b - Browse repository at this point
Copy the full SHA b1c0f4bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 28006df - Browse repository at this point
Copy the full SHA 28006dfView commit details -
Configuration menu - View commit details
-
Copy full SHA for 028ff6a - Browse repository at this point
Copy the full SHA 028ff6aView commit details -
Configuration menu - View commit details
-
Copy full SHA for aa30077 - Browse repository at this point
Copy the full SHA aa30077View commit details -
Configuration menu - View commit details
-
Copy full SHA for a5f16f0 - Browse repository at this point
Copy the full SHA a5f16f0View commit details -
Configuration menu - View commit details
-
Copy full SHA for b539a2f - Browse repository at this point
Copy the full SHA b539a2fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 85ef34f - Browse repository at this point
Copy the full SHA 85ef34fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3c44c63 - Browse repository at this point
Copy the full SHA 3c44c63View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1bfa803 - Browse repository at this point
Copy the full SHA 1bfa803View commit details -
Configuration menu - View commit details
-
Copy full SHA for a13df40 - Browse repository at this point
Copy the full SHA a13df40View commit details -
Pass timeout to lock constructor and use lock instead of lock.acquire…
… in with-statement, to make sure lock.acquire and lock.release are called
Configuration menu - View commit details
-
Copy full SHA for 9202581 - Browse repository at this point
Copy the full SHA 9202581View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0d806e9 - Browse repository at this point
Copy the full SHA 0d806e9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 07f7c8e - Browse repository at this point
Copy the full SHA 07f7c8eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9e313b4 - Browse repository at this point
Copy the full SHA 9e313b4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 18c132d - Browse repository at this point
Copy the full SHA 18c132dView commit details -
Configuration menu - View commit details
-
Copy full SHA for c01db7f - Browse repository at this point
Copy the full SHA c01db7fView commit details -
Configuration menu - View commit details
-
Copy full SHA for b77d622 - Browse repository at this point
Copy the full SHA b77d622View commit details -
Configuration menu - View commit details
-
Copy full SHA for e2a24fe - Browse repository at this point
Copy the full SHA e2a24feView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0bd5b37 - Browse repository at this point
Copy the full SHA 0bd5b37View commit details -
Configuration menu - View commit details
-
Copy full SHA for 680dc33 - Browse repository at this point
Copy the full SHA 680dc33View commit details -
Configuration menu - View commit details
-
Copy full SHA for 124168b - Browse repository at this point
Copy the full SHA 124168bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4664602 - Browse repository at this point
Copy the full SHA 4664602View commit details -
Configuration menu - View commit details
-
Copy full SHA for 71dae0a - Browse repository at this point
Copy the full SHA 71dae0aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4e37d0a - Browse repository at this point
Copy the full SHA 4e37d0aView commit details
Commits on Dec 1, 2022
-
Configuration menu - View commit details
-
Copy full SHA for a0590a0 - Browse repository at this point
Copy the full SHA a0590a0View commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.