Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consolidate BenchmarkMetric functionality in one file #2710

Closed
wants to merge 3 commits into from

Conversation

esantorella
Copy link
Contributor

Summary:
There is no need to have multiple files here anymore now that a lot of BenchmarkMetric functionality has disappeared.

D61736027 follows up by moving benchmark/metrics/benchmark.py to benchmark/benchmark_metric.py and moving the corresponding test file.

Reviewed By: Balandat

Differential Revision: D61432000

@codecov-commenter
Copy link

codecov-commenter commented Aug 24, 2024

Codecov Report

Attention: Patch coverage is 96.00000% with 3 lines in your changes missing coverage. Please review.

Project coverage is 95.39%. Comparing base (f1d2f88) to head (09150d4).

Files Patch % Lines
ax/benchmark/metrics/benchmark.py 86.36% 3 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2710      +/-   ##
==========================================
- Coverage   95.39%   95.39%   -0.01%     
==========================================
  Files         492      490       -2     
  Lines       47920    47738     -182     
==========================================
- Hits        45715    45541     -174     
+ Misses       2205     2197       -8     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Aug 24, 2024
esantorella and others added 3 commits August 27, 2024 06:56
…#2704)

Summary:
Pull Request resolved: facebook#2704

This currently doesn't change behavior, but enables more flexibility by redefining `Problem.get_ground_truth_opt_trace` or `BenchmarkRunner.get_Y_true`. This is currently duplicative with the tracking metrics setup, which will be reaped in D61432000; these should be combined. This diff has both ways of computing the optimization trace running, along with an assertion that they give the same results.

Differential Revision: D61404056

Reviewed By: saitcakmak
Summary:
Pull Request resolved: facebook#2706

No longer needed after the changes in the previous diff.

Differential Revision: D61415525

Reviewed By: Balandat
Summary:
There is no need to have multiple files here anymore now that a lot of BenchmarkMetric functionality has disappeared.

D61736027 follows up by moving `benchmark/metrics/benchmark.py` to `benchmark/benchmark_metric.py` and moving the corresponding test file.

Reviewed By: Balandat

Differential Revision: D61432000
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D61432000

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D61432000

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 3e2e290.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed Do not delete this pull request or issue due to inactivity. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants