Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Log an exception rather than erroring out when data is found for metrics that are not attached to the experiment #2680

Closed
wants to merge 1 commit into from

Conversation

saitcakmak
Copy link
Contributor

Summary: D57165887 added an error when modeling layer encountered data for metrics that are not attached to the experiment. Daniel has been seeing these errors in some use cases where it is non-trivial to attach these metrics to the experiment. In order to unblock, we are relaxing the error, and logging an exception instead. This should keep the issue visible while letting the experiment proceed.

Reviewed By: danielcohenlive

Differential Revision: D61544922

@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Aug 20, 2024
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D61544922

@codecov-commenter
Copy link

codecov-commenter commented Aug 20, 2024

Codecov Report

Attention: Patch coverage is 91.66667% with 1 line in your changes missing coverage. Please review.

Project coverage is 95.28%. Comparing base (40c8417) to head (8e54ca2).

Files Patch % Lines
ax/service/tests/scheduler_test_utils.py 50.00% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2680      +/-   ##
==========================================
- Coverage   95.29%   95.28%   -0.01%     
==========================================
  Files         495      495              
  Lines       47773    47780       +7     
==========================================
+ Hits        45523    45529       +6     
- Misses       2250     2251       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

…ics that are not attached to the experiment (facebook#2680)

Summary:
Pull Request resolved: facebook#2680

D57165887 added an error when modeling layer encountered data for metrics that are not attached to the experiment. Daniel has been seeing these errors in some use cases where it is non-trivial to attach these metrics to the experiment. In order to unblock, we are relaxing the error, and logging an exception instead. This should keep the issue visible while letting the experiment proceed.

Reviewed By: danielcohenlive

Differential Revision: D61544922
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D61544922

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 6ac3aae.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed Do not delete this pull request or issue due to inactivity. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants