Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FIX] Incorrect cost for crash, r2 #340

Merged
merged 1 commit into from
Nov 22, 2021
Merged

Conversation

ravinkohli
Copy link
Contributor

Addresses #339

@ravinkohli ravinkohli added bug Something isn't working first priority PRs to be checked as a priority labels Nov 22, 2021
@ravinkohli ravinkohli linked an issue Nov 22, 2021 that may be closed by this pull request
@codecov
Copy link

codecov bot commented Nov 22, 2021

Codecov Report

Merging #340 (af8f823) into development (751b9ce) will increase coverage by 0.18%.
The diff coverage is n/a.

Impacted file tree graph

@@               Coverage Diff               @@
##           development     #340      +/-   ##
===============================================
+ Coverage        81.97%   82.16%   +0.18%     
===============================================
  Files              153      153              
  Lines             8812     8812              
  Branches          1341     1341              
===============================================
+ Hits              7224     7240      +16     
+ Misses            1124     1106      -18     
- Partials           464      466       +2     
Impacted Files Coverage Δ
...ch/pipeline/components/training/metrics/metrics.py 100.00% <ø> (ø)
...r_preprocessing/feature_preprocessing/KernelPCA.py 91.66% <0.00%> (+1.66%) ⬆️
...essing/feature_preprocessing/RandomKitchenSinks.py 94.11% <0.00%> (+2.94%) ⬆️
autoPyTorch/pipeline/tabular_regression.py 82.65% <0.00%> (+14.28%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 751b9ce...af8f823. Read the comment docs.

@ravinkohli ravinkohli merged commit 9d93085 into automl:development Nov 22, 2021
Copy link
Collaborator

@nabenabe0928 nabenabe0928 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the fix
We can merge this!

ravinkohli added a commit that referenced this pull request Nov 23, 2021
* [enhance] Increase the coverage (#336)

* [feat] Support statistics print by adding results manager object (#334)

* [feat] Support statistics print by adding results manager object

* [refactor] Make SearchResults extract run_history at __init__

Since the search results should not be kept in eternally,
I made this class to take run_history in __init__ so that
we can implicitly call extraction inside.
From this change, the call of extraction from outside is not recommended.
However, you can still call it from outside and to prevent mixup of
the environment, self.clear() will be called.

* [fix] Separate those changes into PR#336

* [fix] Fix so that test_loss includes all the metrics

* [enhance] Strengthen the test for sprint and SearchResults

* [fix] Fix an issue in documentation

* [enhance] Increase the coverage

* [refactor] Separate the test for results_manager to organize the structure

* [test] Add the test for get_incumbent_Result

* [test] Remove the previous test_get_incumbent and see the coverage

* [fix] [test] Fix reversion of metric and strengthen the test cases

* [fix] Fix flake8 issues and increase coverage

* [fix] Address Ravin's comments

* [enhance] Increase the coverage

* [fix] Fix a flake8 issu

* Update for release (#335)

* Create release workflow and CITATION.cff  and update README, setup.py

* fix bug in pypy token

* fix documentation formatting

* TODO for docker image

* accept suggestions from shuhei

* add further options for disable_file_output documentation

* remove  from release.yml

* [feat] Add templates for issue and PR with the Ravin's suggestions (#136)

* [doc] Add the workflow of the Auto-Pytorch (#285)

* [doc] Add workflow of the AutoPytorch

* [doc] Address Ravin's comment

* [FIX] Silence catboost (#338)

* set verbose=False in catboost

* fix flake

* change worst possible result of r2 (#340)

* Update README.md with link for master branch

* [FIX formatting in docs (#342)

* fix formatting in docs

* Update examples/40_advanced/example_resampling_strategy.py

* Update README.md, remove cat requirements.txt

Co-authored-by: nabenabe0928 <47781922+nabenabe0928@users.noreply.github.com>
ravinkohli added a commit that referenced this pull request Dec 8, 2021
Update README.md with link for master branch
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working first priority PRs to be checked as a priority
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Incorrect cost for crash, r2 metric.
2 participants