Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Information Retrieval (6/5) #161

Merged
merged 37 commits into from
Apr 6, 2021
Merged

Information Retrieval (6/5) #161

merged 37 commits into from
Apr 6, 2021

Conversation

lucadiliello
Copy link
Contributor

Before submitting

  • Was this discussed/approved via a Github issue? (no need for typos and docs improvements)
  • Did you read the contributor guideline, Pull Request section?
  • Did you make sure to update the docs?
  • Did you write any new necessary tests?

What does this PR do?

implements Fall Our rate for IR. Original discussione here.

PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

@codecov
Copy link

codecov bot commented Apr 6, 2021

Codecov Report

Merging #161 (4d7f644) into master (89acd4e) will decrease coverage by 17.59%.
The diff coverage is 81.63%.

Impacted file tree graph

@@             Coverage Diff             @@
##           master     #161       +/-   ##
===========================================
- Coverage   96.81%   79.22%   -17.60%     
===========================================
  Files         160       82       -78     
  Lines        4900     2493     -2407     
===========================================
- Hits         4744     1975     -2769     
- Misses        156      518      +362     
Flag Coverage Δ
Linux 79.22% <81.63%> (+0.03%) ⬆️
Windows 79.22% <81.63%> (+0.03%) ⬆️
cpu 79.22% <81.63%> (-17.60%) ⬇️
gpu ?
macOS 79.22% <81.63%> (-17.60%) ⬇️
pytest 79.22% <81.63%> (-17.60%) ⬇️
python3.6 ?
python3.8 ?
python3.9 ?
torch1.3.1 ?
torch1.4.0 ?
torch1.8.1 ?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
torchmetrics/functional/retrieval/recall.py 76.92% <ø> (-23.08%) ⬇️
torchmetrics/retrieval/retrieval_metric.py 81.81% <ø> (-18.19%) ⬇️
torchmetrics/retrieval/retrieval_fallout.py 78.12% <78.12%> (ø)
torchmetrics/functional/retrieval/fall_out.py 84.61% <84.61%> (ø)
torchmetrics/__init__.py 100.00% <100.00%> (ø)
torchmetrics/functional/__init__.py 100.00% <100.00%> (ø)
torchmetrics/functional/retrieval/__init__.py 100.00% <100.00%> (ø)
torchmetrics/retrieval/__init__.py 100.00% <100.00%> (ø)
torchmetrics/utilities/distributed.py 22.85% <0.00%> (-74.29%) ⬇️
torchmetrics/classification/auc.py 47.61% <0.00%> (-52.39%) ⬇️
... and 121 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 89acd4e...4d7f644. Read the comment docs.

@Borda Borda added enhancement New feature or request New metric labels Apr 6, 2021
@Borda Borda added this to the 0.3 milestone Apr 6, 2021
docs/source/references/functional.rst Outdated Show resolved Hide resolved
docs/source/references/modules.rst Outdated Show resolved Hide resolved
@Borda Borda enabled auto-merge (squash) April 6, 2021 14:31
@Borda
Copy link
Member

Borda commented Apr 6, 2021

@lucadiliello mind adding an entry to changelog... 🐰

@Borda Borda added the ready label Apr 6, 2021
tests/retrieval/test_fallout.py Outdated Show resolved Hide resolved
tests/retrieval/test_fallout.py Outdated Show resolved Hide resolved
torchmetrics/functional/retrieval/fall_out.py Outdated Show resolved Hide resolved
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
auto-merge was automatically disabled April 6, 2021 17:15

Head branch was pushed to by a user without write access

auto-merge was automatically disabled April 6, 2021 17:15

Head branch was pushed to by a user without write access

Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
@SkafteNicki SkafteNicki enabled auto-merge (squash) April 6, 2021 17:20
auto-merge was automatically disabled April 6, 2021 17:22

Head branch was pushed to by a user without write access

@SkafteNicki SkafteNicki enabled auto-merge (squash) April 6, 2021 17:27
@SkafteNicki SkafteNicki merged commit 12eea74 into Lightning-AI:master Apr 6, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants