Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to interpret score values? #8

Open
Ellyuca opened this issue Sep 28, 2022 · 1 comment
Open

How to interpret score values? #8

Ellyuca opened this issue Sep 28, 2022 · 1 comment

Comments

@Ellyuca
Copy link

Ellyuca commented Sep 28, 2022

Hi. Thanks for this interesting work.

I want to use this full reference metric to evaluate the quality of some images for my research.

I managed to run the code and I tried a few images from the PIPAL validation set (i.e the image of the parrot A0019.bmp and the image with a house A0020.bmp and their corresponding distorted versions A0019_10_04.bmp and A0020_10_04.bmp).
I used this model: AHIQ_vit_p8_epoch33.pth.

When I compare A0019_10_04.bmp with A0019.bmp I get as score 0.466813. For A0020_10_04.bmp with A0020.bmp I get 0.589722.
But then when I compare the images with themselves (A0019.bmp with A0019.bmp and A0020.bmp with A0020.bmp) I get the scores 0.691261 and 0.704291, respectively.

I am wondering that is the score range min and max value for this metric? It is 0 and 1?
How do you interpret the score values? Lower means more different? Higher means more similar?
For examples, in the case of other FR metrics like SSIM, when I compare two identical images I get a score of 1, so then I can say that the images are identical. But with your metric, how can I tell if 2 images are the same (or different) just by looking at the score values?

Thank you for your time.
I'm looking forward to your answer.
Have a great day!

@yangyijune
Copy link

Same as above.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

2 participants