Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Metric: CLIP-IQA and CLIP-IQA+ #331

Closed
snk4tr opened this issue Jan 23, 2023 · 1 comment · Fixed by #348
Closed

Metric: CLIP-IQA and CLIP-IQA+ #331

snk4tr opened this issue Jan 23, 2023 · 1 comment · Fixed by #348
Assignees
Labels
feature New feature or request

Comments

@snk4tr
Copy link
Contributor

snk4tr commented Jan 23, 2023

Is your feature request related to a problem? Please describe.
CLIP-IQA and CLIP-IQA+ no-reference metrics were introduced in recent publication by Wang et.al.. This metric is interesting because it shows relatively good generalizability and low computational cost (for NN-based metric).

Describe the solution you'd like
Add a class or a function with both CLIP-IQA and CLIP-IQA+ metrics.

Additional context
Official implementation is available. However, the code has lots of dependencies and needs to be minimized.

@snk4tr snk4tr added the feature New feature or request label Jan 23, 2023
@snk4tr snk4tr self-assigned this Jan 23, 2023
@snk4tr snk4tr mentioned this issue Feb 28, 2023
@snk4tr
Copy link
Contributor Author

snk4tr commented Apr 23, 2023

The main reason to implement CLIP-IQA here is to give a user an opportunity to use the metric without bringing additional dependencies (mmcv/mmedit) to the project.

Note that CLIP-IQA+ won't be implemented here because CLIP weights were fine-tuned with mmcv and hence cannot be loaded and run without it.

Note that the values of this implementation correspond to the values produced by the official CLIP-IQA implementation. SRCC scores of evaluations on public benchmarks may mismatch the ones listed in the paper. We consider official code and weights to be an ultimate source of truth and hence stick with it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant