Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request for Evaluation Code #1

Open
Ka2ukiMatsuda opened this issue Nov 11, 2024 · 2 comments
Open

Request for Evaluation Code #1

Ka2ukiMatsuda opened this issue Nov 11, 2024 · 2 comments

Comments

@Ka2ukiMatsuda
Copy link

Hello,

I am currently working on developing an image captioning model and would like to evaluate its performance using your metric. Could you please share the complete code necessary to generate a results table with HiFi-Score?

Thank you in advance for your assistance!

@amith-ananthram
Copy link

Just wanted to bump this thread -- really enjoyed your paper and would love to use your metric for evaluating a system I'm working on. Thanks!

@lydia7632
Copy link
Owner

Thank you for your interest in our work! And sorry for the late response as I've been busy with other projects recently.
You can refer to HPG/blip2_matching_and_scoring.py for evaluation and HPG/build_HPG.py for HPG generation, with the updated data format available in HPG_example.
We will soon release an extended code version with faster and better sub-modules.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants