Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluation on ReasonSeg test set (missing annotation, text for refer) #157

Open
suikei-wang opened this issue Nov 9, 2024 · 0 comments
Open

Comments

@suikei-wang
Copy link

Thanks for the amazing work!

I am currently running some evaluation on ReasonSeg test set and I found that there are 2 jsons files are missing the polygon shape. I simply removed them from the test set (now 777 images). Not sure if this affect the evaluation result.

Also I am wondering how you take the texts for an image when you perform the evaluation? Do I need to take each text in list texts as a refer? Apparently all texts are referring to the same region (they share an annotation) but I am not sure if the evaluation are done for each text.

Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant