Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FID score #13

Closed
wb-finalking opened this issue Jan 22, 2021 · 2 comments
Closed

FID score #13

wb-finalking opened this issue Jan 22, 2021 · 2 comments

Comments

@wb-finalking
Copy link

Hello! I am very interested in your work. And I use your pretrained model netGv2_coco128.pth for testing. But my metric scores(IS: 14.31, FID 30.71) are not match yours in paper (IS: 14.21, FID: 24.76). I want to know why there is a big difference between my FID score and yours. I use the evaluate code mentioned in #3 and generate 5 images for each layout.
Looking forward to your reply.

@WillSuen
Copy link
Owner

Hi thanks for your interests. How many images did you use for evaluate FID? I use all about 3000 images, so the FID is calculated over about 3k vs 15k. If still have the issue, could you please upload the generated images and let me have a check

@wb-finalking
Copy link
Author

Hi thanks for your interests. How many images did you use for evaluate FID? I use all about 3000 images, so the FID is calculated over about 3k vs 15k. If still have the issue, could you please upload the generated images and let me have a check

Sorry, its my fault to modify the code for image saving, which would result in information loss. When I use misc.imsave for image saving, FID score can reach to 24.8.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants