Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is the pre-trained model trained using both the FLIC AND MPII dataset? #44

Open
neherh opened this issue Jan 23, 2018 · 3 comments
Open

Comments

@neherh
Copy link

neherh commented Jan 23, 2018

Is the pre-trained model trained using both the FLIC AND MPII dataset? Or is it just pre-trained on one of the datasets? In your paper, you are unclear as to whether you trained on both or separately.

@anewell
Copy link
Collaborator

anewell commented Feb 1, 2018

The pretrained model is trained only on MPII. Benchmarking for the paper is done by training and evaluating on a each dataset separately.

@vicdu
Copy link

vicdu commented Mar 7, 2018

The result in the paper is 90.09, but the recurring result is 88.78, where do you think the problem occurred?

@anewell
Copy link
Collaborator

anewell commented Mar 12, 2018

If you're getting 88.78 on validation then that's probably fine. The performance on the official test set (what we report in the paper) is always different, and usually a little bit higher than validation performance in my experience.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants