Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About the experimental reproduction results #2

Open
wlsh1up opened this issue Dec 5, 2021 · 3 comments
Open

About the experimental reproduction results #2

wlsh1up opened this issue Dec 5, 2021 · 3 comments

Comments

@wlsh1up
Copy link

wlsh1up commented Dec 5, 2021

Hi hdbat:
thanks for your nice work and I am very interested in this paper. However, after the code is finished trained, I get the following results.
In 1A setting.
"detail_human.csv & model_final.pt & partition_F1_3.csv & ranking_k_10.csv & stats.csv detail_hoi.csv & detail_object.csv & partition_AP.csv & partition_F1_5.csv & ranking_k_7.csv"
image
image

This is inconsistent with the results reported in the paper. Can you tell me how to reproduce it
Best

@hbdat
Copy link
Owner

hbdat commented Dec 6, 2021

Hi @wlsh1up

Thanks for your interests in the project.
Could you provide more information about the training setting you use?

Best,
Dat

@wlsh1up
Copy link
Author

wlsh1up commented Dec 15, 2021

Sorry for your late reply. I've read your code carefully these days. and i am new to this field, so I hope my questions are not irrelevant.
The complete reproduction results are shown below

111

the training setting I use is HICO which iniclud 38116 + 9658 = 47774 pkl.gz in /data/hico_20160224_det/features_pad

I only changed epoch to 15, Other hype-parameters are not changed.

@hbdat
Copy link
Owner

hbdat commented Dec 24, 2021

Hi @wlsh1up

I am not sure what the issue is.
Have you tried to reproduce the results using the pretrained models?
I have included the instruction for evaluating on pretrained models in the README.

Please let me know what the results on your side are for these pretrained models.

Best,
Dat

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants