Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

video-text retrieval MSVD数据集划分 #12

Closed
SuperHalo opened this issue Sep 18, 2023 · 10 comments
Closed

video-text retrieval MSVD数据集划分 #12

SuperHalo opened this issue Sep 18, 2023 · 10 comments

Comments

@SuperHalo
Copy link

您好!我想用您的代码复现一下MSVD数据集的结果,下图是用l16_25m微调后的模型测试的结果。与论文结果不一致,应该是数据划分不一样导致的。MSVD数据集的文本标注原本是一对多,但是根据论文Table28对MSVD数据集的描述,对于每个视频,您只从对应的文本标注取了一个文本吗?能否提供您的标注json文件?谢谢!
image

@Andy1621
Copy link
Collaborator

@SuperHalo
Copy link
Author

谢谢您的及时回复与分享!使用您的数据标注文件的测试结果仍与论文中的不同。能否麻烦您帮我看看是否有参数设置与您论文结果对应的设置不一样。我使用的模型是ret_msvd_l16_25m.pth。非常感谢!!
msvd_l16.md

@Andy1621
Copy link
Collaborator

能否提供完整的训练/测试log呢?

@SuperHalo
Copy link
Author

这是测试的log,您看看,谢谢
msvd_l16.log

@Andy1621
Copy link
Collaborator

可以查看google drive,我上传了之前实验训练和测试的log,您可以对照着看看有无问题,最近比较忙,实在难以帮忙debug

@SuperHalo
Copy link
Author

谢谢,是我这边的参数设置跟您不一样,已经复现出论文的结果了

@Andy1621
Copy link
Collaborator

我抽空查了下bug,可以看看这个warning

@SuperHalo
Copy link
Author

非常感谢!请问能再给一下video-text retrieval任务其他数据集的标注文件吗?包括DiDeMo,ActivityNet,LSMDC

@Andy1621
Copy link
Collaborator

Andy1621 commented Oct 9, 2023

可以从VINDLU共享的文件中转换https://drive.google.com/drive/folders/12cr94wT8j7pR09AR2nmQg6o26Y1arI50

@Andy1621
Copy link
Collaborator

Andy1621 commented Nov 6, 2023

测试结果已经更新

@Andy1621 Andy1621 closed this as completed Nov 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants