Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

添加FLIP训练功能 #26

Merged
merged 5 commits into from
Dec 12, 2022
Merged

添加FLIP训练功能 #26

merged 5 commits into from
Dec 12, 2022

Conversation

zwkkk
Copy link
Contributor

@zwkkk zwkkk commented Dec 8, 2022

No description provided.

@yangapku yangapku changed the title add flip 添加FLIP训练功能 Dec 8, 2022
@yangapku
Copy link
Member

yangapku commented Dec 8, 2022

@zwkkk 感谢贡献代码!您可以把加入FLIP后,实验的具体setting(下游数据集、模型规模、使用GPU规格、训练轮数)以及对比直接使用Chinese-CLIP的结果,在这里简单汇报下哈!

@zwkkk
Copy link
Contributor Author

zwkkk commented Dec 8, 2022

下游数据集:
MUGE,电商图文检索
实验设置:
16卡V100 32G,CN-CLIPViT-H/14版本,batch选取原则:尽量装满GPU

实验1:
备注:有添加一些额外数据
mask 比例50%,lr=1e-6,
取8轮的pt,cn-clip,batch/gpu:8,训练时间14h,MUGE retrival test测试,mean recall:81.71
取8轮的pt,cn-clip+mask,batch/gpu:28,训练时间5.5h,MUGE retrival test测试,mean recall:82.25 | test开启mask,mask 50%,推理速度快100%,mean recall:80.88

实验2:
无添加额外数据:
mask 比例50% ,lr=5e-6
cn-clip+mask, batch/gpu:28,8轮 81.36,4轮 82.00。2轮 82.09,1轮 81.29

@yangapku yangapku merged commit 1e618b0 into OFA-Sys:master Dec 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants