-
Notifications
You must be signed in to change notification settings - Fork 10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
如何关闭其中一个pre training model #17
Comments
这个参数是在预训练的过程中更改的,您需要更改这些参数重新训练预训练模型,而不是加载我提供的模型。 |
您需要首先处理出预训练的数据,然后更改参数运行MVSA_pretrain.sh脚本文件 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
你好,中文不好请见谅。
我想要在实验中将论文中提到的5个pre training model
分别关闭一次,然后测试得到的成绩
我在training.py中的第60行开始将pre training model 註解化,如下
mlm_infos={ """2/22 disable MLM key: value.to(device) for key, value in batch['MLM'].items() """ } if 'MLM' in batch else None,
可是结果并没有变化,请问是哪裡做错了?
The text was updated successfully, but these errors were encountered: