-
Notifications
You must be signed in to change notification settings - Fork 5.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
batch norm 预测时指定 use_global_stats=True,出现 CUDNN_STATUS_NOT_SUPPORTED 错误 #929
Comments
@lcy-seso 我拷贝你的环境,使用develop最新版本、cudnn-v5.1测试,没有复现该问题,我这里可以正常测试~ |
经过调试,觉得这个问题是 cuDNN接口 在sequence相关的模型中,这个对应的是mini-batch中word总和,比较容易超出1024, 所以很容出错。 会尽快fix下~ 另外,CUDNN_STATUS_NOT_SUPPORTED 这个错误码 不在该接口的文档中~ |
谢谢 @qingqing01 ~ |
We meet this problem again in training DS2 model. |
This problem will be fixed by using |
* add csc task. 1. add detection labels in convert_example * add train progress * rename spelling_correction to text_correction * add pinyin vocab * fix read_test * fix decode * change data.py to utils.py * add evaluate for csc * add parse decode for predict * add Chinses Spelling Correction datasets * use load_dataset('csc') instead of load_dataset(local_file) * fix word length * add predict script * decouple csc model and ernie-gram * add ernie backbone * change default model_type to ernie * add roberta * fix decode * add sighan test dataset;add sighan predict script; * remove sighan testset * add download script * add README.md * add export model * add ernie-csc directory * fix some review comments * add sighan dataaset * remove unnecessary model * add deploy model * add dataset download * remove deploy/predict.py;fix some readme bug * modify accroding to review comments * Add more comments on model implementation * upgrade sighan_evaluate.py * add some comments in sighan metrics.
文本分类任务,想使用 cnn + batch norm,配置的片段如下:
使用 gpu 训练可以正常训练。
测试时,希望保持 use_global_stats=True,使用训练时存储下来的 mean 和 std 的working average ,
但是报如下错误:
The text was updated successfully, but these errors were encountered: