[CPU-PSLIB] Add consistency insepection of op's embedding name and sparse table name in config_fleet.py, test=develop #34249
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR types
Function optimization
PR changes
Others
Describe
问题描述:
之前的报错日志:
改动说明:
增加训练前的检查机制:1) 如果配置的fluid.layers.embedding的name不在config_fleet.py的config词典的key中,则进行warning提示,同时根据fluid.layers.embedding中的size配置生成一张新的sparse_table (原来是直接用默认值生成新的sparse_table,但这样会导致fluid.layers.embedding中的emb_size和实际的不符而报错) 2) 如果配置的fluid.layers.embedding的name在config_fleet.py的config词典的key中,但config_fleet.py中的sparse_embdex_dim + 3 != fluid.layers.embedding中的fea_dim,则直接进行报错
修改后报错日志: