Reset env_info

[neal2164]

DI-engine/ding/framework/middleware/functional/collector.py

Line 163 in de9ada0

episode_info.append(info)

There should be a line like "env_info[timestep.env_id.item()] = {'time': 0., 'step': 0, 'train_sample': 0}" here. Otherwise, the value of env_info keeps accumulating and doesn't represent the intended statistics anymore.

[PaParaZz1]

Thanks for your feedback. We have added this reset mechanism for env_info in the above commit, add related unittest modules are also improved to check its correctness.