why did the memory occupy increasely always

[wang88256187]

No description provided.

[ghost]

Same problem for me. When i ran the notebook on Google Colab the RAM rans out of memory, any solution for this? Do we have to add some cache emptying somewhere in the while not done loop?

[kevingoh]

I think I found the reason, it is in the varupdate() method when summing up random rewards, it needs to be detached otherwise computational graph memory consumption will build up.

[kevingoh]

Does this notebook really work??? All the NNs do not have non-linearity layers between Conv Layers...