[BUG] Invalidate trace cache @ step 975: expected module 1003, but got module 1003

[cbiras]

Describe the bug
I am using pytorch lightning with deepspeed zero3, with offload. Each step of the training, I am receiving the following warning: "Invalidate trace cache @ step 975: expected module 1003, but got module 1003"
I saw other issues with the same bug, but none that prints the same module.

[tjruwase]

Fixed by #7039