Fix flip consistent test bug

[BBuf]

解决：https://github.com/Oneflow-Inc/OneTeam/issues/1012#issuecomment-1038801402 。

python3 -m oneflow.distributed.launch --master_port=23452 --nproc_per_node=2 /home/zhangxiaoyu/oneflow/python/oneflow/test/modules/test_consistent_flip.py --verbose --failfast

[wyushun]

review done.

[github-actions]

Code got formatted by CI. Please request CI again if you still want to have this PR merged. If the PR is from a forked repo, please download the patch files from the GitHub Actions web page and apply them locally.

[github-actions]

CI failed when running job: cpu-module. PR label automerge has been removed

[github-actions]

CI failed when running job: cuda-module. PR label automerge has been removed

[github-actions]

Speed stats:

GPU Name: GeForce GTX 1080 

✔️ OneFlow resnet50 time: 128.5ms (= 12851.1ms / 100, input_shape=[16, 3, 224, 224])
PyTorch resnet50 time: 140.7ms (= 14069.9ms / 100, input_shape=[16, 3, 224, 224])
✔️ Relative speed: 1.09 (= 140.7ms / 128.5ms)

✔️ OneFlow resnet50 time: 78.5ms (= 7853.4ms / 100, input_shape=[8, 3, 224, 224])
PyTorch resnet50 time: 84.3ms (= 8427.1ms / 100, input_shape=[8, 3, 224, 224])
✔️ Relative speed: 1.07 (= 84.3ms / 78.5ms)

OneFlow resnet50 time: 52.4ms (= 10486.4ms / 200, input_shape=[4, 3, 224, 224])
PyTorch resnet50 time: 58.2ms (= 11633.7ms / 200, input_shape=[4, 3, 224, 224])
✔️ Relative speed: 1.11 (= 58.2ms / 52.4ms)

OneFlow resnet50 time: 44.1ms (= 8815.3ms / 200, input_shape=[2, 3, 224, 224])
PyTorch resnet50 time: 46.9ms (= 9385.9ms / 200, input_shape=[2, 3, 224, 224])
✔️ Relative speed: 1.06 (= 46.9ms / 44.1ms)

OneFlow resnet50 time: 39.2ms (= 7844.3ms / 200, input_shape=[1, 3, 224, 224])
PyTorch resnet50 time: 37.4ms (= 7487.6ms / 200, input_shape=[1, 3, 224, 224])
✔️ Relative speed: 0.95 (= 37.4ms / 39.2ms)

✔️ OneFlow resnet50 time: 140.9ms (= 14088.0ms / 100, input_shape=[16, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 161.7ms (= 16173.9ms / 100, input_shape=[16, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.15 (= 161.7ms / 140.9ms)

OneFlow resnet50 time: 89.5ms (= 8954.2ms / 100, input_shape=[8, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 101.7ms (= 10167.7ms / 100, input_shape=[8, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.14 (= 101.7ms / 89.5ms)

OneFlow resnet50 time: 61.2ms (= 12249.3ms / 200, input_shape=[4, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 73.3ms (= 14656.1ms / 200, input_shape=[4, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.20 (= 73.3ms / 61.2ms)

OneFlow resnet50 time: 53.7ms (= 10745.2ms / 200, input_shape=[2, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 65.8ms (= 13152.1ms / 200, input_shape=[2, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.22 (= 65.8ms / 53.7ms)

OneFlow resnet50 time: 48.2ms (= 9641.2ms / 200, input_shape=[1, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 64.9ms (= 12981.2ms / 200, input_shape=[1, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.35 (= 64.9ms / 48.2ms)