Is GossipSub working as expected?

[weijiewu8]

If GossipSub is working as expected then orders should be propagated really quickly.
Consider the time point when an order is propagated for the first time by some peer in Mesh, for all peers that are online at that moment, they should receive the order really quickly (hopefully within 1-2 seconds). This is because according to the mechanism of GossipSub, a subset of the neighboring peers (between 4 to 12, by default) should receive the order from the first sender, then each of these neighboring peers should immediately forward this order to its own neighboring peers (again, between 4 to 12), and the process should be going on so that nearly all peers in Mesh should receive the order really quickly.

However, we found many cases per day where an order can take more than 10 seconds to reach the peers, and there are occasionally cases that take minutes. It's questionable whether GossipSub is working as we expect.

[albrow]

This should be fixed by #692. We just need to run more simulations/tests to confirm.