The current implementation automatically uses one IPv4 address Ansible finds as fact for connections. This works with nodes with one interface but it may or may not work with multihomed hosts.
We need a way to tackle this issue in a default way. Solutions to bin different connections to different networks is definitely a "nice to have" but beyond the scope of a single issue.