[FLINK-32416] Fix flaky tests by ensuring test utilities produce reco… #272

Job	Run time
compile_and_test (1.17.1, 8) / compile_and_test (8)	5m 42s
compile_and_test (1.17.1, 11) / compile_and_test (11)	6m 18s
compile_and_test (1.18.0, 11) / compile_and_test (11)	5m 59s
compile_and_test (1.18.0, 17) / compile_and_test (17)	5m 59s
compile_and_test (1.18.0, 8) / compile_and_test (8)	6m 0s
python_test (1.17.1) / python_test (8)	4m 18s
python_test (1.18.0) / python_test (8)	4m 12s
	38m 28s

Provide feedback