fix deleting management cluster clean up avi resource error in long latency condition

[XudongLiuHarold]

Signed-off-by: Xudong Liu xudongl@vmware.com

What this PR does / why we need it

Fix when the network condition is poor, clean up avi resources could cause the management cluster deletion failed error.

Which issue(s) this PR fixes

Fixes #2330

Describe testing done for PR

• launched vSphere testbed, create and delete management cluster several times to verify this change, and test passed.

Release note

deleting management cluster can run successfully even in high latency network env.

PR Checklist

• Squash the commits into one or a small number of logical commits
  
• Use good commit messages
• Ensure PR contains terms all contributors can understand and links all contributors can access

Additional information

Special notes for your reviewer

[github-actions]

Cluster Generation A/B Results:
https://storage.googleapis.com/tkg-clustergen/2329/20220509021415/clustergen.diff.txt
Author/reviewers:
Please review to verify that the effects on the generated cluster configurations are exactly what the PR intended, and give a thumbs-up if so.

[XudongLiuHarold]

/test install-vc7

[alfredthenarwhal]

@XudongLiuHarold: /test install-vc7
Commit: 669d2f0

Tests failed! Build no: 1947

[github-actions]

Cluster Generation A/B Results:
https://storage.googleapis.com/tkg-clustergen/2329/20220511194658/clustergen.diff.txt
Author/reviewers:
Please review to verify that the effects on the generated cluster configurations are exactly what the PR intended, and give a thumbs-up if so.

[github-actions]

Cluster Generation A/B Results:
https://storage.googleapis.com/tkg-clustergen/2329/20220517210716/clustergen.diff.txt
Author/reviewers:
Please review to verify that the effects on the generated cluster configurations are exactly what the PR intended, and give a thumbs-up if so.

[github-actions]

Cluster Generation A/B Results:
https://storage.googleapis.com/tkg-clustergen/2329/20220517211538/clustergen.diff.txt
Author/reviewers:
Please review to verify that the effects on the generated cluster configurations are exactly what the PR intended, and give a thumbs-up if so.

[github-actions]

Cluster Generation A/B Results:
https://storage.googleapis.com/tkg-clustergen/2329/20220517225830/clustergen.diff.txt
Author/reviewers:
Please review to verify that the effects on the generated cluster configurations are exactly what the PR intended, and give a thumbs-up if so.

[XudongLiuHarold]

/test install-vc7

[alfredthenarwhal]

@XudongLiuHarold: /test install-vc7
Commit: 49c51d7

Tests failed! Build no: 2025

[github-actions]

Cluster Generation A/B Results:
https://storage.googleapis.com/tkg-clustergen/2329/20220519182434/clustergen.diff.txt
Author/reviewers:
Please review to verify that the effects on the generated cluster configurations are exactly what the PR intended, and give a thumbs-up if so.

[XudongLiuHarold]

/test install-vc7

[github-actions]

Cluster Generation A/B Results:
https://storage.googleapis.com/tkg-clustergen/2329/20220519183514/clustergen.diff.txt
Author/reviewers:
Please review to verify that the effects on the generated cluster configurations are exactly what the PR intended, and give a thumbs-up if so.

[alfredthenarwhal]

@XudongLiuHarold: /test install-vc7
Commit: 8f3b777

Tests failed! Build no: 2026

[danniel1205]

/lgtm, thanks for the PR. Let's fix the linter.

[danniel1205]

I see this change has been tested from the bot comment, thanks for having it tested. Could you also help updating the PR description by adding something in Describe testing done for PR ?

[github-actions]

Cluster Generation A/B Results:
https://storage.googleapis.com/tkg-clustergen/2329/20220520200345/clustergen.diff.txt
Author/reviewers:
Please review to verify that the effects on the generated cluster configurations are exactly what the PR intended, and give a thumbs-up if so.

[codecov]

Codecov Report

❗ No coverage uploaded for pull request base (main@3659261). Click here to learn what that means.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main    #2329   +/-   ##
=======================================
  Coverage        ?   42.37%           
=======================================
  Files           ?      392           
  Lines           ?    38966           
  Branches        ?        0           
=======================================
  Hits            ?    16510           
  Misses          ?    20911           
  Partials        ?     1545           

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3659261...ee47456. Read the comment docs.