[release-v1.34] Auto pick #3381: Fix deadlock where terminating resources were never

[caseydavenport]

Cherry pick of #3381 on release-v1.34.

#3381: Fix deadlock where terminating resources were never

Original PR Body below

Description

Originally spotted in this comment: projectcalico/calico#8368 (comment)

The operator only removes the CNI protector finalizers on these resources when the Installation is Terminating. However, in practice there are other scenarios that might result in these resources being deleted. In those cases, we should allow the deletion to complete and immmediately recreate them. Otherwise, they will be stuck terminating forever and be left in a broken state.

Fixes projectcalico/calico#8368

For PR author

• Tests for change.
• If changing pkg/apis/, run make gen-files
• If changing versions, run make gen-versions

For PR reviewers

A note for code reviewers - all pull requests must have the following:

• Milestone set according to targeted release.
• Appropriate labels:
  • kind/bug if this is a bugfix.
  • kind/enhancement if this is a a new feature.
  • enterprise if this PR applies to Calico Enterprise only.