AWS flake: network.LoadBalancersClient#CreateOrUpdate: Failure

[s-urbaniak]

Error applying plan:

1 error(s) occurred:

* module.vnet.azurerm_lb_probe.console-lb (destroy): 1 error(s) occurred:

* azurerm_lb_probe.console-lb: Error Creating/Updating LoadBalancer network.LoadBalancersClient#CreateOrUpdate: Failure responding to request: StatusCode=429 -- Original Error: autorest/azure: Service returned an error. Status=429 Code="RetryableError" Message="A retryable error occurred." Details=[{"code":"ReferencedResourceNotProvisioned","message":"Cannot proceed with operation because resource /subscriptions/****/resourceGroups/tectonic-cluster-example-pr-1389-801234567890/providers/Microsoft.Network/networkInterfaces/example-pr-1389-801234567890-master-0/ipConfigurations/example-pr-1389-801234567890-MasterIPConfiguration used by resource /subscriptions/****/resourceGroups/tectonic-cluster-example-pr-1389-801234567890/providers/Microsoft.Network/loadBalancers/example-pr-1389-801234567890-api-lb is not in Succeeded state. Resource is in Deleting state and the last operation that updated/is updating the resource is DeleteNicOperation."}]

xref #1054 (comment)

[cpanato]

saw the same in another test:

* module.vnet.azurerm_lb_probe.ssh-lb (destroy): 1 error(s) occurred:

* azurerm_lb_probe.ssh-lb: Error Creating/Updating LoadBalancer network.LoadBalancersClient#CreateOrUpdate: Failure responding to request: StatusCode=429 -- Original Error: autorest/azure: Service returned an error. Status=429 Code="RetryableError" Message="A retryable error occurred." Details=[{"code":"ReferencedResourceNotProvisioned","message":"Cannot proceed with operation because resource /subscriptions/****/resourceGroups/tectonic-cluster-exper-pr-1470-30123456789012/providers/Microsoft.Network/networkInterfaces/exper-pr-1470-30123456789012-master-0/ipConfigurations/exper-pr-1470-30123456789012-MasterIPConfiguration used by resource /subscriptions/****/resourceGroups/tectonic-cluster-exper-pr-1470-30123456789012/providers/Microsoft.Network/loadBalancers/exper-pr-1470-30123456789012-api-lb is not in Succeeded state. Resource is in Deleting state and the last operation that updated/is updating the resource is DeleteNicOperation."}]

[mxinden]

Happened again here: https://jenkins-tectonic-installer.prod.coreos.systems/blue/organizations/jenkins/tectonic-installer/detail/PR-1608/2/pipeline/65

[mxinden]

Occured again in https://jenkins-tectonic-installer.prod.coreos.systems/blue/organizations/jenkins/tectonic-installer/detail/master/80/pipeline/65