BUG: Resources stuck in provisioning

[MagnusRef]

Problem Description

Based on previous slack conversation: https://projectsveltos.slack.com/archives/C046P825BBL/p1704806833044409

Cluster summary stays in provsioning state after resoruces have been deployed.

Test resoruces:

---
apiVersion: v1
data:
  ns.yaml: |
    apiVersion: v1
    kind: Namespace
    metadata:
      creationTimestamp: null
      name: test
      namespace: default
    spec: {}
    status: {}
kind: ConfigMap
metadata:
  creationTimestamp: null
  name: test
---
apiVersion: config.projectsveltos.io/v1alpha1
kind: ClusterProfile
metadata:
  name: test
spec:
  clusterSelector: env=dev
  policyRefs:
  - name: test
    namespace: default
    kind: ConfigMap

resource in managed cluster:

k describe namespaces test --kubeconfig test-config                                                          
Name:         test
Labels:       kubernetes.io/metadata.name=test
              projectsveltos.io/reason=Resources
              projectsveltos.io/reference-kind=ConfigMap
              projectsveltos.io/reference-name=test
              projectsveltos.io/reference-namespace=default
Annotations:  projectsveltos.io/hash: sha256:e495e475662b02df5ddbb8ab3cf00a69e5a62bb72a7b0fdb958f6ac6276cc04e
Status:       Active

cluster summary:

 k describe clustersummaries.config.projectsveltos.io -n org-azure-workload
Name:         test-capi-magchr-dev-c2
Namespace:    org-azure-workload
Labels:       projectsveltos.io/cluster-name=magchr-dev-c2
              projectsveltos.io/cluster-profile-name=test
              projectsveltos.io/cluster-type=Capi
Annotations:  <none>
API Version:  config.projectsveltos.io/v1alpha1
Kind:         ClusterSummary
Metadata:
  Creation Timestamp:  2024-01-09T14:52:47Z
  Finalizers:
    clustersummaryfinalizer.projectsveltos.io
  Generation:  1
  Owner References:
    API Version:     config.projectsveltos.io/v1alpha1
    Kind:            ClusterProfile
    Name:            test
    UID:             d1c5dcf3-a960-4a7c-aea8-a713e070ebf6
  Resource Version:  36612
  UID:               f7f775ab-bc7d-434d-bac3-f3eaaf7eaabf
Spec:
  Cluster Name:       magchr-dev-c2
  Cluster Namespace:  org-azure-workload
  Cluster Profile Spec:
    Cluster Selector:  env=dev
    Policy Refs:
      Deployment Type:       Remote
      Kind:                  ConfigMap
      Name:                  test
      Namespace:             default
    Reloader:                false
    Stop Matching Behavior:  WithdrawPolicies
    Sync Mode:               Continuous
  Cluster Type:              Capi
Status:
  Dependencies:  no dependencies
  Feature Summaries:
    Deployed Group Version Kind:
      Namespace.v1.
    Failure Message:    failed to get API group resources: unable to retrieve the complete list of server APIs: lib.projectsveltos.io/v1alpha1: the
 server could not find the requested resource
    Feature ID:         Resources
    Hash:               SU4trXmta5VHbjHlzcM+osWJeTRN+Ho/hcS0lXJvSPQ=
    Last Applied Time:  2024-01-09T15:17:50Z
    Status:             Provisioning
Events:                 <none>

System Information

CLUSTERAPI VERSION: v1.5.2
SVELTOS VERSION: main
KUBERNETES VERSION: minikube v1.27.4

Logs

from addon-controller

 name="test-capi-magchr-dev-c2" reconcileID="d3175851-143b-4ac7-923b-1426c360bae2" clusternamespace="org-azure-workload" clustername="magchr-dev
-c2" clusternamespace="org-azure-workload" clustername="org-azure-workload" applicant="test-capi-magchr-dev-c2" feature="Resources" hash="494e2
dad79ad6b95476e31e5cdc33ea2c58979344df87a3f85c4b495726f48f4" status="Provisioning"
I0109 15:20:10.705880       1 clustersummary_controller.go:516] "no helm configuration" controller="clustersummary" controllerGroup="config.proje
ctsveltos.io" controllerKind="ClusterSummary" ClusterSummary="org-azure-workload/test-capi-magchr-dev-c2" namespace="org-azure-workload" name="
test-capi-magchr-dev-c2" reconcileID="d3175851-143b-4ac7-923b-1426c360bae2" clusternamespace="org-azure-workload" clustername="magchr-dev-c2"
I0109 15:20:10.705886       1 clustersummary_controller.go:518] "no helm status. Do not reconcile this" controller="clustersummary" controllerGro
up="config.projectsveltos.io" controllerKind="ClusterSummary" ClusterSummary="org-azure-workload/test-capi-magchr-dev-c2" namespace="org-azure-
workload" name="test-capi-magchr-dev-c2" reconcileID="d3175851-143b-4ac7-923b-1426c360bae2" clusternamespace="org-azure-workload" clustername="m
agchr-dev-c2"
I0109 15:20:10.705892       1 clustersummary_controller.go:488] "no policy configuration" controller="clustersummary" controllerGroup="config.pro
jectsveltos.io" controllerKind="ClusterSummary" ClusterSummary="org-azure-workload/test-capi-magchr-dev-c2" namespace="org-azure-workload" name
="test-capi-magchr-dev-c2" reconcileID="d3175851-143b-4ac7-923b-1426c360bae2" clusternamespace="org-azure-workload" clustername="magchr-dev-c2"
I0109 15:20:10.705898       1 clustersummary_controller.go:490] "no policy status. Do not reconcile this" controller="clustersummary" controllerG
roup="config.projectsveltos.io" controllerKind="ClusterSummary" ClusterSummary="org-azure-workload/test-capi-magchr-dev-c2" namespace="org-azur
e-workload" name="test-capi-magchr-dev-c2" reconcileID="d3175851-143b-4ac7-923b-1426c360bae2" clusternamespace="org-azure-workload" clustername=
"magchr-dev-c2"
E0109 15:20:10.705905       1 clustersummary_controller.go:350] "failed to deploy" err="feature is still being provisioned" controller="clustersu
mmary" controllerGroup="config.projectsveltos.io" controllerKind="ClusterSummary" ClusterSummary="org-azure-workload/test-capi-magchr-dev-c2" na
mespace="org-azure-workload" name="test-capi-magchr-dev-c2" reconcileID="d3175851-143b-4ac7-923b-1426c360bae2"
I0109 15:20:10.706064       1 controller.go:331] "Reconcile done, requeueing after 10s" controller="clustersummary" controllerGroup="config.proje
ctsveltos.io" controllerKind="ClusterSummary" ClusterSummary="org-azure-workload/test-capi-magchr-dev-c2" namespace="org-azure-workload" name="
test-capi-magchr-dev-c2" reconcileID="d3175851-143b-4ac7-923b-1426c360bae2"

[gianlucam76]

Thank you @MagnusRef