Skip to content

CB Dragonfly FW Test for CafeLatte Release (v0.6.0)

innogrid edited this page Dec 13, 2023 · 3 revisions
  • [CB-Dragonfly 테스트 환경]

    • 쿠버네티스 기반 우분투 파드
    • CB-Operator Docker-compose 기반
    • CB-Operator Helm(Kubernetes) 기반
  • [Test Tools]

  • [시험 주안점]

    키워드 주안점 결과
    구동 환경 DF가 Go Binary, Docker-compose, Kubernetes 환경에서 정상동작 하는가?) Pass
    에이전트 설치 및 구동 Go Binary, 컨테이너, 쿠버네티스 환경의 DF 기반 MCIS 에이전트 및 MCK8S 에이전트 통합 설치가 가능한가? Pass
    메트릭 수집 설치된 에이전트들의 종류에 상관없이 통합 모니터링 메트릭 수집이 정상적으로 가능한가? Pass
    콜렉터 스케일링 환경 설정 기반 서비스별 콜렉터가 정상적으로 스케일링 하는가? Pass
    메트릭 Aggregate 모니터링 메트릭 Aggregate 기능에 이상이 있는가? Pass
    메트릭 조회 모니터링 메트릭 통합 조회가 가능한가? Pass
  • [시험 결과]

    [DF가 Go Binary, Docker-compose, Kubernetes 환경에서 정상동작 하는가?]
    환경 설치 결과 구동 결과
    Go Binary 정상 정상
    Docker-compose 정상 정상
    Kubernetes 정상 정상
    • Go Binary

      GOROOT=/usr/local/go #gosetup
      GOPATH=/home/pjini/project/gosrc/cloud-barista #gosetup
      /usr/local/go/bin/go build -o /tmp/GoLand/___cb_dragonfly . #gosetup
      /tmp/GoLand/___cb_dragonfly
      INFO[0005] create tick file with name default.tick
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:36, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.initialize() - ######## dbfile: /home/pjini/project/gosrc/cloud-barista/src/github.com/cloud-barista/cb-dragonfly/meta_db/dat
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/monitoring/configs/mck8s_collector_interval, value:60
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/monitoring/configs/monitoring_policy, value:agentCount
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/monitoring/configs/max_host_count, value:5
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/monitoring/configs/default_policy, value:push
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/monitoring/configs/puller_interval, value:10
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/monitoring/configs/puller_aggregate_interval, value:30
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/monitoring/configs/aggregate_type, value:avg
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/monitoring/configs/agent_interval, value:2
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/monitoring/configs/mcis_collector_interval, value:10
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/monitoring/configs/deploy_type, value:dev
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:160, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).GetList() - Key:/push/topic
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/monitoring/collectorPolicy
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/push/collectorTopicMap
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/monitoring/collectorPolicy, value:AGENTCOUNT
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:160, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).GetList() - Key:/mck8s/push/topic
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/mck8s/push/collectorTopicMap
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/monitoring/collectorPolicy
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/monitoring/configs/mcis_collector_interval
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/monitoring/collectorPolicy, value:AGENTCOUNT
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/monitoring/configs/mck8s_collector_interval
      [CLOUD-BARISTA].[INFO]: 2022-07-05 19:53:05 apiserver.go:42, github.com/cloud-barista/cb-dragonfly/pkg/api.(*APIServer).StartAPIServer() - start CB-Dragonfly Framework API Server
      
      ____    __
      / __/___/ /  ___
      / _// __/ _ \/ _ \
      /___/\__/_//_/\___/ v4.3.0
      High performance, minimalist Go web framework
      https://echo.labstack.com
      ____________________________________O/_______
      O\
      ⇨ http server started on [::]:9090
      
    • Docker-Compose

      root@operator:~/project/gosrc/cloud-barista/src/github.com/cloud-barista/cb-operator/docker-compose-mode-files# docker-compose -f docker-compose-df-only.yaml up -d
      Creating network "docker-compose-mode-files_default" with the default driver
      Creating cb-dragonfly-zookeeper ... done
      Creating cb-dragonfly-influxdb  ... done
      Creating cb-dragonfly-kafka     ... done
      Creating cb-dragonfly-kapacitor ... done
      Creating cb-dragonfly           ... done
      root@operator:~/project/gosrc/cloud-barista/src/github.com/cloud-barista/cb-operator/docker-compose-mode-files# docker ps
      CONTAINER ID   IMAGE                                                              COMMAND                  CREATED          STATUS         PORTS                                                NAMES
      af8eccc02701   harbor.innogrid.com/cb-operator/cb-dragonfly:0.6.0                 "cb-dragonfly"           4 seconds ago    Up 2 seconds   0.0.0.0:9090->9090/tcp, 0.0.0.0:9999->9999/tcp       cb-dragonfly
      45f5460e3284   harbor.innogrid.com/cb-operator/cb-dragonfly-kapacitor:1.5         "/entrypoint.sh kapa…"   6 seconds ago    Up 4 seconds   0.0.0.0:29092->9092/tcp                              cb-dragonfly-kapacitor
      afb2080ce4f1   harbor.innogrid.com/cb-operator/cb-dragonfly-kafka:2.12-2.4.1      "start-kafka.sh"         11 seconds ago   Up 9 seconds   0.0.0.0:9092->9092/tcp                               cb-dragonfly-kafka
      fe7b2f36aa68   harbor.innogrid.com/cb-operator/cb-dragonfly-influxdb:1.8-alpine   "/entrypoint.sh infl…"   11 seconds ago   Up 6 seconds   0.0.0.0:28086->8086/tcp, 0.0.0.0:28088->8088/tcp     cb-dragonfly-influxdb
      b64723eb83a9   harbor.innogrid.com/cb-operator/cb-dragonfly-zookeeper:latest      "/bin/sh -c '/usr/sb…"   11 seconds ago   Up 7 seconds   22/tcp, 2888/tcp, 3888/tcp, 0.0.0.0:2181->2181/tcp   cb-dragonfly-zookeeper
      
    • Kubernetes

      $ helm install dragonfly -n cloud-barista ./cb-dragonfly/
      coalesce.go:175: warning: skipped value for kafka.image: Not a table.
      W0706 10:07:25.587773   21246 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
      W0706 10:07:25.634670   21246 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
      NAME: dragonfly
      LAST DEPLOYED: Wed Jul  6 10:07:24 2022
      NAMESPACE: cloud-barista
      STATUS: deployed
      REVISION: 1
      TEST SUITE: None
      NOTES:
      1. Get the application URL by running these commands:
      export NODE_PORT=$(kubectl get --namespace cloud-barista -o jsonpath="{.spec.ports[0].nodePort}" services cb-dragonfly)
      export NODE_IP=$(kubectl get nodes --namespace cloud-barista -o jsonpath="{.items[0].status.addresses[0].address}")
      echo http://$NODE_IP:$NODE_PORT
      
      
      [root@master helm]# kubectl get all -n cloud-barista
      NAME                                      READY   STATUS    RESTARTS      AGE
      pod/cb-dragonfly-68c965b96f-hlh4x         1/1     Running   1 (86s ago)   94s
      pod/cb-dragonfly-influxdb-0               1/1     Running   0             94s
      pod/cb-dragonfly-kafka-0                  0/1     Running   0             12s
      pod/cb-dragonfly-zookeeper-0              1/1     Running   0             94s
      pod/dragonfly-kapacitor-ff97f66cb-mbggg   1/1     Running   0             94s
      
      NAME                                      TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)                         AGE
      service/cb-dragonfly                      NodePort    10.97.226.16     <none>        9090:30090/TCP,9999:30999/TCP   94s
      service/cb-dragonfly-influxdb             ClusterIP   10.100.3.172     <none>        8086/TCP,8088/TCP               94s
      service/cb-dragonfly-kafka                ClusterIP   10.110.174.205   <none>        9092/TCP,32000/TCP              94s
      service/cb-dragonfly-kafka-0-external     NodePort    10.100.35.96     <none>        9092:32000/TCP                  94s
      service/cb-dragonfly-kafka-headless       ClusterIP   None             <none>        9092/TCP                        94s
      service/cb-dragonfly-zookeeper            ClusterIP   10.102.41.63     <none>        2181/TCP                        94s
      service/cb-dragonfly-zookeeper-headless   ClusterIP   None             <none>        2181/TCP,3888/TCP,2888/TCP      94s
      service/dragonfly-kapacitor               ClusterIP   10.108.51.191    <none>        9092/TCP                        94s
      
      NAME                                  READY   UP-TO-DATE   AVAILABLE   AGE
      deployment.apps/cb-dragonfly          1/1     1            1           94s
      deployment.apps/dragonfly-kapacitor   1/1     1            1           94s
      
      NAME                                            DESIRED   CURRENT   READY   AGE
      replicaset.apps/cb-dragonfly-68c965b96f         1         1         1       94s
      replicaset.apps/dragonfly-kapacitor-ff97f66cb   1         1         1       94s
      
      NAME                                      READY   AGE
      statefulset.apps/cb-dragonfly-influxdb    1/1     94s
      statefulset.apps/cb-dragonfly-kafka       0/1     94s
      statefulset.apps/cb-dragonfly-zookeeper   1/1     94s
      [root@master helm]# watch -n 1 'kubectl get all -n cloud-barista'
      [root@master helm]# kubectl get all -n cloud-barista
      NAME                                      READY   STATUS    RESTARTS       AGE
      pod/cb-dragonfly-68c965b96f-hlh4x         1/1     Running   1 (2m7s ago)   2m15s
      pod/cb-dragonfly-influxdb-0               1/1     Running   0              2m15s
      pod/cb-dragonfly-kafka-0                  1/1     Running   0              53s
      pod/cb-dragonfly-zookeeper-0              1/1     Running   0              2m15s
      pod/dragonfly-kapacitor-ff97f66cb-mbggg   1/1     Running   0              2m15s
      
      NAME                                      TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)                         AGE
      service/cb-dragonfly                      NodePort    10.97.226.16     <none>        9090:30090/TCP,9999:30999/TCP   2m15s
      service/cb-dragonfly-influxdb             ClusterIP   10.100.3.172     <none>        8086/TCP,8088/TCP               2m15s
      service/cb-dragonfly-kafka                ClusterIP   10.110.174.205   <none>        9092/TCP,32000/TCP              2m15s
      service/cb-dragonfly-kafka-0-external     NodePort    10.100.35.96     <none>        9092:32000/TCP                  2m15s
      service/cb-dragonfly-kafka-headless       ClusterIP   None             <none>        9092/TCP                        2m15s
      service/cb-dragonfly-zookeeper            ClusterIP   10.102.41.63     <none>        2181/TCP                        2m15s
      service/cb-dragonfly-zookeeper-headless   ClusterIP   None             <none>        2181/TCP,3888/TCP,2888/TCP      2m15s
      service/dragonfly-kapacitor               ClusterIP   10.108.51.191    <none>        9092/TCP                        2m15s
      
      NAME                                  READY   UP-TO-DATE   AVAILABLE   AGE
      deployment.apps/cb-dragonfly          1/1     1            1           2m15s
      deployment.apps/dragonfly-kapacitor   1/1     1            1           2m15s
      
      NAME                                            DESIRED   CURRENT   READY   AGE
      replicaset.apps/cb-dragonfly-68c965b96f         1         1         1       2m15s
      replicaset.apps/dragonfly-kapacitor-ff97f66cb   1         1         1       2m15s
      
      NAME                                      READY   AGE
      statefulset.apps/cb-dragonfly-influxdb    1/1     2m15s
      statefulset.apps/cb-dragonfly-kafka       1/1     2m15s
      statefulset.apps/cb-dragonfly-zookeeper   1/1     2m15s
      
    [Go Binary, 컨테이너, 쿠버네티스 환경의 DF 기반 MCIS 에이전트 및 MCK8S 에이전트 통합 설치가 가능한가?]
    구동 환경 서비스 설치 결과 구동 결과
    Go Binary
    Docker-compose
    Kubernetes
    MCIS 정상 정상
    MCK8S 정상 정상
    • DF 서버
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:41, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.Connect() - call Connect()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/monitoring/agents/test_ns_mcis_test_mcis_vm-3_test_csp
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/monitoring/agents/test_ns_mcis_test_mcis_vm-1_test_csp
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:133, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.SSHRun() - call SSHRun()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:41, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.Connect() - call Connect()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:133, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.SSHRun() - call SSHRun()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:41, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.Connect() - call Connect()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:90, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.RunCommand() - call RunCommand()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:90, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.RunCommand() - call RunCommand()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:90, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.RunCommand() - call RunCommand()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:84, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.Close() - call Close()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:84, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.Close() - call Close()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:133, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.SSHRun() - call SSHRun()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:133, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.SSHRun() - call SSHRun()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:84, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.Close() - call Close()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:41, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.Connect() - call Connect()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:41, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.Connect() - call Connect()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:133, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.SSHRun() - call SSHRun()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:45 sshrun.go:41, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.Connect() - call Connect()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:46 sshrun.go:90, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.RunCommand() - call RunCommand()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:46 sshrun.go:90, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.RunCommand() - call RunCommand()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:46 sshrun.go:90, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.RunCommand() - call RunCommand()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:46 sshrun.go:84, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.Close() - call Close()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:47 sshrun.go:84, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.Close() - call Close()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:47 sshrun.go:84, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.Close() - call Close()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:48 nutsdb-driver.go:160, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).GetList() - Key:/monitoring/agents/
    [2022-07-06T10:42:48+09:00] <MCK8S> collector scheduler - Now Scheduling ###
    [2022-07-06T10:42:48+09:00] <MCK8S> Add Topics Queue ## : [ns-02_mck8s_mcks-51]
    [2022-07-06T10:42:48+09:00] <MCK8S> Del Topics Queue ## : []
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:48 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/mck8s/push/topic/ns-02_mck8s_mcks-51
    %4|1657071768.878|CONFWARN|rdkafka#producer-1| [thrd:app]: Configuration property group.id is a consumer property and will be ignored by this producer instance
    %4|1657071768.879|CONFWARN|rdkafka#producer-1| [thrd:app]: Configuration property enable.auto.commit is a consumer property and will be ignored by this producer instance
    %4|1657071768.879|CONFWARN|rdkafka#producer-1| [thrd:app]: Configuration property auto.offset.reset is a consumer property and will be ignored by this producer instance
    [2022-07-06T10:42:48+09:00] <MCK8S> CREATE collector
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:48 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/mck8s/push/collectorTopicMap, value:{"TopicMap":{"ns-02_mck8s_mcks-51":["ns-02_mck8s_mcks-51"]}}
    [2022-07-06T10:42:48+09:00] <MCK8S> EXECUTE Group_0 collector - topic: ns-02_mck8s_mcks-51
    [2022-07-06T10:42:48+09:00] <MCIS> collector scheduler - Now Scheduling ###
    [2022-07-06T10:42:48+09:00] <MCIS> Add Topics Queue ## : []
    [2022-07-06T10:42:48+09:00] <MCIS> Del Topics Queue ## : []
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:48 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/push/collectorTopicMap, value:{"TopicMap":{},"CollectorPerAgentCnt":[]}
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:51 sshrun.go:133, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.SSHRun() - call SSHRun()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:51 sshrun.go:41, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.Connect() - call Connect()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:51 sshrun.go:133, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.SSHRun() - call SSHRun()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:51 sshrun.go:41, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.Connect() - call Connect()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:51 sshrun.go:90, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.RunCommand() - call RunCommand()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:51 sshrun.go:90, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.RunCommand() - call RunCommand()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:51 nutsdb-driver.go:160, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).GetList() - Key:/monitoring/agents/
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:52 sshrun.go:133, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.SSHRun() - call SSHRun()
    [CLOUD-BARISTA].[INFO]: 2022-07-06 10:42:52 sshrun.go:41, github.com/cloud-barista/cb-spider/cloud-control-manager/vm-ssh.Connect() - call Connect()
    
    • MCIS 에이전트
    root@ubuntu-agent-test-1:/# systemctl status telegraf
    ● telegraf.service - The plugin-driven server agent for reporting metrics into InfluxDB
    Loaded: loaded (/lib/systemd/system/telegraf.service; enabled; vendor preset: enabled)
    Active: active (running) since Wed 2022-07-06 01:44:43 UTC; 4min 55s ago
    Docs: https://github.com/influxdata/telegraf
    Main PID: 1652 (telegraf)
    Tasks: 15 (limit: 737)
    CGroup: /kubepods.slice/kubepods-podffaff76f_e496_4ba5_bafa_9010e4150161.slice/docker-0bc49d9434159e510bda45db84954c2a7d96c271e79b949aab556aad774b520d.scope/system.slice/telegraf.service
    └─1652 /usr/bin/telegraf -config /etc/telegraf/telegraf.conf
    
    Jul 06 01:44:44 ubuntu-agent-test-1 telegraf[1652]:  / _// __/ _ \/ _ \
    Jul 06 01:44:44 ubuntu-agent-test-1 telegraf[1652]: /___/\__/_//_/\___/ v3.3.10-dev
    Jul 06 01:44:44 ubuntu-agent-test-1 telegraf[1652]: High performance, minimalist Go web framework
    Jul 06 01:44:44 ubuntu-agent-test-1 telegraf[1652]: https://echo.labstack.com
    Jul 06 01:44:44 ubuntu-agent-test-1 telegraf[1652]: ____________________________________O/_______
    Jul 06 01:44:44 ubuntu-agent-test-1 telegraf[1652]:                                     O\
    Jul 06 01:44:44 ubuntu-agent-test-1 telegraf[1652]: 2022-07-06T01:44:44Z I! Monitoring Server url confirmed, address:  210.207.104.156:9090
    Jul 06 01:44:44 ubuntu-agent-test-1 telegraf[1652]: ⇨ http server started on [::]:8888
    Jul 06 01:44:44 ubuntu-agent-test-1 telegraf[1652]: 2022-07-06T01:44:44Z I! Agent IP confirmed, IP:  10.100.42.204
    Jul 06 01:44:44 ubuntu-agent-test-1 telegraf[1652]: 2022-07-06T01:44:44Z I! Starting Telegraf
    
    • MCK8S 에이전트
    root@operator:~/kubeconfig$ kubectl get all -n cb-dragonfly
    NAME                           READY   STATUS    RESTARTS   AGE
    pod/cb-dragonfly-agent-dbnqq   1/1     Running   0          9m2s
    
    NAME                                DESIRED   CURRENT   READY   UP-TO-DATE   AVAILABLE   NODE SELECTOR   AGE
    daemonset.apps/cb-dragonfly-agent   1         1         1       1            1           <none>          9m2s
    
    [설치된 에이전트들의 종류에 상관없이 통합 모니터링 메트릭 수집이 정상적으로 가능한가?]
    서비스 모니터링 메커니즘 설치 결과 구동 결과
    MCIS PUSH 정상 정상
    PULL 정상 정상
    ONDEMAND 정상 정상
    MCK8S PUSH 정상 정상
    PULL - -
    ONDEMAND - -
    • MCIS 메트릭 수집
    Group_0 collector Delivered : [test_ns_mcis_test_mcis_vm-1_test_csp test_ns_mcis_test_mcis_vm-2_test_csp test_ns_mcis_test_mcis_vm-3_test_csp]
    [CLOUD-BARISTA].[INFO]: 2022-07-06 16:52:02 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/push/collectorTopicMap, value:{"TopicMap":{"0":["test_ns_mcis_test_mcis_vm-1_test_csp","test_ns_mcis_test_mcis_vm-2
    _test_csp","test_ns_mcis_test_mcis_vm-3_test_csp"]},"CollectorPerAgentCnt":[3]}
    [test_ns_mcis_test_mcis_vm-1_test_csp test_ns_mcis_test_mcis_vm-2_test_csp test_ns_mcis_test_mcis_vm-3_test_csp] : 315
    
    Aggregate Time:  923.711658ms
    [2022-07-06T16:52:12+09:00] <MCIS> collector scheduler - Now Scheduling ###
    [2022-07-06T16:52:12+09:00] <MCIS> Add Topics Queue ## : []
    [2022-07-06T16:52:12+09:00] <MCIS> Del Topics Queue ## : []
    Group_0 collector Delivered : [test_ns_mcis_test_mcis_vm-1_test_csp test_ns_mcis_test_mcis_vm-2_test_csp test_ns_mcis_test_mcis_vm-3_test_csp]
    [CLOUD-BARISTA].[INFO]: 2022-07-06 16:52:12 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/push/collectorTopicMap, value:{"TopicMap":{"0":["test_ns_mcis_test_mcis_vm-1_test_csp","test_ns_mcis_test_mcis_vm-2
    _test_csp","test_ns_mcis_test_mcis_vm-3_test_csp"]},"CollectorPerAgentCnt":[3]}
    [test_ns_mcis_test_mcis_vm-1_test_csp test_ns_mcis_test_mcis_vm-2_test_csp test_ns_mcis_test_mcis_vm-3_test_csp] : 315
    
    Aggregate Time:  921.84276ms
    [2022-07-06T16:52:22+09:00] <MCIS> collector scheduler - Now Scheduling ###
    [2022-07-06T16:52:22+09:00] <MCIS> Add Topics Queue ## : []
    [2022-07-06T16:52:22+09:00] <MCIS> Del Topics Queue ## : []
    [CLOUD-BARISTA].[INFO]: 2022-07-06 16:52:22 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/push/collectorTopicMap, value:{"TopicMap":{"0":["test_ns_mcis_test_mcis_vm-1_test_csp","test_ns_mcis_test_mcis_vm-2
    _test_csp","test_ns_mcis_test_mcis_vm-3_test_csp"]},"CollectorPerAgentCnt":[3]}
    Group_0 collector Delivered : [test_ns_mcis_test_mcis_vm-1_test_csp test_ns_mcis_test_mcis_vm-2_test_csp test_ns_mcis_test_mcis_vm-3_test_csp]
    [test_ns_mcis_test_mcis_vm-1_test_csp test_ns_mcis_test_mcis_vm-2_test_csp test_ns_mcis_test_mcis_vm-3_test_csp] : 315
    
    • MCK8S 메트릭 수집
    [CLOUD-BARISTA].[INFO]: 2022-07-06 13:59:03 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/push/collectorTopicMap, value:{"TopicMap":{},"CollectorPerAgentCnt":[]}
    [CLOUD-BARISTA].[INFO]: 2022-07-06 13:59:05 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/monitoring/agents/ns-02_mck8s_mcks-51
    MCK8S Collected Topic ns-02_mck8s_mcks-51 : 1710
    
    [2022-07-06T13:59:05+09:00] <MCK8S> EXECUTE Group_0 aggregator
    [2022-07-06T13:59:13+09:00] <MCIS> collector scheduler - Now Scheduling ###
    [2022-07-06T13:59:13+09:00] <MCIS> Add Topics Queue ## : []
    [2022-07-06T13:59:13+09:00] <MCIS> Del Topics Queue ## : []
    [CLOUD-BARISTA].[INFO]: 2022-07-06 13:59:13 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/push/collectorTopicMap, value:{"TopicMap":{},"CollectorPerAgentCnt":[]}
    [2022-07-06T13:59:23+09:00] <MCIS> collector scheduler - Now Scheduling ###
    [2022-07-06T13:59:23+09:00] <MCIS> Add Topics Queue ## : []
    [2022-07-06T13:59:23+09:00] <MCIS> Del Topics Queue ## : []
    [CLOUD-BARISTA].[INFO]: 2022-07-06 13:59:23 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/push/collectorTopicMap, value:{"TopicMap":{},"CollectorPerAgentCnt":[]}
    
    [환경 설정 기반 서비스별 콜렉터가 정상적으로 스케일링 하는가?]
    구동 환경 서비스 Scale In Scale Out
    Go Binary
    Docker-compose
    Kubernetes
    MCIS 정상 정상
    MCKS 정상 정상
    • MCIS 콜렉터 Scale Out
    CLOUD-BARISTA].[INFO]: 2022-07-06 13:55:57 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/monitoring/agents/test_ns_mcis_test_mcis_vm-1_test_csp
    [CLOUD-BARISTA].[INFO]: 2022-07-06 13:55:57 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/monitoring/agents/test_ns_mcis_test_mcis_vm-1_test_csp, value:{"service_type":"mcis","ns_id":"test_ns","mcis_id":"t
    est_mcis","vm_id":"vm-1","cspType":"test_csp","agent_type":"push","agent_state":"enable","agent_health":"healthy","agent_unhealthy_resp_cnt":0,"public_ip":"10.100.42.219","mck8s_id":""}
    [CLOUD-BARISTA].[INFO]: 2022-07-06 13:55:59 nutsdb-driver.go:160, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).GetList() - Key:/monitoring/agents/
    2022-07-06T13:55:51+09:00] <MCIS> collector scheduler - Now Scheduling ###
    2022-07-06T13:55:51+09:00] <MCIS> Add Topics Queue ## : [test_ns_mcis_test_mcis_vm-1_test_csp test_ns_mcis_test_mcis_vm-3_test_csp]
    2022-07-06T13:55:51+09:00] <MCIS> Del Topics Queue ## : []
    [CLOUD-BARISTA].[INFO]: 2022-07-06 13:56:02 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/push/topic/test_ns_mcis_test_mcis_vm-1_test_csp
    [CLOUD-BARISTA].[INFO]: 2022-07-06 13:56:02 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/push/topic/test_ns_mcis_test_mcis_vm-1_test_csp, value:0
    [CLOUD-BARISTA].[INFO]: 2022-07-06 13:56:02 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/push/topic/test_ns_mcis_test_mcis_vm-3_test_csp
    [CLOUD-BARISTA].[INFO]: 2022-07-06 13:56:02 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/push/topic/test_ns_mcis_test_mcis_vm-3_test_csp, value:0
    [CLOUD-BARISTA].[INFO]: 2022-07-06 13:56:02 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/push/collectorTopicMap, value:{"TopicMap":{"0":["test_ns_mcis_test_mcis_vm-2_test_csp","test_ns_mcis_test_mcis_vm-1
    _test_csp","test_ns_mcis_test_mcis_vm-3_test_csp"]},"CollectorPerAgentCnt":[3]}
    Group_0 collector Delivered : [test_ns_mcis_test_mcis_vm-1_test_csp test_ns_mcis_test_mcis_vm-2_test_csp test_ns_mcis_test_mcis_vm-3_test_csp]
    [test_ns_mcis_test_mcis_vm-1_test_csp test_ns_mcis_test_mcis_vm-2_test_csp test_ns_mcis_test_mcis_vm-3_test_csp] : 104
    
    • MCK8S 콜렉터 Scale Out
    2022-07-06T13:56:52+09:00] <MCK8S> Add Topics Queue ## : [ns-02_mck8s_mcks-51]
    [2022-07-06T13:56:52+09:00] <MCK8S> Del Topics Queue ## : []
    [CLOUD-BARISTA].[INFO]: 2022-07-06 13:56:52 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/mck8s/push/topic/ns-02_mck8s_mcks-51
    [CLOUD-BARISTA].[INFO]: 2022-07-06 13:56:52 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/mck8s/push/topic/ns-02_mck8s_mcks-51, value:0
    %4|1657083413.001|CONFWARN|rdkafka#producer-1| [thrd:app]: Configuration property group.id is a consumer property and will be ignored by this producer instance
    %4|1657083413.001|CONFWARN|rdkafka#producer-1| [thrd:app]: Configuration property enable.auto.commit is a consumer property and will be ignored by this producer instance
    %4|1657083413.001|CONFWARN|rdkafka#producer-1| [thrd:app]: Configuration property auto.offset.reset is a consumer property and will be ignored by this producer instance
    [2022-07-06T13:56:53+09:00] <MCK8S> CREATE collector
    [CLOUD-BARISTA].[INFO]: 2022-07-06 13:56:53 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/mck8s/push/collectorTopicMap, value:{"TopicMap":{"ns-02_mck8s_mcks-51":["ns-02_mck8s_mcks-51"]}}
    [2022-07-06T13:56:53+09:00] <MCK8S> EXECUTE Group_0 collector - topic: ns-02_mck8s_mcks-51
    [2022-07-06T13:56:53+09:00] <MCIS> collector scheduler - Now Scheduling ###
    [2022-07-06T13:56:53+09:00] <MCIS> Add Topics Queue ## : []
    
    • MCIS 콜렉터 Scale IN
    [CLOUD-BARISTA].[INFO]: 2022-07-06 14:13:20 nutsdb-driver.go:160, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).GetList() - Key:/monitoring/agents/
    [CLOUD-BARISTA].[INFO]: 2022-07-06 14:13:23 nutsdb-driver.go:160, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).GetList() - Key:/monitoring/agents/
    [2022-07-06T14:13:30+09:00] <MCIS> collector scheduler - Now Scheduling ###
    [2022-07-06T14:13:30+09:00] <MCIS> Add Topics Queue ## : []
    [2022-07-06T14:13:30+09:00] <MCIS> Del Topics Queue ## : []
    [CLOUD-BARISTA].[INFO]: 2022-07-06 14:13:25 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/push/collectorTopicMap, value:{"TopicMap":{},"CollectorPerAgentCnt":[]}
    [CLOUD-BARISTA].[INFO]: 2022-07-06 14:13:27 nutsdb-driver.go:160, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).GetList() - Key:/monitoring/agents/
    [CLOUD-BARISTA].[INFO]: 2022-07-06 14:13:50 nutsdb-driver.go:160, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).GetList() - Key:/monitoring/agents/
    %5|1657095950.507|REQTMOUT|rdkafka#consumer-3| [thrd:GroupCoordinator]: GroupCoordinator/1001: Timed out LeaveGroupRequest in flight (after 5005ms, timeout #0): possibly held back by preceeding blocking JoinGroupRequest with timeout in 267986ms
    %4|1657095950.507|REQTMOUT|rdkafka#consumer-3| [thrd:GroupCoordinator]: GroupCoordinator/1001: Timed out 1 in-flight, 0 retry-queued, 0 out-queue, 0 partially-sent requests
    %3|1657095950.507|FAIL|rdkafka#consumer-3| [thrd:GroupCoordinator]: GroupCoordinator: 1 request(s) timed out: disconnect (after 285122ms in state UP)
    #### Group_0 collector Delete ####
    [CLOUD-BARISTA].[INFO]: 2022-07-06 14:13:53 nutsdb-driver.go:160, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).GetList() - Key:/monitoring/agents/
    [2022-07-06T14:13:30+09:00] <MCK8S> collector scheduler - Now Scheduling ###
    [2022-07-06T14:13:30+09:00] <MCK8S> Add Topics Queue ## : []
    [2022-07-06T14:13:30+09:00] <MCK8S> Del Topics Queue ## : []
    [CLOUD-BARISTA].[INFO]: 2022-07-06 14:13:54 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/mck8s/push/collectorTopicMap, value:{"TopicMap":{"test_ns_mck8s_mcks-51":["test_ns_mck8s_mcks-51"]}}
    [CLOUD-BARISTA].[INFO]: 2022-07-06 14:13:54 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/mck8s/push/topic/[test_ns_mck8s_mcks-51], value:0
    [2022-07-06T14:13:30+09:00] <MCK8S> EXECUTE Group_0 collector - topic: test_ns_mck8s_mcks-51
    
    • MCK8S 콜렉터 Scale IN
    [2022-07-06T14:13:20+09:00] <MCIS> Add Topics Queue ## : []
    [2022-07-06T14:13:20+09:00] <MCIS> Del Topics Queue ## : []
    [CLOUD-BARISTA].[INFO]: 2022-07-06 14:13:20 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/push/collectorTopicMap, value:{"TopicMap":{},"CollectorPerAgentCnt":[]}
    [2022-07-06T14:13:30+09:00] <MCK8S> collector scheduler - Now Scheduling ###
    [2022-07-06T14:13:30+09:00] <MCK8S> Add Topics Queue ## : []
    [2022-07-06T14:13:30+09:00] <MCK8S> Del Topics Queue ## : [ns-02_mck8s_mcks-51]
    [CLOUD-BARISTA].[INFO]: 2022-07-06 14:13:30 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/monitoring/agents/ns-02_mck8s_mcks-51
    [CLOUD-BARISTA].[INFO]: 2022-07-06 14:13:30 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/mck8s/push/topic/ns-02_mck8s_mcks-51
    [CLOUD-BARISTA].[INFO]: 2022-07-06 14:13:30 nutsdb-driver.go:210, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Delete() - Key:/monitoring/agents/ns-02_mck8s_mcks-51
    [2022-07-06T14:13:30+09:00] <MCK8S> DELETE Group_0 collector
    [2022-07-06T14:13:30+09:00] <MCK8S> Delete collector - topic: ns-02_mck8s_mcks-51
    [CLOUD-BARISTA].[INFO]: 2022-07-06 14:13:30 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/mck8s/push/collectorTopicMap, value:{"TopicMap":{}}
    [2022-07-06T14:13:30+09:00] <MCIS> collector scheduler - Now Scheduling ##
    
    [모니터링 메트릭 통합 조회가 가능한가?]
    구동 환경 서비스 메트릭 종류 조회
    Go Binary
    Docker-compose
    Kubernetes
    MCIS cpu 정상
    cpufreq 정상
    memory 정상
    disk 정상
    network 정상
    MCK8S node 정상
    MCK8S 정상
    • MCIS 메트릭 조회
    {
        "name": "cpu",
        "tags": {
            "vmId": "vm-1"
        },
        "values": [
            {
            "cpu_guest": 14.761987306363956,
            "cpu_guest_nice": 7.595411892498859,
            "cpu_hintr": 85.23801269363605,
            "cpu_idle": 0.012607160868192586,
            "cpu_iowait": 0,
            "cpu_nice": 0.16416848450863164,
            "cpu_sintr": 6.989799768832858,
            "cpu_steal": 0,
            "cpu_system": 0,
            "cpu_user": 0,
            "cpu_utilization": 0,
            "time": "2022-07-06T07:53:00Z"
            },
            {
            "cpu_guest": 14.383263817045403,
            "cpu_guest_nice": 7.399422124925096,
            "cpu_hintr": 85.6167361829546,
            "cpu_idle": 0.012600806451982593,
            "cpu_iowait": 0,
            "cpu_nice": 0.16415589929657526,
            "cpu_sintr": 6.807084986795077,
            "cpu_steal": 0,
            "cpu_system": 0,
            "cpu_user": 0,
            "cpu_utilization": 0,
            "time": "2022-07-06T07:54:00Z"
            },
            {
            "cpu_guest": 14.726260519828362,
            "cpu_guest_nice": 7.6415601742735575,
            "cpu_hintr": 85.27373948017163,
            "cpu_idle": 0,
            "cpu_iowait": 0,
            "cpu_nice": 0.13915094569823586,
            "cpu_sintr": 6.945549400312833,
            "cpu_steal": 0,
            "cpu_system": 0,
            "cpu_user": 0,
            "cpu_utilization": 0,
            "time": "2022-07-06T07:55:00Z"
            },
            {
            "cpu_guest": 14.057681135812668,
            "cpu_guest_nice": 7.4629254895461985,
            "cpu_hintr": 85.94231886418734,
            "cpu_idle": 0,
            "cpu_iowait": 0,
            "cpu_nice": 0.1312537572167229,
            "cpu_sintr": 6.463501889161767,
            "cpu_steal": 0,
            "cpu_system": 0,
            "cpu_user": 0,
            "cpu_utilization": 0,
            "time": "2022-07-06T07:56:00Z"
            },
            {
            "cpu_guest": 14.79590345366554,
            "cpu_guest_nice": 7.533572488131608,
            "cpu_hintr": 85.20409654633447,
            "cpu_idle": 0.010121457490213964,
            "cpu_iowait": 0,
            "cpu_nice": 0.13101997170969165,
            "cpu_sintr": 7.111093625213648,
            "cpu_steal": 0,
            "cpu_system": 0.01009591115570685,
            "cpu_user": 0,
            "cpu_utilization": 0,
            "time": "2022-07-06T07:57:00Z"
            }
        ]
    }
    
    • MCK8S 메트릭 조회
    {
        "name": "pod",
        "tags": {
            "mck8sId": "mcks-51",
            "node_name": "master",
            "nsId": "ns-02"
            },
        "columns": [
            "time",
            "cpu_usage_nanocores",
            "memory_usage_bytes",
            "rootfs_capacity_bytes",
            "rootfs_used_bytes",
            "rx_bytes",
            "rx_errors",
            "tx_bytes",
            "tx_errors"
        ],
        "values": [
            [
                "2022-07-06T05:39:00Z",
                0,
                0,
                0,
                0,
                0,
                0,
                0,
                0
            ],
            [
                "2022-07-06T05:40:00Z",
                15249299.541666668,
                0,
                32200699904,
                961280,
                0,
                0,
                0,
                0
            ],
            [
                "2022-07-06T05:41:00Z",
                16125290.7,
                0,
                32200699904,
                961280,
                0,
                0,
                0,
                0
            ],
            [
                "2022-07-06T05:42:00Z",
                15277321.58125,
                0,
                32200699904,
                961280,
                0,
                0,
                0,
                0
                ],
            [
                "2022-07-06T05:43:00Z",
                14852714.825,
                0,
                32200699904,
                961280,
                0,
                0,
                0,
                0
            ]
        ]
    }
    
    [모니터링 메트릭 Aggregate 기능에 이상이 있는가?]
    구동 환경 서비스 Aggregate
    Go Binary
    Docker-compose
    Kubernetes
    MCIS 정상
    MCK8S 정상
    [2022-07-06T14:57:49+09:00] <MCK8S> Del Topics Queue ## : []
    [CLOUD-BARISTA].[INFO]: 2022-07-06 14:57:49 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/mck8s/push/collectorTopicMap, value:{"TopicMap":{"ns-02_mck8s_mcks-51":["ns-02_mck8s_mcks-51"]}}
    [2022-07-06T14:57:49+09:00] <MCK8S> EXECUTE Group_0 collector - topic: ns-02_mck8s_mcks-51
    [2022-07-06T14:57:49+09:00] <MCIS> collector scheduler - Now Scheduling ###
    [2022-07-06T14:57:49+09:00] <MCIS> Add Topics Queue ## : []
    [2022-07-06T14:57:49+09:00] <MCIS> Del Topics Queue ## : []
    [CLOUD-BARISTA].[INFO]: 2022-07-06 14:57:50 nutsdb-driver.go:116, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Put() - Key:/push/collectorTopicMap, value:{"TopicMap":{},"CollectorPerAgentCnt":[]}
    [CLOUD-BARISTA].[INFO]: 2022-07-06 14:57:57 nutsdb-driver.go:133, github.com/cloud-barista/cb-store/store-drivers/nutsdb-driver.(*NUTSDBDriver).Get() - Key:/monitoring/agents/ns-02_mck8s_mcks-51
    
Clone this wiki locally