[Tencent:VM] When ocurring TencentCloudSDKError(NetworkError), the driver do not return an error

[sykim-etri]

개발 환경이 OpenStack(devstack)에서 개발 중인데, 최근 Tencent가 이상한지 NetworkError를 자주 리턴하고 있습니다. 그런데 그에 따라 Tencent driver가 이를 제대로 감지하지 못하고 있는 것으로 추정됩니다.
로그상 CreateSecurityHandler()에서 SecurityGroup 생성이 제대로 되지 않았는데, 에러를 리턴하지 않는 것으로 보입니다.

[CB-SPIDER].[INFO]: 2024-11-14 08:42:00 TencentCloudConnection.go:99, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent/connect.(*TencentCloudConnection).CreateSecurityHandler() - Start                                             
[CB-SPIDER].[INFO]: 2024-11-14 08:42:00 ConnectionConfigInfoManager.go:102, github.com/cloud-barista/cb-spider/cloud-info-manager/connection-config-info-manager.GetConnectionConfig() - call GetConnectionConfig()                                                       
[CB-SPIDER].[INFO]: 2024-11-14 08:42:00 SecurityHandler.go:55, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent/resources.(*TencentSecurityHandler).CreateSecurity() - securityReqInfo : %!(EXTRA resources.SecurityReqInfo={{csqrfm6
3j7g3d9qe0380_csqrfm63j7ge3frkr1ug } {csqq90m3j7g2uqc5qfng vpc-hetntupa} 0xc0046249a8 []})                                                                                                                                                                                
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:00 SecurityHandler.go:249, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent/resources.(*TencentSecurityHandler).isExist() - chkName : csqrfm63j7g3d9qe0380_csqrfm63j7ge3frkr1ug                
[CB-SPIDER].[ERROR]: 2024-11-14 08:42:10 SecurityHandler.go:261, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent/resources.(*TencentSecurityHandler).isExist() - [TencentCloudSDKError] Code=ClientError.NetworkError, Message=Fail 
to get response because Post "https://vpc.tencentcloudapi.com/": dial tcp: lookup vpc.tencentcloudapi.com on 127.0.0.53:53: read udp 127.0.0.1:52250->127.0.0.53:53: i/o timeout                                                                                          
[CB-SPIDER].[ERROR]: 2024-11-14 08:42:10 SecurityHandler.go:61, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent/resources.(*TencentSecurityHandler).CreateSecurity() - [TencentCloudSDKError] Code=ClientError.NetworkError, Message
=Fail to get response because Post "https://vpc.tencentcloudapi.com/": dial tcp: lookup vpc.tencentcloudapi.com on 127.0.0.53:53: read udp 127.0.0.1:52250->127.0.0.53:53: i/o timeout                                                                                    
[CB-SPIDER].[ERROR]: 2024-11-14 08:42:10 SecurityGroupManager.go:377, github.com/cloud-barista/cb-spider/api-runtime/common-runtime.CreateSecurity() - [TencentCloudSDKError] Code=ClientError.NetworkError, Message=Fail to get response because Post "https://vpc.tencen
tcloudapi.com/": dial tcp: lookup vpc.tencentcloudapi.com on 127.0.0.53:53: read udp 127.0.0.1:52250->127.0.0.53:53: i/o timeout                                                                                                                                          
[CB-SPIDER].[INFO]: 2024-11-14 08:42:33 SecurityGroupRest.go:132, github.com/cloud-barista/cb-spider/api-runtime/rest-runtime.CreateSecurity() - call CreateSecurity()                                                                                                    
[CB-SPIDER].[INFO]: 2024-11-14 08:42:33 SecurityGroupManager.go:273, github.com/cloud-barista/cb-spider/api-runtime/common-runtime.CreateSecurity() - call CreateSecurity()                                                                                               
[CB-SPIDER].[INFO]: 2024-11-14 08:42:33 ConnectionConfigInfoManager.go:102, github.com/cloud-barista/cb-spider/cloud-info-manager/connection-config-info-manager.GetConnectionConfig() - call GetConnectionConfig()                                                       
[CB-SPIDER].[INFO]: 2024-11-14 08:42:33 ConnectionConfigInfoManager.go:102, github.com/cloud-barista/cb-spider/cloud-info-manager/connection-config-info-manager.GetConnectionConfig() - call GetConnectionConfig()                                                       
[CB-SPIDER].[INFO]: 2024-11-14 08:42:33 DriverInfoManager.go:117, github.com/cloud-barista/cb-spider/cloud-info-manager/driver-info-manager.GetCloudDriver() - call GetCloudDriver()                                                                                      
[CB-SPIDER].[INFO]: 2024-11-14 08:42:33 CloudDriverHandler_static.go:49, github.com/cloud-barista/cb-spider/cloud-control-manager.getCloudDriver() - CloudDriverHandler: called getStaticCloudDriver() - tencent-driver-v1.0.so                                           
[CB-SPIDER].[INFO]: 2024-11-14 08:42:33 CredentialInfoManager.go:221, github.com/cloud-barista/cb-spider/cloud-info-manager/credential-info-manager.GetCredentialDecrypt() - call GetCredential()                                                                         
[CB-SPIDER].[INFO]: 2024-11-14 08:42:33 RegionInfoManager.go:114, github.com/cloud-barista/cb-spider/cloud-info-manager/region-info-manager.GetRegion() - call GetRegion()               
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:33 TencentDriver.go:69, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent.getVmClient() - TencentDriver : getVmClient() - Region : [ap-seoul]                                                   
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:33 TencentDriver.go:70, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent.getVmClient() - TencentDriver : getVmClient() - Zone : [ap-seoul-1] 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:33 TencentDriver.go:71, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent.getVmClient() - TencentDriver : getVmClient() - ClientId : [IKIDmjzRsO7DNWfZVbdhfizlP902APf2NyU2] 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:33 TencentDriver.go:100, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent.getVpcClient() - TencentDriver : getVpcClient() - Region : [ap-seoul] 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:33 TencentDriver.go:101, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent.getVpcClient() - TencentDriver : getVpcClient() - Zone : [ap-seoul-1] 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:33 TencentDriver.go:102, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent.getVpcClient() - TencentDriver : getVpcClient() - ClientId : [IKIDmjzRsO7DNWfZVbdhfizlP902APf2NyU2] 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:33 TencentDriver.go:131, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent.getClbClient() - TencentDriver : getClbClient() - Region : [ap-seoul] 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:33 TencentDriver.go:132, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent.getClbClient() - TencentDriver : getClbClient() - Zone : [ap-seoul-1] 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:33 TencentDriver.go:133, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent.getClbClient() - TencentDriver : getClbClient() - ClientId : [IKIDmjzRsO7DNWfZVbdhfizlP902APf2NyU2] 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:33 TencentDriver.go:162, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent.getCbsClient() - TencentDriver : getCbsClient() - Region : [ap-seoul] 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:33 TencentDriver.go:163, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent.getCbsClient() - TencentDriver : getCbsClient() - Zone : [ap-seoul-1] 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:33 TencentDriver.go:164, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent.getCbsClient() - TencentDriver : getCbsClient() - ClientId : [IKIDmjzRsO7DNWfZVbdhfizlP902APf2NyU2] 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:33 TencentDriver.go:192, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent.getTagClient() - TencentDriver : getTagClient() - ClientId : [IKIDmjzRsO7DNWfZVbdhfizlP902APf2NyU2] 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:33 TencentDriver.go:213, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent.getClusterClient() - TencentDriver : getClusterClient() - Region : [ap-seoul] 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:33 TencentDriver.go:214, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent.getClusterClient() - TencentDriver : getClusterClient() - ClientId : [IKIDmjzRsO7DNWfZVbdhfizlP902APf2NyU2] 
[CB-SPIDER].[INFO]: 2024-11-14 08:42:33 TencentCloudConnection.go:99, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent/connect.(*TencentCloudConnection).CreateSecurityHandler() - Start 
[CB-SPIDER].[INFO]: 2024-11-14 08:42:33 ConnectionConfigInfoManager.go:102, github.com/cloud-barista/cb-spider/cloud-info-manager/connection-config-info-manager.GetConnectionConfig() - call GetConnectionConfig() 
[CB-SPIDER].[INFO]: 2024-11-14 08:42:33 SecurityHandler.go:55, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent/resources.(*TencentSecurityHandler).CreateSecurity() - securityReqInfo : %!(EXTRA resources.SecurityReqInfo={{csqrfue3j7g3d9qe038g_csqrfue3j7ge3frkr1v0 } {csqq90m3j7g2uqc5qfng vpc-hetntupa} 0xc0018dedc8 []})                                           
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:33 SecurityHandler.go:249, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent/resources.(*TencentSecurityHandler).isExist() - chkName : csqrfue3j7g3d9qe038g_csqrfue3j7ge3frkr1v0 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:35 SecurityHandler.go:109, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent/resources.(*TencentSecurityHandler).CreateSecurity() - {"Response":{"SecurityGroup":{"SecurityGroupId":"sg-pvrne85t","SecurityGroupName":"csqrfue3j7g3d9qe038g_csqrfue3j7ge3frkr1v0","SecurityGroupDesc":"csqrfue3j7g3d9qe038g_csqrfue3j7ge3frkr1v0","ProjectId":"0","CreatedTime":"2024-11-14 16:42:35"},"RequestId":"cbd995fa-c5b1-40a5-a306-d4bea1d432c1"}} 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:35 SecurityHandler.go:112, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent/resources.(*TencentSecurityHandler).CreateSecurity() - Security Policy Processing 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:36 SecurityHandler.go:157, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent/resources.(*TencentSecurityHandler).CreateSecurity() - {"Response":{"RequestId":"e7765cd7-0244-4122-ae3e-20647e792344"}}                                                             
[CB-SPIDER].[INFO]: 2024-11-14 08:42:36 SecurityHandler.go:274, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent/resources.(*TencentSecurityHandler).GetSecurity() - securitySystemId : [sg-pvrne85t] 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:36 SecurityHandler.go:301, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent/resources.(*TencentSecurityHandler).GetSecurity() - {"Response":{"SecurityGroupSet":[{"SecurityGroupId":"sg-pvrne85t","SecurityGroupName":"csqrfue3j7g3d9qe038g_csqrfue3j7ge3frkr1v0","SecurityGroupDesc":"csqrfue3j7g3d9qe038g_csqrfue3j7ge3frkr1v0","ProjectId":"0","IsDefault":false,"CreatedTime":"2024-11-14 16:42:35"}],"TotalCount":1,"RequestId":"0edbc5a9-6646-47d1-ba18-74b57b6a307b"}}                                            
[CB-SPIDER].[INFO]: 2024-11-14 08:42:36 SecurityHandler.go:332, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent/resources.(*TencentSecurityHandler).GetSecurityRuleInfo() - securitySystemId : [sg-pvrne85t] 
[CB-SPIDER].[DEBUG]: 2024-11-14 08:42:36 SecurityHandler.go:344, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/tencent/resources.(*TencentSecurityHandler).GetSecurityRuleInfo() - {"Response":{"SecurityGroupPolicySet":{"Version":"2","Egress":[{"PolicyIndex":0,"Protocol":"ALL","Port":"ALL","ServiceTemplate":{"ServiceId":"","ServiceGroupId":""},"CidrBlock":"0.0.0.0/0","Ipv6CidrBlock":"","SecurityGroupId":"","AddressTemplate":{"AddressId":"","AddressGroupId":""},"Action":"ACCEPT","PolicyDescription":"","ModifyTime":"2024-11-14 16:42:35"}],"Ingress":[{"PolicyIndex":0,"Protocol":"tcp","Port":"1-65535","ServiceTemplate":{"ServiceId":"","ServiceGroupId":""},"CidrBlock":"0.0.0.0/0","Ipv6CidrBlock":"","SecurityGroupId":"","AddressTemplate":{"AddressId":"","AddressGroupId":""},"Action":"ACCEPT","PolicyDescription":"","ModifyTime":"2024-11-14 16:42:36"},{"PolicyIndex":1,"Protocol":"udp","Port":"1-65535","ServiceTemplate":{"ServiceId":"","ServiceGroupId":""},"CidrBlock":"0.0.0.0/0","Ipv6CidrBlock":"","SecurityGroupId":"","AddressTemplate":{"AddressId":"","AddressGroupId":""},"Action":"ACCEPT","PolicyDescription":"","ModifyTime":"2024-11-14 16:42:36"},{"PolicyIndex":2,"Protocol":"icmp","Port":"ALL","ServiceTemplate":{"ServiceId":"","ServiceGroupId":""},"CidrBlock":"0.0.0.0/0","Ipv6CidrBlock":"","SecurityGroupId":"","AddressTemplate":{"AddressId":"","AddressGroupId":""},"Action":"ACCEPT","PolicyDescription":"","ModifyTime":"2024-11-14 16:42:36"}]},"RequestId":"8f737d78-25ac-478d-b8a1-4662e9fede5e"}} 
[CB-SPIDER].[INFO]: 2024-11-14 08:42:37 ClusterRest.go:187, github.com/cloud-barista/cb-spider/api-runtime/rest-runtime.CreateCluster() - call CreateCluster() 
[CB-SPIDER].[INFO]: 2024-11-14 08:42:37 ClusterManager.go:305, github.com/cloud-barista/cb-spider/api-runtime/common-runtime.CreateCluster() - call CreateCluster() 
[CB-SPIDER].[ERROR]: 2024-11-14 08:42:37 ClusterManager.go:352, github.com/cloud-barista/cb-spider/api-runtime/common-runtime.CreateCluster() - tencent-ap-seoul, csqq90m3j7g2uqc5qfo0: does not exist! 

[powerkimhub]

@sykim-etri

• 클라우드 운영 환경의 DNS 서버 응답이 불안정합니다.
  • 통상 0.1초 미만인데, 간헐적으로 10초 이상의 응답 시간을 보이고 있습니다.
  • 느려진 원인은 DNS 서버가 아닐수도 있지만...
  • 클라우드 운영 기관에 확인 요청하지요.
• 현재는 Driver 코드 개선 보다는 클라우드 운영 환경에 대한 개선 가능한지 타진 해보도록 하겠습니다.

[sykim-etri]

@powerkimhub 분석 감사합니다. CB-TB쪽 이슈도 있을 것으로 예상되니 함께 검토해보도록 하겠습니다.