Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable RootDiskType for dynamic provisioning to fix Alibaba provisioning failures #1120

Merged
merged 3 commits into from
May 29, 2022
Merged

Enable RootDiskType for dynamic provisioning to fix Alibaba provisioning failures #1120

merged 3 commits into from
May 29, 2022

Conversation

seokho-son
Copy link
Member

  • Alibaba error in testing VM creation for multiple regions cb-spider#660
    • CB-SP의 현재 Alibaba 드라이버 설정상 ESSD 타입 DISK를 지원하지 않고 (ESSD의 경우, 최소 DISK 크기 지정 관련 이슈 정도가 있을 것으로 보임), Alibaba의 default 타입(클라우드-옵티말)으로는 많은 리전에서 VM 생성이 실패,
    • 부득이하게 TB에 각 Spec별로 DISK 타입을 지정하도록 Script 수정. (spec, image 를 조합하여 지정하듯이 메뉴얼하게 disk 관련 사항도 조합이 필요하게 됨.)
    • MapUI에도 유사 코드 반영 필요. (if alibaba)
  • (주의) 기존 테스트된 SP v0.5.3에서 NCP가 바로 동작하지 않는 문제 등을 고려하여, 최신 프리릴리스 버전인 CB-SP 0.5.6를 연동하여 시험 (master HEAD는 구동 가능 버전이 아닐 수 있음. 릴리스 기반으로 처리 필요.)
    • VM 생성 테스트만 되었으며, 다른 기능에서 오류 발생 가능성 있음. 혹시 다른 기능의 문제가 치명적이며, 문제 해결에 시간이 오래 걸리는 사항일 경우, SP v0.5.3로 되돌리고 다른 방안을 찾아야할 수 있음.

현시점에서 Alibaba 모든 리전에 대해서, VM 생성 여부 확인 완료.

shson@dev:~/go/src/github.com/cloud-barista/cb-tumblebug/src/testclient/scripts/sequentialFullTest$ ./clean-all.sh -n shson01 -f ../testSet-alibaba.env

[CB-Tumblebug is READY]
[CB-Spider is READY]
####################################################################
## Check test config file (-n deveoperPrefix -f ../testSetCustom.env -x numOfVMsInEachVMGroup)
####################################################################


[Configuration in  ../testSet-alibaba.env &  ../conf.env  files]

1) System Endpoints
 - Tumblebug Server :  localhost:1323 
 - Spider Server :  localhost:1024 

2) Enabled Clouds and Regions
 - [1] Cloud : alibaba (enabled regions : 24)
   [1,1] Region : alibaba-ap-northeast-2 (South Korea (Seoul) [zone:a]) 
    - VM SPEC : ecs.g6e.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,2] Region : alibaba-ap-northeast-1 (Japan (Tokyo) [zone:b]) 
    - VM SPEC : ecs.g6e.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,3] Region : alibaba-ap-south-1 (Mumbai [zone:b]) 
    - VM SPEC : ecs.g6.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,4] Region : alibaba-ap-southeast-1 (Singapore [zone:c]) 
    - VM SPEC : ecs.g7.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,5] Region : alibaba-ap-southeast-2 (Australia (Sydney) [zone:2b]) 
    - VM SPEC : ecs.g6.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,6] Region : alibaba-ap-southeast-3 (Malaysia (Kuala Lumpur) [zone:b]) 
    - VM SPEC : ecs.g6.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,7] Region : alibaba-ap-southeast-5 (Indonesia (Jakarta) [zone:c]) 
    - VM SPEC : ecs.g6.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,8] Region : alibaba-us-west-1 (US (Silicon Valley) [zone:a]) 
    - VM SPEC : ecs.g6.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,9] Region : alibaba-us-east-1 (US (Virginia) [zone:b]) 
    - VM SPEC : ecs.g6.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,10] Region : alibaba-eu-central-1 (Germany (Frankfurt) [zone:b]) 
    - VM SPEC : ecs.g6.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,11] Region : alibaba-eu-west-1 (UK (London) [zone:b]) 
    - VM SPEC : ecs.g6.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,12] Region : alibaba-me-east-1 (UAE (Dubai) [zone:a]) 
    - VM SPEC : ecs.sn2.medium 
    - VM DISK : cloud_ssd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,13] Region : alibaba-cn-hongkong (China (Hong Kong) [zone:d]) 
    - VM SPEC : ecs.g7.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,14] Region : alibaba-cn-shanghai (China (Shanghai) [zone:n]) 
    - VM SPEC : ecs.g7.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,15] Region : alibaba-cn-beijing (China (Beijing) [zone:l]) 
    - VM SPEC : ecs.g7.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,16] Region : alibaba-cn-qingdao (China (Qingdao) [zone:b]) 
    - VM SPEC : ecs.g6.large 
    - VM DISK : cloud_ssd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,17] Region : alibaba-cn-zhangjiakou (China (Zhangjiakou) [zone:c]) 
    - VM SPEC : ecs.g6.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,18] Region : alibaba-cn-huhehaote (China (Huhehaote) [zone:b]) 
    - VM SPEC : ecs.g6.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,19] Region : alibaba-cn-hangzhou (China (Hangzhou) [zone:k]) 
    - VM SPEC : ecs.g7.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,20] Region : alibaba-cn-shenzhen (China (Shenzhen) [zone:f]) 
    - VM SPEC : ecs.g7.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,21] Region : alibaba-cn-heyuan (China (Heyuan) [zone:b]) 
    - VM SPEC : ecs.g7.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,22] Region : alibaba-cn-chengdu (China (Chengdu) [zone:b]) 
    - VM SPEC : ecs.g6.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,23] Region : alibaba-cn-wulanchabu (China (Ulanqab) [zone:c]) 
    - VM SPEC : ecs.g7.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 
   [1,24] Region : alibaba-cn-guangzhou (China (Guangzhou) [zone:b]) 
    - VM SPEC : ecs.g7a.large 
    - VM DISK : cloud_essd (40 GB) 
    - VM IMAGE : Ubuntu 18.04 (ubuntu_18_04_x64_20G_alibase_20220428.vhd) 

3) MCIS Configuration
 - NameSpace ID : ns01
 - MCIS ID : shson01
 - Number of Total VMs : 24
   - [1] VMs(24) = alibaba(24) * Replica(1)


Confirm the above configuration. Do you want to proceed to clean ? (y/n) : y

Table: All VMs in the MCIS : shson01
  
VM-ID                     Status   PublicIP        PrivateIP       CloudType  CloudRegion     CreatedTime
-----                     ------   --------        ---------       ---------  -----------     -----------
alibaba-ap-northeast-1-0  Running  8.209.250.239   192.168.4.138   alibaba    ap-northeast-1  2022-05-29   06:08:07
alibaba-ap-northeast-2-0  Running  8.213.129.4     192.168.2.134   alibaba    ap-northeast-2  2022-05-29   06:07:39
alibaba-ap-south-1-0      Running  147.139.1.221   192.168.6.130   alibaba    cn-shenzhen     2022-05-29   06:08:03
alibaba-ap-southeast-1-0  Running  8.219.90.33     192.168.8.132   alibaba    ap-southeast-1  2022-05-29   06:08:02
alibaba-ap-southeast-2-0  Running  47.74.93.28     192.168.10.130  alibaba    ap-southeast-2  2022-05-29   06:08:18
alibaba-ap-southeast-3-0  Running  47.250.49.16    192.168.12.135  alibaba    ap-southeast-3  2022-05-29   06:08:14
alibaba-ap-southeast-5-0  Running  8.215.70.213    192.168.14.140  alibaba    ap-southeast-5
alibaba-cn-beijing-0      Running  47.93.22.54     192.168.30.131  alibaba    cn-beijing      2022-05-29   06:09:18
alibaba-cn-chengdu-0      Running  47.108.213.196  192.168.44.135  alibaba    cn-chengdu      2022-05-29   06:10:08
alibaba-cn-guangzhou-0    Running  8.134.100.148   192.168.48.137  alibaba    cn-guangzhou
alibaba-cn-hangzhou-0     Running  47.99.222.246   192.168.38.131  alibaba    cn-hangzhou     2022-05-29   06:09:31
alibaba-cn-heyuan-0       Running  47.113.189.63   192.168.42.133  alibaba    cn-heyuan       2022-05-29   06:09:39
alibaba-cn-hongkong-0     Running  8.210.3.231     192.168.26.135  alibaba    cn-hongkong     2022-05-29   06:09:10
alibaba-cn-huhehaote-0    Running  39.104.163.201  192.168.36.139  alibaba    cn-huhehaote    2022-05-29   06:09:23
alibaba-cn-qingdao-0      Running  118.190.201.66  192.168.32.134  alibaba    cn-qingdao      2022-05-29   06:09:20
alibaba-cn-shanghai-0     Running  106.14.127.243  192.168.28.130  alibaba    cn-shanghai     2022-05-29   06:08:54
alibaba-cn-wulanchabu-0   Running  8.130.100.240   192.168.46.140  alibaba    cn-wulanchabu   2022-05-29   06:10:07
alibaba-cn-zhangjiakou-0  Running  39.99.138.176   192.168.34.133  alibaba    cn-zhangjiakou
alibaba-eu-central-1-0    Running  47.254.128.150  192.168.20.135  alibaba    eu-central-1    2022-05-29   06:08:34
alibaba-eu-west-1-0       Running  8.208.102.124   192.168.22.133  alibaba    eu-west-1       2022-05-29   06:09:02
alibaba-me-east-1-0       Running  47.91.104.53    192.168.24.138  alibaba    me-east-1       2022-05-29   06:08:48
alibaba-us-east-1-0       Running  47.90.132.145   192.168.18.139  alibaba    us-east-1       2022-05-29   06:09:01
alibaba-us-west-1-0       Running  47.88.30.148    192.168.16.132  alibaba    us-west-1       2022-05-29   06:08:28

마찬가지 동일 환경에서 스크립트 기반 AWS 전리전 MCIS 프로비저닝은 테스트됨.

Table: All VMs in the MCIS : shson01
  
VM-ID                 Status   PublicIP         PrivateIP       CloudType  CloudRegion     CreatedTime
-----                 ------   --------         ---------       ---------  -----------     -----------
aws-af-south-1-0      Running  13.245.13.128    192.168.40.134  aws        af-south-1      2022-05-29   06:25:32
aws-ap-east-1-0       Running  18.166.15.243    192.168.36.137  aws        ap-east-1       2022-05-29   06:25:21
aws-ap-northeast-1-0  Running  18.179.35.32     192.168.10.134  aws        ap-northeast-1  2022-05-29   06:23:48
aws-ap-northeast-2-0  Running  3.38.250.56      192.168.34.140  aws        ap-northeast-2  2022-05-29   06:25:40
aws-ap-northeast-3-0  Running  15.152.38.4      192.168.22.139  aws        ap-northeast-3  2022-05-29   06:24:17
aws-ap-south-1-0      Running  3.110.190.126    192.168.12.138  aws        ap-south-1      2022-05-29   06:24:29
aws-ap-southeast-1-0  Running  18.141.164.108   192.168.2.136   aws        ap-southeast-1  2022-05-29   06:23:29
aws-ap-southeast-2-0  Running  13.236.179.215   192.168.14.136  aws        ap-southeast-2  2022-05-29   06:24:42
aws-ca-central-1-0    Running  52.60.112.194    192.168.4.141   aws        ca-central-1    2022-05-29   06:23:42
aws-eu-central-1-0    Running  18.195.148.17    192.168.24.140  aws        eu-central-1
aws-eu-north-1-0      Running  13.53.207.161    192.168.30.132  aws        eu-north-1      2022-05-29   06:25:02
aws-eu-south-1-0      Running  15.161.99.202    192.168.42.138  aws        eu-south-1      2022-05-29   06:25:34
aws-eu-west-1-0       Running  3.250.53.135     192.168.26.140  aws        eu-west-1       2022-05-29   06:25:24
aws-eu-west-2-0       Running  3.8.48.222       192.168.16.142  aws        eu-west-2       2022-05-29   06:24:20
aws-eu-west-3-0       Running  52.47.81.160     192.168.28.134  aws        eu-west-3       2022-05-29   06:24:56
aws-me-south-1-0      Running  157.175.159.226  192.168.38.137  aws        me-south-1      2022-05-29   06:25:08
aws-sa-east-1-0       Running  15.228.227.95    192.168.32.137  aws        sa-east-1       2022-05-29   06:25:24
aws-us-east-1-0       Running  35.173.239.48    192.168.8.134   aws        us-east-1       2022-05-29   06:24:33
aws-us-east-2-0       Running  3.144.103.63     192.168.18.141  aws        us-east-2       2022-05-29   06:24:25
aws-us-west-1-0       Running  54.193.60.96     192.168.6.135   aws        us-west-1       2022-05-29   06:23:53
aws-us-west-2-0       Running  34.219.214.144   192.168.20.140  aws        us-west-2       2022-05-29   06:24:25

@seokho-son seokho-son requested a review from jihoon-seo as a code owner May 28, 2022 21:43
@seokho-son seokho-son mentioned this pull request May 28, 2022
Closed
@seokho-son
Copy link
Member Author

/approve

@seokho-son seokho-son merged commit 9cd430b into cloud-barista:main May 29, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@github-actions github-actions[bot] github-actions[bot] approved these changes

@jihoon-seo jihoon-seo Awaiting requested review from jihoon-seo

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@seokho-son