[TEST] v1.4.2 Release Testing - Automation - Upgrade test

[albinsun]

What's the test to develop?

1. Target Path
   • v1.4.1 -> v1.4.2-rc1
2. Test Command
   tox -e py310 --result-json=test_result.json -- -l harvester_e2e_tests --json-report --html=test_report/test_result.html -k 'test_upgrade' --co -q

Prerequisite and dependency of test

n/a

Describe the items of the test development (DoD, definition of done) you'd like

Scenarios

1. Baremetal
   • 3 nodes AMD64
2. Local ipxe-example
   • 3 nodes witness AMD64

Reference

1. [TEST] v1.4.1 Release Testing - Automation - Upgrade test #1773

[albinsun]

Round 1

• Overall Status: FAIL
• Issue:
  • feat: change to use helm get values -a to get image harvester#7479 (Known)
  • [BUG] v1.4.1 -> v1.4.2-rc1 upgrade stuck in Pre-drained harvester#7679
• Test Case Enhancement:
  • Fix non-exited while loop in teardown #1889

Bare-metal AMD64

1. 🟢 3 nodes

   • Report
     
   • Cluster
     
2. 🔴 4 nodes

   

   • Can proceed upgrade after manually unpause the VM
     

   [BUG] v1.4.1 -> v1.4.2-rc1 upgrade stuck in Pre-drained harvester#7679
   Can proceed upgrade and success after manually unpause the VM

QEMU/KVM AMD64

1. 🟢 3 nodes

   • Report
     
   • Cluster
     

[albinsun]

Round 2

• Overall Status: PASS
• New Issue:
  • [BUG] v1.4.1 -> v1.4.2-rc1 upgrade stuck in Pre-drained harvester#7679
• Known Issue:
  • feat: change to use helm get values -a to get image harvester#7479
• Test Case Enhancement:
  • Fix non-exited while loop in teardown #1889

4 nodes Bare-metal AMD64

1. 🟢 Trial 1

   • Report harvester-upgrade-test/201
     
   • Cluster
     
2. 🟢 Trial 2

   • Report harvester-upgrade-test/202
     
   • Cluster