3.15 Testplan

[ramezsaeed]

Introduction

Test plan for v 3.15.x release on TFgrid

• development project: https://github.com/orgs/threefoldtech/projects/210
• Known Issues: Known issues for 3.15.x release #1566
• References: https://git.ourworld.tf/tfgrid/circle_engineering/issues/89

Schedule

• 3.15.x is expected to be on QAnet on: --
• All tests and verification should be done on QAnet within one week maximum.
• After deploying on Testnet will keep it for one week before go to Mainnet in order to get tested by the community.

Scope

Test the main features in 3.15.x release:

• Multiple Grid stack
• Sentry Integration
• QSFS
• Mycelium Stable release
• Expose Solutions
• Refactor tfchain Billing logic
• Threefold Connect app

Test Reports

• Testlodge Run:

  • QAnet:

  • Testnet:

  • Mainnet:

Roles and Responsibilities

1. verification are done on Devnet (team members verify/ Ramez can close)
2. release on QAnet done by dev team approval.
3. QA team starts new test run iteration on Qanet.
4. BAM(Bug Assessment Meeting) is needed to approve the release and address the reported issues.
5. once approved the release go to Testnet.
6. QA team starts new test run iteration on Testnet.
7. BAM is needed to approve the release and address the reported issues.
8. once approved release kept on Testnet for two weeks before go to Mainnet.
9. once release on Mainnet QA team starts new test run iteration on Mainnet.

This test plan is maintained by QA team:

@ramezsaeed
@khaledyoussef24
@A-Harby

Main Features Testing and Validation:

• Support multiple stacks per network in ZOS, sdk-go and sdk-ts #1550
  • Related issues:
    • TFGrid Full Stack Deployment: Procedures and Documentation #1546
    • sdk-ts : Support multiple stacks per network  tfgrid-sdk-ts#3078
  • Testsuite:
    • Gurdian
    • https://app.testlodge.com/a/26076/projects/40893/suites/234374?expand_section=422337#case_4363617
• Sentry integration: Typescript and Dashboard #1554
  • Related issues:
    • sentry integration tfgrid-sdk-go#1118
    • Sentry integration tfgrid-sdk-ts#3101
  • Testsuiite: TODO
• qsfs tutorial #1539
  • Related issues:
    • Add qsfs unit tests tfgrid-sdk-ts#2453
    • Add QSFS to TFCMD tfgrid-sdk-go#1103
  • Testsuiite: QSFS
• Mycelium 1.0.0 stable release #1542
  • Related issues:
    • Mycelium desktop and mobile clients #1544
    • 🐞 [Bug]: updated all automated jest to add mycelium test cases tfgrid-sdk-ts#2958
    • TFRobot: support mycelium in deployments tfgrid-sdk-go#1048
    • Mycelium UI mycelium#340
  • Testsuiite:
    • mycelium
    • myceliumflut
• Expose solution tfgrid-sdk-ts#3178
  • Testsuiite: https://app.testlodge.com/a/26076/projects/40893/suites/234374?expand_section=422332#case_4364216
• Refactor tfchain Billing logic #1560
  • Related issues:
    • 🐞 [Bug]: Remove unused billing interfaces in gridproxy_client/contracts tfgrid-sdk-ts#3372
    • 🐞 [Bug]: Billing isn't reflected on the dashboard contracts tfgrid-sdk-ts#3406
    • Calculate contracts in first billing cycle tfgrid-sdk-ts#3418
    • 🐞[QAnet] [Bug]: Grace period contracts are showing zero locked tfts with no billing rate because its on a dedicated machine while it was never on a dedicated node tfgrid-sdk-ts#3364
    • [Qanet] Ensure compatibility with TFChain 2.9 release tfgrid-sdk-ts#3340
  • Testsuiite:
    • Billing
• KYC integration with idenfy #1572
  • Related issues:
    • introduce KYC in the dashboard tfgrid-sdk-ts#3519
    • MVP: KYC Verification Core requirements tf-kyc-verifier#3
    • KYC verifier  tf-kyc-verifier#2
    • introduce KYC with idenfy in the mobile app threefold_connect#624
  • Testsuiite:
    • KYC
• Threefold Connect App https://github.com/orgs/threefoldtech/projects/210/views/20
  • Related issues:
    • introduce KYC with idenfy in the mobile app threefold_connect#624
    • Add DAO vote functionality threefold_connect#593
    • Support dark mode threefold_connect#587
  • Testsuiite:
    • TFConnect

Non Release Blocking Stories:

• NOSTR Node (mycelium, optional pub ip) tfgrid-sdk-ts#2010

Out of QA Team Scope

[sameh-farouk]

@ramezsaeed Should it also include this and the related issues?
#1560

Please refer to the PR description for further information.

[xmonader]

@ramezsaeed this should have been in verification already. please update.

[ramezsaeed]

@xmonader
Nope; not yet in verification.
we still need to do the test runs for QA and Testnet

[xmonader]

@ramezsaeed this is still missing threefold connect and the KYC once you update it please move it to verification.

[ramezsaeed]

Done and added to verification.