Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

scale out graph but the Phase of graph is ScaleOut after ready #346

Closed
veezhang opened this issue Oct 16, 2023 · 2 comments
Closed

scale out graph but the Phase of graph is ScaleOut after ready #346

veezhang opened this issue Oct 16, 2023 · 2 comments
Labels
affects/none PR/issue: this bug affects none version. find-by-e2e Bugs that find by e2e. process/fixed Process of bug severity/none Severity of bug type/bug Type: something is unexpected

Comments

@veezhang
Copy link
Contributor

veezhang commented Oct 16, 2023

Please check the FAQ documentation before raising an issue

When scale out graph but the Phase of graph is ScaleOut after ready. After a while, it becomes normal again.

Here is the e2e logs:

I1016 14:26:46.668715    6754 helm.go:238] "Determining if helm binary is available or not" executable="helm"
I1016 14:26:46.668911    6754 helm.go:247] "Running Helm Operation" command="helm upgrade e2e-nc-0-d4130fe8835ec2c20ec3a68 ../../charts/nebula-cluster --namespace e2e-nc-0-4facae02e9c99d67a5c72ba --set nameOverride=e2e-nc-0-d4130fe8835ec2c20ec3a68 --set nebula.graphd.replicas=5 --set nebula.metad.replicas=3 --set nebula.storaged.replicas=4 --wait --kubeconfig /Users/veezhang/.kube/kubeconfig-181"
I1016 14:26:48.180191    6754 helm.go:254] Helm Command output 
=== RUN   TestNebulaCluster/scale_with_default_values/Wait_NebulaCluster_to_be_ready_after_upgrade_scale_out__[graphd]:_5-3-4
I1016 14:26:48.180517    6754 nebulacluster_test.go:179] "Waiting for NebulaCluster to be ready" namespace="e2e-nc-0-4facae02e9c99d67a5c72ba" name="e2e-nc-0-d4130fe8835ec2c20ec3a68"
I1016 14:26:53.224223    6754 nebulacluster.go:163] "Waiting for NebulaCluster to be ready" namespace="e2e-nc-0-4facae02e9c99d67a5c72ba" name="e2e-nc-0-d4130fe8835ec2c20ec3a68" generation=3
I1016 14:26:58.198791    6754 nebulacluster.go:163] "Waiting for NebulaCluster to be ready" namespace="e2e-nc-0-4facae02e9c99d67a5c72ba" name="e2e-nc-0-d4130fe8835ec2c20ec3a68" generation=3
I1016 14:27:03.198461    6754 nebulacluster.go:163] "Waiting for NebulaCluster to be ready" namespace="e2e-nc-0-4facae02e9c99d67a5c72ba" name="e2e-nc-0-d4130fe8835ec2c20ec3a68" generation=3
I1016 14:27:08.289023    6754 nebulacluster.go:163] "Waiting for NebulaCluster to be ready" namespace="e2e-nc-0-4facae02e9c99d67a5c72ba" name="e2e-nc-0-d4130fe8835ec2c20ec3a68" generation=3
I1016 14:27:13.205298    6754 nebulacluster.go:163] "Waiting for NebulaCluster to be ready" namespace="e2e-nc-0-4facae02e9c99d67a5c72ba" name="e2e-nc-0-d4130fe8835ec2c20ec3a68" generation=3
I1016 14:27:18.460115    6754 nebulacluster.go:163] "Waiting for NebulaCluster to be ready" namespace="e2e-nc-0-4facae02e9c99d67a5c72ba" name="e2e-nc-0-d4130fe8835ec2c20ec3a68" generation=3
I1016 14:27:23.213154    6754 nebulacluster.go:163] "Waiting for NebulaCluster to be ready" namespace="e2e-nc-0-4facae02e9c99d67a5c72ba" name="e2e-nc-0-d4130fe8835ec2c20ec3a68" generation=3
E1016 14:27:23.214439    6754 nebulacluster-ready-func.go:191] "Waiting for NebulaCluster to be ready but componentStatus not expected" err=<
        1 error occurred:
                * fields ["Phase"](ScaleOut) does not match validate(eq=Running) failed Key: '' Error:Field validation for '' failed on the 'eq' tag
        
 > namespace="e2e-nc-0-4facae02e9c99d67a5c72ba" name="e2e-nc-0-d4130fe8835ec2c20ec3a68" component="graphd"
I1016 14:27:28.213355    6754 nebulacluster.go:163] "Waiting for NebulaCluster to be ready" namespace="e2e-nc-0-4facae02e9c99d67a5c72ba" name="e2e-nc-0-d4130fe8835ec2c20ec3a68" generation=3
I1016 14:27:28.245102    6754 nebulacluster-ready-func.go:231] "Check Component Resource find container" namespace="e2e-nc-0-4facae02e9c99d67a5c72ba" name="e2e-nc-0-d4130fe8835ec2c20ec3a68-graphd" container="graphd" index=0
I1016 14:27:28.274595    6754 nebulacluster-ready-func.go:231] "Check Component Resource find container" namespace="e2e-nc-0-4facae02e9c99d67a5c72ba" name="e2e-nc-0-d4130fe8835ec2c20ec3a68-metad" container="metad" index=0
I1016 14:27:28.306054    6754 nebulacluster-ready-func.go:231] "Check Component Resource find container" namespace="e2e-nc-0-4facae02e9c99d67a5c72ba" name="e2e-nc-0-d4130fe8835ec2c20ec3a68-storaged" container="storaged" index=0
I1016 14:27:28.306489    6754 nebulacluster.go:185] "Waiting for NebulaCluster to be ready successfully" namespace="e2e-nc-0-4facae02e9c99d67a5c72ba" name="e2e-nc-0-d4130fe8835ec2c20ec3a68"

Describe the bug (required)

Your Environments (required)

  • OS: uname -a
  • Commit id (e.g. a3ffc7d8)

How To Reproduce(required)

Steps to reproduce the behavior:

  1. Step 1
  2. Step 2
  3. Step 3

Expected behavior

Additional context

@veezhang veezhang added the type/bug Type: something is unexpected label Oct 16, 2023
@github-actions github-actions bot added affects/none PR/issue: this bug affects none version. severity/none Severity of bug labels Oct 16, 2023
@veezhang veezhang removed severity/none Severity of bug affects/none PR/issue: this bug affects none version. labels Oct 16, 2023
@github-actions github-actions bot added affects/none PR/issue: this bug affects none version. severity/none Severity of bug labels Oct 16, 2023
@veezhang veezhang added the find-by-e2e Bugs that find by e2e. label Oct 16, 2023
@MegaByte875
Copy link
Contributor

#399

@MegaByte875
Copy link
Contributor

--- PASS: TestNebulaCluster (369.19s)
    --- PASS: TestNebulaCluster/scale_with_default_values (369.19s)
        --- PASS: TestNebulaCluster/scale_with_default_values/Install_NebulaCluster (0.39s)
        --- PASS: TestNebulaCluster/scale_with_default_values/Wait_NebulaCluster_to_be_ready (65.02s)
        --- PASS: TestNebulaCluster/scale_with_default_values/Load_LDBC-SNB_dataset (95.02s)
        --- PASS: TestNebulaCluster/scale_with_default_values/Upgrade_NebulaCluster_scale_out_[graphd,_storaged]:_4-3-4 (0.42s)
        --- PASS: TestNebulaCluster/scale_with_default_values/Wait_NebulaCluster_to_be_ready_after_upgrade_scale_out_[graphd,_storaged]:_4-3-4 (40.02s)
        --- PASS: TestNebulaCluster/scale_with_default_values/Upgrade_NebulaCluster_scale_out__[graphd]:_5-3-4 (0.37s)
        --- PASS: TestNebulaCluster/scale_with_default_values/Wait_NebulaCluster_to_be_ready_after_upgrade_scale_out__[graphd]:_5-3-4 (30.02s)
        --- PASS: TestNebulaCluster/scale_with_default_values/Upgrade_NebulaCluster_scale_out_[storaged]:_5-3-5 (0.41s)
        --- PASS: TestNebulaCluster/scale_with_default_values/Wait_NebulaCluster_to_be_ready_after_upgrade_scale_out_[storaged]:_5-3-5 (60.02s)
        --- PASS: TestNebulaCluster/scale_with_default_values/Upgrade_NebulaCluster_scale_in_[graphd,_storaged]:_3-3-4 (0.42s)
        --- PASS: TestNebulaCluster/scale_with_default_values/Wait_NebulaCluster_to_be_ready_after_upgrade_scale_in_[graphd,_storaged]:_3-3-4 (30.02s)
        --- PASS: TestNebulaCluster/scale_with_default_values/Upgrade_NebulaCluster_scale_in_[storaged]:_3-3-3 (0.37s)
        --- PASS: TestNebulaCluster/scale_with_default_values/Wait_NebulaCluster_to_be_ready_after_upgrade_scale_in_[storaged]:_3-3-3 (35.02s)
        --- PASS: TestNebulaCluster/scale_with_default_values/Upgrade_NebulaCluster_scale_in[graphd]:_2-3-3 (0.38s)
        --- PASS: TestNebulaCluster/scale_with_default_values/Wait_NebulaCluster_to_be_ready_after_upgrade_scale_in[graphd]:_2-3-3 (10.02s)
        --- PASS: TestNebulaCluster/scale_with_default_values/Uninstall_NebulaCluster (1.24s)
PASS
ok      github.com/vesoft-inc/nebula-operator/tests/e2e 369.230s

@github-actions github-actions bot added the process/fixed Process of bug label Nov 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects/none PR/issue: this bug affects none version. find-by-e2e Bugs that find by e2e. process/fixed Process of bug severity/none Severity of bug type/bug Type: something is unexpected
Projects
None yet
Development

No branches or pull requests

2 participants