Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[aws-eks]: Newly introduced default timeout of helm chart breaks 'wait' option #8713

Closed
zxkane opened this issue Jun 24, 2020 · 2 comments
Closed
Assignees
Labels
@aws-cdk/aws-eks Related to Amazon Elastic Kubernetes Service bug This issue is a bug. p1

Comments

@zxkane
Copy link
Contributor

zxkane commented Jun 24, 2020

After upgrading cdk to latest 1.46.0, deploying a helm chart to EKS failing on timeout.

Reproduction Steps

Deploy a helm chart without specifying wait and timeout in slow network env(such as China regions) like below,

cluster.addChart('Nexus3', {
      chart: 'sonatype-nexus',
      repository: 'https://oteemo.github.io/charts/',
      namespace: nexus3Namespace,
      release: nexus3ChartName,
      version: nexus3ChartVersion,
      values: { ... }
}

See complete app here.

The deployment fails on timeout waiting the chart is completely deployed.

9:09:30 PM | CREATE_FAILED        | Custom::AWSCDK-EKS-HelmChart          | MyK8SCluster/chart...3/Resource/Default
Failed to create resource. Error: b'Release "nexus3" does not exist. Installing it now.\nError: timed out waiting for th
e condition\n'
at invokeUserFunction (/var/task/framework.js:85:19)
at process._tickCallback (internal/process/next_tick.js:68:7)

It should be introduced by #8338 that does not honor the default wait value false. Looks like explicit --timeout enables --wait switch as well.

--timeout duration time to wait for any individual Kubernetes operation (like Jobs for hooks) (default 5m0s)
--wait if set, will wait until all Pods, PVCs, Services, and minimum number of Pods of a Deployment, StatefulSet, or ReplicaSet are in a ready state before marking the release as successful. It will wait for as long as --timeout

Error Log

Environment

  • CLI Version : 1.46.0
  • Framework Version:
  • Node.js Version:
  • OS :
  • Language (Version):

Other


This is 🐛 Bug Report

@zxkane zxkane added bug This issue is a bug. needs-triage This issue or PR still needs to be triaged. labels Jun 24, 2020
@github-actions github-actions bot added the @aws-cdk/aws-eks Related to Amazon Elastic Kubernetes Service label Jun 24, 2020
@eladb eladb added the p1 label Jun 24, 2020
@eladb
Copy link
Contributor

eladb commented Jun 24, 2020

Thanks for reporting

@SomayaB SomayaB removed the needs-triage This issue or PR still needs to be triaged. label Jun 25, 2020
@eladb
Copy link
Contributor

eladb commented Jun 29, 2020

Resolved by #8548

@eladb eladb closed this as completed Jun 29, 2020
mergify bot pushed a commit that referenced this issue Jun 30, 2020
chore(eks): support create namespace with helm 

- add `createNamespace` property for `eks.HelmChart`
- set the `wait` flag correctly for HelmChart custom resource

Fixes: #7216 #7209 #8713

----

*By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license*
@iliapolo iliapolo added this to the EKS Dev Preview milestone Aug 10, 2020
@iliapolo iliapolo changed the title (eks): Newly introduced default timeout of helm chart breaks 'wait' option [aws-eks]: Newly introduced default timeout of helm chart breaks 'wait' option Aug 16, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
@aws-cdk/aws-eks Related to Amazon Elastic Kubernetes Service bug This issue is a bug. p1
Projects
None yet
Development

No branches or pull requests

4 participants