Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add timeout to the e2e command #5642

Merged
merged 1 commit into from
Apr 14, 2023

Conversation

abhinavmpandey08
Copy link
Member

Description of changes:
Add timeout to the e2e command. This makes sure that the e2e test command itself times out instead of the SSM command timing out. With this change, we will be able to get the results of the tests that finished even if the instance timed out.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@eks-distro-bot eks-distro-bot added the size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. label Apr 14, 2023
@codecov
Copy link

codecov bot commented Apr 14, 2023

Codecov Report

Merging #5642 (9202204) into main (957be2e) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main    #5642   +/-   ##
=======================================
  Coverage   73.34%   73.34%           
=======================================
  Files         449      449           
  Lines       37297    37297           
=======================================
  Hits        27354    27354           
  Misses       8311     8311           
  Partials     1632     1632           

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

Copy link
Member

@g-gaston g-gaston left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great idea!

internal/pkg/ssm/command.go Outdated Show resolved Hide resolved
@@ -94,7 +94,7 @@ func RunCommand(session *session.Session, logger logr.Logger, instanceId, comman

logger.Info("Waiting for ssm command to finish")
var commandOut *ssm.GetCommandInvocationOutput
r := retrier.New(300*time.Minute, retrier.WithMaxRetries(2160, 60*time.Second))
r := retrier.New(310*time.Minute, retrier.WithMaxRetries(2160, 60*time.Second))
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we also need to update the SendCommandInput
I think we want go test timeout < SSM command timeout < timeout in retrier that pulls the SSM command results.
That guarantees the SSM command always gets the test results and that we always get the results of the SSM command.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@eks-distro-bot eks-distro-bot added size/M Denotes a PR that changes 30-99 lines, ignoring generated files. and removed size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. labels Apr 14, 2023
internal/test/e2e/run.go Outdated Show resolved Hide resolved
internal/pkg/ssm/command.go Outdated Show resolved Hide resolved
@abhinavmpandey08 abhinavmpandey08 force-pushed the e2e-timeouts branch 2 times, most recently from d38c3c2 to 248b2bd Compare April 14, 2023 18:44
@abhinavmpandey08
Copy link
Member Author

/approve
/cherry-pick release-0.15

@eks-distro-pr-bot
Copy link
Contributor

@abhinavmpandey08: once the present PR merges, I will cherry-pick it on top of release-0.15 in a new PR and assign it to you.

In response to this:

/approve
/cherry-pick release-0.15

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@eks-distro-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: abhinavmpandey08

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@eks-distro-pr-bot
Copy link
Contributor

@abhinavmpandey08: new pull request created: #5649

In response to this:

/approve
/cherry-pick release-0.15

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@abhinavmpandey08 abhinavmpandey08 deleted the e2e-timeouts branch April 14, 2023 20:47
ddjjia pushed a commit to ddjjia/eks-anywhere that referenced this pull request Jun 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved lgtm size/M Denotes a PR that changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants