Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NE-406: ingress: Add aws-elb-idle-timeout enhancement #461

Conversation

Miciah
Copy link
Contributor

@Miciah Miciah commented Sep 1, 2020

This enhancement extends the IngressController API to allow the user to configure the timeout period for idle connections to an IngressController that is published using an AWS Classic Elastic Load Balancer.

@openshift-ci-robot
Copy link

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: Miciah
To complete the pull request process, please assign runcom
You can assign the PR to them by writing /assign @runcom in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-bot
Copy link

Issues go stale after 90d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle stale

@openshift-ci-robot openshift-ci-robot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Dec 8, 2020
@openshift-bot
Copy link

Stale issues rot after 30d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle rotten
/remove-lifecycle stale

@openshift-ci-robot openshift-ci-robot added lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. and removed lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. labels Jan 7, 2021
@openshift-bot
Copy link

Rotten issues close after 30d of inactivity.

Reopen the issue by commenting /reopen.
Mark the issue as fresh by commenting /remove-lifecycle rotten.
Exclude this issue from closing again by commenting /lifecycle frozen.

/close

@openshift-ci-robot
Copy link

@openshift-bot: Closed this PR.

In response to this:

Rotten issues close after 30d of inactivity.

Reopen the issue by commenting /reopen.
Mark the issue as fresh by commenting /remove-lifecycle rotten.
Exclude this issue from closing again by commenting /lifecycle frozen.

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@Miciah
Copy link
Contributor Author

Miciah commented May 17, 2021

/reopen
/remove-lifecycle rotten

@openshift-ci
Copy link
Contributor

openshift-ci bot commented May 17, 2021

@Miciah: Reopened this PR.

In response to this:

/reopen
/remove-lifecycle rotten

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci openshift-ci bot reopened this May 17, 2021
@openshift-ci openshift-ci bot removed the lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. label May 17, 2021
@openshift-bot
Copy link

Issues go stale after 90d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle stale

@openshift-ci openshift-ci bot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Aug 15, 2021
@openshift-bot
Copy link

Stale issues rot after 30d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle rotten
/remove-lifecycle stale

@openshift-ci openshift-ci bot added lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. and removed lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. labels Sep 15, 2021
@openshift-bot
Copy link

Rotten enhancement proposals close after 7d of inactivity.

See https://github.com/openshift/enhancements#life-cycle for details.

Reopen the proposal by commenting /reopen.
Mark the proposal as fresh by commenting /remove-lifecycle rotten.
Exclude this proposal from closing again by commenting /lifecycle frozen.

/close

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 22, 2021

@openshift-bot: Closed this PR.

In response to this:

Rotten enhancement proposals close after 7d of inactivity.

See https://github.com/openshift/enhancements#life-cycle for details.

Reopen the proposal by commenting /reopen.
Mark the proposal as fresh by commenting /remove-lifecycle rotten.
Exclude this proposal from closing again by commenting /lifecycle frozen.

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci openshift-ci bot closed this Sep 22, 2021
@Miciah
Copy link
Contributor Author

Miciah commented Mar 16, 2022

/reopen

@openshift-ci openshift-ci bot reopened this Mar 16, 2022
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Mar 16, 2022

@Miciah: Reopened this PR.

In response to this:

/reopen

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@Miciah
Copy link
Contributor Author

Miciah commented Mar 16, 2022

/remove-lifecycle rotten

@Miciah Miciah force-pushed the add-aws-elb-idle-timeout-enhancement branch from 9a0f9ac to 504a5c4 Compare March 16, 2022 02:34
@openshift-ci openshift-ci bot removed the lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. label Mar 16, 2022
@Miciah Miciah force-pushed the add-aws-elb-idle-timeout-enhancement branch from 504a5c4 to 14009aa Compare March 16, 2022 05:57
Route annotation for the application's Route:

```shell
oc patch -n my-project routes/my-route haproxy.router.openshift.io/timeout=5m
Copy link
Contributor

@gcs278 gcs278 Mar 25, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is supposed to be the annotate command right? patch doesn't work like this.

Copy link
Contributor

@gcs278 gcs278 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall 👍, comments are just nits or ideas. It's harder for me to judge based on design precedents because of my lack of experience with openshift API, but the methods listed here are sound.

be added:

1. Create an IngressController that specifies a short timeout (for example, 10 seconds).
2. Create a pod with a simple HTTP application that sends static responses.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit semantics I think you also need to specify it intentionally holds a connection open so it does indeed timeout, but I understand what you are getting at here.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good point, this test plan has problems. When I wrote this test plan way back when, I had in mind that the client would open the connection and wait before sending the request. I realize now that the client would reach the tcp-request inspect-delay timeout of 5 seconds with this approach. I've updated the test plan to say that the client sends a request and the server imposes a delay for the response.

field of the corresponding IngressController to the desired value to restore the
configuration. Otherwise, the default ELB timeout period remains in effect
after an upgrade. Because modifying operator-managed resources is generally
unsupported, it should suffice to address this issue through a release note.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree here 👍

annotation on operator-managed Services. This would require less work to
implement. However, an explicit API can be more easily validated.
Additionally, allowing users to set the annotation would set a precedent of
allowing users to modify operator-managed resources, which we want to avoid.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I also add the idea of centralized configuration. In our current version, you'd turn on the classic load balance service via spec.endpointPublishingStrategy.loadBalancer.providerParameters.aws.classicLoadBalancer, but then users need to go tweak the timeout on a different object (service) that is created after you enable the classic load balancer. This enhancement seems more congruent to me. You configure it where you turn enable it.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! Very good point. I've added it to the enhancement.

annotation on operator-managed Services. This would require less work to
implement. However, an explicit API can be more easily validated.
Additionally, allowing users to set the annotation would set a precedent of
allowing users to modify operator-managed resources, which we want to avoid.

This comment was marked as duplicate.

@Miciah Miciah force-pushed the add-aws-elb-idle-timeout-enhancement branch from 14009aa to 9f0ffa7 Compare March 28, 2022 13:01
@gcs278
Copy link
Contributor

gcs278 commented Mar 28, 2022

Changes look good to me @Miciah thanks!

@Miciah Miciah force-pushed the add-aws-elb-idle-timeout-enhancement branch from 9f0ffa7 to 3feb104 Compare March 29, 2022 03:51
@Miciah Miciah force-pushed the add-aws-elb-idle-timeout-enhancement branch from 3feb104 to b070b03 Compare March 29, 2022 03:51
Copy link
Contributor

@frobware frobware left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, just one comment that need not hold up the PR but, equally, curious about the answer.

IngressController's
`spec.endpointPublishingStrategy.loadBalancer.providerParameters.aws.classicLoadBalancer.connectionIdleTimeout`
field to `5m` or longer, and the project administrator must similarly set a
Route annotation for the application's Route:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the connection idle timeout value is set and you forget (or omit) the route setting is there any feedback that the latter hasn't been done?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, there is no feedback. Application developers usually shouldn't need to worry about this sort of thing anyway; configuring timeouts on routes is an advanced use-case.

@frobware
Copy link
Contributor

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Apr 11, 2022
@frobware
Copy link
Contributor

/approve

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Apr 11, 2022

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: frobware

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Apr 11, 2022
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Apr 11, 2022

@Miciah: all tests passed!

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@openshift-merge-robot openshift-merge-robot merged commit 8576119 into openshift:master Apr 11, 2022
@Miciah Miciah changed the title ingress: Add aws-elb-idle-timeout enhancement NE-406: ingress: Add aws-elb-idle-timeout enhancement Apr 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants