Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Ingest Manager] Set the default timeout to 5 minute with a 20 seconds and improve rate limiter #79307

Conversation

nchaulet
Copy link
Member

@nchaulet nchaulet commented Oct 2, 2020

Description

This PR fix a few things we want to load test fleet on cloud.

Some context

The agent use a long polling request to wait for config change, it's configured to timeout after 5 minutes by default.

We have a rate limiter to control the rate where we deliver policy change to actions, I configured it to 5 policy per seconds by default.

Changes

  • The default timeout for long polling is now 5 minutes and we take a 20 seconds margin (instead of 3 previously) to have more chance to send the response before a socket idle timeout

  • Also the rate limiter is updated to drop POLICY_CHANGE that cannot be distributed in the next 5 minutes, the agent will get the change on the next checkin.

@nchaulet nchaulet added v8.0.0 release_note:skip Skip the PR/issue when compiling release notes v7.10.0 Team:Fleet Team label for Observability Data Collection Fleet team labels Oct 2, 2020
@nchaulet nchaulet requested review from jfsiii, jen-huang and a team October 2, 2020 15:28
@nchaulet nchaulet self-assigned this Oct 2, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/ingest-management (Team:Ingest Management)

@nchaulet nchaulet force-pushed the feature-fleet-timeout-default-and-ratelimiter branch from 3067523 to 54b567e Compare October 2, 2020 16:33
@kibanamachine
Copy link
Contributor

💚 Build Succeeded

Metrics [docs]

page load bundle size

id before after diff
ingestManager 510.2KB 510.5KB +348.0B

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

Copy link
Contributor

@jen-huang jen-huang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Did a quick smoke test locally and didn't see any problems. Code LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release_note:skip Skip the PR/issue when compiling release notes Team:Fleet Team label for Observability Data Collection Fleet team v7.10.0 v8.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants