Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Fleet] Retry 502 errors from Elastic Package Registry #131505

Open
joshdover opened this issue May 4, 2022 · 2 comments
Open

[Fleet] Retry 502 errors from Elastic Package Registry #131505

joshdover opened this issue May 4, 2022 · 2 comments
Labels
bug Fixes for quality problems that affect the customer experience Team:Fleet Team label for Observability Data Collection Fleet team

Comments

@joshdover
Copy link
Contributor

Kibana version: 8.2, main

Fleet's setup procedure can fail if we receive a transient 502 error from the registry. We should gracefully retry this type of error with some exponential backoff logic up to a max number of retries before failing all of the setup procedure. This can result in an error like:

Kibana Fleet setup failed: http POST request to https://kibana-zbjc-kb-http.e2e-hqiu1-mercury.svc:5601/api/fleet/setup fails: [Elastic Agent on ECK policy] could not be added. [system] could not be installed due to error: [PackageNotFoundError: [system] package not found in registry]: <nil>. Response: {"statusCode":500,"error":"Internal Server Error","message":"[Elastic Agent on ECK policy] could not be added. [system] could not be installed due to error: [PackageNotFoundError: [system] package not found in registry]"}

Currently we rely on either Fleet Server to retry calling setup (which is not always configured to do so) or the user visiting the Fleet UI.

This should only affect instances where the only preconfigured packages are not all bundled packages. In the case of Cloud, all packages we preconfigure there are bundled.

@joshdover joshdover added bug Fixes for quality problems that affect the customer experience Team:Fleet Team label for Observability Data Collection Fleet team labels May 4, 2022
@elasticmachine
Copy link
Contributor

Pinging @elastic/fleet (Team:Fleet)

@kpollich
Copy link
Member

kpollich commented May 4, 2022

This seems like it might be related to or the same issue as #129696

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Fixes for quality problems that affect the customer experience Team:Fleet Team label for Observability Data Collection Fleet team
Projects
None yet
Development

No branches or pull requests

3 participants