Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed usage reconciliations did not alert #12491

Closed
easyCZ opened this issue Aug 29, 2022 · 3 comments
Closed

Failed usage reconciliations did not alert #12491

easyCZ opened this issue Aug 29, 2022 · 3 comments
Labels
team: webapp Issue belongs to the WebApp team

Comments

@easyCZ
Copy link
Member

easyCZ commented Aug 29, 2022

On Monday 29.8, we noticed the Usage Reconciler Failed with "failed to reconcile usage: rpc error: code = ResourceExhausted desc = grpc: received message larger than max (117180415 vs. 104857600)".

This did not produce an Alert, but it should.

Ensure an alert fires in this exact scenario, routed to WebApp.

Image

Logs

Metrics

@easyCZ
Copy link
Member Author

easyCZ commented Aug 29, 2022

Related issue for a fix: #12487

@geropl geropl moved this from Next Milestone to Scheduled in 🍎 WebApp Team Sep 9, 2022
@geropl geropl removed the status in 🍎 WebApp Team Sep 12, 2022
@geropl
Copy link
Member

geropl commented Sep 12, 2022

@easyCZ Is this still relevant?

@easyCZ
Copy link
Member Author

easyCZ commented Sep 26, 2022

Resolved as part of #13034

@easyCZ easyCZ closed this as completed Sep 26, 2022
@easyCZ easyCZ moved this to Done in 🍎 WebApp Team Sep 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
team: webapp Issue belongs to the WebApp team
Projects
Status: Done
Development

No branches or pull requests

2 participants