Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(subscriber): count dropped events due to buffer cap #211

Merged
merged 2 commits into from
Dec 16, 2021
Merged

Conversation

hawkw
Copy link
Member

@hawkw hawkw commented Dec 16, 2021

See also #209

Currently, we don't really have any way of surfacing potential data loss
due to the event buffer capacity limit --- so, if events are dropped,
the user may not be aware that they're seeing an incomplete picture of
their application. It would be better if we had a way to surface this in
the UI.

This branch adds support for counting the number of dropped events in
the ConsoleLayer. This data is now included in the ResourceUpdate,
TaskUpdate, and AsyncOpUpdate messages, respectively. We track a
separate counter for dropped events of each type, to make it easier to
determine what data may be missing.

The console UI doesn't currently display these counts; that can be
added in a separate PR. We may want to use the warnings interface for
displaying this information?

See also #209

Currently, we don't really have any way of surfacing potential data loss
due to the event buffer capacity limit --- so, if events are dropped,
the user may not be *aware* that they're seeing an incomplete picture of
their application. It would be better if we had a way to surface this in
the UI.

This branch adds support for counting the number of dropped events in
the `ConsoleLayer`. This data is now included in the `ResourceUpdate`,
`TaskUpdate`, and `AsyncOpUpdate` messages, respectively. We track a
separate counter for dropped events of each type, to make it easier to
determine what data may be missing.

The console UI doesn't currently *display* these counts; that can be
added in a separate PR. We may want to use the warnings interface for
displaying this information?
@hawkw hawkw merged commit aa09600 into main Dec 16, 2021
@hawkw hawkw deleted the eliza/track-lag branch December 16, 2021 21:33
@bobrik
Copy link
Contributor

bobrik commented Mar 31, 2022

I added the ui portion in #316.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants