Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Drop messages that are no longer useful for GPBFT progression #649

Merged
merged 1 commit into from
Sep 23, 2024

Conversation

masih
Copy link
Member

@masih masih commented Sep 20, 2024

As a GPBFT instance progresses some messages become irrelevant, in that they do not effectively aid the progress of the instance for participants. Instead, GPBFT offers other built-in mechanisms to aid progress of lagging participants such as selective rebroadcast, propagation of DECIDE messages from the previous instance and finality certificate exchange.

The changes here introduce a dedicated error type returned as part of message validation to signal that although a message is valid it is no longer relevant. This error type is then checked by pubsub to avoid further propagation of those messages.

This reduces the redundant pubsub traffic for the network participants.

Fixes #583

@masih masih force-pushed the masih/pubsub-ignore-irrelevant-msgs branch from 4cb81c0 to e6a8851 Compare September 20, 2024 13:36
Copy link

Fuzz test failed on commit 4cb81c0. To troubleshoot locally, download the seed corpus using GitHub CLI by running:

gh run download 10960282602 -n testdata

Alternatively, download directly from here.

Copy link

Fuzz test failed on commit e6a8851. To troubleshoot locally, download the seed corpus using GitHub CLI by running:

gh run download 10960300308 -n testdata

Alternatively, download directly from here.

@masih masih force-pushed the masih/pubsub-ignore-irrelevant-msgs branch 4 times, most recently from 1b50bb8 to 92b32f2 Compare September 21, 2024 13:41
Copy link

Fuzz test failed on commit 92b32f2. To troubleshoot locally, download the seed corpus using GitHub CLI by running:

gh run download 10973051853 -n testdata

Alternatively, download directly from here.

Copy link

codecov bot commented Sep 21, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 76.58%. Comparing base (76ecca1) to head (0503f70).
Report is 2 commits behind head on main.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #649      +/-   ##
==========================================
- Coverage   76.94%   76.58%   -0.37%     
==========================================
  Files          65       65              
  Lines        5487     5496       +9     
==========================================
- Hits         4222     4209      -13     
- Misses        861      878      +17     
- Partials      404      409       +5     
Files with missing lines Coverage Δ
gpbft/errors.go 100.00% <ø> (ø)
gpbft/participant.go 84.35% <ø> (-1.12%) ⬇️
gpbft/validator.go 91.25% <100.00%> (+0.40%) ⬆️
host.go 68.62% <100.00%> (-1.33%) ⬇️

... and 6 files with indirect coverage changes

@masih masih force-pushed the masih/pubsub-ignore-irrelevant-msgs branch from a0e155b to fb2badd Compare September 23, 2024 13:30
@masih masih changed the base branch from main to masih/validation-refactor September 23, 2024 13:31
@masih masih force-pushed the masih/pubsub-ignore-irrelevant-msgs branch from fb2badd to 31e65c1 Compare September 23, 2024 13:34
@masih masih marked this pull request as ready for review September 23, 2024 13:52
@masih masih requested a review from Stebalien September 23, 2024 13:52
@masih masih force-pushed the masih/validation-refactor branch 2 times, most recently from 380fc6c to 5c00dc0 Compare September 23, 2024 15:16
@masih masih force-pushed the masih/pubsub-ignore-irrelevant-msgs branch 2 times, most recently from 628ff0a to a9c2397 Compare September 23, 2024 15:44
@masih masih force-pushed the masih/validation-refactor branch 2 times, most recently from 13cb79b to 9fad427 Compare September 23, 2024 15:49
@masih masih force-pushed the masih/pubsub-ignore-irrelevant-msgs branch 2 times, most recently from 70639ba to 7975dfe Compare September 23, 2024 15:55
Base automatically changed from masih/validation-refactor to main September 23, 2024 16:17
@masih masih force-pushed the masih/pubsub-ignore-irrelevant-msgs branch from 7975dfe to 984caa9 Compare September 23, 2024 18:24
gpbft/validator.go Outdated Show resolved Hide resolved
gpbft/validator.go Show resolved Hide resolved
@masih masih force-pushed the masih/pubsub-ignore-irrelevant-msgs branch from 984caa9 to 7dda4e8 Compare September 23, 2024 20:06
@masih masih enabled auto-merge September 23, 2024 20:08
@masih masih disabled auto-merge September 23, 2024 20:09
As a GPBFT instance progresses some messages become irrelevant, in that
they do not effectively aid the progress of the instance for
participants. Instead, GPBFT offers other built-in mechanisms to aid
progress of lagging participants such as selective
rebroadcast, propagation of DECIDE messages from the previous instance
and finality certificate exchange.

The changes here introduce a dedicated error type returned as part of
message validation to signal that although a message is valid it is no
longer relevant. This error type is then checked by pubsub to avoid
further propagation of those messages.

This reduces the redundant pubsub traffic for the network participants.

Fixes #583
@masih masih force-pushed the masih/pubsub-ignore-irrelevant-msgs branch from 7dda4e8 to 0503f70 Compare September 23, 2024 20:29
@masih masih enabled auto-merge September 23, 2024 20:34
@masih masih added this pull request to the merge queue Sep 23, 2024
Merged via the queue into main with commit b7576c8 Sep 23, 2024
13 checks passed
@masih masih deleted the masih/pubsub-ignore-irrelevant-msgs branch September 23, 2024 20:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Drop all messages we wouldn't rebroadcast (pubsub related)
2 participants