Reduce memory usage

[damip]

Contents

• reduce the number of force-kept final periods to 5 (1min20s)
• in protocol, when retrieving block ops, they were added to Storage but not to stored_operations so they were not cleaned by clear_storage => refactor this to not use self.storage, to make better use of Storage instances in general, and move the responsibility of keeping ops temporarily alive during propagation to the op propagation handler instead of the retrievers
• box heavy elements in Storage to avoid huge allocations on HashMap growth
• cap the number of operations kept for propagation
• reduce the endorsement propagation time to 2 periods
• make operation batch announcement more robust
• achieve stable 3GB RAM usage at 4ktxps on testnet

Checklist

• document all added functions
• try in sandbox /simulation/labnet
• unit tests on the added/changed features
  • make tests compile
  • make tests pass
• add logs allowing easy debugging in case the changes caused problems
• if the API has changed, update the API specification
• after merging in main, merge main to branch testnet24

[AurelienFT]

How the ops storage wasn't growing with the leak on block handler. Anyway. Nice found and if tested on the testnet we can merge it.

[AurelienFT]

bors merge

[bors]

Build succeeded!

The publicly hosted instance of bors-ng is deprecated and will go away soon.

If you want to self-host your own instance, instructions are here.
For more help, visit the forum.

If you want to switch to GitHub's built-in merge queue, visit their help page.

• build