EXPERIMENTAL Tree States v5.0.111
Pre-releaseDisclaimer
If you are looking for the latest Lighthouse release please go to https://github.com/sigp/lighthouse/releases/latest.
Summary
This is an alpha release of upcoming changes to Lighthouse which improve disk usage and state management.
We are making this alpha release so that expert users may help us test these improvements. It is not backwards-compatible and not recommended for mainnet validators. Our current plan is to stabilise these changes shortly after the Deneb hard fork on mainnet.
For the adventurous, the main benefits are:
- Smaller disk footprint for archive nodes, <200GB total. Use checkpoint sync, and set the flag
--reconstruct-historic-states
. - Smaller disk footprint for regular nodes, <30GB.
- Faster handling of re-orgs.
- Faster restarts.
- Less disk I/O.
We hope that this is useful for running block explorers and supporting other beacon chain analytics. We are using it internally at SigP to run some of our analytics.
This release includes all the latest changes from v5.0.0 including Deneb on mainnet. Check out the release notes for v5.0.0 for more information. Note that we do not recommend running mainnet validators using tree-states
.
There are no substantial tree-states
specific changes in this release, as we have been focussed on cleaning up the branch and preparing it for review & merge.
⚠️ Backwards Compatibility ⚠️
This release is backwards compatible with v4.6.222-exp, v4.6.111-exp, v4.5.444-exp, v4.5.222-exp and v4.4.111-exp.
This release is not backwards compatible with stable Lighthouse or tree-states
releases prior to v4.4.111-exp. It uses a different database schema (v24) for which no automatic upgrade or downgrade is implemented. We intend to implement an automatic upgrade process once the new schema is finalized. A re-sync might be required to run future versions of tree-states
. This release's schema might be the final iteration.
Please only run this release if you are willing to re-sync now, and again in several weeks/months.
There are several breaking changes to CLI flags:
- The secret dummy flag
--unsafe-and-dangerous-mode
must be supplied. This is to prevent accidental upgrades to the release by users who don't know what they're getting themselves into. Unfortunately we found that far too many people accidentally ran previoustree-states
releases on mainnet. - The flags
--slots-per-restore-point
and--historic-state-cache-size
are deprecated and no longer necessary due to the freezer database using hierarchical diffs. - The flag
--db-migration-period
fromtree-states
v4.2.0-999-exp release is gone and has been replaced by--epochs-per-migration
(same name asstable
).
Known Issues
Expect a few sharp edges. Some things you may run into:
WARN Parent state is not advanced
is logged excessively during sync. This is harmless, albeit annoying.- Memory usage may be a bit higher when using the parallel HTTP cache (see #5112).
If you observe any panics, crashes or major performance regressions, please open an issue!
Building from source
Build the v5.0.111-exp
tag.
All Changes
- Tree states release v5.0.111-exp (#5276)
- Fix tree-states tests (#5277)
- Merge remote-tracking branch 'origin/unstable' into tree-states
- Remove progressive balances mode (#5224)
- Use epoch cache in block packing (#5223)
- Delete unused epoch processing code (#5170)
- Delete
lighthouse db diff
(#5171)
Binaries
See pre-built binaries documentation.
The binaries are signed with Sigma Prime's PGP key: 15E66D941F697E28F49381F426416DC3F30674B0
System | Architecture | Binary | PGP Signature |
---|---|---|---|
x86_64 | lighthouse-v5.0.111-exp-x86_64-apple-darwin.tar.gz | PGP Signature | |
x86_64 | lighthouse-v5.0.111-exp-x86_64-apple-darwin-portable.tar.gz | PGP Signature | |
x86_64 | lighthouse-v5.0.111-exp-x86_64-unknown-linux-gnu.tar.gz | PGP Signature | |
x86_64 | lighthouse-v5.0.111-exp-x86_64-unknown-linux-gnu-portable.tar.gz | PGP Signature | |
aarch64 | lighthouse-v5.0.111-exp-aarch64-unknown-linux-gnu.tar.gz | PGP Signature | |
aarch64 | lighthouse-v5.0.111-exp-aarch64-unknown-linux-gnu-portable.tar.gz | PGP Signature | |
x86_64 | lighthouse-v5.0.111-exp-x86_64-windows.tar.gz | PGP Signature | |
x86_64 | lighthouse-v5.0.111-exp-x86_64-windows-portable.tar.gz | PGP Signature | |
System | Option | - | Resource |
Docker | v5.0.111-exp | sigp/lighthouse |