Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow skipping block history download in warp sync #2710

Closed
wants to merge 2 commits into from
Closed

Allow skipping block history download in warp sync #2710

wants to merge 2 commits into from

Conversation

tmpolaczyk
Copy link
Contributor

Adds a new sync mode --warp-no-block-history that is exactly the same as --warp, but doesn't download block history.

Close #8

@paritytech-cicd-pr
Copy link

The CI pipeline was cancelled due to failure one of the required jobs.
Job name: cargo-clippy
Logs: https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/4724646

@tomaka
Copy link
Contributor

tomaka commented Dec 18, 2023 •
edited
Loading

I don't know whether it is already the case as I'm not familiar with the sync code, but we must make sure that, no matter what, the block headers and justifications of session change blocks are downloaded anyway.

Otherwise it won't be possible for other nodes to warp sync from your node, which means that if enough people run with this option we could completely break warp syncing on the entire network.

@dmitry-markin
Copy link
Contributor

but we must make sure that, no matter what, the block headers and justifications of session change blocks are downloaded anyway.

As far as I can read the code, that's not the case — as a result of warp sync we only import target block body, state, and justifications. So it won't be possible to warp sync from a node that skipped block history phase.

Also, it needs to be carefully evaluated if adding nodes not able to provide syncing from genesis is safe for network. And likely address #523 first.

So, right now adding an option to turn off gap sync (block history phase) sounds risky.

@tmpolaczyk
Copy link
Contributor Author

Thanks for your comments. Is the justifications problem something that affects only the relaychain, or does it affects parachains as well? Because I only need this feature for syncing parachains, so I could modify the pr to error if trying to sync a relaychain.

Otherwise is there any way to make this a hidden sync mode or something? Because for my use case it doesn't matter if other nodes are not able to sync from this one.

@tomaka
Copy link
Contributor

tomaka commented Dec 18, 2023

Also, it needs to be carefully evaluated if adding nodes not able to provide syncing from genesis is safe for network. And likely address #523 first.

I've recently noticed that more and more nodes refuse to serve warp sync requests. Currently, around 20% of warp sync requests fail on Westend, and after a small investigation it seems that it's because they target nodes that have blocks pruning enable.

While it's not alarming yet, it could become alarming if people enable the mode that this PR adds.

@tomaka
Copy link
Contributor

tomaka commented Dec 18, 2023 •
edited
Loading

Because for my use case it doesn't matter if other nodes are not able to sync from this one.

The problem that we're talking about is a tragedy of the commons type of problem.
If you alone enable this mode then there's no problem, but the more people enable it (and I get that many people would want to enable it) the worse the syncing will become for everyone.

@girazoki
Copy link
Contributor

girazoki commented Dec 18, 2023 •
edited
Loading

can we make it under a feature flag? Our usecase is rotating-collators that warp synch to a full-node that has the history of a chain. The collators are not intended to store the history.

Now using full-sync but then enabling block-prunning has the same implications as this PR right?

@tomaka
Copy link
Contributor

tomaka commented Dec 18, 2023

An alternative way is that nodes that have this mode enabled do not participate in the DHT at all.

Light clients currently do not participate in the DHT at all because they would otherwise be polluting the network similar to how nodes that have this mode enabled would be polluting the network.

Now using full-sync but then enabling block-prunning has the same implications as this PR right?

Yes, but that doesn't make it correct. See #2733.

bkontur added a commit that referenced this pull request Dec 18, 2023
@bkontur
Squashed 'bridges/' changes from 277f0d5..68d8650
a465a56 
68d8650 Bump thiserror from 1.0.50 to 1.0.51
009c989 remove no longer valid check from the ensure_weights_are_correct (#2740)
94c44a7 Added Rococo BH <> Rococo Bulletin bridge (#2724)
5fe0f2f Bump tokio from 1.34.0 to 1.35.0
25f8251 Grafana update stuff (#2733)
06fbe8b Improved `ExportXcm::validate` implementation for BridgeHubs - step 1 (#2727)
390e836 Select header that will be fully refunded in on-demand batch finality relay (#2729)
ce701dd separate constants for average and worst case relay headers (#2728)
09215c5 Backport from `polkadot-sdk` + bump (#2725)
6327261 Bump serde from 1.0.192 to 1.0.193
fff9ddd Bump sysinfo from 0.29.10 to 0.29.11
4be99fe Monitoring and alerts for Rococo/Westend (#2710)
67a683a Bump ed25519-dalek from 2.0.0 to 2.1.0
8e0e794 quick and dirty fix for the `wait -p` and older distros (#2712)
3ab6562 Add withdraw reserve assets to zombienet tests (#2711)
c2c409b increase init timeouts in zombienet tests (#2706)
a8c60b4 fix lane id and bridged chain id (#2705)
9ac0f26 removed bp-asset-hub-kusama and bp-asset-hub-polkadot (#2703)
4916475 Some fixes for zombienet tests (polkadot-staging) (#2704)
6f9a147 zombienet from Wococo to Westend (#2699)
3ba7910 Porting changes from polkadot-sdk to polkadot-staging - before update subtree with removed wococo stuff (#2696)
653448f Remove Woococo related stuff (#2692)
03aaab2 Gitspiegel polkadot staging (#2695)
702a4c1 Drop Rialto <> Millau bridges (#2663) (#2694)
6a63b5f Start version guards for the ED loop (#2678)
896b9a9 typo (#2690)
671d27c Bump serde from 1.0.190 to 1.0.192
991b229 Bump clap from 4.4.7 to 4.4.8
ec267ec Bump env_logger from 0.10.0 to 0.10.1
592e407 Bump tokio from 1.33.0 to 1.34.0
c49ce3d Bump serde_json from 1.0.107 to 1.0.108
04b3319 Update subxt-codegen version (#2674)
03f9804 backport #2139 (#2673)
49245dd removed unused PARACHAINS_FINALITY_PALLET_NAME constant (#2670)
658a3f5 BHR/BHWE spec_version according to the `polkadot-sdk` (#2668)
7666b94 Nit from `polkadot-sdk` (#2665)
b5c43bb Adjusted constant because for measuring we used mistakenly rococo constants (#2664)
062449d Add Rococo<>Westend bridge support/relay (#2647)
55eb44e Add basic zombienet test to be used in the future (#2649) (#2660)
93b6b3f Bump clap from 4.4.6 to 4.4.7
4c01ab0 Bump futures from 0.3.28 to 0.3.29
a31a6c0 Bump tempfile from 3.8.0 to 3.8.1
bcdfe83 Bump serde from 1.0.189 to 1.0.190
f7433b0 Port #2648 to polkadot-staging (#2651)
3896738 Bump scale-info from 2.9.0 to 2.10.0
12d62c5 Bump thiserror from 1.0.49 to 1.0.50
1d78aa1 Backport from `polkadot-sdk` with actual master (#2633)
ab4de94 Grandpa justifications: Avoid duplicate vote ancestries (#2634) (#2635)
465562a add missing crate descriptions (#2629)
28d3680 Bump fixed-hash
67528c4 Bump serde from 1.0.188 to 1.0.189
d450c47 Bump time from 0.3.29 to 0.3.30
6a19f83 Bump async-trait from 0.1.73 to 0.1.74
a92d213 Millau, Rialto: accept equivocation reports (#2614) (#2617)
a61f777 Bump tokio from 1.32.0 to 1.33.0
0052f64 Bump subxt from 0.32.0 to 0.32.1
ccc849d Bump num-traits from 0.2.16 to 0.2.17
22f2752 apply late suggestions for #2600 (#2603)
0320172 actualize check_obsolete_call comment (#2601)
5cbbd25 Reject transactions if bridge pallets are halted (#2600)
ca4dfe3 Bump subxt from 0.31.0 to 0.32.0
8bf7b58 Bump clap from 4.4.4 to 4.4.6
88b0b99 Bump thiserror from 1.0.48 to 1.0.49
263833b https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/3833103 (#2589)
4f44968 Backport changes from polkadot-sdk (#2588)
7200ed1 fiox overflow when computing priority boost (#2587)
e02cbd3 Bump time from 0.3.28 to 0.3.29
a097dd2 Bump clap from 4.4.3 to 4.4.4
801ce88 Merge bulletin chain changes into polkadot staging (#2574)
a3803ce Add unit tests for the equivocation detection loop (#2571)
26dfc31 Bump clap from 4.4.2 to 4.4.3
66a8beb Bump serde_json from 1.0.106 to 1.0.107
18c50da Bump trie-db from 0.27.1 to 0.28.0
4c4fa92 Equivocation detection loop: Reorganize block checking logic as state machine (#2555) (#2557)
6bd317a Bump serde_json from 1.0.105 to 1.0.106
a7e6bfd Backport for polkadot-sdk#1446 (#2546)
d9f8050 Bump sysinfo from 0.29.9 to 0.29.10
901f44c Bump thiserror from 1.0.47 to 1.0.48
82eeb50 Bump sysinfo from 0.29.8 to 0.29.9
a0c934b Bump strum from 0.24.1 to 0.25.0
1064fbf Bump subxt from 0.28.0 to 0.31.0
e50398d bridges subtree fixes (#2528)
99af075 Markdown linter (#1309) (#2526)
733ff0f `polkadot-staging` branch: Use polkadot-sdk dependencies (#2524)
e8a59f1 Fix benchmark with new XCM::V3 `MAX_INSTRUCTIONS_TO_DECODE` (#2514)
62b185d Backport `polkadot-sdk` changes to `polkadot-staging` (#2518)
d9658f4 Fix equivocation detection containers startup (#2516) (#2517)
d65db28 Backport: building images from locally built binaries (#2513)
5fdbaf4 Start the equivocation detection loop from the complex relayer (#2507) (#2512)
7fbb67d Backport: Implement basic equivocations detection loop (#2375)
cb7efe2 Manually update deps in polkadot staging (#2371)
d17981f #2351 to polkadot-staging (#2359)

git-subtree-dir: bridges
git-subtree-split: 68d8650
bkchr
bkchr requested changes Dec 18, 2023
View reviewed changes
Copy link
Member

@bkchr bkchr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This will first require: #2738 and #2733

I would also not add a new warp sync mode and instead this should be decided based on the blocks-pruning/state pruning flags.

@tmpolaczyk
Copy link
Contributor Author

@bkchr regarding block prunning, I was thinking the same. I just tested that running --sync warp --blocks-pruning=100 does still download the full block history. So in that case we want to only download HEADER | BODY | JUSTIFICATION of the latest 100 blocks, and HEADER | JUSTIFICATION of the full block history. Is that correct?

@bkchr
Copy link
Member

bkchr commented Dec 18, 2023

So in that case we want to only download HEADER | BODY | JUSTIFICATION of the latest 100 blocks

Not sure I would care that much about this part, but it would be for sure the cleanest implementation. We will need some kind of implementation that handles the "dynamic nature", as the node will continue to import and finalize new blocks. This means, the "ultimate" last block to download moves all the time. However, it should not be that complicated to implement and also downloading one more block is probably fine.

and HEADER | JUSTIFICATION of the full block history.

The beauty of #2738 would be that we do not need to download them, as we already downloaded them as part of the warp proof. When we have support for syncing from a checkpoint, we will not have all the justifications back from the genesis anymore. We could then discuss to download them or we would expect that all nodes always use some recent checkpoint.

@bkchr bkchr mentioned this pull request Dec 18, 2023
Open
@dmitry-markin
Copy link
Contributor

To give a heads up — as the syncing is currently being heavily refactored in preparation for Sync 2.0, it's better to wait at least for #2467 and follow-up warp sync strategy PRs to be merged before implementing improvements to warp sync. Otherwise we'll end up with a lot of conflicts.

@tmpolaczyk
Copy link
Contributor Author

Ok, I will close this PR given that it needs to be rewritten anyway. If after sync 2.0 this functionality is still missing I will open a new PR. Thank you all for your input!

@tmpolaczyk tmpolaczyk closed this Dec 18, 2023
serban300 added a commit to serban300/polkadot-sdk that referenced this pull request Jan 19, 2024
@serban300
Squashed 'bridges/' changes from 277f0d5..2755d51
450e59b 
2755d51 [polkadot-staging] Backport polkadot-sdk changes + update refs (paritytech#2798)
dfec8bc [`polkadot-staging`] Separate `send_message()` validations (paritytech#2795)
c3e469e Bump thiserror from 1.0.55 to 1.0.56
8fb8fdd Port safe commits from master to polkadot-staging (paritytech#2761)
6e526c3 [polkadot-staging] Bump sysinfo from 0.29.11 to 0.30.5 (paritytech#2790)
c3436b2 Bump anyhow from 1.0.78 to 1.0.79
d618416 Bump async-trait from 0.1.76 to 0.1.77
d3f97a4 Bump serde_json from 1.0.109 to 1.0.111
688281f Bump thiserror from 1.0.53 to 1.0.55
d26dd51 get rid of LaneMessageVerifier (paritytech#2168) (paritytech#2764)
e189156 Bump serde_json from 1.0.108 to 1.0.109
e816e13 Bump tempfile from 3.8.1 to 3.9.0
1cd5db7 Bump async-trait from 0.1.75 to 0.1.76
d9cf492 Bump anyhow from 1.0.76 to 1.0.78
eabed3f Bump thiserror from 1.0.51 to 1.0.53
5011481 Bump async-trait from 0.1.74 to 0.1.75
64e635d Bump tokio from 1.35.0 to 1.35.1
c68b2a2 Bump futures from 0.3.29 to 0.3.30
114ad74 Bump anyhow from 1.0.75 to 1.0.76
afd1787 Bump time from 0.3.30 to 0.3.31
ea3d0cd Pokladot sdk backport to staging (paritytech#2746)
68d8650 Bump thiserror from 1.0.50 to 1.0.51
009c989 remove no longer valid check from the ensure_weights_are_correct (paritytech#2740)
94c44a7 Added Rococo BH <> Rococo Bulletin bridge (paritytech#2724)
5fe0f2f Bump tokio from 1.34.0 to 1.35.0
25f8251 Grafana update stuff (paritytech#2733)
06fbe8b Improved `ExportXcm::validate` implementation for BridgeHubs - step 1 (paritytech#2727)
390e836 Select header that will be fully refunded in on-demand batch finality relay (paritytech#2729)
ce701dd separate constants for average and worst case relay headers (paritytech#2728)
09215c5 Backport from `polkadot-sdk` + bump (paritytech#2725)
6327261 Bump serde from 1.0.192 to 1.0.193
fff9ddd Bump sysinfo from 0.29.10 to 0.29.11
4be99fe Monitoring and alerts for Rococo/Westend (paritytech#2710)
67a683a Bump ed25519-dalek from 2.0.0 to 2.1.0
8e0e794 quick and dirty fix for the `wait -p` and older distros (paritytech#2712)
3ab6562 Add withdraw reserve assets to zombienet tests (paritytech#2711)
c2c409b increase init timeouts in zombienet tests (paritytech#2706)
a8c60b4 fix lane id and bridged chain id (paritytech#2705)
9ac0f26 removed bp-asset-hub-kusama and bp-asset-hub-polkadot (paritytech#2703)
4916475 Some fixes for zombienet tests (polkadot-staging) (paritytech#2704)
6f9a147 zombienet from Wococo to Westend (paritytech#2699)
3ba7910 Porting changes from polkadot-sdk to polkadot-staging - before update subtree with removed wococo stuff (paritytech#2696)
653448f Remove Woococo related stuff (paritytech#2692)
03aaab2 Gitspiegel polkadot staging (paritytech#2695)
702a4c1 Drop Rialto <> Millau bridges (paritytech#2663) (paritytech#2694)
6a63b5f Start version guards for the ED loop (paritytech#2678)
896b9a9 typo (paritytech#2690)
671d27c Bump serde from 1.0.190 to 1.0.192
991b229 Bump clap from 4.4.7 to 4.4.8
ec267ec Bump env_logger from 0.10.0 to 0.10.1
592e407 Bump tokio from 1.33.0 to 1.34.0
c49ce3d Bump serde_json from 1.0.107 to 1.0.108
04b3319 Update subxt-codegen version (paritytech#2674)
03f9804 backport paritytech#2139 (paritytech#2673)
49245dd removed unused PARACHAINS_FINALITY_PALLET_NAME constant (paritytech#2670)
658a3f5 BHR/BHWE spec_version according to the `polkadot-sdk` (paritytech#2668)
7666b94 Nit from `polkadot-sdk` (paritytech#2665)
b5c43bb Adjusted constant because for measuring we used mistakenly rococo constants (paritytech#2664)
062449d Add Rococo<>Westend bridge support/relay (paritytech#2647)
55eb44e Add basic zombienet test to be used in the future (paritytech#2649) (paritytech#2660)
93b6b3f Bump clap from 4.4.6 to 4.4.7
4c01ab0 Bump futures from 0.3.28 to 0.3.29
a31a6c0 Bump tempfile from 3.8.0 to 3.8.1
bcdfe83 Bump serde from 1.0.189 to 1.0.190
f7433b0 Port paritytech#2648 to polkadot-staging (paritytech#2651)
3896738 Bump scale-info from 2.9.0 to 2.10.0
12d62c5 Bump thiserror from 1.0.49 to 1.0.50
1d78aa1 Backport from `polkadot-sdk` with actual master (paritytech#2633)
ab4de94 Grandpa justifications: Avoid duplicate vote ancestries (paritytech#2634) (paritytech#2635)
465562a add missing crate descriptions (paritytech#2629)
28d3680 Bump fixed-hash
67528c4 Bump serde from 1.0.188 to 1.0.189
d450c47 Bump time from 0.3.29 to 0.3.30
6a19f83 Bump async-trait from 0.1.73 to 0.1.74
a92d213 Millau, Rialto: accept equivocation reports (paritytech#2614) (paritytech#2617)
a61f777 Bump tokio from 1.32.0 to 1.33.0
0052f64 Bump subxt from 0.32.0 to 0.32.1
ccc849d Bump num-traits from 0.2.16 to 0.2.17
22f2752 apply late suggestions for paritytech#2600 (paritytech#2603)
0320172 actualize check_obsolete_call comment (paritytech#2601)
5cbbd25 Reject transactions if bridge pallets are halted (paritytech#2600)
ca4dfe3 Bump subxt from 0.31.0 to 0.32.0
8bf7b58 Bump clap from 4.4.4 to 4.4.6
88b0b99 Bump thiserror from 1.0.48 to 1.0.49
263833b https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/3833103 (paritytech#2589)
4f44968 Backport changes from polkadot-sdk (paritytech#2588)
7200ed1 fiox overflow when computing priority boost (paritytech#2587)
e02cbd3 Bump time from 0.3.28 to 0.3.29
a097dd2 Bump clap from 4.4.3 to 4.4.4
801ce88 Merge bulletin chain changes into polkadot staging (paritytech#2574)
a3803ce Add unit tests for the equivocation detection loop (paritytech#2571)
26dfc31 Bump clap from 4.4.2 to 4.4.3
66a8beb Bump serde_json from 1.0.106 to 1.0.107
18c50da Bump trie-db from 0.27.1 to 0.28.0
4c4fa92 Equivocation detection loop: Reorganize block checking logic as state machine (paritytech#2555) (paritytech#2557)
6bd317a Bump serde_json from 1.0.105 to 1.0.106
a7e6bfd Backport for polkadot-sdk#1446 (paritytech#2546)
d9f8050 Bump sysinfo from 0.29.9 to 0.29.10
901f44c Bump thiserror from 1.0.47 to 1.0.48
82eeb50 Bump sysinfo from 0.29.8 to 0.29.9
a0c934b Bump strum from 0.24.1 to 0.25.0
1064fbf Bump subxt from 0.28.0 to 0.31.0
e50398d bridges subtree fixes (paritytech#2528)
99af075 Markdown linter (paritytech#1309) (paritytech#2526)
733ff0f `polkadot-staging` branch: Use polkadot-sdk dependencies (paritytech#2524)
e8a59f1 Fix benchmark with new XCM::V3 `MAX_INSTRUCTIONS_TO_DECODE` (paritytech#2514)
62b185d Backport `polkadot-sdk` changes to `polkadot-staging` (paritytech#2518)
d9658f4 Fix equivocation detection containers startup (paritytech#2516) (paritytech#2517)
d65db28 Backport: building images from locally built binaries (paritytech#2513)
5fdbaf4 Start the equivocation detection loop from the complex relayer (paritytech#2507) (paritytech#2512)
7fbb67d Backport: Implement basic equivocations detection loop (paritytech#2375)
cb7efe2 Manually update deps in polkadot staging (paritytech#2371)
d17981f paritytech#2351 to polkadot-staging (paritytech#2359)

git-subtree-dir: bridges
git-subtree-split: 2755d51
serban300 pushed a commit to serban300/polkadot-sdk that referenced this pull request Mar 26, 2024
@bkontur
Monitoring and alerts for Rococo/Westend (paritytech#2710)
4be99fe 
* Monitoring and alerts for Rococo/Westend

* 00000001 -> 00000002

* Backup actual version

* Upload "Rococo BEEFY dashboard" from grafana (I cannot find it)

* Separated Rococo Beefy dashboard and alerts

* Group Rococo BEEFY alerts + add `Rococo` labels

* Renamed evaluation group `Bridges` -> `Bridge Rococo <> Wococo`

* Updated Wococo -> Westend dashboards

* Rococo<>Westend alerts

* Fixed matrix_room for rococo beefy

* Removed "refId": "B" for rewards lags and set condition A > 10 + fixed time range

* Delivery race dashboard from now-5m -> now-6h

* Removed rococo-wococo

* Less than 500 Westend headers have been synced to RococoBridgeHub in last 120 minutes -> 390
serban300 added a commit to serban300/polkadot-sdk that referenced this pull request Mar 26, 2024
@serban300
Squashed 'bridges/' changes from 277f0d5..b9acdab
83a013f 
b9acdab polkadot-sdk backport leftovers (paritytech#2896)
1022b6d Relayer v1.2.1 (paritytech#2895)
47b4c48 relayer waits until chain spec version matches the configured in Client constructor/reconnect (paritytech#2894)
a6bac6b Move relay clients to separate folder (paritytech#2893)
4bc73d8 [Backport from `polkadot-sdk`] Move chain definitions to separate folder (paritytech#2892)
8e58eb9 Bump async-trait from 0.1.78 to 0.1.79
28c459b Backport changes from `polkadot-sdk/master` (paritytech#2887)
2a76cbb Move generic CLI logic to different crate (paritytech#2885)
9cb8a2c fixed dependency in runtime-codegen (paritytech#2886)
62372e7 Bump async-trait from 0.1.77 to 0.1.78
61e865b Bump anyhow from 1.0.80 to 1.0.81
d9c5e41 Bump scale-info from 2.10.0 to 2.11.0
9be3e0b Bump thiserror from 1.0.57 to 1.0.58
88900bd backport changes from polkadot-sdk (paritytech#2872)
5c923e0 Bump strum from 0.26.1 to 0.26.2
7e22cc3 Bump sysinfo from 0.30.6 to 0.30.7
3f3d836 Bump env_logger from 0.11.2 to 0.11.3
8b903c6 Prepare P<> K relay release: 1.2.0 (paritytech#2863)
1b0ea65 Document: how to make relayer releases (paritytech#2860)
af8480e Some remaining fixes (mostly insubstantial) for relay (paritytech#2859)
503f64b Bump log from 0.4.20 to 0.4.21
7ee64ec Bump tempfile from 3.10.0 to 3.10.1
38254ac Bump sysinfo from 0.30.5 to 0.30.6
ccf18d6 [Do Not Merge until RBH/WBH upgrade] Relayers use new submit_finality_proof_ex call in Rococo <> Westend bridge (paritytech#2827)
f1c1487 Running relayer: documentation (paritytech#2829)
9f89c7e Bump anyhow from 1.0.79 to 1.0.80
5317ccb Bump serde from 1.0.196 to 1.0.197
d218c7a Bump serde_json from 1.0.113 to 1.0.114
bf7b81a Bump env_logger from 0.11.1 to 0.11.2
8e7b471 Fix relay submitting extra parachain headers during reorg (paritytech#2839)
8a0ed23 Bump thiserror from 1.0.56 to 1.0.57
915628a Bump ed25519-dalek from 2.1.0 to 2.1.1
6c1ed87 Bump tempfile from 3.9.0 to 3.10.0
723f38f Bump num-traits from 0.2.17 to 0.2.18
409922b fix typo (paritytech#2826)
555866b Backport latest PRs from polkadot sdk (paritytech#2824)
d099107 Pass finality proof verification context to the call builder (paritytech#2823)
b3528d2 Add submit_finality_proof_ex call to the GRANDPA pallet (paritytech#2821)
577d2e6 Bump time from 0.3.31 to 0.3.34
b04e82c Bump tokio from 1.35.1 to 1.36.0
b266084 Bump serde_json from 1.0.112 to 1.0.113
dfb0f90 fix clippy
49d1d5e Bump strum from 0.25.0 to 0.26.1
7d92922 Bump serde from 1.0.195 to 1.0.196
2605273 Bump serde_json from 1.0.111 to 1.0.112
b5fa75b Bump env_logger from 0.11.0 to 0.11.1
f116c29 Bump env_logger from 0.10.1 to 0.11.0
2755d51 [polkadot-staging] Backport polkadot-sdk changes + update refs (paritytech#2798)
dfec8bc [`polkadot-staging`] Separate `send_message()` validations (paritytech#2795)
c3e469e Bump thiserror from 1.0.55 to 1.0.56
8fb8fdd Port safe commits from master to polkadot-staging (paritytech#2761)
6e526c3 [polkadot-staging] Bump sysinfo from 0.29.11 to 0.30.5 (paritytech#2790)
c3436b2 Bump anyhow from 1.0.78 to 1.0.79
d618416 Bump async-trait from 0.1.76 to 0.1.77
d3f97a4 Bump serde_json from 1.0.109 to 1.0.111
688281f Bump thiserror from 1.0.53 to 1.0.55
d26dd51 get rid of LaneMessageVerifier (paritytech#2168) (paritytech#2764)
e189156 Bump serde_json from 1.0.108 to 1.0.109
e816e13 Bump tempfile from 3.8.1 to 3.9.0
1cd5db7 Bump async-trait from 0.1.75 to 0.1.76
d9cf492 Bump anyhow from 1.0.76 to 1.0.78
eabed3f Bump thiserror from 1.0.51 to 1.0.53
5011481 Bump async-trait from 0.1.74 to 0.1.75
64e635d Bump tokio from 1.35.0 to 1.35.1
c68b2a2 Bump futures from 0.3.29 to 0.3.30
114ad74 Bump anyhow from 1.0.75 to 1.0.76
afd1787 Bump time from 0.3.30 to 0.3.31
ea3d0cd Pokladot sdk backport to staging (paritytech#2746)
68d8650 Bump thiserror from 1.0.50 to 1.0.51
009c989 remove no longer valid check from the ensure_weights_are_correct (paritytech#2740)
94c44a7 Added Rococo BH <> Rococo Bulletin bridge (paritytech#2724)
5fe0f2f Bump tokio from 1.34.0 to 1.35.0
25f8251 Grafana update stuff (paritytech#2733)
06fbe8b Improved `ExportXcm::validate` implementation for BridgeHubs - step 1 (paritytech#2727)
390e836 Select header that will be fully refunded in on-demand batch finality relay (paritytech#2729)
ce701dd separate constants for average and worst case relay headers (paritytech#2728)
09215c5 Backport from `polkadot-sdk` + bump (paritytech#2725)
6327261 Bump serde from 1.0.192 to 1.0.193
fff9ddd Bump sysinfo from 0.29.10 to 0.29.11
4be99fe Monitoring and alerts for Rococo/Westend (paritytech#2710)
67a683a Bump ed25519-dalek from 2.0.0 to 2.1.0
8e0e794 quick and dirty fix for the `wait -p` and older distros (paritytech#2712)
3ab6562 Add withdraw reserve assets to zombienet tests (paritytech#2711)
c2c409b increase init timeouts in zombienet tests (paritytech#2706)
a8c60b4 fix lane id and bridged chain id (paritytech#2705)
9ac0f26 removed bp-asset-hub-kusama and bp-asset-hub-polkadot (paritytech#2703)
4916475 Some fixes for zombienet tests (polkadot-staging) (paritytech#2704)
6f9a147 zombienet from Wococo to Westend (paritytech#2699)
3ba7910 Porting changes from polkadot-sdk to polkadot-staging - before update subtree with removed wococo stuff (paritytech#2696)
653448f Remove Woococo related stuff (paritytech#2692)
03aaab2 Gitspiegel polkadot staging (paritytech#2695)
702a4c1 Drop Rialto <> Millau bridges (paritytech#2663) (paritytech#2694)
6a63b5f Start version guards for the ED loop (paritytech#2678)
896b9a9 typo (paritytech#2690)
671d27c Bump serde from 1.0.190 to 1.0.192
991b229 Bump clap from 4.4.7 to 4.4.8
ec267ec Bump env_logger from 0.10.0 to 0.10.1
592e407 Bump tokio from 1.33.0 to 1.34.0
c49ce3d Bump serde_json from 1.0.107 to 1.0.108
04b3319 Update subxt-codegen version (paritytech#2674)
03f9804 backport paritytech#2139 (paritytech#2673)
49245dd removed unused PARACHAINS_FINALITY_PALLET_NAME constant (paritytech#2670)
658a3f5 BHR/BHWE spec_version according to the `polkadot-sdk` (paritytech#2668)
7666b94 Nit from `polkadot-sdk` (paritytech#2665)
b5c43bb Adjusted constant because for measuring we used mistakenly rococo constants (paritytech#2664)
062449d Add Rococo<>Westend bridge support/relay (paritytech#2647)
55eb44e Add basic zombienet test to be used in the future (paritytech#2649) (paritytech#2660)
93b6b3f Bump clap from 4.4.6 to 4.4.7
4c01ab0 Bump futures from 0.3.28 to 0.3.29
a31a6c0 Bump tempfile from 3.8.0 to 3.8.1
bcdfe83 Bump serde from 1.0.189 to 1.0.190
f7433b0 Port paritytech#2648 to polkadot-staging (paritytech#2651)
3896738 Bump scale-info from 2.9.0 to 2.10.0
12d62c5 Bump thiserror from 1.0.49 to 1.0.50
1d78aa1 Backport from `polkadot-sdk` with actual master (paritytech#2633)
ab4de94 Grandpa justifications: Avoid duplicate vote ancestries (paritytech#2634) (paritytech#2635)
465562a add missing crate descriptions (paritytech#2629)
28d3680 Bump fixed-hash
67528c4 Bump serde from 1.0.188 to 1.0.189
d450c47 Bump time from 0.3.29 to 0.3.30
6a19f83 Bump async-trait from 0.1.73 to 0.1.74
a92d213 Millau, Rialto: accept equivocation reports (paritytech#2614) (paritytech#2617)
a61f777 Bump tokio from 1.32.0 to 1.33.0
0052f64 Bump subxt from 0.32.0 to 0.32.1
ccc849d Bump num-traits from 0.2.16 to 0.2.17
22f2752 apply late suggestions for paritytech#2600 (paritytech#2603)
0320172 actualize check_obsolete_call comment (paritytech#2601)
5cbbd25 Reject transactions if bridge pallets are halted (paritytech#2600)
ca4dfe3 Bump subxt from 0.31.0 to 0.32.0
8bf7b58 Bump clap from 4.4.4 to 4.4.6
88b0b99 Bump thiserror from 1.0.48 to 1.0.49
263833b https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/3833103 (paritytech#2589)
4f44968 Backport changes from polkadot-sdk (paritytech#2588)
7200ed1 fiox overflow when computing priority boost (paritytech#2587)
e02cbd3 Bump time from 0.3.28 to 0.3.29
a097dd2 Bump clap from 4.4.3 to 4.4.4
801ce88 Merge bulletin chain changes into polkadot staging (paritytech#2574)
a3803ce Add unit tests for the equivocation detection loop (paritytech#2571)
26dfc31 Bump clap from 4.4.2 to 4.4.3
66a8beb Bump serde_json from 1.0.106 to 1.0.107
18c50da Bump trie-db from 0.27.1 to 0.28.0
4c4fa92 Equivocation detection loop: Reorganize block checking logic as state machine (paritytech#2555) (paritytech#2557)
6bd317a Bump serde_json from 1.0.105 to 1.0.106
a7e6bfd Backport for polkadot-sdk#1446 (paritytech#2546)
d9f8050 Bump sysinfo from 0.29.9 to 0.29.10
901f44c Bump thiserror from 1.0.47 to 1.0.48
82eeb50 Bump sysinfo from 0.29.8 to 0.29.9
a0c934b Bump strum from 0.24.1 to 0.25.0
1064fbf Bump subxt from 0.28.0 to 0.31.0
e50398d bridges subtree fixes (paritytech#2528)
99af075 Markdown linter (paritytech#1309) (paritytech#2526)
733ff0f `polkadot-staging` branch: Use polkadot-sdk dependencies (paritytech#2524)
e8a59f1 Fix benchmark with new XCM::V3 `MAX_INSTRUCTIONS_TO_DECODE` (paritytech#2514)
62b185d Backport `polkadot-sdk` changes to `polkadot-staging` (paritytech#2518)
d9658f4 Fix equivocation detection containers startup (paritytech#2516) (paritytech#2517)
d65db28 Backport: building images from locally built binaries (paritytech#2513)
5fdbaf4 Start the equivocation detection loop from the complex relayer (paritytech#2507) (paritytech#2512)
7fbb67d Backport: Implement basic equivocations detection loop (paritytech#2375)
cb7efe2 Manually update deps in polkadot staging (paritytech#2371)
d17981f paritytech#2351 to polkadot-staging (paritytech#2359)

git-subtree-dir: bridges
git-subtree-split: b9acdab
serban300 added a commit to serban300/polkadot-sdk that referenced this pull request Apr 2, 2024
@serban300
Squashed 'bridges/' changes from 277f0d5..bea13eab99a
09f41c8 
bea13eab99a ckb-merkle-mountain-range -> 0.5.2 (paritytech#2911)
8c4c99d11b3 Address migration comments (paritytech#2910)
34817d81593 Some relayer improvments (paritytech#2902)
f7f983c4f8f Bump tokio from 1.36.0 to 1.37.0
051d6ed6446 Bump scale-info from 2.11.0 to 2.11.1
35474455e9a Bump serde_json from 1.0.114 to 1.0.115
956601369a5 Fix polkadot-sdk CI failures (paritytech#2901)
1e4fd28e99c Leftover (paritytech#2900)
a7a47eaebe6 Backport changes from polkadot-sdk (paritytech#2899)
e4e1ea60cfb Remove test dependecies on specific relay clients (paritytech#2898)
b9acdab polkadot-sdk backport leftovers (paritytech#2896)
1022b6d Relayer v1.2.1 (paritytech#2895)
47b4c48 relayer waits until chain spec version matches the configured in Client constructor/reconnect (paritytech#2894)
a6bac6b Move relay clients to separate folder (paritytech#2893)
4bc73d8 [Backport from `polkadot-sdk`] Move chain definitions to separate folder (paritytech#2892)
8e58eb9 Bump async-trait from 0.1.78 to 0.1.79
28c459b Backport changes from `polkadot-sdk/master` (paritytech#2887)
2a76cbb Move generic CLI logic to different crate (paritytech#2885)
9cb8a2c fixed dependency in runtime-codegen (paritytech#2886)
62372e7 Bump async-trait from 0.1.77 to 0.1.78
61e865b Bump anyhow from 1.0.80 to 1.0.81
d9c5e41 Bump scale-info from 2.10.0 to 2.11.0
9be3e0b Bump thiserror from 1.0.57 to 1.0.58
88900bd backport changes from polkadot-sdk (paritytech#2872)
5c923e0 Bump strum from 0.26.1 to 0.26.2
7e22cc3 Bump sysinfo from 0.30.6 to 0.30.7
3f3d836 Bump env_logger from 0.11.2 to 0.11.3
8b903c6 Prepare P<> K relay release: 1.2.0 (paritytech#2863)
1b0ea65 Document: how to make relayer releases (paritytech#2860)
af8480e Some remaining fixes (mostly insubstantial) for relay (paritytech#2859)
503f64b Bump log from 0.4.20 to 0.4.21
7ee64ec Bump tempfile from 3.10.0 to 3.10.1
38254ac Bump sysinfo from 0.30.5 to 0.30.6
ccf18d6 [Do Not Merge until RBH/WBH upgrade] Relayers use new submit_finality_proof_ex call in Rococo <> Westend bridge (paritytech#2827)
f1c1487 Running relayer: documentation (paritytech#2829)
9f89c7e Bump anyhow from 1.0.79 to 1.0.80
5317ccb Bump serde from 1.0.196 to 1.0.197
d218c7a Bump serde_json from 1.0.113 to 1.0.114
bf7b81a Bump env_logger from 0.11.1 to 0.11.2
8e7b471 Fix relay submitting extra parachain headers during reorg (paritytech#2839)
8a0ed23 Bump thiserror from 1.0.56 to 1.0.57
915628a Bump ed25519-dalek from 2.1.0 to 2.1.1
6c1ed87 Bump tempfile from 3.9.0 to 3.10.0
723f38f Bump num-traits from 0.2.17 to 0.2.18
409922b fix typo (paritytech#2826)
555866b Backport latest PRs from polkadot sdk (paritytech#2824)
d099107 Pass finality proof verification context to the call builder (paritytech#2823)
b3528d2 Add submit_finality_proof_ex call to the GRANDPA pallet (paritytech#2821)
577d2e6 Bump time from 0.3.31 to 0.3.34
b04e82c Bump tokio from 1.35.1 to 1.36.0
b266084 Bump serde_json from 1.0.112 to 1.0.113
dfb0f90 fix clippy
49d1d5e Bump strum from 0.25.0 to 0.26.1
7d92922 Bump serde from 1.0.195 to 1.0.196
2605273 Bump serde_json from 1.0.111 to 1.0.112
b5fa75b Bump env_logger from 0.11.0 to 0.11.1
f116c29 Bump env_logger from 0.10.1 to 0.11.0
2755d51 [polkadot-staging] Backport polkadot-sdk changes + update refs (paritytech#2798)
dfec8bc [`polkadot-staging`] Separate `send_message()` validations (paritytech#2795)
c3e469e Bump thiserror from 1.0.55 to 1.0.56
8fb8fdd Port safe commits from master to polkadot-staging (paritytech#2761)
6e526c3 [polkadot-staging] Bump sysinfo from 0.29.11 to 0.30.5 (paritytech#2790)
c3436b2 Bump anyhow from 1.0.78 to 1.0.79
d618416 Bump async-trait from 0.1.76 to 0.1.77
d3f97a4 Bump serde_json from 1.0.109 to 1.0.111
688281f Bump thiserror from 1.0.53 to 1.0.55
d26dd51 get rid of LaneMessageVerifier (paritytech#2168) (paritytech#2764)
e189156 Bump serde_json from 1.0.108 to 1.0.109
e816e13 Bump tempfile from 3.8.1 to 3.9.0
1cd5db7 Bump async-trait from 0.1.75 to 0.1.76
d9cf492 Bump anyhow from 1.0.76 to 1.0.78
eabed3f Bump thiserror from 1.0.51 to 1.0.53
5011481 Bump async-trait from 0.1.74 to 0.1.75
64e635d Bump tokio from 1.35.0 to 1.35.1
c68b2a2 Bump futures from 0.3.29 to 0.3.30
114ad74 Bump anyhow from 1.0.75 to 1.0.76
afd1787 Bump time from 0.3.30 to 0.3.31
ea3d0cd Pokladot sdk backport to staging (paritytech#2746)
68d8650 Bump thiserror from 1.0.50 to 1.0.51
009c989 remove no longer valid check from the ensure_weights_are_correct (paritytech#2740)
94c44a7 Added Rococo BH <> Rococo Bulletin bridge (paritytech#2724)
5fe0f2f Bump tokio from 1.34.0 to 1.35.0
25f8251 Grafana update stuff (paritytech#2733)
06fbe8b Improved `ExportXcm::validate` implementation for BridgeHubs - step 1 (paritytech#2727)
390e836 Select header that will be fully refunded in on-demand batch finality relay (paritytech#2729)
ce701dd separate constants for average and worst case relay headers (paritytech#2728)
09215c5 Backport from `polkadot-sdk` + bump (paritytech#2725)
6327261 Bump serde from 1.0.192 to 1.0.193
fff9ddd Bump sysinfo from 0.29.10 to 0.29.11
4be99fe Monitoring and alerts for Rococo/Westend (paritytech#2710)
67a683a Bump ed25519-dalek from 2.0.0 to 2.1.0
8e0e794 quick and dirty fix for the `wait -p` and older distros (paritytech#2712)
3ab6562 Add withdraw reserve assets to zombienet tests (paritytech#2711)
c2c409b increase init timeouts in zombienet tests (paritytech#2706)
a8c60b4 fix lane id and bridged chain id (paritytech#2705)
9ac0f26 removed bp-asset-hub-kusama and bp-asset-hub-polkadot (paritytech#2703)
4916475 Some fixes for zombienet tests (polkadot-staging) (paritytech#2704)
6f9a147 zombienet from Wococo to Westend (paritytech#2699)
3ba7910 Porting changes from polkadot-sdk to polkadot-staging - before update subtree with removed wococo stuff (paritytech#2696)
653448f Remove Woococo related stuff (paritytech#2692)
03aaab2 Gitspiegel polkadot staging (paritytech#2695)
702a4c1 Drop Rialto <> Millau bridges (paritytech#2663) (paritytech#2694)
6a63b5f Start version guards for the ED loop (paritytech#2678)
896b9a9 typo (paritytech#2690)
671d27c Bump serde from 1.0.190 to 1.0.192
991b229 Bump clap from 4.4.7 to 4.4.8
ec267ec Bump env_logger from 0.10.0 to 0.10.1
592e407 Bump tokio from 1.33.0 to 1.34.0
c49ce3d Bump serde_json from 1.0.107 to 1.0.108
04b3319 Update subxt-codegen version (paritytech#2674)
03f9804 backport paritytech#2139 (paritytech#2673)
49245dd removed unused PARACHAINS_FINALITY_PALLET_NAME constant (paritytech#2670)
658a3f5 BHR/BHWE spec_version according to the `polkadot-sdk` (paritytech#2668)
7666b94 Nit from `polkadot-sdk` (paritytech#2665)
b5c43bb Adjusted constant because for measuring we used mistakenly rococo constants (paritytech#2664)
062449d Add Rococo<>Westend bridge support/relay (paritytech#2647)
55eb44e Add basic zombienet test to be used in the future (paritytech#2649) (paritytech#2660)
93b6b3f Bump clap from 4.4.6 to 4.4.7
4c01ab0 Bump futures from 0.3.28 to 0.3.29
a31a6c0 Bump tempfile from 3.8.0 to 3.8.1
bcdfe83 Bump serde from 1.0.189 to 1.0.190
f7433b0 Port paritytech#2648 to polkadot-staging (paritytech#2651)
3896738 Bump scale-info from 2.9.0 to 2.10.0
12d62c5 Bump thiserror from 1.0.49 to 1.0.50
1d78aa1 Backport from `polkadot-sdk` with actual master (paritytech#2633)
ab4de94 Grandpa justifications: Avoid duplicate vote ancestries (paritytech#2634) (paritytech#2635)
465562a add missing crate descriptions (paritytech#2629)
28d3680 Bump fixed-hash
67528c4 Bump serde from 1.0.188 to 1.0.189
d450c47 Bump time from 0.3.29 to 0.3.30
6a19f83 Bump async-trait from 0.1.73 to 0.1.74
a92d213 Millau, Rialto: accept equivocation reports (paritytech#2614) (paritytech#2617)
a61f777 Bump tokio from 1.32.0 to 1.33.0
0052f64 Bump subxt from 0.32.0 to 0.32.1
ccc849d Bump num-traits from 0.2.16 to 0.2.17
22f2752 apply late suggestions for paritytech#2600 (paritytech#2603)
0320172 actualize check_obsolete_call comment (paritytech#2601)
5cbbd25 Reject transactions if bridge pallets are halted (paritytech#2600)
ca4dfe3 Bump subxt from 0.31.0 to 0.32.0
8bf7b58 Bump clap from 4.4.4 to 4.4.6
88b0b99 Bump thiserror from 1.0.48 to 1.0.49
263833b https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/3833103 (paritytech#2589)
4f44968 Backport changes from polkadot-sdk (paritytech#2588)
7200ed1 fiox overflow when computing priority boost (paritytech#2587)
e02cbd3 Bump time from 0.3.28 to 0.3.29
a097dd2 Bump clap from 4.4.3 to 4.4.4
801ce88 Merge bulletin chain changes into polkadot staging (paritytech#2574)
a3803ce Add unit tests for the equivocation detection loop (paritytech#2571)
26dfc31 Bump clap from 4.4.2 to 4.4.3
66a8beb Bump serde_json from 1.0.106 to 1.0.107
18c50da Bump trie-db from 0.27.1 to 0.28.0
4c4fa92 Equivocation detection loop: Reorganize block checking logic as state machine (paritytech#2555) (paritytech#2557)
6bd317a Bump serde_json from 1.0.105 to 1.0.106
a7e6bfd Backport for polkadot-sdk#1446 (paritytech#2546)
d9f8050 Bump sysinfo from 0.29.9 to 0.29.10
901f44c Bump thiserror from 1.0.47 to 1.0.48
82eeb50 Bump sysinfo from 0.29.8 to 0.29.9
a0c934b Bump strum from 0.24.1 to 0.25.0
1064fbf Bump subxt from 0.28.0 to 0.31.0
e50398d bridges subtree fixes (paritytech#2528)
99af075 Markdown linter (paritytech#1309) (paritytech#2526)
733ff0f `polkadot-staging` branch: Use polkadot-sdk dependencies (paritytech#2524)
e8a59f1 Fix benchmark with new XCM::V3 `MAX_INSTRUCTIONS_TO_DECODE` (paritytech#2514)
62b185d Backport `polkadot-sdk` changes to `polkadot-staging` (paritytech#2518)
d9658f4 Fix equivocation detection containers startup (paritytech#2516) (paritytech#2517)
d65db28 Backport: building images from locally built binaries (paritytech#2513)
5fdbaf4 Start the equivocation detection loop from the complex relayer (paritytech#2507) (paritytech#2512)
7fbb67d Backport: Implement basic equivocations detection loop (paritytech#2375)
cb7efe2 Manually update deps in polkadot staging (paritytech#2371)
d17981f paritytech#2351 to polkadot-staging (paritytech#2359)

git-subtree-dir: bridges
git-subtree-split: bea13eab99af22f943b06397324c14fb2d7149e1
@girazoki girazoki mentioned this pull request Jul 3, 2024
Open
@tmpolaczyk tmpolaczyk mentioned this pull request Jul 23, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bkchr bkchr bkchr requested changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

warp sync without download histrocial blocks
6 participants
@tmpolaczyk @paritytech-cicd-pr @tomaka @dmitry-markin @girazoki @bkchr