-
Notifications
You must be signed in to change notification settings - Fork 129
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Unify metric names #1209
Unify metric names #1209
Conversation
// takes a bit longer than expected - initially I was going to replace Prometheus registry with our own struct that will essentially be a map of id -> standalone metric. But that was not a best idea, so now I'm moving all standalone metrics to the binary ( |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
deployments/bridges/rialto-millau/dashboard/grafana/rialto-millau-maintenance-dashboard.json
Show resolved
Hide resolved
* unify metric names * refactor standalone metrics * headers sync metrics * post-merge fix * fix compilation * fmt * fix dashboards * fix local dashboards * update Rococo/Wococo runtime version * remove commented code * fixed grumbles * fmt * fixed widget names
* Add `AtLeast32BitUnsigned` for MessageLance::SourceChainBalance (#1207) * Fix UI deployment. (#1211) * Remove unused PoA<>Substrate bridge (#1210) * Decouple the PoA bridge code from Rialto * Remove Rialto PoA bridge code * Remove relays/bin-ethereum code * Remove relays/client-ethereum code * Remove modules/ethereum code * Remove modules/ethereum-contract-builtin code * Remove PoA bridge documentation * Remove primitives/ethereum-poa code * Decouple Rialto from currency-exchange * Fix building with runtime-benchmarks * Fix should_encode_bridge_send_message_call test Because we removed some runtime modules/pallets, the substrate2substrate bridge pallet has a different index within the runtime so its calls have a different encoding. Update the test to use the new encoding. * Update readme - no more PoA bridge * Remove deployments/bridges/poa-rialto Also removes: - deployments/networks/eth-poa.yml - deployments/networks/OpenEthereum.Dockerfile * Remove deployments/dev/poa-config * Update deployments readme - no more PoA bridge * Remove eth-related scripts Deletes: - deployments/networks/eth-poa.yml - scripts/run-openethereum-node.sh * Remove poa-relay from gitlab-ci * Dockerfiles to use substrate-relay as default * Remove modules/currency-exchange code * Remove primitives/currency-exchange code Signed-off-by: acatangiu <adrian@parity.io> * Remove unused `relays/headers` (#1216) * Decouple `relays/client-substrate` from `headers_relay` * Remove `blocks_in_state` from `SyncLoopMetrics` This metric was only relevant for PoA <> Substrate bridge. * Move `sync_loop_metrics.rs` to `relays/finality` * Remove unused `SyncLoopMetrics::update()` * Hook up SyncLoopMetrics to finality_loop * Delete now unused `relays/headers` Signed-off-by: acatangiu <adrian@parity.io> * remove abandoned exchange relay (#1217) * Unify metric names (#1209) * unify metric names * refactor standalone metrics * headers sync metrics * post-merge fix * fix compilation * fmt * fix dashboards * fix local dashboards * update Rococo/Wococo runtime version * remove commented code * fixed grumbles * fmt * fixed widget names * Add CODEOWNERS file (#1219) * fixed set_operational in GRANDPA pallet (#1226) * Add mut support (#1232) * update dependencies (#1229) * Integrate BEEFY with Rialto & Millau runtimes (#1227) * Add Beefy pallet to Rialto runtime * Add Beefy gadget to Rialto node * Add MMR pallet to Rialto runtime * Add Beefy pallet to Millau runtime * Add Beefy gadget to Millau node * Add MMR pallet to Millau runtime * Add pallet_beefy_mmr to Millau runtime * Add pallet_beefy_mmr to Rialto runtime * Implement MMR and BEEFY APIs in Rialto * fix unit tests - should_encode_bridge_send_message_call() tests for new runtime encoding resulted from newly added pallets. - runtime size_of::<Call>() slightly increased from newly added pallets. * fix grumbles * tighten clippy allowances * fix more grumbles * Add MMR RPC to Rialto and Millau nodes Also implement MmrApi in Millau runtime. * rialto: use upstream polkadot_client::RuntimeApiCollection * Fix storage parameter name computation (#1238) * fixed storage_parameter_key * added test for storage_parameter_key * Enable Beefy debug logs in test deployment (#1237) Signed-off-by: Adrian Catangiu <adrian@parity.io> * Enable offchain indexing for Rialto/Millau nodes (#1239) * Enable off-chain indexing for Rialto & Millau nodes * cargo fmt --all * cargo +nightly fmt --all * fmt is weird. * Update Rococo/Wococo version + prepare relay for Rococo<>Wococo bridge (#1241) * update Rococo version + create relayers fund account * start finality relay guards when complex relay is started * Refactor finality relay helpers (#1220) * refactor finality relay helper definitions * add missing doc * removed commented code * fmt * disable rustfmt for macro * move best_finalized method const to relay chain def * Expose prometheus BEEFY metrics and add them to grafana dashboard (#1242) * deployments: expose node metrics Signed-off-by: acatangiu <adrian@parity.io> * deployments: add beefy grafana dashboard Signed-off-by: acatangiu <adrian@parity.io> * deployments: add beefy alarms Signed-off-by: acatangiu <adrian@parity.io> * Fix transactions mortality (#1196) * added lost stall timeout fix * use best_block.parent() to start mortal tx era * fmt * Revert "revert messages transactions mortality" This reverts commit 7777635. * post-merge build fix (#1243) * Refactor message relay helpers (#1234) * refactor message relay helpers * single standalone_metrics function * fixed tests * clippy + fmt * removed commented code * add calls tracing * fix spelling * cargo fmt * -commented code * fix build again * post-merge build fix * clippy + fmt * Use same endowed accounts set on dev/local chains (#1244) * use same accounts set on dev/local chains * run altruistic relayers in local demo scripts * runtimes: fix call_size() test (#1245) Signed-off-by: acatangiu <adrian@parity.io> * Bump relay version to 1.0.0 (#1249) * Add missing RPC APIs to rialto parachain node (#1250) * add missing RPC APIs to rialto parachain node * spellcheck * decrease startup sleep to 5s for relays and to 120s for generators + remove curl (#1251) * pin bridges-ci image (#1256) * Change submit transaction spec_version and transaction_version query from chain (#1248) * The `spec_version` and `transaction_version` query from chain * fix compile * Lint * Custom spec_version and transaction_version * runtime version params struct opt * runtime version cli * cli params * Add missing types defined * fix compile * debug cli * clippy * clippy * Query spec_version and transaction_version same times * Fix vars * Wrap option * Wrap option * Try fix ci * Change follow suggestions * remporary use pinned bridges-ci image in Dockerfile (#1258) * move storage keys computation to primitivs (#1254) * override conversion rate in estimate-message-fee RPC (#1189) * read latest_generated_nonce directly from storage (#1260) * bump rococo version (#1263) Co-authored-by: fewensa <37804932+fewensa@users.noreply.github.com> Co-authored-by: Tomasz Drwięga <tomusdrw@users.noreply.github.com> Co-authored-by: Adrian Catangiu <31917973+acatangiu@users.noreply.github.com> Co-authored-by: Sergejs Kostjucenko <85877331+sergejparity@users.noreply.github.com> Co-authored-by: Antonio Dropulic <antonio@parity.io> Co-authored-by: Adrian Catangiu <adrian@parity.io>
* unify metric names * refactor standalone metrics * headers sync metrics * post-merge fix * fix compilation * fmt * fix dashboards * fix local dashboards * update Rococo/Wococo runtime version * remove commented code * fixed grumbles * fmt * fixed widget names
* unify metric names * refactor standalone metrics * headers sync metrics * post-merge fix * fix compilation * fmt * fix dashboards * fix local dashboards * update Rococo/Wococo runtime version * remove commented code * fixed grumbles * fmt * fixed widget names
closes #1056
History of this issue:
prometheus::Registry
. So e.g. headers relay from Rialto to Millau had prefixRialto_to_Millau_Sync
and metric names likebest_block_numbers
, resulting in final names likeRialto_to_Millau_Sync_best_block_numbers
feed to Prometheus;Registry
prefix anymore. Because different relays have different prefixes - e.g. single process (means singleRegistry
) may have relays with prefixRialto_to_Millau_Sync
andMillau_to_Rialto_Sync
. But at the same ideally we should have had metrics with same final names exposed by the process - to avoid using different dashboard for different configurations. That's why prefixes were created directly with final names, without usingRegistry
prefix;Right now the situation is as follows:
Registry
prefix for standalone relays and using final metric names + no-registry-prefix for complex relays;process_cpu_usage_percentage
) and with prefix (Rialto_to_Millau_Sync_process_cpu_usage_percentage
).After this PR, we'll be using final metric names everywhere. We won't be using
Registry
prefix. The only metrics-related thing that'll need fix after this PR is that every relay will keep collecting data for its own copy of standalone metric values, even though only one metric will be exposed. This should be fixed in follow-up PRs.Things to do here:
verify Rococo <> Wococo messages relay (since it doesn't use conversion rates, which coming from metrics, which have been altered here)checked with altruistic relayer on Rialto <> Millau, because Rococo <> Wococo is too outdated.