Transition to VM weights

[mateo-moon]

• Update weights using VM instances.
• Change runner tag for weights ci job to weights-vm

cc: paritytech/ci_cd#697

[ggwpez]

You force pushed the master commit. That unfortunately breaks the MR.

[mateo-moon]

You force pushed the master commit. That unfortunately breaks the MR.

I had to reset to master commit, because there are merging conflicts. I didn't see another option else than start everything again after force rebase of master(

[mateo-moon]

bot bench-vm $ all polkadot

[command-bot]

@oleg-plakida Command was rescheduled and failed to finish (check for task id 5-29cd68cf-07a8-4f86-ad75-1207b01b684c in the logs); execution will not automatically be restarted further.

[mateo-moon]

bot bench-vm $ all kusama

[command-bot]

@oleg-plakida Command was rescheduled and failed to finish (check for task id 6-f1f17758-7251-4252-b319-c3cdfdb294c7 in the logs); execution will not automatically be restarted further.

[mateo-moon]

bot bench-vm $ all rococo

[command-bot]

@oleg-plakida Command was rescheduled and failed to finish (check for task id 7-c59a88da-61ed-49b9-ae30-f42cdc1ef1f8 in the logs); execution will not automatically be restarted further.

[mateo-moon]

bot bench-vm $ all westend

[command-bot]

@oleg-plakida Command was rescheduled and failed to finish (check for task id 8-00dfdb82-ca12-4224-ab24-233e84334ee1 in the logs); execution will not automatically be restarted further.

[command-bot]

@oleg-plakida https://gitlab.parity.io/parity/mirrors/polkadot/-/jobs/3004757 was started for your command "$PIPELINE_SCRIPTS_DIR/commands/bench-vm/bench-vm.sh" all polkadot. Check out https://gitlab.parity.io/parity/mirrors/polkadot/-/pipelines?page=1&scope=all&username=group_605_bot to know what else is being executed currently.

Comment bot cancel 1-7430ca96-6e00-4ed2-b8f8-0fa3f1a3f6c9 to cancel this command or bot cancel to cancel all commands in this pull request.

[command-bot]

@oleg-plakida Command "$PIPELINE_SCRIPTS_DIR/commands/bench-vm/bench-vm.sh" all polkadot has finished. Result: https://gitlab.parity.io/parity/mirrors/polkadot/-/jobs/3004757 has finished. If any artifacts were generated, you can download them from https://gitlab.parity.io/parity/mirrors/polkadot/-/jobs/3004757/artifacts/download.

[mateo-moon]

bot bench-vm $ all polkadot

[command-bot]

@oleg-plakida Command was rescheduled and failed to finish (check for task id 3-d5406ae1-61a8-4c84-98fd-2163648232b5 in the logs); execution will not automatically be restarted further.

[mateo-moon]

bot bench-vm $ all polkadot

[command-bot]

@oleg-plakida https://gitlab.parity.io/parity/mirrors/polkadot/-/jobs/3017945 was started for your command "$PIPELINE_SCRIPTS_DIR/commands/bench-vm/bench-vm.sh" all polkadot. Check out https://gitlab.parity.io/parity/mirrors/polkadot/-/pipelines?page=1&scope=all&username=group_605_bot to know what else is being executed currently.

Comment bot cancel 5-d1783493-1257-4253-aa87-8fe838b12378 to cancel this command or bot cancel to cancel all commands in this pull request.

[command-bot]

@oleg-plakida Command "$PIPELINE_SCRIPTS_DIR/commands/bench-vm/bench-vm.sh" all polkadot has finished. Result: https://gitlab.parity.io/parity/mirrors/polkadot/-/jobs/3017945 has finished. If any artifacts were generated, you can download them from https://gitlab.parity.io/parity/mirrors/polkadot/-/jobs/3017945/artifacts/download.

[mateo-moon]

bot bench-vm $ all kusama

[command-bot]

@oleg-plakida https://gitlab.parity.io/parity/mirrors/polkadot/-/jobs/3022130 was started for your command "$PIPELINE_SCRIPTS_DIR/commands/bench-vm/bench-vm.sh" all kusama. Check out https://gitlab.parity.io/parity/mirrors/polkadot/-/pipelines?page=1&scope=all&username=group_605_bot to know what else is being executed currently.

Comment bot cancel 1-30221952-f80f-40b6-8d43-b3aa6086493c to cancel this command or bot cancel to cancel all commands in this pull request.

[command-bot]

@oleg-plakida Command "$PIPELINE_SCRIPTS_DIR/commands/bench-vm/bench-vm.sh" all kusama has finished. Result: https://gitlab.parity.io/parity/mirrors/polkadot/-/jobs/3022130 has finished. If any artifacts were generated, you can download them from https://gitlab.parity.io/parity/mirrors/polkadot/-/jobs/3022130/artifacts/download.

[mateo-moon]

bot bench-vm $ all rococo

[command-bot]

@oleg-plakida https://gitlab.parity.io/parity/mirrors/polkadot/-/jobs/3030458 was started for your command "$PIPELINE_SCRIPTS_DIR/commands/bench-vm/bench-vm.sh" all rococo. Check out https://gitlab.parity.io/parity/mirrors/polkadot/-/pipelines?page=1&scope=all&username=group_605_bot to know what else is being executed currently.

Comment bot cancel 6-83656975-32cb-4950-9b95-9a9344c69946 to cancel this command or bot cancel to cancel all commands in this pull request.

[command-bot]

@oleg-plakida Command "$PIPELINE_SCRIPTS_DIR/commands/bench-vm/bench-vm.sh" all rococo has finished. Result: https://gitlab.parity.io/parity/mirrors/polkadot/-/jobs/3030458 has finished. If any artifacts were generated, you can download them from https://gitlab.parity.io/parity/mirrors/polkadot/-/jobs/3030458/artifacts/download.

[chevdor]

That leads to a few major increases, which is fine as long as it is consistent.

https://weights.tasty.limo/compare?old=refs/tags/v0.9.43&new=oleg/ci-cd/weights-vm&threshold=90&unit=weight&repo=polkadot&path_pattern=runtime%2F**%2Fsrc%2Fweights%2F**%2F*.rs&method=guess-worst&ignore_errors=true&git_pull=true

[ggwpez]

That leads to a few major increases, which is fine as long as it is consistent.

Looking at asymptotic makes a bit more sense for the ones that do not have a proper base component, but having a few out of ~1670 benchmarks off is fine i think.
Just need to monitor that they stay consistent after this is merged.

[ggwpez]

It seems that we are not using the correct weight file for Kusama follow up for https://github.com/paritytech/polkadot/issues/7408