feat(tally): add prometheus metrics reporter

[dnjp]

What changed? Why?

This PR adds support for a Prometheus Tally Reporter which can be used in place of the current statsd reporter. A full example configuration might look like this:

prometheus:
  port: 9091
  metrics_path: /mymetrics
  namespace: mymetrics
  global_labels:
    some-new-feature: enabled
  default_histogram_buckets:
    - 1.0
    - 5.0
    - 10.0
    - 25.0
    - 50.0
    - 75.0
    - 100.0
  histogram_buckets:
    chainstorage_temporal_request_latency:
      - 1.0
      - 5.0
      - 10.0
      - 25.0
      - 50.0
      - 75.0
      - 100.0

The Prometheus reporter has been added in order to support both push and pull methods of collecting metrics.

How did you test the change?

• unit test
• integration test
• functional test
• adhoc test (described below)

This has been validated locally using localstack. Below you will find example metrics from running chainstorage locally:

Details

# HELP chainstorage_chainstorage_block_storage_get_blocks_by_height_range 
# TYPE chainstorage_chainstorage_block_storage_get_blocks_by_height_range counter
chainstorage_chainstorage_block_storage_get_blocks_by_height_range{blockchain="ethereum",network="ethereum-mainnet",result_type="success",sidechain="none",storage_type="dynamodb",tier="1"} 4
# HELP chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency 
# TYPE chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency histogram
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.1"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.2"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.3"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.5"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.7"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="1"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="2"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="3"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="4"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="5"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="6"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="7"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="8"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="9"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="10"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="12"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="15"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="20"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="25"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="30"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="40"} 0
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="50"} 1
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="75"} 3
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="100"} 4
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="200"} 4
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="300"} 4
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="500"} 4
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="750"} 4
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="1000"} 4
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="2000"} 4
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="3000"} 4
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="5000"} 4
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="7000"} 4
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="10000"} 4
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="+Inf"} 4
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_sum{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1"} 244.187
chainstorage_chainstorage_block_storage_get_blocks_by_height_range_latency_count{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1"} 4
# HELP chainstorage_chainstorage_block_storage_get_latest_block 
# TYPE chainstorage_chainstorage_block_storage_get_latest_block counter
chainstorage_chainstorage_block_storage_get_latest_block{blockchain="ethereum",network="ethereum-mainnet",result_type="error",sidechain="none",storage_type="dynamodb",tier="1"} 2
chainstorage_chainstorage_block_storage_get_latest_block{blockchain="ethereum",network="ethereum-mainnet",result_type="success",sidechain="none",storage_type="dynamodb",tier="1"} 5
# HELP chainstorage_chainstorage_block_storage_get_latest_block_latency 
# TYPE chainstorage_chainstorage_block_storage_get_latest_block_latency histogram
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.1"} 0
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.2"} 0
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.3"} 0
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.5"} 0
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.7"} 0
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="1"} 0
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="2"} 0
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="3"} 0
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="4"} 0
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="5"} 0
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="6"} 0
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="7"} 0
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="8"} 0
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="9"} 1
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="10"} 3
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="12"} 3
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="15"} 4
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="20"} 4
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="25"} 4
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="30"} 6
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="40"} 6
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="50"} 6
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="75"} 6
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="100"} 6
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="200"} 7
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="300"} 7
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="500"} 7
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="750"} 7
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="1000"} 7
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="2000"} 7
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="3000"} 7
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="5000"} 7
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="7000"} 7
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="10000"} 7
chainstorage_chainstorage_block_storage_get_latest_block_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="+Inf"} 7
chainstorage_chainstorage_block_storage_get_latest_block_latency_sum{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1"} 226.79766700000005
chainstorage_chainstorage_block_storage_get_latest_block_latency_count{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1"} 7
# HELP chainstorage_chainstorage_event_storage_get_events_after_event_id 
# TYPE chainstorage_chainstorage_event_storage_get_events_after_event_id counter
chainstorage_chainstorage_event_storage_get_events_after_event_id{blockchain="ethereum",network="ethereum-mainnet",result_type="error",sidechain="none",storage_type="dynamodb",tier="1"} 2
# HELP chainstorage_chainstorage_event_storage_get_events_after_event_id_latency 
# TYPE chainstorage_chainstorage_event_storage_get_events_after_event_id_latency histogram
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.1"} 0
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.2"} 0
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.3"} 0
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.5"} 0
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.7"} 0
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="1"} 0
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="2"} 0
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="3"} 0
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="4"} 0
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="5"} 0
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="6"} 0
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="7"} 0
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="8"} 0
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="9"} 0
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="10"} 0
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="12"} 1
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="15"} 1
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="20"} 1
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="25"} 1
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="30"} 1
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="40"} 1
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="50"} 2
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="75"} 2
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="100"} 2
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="200"} 2
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="300"} 2
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="500"} 2
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="750"} 2
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="1000"} 2
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="2000"} 2
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="3000"} 2
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="5000"} 2
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="7000"} 2
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="10000"} 2
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="+Inf"} 2
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_sum{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1"} 56.669917
chainstorage_chainstorage_event_storage_get_events_after_event_id_latency_count{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1"} 2
# HELP chainstorage_chainstorage_event_storage_get_max_event_id 
# TYPE chainstorage_chainstorage_event_storage_get_max_event_id counter
chainstorage_chainstorage_event_storage_get_max_event_id{blockchain="ethereum",network="ethereum-mainnet",result_type="error",sidechain="none",storage_type="dynamodb",tier="1"} 2
# HELP chainstorage_chainstorage_event_storage_get_max_event_id_latency 
# TYPE chainstorage_chainstorage_event_storage_get_max_event_id_latency histogram
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.1"} 0
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.2"} 0
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.3"} 0
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.5"} 0
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="0.7"} 0
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="1"} 0
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="2"} 0
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="3"} 0
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="4"} 0
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="5"} 0
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="6"} 0
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="7"} 0
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="8"} 0
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="9"} 0
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="10"} 0
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="12"} 1
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="15"} 1
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="20"} 1
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="25"} 1
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="30"} 1
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="40"} 1
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="50"} 2
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="75"} 2
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="100"} 2
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="200"} 2
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="300"} 2
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="500"} 2
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="750"} 2
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="1000"} 2
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="2000"} 2
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="3000"} 2
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="5000"} 2
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="7000"} 2
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="10000"} 2
chainstorage_chainstorage_event_storage_get_max_event_id_latency_bucket{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1",le="+Inf"} 2
chainstorage_chainstorage_event_storage_get_max_event_id_latency_sum{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1"} 56.548083
chainstorage_chainstorage_event_storage_get_max_event_id_latency_count{blockchain="ethereum",network="ethereum-mainnet",sidechain="none",storage_type="dynamodb",tier="1"} 2
# HELP chainstorage_chainstorage_server_blocks_served 
# TYPE chainstorage_chainstorage_server_blocks_served counter
chainstorage_chainstorage_server_blocks_served{blockchain="ethereum",clientID="unknown",format="file",network="ethereum-mainnet",sidechain="none",tier="1"} 40
# HELP chainstorage_chainstorage_server_error 
# TYPE chainstorage_chainstorage_server_error counter
chainstorage_chainstorage_server_error{blockchain="ethereum",method="GetLatestBlock",network="ethereum-mainnet",sidechain="none",status="NotFound",tier="1"} 2
chainstorage_chainstorage_server_error{blockchain="ethereum",method="StreamChainEvents",network="ethereum-mainnet",sidechain="none",status="Internal",tier="1"} 2
# HELP chainstorage_chainstorage_server_request 
# TYPE chainstorage_chainstorage_server_request counter
chainstorage_chainstorage_server_request{blockchain="ethereum",clientID="unknown",method="GetBlockFilesByRange",network="ethereum-mainnet",service="coinbase.chainstorage.ChainStorage",sidechain="none",status="OK",tier="1"} 4
chainstorage_chainstorage_server_request{blockchain="ethereum",clientID="unknown",method="GetLatestBlock",network="ethereum-mainnet",service="coinbase.chainstorage.ChainStorage",sidechain="none",status="NotFound",tier="1"} 2
chainstorage_chainstorage_server_request{blockchain="ethereum",clientID="unknown",method="GetLatestBlock",network="ethereum-mainnet",service="coinbase.chainstorage.ChainStorage",sidechain="none",status="OK",tier="1"} 1
chainstorage_chainstorage_server_request{blockchain="ethereum",clientID="unknown",method="ServerReflectionInfo",network="ethereum-mainnet",service="grpc.reflection.v1.ServerReflection",sidechain="none",status="OK",tier="1"} 9
chainstorage_chainstorage_server_request{blockchain="ethereum",clientID="unknown",method="StreamChainEvents",network="ethereum-mainnet",service="coinbase.chainstorage.ChainStorage",sidechain="none",status="Internal",tier="1"} 2
# HELP chainstorage_chainstorage_temporal_request 
# TYPE chainstorage_chainstorage_temporal_request counter
chainstorage_chainstorage_temporal_request{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none"} 1
# HELP chainstorage_chainstorage_temporal_request_attempt 
# TYPE chainstorage_chainstorage_temporal_request_attempt counter
chainstorage_chainstorage_temporal_request_attempt{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none"} 1
# HELP chainstorage_chainstorage_temporal_request_latency 
# TYPE chainstorage_chainstorage_temporal_request_latency histogram
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="0.1"} 0
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="0.2"} 0
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="0.3"} 0
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="0.5"} 0
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="0.7"} 0
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="1"} 0
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="2"} 0
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="3"} 0
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="4"} 0
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="5"} 0
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="6"} 0
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="7"} 0
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="8"} 0
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="9"} 0
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="10"} 0
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="12"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="15"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="20"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="25"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="30"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="40"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="50"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="75"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="100"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="200"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="300"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="500"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="750"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="1000"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="2000"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="3000"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="5000"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="7000"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="10000"} 1
chainstorage_chainstorage_temporal_request_latency_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="+Inf"} 1
chainstorage_chainstorage_temporal_request_latency_sum{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none"} 11.848833
chainstorage_chainstorage_temporal_request_latency_count{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none"} 1
# HELP chainstorage_chainstorage_temporal_request_latency_attempt 
# TYPE chainstorage_chainstorage_temporal_request_latency_attempt histogram
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="0.1"} 0
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="0.2"} 0
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="0.3"} 0
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="0.5"} 0
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="0.7"} 0
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="1"} 0
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="2"} 0
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="3"} 0
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="4"} 0
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="5"} 0
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="6"} 0
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="7"} 0
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="8"} 0
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="9"} 0
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="10"} 0
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="12"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="15"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="20"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="25"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="30"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="40"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="50"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="75"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="100"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="200"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="300"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="500"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="750"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="1000"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="2000"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="3000"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="5000"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="7000"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="10000"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_bucket{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none",le="+Inf"} 1
chainstorage_chainstorage_temporal_request_latency_attempt_sum{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none"} 11.802375
chainstorage_chainstorage_temporal_request_latency_attempt_count{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",operation="GetSystemInfo",sidechain="none",task_queue="none",tier="1",worker_type="none",workflow_type="none"} 1
# HELP chainstorage_chainstorage_temporal_worker_task_slots_available 
# TYPE chainstorage_chainstorage_temporal_worker_task_slots_available gauge
chainstorage_chainstorage_temporal_worker_task_slots_available{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",sidechain="none",task_queue="default",tier="1",worker_type="ActivityWorker",workflow_type="none"} 1000
chainstorage_chainstorage_temporal_worker_task_slots_available{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",sidechain="none",task_queue="default",tier="1",worker_type="LocalActivityWorker",workflow_type="none"} 1000
chainstorage_chainstorage_temporal_worker_task_slots_available{activity_type="none",blockchain="ethereum",client_name="temporal_go",namespace="chainstorage-ethereum-mainnet",network="ethereum-mainnet",sidechain="none",task_queue="default",tier="1",worker_type="WorkflowWorker",workflow_type="none"} 1000
# HELP go_gc_duration_seconds A summary of the pause duration of garbage collection cycles.
# TYPE go_gc_duration_seconds summary
go_gc_duration_seconds{quantile="0"} 8.0458e-05
go_gc_duration_seconds{quantile="0.25"} 0.000211167
go_gc_duration_seconds{quantile="0.5"} 0.000436875
go_gc_duration_seconds{quantile="0.75"} 0.001483666
go_gc_duration_seconds{quantile="1"} 0.001501917
go_gc_duration_seconds_sum 0.0046805
go_gc_duration_seconds_count 8
# HELP go_goroutines Number of goroutines that currently exist.
# TYPE go_goroutines gauge
go_goroutines 31
# HELP go_info Information about the Go environment.
# TYPE go_info gauge
go_info{version="go1.22.0"} 1
# HELP go_memstats_alloc_bytes Number of bytes allocated and still in use.
# TYPE go_memstats_alloc_bytes gauge
go_memstats_alloc_bytes 1.4694808e+07
# HELP go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed.
# TYPE go_memstats_alloc_bytes_total counter
go_memstats_alloc_bytes_total 3.2792376e+07
# HELP go_memstats_buck_hash_sys_bytes Number of bytes used by the profiling bucket hash table.
# TYPE go_memstats_buck_hash_sys_bytes gauge
go_memstats_buck_hash_sys_bytes 1.464324e+06
# HELP go_memstats_frees_total Total number of frees.
# TYPE go_memstats_frees_total counter
go_memstats_frees_total 252128
# HELP go_memstats_gc_sys_bytes Number of bytes used for garbage collection system metadata.
# TYPE go_memstats_gc_sys_bytes gauge
go_memstats_gc_sys_bytes 3.839576e+06
# HELP go_memstats_heap_alloc_bytes Number of heap bytes allocated and still in use.
# TYPE go_memstats_heap_alloc_bytes gauge
go_memstats_heap_alloc_bytes 1.4694808e+07
# HELP go_memstats_heap_idle_bytes Number of heap bytes waiting to be used.
# TYPE go_memstats_heap_idle_bytes gauge
go_memstats_heap_idle_bytes 5.750784e+06
# HELP go_memstats_heap_inuse_bytes Number of heap bytes that are in use.
# TYPE go_memstats_heap_inuse_bytes gauge
go_memstats_heap_inuse_bytes 1.8284544e+07
# HELP go_memstats_heap_objects Number of allocated objects.
# TYPE go_memstats_heap_objects gauge
go_memstats_heap_objects 70009
# HELP go_memstats_heap_released_bytes Number of heap bytes released to OS.
# TYPE go_memstats_heap_released_bytes gauge
go_memstats_heap_released_bytes 2.883584e+06
# HELP go_memstats_heap_sys_bytes Number of heap bytes obtained from system.
# TYPE go_memstats_heap_sys_bytes gauge
go_memstats_heap_sys_bytes 2.4035328e+07
# HELP go_memstats_last_gc_time_seconds Number of seconds since 1970 of last garbage collection.
# TYPE go_memstats_last_gc_time_seconds gauge
go_memstats_last_gc_time_seconds 1.746551905283527e+09
# HELP go_memstats_lookups_total Total number of pointer lookups.
# TYPE go_memstats_lookups_total counter
go_memstats_lookups_total 0
# HELP go_memstats_mallocs_total Total number of mallocs.
# TYPE go_memstats_mallocs_total counter
go_memstats_mallocs_total 322137
# HELP go_memstats_mcache_inuse_bytes Number of bytes in use by mcache structures.
# TYPE go_memstats_mcache_inuse_bytes gauge
go_memstats_mcache_inuse_bytes 9600
# HELP go_memstats_mcache_sys_bytes Number of bytes used for mcache structures obtained from system.
# TYPE go_memstats_mcache_sys_bytes gauge
go_memstats_mcache_sys_bytes 15600
# HELP go_memstats_mspan_inuse_bytes Number of bytes in use by mspan structures.
# TYPE go_memstats_mspan_inuse_bytes gauge
go_memstats_mspan_inuse_bytes 276960
# HELP go_memstats_mspan_sys_bytes Number of bytes used for mspan structures obtained from system.
# TYPE go_memstats_mspan_sys_bytes gauge
go_memstats_mspan_sys_bytes 293760
# HELP go_memstats_next_gc_bytes Number of heap bytes when next garbage collection will take place.
# TYPE go_memstats_next_gc_bytes gauge
go_memstats_next_gc_bytes 2.681616e+07
# HELP go_memstats_other_sys_bytes Number of bytes used for other system allocations.
# TYPE go_memstats_other_sys_bytes gauge
go_memstats_other_sys_bytes 1.924668e+06
# HELP go_memstats_stack_inuse_bytes Number of bytes in use by the stack allocator.
# TYPE go_memstats_stack_inuse_bytes gauge
go_memstats_stack_inuse_bytes 1.081344e+06
# HELP go_memstats_stack_sys_bytes Number of bytes obtained from system for stack allocator.
# TYPE go_memstats_stack_sys_bytes gauge
go_memstats_stack_sys_bytes 1.081344e+06
# HELP go_memstats_sys_bytes Number of bytes obtained from system.
# TYPE go_memstats_sys_bytes gauge
go_memstats_sys_bytes 3.26546e+07
# HELP go_threads Number of OS threads created.
# TYPE go_threads gauge
go_threads 13
# HELP promhttp_metric_handler_errors_total Total number of internal errors encountered by the promhttp metric handler.
# TYPE promhttp_metric_handler_errors_total counter
promhttp_metric_handler_errors_total{cause="encoding"} 0
promhttp_metric_handler_errors_total{cause="gathering"} 0

[aegis-cipherowl]

Thanks for adding this capability. Can you sign the commit please?

[dnjp]

Thanks for adding this capability. Can you sign the commit please?

@aegis-cipherowl You bet. I just pushed the signed commit. Would you like me to merge this PR or would you prefer to do that?

[aegis-cipherowl]

I'm fine either way. Thanks again for your contribution