Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Out of the box logging for validators and miners #28

Open
steffencruz opened this issue Nov 21, 2023 · 1 comment
Open

Out of the box logging for validators and miners #28

steffencruz opened this issue Nov 21, 2023 · 1 comment

Comments

@steffencruz
Copy link
Contributor

steffencruz commented Nov 21, 2023

Overview

We want to enable validators and miners to see the data created by themselves and other entities within subnets by default.

This will support network monitoring and analytics and help to create a standard of quality for subnets. Of course, subnet developers can and should improve upon the default behaviour but we will at least ensure that there is some telemetry from day zero.

To do this we will first implement basic logging for miners and validators:

Validators

The end of each forward pass will call log_event, which will write the following data to a local log file as a dict of lists:

  • UIDs queried
  • responses
    • deserialized outputs
    • status codes
    • response time
  • rewards

Miners

Each validator query will call log_event with information such as

  • Validator info
    • UID
    • hotkey
    • stake
  • Blacklist return value
  • Priority return value
  • Forward return value
  • Forward run time

We can also introduce a specific event that is logged when weight setting occurs.

@wjurkowlaniec
Copy link

great idea, it'd be nice to add logging X-Request-ID header to track "actions" that are performed across entites and parts of code

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants