Fix/wandb missing final scores #88
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Collaborator
mediumsizeworkingdog
commented
Dec 6, 2024
mediumsizeworkingdog
commented
- final scores weren't showing on wandb because they were of type tensor.float.
- casted them to primitive float and its fixed.
jarvis8x7b
pushed a commit
that referenced
this pull request
Dec 9, 2024
* fix: wandb now storing final scores correctly * fix: cast scores from tensor.float to primitive float
codebender37
pushed a commit
that referenced
this pull request
Dec 9, 2024
- wandb now storing final scores correctly - cast scores from tensor.float to primitive float
karootplx
pushed a commit
that referenced
this pull request
Dec 9, 2024
* fix: wandb now storing final scores correctly * fix: cast scores from tensor.float to primitive float
jarvis8x7b
added a commit
that referenced
this pull request
Dec 10, 2024
* feat: simulator * chore: ruff lint * fix: scoring interval * refactor: migrate score data from db to .pt file * fix: add VALIDATOR_MIN_STAKE in environment * feat: added script to inspect score * fix: fixed from PR feedback * fix: fixed linter issue, and commitizen * feat: add dataset collection endpoint, script to scrape validator db (#78) * feat: add validator api dataset service, extract dataset script build: add deps for dataset service build: add docker compose services & entrypoints * chore: remove test script * chore: fix comment * chore: update readme and env example * fix: add auth * refactor: add hotkey to filename * chore: format toml * fix: minersim task scoring, validatorsim subtensor retry mechanism and dendrite forward timeout * chore: ruff lint * fix: ground truth arr ordering * perf: increase timeout * fix: negative stride error from scoring (#86) * fix: add .copy() when creating tensors from np array * chore: deleted duplicate logs * fix: wandb now storing final scores correctly (#87) * fix: wandb missing final scores (#88) * fix: wandb now storing final scores correctly * fix: cast scores from tensor.float to primitive float * chore: commitizen ci actions (#92) * ci: add conventional commits CI * refactor: edits from pr feedback * perf: add subtensor retries (#90) * perf: add subtensor retries * fix: add retries to sync function * chore: updated pyproject for dev dependencies (#94) - added tabulate, and termcolor in dev dependencies - fixed insepect_score.py using wrong file name * fix: use correct dimension when calculating mean scores --------- Co-authored-by: tedbee <tedbee@tensorplex.ai> Co-authored-by: karootplx <karoo@tensorplex.ai> Co-authored-by: codebender <167290009+codebender37@users.noreply.github.com> Co-authored-by: mediumsizeworkingdog <mediumsizeworkingdog@tensorplex.ai>
Tedbees
pushed a commit
that referenced
this pull request
Dec 10, 2024
## [1.5.0](v1.4.2...v1.5.0) (2024-12-10) ### Features * add dataset collection endpoint, script to scrape validator db ([#78](#78)) ([1b4ef9e](1b4ef9e)) * added script to inspect score ([f9dd7e4](f9dd7e4)) * simulator ([ed110e3](ed110e3)) ### Bug Fixes * add VALIDATOR_MIN_STAKE in environment ([84774a4](84774a4)) * fixed from PR feedback ([23d085a](23d085a)) * fixed linter issue, and commitizen ([553ad66](553ad66)) * ground truth arr ordering ([75f008a](75f008a)) * minersim task scoring, validatorsim subtensor retry mechanism and dendrite forward timeout ([956f5cf](956f5cf)) * negative stride error from scoring ([#86](#86)) ([50c86c6](50c86c6)) * scoring interval ([94e050b](94e050b)) * use correct dimension when calculating mean scores ([2f30931](2f30931)) * wandb missing final scores ([#88](#88)) ([0d8b93d](0d8b93d)) * wandb now storing final scores correctly ([#87](#87)) ([affcd3e](affcd3e)) ### Performance Improvements * add subtensor retries ([#90](#90)) ([ca07d46](ca07d46)) * increase timeout ([23669b7](23669b7))
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.