-
Notifications
You must be signed in to change notification settings - Fork 81
Evaluation Process
The Office of Inspector General (OIG) is a neutral third-party role designed to evaluate WAX Guild Candidates' contribution to the ecosystem and provide ongoing transparency for the community.
The OIG is designed as a committee of 3 IG’s, that work out a transparent and heuristic framework to evaluate all WAX guilds in a fair manner and drive the networks quality, security and competitiveness.
Guilds will be evaluated on a regular basis on the criteria below. The committee will publish the cutoff date for rating Guilds each evaluation cycle. Guilds will submit their update and appeals to [Github](https://github.com/wax-office-of-inspector-general/waxguilds/) in plain text with links to data/screenshots. Confidential information can be submitted via email, but requires to be noted in the public update. Publishing an update with non-confidential information is mandatory if you want the OIG to evaluate your confidential sections.
Evaluation criteria will consist of line items in a range of categories with various point ranges. The committee believes this will make it easier to evaluate Guilds fairly.
The OIG does however have to rely on the reported information to be accurate. Points credited under false pretence due to wrong information being submitted or important changes not being communicated may result in a penalty. Submission of inaccurate information during reports or appeals where the OIG has to assume the goal is to scrounge evaluation scores may also result in a penalty. This includes, but does not conclude with: The misrepresentation of development efforts, development progress, purported collaborations or partnerships, knowingly boasting the significance of a products based on false claims, fakery of infrastructure availability or performance.
If no time range is specified, the last evaluation time frame is applied, starting with the last evaluation report release, ending with the submission cut off date.
The pre-evaluation and minimum requirements must be fulfilled to be considered for a rating. Satisfied criteria will improve a Guild's score on the report.
Guilds, that failed an evaluation based on minimum requirements, are granted the opportunity to apply for reinstatement. This can only be done once within an evaluation period, after addressing all outstanding issues and providing a stable service for 7 days. Guilds that have been in a Top 21 position by score during the previous evaluation, that (a) fail minimum requirements but (b) achieve the required minimum score and (c) have their issues addressed before the end of the appeal period, will instead of failing be demoted to a standby position. Guilds that failed the previous evaluation and don't submit an update will not be reviewed and retired by the end of the evaluation.
During full evaluations ratings can be appealed to be corrected/changed. Rating appeals have to be provided as an issue in this repository
While active producers can claim their pay daily based on produced blocks, Guilds in standby positions are paid on a monthly basis. To be eligible for payments, Guilds need to pass the minimum requirements of each month, verifying they offered a service over the paid evaluation period. Severly failing to uphold minimum requirements, or being unregistered, for a prolonged time over an evaluation period while otherwise still passing minimum requirements, can result in a proportionate share of the standby rewards getting deducted. This also applies to reinstatement periods when minimum requirements have not been met towards the end of an evaluation period. Reinstatements are always evaluated based on testnet performance. For this timeframe Guilds are considered unregistered from WAX mainnet, no matter if they actually are or not.
If required, information can be submitted to the IGs confidentially via email; Confidential submissions must still be noted in the public report published on github.
If two guilds are tied for a rank, the tie is resolved by looking at the points scored in the previous evaluation. The guild with a higher score in the previous month is determined to be the winner of the tie.