Ratings for Specific Categories

[veermshah]

Describe the feature you'd like

After a judge rates a project, there should be a way to rate the project in different categories like Visual Design, Technical Complexity, Presentation, Learning, etc. There should be a way from the admin side to change the categories/rubric for the hackathon. Not sure how hard this would be to implement. Also want a toggle so that we can choose whether these category scores affect the overall score or not.

Pre-existing Issue or Justification

Axxess wants us to have this feature for the Axxess hackathon

Additional context

No response

[MichaelZhao21]

No.

This goes against the core principle of Jury. Actually it's funny because we did used to have the exact feature you want, but it was removed in #168. Jury used to only be a rating system and not ranking, so each judge would rate projects instead of ranking (which obviously is not good because it's a score-based voting system blah blah blah).

The reason why it was removed from Jury after rankings were added was because we did not care about the ratings--rankings proved to be far more important in determining an overall best project. It was also like not rly used in the admin side, so there is a bit of design to blame here.

Despite that, I think not having ratings is a good thing still. Because ratings are always going to be biased. When you have something on a number scale, unless every judge gives a rating to every project, it's not going to be fair (and Jury is designed with the idea that there are more projects than a single judge can view, even in science-fair style).

If one were to want ratings such as what you are requesting, you would be much better off just using a spreadsheet or paper to judge. And it really REALLY makes no sense for the category scores to affect the overall score because what does that even mean--our final ranking number is calculated off of relative position and that number isn't going to be the same every time so we can't just "add" amounts to that score.

Tl;dr: Jury is designed for partial rankings by judges, distributed in a fair manner. We don't use ratings because numbers are way more biased.

I'm going to close this issue in like a week, let me know if you still think you want to add this feature and we can discuss.