RFC: Correct volunteer annotations based on feedback #2443
hughdickinson
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
lib-classifier
Is your feature request related to a problem? Please describe.
Highlighting a potential issue with feedback that occurs in PFE and may persist in the new front end. In workflows with several single answer questions, the tasks a volunteer encounters may depend on their answers to previous tasks. If they provide an incorrect answer to the first task, then they cannot possible answer correctly for the second task. In PFE feedback is shown after each task, so this can lead to a situation where a volunteer receives feedback that they gave the wrong answer but then proceed to the (incorrect) task based on the (incorrect) answer they did submit. This can be very frustrating.
Describe the solution you'd like
It would be nice if project owners could enable functionality that replaces incorrect annotations/classifications with the correct answers before submitting the task so that the volunteer arrives at a task that makes sense in the context of the feedback they just received.
Describe alternatives you've considered
I note that for intermediate tasks, this can be somewhat mitigated in PFE by enabling the "Go back" button, but volunteers don't have to choose this option and they would still be looking at a potentially meaningless/impossible task. Maybe adding "Try again" in the feedback modal would work.
Additional context
This is not a feature request per-se. Just highlighting a potential issue.
Also noting that the desired "replace answer" behaviour might not be appropriate if the responses to feedback enabled subjects are being used to calibrate volunteer skill. It would be appropriate for a workflow designed exclusively for tutorial/training purposes like the "Tutorial" workflow in Radio Galaxy Zoo: LOFAR.
Beta Was this translation helpful? Give feedback.
All reactions