Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluation Recusal #91

Open
43 tasks
r-bartlett-gsa opened this issue Jul 31, 2024 · 1 comment
Open
43 tasks

Evaluation Recusal #91

r-bartlett-gsa opened this issue Jul 31, 2024 · 1 comment

Comments

@r-bartlett-gsa
Copy link
Member

r-bartlett-gsa commented Jul 31, 2024

User story

As an evaluator, in order to provide fair evaluation for the submission the public solvers submitted, I would like to be able to indicate if I am not able to evaluate the submission I am assigned to.

Acceptance criteria:

  • On a submission detail view for an evaluator, there's an option to recuse from evaluating a submission:
    • A warning message is displayed asking evaluator to confirm recusal
  • The recusal is saved as a submission evaluation status and is displayed throughout workflows for the evaluator and for the challenge manager
  • The submission remains assigned to the evaluator until a challenge manager unassigns the evaluator from the submission, Unassign Evaluators from a Submission #76
    • If an evaluator has any scores saved on the submission, the scores are removed along with removing evaluator assignment

Dev tasks:

Definition of Done

Doing (dev team)

  • Code complete
  • Code is organized appropriately
  • Any known trade offs are documented in the associated GH issue
  • Code is documented, modules, shared functions, etc.
  • Automated testing has been added or updated in response to changes in this PR
  • The feature is smoke tested to confirm it meets requirements
  • Database changes have been peer reviewed for index changes and performance bottlenecks
  • PR that changes or adds UI
    • include a screenshot of the WAVE report for the altered pages
    • Confirm changes were validated for mobile responsiveness
  • PR approved / Peer reviewed
  • Security scans passed
  • Automate accessibility tests passed
  • Build process and deployment is automated and repeatable
  • Feature toggles if appropriate
  • Deploy to staging
  • Move card to testing column in the board

Staging

  • Accessibility tested (Marni)
    • Keyboard navigation
    • Focus confirmed
    • Color contrast compliance
    • Screen reader testing
  • Usability testing: mobile and desktop (Tracy or Marni)
  • Cross browser testing - UI rendering is performant on below listed devices/browsers (Tracy or Marni)
    • Windows/Chrome
    • Windows/Edge
    • Mac/Chrome
    • Mac/Safari
    • iOS/Safari
  • AC review (Renata)
  • Deploy to production (production-like environment for eval capability) (dev team)
  • Move to production column in the board

Production

  • User and security documentation has been reviewed for necessary updates (Renata / Tracy / Dev team)
  • PO / PM approved (Jarah or Renata)
  • AC is met and it works as expected (Jarah or Renata)
  • Move to done column in the board (Jarah or Renata)
@r-bartlett-gsa
Copy link
Member Author

r-bartlett-gsa commented Oct 4, 2024

Some button styles, colors and labels may have changed and screenshots below may reflect outdated styles. Please refer to Figma for latest designs.
Misalignment in styles, colors and labels should not affect the completion of development work. There will be additional user stories towards the end of this epic or MVP to bring uniformity to styles and colors.
If significant difference is noticed in features / functionality, please contact Renata.

Image

Image
Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant