IA 1.5 Search - community testing

[kittykat]

Run a thorough community testing session to verify that the search works as intended on a range of different systems and there are no major usability problems

What we need going into the session

• List of test cases based on must haves for IA1.5
• Spreadsheet for recording results during testing
• Allow people to sign up to spreadsheet ahead of time
• Pick a time when Product, Design and lead developer for the platform can attend
• 100% of IA1.5 tasks are complete
• Pick a time and update room topic
• Create event in company calendar
• Publicise
  • Twitter/Mastodon (add to marketing calendar)
  • TWIM
  • Channel
• Check and update docs on wiki as needed
• Create a Netlify build with the feature, as it would appear in production

During the session

• Lay out standard paths to follow to achieve tasks (test cases with steps)
• Run through some exploratory test cases (tasks to achieve without steps)
• Monitor testing to track if testers are naturally taking expected paths in achieving tasks
• Collect defects and enhancements which are found, and make sure to collect accurate reproductions steps with screenshots and screen recordings as needed
• Compare product against designs

Outputs from the session

• All defects have been reviewed
• All new defects have been filed
• All repeat defects have been linked to existing issues
• All enhancements have been reviewed
• All new enhancement requests have been filed
• All enhancement requests have been responded to (including links to existing ones)
• Design reviews any designs to update for findings from session (especially around actual usage)
• Acceptance criteria on issues updated as needed (by design, product or development)

[kittykat]

Issues are processed now and incorporated into planning for upcoming changes