Skip to content

Think Aloud Protocol

Jean edited this page Apr 14, 2017 · 3 revisions

Table of Contents

  1. About
  2. Users Responses
  3. Summary

About

In the think aloud protocol, we have decided to come up with several key tasks that our users has to complete. While they explore around and complete their task, the users will voice out their thoughts and we record it down. We avoid interfering with the users as much as possible, unless they are very stuck and require prompting from us. We have asked a total of 5 users, all of which are either participants or guests of STePS.

Key Tasks:

  • (Scenario 1) You are a employer who have attended steps, and are looking students who can do web development
  • (Scenario 2) You are a student looking for other students who are looking for collaborators in their projects
  • (Open) Since you are new to our website, try exploring around to complete your tasks.

Users Responses

User 1

(Scenario 2)

Login Page:

  • Clean.
  • Signup Button should be a button.

Signup Page:

  • Password should dynamically check for validity as it is being typed.

Home Page:

  • Image not HD.
  • Event Tile ("View More" Button) not very clear.
  • Event Tile doesn't suggest that a dropdown panel will appear upon clicking the lower half.
  • Event Tiles not consistent in terms of clickable visual tiles.
  • Event Tiles should be highlighted if selected.

Event Page:

  • Attendee List: Too long - should use Pagination.
  • Exhibition List: Too long - should use Pagination.

Exhibition Page:

  • Felt that comment box should not re-sizable.
  • UI quite clean.
  • Navigation seems clear.

Profile Page:

  • Confusion - what kind of links are acceptable.
  • Concerns - if Event and Exhibition attending is not editable, should not be in that view.
  • Search Bar position not consistent with the Home Page.

Chat Page:

  • Chat should advise how can one get more people to talk to.
  • At first glance, the side drawer and the top panel are not very clear and separate.
  • Expected messages sent to be on the left instead of the right - attributed it to his left-handedness.

Search Bar:

  • Cannot use Arrow Keys to highlight search suggestions.
  • Filters not clearly linked to the Search Bar - should use tabs instead of dropdown menu.

Logout:

  • Should thank Users for using our site.

User 2

(Scenario 1)

Login Page:

  • -No comment from user-

Signup Page:

  • -No comment from user-

Home Page:

  • Application Icon is triggering - looks like something is missing.
  • Event tile picture preview is too small - sees a picture but can’t read it.
  • Each tile should be bigger for the desktop view.
  • Confused about why the Past Tab automatically shows.

Event Page:

  • Clicking on one the Show All buttons should make the view auto focus on the list.

Exhibition Page:

  • Confused about why Comments show user email rather than user name.
  • Expected tags to be clickable - and show all related activities with the same clicked tag.

Profile:

  • Looks pretty basic - too few fields.
  • Navigation feels weird - feels like going down a rabbit hole.

Chat:

  • -No comment from User-

Search Bar:

  • Changing filters should not clear the typed input.

Logout:

  • -No Comment from User-

User 3

(Scenario 1)

Login Page:

  • Like Facebook, force you to login before you can see anything.

Signup Page:

  • Field requirements should be given upfront.

Home Page:

  • Should not be able to toggle Attendance for Past Events.
  • Past Events should be tagged with Attended rather than Attending.
  • Event tile button felt like it was meant to expand event picture, but instead redirected to the Event Page.
  • Doesn’t like main image used in home page.

Event Page:

  • Likes the Exhibition Listings.
  • Doesn’t know that Attendee names are clickable.
  • Could rotate Event PDFs.

Exhibition Page:

  • -No comment from user-

Profile Page:

  • Dropdown row for Events and Exhibitions attended feels rather empty in the middle.
  • Forgot whose profile they navigated from to the Exhibition Page after clicking on one of the User’s Exhibitions.
  • Contact Button not clear - looks like a logo.
  • Inconsistent tabbing on some Event / Exhibition listing.

Chat:

  • Should be able to click on the names to go to the User Profiles.

Search Bar:

  • Search suggestions not clear enough - keep getting blocked by Chrome’s suggestions.
  • Felt that search filters not connected to the search bar.
  • Should be able to parse commas properly.
  • Cannot search by User names.
  • Search Results:
    • Feels like it’s too cluttered, one result should be on one row.

Logout:

  • -No comment from User-

User 4

(Scenario 1)

Login Page:

  • -No comment from user-

Signup Page:

  • Error message should be at the same level as the main error message.

Home Page:

  • Should dynamically convert PDFs into images.
  • Confused about why the Past tab is shown first.
  • Confused about Event Tile icon - thought it was zoomify.
  • No visual feedback for clickable parts of Event Tiles - does not know about the dropdown bar to specify attendance.
  • Event Tiles not in order.
  • Should not be able to change events for Past Events.

Event Page:

  • Attendee List: Oh, I can click on the names!
  • List - should be in alphabetical order, and paginated.
  • Wants Exhibition details to be in the list preview.
  • Event Page should open up as a new tab.

Exhibition Page:

  • -No comment from User-

Profile Page:

  • Why no bookmarks when generally viewing Profiles for other Users?

Chat:

  • -No comment from User-

Search Bar:

  • Annoyed that Exhibition Tags filter changes to Tags.
  • Search Results:
    • Too cluttered.
    • Extra space created after resizing windows.

Matching Tinder Interface:

  • Did not see the Next button.
  • Interested Events should be Attended Events.
  • Bookmark does not show visual feedback.
  • Bookmarks fail? Doesn’t seem to do anything.
  • Feels like Matching Tinder Interface is not consistent with generally seeing the profiles of other Users.

Logout:

  • -No comment from User-

User 5

(Scenario 2)

Login:

  • -No comment from User-

Signup Page:

  • -No comment from User-

Home Page:

  • Forgot original intent because Home Page feels too overpowering.
  • Find an Opportunity implies one can search for Attendance reasons as well.
  • Doesn’t know that Tiles are for Events.
  • Has a hard time reading the Attendance Looking For description.
  • Confused about Event Tile See More.
  • Did not think that icon for See More in the Event Tile is the See More functionality.

Event Page:

  • Site Map incorrectly stretched.
  • Wasn’t sure that names could be clicked.
  • Attendee List too long - should paginate.
  • Likes Exhibition List, but too lag.
  • Did not see Exhibition List page drop down menu.

Exhibition Page:

  • Comments cannot be entered by pressing Enter.
  • Please use user name instead of email for comments.

Profile Page:

  • What does Exhibition mean?
  • Maintain UI state across multiple pages.
  • Had a hard time locating the chat functionality.
  • Should be able to email users by clicking on their email.
  • Doesn’t know how to specify Attendance Reasons.
  • Doesn’t know there’s an Edit button.
  • Doesn’t know he’s currently editing after scrolling down.
  • Success save not obvious enough.

Search Bar:

  • Should not clear typed content when changing filters.
  • Why can’t it be a contains search rather than an exact search?
    • Shows suggestions, but upon pressing enter, it shows invalid as key is not complete
  • Search Results:
    • Should be 404 rather than Event Page.
    • Searched for skills, was wondering if those people with the skills are hiring or not.

Logout:

  • -No comment from User-

Summary

Choices of images and icons:

Most users have issues with the icon placed in the Event Picture. Most of them thought that it would enlarge the event picture instead of finding out more. This tells us that our selection of icons could be better and there are many ways of interpreting icons. Other than that icon, the rest of the images and icons are fitting.

Navigation:

Navigation is a little unclear in some places as they are not as intuitive as we had thought, and some buttons are not obvious enough. Users get the hang of it after a while.

Overall:

Overall, users are able to complete their task with some prompt and help. This tells us that we can consider implementing tutorials or adding more documentation.