Before creating a working prototype for usability testing in Marvel, I made the effort to create low-fidelity digital screens for increased legibility during testing and ease in editing when feedback is received and applied.
The primary functions of Completing On-boarding, Creating a New Deck, and Completing a Practice were the focus of the usability tests.
The working prototype for this project can be viewed HERE.
The tests consisted of one, 10-15 minute session with the testers completing five main tasks:
- Complete On-boarding
- Create a new Study Deck
- Complete a Practice Quiz
- Enter Study Mode
- View Folders
During the test, these tasks were given in the following scenarios:
- "You've just downloaded the app, now open it up and complete the on- boarding process to get to the home screen."
- "You have a test coming up and you want to create a new study deck with 2 cards."
- "After creating a deck, you now want to have a session in Study Mode."
- "You now feel confident enough to attempt a practice quiz."
- "After creating a deck you now want to view folders you have available."
Three users were tested via Zoom where the users interacted with the Marvel prototype while I watched on. Using the Jakob Nielsen Error scale, each mistake or comment made by the user was recorded and rated on a scale of 1-5. 1 being something to not consider very strongly and 5 being a very critical usability error.
Each user stumbled on the same three issues which I ranked as a 3 on each individual test. Looking back now and seeing that each user struggled with these areas, a rating of 4-5 may be more appropriate.
The three major usability errors were:
- Completing the on-boarding process - Every user stopped clicking through on-boarding, not realizing they were in an on-boarding process
- The correct action buttons for Study Mode and Quiz were forgotten by the user after going through on-boarding and there was no text to identify the buttons.
- When trying to leave a study deck or practice quiz, they could not find the appropriate button to use - An “X” at the top left was provided, but largely ignored with two users going to the pull-out menu looking for a “Home” button
To improve usability in these three areas, the following changes were made:
On-boarding:
- Prompts were added to the beginning of the process such as “Let’s show you around!”
- The “how-to” screens for adding cards were removed from the initial on-boarding and added to when the user first choose “Create a Deck” from the home screen.
Action Buttons:
- How-to prompts were added to this screen when the user first accesses it ensuring the directions are fresh in their minds.
- Small descriptive text was added under the buttons to remind users of the functions.
Returning Home:
- A standard “home” icon was added to the top left of the app so users know that takes them back to the home screen.
- A “Home” option was added to the pull-out screen.