PRE2019 3 Group4 Usability-Tests

Usability Tests

Users

The usability tests were performed with a family member of Rob Vissers blindfolded, since the design could not be tested with an actual blind person due to the current circumstances. A meeting was set up with Visio, but unfortunately, this could not continue with the current measures taken.

Task 1: Device placement

• Participant is required to put the device at a stable/reachable surface and in front of them (in the correct way with the buttons at the top and the charging input at the right hand side)
• The participant is able to do this, this task is passed.
  • Test: At first a moment was needed to grasp the situation of not being able to see. After that the Braillearn was handed over to the user. The user was seated down with a table in front of him, such that the Braillearn could be placed properly on the steady surface. After feeling and rotating the design, the user was able to place the side with the letters to face him. Therefore this task is properly completed.

Task 2: Charge the device

• Participant is required to charge the device by plugging a cable in the device as well as in the power output.
• If a sound is produced by the device (which means that it is charging), this task is passed.
  • Test: With the design in place, the next task was to plug in the mains voltage cable. Since the user already knew the placement of the power sockets in the room, this task was completed without any problems.

Task 3: Turn the device on

• Participant is required to turn on the device by pressing the on/off button.
• If a sound is produced by the device (which means that it is on), this task is passed.
  • Test: After feeling all different buttons of the design, it was fairly easy for the user to decide what the on/off button would be. This is due to the fact that the on/off button is the only switch on the device, and could therefore be interpreted as the on/off button. By flipping the switch, followed by the tutorial starting, the task was completed succesfully.

Task 4: Change modus at novice level

• Participant is required to put the modus at the novice level.
• If the participant uses the arrow shaped buttons properly (to change buttons), then a sound will be generated which indicates the current modus the participant has activated. If the participant has activated the correct modus, then this task is passed
  • Test: After the tutorial the user had to change the teaching modus. Since all buttons were already walked through in the tutorial, this did not pose any problems. However, feedback was obtained that it would be better to shape the buttons as arrows, such that it is better understandable what modus up and modus down is. This was indeed not yet implemented in the first prototype.

Task 5: Typing a letter

• Participant is required to type one letter by using the device. This task measures two things:
  • If a participant is able to recognize the six-point system of the Braille cells by using the left Braille cell on the device. This will be measured by response time (time to recognize)
  • If the participant entered the correct letter (error rate) by using the right Braille cell of the device properly.
• If a letter is entered, then this task is passed.
  • Test: A first braille learning task was conducted with the user, where the user had to learn the letter 'a', 'b', and 'c'. Since the top leftmost entry of the read braille cell did not move up and down very properly due to the stiffness and friction, this entry was constantly pointed up. In this exercise, it did not pose any problems, since the 'a' is the top leftmost entry. The 'b' and 'c' also include this top leftmost entry, in conjunction with one other entry. Therefore another learning task was conducted, where the user had to write the word 'way' letter by letter. Since the letter 'w' does not include the top leftmost entry, this posed any problems. The user kept taking pushing this entry in the write braille cell. After three tries, a little help was provided from the outside, saying that the top leftmost braille cell did not function as properly as intended. After knowing this, the rest of the task could be completed without any problems.

Task 6: Using the reset button

• Participant is required to type another letter, however he is asked to make a mistake on purpose. At this point, the participant has to use the reset button to correct his mistake.
• If the participant succeeds, then this task is passed.
  • Test: At the third try for the letter 'w', the input was not yet confirmed with the next button. With help from the outside saying that the top leftmost entry should not be included for the letter 'w', the reset button was pressed by the user to try again. Now, not taking into account the top leftmost entry, the task could be completed succesfully.

Task 7: Turn the device off

• Participant is required to turn off the device by pressing the on/off button again.
• If the participant is capable to turn off the device, then this task is passed.
  • Test: Since the location of the on/off button was known from the start-up, the shutdown was fairly easy. By feeling over the left side of the Braillearn, the on/off button could be found again, and the system was turned off in advance.

Tutors

Task 1: Guidance

• The tutor must be able to help the student with the initial set-up of the device and getting familiar with its hardware and software. The typed manual can be consulted for this.

Task 2: New study material

• the tutor must be able to understand the GUI of the website/program that allows them to make new study material. Potentially the website/program can be used to track the performance of the students. This can be used to offer additional assistance.