Date : 7 April 2011.
Location : Software Quality Assurance Lab (an isolated area) -- Palo Alto, US
Facilitator : Lawrence Yuen Lai Wing
Participant : 10 Software Quality Testers
Usability Script :
Test subjects :-
Navigation of the travel.com.au
Search function usability for the hotel, holiday and flight.
Duration : Total 30 minutes.
Supplies for each of the participant :
A computer with 2.2 GHz CPU, 4 GB Memory, a 15" LCD and Internet connection
A task list
A questionnaire
Processes :
Facilitator will have a speech with the participants before the test. The speech will make sure the participant understand the purpose of the test -- usability test (2 subjects) for travel.com.au, explanation of the testing procedure -- complete the task list and answer the questionnaire. In addition, the facilitator will give an overview of the testing website before the test start.
Participants use the task list to complete the task.
Participants are filling in the questions for the questionnaire.
Facilitator collect and questionnaires and end of the testing. (eHow, 2011)
The task list is as follow :-
Please complete the following tasks in 30 minutes
Navigate inside this website by your own experience for 5 minutes, try to hit as many as tabs and links possible.
For task 6-7, if you can complete a task within 5 minutes, please go to next task.
Try to search a flight from Sydney to Hong Kong on April 13 and the return flight on April 21 - 5 minutes
Try to search a holiday package for Hong Kong on April - 5 minutes
Try to search a hotel in Kowloon, Hong Kong from April 13 to April 21 - 5 minutes
Complete the questionnaire. - 10 minutes
Test finish. Thanks you for your help.
The questionnaire is as follow :-
1. It is easy to navigate around this website.
- Totally Agree
- Agree
- Neutral
- Disagree
- Totally Disagree
2. You can always find what you want in this website.
- Totally Agree
- Agree
- Neutral
- Disagree
- Totally Disagree
3. The loading speed of the web site is good.
- Totally Agree
- Agree
- Neutral
- Disagree
- Totally Disagree
4. You can search your hotel without problem.
- Totally Agree
- Agree
- Neutral
- Disagree
- Totally Disagree
5. You can search your holiday without problem
- Totally Agree
- Agree
- Neutral
- Disagree
- Totally Disagree
6. You can search your flight without problem
- Totally Agree
- Agree
- Neutral
- Disagree
- Totally Disagree
7. This is a good online travel agency (OTA) website
- Totally Agree
- Agree
- Neutral
- Disagree
- Totally Disagree
This is an unnamed questionnaire and the participant is free to answer the questions.
Question 1-3 and 7 are related to the navigation test subject. Question 4-6 are related to the Search function usability test subject.
The Totally Agree, Agree, Neutral, Disagree and Totally Disagree will carry 5 to 1 points accordingly.
The testing process is completed without any problem, all 10 questionnaires are collected and the result is as follow :-
| Question\Participant | I | II | III | IV | V | VI | VII | VIII | IX | X | Total Marks |
| 1 General navigation | 4 | 4 | 5 | 4 | 5 | 4 | 4 | 4 | 4 | 4 | 42 |
| 2 Content Completeness | 4 | 3 | 4 | 4 | 4 | 3 | 4 | 3 | 3 | 4 | 36 |
| 3 Loading Speed | 4 | 4 | 4 | 3 | 4 | 4 | 3 | 4 | 4 | 4 | 38 |
| 4 Hotel Search | 5 | 5 | 4 | 4 | 5 | 5 | 4 | 4 | 4 | 4 | 44 |
| 5 Holiday Search | 5 | 5 | 4 | 4 | 5 | 5 | 4 | 4 | 4 | 4 | 44 |
| 6 Flight Search | 5 | 5 | 4 | 4 | 5 | 5 | 4 | 4 | 4 | 4 | 44 |
| 7 User Satisfaction | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 40 |
The Report :-
From the results of the questionnaire, the test subject for navigation on travel.com.au only get the score of 79% and the search function usability for Hotel, Holiday and Flight get the score of 88%. It is very obvious that participants are very satisfy with the search functionality for this site but not too surprise with the overall navigation of this site.
All the participants are experience computer software testers and they access Internet frequently and have a lot of experience on online travel agency. It is not surprise that this web site has a fair score on its navigation. The result doesn't indicate the navigation is bad for this site but it does meant that the design is only following a very common design practice.
The Search function usability for Hotel, Holiday and Flight has a high score. This implies the search function in this site for the main tasks are well developed and easy to use. The user can easily find out the required information without any issue.
In conclusion, in order to improve the navigation for this site, the developer should pay more attention on the content and the loading speed. Try to use more clear links and text; use too much pictures and animated advertisement will confuse the user on how to find the necessary information and moreover slow down the web site loading performance. The search function usability is good in the main tasks and if the developer can extend it to have a general search function for the site content, it should make the site become more easy to navigate.