Usability Testing
This study is designed to evaluate the usability of Ateneo De Zamboanga University website. Our
goal to find how easy or difficult the site to use for a perspective senior high school student looking for
a university to enroll. Thirteen (13) participants were ask to spend 33 minutes to accomplish the tasks
and there 11 tasks were prepared for them. Base on the data that we collected, we conclude that the
Ateneo De Zamboanga University Website when it comes to usability, the difficulty is moderate to
average.
Methodology
What happened during the usability test?
The usability test of the Ateneo de Zamboanga University website was conducted by a group in Don
Pablo Lorenzo Memorial High School, Zamboanga City Philippines on September 11 and September
18 2019.
Participants, matching the Ateneo De Zamboanga website user profile, were recruited prior to the
testing with the use of screening questionnaire. Participants were compensated snacks for their time.
What participants did
During the usability test, participants were asked to answer the [Eleven (11)] scenarios
Tasks on the site. The task was presented in order
Audience Type Computer Usage
User Profile 1 13 Less than 1hour a week 4
TOTAL 13 4-15 hours a week 5
4-15 hours a week 2
More than 15 hours 2
TOTAL 13
(participants)
Age Gender
24 1 Male 5
18 1 Female 8
17 7 TOTAL 13
16 3 (participants)
15 1
TOTAL 13
The following tasks were identified from user data collection efforts and assistance from group.
# Tasks
1 Type the URL of the School Website.
2 Explore the website freely and state your reactions loudly.
3 Find different courses offered.
4 Find the coursed of BS Information Technology
5 Find the prospectus of the BS Information Technology
6 Find the college ADMISSION and Aid.
7 Find the Admission Requirements.
8 Find the information about the freshmen application form with privacy notice
9 Find the College Scholarship Application Form.
10 Find the ADZU Map.
11 Find the Directory of the School.
Table 1. Data Collection Task Score Max:70%
DATA COLLECTION TASK SCORE (%)
Participant 13
Participant 12
Participant 11
Participant 10
Participant 9
Participant 8
Participant 7
Participant 6
Participant 5
Participant 4
Participant 3
Participant 2
Participant 1
0 10 20 30 40 50 60 70 80
DATA COLLECTION TASK SCORE (%)
The graph shows the participant number and number of score percentages achieve from the
number of succeeded tasks of each participant. In general, this show how competitive the given
contestant is in achieving the tasks
Where we tested
Following is a summary of the participants computing environment:
URL of Tested Website: [Link]
Computer Platforms Acer, Ryzen 5, 8GB RAM
Browser Tested: Google Chrome
Screen Resolution: 1980 x 1080
Operating System: Windows 10
Connection Speed: 500 kbps to 1mbps
In the first day of the testing, the test started at 2pm and lasted up until 4:30pm at Don Pablo Lorenzo
Memorial High School. We conducted eight (8) students on September 11,2019, and on the second
day we conducted five (5) students on the same venue on September 18,2019. Upon conducting the
usability testing we prepared the following tools:
Screening Questionnaire
Background and Information Questionnaire
Pre-test Questionnaire
Data Collection Instrument
Post Test
Debriefing Questionnaires
Task Scenario
The test environment was conducted in a single room set-up that has a Test Monitor that give the
instruction to the participants, Data Logger takes note of the whole process of the test, timer Video
recorder records the entire set-up using Canon Camera and Cellphones.
Introductory Question and Task
At the beginning of each session, we asked participants [six] questions, including:
Have you ever seen this school website before?
Please give me your initial impressions about the layout of this page and what you think of the
colors, graphics, photos, etc.?
Without clicking on the anything yet, please describe the options you see on the homepage
and what you think they do. Feel free to move around the page but again I’ll ask you to not to
click on anything right now.
If you were exploring, what would you click on first?
What do you think is the purpose of the site?
Who do you think this site is intended for?
Pre-Test Questionaire
7
0
Home About FAQ Colleges Subject Offering
Pre-Test Questionaire
This table shows how much each of the section of the school webpage is most visited first. It shows
that the HOME link is the most visited with the points of 6 participants who took the pre-test
questionnaire.
Table 3. PRE-TEST Score
PRE-TEST Ateneo De Zamboanga University
60
50
40
30
20
10
0
Is the website easy to Did it give enough How about the How about on Do you Find the
use information such as tuition fees? Scholarship Grants? Information reiable?
undergraduate
courses?
PRE-TEST Ateneo De Zamboanga University
The Table shows that the participants is well satisfied on how easy the website is, the
information’s of undergraduate courses the tuition fees and scholarship grants and the reasons of
some participants when they visit a school website is to now the course the information of the school
and tuition fees.
The Thirteen (13) participants are new to the website and never visited the site before. The
impression of the participants on the graphical user interface, the website has many activities posted
the design is good because it matches to the school. majority of participants are well satisfied. We
also asked them what is the purpose of the website and what this site is intended for? Some of the
participants answer, the purpose is to know the information about the school on how to enrol and to
see the courses that is offered on the school and its intended for the students who are willing to enrol
to that school.
Table 3. Success Rate, Partial Success and Failed per Task
Task Rate Information
9
8
7 8
6 7 7 7 7 7 7
5 6 6 6 6 6
4 5 5
3 4 4
2 3 3 3
1 2 2 2
0 1 1 1 1
0
Task 3 Task 4 Task 5 Task 6 Task 7 Task 8 Task 9 Task 10 Task 11
No. of Success Partial Success Failed Linear (No. of Success)
This table shows the success rate, partial rate and failed task in order. Some of the task for
them are easy and some are moderate as shown on the table. The linear drafted line shows the
learning curve for a given set of scenarios and its associated set of consecutive actions needed to
complete a task. A negative learning curve shows that the website from them is moderate to use.
Table 4. POST-TEST SCORE – Level of Satisfaction after testing the website
POST TEST SCORE
80
70
60 67 68 66 69
62 64 62 65
50 60 57 60 57
40 51
30
20
10
0
1 2 3 4 5 6 7 8 9 10 11 12 13
POST TEST SCORE
This table shows the level of satisfaction of each participant after testing the website. For each
metric 5 is the highest and 1 is the lowest. The graph show that almost all the participants are well
satisfied with the website.
Findings:
Result: (Based On tabulated data)
Difficult in finding the information: 50% Moderate
Website is easy to use: 80% Good
The website can be learned in the given amount of time, meaning participants will have a
better change in completing a task if there is no time limit given.
Almost all the participants are satisfied with the website. The result show that the participants
is interested in learning the website and find it easy to use.
Also show that some of the concerns of the participants that the tuition fee is expensive.
Screenshot of the HOMEPAGE: Ateneo De Zamboanga University
Exit Question
At the end of each session, we asked participants sixteen questions:
How easy is or difficult was it to learn how to use website?
How do you rate the overall ease of use the website?
How do you rate the efficiency of the website?
How easy or difficult was it for you to find the information on the website?
How do you rate the overall navigation of the website?
If the website has downloadable or printable materials (PDF, documents, etc.) how easy was it for you
to download them?
How useful did you find the information that you got from the website?
What are the three things you like best about the website?
What are the three things you like least about the website?
What were your expectations in the beginning? Which of them were fulfilled?
Would you return to the website again? Why or Why not/
If you could make one significant change to the website what change would you make?
Do you have any other questions or comments about the website or your experiences with it?
Debriefing Score
35
30
29
30 28
27
26 26
24 24 24
25 23 23
20
19
20
15
10
0
1 2 3 4 5 6 7 8 9 10 11 12 13
Debriefing Score
This table shows the participants’ perception of how easy to use the website. It shows that the most
participants find it easy and not too hard to use the website.
Appendices
