User Testing & Validation
HI!
I am Wiza Teguh. I am currently helping
students in various competitions and
also a lecturer in Information Systems
OUR AGENDA TODAY
SESSION 1 SESSION 2 SESSION 3 SESSION 4
Get to Know Usability Usability Usability
Usability Testing Testing Session Testing Result
Testing Preparation Presentation
GET TO KNOW
USABILITY TESTING
USABILITY TESTING
Usability testing refers to evaluating a
product or service by testing it with
representative users.
USABILITY TESTING
=
USER TESTING
DESIGN THINKING PROCESS
WHY DO YOU NEED
USABILITY TESTING?
WHY USABILITY TESTING?
IDENTIFYING UNCOVER LEARN ABOUT
PROBLEMS OPPORTUNITIES USERS
Problems that might Getting to know your
Opportunities to
occurs on your users better in terms
improve your design
design and of preferences and
based on feedbacks
processes goals
USABILITY TESTING VS UAT
USABILITY TESTING USER ACCEPTANCE TESTING
This method is used to test if an application Also known as “Beta Testing”, is used to
is or will be easy to use for the end user find bugs in a website’s design
Satisfaction Compatibility
Memorability Roadmap Validation
Desirability Test Support Processes
Credibility
Errors
Efficiency
Learnability
THE ELEMENTS OF
USABILITY TESTING
ELEMENTS OF USABILITY TESTING
FACILITATOR
Guides participants through the
test process
Gives instructions, ask follow up
questions
Ensures that test results in high-
quality, valid data, without
influencing participant's behavior
TASKS
Realistic activities that
participants' might perform in real
life
Can be delivered verbally or can
be handed on a written task
sheets
PARTICIPANT
Realistic user of product or
service
Depending on the research
question, participant of test might
be ones who already used the
product or service
FLOW OF
INFORMATION
THE PRODUCTS
DESKTOP/WEB MOBILE PHONES
DESKTOP / WEB BASED TESTING
MOBILE PHONES BASED TESTING
QUALITATIVE VS QUANTITATIVE
QUALITATIVE TESTING
Qualitative data offer a direct assessment of the usability of a
system: researchers will observe participants struggle with
specific UI elements and infer which aspects of the design
are problematic and which work well. They can always ask
participants followup questions and change the course of the
study to get insights into the specific issue that the
participant experiences.
QUANTITATIVE TESTING
Quantitative data offer an indirect assessment of the
usability of a design. They can be based on users’
performance on a given task (e.g., task-completion times,
success rates, number of errors) or can reflect participants’
perception of usability (e.g., satisfaction ratings). Quantitative
metrics are simply numbers, and as such, they can be hard to
interpret in the absence of a reference point.
THE COMPARISONS
QUAL. TESTING QUAN. TESTING
Why? How many and how much?
Formative and Summative: Summative:
Inform design decisions Evaluate the usability of an existing site
Identify usability issues and finding solutions Track usability over time
Compare site with other designs
Performed anytime When working product is available
Researcher's impressions, interpretations, and prior Statistical numbers
knowledge
Few participants Many participants
Flexible Well-defined and strict
USABILITY TESTING
PREPARATION
THE PILLARS OF USABILITY TESTING
TYPICAL APPROPRIATE SKILLED
USERS TASKS FACILITATOR
TYPICAL USERS
Recruit people Use a screener to Exclude people
similar to your select participants who aren't good
target users fit
HOW MANY PARTICIPANTS DO YOU NEED?
HOW MANY PARTICIPANTS DO YOU NEED?
5
Exception for quantitative testing: 20
ARGUMENTS FOR MORE
TEST PARTICIPANTS
A BIG A BIG SEVERAL
WEBSITE HAS WEBSITE HAS DIFFERENT
MILLIONS OF HUNDREDS TARGET
USERS OF FEATURES AUDIENCES
WHY 5 ?
Higher ROI Repetitive Insights Information Foraging
DO NOT USE THE SAME PERSON ON THE
NEXT TEST ITERATION
APPROPRIATE TASK
AVOID
GIVING ADD A BRIEF
ACTIONABLE REALISTIC
CLUES AND CONTEXT
STEPS
ASK YOURSELF: WHAT ARE THE MOST
IMPORTANT THINGS THAT EVERY USER MUST
BE ABLE TO ACCOMPLISH ON THE SITE
EXAMPLE OF USER GOALS
Find articles on a specific topic
Sign up for UX Week seminars
Learn about our consulting services
EXAMPLE: ACTIONABLE
User goal: Find articles on a specific topic
Poor task: You want to read an article about UI/UX. Open the
website and tell me what would you do?
Better task: Open the website to find an article about UI/UX
that you might be interested in
EXAMPLE: REALISTIC
User goal: Learn about our consulting services
Poor task: Book on the service of usability testing consultation
Better task: As a representative of your company, book a
service of your preferred consultation topic
EXAMPLE: AVOID CLUES AND STEPS
User goal: Sign up for UX Week seminars
Poor task: Go to the website, sign in to your account, go to the
seminars page, and sign up for UX Week seminars
Better task: You want to join UX Week seminars, book for
yourself on the website
SKILLED FACILITATOR
ABILITY TO
NOT MAKE THE
ANALYZE AND
CREATING USER FEELS
INTERPRET
BIAS COMFORTABLE
RESULTS
SKILLED FACILITATOR
USABILITY TESTING EXAMPLE
OBJECT:
Website Bank
Mantap
USABILITY TESTING
SESSION
TESTING SESSION
Introduce yourself Introduce yourself
Read out the test situation Pay attention to the instructions
Read or hand out the task to the Follow the task given (don't ask
tester what to do)
Write every feedbacks Give your honest feedbacks
DON'T VALIDATE
TEST THEM
USABILITY TESTING
RESULT PRESENTATION
EVALUATION
List all the feedbacks from Usability Testing
Consider which feedbacks that you will accept and which one
is not (give reasons)
Prepare your short presentation
THANK YOU
