RESEARCH INSTRUMENT:
DESIGNING A
QUESTIONNAIRE
Dr Noor Hamzani Farizan
Faculty of Medicine & Health Sciences, UPM
Overview
• Definition of a questionnaire
• Types & Functions of questionnaire
• Constructing a questionnaire
• Adopting & adapting a questionnaire
• Conclusion
Definition
What is questionnaire?
A set of question design to generate the
information necessary to address the needs of
research.
Use of questionnaire is one of the most common data
collection tools employed in research works (Kothari, 2004).
Questionnaires are used extensively to gather data on current
conditions, practices, opinions and attitudes quickly and in a
precise way (Orodho, 2008).
Types & Functions
Types of questionnaire
• Structured
- close-ended questions
• Unstructured/ Exploratory
-open-ended questions
• Semi-structured
-mixed
Close-ended Open-ended
questionnaire questionnaire
Limited freedom to express opinion Freedom to express opinion
Answer are often short/ factual Answer are often descriptive &
explanatory
Begin with words like would, do, Begin with words like how, why,
what, etc. explain, describe, etc.
Less scope of getting extra Scope to obtain more information
information
Quantitative data Qualitative data
Semi-structured/ mixed questionnaire
Comprise mixture of closed and open questions
Used when there is need to accommodate a large range of
responses
Mixed of quantitative & qualitative
Close-ended questions
1. Dichotomous (two-category)
2. Multiple choice
3. Likert Scale
4. Matrix
5. Contingency
Dichotomous (two-category)
Multiple choice
Likert Scale
Matrix
Contingency / Filter
Open-ended questions
1. Completely unstructured questions
2. Word associate questions
3. Thematic Apperception Test (TAT)
How can we promote environmental
awareness in children?
What is the first thing coming to mind when you
hear the following;
• Exam:……………..(challenging, nervous)
• Lecture…………........( Interesting, boring)
Constructing a questionnaire
• “Ask what you want to know, not something
else” (Bradburn, 2004)
Constructing a questionnaire: The steps
1 •Formulation of ideas/ Conceptualization
2 •Define the target respondents
3 •Choose the method to reach the target respondents
4 •Decide on question content
5 •Develop relevant questions wording
6 •Sequence - put questions in order – layout & format
7 •Conduct preliminary study – pre test
8 •Develop final survey form
1. Formulation of ideas/ conceptualization
• Identify what problem or need to be
addressed
• Decide information required
2. Define target respondents
• Define the populations
• Draw sampling frame
• Demographic & relevant characteristics
3. Method(s) of reaching target respondents
• Personal/ face-to-face interviews
• Group or focus interviews
• Self-administrated questionnaire
• Mailed/ Online questionnaires
• Telephone interviews.
4. Decide on question content
• Are the questions relevant?
- do they pertain to research problem.
• Are the questions accurate?
- do they accurately depict attitudes, behaviours etc.
intended to investigate?
• Do respondents have the necessary information?
- qualify respondents
• Do respondents understand and interpret the questions
correctly?
• Will respondents give the information?
5. Develop relevant questions wording
• Use simple language
• Use specific questions/ statements for specific answers
• Avoid ambiguous words and questions
• Avoid vague words
• Avoid leading questions
• Avoid double negative questions
• Deal with embarrassing, controversial and sensitives
questions carefully
• Use simple language
Clear & understandable
• Sex?
• What is your gender (Male/ Female)
Avoid slang, jargon and technical terms
• Did you hook up with him? (slang)
• What is your vitals reading? (medical jargon)
Short items are best
•they maybe read, understood & answered quickly
• Use specific questions/ statements for specific
answers
Specific questions & concise
• Have you been to hospital recently?
• Have you been to hospital in last two weeks?
Avoid double-barrelled questions
• Do you think that women should eat less and exercise
more? (Yes/ No)
• Do you think that women should eat less? (Yes/ No)
• Do you think that women should exercise more? (Yes/ No)
• Avoid ambiguous words & questions
Questions should mean the same thing to all respondents
• How often do you feel tired during the day?
• Do you smoke?
• Avoid vague words
Vague questions are difficult to answer
• Do you exercise regularly?
• How often do you exercise?
• Avoid leading questions
Questions which subtly prompt the respondent to answer in particular
way
• Nearly everyone recycles, do you recycle?
• Do you recycle?
• Avoid double negative questions
Double negative – TWO negative words in one sentences
• Do you disagree that lectures should not be required to
help students outside of class?
• Deal with embarrassing, controversial &
sensitives questions carefully
Sexual orientation, political orientations, health status (HIV), drug uses
etc.
• “Did you use drugs?”
• E.g.; Use “the everybody approach” – as you know, many
people have been use drugs these days. Do you happen
to have use drugs?
• E.g.; Use numbered card: (F2F survey). Would you please
read the number on this card which corresponds to what
became to your wife (Give the card to respondent)
• Card 1: Natural Death, Card 2: I killed her, Card 3; Other
(get back the card from respondent before proceeding)
6. Sequence – Layout & Formatting
Ordering of questions – put questions into meaningful order & format
• Opening questions
• Question flow
• Question variety
• Closing questions
Organizing the questionnaire
• Cover letter, interview instructions,
• Clear written format, be consistent formatting
• Use booklet, colour coding etc.
7. Conduct preliminary study - pretest
- Test questionnaire with a small no. of respondents before conducting
main survey
- Checking content, clarity, layout, timing & other factors
• Worded - achieve the desired results
• Placed in the best order
• Understood by respondents
• Need additional/ specific questions/ eliminated questions
• Adequate clear instruction to respondent
Basic steps in pre-testing the questionnaire
• Respondents from target population (not sample
population)
• The questionnaire should be revised based on these
observation
• Check reliability & validity
Reliability
• A measurement gives consistent results
• Types of reliability test;
- test-retest
- inter-rater
- internal consistency
Validity
• The degree to which a questionnaire
measures what it was intended to measure.
• Types of validity test;
- face validity
- content validity
- construct validity
- criterion validity
8. Develop Final Survey Form
• Edit the questionnaire and specify the
procedures for its use
• Conduct pilot test
Adopting or adapting an
instruments
Existing questionnaire: to adopt or adapt?
•Adopting ; use the instrument nearly verbatim
•Adapting; use the instrument with an alteration
Adopting questionnaire
•Ask permission
•Describe the instruments in Chap.3;
-who develop, who validated, other studies
that have used the instrument
•Modification that necessary*
Adapting questionnaire
•Modifications - add items, remove items, changes
content of each item etc
•Pre-test, reliability, validity & pilot test
•Describe the instruments in Chap.3;
-include what changes and why
Good practice in adopting & adapting an
instruments;
•Focus on the theory
•Translation* – TRAPD
•Common key issues; age of respondents,
comparison over time, countries, cultures,
religions etc.
Conclusion
Effective questionnaire
•Maximise the proportion of subjects answering
our questionnaire— response rate.
•Obtain accurate relevant information for our
survey.
Consequences of poor questionnaire design
in research?
•Lower response rate.
•Question skipping
•Questions misunderstanding
Conclusion
• The accuracy of data collected using the tool depends on
the subjective perceptions of the respondents
• The tool need to be highly reliable & valid
• Follow the basic steps & test the tool before using it
References
• William M.K. Trochim 2006 Research Methods Knowledge Base
• WHO; Health Research Methodology :A guide for training in research methods
• Ranjit Kumar. Research Methodology :A step by step guide for beginners. SAGE
Publications
• Development and Validation of a Survey Instrument on Drowning Prevention
and Water Safety among Parents of Primary School Children
https://doi.org/10.7860/JCDR/2019/40100.12817
• Development and Validation of a Questionnaire to Measure Iranian Nurses’
Knowledge, Attitude and Practice Regarding Disaster Preparedness
https://doi.org/10.7860/2016/19894.8337
Thank you
[email protected] 03-9769 2584/ 017-2942183
