Jkms 38 E403
Jkms 38 E403
Review Article
Editing, Writing & Publishing
Designing, Conducting, and Reporting
Survey Studies: A Primer for Researchers
Department of Clinical Rheumatology and Immunology, University Hospital in Krakow, Krakow, Poland
1
2
National Institute of Geriatrics, Rheumatology and Rehabilitation, Warsaw, Poland
Department of Internal Medicine N2, Danylo Halytsky Lviv National Medical University, Lviv, Ukraine
3
Departments of Rheumatology and Research and Development, Dudley Group NHS Foundation Trust
4
(Teaching Trust of the University of Birmingham, UK), Russells Hall Hospital, Dudley, UK
Author Contributions
INTRODUCTION
Conceptualization: Zimba O. Formal analysis:
Zimba O, Gasparyan AY. Writing - original Surveys are increasingly popular research studies that are aimed at collecting and analyzing
draft: Zimba O. Writing - review & editing: opinions of diverse subject groups at certain periods. Initially and predominantly employed
Zimba O, Gasparyan AY. for applied social science research,1 surveys have maintained their social dimension and
transformed into indispensable tools for analyzing knowledge, perceptions, prevalence of
clinical conditions, and practices in the medical sciences.2 In rapidly developing disciplines
with social dimensions such as medical education, public health, and nursing, online surveys
https://jkms.org 1/11
Survey Studies
have become essential for monitoring and auditing healthcare and education services3,4 and
generating new hypotheses and research questions.5 In non-mainstream science countries
with uninterrupted Internet access, online surveys have also been praised as useful studies
for increasing research activities.6
In 2016, the Medical Subject Headings (MeSH) vocabulary of the US National Library of
Medicine introduced "surveys and questionnaires" as a structured keyword, defining survey
studies as "collections of data obtained from voluntary subjects" (https://www.ncbi.nlm.
nih.gov/mesh/?term=surveys+and+questionnaires). Such studies are instrumental in the
absence of evidence from randomized controlled trials, systematic reviews, and cohort
studies. Tagging survey reports with this MeSH term is advisable for increasing the retrieval
of relevant documents while searching through Medline, Scopus, and other global databases.
The EQUATOR Network platform currently lists some widely promoted documents with
statements on conducting and reporting web-based and non-web-based surveys (Table 1).11-14
The oldest published recommendation guides on postal, face-to-face, and telephone interviews.1
One of its critical points highlights the need to formulate a clear and explicit question/objective
to run a focused survey and to design questionnaires with respondent-friendly layout and
content.1 The Checklist for Reporting Results of Internet E-Surveys (CHERRIES) is the most-
used document for reporting online surveys.11 The CHERRIES checklist included points on
Table 1. Recommendations for conducting and reporting survey-based studies and their implications
References Guideline titles and acronyms Descriptions Limitations EQUATOR Network listing
Kelley et al., Good practice in the conduct and The checklist and recommendations focus on The checklist and +
20031 reporting of survey research designing questionnaires and ensuring the recommendations are not based
reliability of non-web-based surveys only. on the Delphi method.
Eysenbach, Checklist for Reporting Results of The CHERRIES checklist focuses on web- This checklist is not based on an +
200411 Internet E-Surveys (CHERRIES) based surveys. It ensures the reliability and expert panel consensus (Delphi
representativeness of online responses and method). It does not cover all
prevents duplicate/multiple entries by the same parts of e-survey reports.
users. It is the top-cited e-survey checklist.
Burns et al., A guide for the design and This guide includes statements on designing, The statements are based on +
200812 conduct of self-administered conducting, and reporting web- and non-web- a literature review, but not the
surveys of clinicians based surveys of clinicians' knowledge, attitude, Delphi method.
and practice.
Sharma et al., Consensus-based Checklist for This is a checklist with 19 sections covering Although 24 experts with +
202113 Reporting of Survey Studies all parts of web- and non-web-based survey numerous related publications
(CROSS) reports. It is based on the Delphi method with 3 were initially enrolled, 6 of them
survey rounds in January 2018 -December 2019 were lost to follow-up.
and 24 experts responding to the 1st round.
Gaur et al., Reporting survey based studies - a These recommendations cover points on Although these -
202014 primer for authors planning and reporting surveys in the COVID-19 recommendations are based
pandemic. Various online platforms, including on a comprehensive literature
social media, for distributing questionnaires and review, statements are not
conducting surveys are presented. discussed with a panel of
experts and lack Delphi
consensus agreements.
COVID-19 = coronavirus disease 2019.
ensuring the reliability of online surveys and avoiding manipulations with multiple entries
by the same users.11 A specific set of recommendations, listed by the EQUATOR Network,
is available for specialists who plan web-based and non-web-based surveys of knowledge,
attitude, and practice in clinical medicine.12 These recommendations help design valid
questionnaires, survey representative subjects with clinical knowledge, and complete
transparent reporting of the obtained results.12
From January 2018 to December 2019, three rounds of surveying experts with interest in
surveys and questionnaires allowed reaching consensus on a set of points for reporting web-
based and non-web-based surveys.13 The Consensus-Based Checklist for Reporting of Survey
Studies included a rating of 19 items of survey reports, from titles to acknowledgments.13
Finally, rapid recommendations on online surveys amid the coronavirus disease 2019
(COVID-19) pandemic were published to guide the authors on how to choose social media
and other online platforms for disseminating questionnaires and targeting representative
groups of respondents.14
ETHICS CONSIDERATIONS
Although health research authorities in some countries lack mandates for full ethics review
of survey studies, obtaining formal review protocols or ethics waivers is advisable for most
surveys involving respondents from more than one country. And following country-based
regulations and ethical norms of research are therefore mandatory.14,17
Full ethics review or exemption procedures are important steps for planning and conducting
ethically sound surveys. Given the non-interventional origin and absence of immediate
health risks for participants, ethics committees may approve survey protocols without a
full ethics review.18 A full ethics review is however required when the informational and
psychological harms of surveys increase the risk.18 Informational harms may result from
unauthorized access to respondents' personal data and stigmatization of respondents
with leaked information about social diseases. Psychological harms may include anxiety,
depression, and exacerbation of underlying psychiatric diseases.
Survey questionnaires submitted for evaluation should indicate how informed consent is
obtained from respondents.13 Additionally, information about confidentiality, anonymity,
questionnaire delivery modes, compensations, and mechanisms preventing unauthorized
access to questionnaires should be provided.13,14 Ethical considerations and validation
are especially important in studies involving vulnerable and marginalized subjects with
diminished autonomy and poor social status due to dementia, substance abuse, inappropriate
sexual behavior, and certain infections.18-20 Precautions should be taken to avoid
confidentiality breaches and bot activities when surveying via insecure online platforms.21
The structure of questionnaires may differ for surveys of patient groups with various age-
dependent health issues. Care should be taken when children are targeted since they often
report a variety of modifiable conditions such as anxiety and depression, musculoskeletal
problems, and pain, affecting their quality of life.29 Likewise, gender and age differences
should be considered in questionnaires addressing the quality of life in association with
mental health and social status.30 Questionnaires for older adults may benefit from including
questions about social support and assistance in the context of caring for aging diseases.31
Finally, addressing the needs of digital technologies and home-care applications may help
to ensure the completeness of questionnaires for older adults with sedentary lifestyles and
mobility disabilities.32,33
Preliminary evidence suggests that distributing survey links via social-media accounts of
individual users and organized e-groups with interest in specific health issues may increase
their engagement and correctness of responses.40,41
Since surveys employing social media are publicly accessible, related questionnaires should
be professionally edited to easily inquire target populations, avoid sensitive and disturbing
points, and ensure privacy and confidentiality.42,43 Although counting e-post views is
feasible, response rates of social-media distributed questionnaires are practically impossible
to record. The latter is an inherent limitation of such surveys.
SURVEY SAMPLING
Establishing connections with target populations and diversifying questionnaire dissemination
may increase the rigor of current surveys which are abundantly administered.44 Sample sizes
depend on various factors, including the chosen topic, aim, and sampling strategy (random or
non-random).12 Some topics such as COVID-19 and global health may easily attract the attention
of large respondent groups motivated to answer a variety of questionnaire questions. In the
beginning of the pandemic, most surveys employed non-random (non-probability) sampling
strategies which resulted in analyses of numerous responses without response rate calculations.
These qualitative research studies were mainly aimed to analyze opinions of specialists and
patients exposed to COVID-19 to develop rapid guidelines and initiate clinical trials.
Outside the pandemic, and beyond hot topics, there is a growing trend of low response rates
and inadequate representation of target populations.45 Such a trend makes it difficult to
design and conduct random (probability) surveys. Subsequently, hypotheses of current online
surveys often omit points on randomization and sample size calculation, ending up with
qualitative analyses and pilot studies. In fact, convenience (non-random or non-probability)
sampling can be particularly suitable for previously unexplored and emerging topics when
overviewing literature cannot help estimate optimal samples and entirely new questionnaires
should be designed and tested. The limitations of convenience sampling minimize the
generalizability of the conclusions since the sample representativeness is uncertain.45
Researchers often employ 'snowball' sampling techniques with initial surveyees forwarding
the questionnaires to other interested respondents, thereby maximizing the sample size.
Another common technique for obtaining more responses relies on generating regular social
media reminders and resending e-mails to interested individuals and groups. Such tactics
can increase the study duration but cannot exclude the participation bias and non-response.
Purposive or targeted sampling is perhaps the most precise technique when knowing the
target population size and respondents' readiness to correctly fill the questionnaires and
ensure an exact estimate of response rate, close to 100%.46
DESIGNING QUESTIONNAIRES
Correctness, confidentiality, privacy, and anonymity are critical points of inquiry in
questionnaires.47 Correctly worded and convincingly presented survey invitations with
consenting options and reassurances of secure data processing may increase response rates
and ensure the validity of responses.47 Online surveys are believed to be more advantageous
than offline inquiries for ensuring anonymity and privacy, particularly for targeting socially
marginalized and stigmatized subjects. Online study design is indeed optimal for collecting
more responses in surveys of sex- and gender-related and otherwise sensitive topics.
Questionnaire revisions are aimed at ensuring the validity and consistency of questions,
implying the appeal to relevant responders and accurate covering of all essential points.45
Valid questionnaires enable reliable and reproducible survey studies that end up with the
same responses to variably worded and located questions.45
Avoiding too simplistic (yes/no) questions and replacing them with Likert-scale items
may increase the robustness of questionnaire analyses.50 Additionally, constructing easily
understandable questions, excluding merged items with two or more points, and moving
sophisticated questions to the beginning of a questionnaire may add to the quality and
feasibility of the study.50
CONCLUSION
Survey studies are increasingly conducted by health professionals to swiftly explore
opinions on a wide range of topics by diverse groups of specialists, patients, and public
representatives. Arguably, quality surveys with generalizable results can be instrumental for
guiding health practitioners in times of crises such as the COVID-19 pandemic when clinical
trials, systematic reviews, and other evidence-based reports are scarcely available or absent.
Online surveys can be particularly valuable for collecting and analyzing specialist, patient,
and other subjects' responses in non-mainstream science countries where top evidence-
based studies are scarce commodities and research funding is limited. Accumulated expertise
in drafting quality questionnaires and conducting robust surveys is valuable for producing
new data and generating new hypotheses and research questions.
The main advantages of surveys are related to the ease of conducting such studies with limited
or no research funding. The digitization and social media advances have further contributed to
the ease of surveying and growing global interest toward surveys among health professionals.
Some of the disadvantages of current surveys are perhaps those related to imperfections of
digital platforms for disseminating questionnaires and analysing responses.
Although some survey reporting standards and recommendations are available, none of these
comprehensively cover all items of questionnaires and steps in surveying. None of the survey
reporting standards is based on summarizing guidance of a large number of contributors
involved in related research projects. As such, presenting the current guidance with a list of
items for survey reports (Table 2) may help better design and publish related articles.
REFERENCES
1. Kelley K, Clark B, Brown V, Sitzia J. Good practice in the conduct and reporting of survey research. Int J
Qual Health Care 2003;15(3):261-6.
PUBMED | CROSSREF
2. Arafa AE, Anzengruber F, Mostafa AM, Navarini AA. Perspectives of online surveys in dermatology. J Eur
Acad Dermatol Venereol 2019;33(3):511-20.
PUBMED | CROSSREF
3. Jones S, Murphy F, Edwards M, James J. Using online questionnaires to conduct nursing research. Nurs
Times 2008;104(47):66-9.
PUBMED
4. Phillips AW, Friedman BT, Utrankar A, Ta AQ, Reddy ST, Durning SJ. Surveys of health professions trainees:
prevalence, response rates, and predictive factors to guide researchers. Acad Med 2017;92(2):222-8.
PUBMED | CROSSREF
5. Latour JM, Tume LN. How to do and report survey studies robustly: a helpful mnemonic SURVEY. Nurs Crit
Care 2021;26(5):313-4.
PUBMED | CROSSREF
6. Regmi PR, Waithaka E, Paudyal A, Simkhada P, van Teijlingen E. Guide to the design and application of
online questionnaire surveys. Nepal J Epidemiol 2016;6(4):640-4.
PUBMED | CROSSREF
7. Evans JR, Mathur A. The value of online surveys. Internet Res 2005;15(2):195-219.
CROSSREF
8. Li AH, Thomas SM, Farag A, Duffett M, Garg AX, Naylor KL. Quality of survey reporting in nephrology
journals: a methodologic review. Clin J Am Soc Nephrol 2014;9(12):2089-94.
PUBMED | CROSSREF
9. Pagano MB, Dunbar NM, Tinmouth A, Apelseth TO, Lozano M, Cohn CS, et al. A methodological review
of the quality of reporting of surveys in transfusion medicine. Transfusion 2018;58(11):2720-7.
PUBMED | CROSSREF
10. Shankar PR, Maturen KE. Survey research reporting in radiology publications: a review of 2017 to 2018. J
Am Coll Radiol 2019;16(10):1378-84.
PUBMED | CROSSREF
11. Eysenbach G. Improving the quality of Web surveys: the Checklist for Reporting Results of Internet
E-Surveys (CHERRIES). J Med Internet Res 2004;6(3):e34.
PUBMED | CROSSREF
12. Burns KE, Duffett M, Kho ME, Meade MO, Adhikari NK, Sinuff T, et al. A guide for the design and
conduct of self-administered surveys of clinicians. CMAJ 2008;179(3):245-52.
PUBMED | CROSSREF
13. Sharma A, Minh Duc NT, Luu Lam Thang T, Nam NH, Ng SJ, Abbas KS, et al. A consensus-based
Checklist for Reporting of Survey Studies (CROSS). J Gen Intern Med 2021;36(10):3179-87.
PUBMED | CROSSREF
14. Gaur PS, Zimba O, Agarwal V, Gupta L. Reporting survey based studies - a primer for authors. J Korean Med
Sci 2020;35(45):e398.
PUBMED | CROSSREF
15. Maselli F, Esculier JF, Storari L, Mourad F, Rossettini G, Barbari V, et al. Low back pain among Italian
runners: a cross-sectional survey. Phys Ther Sport 2021;48:136-45.
PUBMED | CROSSREF
16. Sousa GS, Fitzsimons MG, Mueller A, Quintão VC, Simões CM. Drug abuse amongst anesthetists in
Brazil: a national survey. Braz J Anesthesiol 2021;71(4):326-32.
PUBMED | CROSSREF
17. Looijmans A, Spahrkäs SS, Sanderman R, Hagedoorn M. Ethical review procedures in international
internet-based intervention studies. Internet Interv 2021;28:100487.
PUBMED | CROSSREF
18. Whicher D, Wu AW. Ethics review of survey research: a mandatory requirement for publication? Patient
2015;8(6):477-82.
PUBMED | CROSSREF
19. Langhaug LF, Sherr L, Cowan FM. How to improve the validity of sexual behaviour reporting: systematic
review of questionnaire delivery modes in developing countries. Trop Med Int Health 2010;15(3):362-81.
PUBMED | CROSSREF
20. Artino AR Jr, Durning SJ, Sklar DP. Guidelines for reporting survey-based research submitted to academic
medicine. Acad Med 2018;93(3):337-40.
PUBMED | CROSSREF
21. Teitcher JE, Bockting WO, Bauermeister JA, Hoefer CJ, Miner MH, Klitzman RL. Detecting, preventing,
and responding to “fraudsters” in internet research: ethics and tradeoffs. J Law Med Ethics 2015;43(1):116-33.
PUBMED | CROSSREF
22. Palamar JJ, Acosta P. On the efficacy of online drug surveys during the time of COVID-19. Subst Abus
2020;41(3):283-5.
PUBMED | CROSSREF
23. Broadbent E, Wilkes C, Koschwanez H, Weinman J, Norton S, Petrie KJ. A systematic review and meta-
analysis of the brief illness perception questionnaire. Psychol Health 2015;30(11):1361-85.
PUBMED | CROSSREF
24. Vieira AM, Costa IZ, Oh P, Lima de Melo Ghisi G. Questionnaires designed to assess knowledge of heart
failure patients: a systematic review. J Cardiovasc Nurs 2016;31(5):469-78.
PUBMED | CROSSREF
25. Cinar FI, Cinar M, Yilmaz S, Acikel C, Erdem H, Pay S, et al. Cross-cultural adaptation, reliability, and
validity of the Turkish version of the compliance questionnaire on rheumatology in patients with Behçet’s
disease. J Transcult Nurs 2016;27(5):480-6.
PUBMED | CROSSREF
26. Gao L, Zhang XC, Li MM, Yuan JQ, Cui XJ, Shi BX. Psychometric properties of the Chinese version of
Arthritis Self-Efficacy Scale-8 (ASES-8) in a rheumatoid arthritis population. Rheumatol Int 2017;37(5):751-6.
PUBMED | CROSSREF
27. Park JI, Baek H, Kim SW, Jeong JY, Song KH, Yu JH, et al. Questionnaire-based survey of demographic
and clinical characteristics, health behaviors, and mental health of young Korean adults with early-onset
diabetes. J Korean Med Sci 2021;36(26):e182.
PUBMED | CROSSREF
28. Rodère M, Pereira B, Soubrier M, Fayet F, Piperno M, Pallot-Prades B, et al. Development and validation of
a self-administered questionnaire measuring essential knowledge in patients with rheumatoid arthritis.
Rheumatol Int 2022;42(10):1785-95.
PUBMED | CROSSREF
29. Xiong X, Dalziel K, Huang L, Mulhern B, Carvalho N. How do common conditions impact health-related
quality of life for children? Providing guidance for validating pediatric preference-based measures. Health
Qual Life Outcomes 2023;21(1):8.
PUBMED | CROSSREF
30. Solomou I, Constantinidou F. Prevalence and predictors of anxiety and depression symptoms during the
COVID-19 pandemic and compliance with precautionary measures: age and sex matter. Int J Environ Res
Public Health 2020;17(14):4924.
PUBMED | CROSSREF
31. Fivecoat HC, Sayers SL, Riegel B. Social support predicts self-care confidence in patients with heart
failure. Eur J Cardiovasc Nurs 2018;17(7):598-604.
PUBMED | CROSSREF
32. Zhao Y, Heida T, van Wegen EE, Bloem BR, van Wezel RJ. E-health support in people with Parkinson’s
disease with smart glasses: a survey of user requirements and expectations in the Netherlands. J Parkinsons
Dis 2015;5(2):369-78.
PUBMED | CROSSREF
33. DeSmet A, De Bourdeaudhuij I, Chastin S, Crombez G, Maddison R, Cardon G. Adults’ preferences for
behavior change techniques and engagement features in a mobile app to promote 24-hour movement
behaviors: cross-sectional survey study. JMIR Mhealth Uhealth 2019;7(12):e15707.
PUBMED | CROSSREF
34. Boon-Itt S, Skunkan Y. Public perception of the COVID-19 pandemic on twitter: sentiment analysis and
topic modeling study. JMIR Public Health Surveill 2020;6(4):e21978.
PUBMED | CROSSREF
35. Ali SH, Foreman J, Capasso A, Jones AM, Tozan Y, DiClemente RJ. Social media as a recruitment platform
for a nationwide online survey of COVID-19 knowledge, beliefs, and practices in the United States:
methodology and feasibility analysis. BMC Med Res Methodol 2020;20(1):116.
PUBMED | CROSSREF
36. Stokes Y, Vandyk A, Squires J, Jacob JD, Gifford W. Using Facebook and LinkedIn to recruit nurses for an
online survey. West J Nurs Res 2019;41(1):96-110.
PUBMED | CROSSREF
37. Lee JL, Choudhry NK, Wu AW, Matlin OS, Brennan TA, Shrank WH. Patient use of Email, Facebook, and
physician websites to communicate with physicians: a national online survey of retail pharmacy users. J
Gen Intern Med 2016;31(1):45-51.
PUBMED | CROSSREF
38. Wagner JP, Cochran AL, Jones C, Gusani NJ, Varghese TK Jr, Attai DJ. Professional use of social media
among surgeons: results of a multi-institutional study. J Surg Educ 2018;75(3):804-10.
PUBMED | CROSSREF
39. Reich J, Guo L, Groshek J, Weinberg J, Chen W, Martin C, et al. Social media use and preferences in
patients with inflammatory bowel disease. Inflamm Bowel Dis 2019;25(3):587-91.
PUBMED | CROSSREF
40. Savard I, Kilpatrick K. Tailoring research recruitment strategies to survey harder-to-reach populations: a
discussion paper. J Adv Nurs 2022;78(4):968-78.
PUBMED | CROSSREF
41. Hadler M, Klösch B, Reiter-Haas M, Lex E. Combining survey and social media data: respondents’
opinions on COVID-19 measures and their willingness to provide their social media account information.
Front Sociol 2022;7:885784.
PUBMED | CROSSREF
42. Reich J, Guo L, Hall J, Tran A, Weinberg J, Groshek J, et al. A survey of social media use and preferences in
patients with inflammatory bowel disease. Inflamm Bowel Dis 2016;22(11):2678-87.
PUBMED | CROSSREF
43. Bender JL, Hueniken K, Eng L, Brown MC, Kassirian S, Geist I, et al. Internet and social media use in
cancer patients: association with distress and perceived benefits and limitations. Support Care Cancer
2021;29(9):5273-81.
PUBMED | CROSSREF
44. Hlatshwako TG, Shah SJ, Kosana P, Adebayo E, Hendriks J, Larsson EC, et al. Online health survey
research during COVID-19. Lancet Digit Health 2021;3(2):e76-7.
PUBMED | CROSSREF
45. Ball HL. Conducting online surveys. J Hum Lact 2019;35(3):413-7.
PUBMED | CROSSREF
46. Smeds MR. A brief guide to survey methodology for vascular surgeons. Semin Vasc Surg 2022;35(4):431-7.
PUBMED | CROSSREF
47. McInroy LB. Pitfalls, potentials, and ethics of online survey research: LGBTQ and other marginalized and
hard-to-access youths. Soc Work Res 2016;40(2):83-94.
PUBMED | CROSSREF
48. Stone DH. Design a questionnaire. BMJ 1993;307(6914):1264-6.
PUBMED | CROSSREF
49. LaDonna KA, Taylor T, Lingard L. Why open-ended survey questions are unlikely to support rigorous
qualitative insights. Acad Med 2018;93(3):347-9.
PUBMED | CROSSREF
50. Gehlbach H, Artino AR Jr. The survey checklist (Manifesto). Acad Med 2018;93(3):360-6.
PUBMED | CROSSREF