UX Research Methods for Designing Interactive Media
User Experience (UX) is critical to the success of interactive media products. Successful product... more User Experience (UX) is critical to the success of interactive media products. Successful product development depends on deeply understanding users in order to ensure product utility, usability, and desirability. By putting users at the center of the product development process, UX research establishes who the user is, the context they in which will use the product, and what they want from the product. UX research is also used to evaluate the user experience to confirm that users can interact with product features efficiently, effectively, and satisfactorily. Overall, UX research improves our understanding, informs design, and validates design decisions. This chapter describes several methods employed in UX research to define and evaluate the user experience of interactive media.
Perception and Comprehension of the Hurricane Threats and Impacts Graphics
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Effective tropical cyclone risk reduction is possible only if all relevant threats are considered... more Effective tropical cyclone risk reduction is possible only if all relevant threats are considered and analyzed. Recently, weather organizations have expanded their forecast products to include more information about tropical cyclone hazards. Of these products, the Hurricane Threats and Impacts (HTI) graphics are gaining support. Although the HTI graphics have been operational since 2015, no user evaluations of their efficacy have been published. In an online experiment with 114 non-expert participants, we explored the effect of prior tropical cyclone experience and storm characteristics on HTI perceived ease of use, task completion time, and comprehension. Overall, perceived ease of use and comprehension scores were low across the experience groups. Completion times were similar across the groups and storms. The results suggest that the HTI graphics are misinterpreted by the public and may not be effective in communicating tropical cyclone hazards.
Hearing protection devices (HPDs) remain the first line of defense against hazardous noise exposu... more Hearing protection devices (HPDs) remain the first line of defense against hazardous noise exposure and noise-induced hearing loss (NIHL). Despite the increased awareness of NIHL as a major occupational health hazard, implementation of effective hearing protection interventions remains challenging in at-risk occupational groups including those in public safety that provide fire, emergency medical, or law enforcement services. A reduction of situational awareness has been reported as a primary barrier to including HPDs as routine personal protective equipment. This study examined the effects of hearing protection and simulated NIHL on spatial awareness in ten normal hearing subjects. In a sound-attenuating booth and using a head-orientation tracker, speech intelligibility and localization accuracy were collected from these subjects under multiple listening conditions. Results demonstrate that the use of HPDs disrupts spatial hearing as expected, specifically localization performance ...
International Journal of Environmental Research and Public Health, Jan 28, 2023
This article is an open access article distributed under the terms and conditions of the Creative... more This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY
International Journal of Environmental Research and Public Health
Firefighters are exposed to extensive hazardous noise while on the job, both during routine tasks... more Firefighters are exposed to extensive hazardous noise while on the job, both during routine tasks at the station and when responding to calls. However, little is known about firefighters’ occupational noise hazards. This study employed mixed methods, including focus groups, a survey, and audiometric testing, to identify sources of noise in the firefighters’ work environment, determine hearing protective strategies, discern firefighters’ perceptions of occupational noise exposure and impacts to their health, and quantify the prevalence of hearing loss among South Florida firefighters. A total of 6 senior officers served in an expert panel, 12 participated in focus groups, 300 completed the survey, and 214 received audiometric tests. Most firefighters were unaware of the risk and their departments’ policies, and did not participate in hearing protection practices and avoided using hearing protection devices, which they believed impede team communication and situational awareness. Near...
The accurate interpretation of hurricane risk graphics is expected to benefit public decision-mak... more The accurate interpretation of hurricane risk graphics is expected to benefit public decision-making. To investigate public interpretation and suggest improvements to graphical designs, an interdisciplinary, mixed-methods approach is being undertaken. Drawing on a series of focus groups with Miami residents that focused on understanding interpretations of the National Hurricane Center’s (NHC) track forecast cone or “Cone of Uncertainty,” we developed an online survey targeting a much larger sample of Florida residents (n = 2,847). The findings from this survey are the primary focus of this short article. We attempt to answer three questions: 1) What are the most frequent and trusted sources of information that Florida residents use when they learn that a hurricane is coming their way? 2) How accurately are Florida residents able to interpret risk based on the NHC Cone of Uncertainty graphic? 3) What is the relationship, if any, between the number of correct interpretations and incom...
2019 Survey of Florida Residents to Evaluate Public Comprehension of the "Cone of Uncertainty" Graphic
This data set contains results from an online survey targeting a sample of 2,847 Florida resident... more This data set contains results from an online survey targeting a sample of 2,847 Florida residents in 2019. Unlike previous public surveys that focused more on evacuation decisions, forecast usage, and perception of hurricane risk, our approach specifically pays attention to the details of design elements of the forecast graphics with the long-term goal of minimizing misinterpretation of future graphics. The survey comprised 55 mostly multiple-choice and True/False questions, including demographic information and a series of 42 questions aimed at addressing three main research questions. These data are associated with the article: Evans, S.D., Broad, K., Cairo, A., Majumdar, S.J., McNoldy, B.D., Millet, B., & Rauk, L., "An Interdisciplinary Approach to Evaluate Public Comprehension of the "Cone of Uncertainty" Graphic" submitted to BAMS.
Design guidelines for hurricane risk forecast to non-expert users
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Hurricane forecast graphics, such as the cone of uncertainty and the hurricane threat impacts gra... more Hurricane forecast graphics, such as the cone of uncertainty and the hurricane threat impacts graphics, are provided to assist the general public in assessing their risk and in making protective action decisions for an approaching storm. Many researchers have demonstrated that hurricane forecast graphics are often misinterpreted by the general public. Few studies, however, have investigated the impact of design elements of these graphics on interpretations of hurricane risk communication for non-expert users. This study provides design guidelines for improving hurricane risks forecast products based on a literature review.
International Journal of Environmental Research and Public Health
Noise-induced hearing loss (NIHL) is the most prevalent occupational disease in the world and fir... more Noise-induced hearing loss (NIHL) is the most prevalent occupational disease in the world and firefighters are at increased risk of NIHL due to their frequent exposure to hazardous levels of noise during service. Adverse effects of NIHL include acceleration of age-related hearing loss and an increased risk of cognitive decline. A critical challenge in addressing NIHL is the delayed clinical presentation of symptoms and lack of sensitive tools for early detection. To study the early clinical symptoms of NIHL in this high-risk group, we collected hearing function data including behavioral audiometric thresholds and distortion product otoacoustic emissions (DPOAEs) in 176 firefighters during annual physical assessments. Results revealed significant deficits in cochlear outer hair cell function in the presence of normal audiograms. Additionally, 55% of firefighters self-reported changes in hearing, while 20% self-reported concerns about their balance. This study is the first to characte...
Designing a Hybrid Layout for a Five-Key Text Entry
Five-key text entry methods are useful for limited text entry on small devices. They use four dir... more Five-key text entry methods are useful for limited text entry on small devices. They use four directional keys to move a selector over an on-screen keyboard and an Enter key for selection. Although other researchers have described five-key character layouts using alphabetical order and predictive layouts based on digraph frequencies, there is considerable latitude in designing the rest of a comprehensive on-screen keyboard. Furthermore, it might be possible to capitalize on the relative strengths of the alphabetic and predictive layouts by combining them in a hybrid layout. In this paper, we describe the design factors considered and tools used to develop three five-key text-entry techniques: alphabetic, predictive, and hybrid.
Soundtrack design: The impact of music on visual attention and affective responses
Applied Ergonomics, 2021
Through music, film composers attempt to affect the audience's emotions and visual attention;... more Through music, film composers attempt to affect the audience's emotions and visual attention; however, little empirical evidence exists characterizing the mechanisms whereby music affects viewers. We conducted a mixed-design experiment with 60 participants to explore the effect of music on viewers' visual attention and affective responses to a film. Music led to quicker first fixations on film objects and supplied emotional content, increasing positive sentiment for the film's story. However, music did not influence viewers' attitudes to filmed events. Within this context, music has limited impact on attitudes toward filmed events but can accentuate the saliency of film objects and supply emotional information altering viewers' sentiment towards the film. Understanding the mechanisms of music's physiological and behavioral effects can inform content delivery strategies. This study offers insights for composition and production of musical soundtracks for feature-length films, advertising videos, educational videos, and video games.
Soundtrack design: The impact of music on visual attention and affective responses
Applied Ergonomics, 2021
Through music, film composers attempt to affect the audience's emotions and visual attention;... more Through music, film composers attempt to affect the audience's emotions and visual attention; however, little empirical evidence exists characterizing the mechanisms whereby music affects viewers. We conducted a mixed-design experiment with 60 participants to explore the effect of music on viewers' visual attention and affective responses to a film. Music led to quicker first fixations on film objects and supplied emotional content, increasing positive sentiment for the film's story. However, music did not influence viewers' attitudes to filmed events. Within this context, music has limited impact on attitudes toward filmed events but can accentuate the saliency of film objects and supply emotional information altering viewers' sentiment towards the film. Understanding the mechanisms of music's physiological and behavioral effects can inform content delivery strategies. This study offers insights for composition and production of musical soundtracks for feature-length films, advertising videos, educational videos, and video games.
Can We Stop the Spread of False Information on Vaccination? How Online Comments on Vaccination News Affect Readers’ Credibility Assessments and Sharing Behaviors
Science Communication, 2021
This study used a 2 (type of news: fake vs. real) × 2 (presence of negative user comments: yes vs... more This study used a 2 (type of news: fake vs. real) × 2 (presence of negative user comments: yes vs. no) × 2 (presence of positive user comments: yes vs. no) between-subjects experimental design to examine the differences in perceived news credibility and sharing intention between fake news and real news on vaccination. Fake news was found to generate a lower level of perceived credibility than real news, which subsequently decreased news sharing intention. Furthermore, negative user comments significantly lowered perceived news credibility, and this was especially true for real news. However, this adverse effect was found to be mitigated by the presence of positive user comments. The experimental results have important theoretical and practical implications for future research on fake news about health and science.
Can We Stop the Spread of False Information on Vaccination? How Online Comments on Vaccination News Affect Readers’ Credibility Assessments and Sharing Behaviors
Science Communication, 2021
This study used a 2 (type of news: fake vs. real) × 2 (presence of negative user comments: yes vs... more This study used a 2 (type of news: fake vs. real) × 2 (presence of negative user comments: yes vs. no) × 2 (presence of positive user comments: yes vs. no) between-subjects experimental design to examine the differences in perceived news credibility and sharing intention between fake news and real news on vaccination. Fake news was found to generate a lower level of perceived credibility than real news, which subsequently decreased news sharing intention. Furthermore, negative user comments significantly lowered perceived news credibility, and this was especially true for real news. However, this adverse effect was found to be mitigated by the presence of positive user comments. The experimental results have important theoretical and practical implications for future research on fake news about health and science.
UX Research Methods for Designing Interactive Media
User Experience (UX) is critical to the success of interactive media products. Successful product... more User Experience (UX) is critical to the success of interactive media products. Successful product development depends on deeply understanding users in order to ensure product utility, usability, and desirability. By putting users at the center of the product development process, UX research establishes who the user is, the context they in which will use the product, and what they want from the product. UX research is also used to evaluate the user experience to confirm that users can interact with product features efficiently, effectively, and satisfactorily. Overall, UX research improves our understanding, informs design, and validates design decisions. This chapter describes several methods employed in UX research to define and evaluate the user experience of interactive media.
Perception and Comprehension of the Hurricane Threats and Impacts Graphics
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Effective tropical cyclone risk reduction is possible only if all relevant threats are considered... more Effective tropical cyclone risk reduction is possible only if all relevant threats are considered and analyzed. Recently, weather organizations have expanded their forecast products to include more information about tropical cyclone hazards. Of these products, the Hurricane Threats and Impacts (HTI) graphics are gaining support. Although the HTI graphics have been operational since 2015, no user evaluations of their efficacy have been published. In an online experiment with 114 non-expert participants, we explored the effect of prior tropical cyclone experience and storm characteristics on HTI perceived ease of use, task completion time, and comprehension. Overall, perceived ease of use and comprehension scores were low across the experience groups. Completion times were similar across the groups and storms. The results suggest that the HTI graphics are misinterpreted by the public and may not be effective in communicating tropical cyclone hazards.
Hearing protection devices (HPDs) remain the first line of defense against hazardous noise exposu... more Hearing protection devices (HPDs) remain the first line of defense against hazardous noise exposure and noise-induced hearing loss (NIHL). Despite the increased awareness of NIHL as a major occupational health hazard, implementation of effective hearing protection interventions remains challenging in at-risk occupational groups including those in public safety that provide fire, emergency medical, or law enforcement services. A reduction of situational awareness has been reported as a primary barrier to including HPDs as routine personal protective equipment. This study examined the effects of hearing protection and simulated NIHL on spatial awareness in ten normal hearing subjects. In a sound-attenuating booth and using a head-orientation tracker, speech intelligibility and localization accuracy were collected from these subjects under multiple listening conditions. Results demonstrate that the use of HPDs disrupts spatial hearing as expected, specifically localization performance ...
International Journal of Environmental Research and Public Health, Jan 28, 2023
This article is an open access article distributed under the terms and conditions of the Creative... more This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY
International Journal of Environmental Research and Public Health
Firefighters are exposed to extensive hazardous noise while on the job, both during routine tasks... more Firefighters are exposed to extensive hazardous noise while on the job, both during routine tasks at the station and when responding to calls. However, little is known about firefighters’ occupational noise hazards. This study employed mixed methods, including focus groups, a survey, and audiometric testing, to identify sources of noise in the firefighters’ work environment, determine hearing protective strategies, discern firefighters’ perceptions of occupational noise exposure and impacts to their health, and quantify the prevalence of hearing loss among South Florida firefighters. A total of 6 senior officers served in an expert panel, 12 participated in focus groups, 300 completed the survey, and 214 received audiometric tests. Most firefighters were unaware of the risk and their departments’ policies, and did not participate in hearing protection practices and avoided using hearing protection devices, which they believed impede team communication and situational awareness. Near...
The accurate interpretation of hurricane risk graphics is expected to benefit public decision-mak... more The accurate interpretation of hurricane risk graphics is expected to benefit public decision-making. To investigate public interpretation and suggest improvements to graphical designs, an interdisciplinary, mixed-methods approach is being undertaken. Drawing on a series of focus groups with Miami residents that focused on understanding interpretations of the National Hurricane Center’s (NHC) track forecast cone or “Cone of Uncertainty,” we developed an online survey targeting a much larger sample of Florida residents (n = 2,847). The findings from this survey are the primary focus of this short article. We attempt to answer three questions: 1) What are the most frequent and trusted sources of information that Florida residents use when they learn that a hurricane is coming their way? 2) How accurately are Florida residents able to interpret risk based on the NHC Cone of Uncertainty graphic? 3) What is the relationship, if any, between the number of correct interpretations and incom...
2019 Survey of Florida Residents to Evaluate Public Comprehension of the "Cone of Uncertainty" Graphic
This data set contains results from an online survey targeting a sample of 2,847 Florida resident... more This data set contains results from an online survey targeting a sample of 2,847 Florida residents in 2019. Unlike previous public surveys that focused more on evacuation decisions, forecast usage, and perception of hurricane risk, our approach specifically pays attention to the details of design elements of the forecast graphics with the long-term goal of minimizing misinterpretation of future graphics. The survey comprised 55 mostly multiple-choice and True/False questions, including demographic information and a series of 42 questions aimed at addressing three main research questions. These data are associated with the article: Evans, S.D., Broad, K., Cairo, A., Majumdar, S.J., McNoldy, B.D., Millet, B., & Rauk, L., "An Interdisciplinary Approach to Evaluate Public Comprehension of the "Cone of Uncertainty" Graphic" submitted to BAMS.
Design guidelines for hurricane risk forecast to non-expert users
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Hurricane forecast graphics, such as the cone of uncertainty and the hurricane threat impacts gra... more Hurricane forecast graphics, such as the cone of uncertainty and the hurricane threat impacts graphics, are provided to assist the general public in assessing their risk and in making protective action decisions for an approaching storm. Many researchers have demonstrated that hurricane forecast graphics are often misinterpreted by the general public. Few studies, however, have investigated the impact of design elements of these graphics on interpretations of hurricane risk communication for non-expert users. This study provides design guidelines for improving hurricane risks forecast products based on a literature review.
International Journal of Environmental Research and Public Health
Noise-induced hearing loss (NIHL) is the most prevalent occupational disease in the world and fir... more Noise-induced hearing loss (NIHL) is the most prevalent occupational disease in the world and firefighters are at increased risk of NIHL due to their frequent exposure to hazardous levels of noise during service. Adverse effects of NIHL include acceleration of age-related hearing loss and an increased risk of cognitive decline. A critical challenge in addressing NIHL is the delayed clinical presentation of symptoms and lack of sensitive tools for early detection. To study the early clinical symptoms of NIHL in this high-risk group, we collected hearing function data including behavioral audiometric thresholds and distortion product otoacoustic emissions (DPOAEs) in 176 firefighters during annual physical assessments. Results revealed significant deficits in cochlear outer hair cell function in the presence of normal audiograms. Additionally, 55% of firefighters self-reported changes in hearing, while 20% self-reported concerns about their balance. This study is the first to characte...
Designing a Hybrid Layout for a Five-Key Text Entry
Five-key text entry methods are useful for limited text entry on small devices. They use four dir... more Five-key text entry methods are useful for limited text entry on small devices. They use four directional keys to move a selector over an on-screen keyboard and an Enter key for selection. Although other researchers have described five-key character layouts using alphabetical order and predictive layouts based on digraph frequencies, there is considerable latitude in designing the rest of a comprehensive on-screen keyboard. Furthermore, it might be possible to capitalize on the relative strengths of the alphabetic and predictive layouts by combining them in a hybrid layout. In this paper, we describe the design factors considered and tools used to develop three five-key text-entry techniques: alphabetic, predictive, and hybrid.
Soundtrack design: The impact of music on visual attention and affective responses
Applied Ergonomics, 2021
Through music, film composers attempt to affect the audience's emotions and visual attention;... more Through music, film composers attempt to affect the audience's emotions and visual attention; however, little empirical evidence exists characterizing the mechanisms whereby music affects viewers. We conducted a mixed-design experiment with 60 participants to explore the effect of music on viewers' visual attention and affective responses to a film. Music led to quicker first fixations on film objects and supplied emotional content, increasing positive sentiment for the film's story. However, music did not influence viewers' attitudes to filmed events. Within this context, music has limited impact on attitudes toward filmed events but can accentuate the saliency of film objects and supply emotional information altering viewers' sentiment towards the film. Understanding the mechanisms of music's physiological and behavioral effects can inform content delivery strategies. This study offers insights for composition and production of musical soundtracks for feature-length films, advertising videos, educational videos, and video games.
Soundtrack design: The impact of music on visual attention and affective responses
Applied Ergonomics, 2021
Through music, film composers attempt to affect the audience's emotions and visual attention;... more Through music, film composers attempt to affect the audience's emotions and visual attention; however, little empirical evidence exists characterizing the mechanisms whereby music affects viewers. We conducted a mixed-design experiment with 60 participants to explore the effect of music on viewers' visual attention and affective responses to a film. Music led to quicker first fixations on film objects and supplied emotional content, increasing positive sentiment for the film's story. However, music did not influence viewers' attitudes to filmed events. Within this context, music has limited impact on attitudes toward filmed events but can accentuate the saliency of film objects and supply emotional information altering viewers' sentiment towards the film. Understanding the mechanisms of music's physiological and behavioral effects can inform content delivery strategies. This study offers insights for composition and production of musical soundtracks for feature-length films, advertising videos, educational videos, and video games.
Can We Stop the Spread of False Information on Vaccination? How Online Comments on Vaccination News Affect Readers’ Credibility Assessments and Sharing Behaviors
Science Communication, 2021
This study used a 2 (type of news: fake vs. real) × 2 (presence of negative user comments: yes vs... more This study used a 2 (type of news: fake vs. real) × 2 (presence of negative user comments: yes vs. no) × 2 (presence of positive user comments: yes vs. no) between-subjects experimental design to examine the differences in perceived news credibility and sharing intention between fake news and real news on vaccination. Fake news was found to generate a lower level of perceived credibility than real news, which subsequently decreased news sharing intention. Furthermore, negative user comments significantly lowered perceived news credibility, and this was especially true for real news. However, this adverse effect was found to be mitigated by the presence of positive user comments. The experimental results have important theoretical and practical implications for future research on fake news about health and science.
Can We Stop the Spread of False Information on Vaccination? How Online Comments on Vaccination News Affect Readers’ Credibility Assessments and Sharing Behaviors
Science Communication, 2021
This study used a 2 (type of news: fake vs. real) × 2 (presence of negative user comments: yes vs... more This study used a 2 (type of news: fake vs. real) × 2 (presence of negative user comments: yes vs. no) × 2 (presence of positive user comments: yes vs. no) between-subjects experimental design to examine the differences in perceived news credibility and sharing intention between fake news and real news on vaccination. Fake news was found to generate a lower level of perceived credibility than real news, which subsequently decreased news sharing intention. Furthermore, negative user comments significantly lowered perceived news credibility, and this was especially true for real news. However, this adverse effect was found to be mitigated by the presence of positive user comments. The experimental results have important theoretical and practical implications for future research on fake news about health and science.
Uploads
Papers by Barbara Millet