Human eye-to-eye contact is a primary source of social cues and communication. In spite of the bi... more Human eye-to-eye contact is a primary source of social cues and communication. In spite of the biological significance of this interpersonal interaction, the underlying neural processes are not well-understood. This knowledge gap, in part, reflects limitations of conventional neuroimaging methods, including solitary confinement in the bore of a scanner and minimal tolerance of head movement that constrain investigations of natural, two-person interactions. However, these limitations are substantially resolved by recent technical developments in functional near-infrared spectroscopy (fNIRS), a non-invasive spectral absorbance technique that detects changes in blood oxygen levels in the brain by using surface-mounted optical sensors. Functional NIRS is tolerant of limited head motion and enables simultaneous acquisitions of neural signals from two interacting partners in natural conditions. We employ fNIRS to advance a data-driven theoretical framework for two-person neuroscience motivated by the Interactive Brain Hypothesis which proposes that interpersonal interaction between individuals evokes neural mechanisms not engaged during solo, non-interactive, behaviors. Within this context, two specific hypotheses related to eyeto-eye contact, functional specificity and functional synchrony, were tested. The functional specificity hypothesis proposes that eye-to-eye contact engages specialized, within-brain, neural systems; and the functional synchrony hypothesis proposes that eye-to-eye contact engages specialized, across-brain, neural processors that are synchronized between dyads. Signals acquired
It has long been understood that the ventral visual stream of the human brain processes features ... more It has long been understood that the ventral visual stream of the human brain processes features of simulated human faces. Recently, specificity for real and interactive faces has been reported in lateral and dorsal visual streams, raising new questions regarding neural coding of interactive faces and lateral and dorsal face-processing mechanisms. We compare neural activity during two live interactive face-to-face conditions where facial features and tasks remain constant while the social contexts (in-person or on-line conditions) are varied. Current models of face processing do not predict differences in these two conditions as features do not vary. However, behavioral eye-tracking measures showed longer visual dwell times on the real face and also increased arousal as indicated by pupil diameters for the real face condition. Consistent with the behavioral findings, signal increases with functional near infrared spectroscopy, fNIRS, were observed in dorsal-parietal regions for the ...
Background: Social symptomatology quantified by clinical interview (Autism Diagnostic Observation... more Background: Social symptomatology quantified by clinical interview (Autism Diagnostic Observation Schedule, ADOS) and self-report (Social Responsiveness Scale, SRS) indicate symptom severity in autism spectrum disorder (ASD). Reluctance to engage in interpersonal eye contact is a frequently observed behavioral hallmark, though neural bases for these difficulties and relation to symptomatology are not understood. We test the hypothesis that eye contact in ASD activates atypical neural mechanisms that are related to individual differences in symptomatology. Methods: Neural activity represented by hemodynamic signals was acquired by functional near-infrared spectroscopy (fNIRS) during real person-to-person eye contact (confirmed by eye-tracking) for 17 adult ASD (3 female, 14 male) and 19 typically-developed (TD) participants (8 female, 11 male). Assessment of social function was based on ADOS scores for ASD participants and SRS scores for the combined group of ASD and TD participants....
The nexus model of social processing proposes that the right temporal parietal junction (rTPJ) se... more The nexus model of social processing proposes that the right temporal parietal junction (rTPJ) serves as a neural hub for cognitive social functions. We test the hypothesis that the rTPJ is a domain general region including somatosensory social functions. Neuroimaging findings and cross-brain coherence for right- and left-hand handclasps with real vs. simulated hands were consistent with the domain general model.
Robot design to simulate interpersonal social interaction is an active area of research with appl... more Robot design to simulate interpersonal social interaction is an active area of research with applications in therapy and companionship. Neural responses to eye-to-eye contact in humans have recently been employed to determine the neural systems that are active during social interactions. Whether eye-contact with a social robot engages the same neural system remains to be seen. Here, we employ a similar approach to compare human-human and human-robot social interactions. We assume that if human-human and human-robot eye-contact elicit similar neural activity in the human, then the perceptual and cognitive processing is also the same for human and robot. That is, the robot is processed similar to the human. However, if neural effects are different, then perceptual and cognitive processing is assumed to be different. In this study neural activity was compared for human-to-human and human-to-robot conditions using near infrared spectroscopy for neural imaging, and a robot (Maki) with ey...
A novel photonic method for remote monitoring of task‐related hemodynamic changes in human brain ... more A novel photonic method for remote monitoring of task‐related hemodynamic changes in human brain activation is presented. Physiological processes associated with neural activity, such as nano‐vibrations due to blood flow and tissue oxygenation in the brain, are detected by remote sensing of nano‐acoustic vibrations using temporal spatial analysis of defocused self‐interference random patterns. Temporal nanometric changes of the speckle pattern due to visual task‐induced hemodynamic responses were tracked by this method. Reversing visual checkerboard stimulation alternated with rest epochs, and responsive signals were identified in occipital lobe using near‐infrared spectroscopy. Temporal vibrations associated with these hemodynamic response functions were observed using three different approaches: (a) single spot illumination at active and control areas simultaneously, (b) subspots cross‐correlation‐based analysis, and (c) multiwavelength measurement using a magnitude‐squared wavele...
Background: Borderline Personality Disorder (BPD) is associated with sensitivity to signals of in... more Background: Borderline Personality Disorder (BPD) is associated with sensitivity to signals of interpersonal threats and misplaced trust in others. The amygdala, an integral part of the threat evaluation and response network, responds to both fear-and trust-related stimuli in non-clinical samples, and is more sensitive to emotional stimuli in BPD compared to controls. However, it is unknown whether the amygdalar response can account for deficits of trust and elevated sensitivity to interpersonal threat in BPD. Methods: Facial stimuli were presented to 16 medication-free women with BPD and 17 demographically-matched healthy controls (total n = 33). Participants appraised fearfulness or trustworthiness of the stimuli while BOLD fMRI was obtained. Results: Though BPD participants judged stimuli as less trustworthy compared to controls, trustworthiness did not correlate with amygdalar activity in either group. Trustworthiness correlated with prefrontal regional activity in the insula and lateral prefrontal cortex. Prefrontal BOLD activity while appraising trustworthiness was smaller in BPD compared to controls, and the size of the reduction was proportional to each participant's response bias. Conclusions: Neural substrates of trustworthiness appraisal are associated with the lateral prefrontal cortex and insula, not amygdala, suggesting that untrustworthy stimuli do not elicit a subcortical threat response. Current models of BPD and its treatment may need to include a focus on improving impairments in frontally mediated trustworthiness appraisal in addition to amygdala-driven emotional hyper-reactivity.
Obese individuals show altered neural responses to high-calorie food cues. Individuals with binge... more Obese individuals show altered neural responses to high-calorie food cues. Individuals with binge eating [BE], who exhibit heightened impulsivity and emotionality, may show a related but distinct pattern of irregular neural responses. However, few neuroimaging studies have compared BE and non-BE groups. To examine neural responses to food cues in BE, 10 women with BE and 10 women without BE (non-BE) who were matched for obesity (5 obese and 5 lean in each group) underwent fMRI scanning during presentation of visual (picture) and auditory (spoken word) cues representing high energy density (ED) foods, low-ED foods, and non-foods. We then compared regional brain activation in BE vs. non-BE groups for high-ED vs. low-ED foods. To explore differences in functional connectivity, we also compared psychophysiologic interactions [PPI] with dorsal anterior cingulate cortex [dACC] for BE vs. non-BE groups. Region of interest (ROI) analyses revealed that the BE group showed more activation tha...
Background and objective. Visual restoration therapy is a home-based treatment program intended t... more Background and objective. Visual restoration therapy is a home-based treatment program intended to expand visual fields of hemianopic patients through repetitive stimulation of the borderzone adjacent to the blind field. We hypothesized that the training itself would induce visual field location-specific changes in the brain's response to stimuli, a phenomenon demonstrated in animal experiments but never in humans with brain injury. Methods. Six chronic right hemianopic patients underwent functional magnetic resonance imaging (fMRI)—responding to stimuli in the trained visual borderzone versus the nontrained seeing field before and after 1 month of visual restoration therapy. Spatially normalized fMRI time-series data were analyzed in a fixed-effects group analysis comparing blood oxygen level dependent (BOLD) activity in the borderzone versus seeing location at baseline and at 1 month. Percent BOLD change was measured to determine each condition's contribution to the time-b...
Background: The minimally conscious state (MCS) resulting from severe brain damage refers to a su... more Background: The minimally conscious state (MCS) resulting from severe brain damage refers to a subset of patients who demonstrate unequivocal, but intermittent, behavioral evidence of awareness of self or their environment. Although clinical examination may suggest residual cognitive function, neurobiological correlates of putative cognition in MCS have not been demonstrated. Objective: To test the hypothesis that MCS patients retain active cerebral networks that underlie cognitive function even though command following and communication abilities are inconsistent. Methods: fMRI was employed to investigate cortical responses to passive language and tactile stimulation in two male adults with severe brain injuries leading to MCS and in seven healthy volunteers. Results: In the case of the patient language-related tasks, auditory stimulation with personalized narratives elicited cortical activity in the superior and middle temporal gyrus. The healthy volunteers imaged during comparable passive language stimulation demonstrated responses similar to the patients' responses. However, when the narratives were presented as a time-reversed signal, and therefore without linguistic content, the MCS patients demonstrated markedly reduced responses as compared with volunteer subjects, suggesting reduced engagement for "linguistically" meaningless stimuli. Conclusions: The first fMRI maps of cortical activity associated with language processing and tactile stimulation of patients in the minimally conscious state (MCS) are presented. These findings of active cortical networks that serve language functions suggest that some MCS patients may retain widely distributed cortical systems with potential for cognitive and sensory function despite their inability to follow simple instructions or communicate reliably.
& Functional magnetic resonance imaging was employed before and after six native English speakers... more & Functional magnetic resonance imaging was employed before and after six native English speakers completed lexical tone training as part of a program to learn Mandarin as a second language. Language-related areas including Broca's area, Wernicke's area, auditory cortex, and supplementary motor regions were active in all subjects before and after training and did not vary in average location. Across all subjects, improvements in performance were associated with an increase in the spatial extent of activation in left superior temporal gyrus (Brodmann's area 22, putative Wernicke's area), the emergence of activity in adjacent Brodmann's area 42, and the emergence of activity in right inferior frontal gyrus (Brodmann's area 44), a homologue of putative Broca's area. These findings demonstrate a form of enrichment plasticity in which the early cortical effects of learning a tone-based second language involve both expansion of preexisting language-related areas and recruitment of additional cortical regions specialized for functions similar to the new language functions. &
Objective: Insecure attachment has been linked to depression and to outcome in psychotherapy.. Th... more Objective: Insecure attachment has been linked to depression and to outcome in psychotherapy.. The neural mechanisms subserving the relationship between attachment security and depression are not well understood. We examine women's brain activity in response to early and late attachment figure viewing. Methods: Twenty-eight women, half depressed, viewed images of their mother, a female friend, and female strangers during fMRI scanning. The effects of depression and insecure attachment were determined with whole-brain multiple linear regression of blood-oxygen-level-dependent (BOLD) response against subjects' Beck Depression Inventory (BDI) and Adult Attachment Interview (AAI) coherence of mind scores. Interaction effects were analyzed with ANOVA. Results: For early attachment (Mother-Friend contrast), depression scores correlated with activation of cortical and sub-cortical components of cortico-striato-thalamic circuits implicated in the modulation of affect, while attachme...
Pairs of participants mutually communicated (or not) biographical information to each other. By c... more Pairs of participants mutually communicated (or not) biographical information to each other. By combining simultaneous eye-tracking, face-tracking and functional near-infrared spectroscopy, we examined how this mutual sharing of information modulates social signalling and brain activity. When biographical information was disclosed, participants directed more eye gaze to the face of the partner and presented more facial displays. We also found that spontaneous production and observation of facial displays was associated with activity in the left SMG and right dlPFC/IFG, respectively. Moreover, mutual information-sharing increased activity in bilateral TPJ and left dlPFC, as well as cross-brain synchrony between right TPJ and left dlPFC. This suggests that a complex longrange mechanism is recruited during information-sharing. These multimodal findings support the second-person neuroscience hypothesis, which postulates that communicative interactions activate additional neurocognitive mechanisms to those engaged in non-interactive situations. They further advance our understanding of which neurocognitive mechanisms underlie communicative interactions.
Although the neural systems that underlie spoken language are well-known, how they adapt to evolv... more Although the neural systems that underlie spoken language are well-known, how they adapt to evolving social cues during natural conversations remains an unanswered question. In this work we investigate the neural correlates of face-to-face conversations between two individuals using functional near infrared spectroscopy (fNIRS) and acoustical analyses of concurrent audio recordings. Nineteen pairs of healthy adults engaged in live discussions on two controversial topics where their opinions were either in agreement or disagreement. Participants were matched according to their a priori opinions on these topics as assessed by questionnaire. Acoustic measures of the recorded speech including the fundamental frequency range, median fundamental frequency, syllable rate, and acoustic energy were elevated during disagreement relative to agreement. Consistent with both the a priori opinion ratings and the acoustic findings, neural activity associated with long-range functional networks, rat...
An emerging theoretical framework suggests that neural functions associated with stereotyping and... more An emerging theoretical framework suggests that neural functions associated with stereotyping and prejudice are associated with frontal lobe networks. Using a novel neuroimaging technique, functional near-infrared spectroscopy (fNIRS), during a face-to-face live communication paradigm, we explore an extension of this model to include live dynamic interactions. Neural activations were compared for dyads of similar and dissimilar socioeconomic backgrounds. The socioeconomic status of each participant was based on education and income levels. Both groups of dyads engaged in pro-social dialectic discourse during acquisition of hemodynamic signals. Post-scan questionnaires confirmed increased anxiety and effort for high-disparity dyads. Consistent with the frontal lobe hypothesis, left dorsolateral pre-frontal cortex (DLPFC), frontopolar area and pars triangularis were more active during speech dialogue in high than in low-disparity groups. Further, frontal lobe signals were more synchro...
Significance: With the increasing popularity of functional near-infrared spectroscopy (fNIRS), th... more Significance: With the increasing popularity of functional near-infrared spectroscopy (fNIRS), the need to determine localization of the source and nature of the signals has grown. Aim: We compare strategies for removal of non-neural signals for a finger-thumb tapping task, which shows responses in contralateral motor cortex and a visual checkerboard viewing task that produces activity within the occipital lobe. Approach: We compare temporal regression strategies using short-channel separation to a spatial principal component (PC) filter that removes global signals present in all channels. For short-channel temporal regression, we compare non-neural signal removal using first and combined first and second PCs from a broad distribution of short channels to limited distribution on the forehead. Results: Temporal regression of non-neural information from broadly distributed short channels did not differ from forehead-only distribution. Spatial PC filtering provides results similar to short-channel separation using the temporal domain. Utilizing both first and second PCs from short channels removes additional non-neural information. Conclusions: We conclude that short-channel information in the temporal domain and spatial domain regression filtering methods remove similar non-neural components represented in scalp hemodynamics from fNIRS signals and that either technique is sufficient to remove non-neural components.
Significance: The expanding field of human social interaction is enabled by functional nearinfrar... more Significance: The expanding field of human social interaction is enabled by functional nearinfrared spectroscopy (fNIRS) that acquires hemodynamic signals during live two-person interactions. These advances call for development of methods to quantify interactive processes. Aim: Wavelet coherence analysis has been applied to cross-brain neural coupling. However, fNIRS-specific computations have not been explored. This investigation determines the effects of global mean removal, wavelet equation, and choice of oxyhemoglobin versus deoxyhemoglobin signals. Approach: We compare signals with a known coherence with acquired signals to determine optimal computational approaches. The known coherence was calculated using three visual stimulation sequences of a contrast-reversing checkerboard convolved with the canonical hemodynamic response function. This standard was compared with acquired human fNIRS responses within visual cortex using the same sequences. Results: Observed coherence was consistent with known coherence with highest correlations within the wavelength range between 10 and 20 s. Removal of the global mean improved the correlation irrespective of the specific equation for wavelet coherence, and the oxyhemoglobin signal was associated with a marginal correlation advantage. Conclusions: These findings provide both methodological and computational guidance that enhances the validity and interpretability of wavelet coherence analysis for fNIRS signals acquired during live social interactions.
Face-specific neural processes in the human brain have been localized to multiple anatomical stru... more Face-specific neural processes in the human brain have been localized to multiple anatomical structures and associated with diverse and dynamic social functions. The question of how various face-related systems and functions may be bound together remains an active area of investigation. We hypothesize that face processing may be associated with specific frequency band oscillations that serve to integrate distributed face processing systems. Using a multimodal imaging approach, including electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS), simultaneous signals were acquired during face and object picture viewing. As expected for face processing, hemodynamic activity in the right occipital face area (OFA) increased during face viewing compared to object viewing, and in a subset of participants, the expected N170 EEG response was observed for faces. Based on recently reported associations between the theta band and visual processing, we hypothesized that increased hemodynamic activity in a face processing area would also be associated with greater theta-band activity originating in the same area. Consistent with our hypothesis, theta-band oscillations were also localized to the right OFA for faces, whereas alpha-and beta-band oscillations were not. Together, these findings suggest that theta-band oscillations originating in the OFA may be part of the distributed face-specific processing mechanism.
Human eye-to-eye contact is a primary source of social cues and communication. In spite of the bi... more Human eye-to-eye contact is a primary source of social cues and communication. In spite of the biological significance of this interpersonal interaction, the underlying neural processes are not well-understood. This knowledge gap, in part, reflects limitations of conventional neuroimaging methods, including solitary confinement in the bore of a scanner and minimal tolerance of head movement that constrain investigations of natural, two-person interactions. However, these limitations are substantially resolved by recent technical developments in functional near-infrared spectroscopy (fNIRS), a non-invasive spectral absorbance technique that detects changes in blood oxygen levels in the brain by using surface-mounted optical sensors. Functional NIRS is tolerant of limited head motion and enables simultaneous acquisitions of neural signals from two interacting partners in natural conditions. We employ fNIRS to advance a data-driven theoretical framework for two-person neuroscience motivated by the Interactive Brain Hypothesis which proposes that interpersonal interaction between individuals evokes neural mechanisms not engaged during solo, non-interactive, behaviors. Within this context, two specific hypotheses related to eyeto-eye contact, functional specificity and functional synchrony, were tested. The functional specificity hypothesis proposes that eye-to-eye contact engages specialized, within-brain, neural systems; and the functional synchrony hypothesis proposes that eye-to-eye contact engages specialized, across-brain, neural processors that are synchronized between dyads. Signals acquired
It has long been understood that the ventral visual stream of the human brain processes features ... more It has long been understood that the ventral visual stream of the human brain processes features of simulated human faces. Recently, specificity for real and interactive faces has been reported in lateral and dorsal visual streams, raising new questions regarding neural coding of interactive faces and lateral and dorsal face-processing mechanisms. We compare neural activity during two live interactive face-to-face conditions where facial features and tasks remain constant while the social contexts (in-person or on-line conditions) are varied. Current models of face processing do not predict differences in these two conditions as features do not vary. However, behavioral eye-tracking measures showed longer visual dwell times on the real face and also increased arousal as indicated by pupil diameters for the real face condition. Consistent with the behavioral findings, signal increases with functional near infrared spectroscopy, fNIRS, were observed in dorsal-parietal regions for the ...
Background: Social symptomatology quantified by clinical interview (Autism Diagnostic Observation... more Background: Social symptomatology quantified by clinical interview (Autism Diagnostic Observation Schedule, ADOS) and self-report (Social Responsiveness Scale, SRS) indicate symptom severity in autism spectrum disorder (ASD). Reluctance to engage in interpersonal eye contact is a frequently observed behavioral hallmark, though neural bases for these difficulties and relation to symptomatology are not understood. We test the hypothesis that eye contact in ASD activates atypical neural mechanisms that are related to individual differences in symptomatology. Methods: Neural activity represented by hemodynamic signals was acquired by functional near-infrared spectroscopy (fNIRS) during real person-to-person eye contact (confirmed by eye-tracking) for 17 adult ASD (3 female, 14 male) and 19 typically-developed (TD) participants (8 female, 11 male). Assessment of social function was based on ADOS scores for ASD participants and SRS scores for the combined group of ASD and TD participants....
The nexus model of social processing proposes that the right temporal parietal junction (rTPJ) se... more The nexus model of social processing proposes that the right temporal parietal junction (rTPJ) serves as a neural hub for cognitive social functions. We test the hypothesis that the rTPJ is a domain general region including somatosensory social functions. Neuroimaging findings and cross-brain coherence for right- and left-hand handclasps with real vs. simulated hands were consistent with the domain general model.
Robot design to simulate interpersonal social interaction is an active area of research with appl... more Robot design to simulate interpersonal social interaction is an active area of research with applications in therapy and companionship. Neural responses to eye-to-eye contact in humans have recently been employed to determine the neural systems that are active during social interactions. Whether eye-contact with a social robot engages the same neural system remains to be seen. Here, we employ a similar approach to compare human-human and human-robot social interactions. We assume that if human-human and human-robot eye-contact elicit similar neural activity in the human, then the perceptual and cognitive processing is also the same for human and robot. That is, the robot is processed similar to the human. However, if neural effects are different, then perceptual and cognitive processing is assumed to be different. In this study neural activity was compared for human-to-human and human-to-robot conditions using near infrared spectroscopy for neural imaging, and a robot (Maki) with ey...
A novel photonic method for remote monitoring of task‐related hemodynamic changes in human brain ... more A novel photonic method for remote monitoring of task‐related hemodynamic changes in human brain activation is presented. Physiological processes associated with neural activity, such as nano‐vibrations due to blood flow and tissue oxygenation in the brain, are detected by remote sensing of nano‐acoustic vibrations using temporal spatial analysis of defocused self‐interference random patterns. Temporal nanometric changes of the speckle pattern due to visual task‐induced hemodynamic responses were tracked by this method. Reversing visual checkerboard stimulation alternated with rest epochs, and responsive signals were identified in occipital lobe using near‐infrared spectroscopy. Temporal vibrations associated with these hemodynamic response functions were observed using three different approaches: (a) single spot illumination at active and control areas simultaneously, (b) subspots cross‐correlation‐based analysis, and (c) multiwavelength measurement using a magnitude‐squared wavele...
Background: Borderline Personality Disorder (BPD) is associated with sensitivity to signals of in... more Background: Borderline Personality Disorder (BPD) is associated with sensitivity to signals of interpersonal threats and misplaced trust in others. The amygdala, an integral part of the threat evaluation and response network, responds to both fear-and trust-related stimuli in non-clinical samples, and is more sensitive to emotional stimuli in BPD compared to controls. However, it is unknown whether the amygdalar response can account for deficits of trust and elevated sensitivity to interpersonal threat in BPD. Methods: Facial stimuli were presented to 16 medication-free women with BPD and 17 demographically-matched healthy controls (total n = 33). Participants appraised fearfulness or trustworthiness of the stimuli while BOLD fMRI was obtained. Results: Though BPD participants judged stimuli as less trustworthy compared to controls, trustworthiness did not correlate with amygdalar activity in either group. Trustworthiness correlated with prefrontal regional activity in the insula and lateral prefrontal cortex. Prefrontal BOLD activity while appraising trustworthiness was smaller in BPD compared to controls, and the size of the reduction was proportional to each participant's response bias. Conclusions: Neural substrates of trustworthiness appraisal are associated with the lateral prefrontal cortex and insula, not amygdala, suggesting that untrustworthy stimuli do not elicit a subcortical threat response. Current models of BPD and its treatment may need to include a focus on improving impairments in frontally mediated trustworthiness appraisal in addition to amygdala-driven emotional hyper-reactivity.
Obese individuals show altered neural responses to high-calorie food cues. Individuals with binge... more Obese individuals show altered neural responses to high-calorie food cues. Individuals with binge eating [BE], who exhibit heightened impulsivity and emotionality, may show a related but distinct pattern of irregular neural responses. However, few neuroimaging studies have compared BE and non-BE groups. To examine neural responses to food cues in BE, 10 women with BE and 10 women without BE (non-BE) who were matched for obesity (5 obese and 5 lean in each group) underwent fMRI scanning during presentation of visual (picture) and auditory (spoken word) cues representing high energy density (ED) foods, low-ED foods, and non-foods. We then compared regional brain activation in BE vs. non-BE groups for high-ED vs. low-ED foods. To explore differences in functional connectivity, we also compared psychophysiologic interactions [PPI] with dorsal anterior cingulate cortex [dACC] for BE vs. non-BE groups. Region of interest (ROI) analyses revealed that the BE group showed more activation tha...
Background and objective. Visual restoration therapy is a home-based treatment program intended t... more Background and objective. Visual restoration therapy is a home-based treatment program intended to expand visual fields of hemianopic patients through repetitive stimulation of the borderzone adjacent to the blind field. We hypothesized that the training itself would induce visual field location-specific changes in the brain's response to stimuli, a phenomenon demonstrated in animal experiments but never in humans with brain injury. Methods. Six chronic right hemianopic patients underwent functional magnetic resonance imaging (fMRI)—responding to stimuli in the trained visual borderzone versus the nontrained seeing field before and after 1 month of visual restoration therapy. Spatially normalized fMRI time-series data were analyzed in a fixed-effects group analysis comparing blood oxygen level dependent (BOLD) activity in the borderzone versus seeing location at baseline and at 1 month. Percent BOLD change was measured to determine each condition's contribution to the time-b...
Background: The minimally conscious state (MCS) resulting from severe brain damage refers to a su... more Background: The minimally conscious state (MCS) resulting from severe brain damage refers to a subset of patients who demonstrate unequivocal, but intermittent, behavioral evidence of awareness of self or their environment. Although clinical examination may suggest residual cognitive function, neurobiological correlates of putative cognition in MCS have not been demonstrated. Objective: To test the hypothesis that MCS patients retain active cerebral networks that underlie cognitive function even though command following and communication abilities are inconsistent. Methods: fMRI was employed to investigate cortical responses to passive language and tactile stimulation in two male adults with severe brain injuries leading to MCS and in seven healthy volunteers. Results: In the case of the patient language-related tasks, auditory stimulation with personalized narratives elicited cortical activity in the superior and middle temporal gyrus. The healthy volunteers imaged during comparable passive language stimulation demonstrated responses similar to the patients' responses. However, when the narratives were presented as a time-reversed signal, and therefore without linguistic content, the MCS patients demonstrated markedly reduced responses as compared with volunteer subjects, suggesting reduced engagement for "linguistically" meaningless stimuli. Conclusions: The first fMRI maps of cortical activity associated with language processing and tactile stimulation of patients in the minimally conscious state (MCS) are presented. These findings of active cortical networks that serve language functions suggest that some MCS patients may retain widely distributed cortical systems with potential for cognitive and sensory function despite their inability to follow simple instructions or communicate reliably.
& Functional magnetic resonance imaging was employed before and after six native English speakers... more & Functional magnetic resonance imaging was employed before and after six native English speakers completed lexical tone training as part of a program to learn Mandarin as a second language. Language-related areas including Broca's area, Wernicke's area, auditory cortex, and supplementary motor regions were active in all subjects before and after training and did not vary in average location. Across all subjects, improvements in performance were associated with an increase in the spatial extent of activation in left superior temporal gyrus (Brodmann's area 22, putative Wernicke's area), the emergence of activity in adjacent Brodmann's area 42, and the emergence of activity in right inferior frontal gyrus (Brodmann's area 44), a homologue of putative Broca's area. These findings demonstrate a form of enrichment plasticity in which the early cortical effects of learning a tone-based second language involve both expansion of preexisting language-related areas and recruitment of additional cortical regions specialized for functions similar to the new language functions. &
Objective: Insecure attachment has been linked to depression and to outcome in psychotherapy.. Th... more Objective: Insecure attachment has been linked to depression and to outcome in psychotherapy.. The neural mechanisms subserving the relationship between attachment security and depression are not well understood. We examine women's brain activity in response to early and late attachment figure viewing. Methods: Twenty-eight women, half depressed, viewed images of their mother, a female friend, and female strangers during fMRI scanning. The effects of depression and insecure attachment were determined with whole-brain multiple linear regression of blood-oxygen-level-dependent (BOLD) response against subjects' Beck Depression Inventory (BDI) and Adult Attachment Interview (AAI) coherence of mind scores. Interaction effects were analyzed with ANOVA. Results: For early attachment (Mother-Friend contrast), depression scores correlated with activation of cortical and sub-cortical components of cortico-striato-thalamic circuits implicated in the modulation of affect, while attachme...
Pairs of participants mutually communicated (or not) biographical information to each other. By c... more Pairs of participants mutually communicated (or not) biographical information to each other. By combining simultaneous eye-tracking, face-tracking and functional near-infrared spectroscopy, we examined how this mutual sharing of information modulates social signalling and brain activity. When biographical information was disclosed, participants directed more eye gaze to the face of the partner and presented more facial displays. We also found that spontaneous production and observation of facial displays was associated with activity in the left SMG and right dlPFC/IFG, respectively. Moreover, mutual information-sharing increased activity in bilateral TPJ and left dlPFC, as well as cross-brain synchrony between right TPJ and left dlPFC. This suggests that a complex longrange mechanism is recruited during information-sharing. These multimodal findings support the second-person neuroscience hypothesis, which postulates that communicative interactions activate additional neurocognitive mechanisms to those engaged in non-interactive situations. They further advance our understanding of which neurocognitive mechanisms underlie communicative interactions.
Although the neural systems that underlie spoken language are well-known, how they adapt to evolv... more Although the neural systems that underlie spoken language are well-known, how they adapt to evolving social cues during natural conversations remains an unanswered question. In this work we investigate the neural correlates of face-to-face conversations between two individuals using functional near infrared spectroscopy (fNIRS) and acoustical analyses of concurrent audio recordings. Nineteen pairs of healthy adults engaged in live discussions on two controversial topics where their opinions were either in agreement or disagreement. Participants were matched according to their a priori opinions on these topics as assessed by questionnaire. Acoustic measures of the recorded speech including the fundamental frequency range, median fundamental frequency, syllable rate, and acoustic energy were elevated during disagreement relative to agreement. Consistent with both the a priori opinion ratings and the acoustic findings, neural activity associated with long-range functional networks, rat...
An emerging theoretical framework suggests that neural functions associated with stereotyping and... more An emerging theoretical framework suggests that neural functions associated with stereotyping and prejudice are associated with frontal lobe networks. Using a novel neuroimaging technique, functional near-infrared spectroscopy (fNIRS), during a face-to-face live communication paradigm, we explore an extension of this model to include live dynamic interactions. Neural activations were compared for dyads of similar and dissimilar socioeconomic backgrounds. The socioeconomic status of each participant was based on education and income levels. Both groups of dyads engaged in pro-social dialectic discourse during acquisition of hemodynamic signals. Post-scan questionnaires confirmed increased anxiety and effort for high-disparity dyads. Consistent with the frontal lobe hypothesis, left dorsolateral pre-frontal cortex (DLPFC), frontopolar area and pars triangularis were more active during speech dialogue in high than in low-disparity groups. Further, frontal lobe signals were more synchro...
Significance: With the increasing popularity of functional near-infrared spectroscopy (fNIRS), th... more Significance: With the increasing popularity of functional near-infrared spectroscopy (fNIRS), the need to determine localization of the source and nature of the signals has grown. Aim: We compare strategies for removal of non-neural signals for a finger-thumb tapping task, which shows responses in contralateral motor cortex and a visual checkerboard viewing task that produces activity within the occipital lobe. Approach: We compare temporal regression strategies using short-channel separation to a spatial principal component (PC) filter that removes global signals present in all channels. For short-channel temporal regression, we compare non-neural signal removal using first and combined first and second PCs from a broad distribution of short channels to limited distribution on the forehead. Results: Temporal regression of non-neural information from broadly distributed short channels did not differ from forehead-only distribution. Spatial PC filtering provides results similar to short-channel separation using the temporal domain. Utilizing both first and second PCs from short channels removes additional non-neural information. Conclusions: We conclude that short-channel information in the temporal domain and spatial domain regression filtering methods remove similar non-neural components represented in scalp hemodynamics from fNIRS signals and that either technique is sufficient to remove non-neural components.
Significance: The expanding field of human social interaction is enabled by functional nearinfrar... more Significance: The expanding field of human social interaction is enabled by functional nearinfrared spectroscopy (fNIRS) that acquires hemodynamic signals during live two-person interactions. These advances call for development of methods to quantify interactive processes. Aim: Wavelet coherence analysis has been applied to cross-brain neural coupling. However, fNIRS-specific computations have not been explored. This investigation determines the effects of global mean removal, wavelet equation, and choice of oxyhemoglobin versus deoxyhemoglobin signals. Approach: We compare signals with a known coherence with acquired signals to determine optimal computational approaches. The known coherence was calculated using three visual stimulation sequences of a contrast-reversing checkerboard convolved with the canonical hemodynamic response function. This standard was compared with acquired human fNIRS responses within visual cortex using the same sequences. Results: Observed coherence was consistent with known coherence with highest correlations within the wavelength range between 10 and 20 s. Removal of the global mean improved the correlation irrespective of the specific equation for wavelet coherence, and the oxyhemoglobin signal was associated with a marginal correlation advantage. Conclusions: These findings provide both methodological and computational guidance that enhances the validity and interpretability of wavelet coherence analysis for fNIRS signals acquired during live social interactions.
Face-specific neural processes in the human brain have been localized to multiple anatomical stru... more Face-specific neural processes in the human brain have been localized to multiple anatomical structures and associated with diverse and dynamic social functions. The question of how various face-related systems and functions may be bound together remains an active area of investigation. We hypothesize that face processing may be associated with specific frequency band oscillations that serve to integrate distributed face processing systems. Using a multimodal imaging approach, including electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS), simultaneous signals were acquired during face and object picture viewing. As expected for face processing, hemodynamic activity in the right occipital face area (OFA) increased during face viewing compared to object viewing, and in a subset of participants, the expected N170 EEG response was observed for faces. Based on recently reported associations between the theta band and visual processing, we hypothesized that increased hemodynamic activity in a face processing area would also be associated with greater theta-band activity originating in the same area. Consistent with our hypothesis, theta-band oscillations were also localized to the right OFA for faces, whereas alpha-and beta-band oscillations were not. Together, these findings suggest that theta-band oscillations originating in the OFA may be part of the distributed face-specific processing mechanism.
Uploads
Papers by Joy Hirsch