A LINKED AGGREGATE CODE FOR PROCESSING FACES (REVISED VERSION)
Michael Lyons2020, arXiv:2009.08281
https://doi.org/10.5281/zenodo.4034544visibility
…
description
18 pages
link
1 file
Sign up for access to the world's latest research
checkGet notified about relevant papers
checkSave papers to use in your research
checkJoin the discussion with peers
checkTrack your impact
Abstract
A model of face representation, inspired by the biology of the visual system, is compared to experimental data on the perception of facial similarity. The face representation model uses aggregate primary visual cortex (V1) cell responses topographically linked to a grid covering the face, allowing comparison of shape and texture at corresponding points in two facial images. When a set of relatively similar faces was used as stimuli, this "linked aggregate code" (LAC) predicted human performance in similarity judgment experiments. When faces of perceivable categories were used, dimensions such as apparent 'sex' and 'race' emerged from the LAC model without training. The dimensional structure of the LAC similarity measure for the mixed category task displayed some psychologically plausible features but also highlighted differences between the model and the human similarity judgements. The human judgements exhibited a racial perceptual bias that was not shared by the LAC model. The results suggest that the LAC based similarity measure may offer a fertile starting point for further modelling studies of face representation in higher visual areas, including studies of the development of biases in face perception.
Related papers
Arbitrary category labels can change similarity judgments of human faces
2012
In two experiments, participants were presented with a triad of morphed White and Hispanic faces paired with pseudoword labels. The meanings of these labels were manipulated to represent categorical information about the face. Labels were said to represent either the person's belief, the food s/he ate, the disease s/he had, or the person's last name. The results indicated that categorical information affects our judgments of faces. Information categories such as belief, food, and diseases were particularly strong in modifying the participants' similarity judgment of faces, whereas information characterized with last names of faces were least powerful. Previous research focuses on race face perception being affected primarily by racial indicators or racial information. Our results provide that how we perceptually analyze faces is not confined to obvious racial cues, but by non-racial semantic information as well, suggesting that category-relevant information by itself provides a strong basis for inductive generalization.
Structural aspects of face recognition and the other-race effect
Memory & Cognition, 1994
The other-race effect was examined in a series of experiments and simulations that looked at the relationships among observer ratings of typicality, familiarity, attractiveness, memorability, and the performance variables ofd’ and criterion. Experiment 1 replicated the other-race effect with our Caucasian and Japanese stimuli for both Caucasian and Asian observers. In Experiment 2, we collected ratings from Caucasian observers on the faces used in the recognition task. A Varimax-rotated principal components analysis on the rating and performance data for the Caucasian faces replicated Vokey and Read’s (1992) finding that typicality is composed of two orthogonal components, dissociable via their independent relationships to: (1) attractiveness and familiarity ratings and (2) memorahility ratings. For Japanese faces, however, we fond that typicality was related only to memorahility. Where performance measures were concerned, two additional principal components dominated by criterion and byd’ emerged for Caucasian faces. For the Japanese faces, however, the performance measures ofd’ and criterion merged into a single component that represented a second component of typicality, one orthogonal to thememorability-dominated component. A measure offace representation quality extracted from an autoassociative neural network trained with a majority of Caucasian faces and a minority of Japanese faces was incorporated into the principal components analysis. For both Caucasian and Japanese faces, the neural network measure related both to memorability ratings and to human accuracy measures. Combined, the human data and simulation results indicate that the memorahility component of typicality may be related to small, local, distinctive features, whereas the attractiveness/familiarity component may be more related to the global, shape-based properties of the face.
Quantitative Models of Face Cognition 1 Viewpoint generalization in face recognition: The role of category-specific processes
The statistical structure of a class of objects such as human faces can be exploited to recognize familiar faces from novel viewpoints and under variable illumination conditions. We present computational and psychophysical data concerning the extent to which class-based learning transfers or generalizes within the class of faces. We first examine the computational prerequisite for generalization across views of novel faces, namely, the similarity of different faces to each other. We next describe two computational models which exploit the similarity structure of the class of faces. The performance of these models constrains hypotheses about the nature of face representation in human vision, and supports the notion that human face processing operates in a class-based fashion. Finally, we relate the computational data to well-established findings in the human memory literature concerning the relationship between the typicality and recognizability of faces.
The Measure of Perceived Similarity Between Faces: Old Issues for a New Method
Measuring perceived similarity is an important issue in visual perception of faces, since a measure of the perceived similarity between faces may be used to investigate fundamental tasks like face categorization and recognition. Despite its fundamental role, measuring perceived similarity between faces is not trivial from both a theoretical and methodological point of view. In this paper we present theoretical arguments that undermine the method currently most used to measure perceived similarity between faces in visual perception, and we propose an alternative method. We finally compare the two methods and find some empirical evidence that the proposed method can provide a more reliable evaluation of the perceived similarity between faces.
The nature of face representations in subcortical regions
Neuropsychologia, 2014
Studies examining the neural correlates of face perception in humans have focused almost exclusively on the distributed cortical network of face-selective regions. Recently, however, investigations have also identified subcortical correlates of face perception and the question addressed here concerns the nature of these subcortical face representations. To explore this issue, we presented to participants pairs of images sequentially to the same or to different eyes. Superior performance in the former over latter condition implicates monocular, prestriate portions of the visual system. Over a series of five experiments, we manipulated both lower-level (size, location) as well as higher-level (identity) similarity across the pair of faces. A monocular advantage was observed even when the faces in a pair differed in location and in size, implicating some subcortical invariance across lower-level image properties. A monocular advantage was also observed when the faces in a pair were two different images of the same individual, indicating the engagement of subcortical representations in more abstract, higher-level aspects of face processing. We conclude that subcortical structures of the visual system are involved, perhaps interactively, in multiple aspects of face perception, and not simply in deriving initial coarse representations.
Same-race faces are perceived more holistically than other-race faces
Visual Cognition, 2006
Two routes to face perception: evidence from psychophysics and computational modeling
2009
The aim of this study was to separately analyze the role of featural and configural face representations. Stimuli containing only featural information were created by cutting the faces into their parts and scrambling them. Stimuli only containing configural information were created by blurring the faces. Employing an old-new recognition task, the aim of Experiments 1 and 2 was to investigate whether unfamiliar faces (Exp. 1) or familiar faces (Exp. 2) can be recognized if only featural or configural information is provided. Both scrambled and blurred faces could be recognized above chance level. A further aim of Experiments 1 and 2 was to investigate whether our method of creating configural and featural stimuli is valid. Pre-activation of one form of representation did not facilitate recognition of the other, neither for unfamiliar faces (Exp. 1) nor for familiar faces (Exp. 2). This indicates a high internal validity of our method for creating configural and featural face stimuli. Experiment 3 examined whether features placed in their correct categorical relational position but with distorted metrical distances facilitated recognition of unfamiliar faces. These faces were recognized no better than the scrambled faces in Experiment 1, providing further evidence that facial features are stored independently of configural information. From these results we conclude that both featural and configural information are important to recognize a face and argue for a dual-mode hypothesis of face processing. Using the psychophysical results as motivation, we propose a computational framework that implements featural and configural processing routes using an appearance-based representation based on local features and their spatial relations. In three computational experiments (Experiments 4-6) using the same sets of stimuli, we show how this framework is able to model the psychophysical data.
Own- and other-race categorization of faces by race, gender, and age
Psychonomic Bulletin & Review, 2008
Although face recognition is a well-documented domain of human perceptual expertise, this expertise is not equal across all faces. Particularly relevant to our present study are differences between processing own-race and other-race faces. Two major differences have been documented. The first is the own-race advantage in face identification (labeled other-race effect; ORE), expressed as easier identification of individual faces from one's own race, relative to other-race faces (for reviews, see Meissner & Brigham, 2001; Sporer, 2001). The second is the other-race advantage in race categorization (labeled otherrace advantage; ORA), expressed as faster categorization of other-race than own-race faces by race (Levin, 1996; Valentine & Endo, 1992). Whereas the ORE is well established (e.g., Rhodes, Hayward, & Winkler, 2006; Valentine, 1991), the ORA has received less attention and has not been consistently found (e.g., Blascovich, Wyer, Swart, & Kibler, 1997; for a review, see Sporer, 2001). Yet, from a face perception perspective, the ORA, as well as the ORE, could be explained by the greater experience people usually have with own-race than with other-race faces. According to an influential theoretical framework, faces are represented in memory as points in a multidimensional space where each dimension represents a perceptually relevant face feature (Valentine, 1991). These features are tuned by experience to capture subtle differences between individual faces. Hence, the distance between the repre-1093
Neural and psychological analysis of object and face recognition
1998
A number of behavioral phenomena distinguish the recognition of faces and objects, even when members of the set of objects are highly similar. Because faces have the same parts in approximately the same relations, individuation of faces typically requires specification of the metric variation in a holistic and integral representation of the facial surface. The direct mapping of a hypercolumnlike pattern of activation onto a representation layer that preserves relative spatial filter values in a 2D coordinate space, as proposed by C. von der Malsburg and his associates (Lades et al.
Neural Processing of Other-Race Faces as a Function of Racial Familiarity: A P300 Study
International Journal of Engineering & Technology, 2018
Background: The other-race categorisation advantage (ORCA) is a well-established phenomenon, whereby other-race faces are categorised faster than own race faces. Objectives: This study investigated whether extraverts would demonstrate an ORCA-like effect toward unfamiliar other-race faces and familiar other-race faces in a modified oddball and choice reaction paradigm. Methods: This event-related potential (ERP) study employed a repeated measures experimental design with one independent variable (racial familiarity) and three levels (familiar other-race/Malay faces, unfamiliar other-race/African faces, control group/furniture photos). In the oddball task, African faces and Malay faces were the target stimuli and furniture photos were the standard stimuli. Electroencephalography data (EEG) was collected during the oddball task, from which ERP components were derived. Results: The reaction time (RT) for African and Malay faces were not significantly different. Significant effect of ...
Own-species bias in the representations of monkey and human face categories in the primate temporal lobe
Journal of neurophysiology, 2011
Face categorization is fundamental for social interactions of primates and is crucial for determining conspecific groups and mate choice. Current evidence suggests that faces are processed by a set of well-defined brain areas. What is the fine structure of this representation, and how is it affected by visual experience? Here, we investigated the neural representations of human and monkey face categories using realistic three-dimensional morphed faces that spanned the continuum between the two species. We found an "own-species" bias in the categorical representation of human and monkey faces in the monkey inferior temporal cortex at the level of single neurons as well as in the population response analyzed using a pattern classifier. For monkey and human subjects, we also found consistent psychophysical evidence indicative of an own-species bias in face perception. For both behavioural and neural data, the species boundary was shifted away from the center of the morph continuum, for each species toward their own face category. This shift may reflect visual expertise for members of one's own species and be a signature of greater brain resources assigned to the processing of privileged categories. Such boundary shifts may thus serve as sensitive and robust indicators of encoding strength for categories of interest.
Extracting Human Face Similarity Judgments: Pairs or Triplets?
Journal of Vision, 2016
Two experimental protocols, pairwise rating and triplet ranking, have been commonly used for eliciting perceptual similarity judgments for faces and other objects. However, there has been little systematic comparison of the two methods. Pairwise rating has the advantage of greater precision, but triplet ranking is potentially a cognitive less taxing task, thus resulting in less noisy responses. Here, we introduce several informationtheoretic measures of how useful responses from the two protocols are for the purpose of response prediction and parameter estimation. Using face similarity data collected on Amazon Mechanical Turk, we demonstrate that triplet ranking is significantly better for extracting subject-specific preferences, while the two are comparable when pooling across subjects. While the specific conclusions should be interpreted cautiously, due to the particularly simple Bayesian model for response generation utilized here, the work provides a information-theoretic framework for quantifying how repetitions within and across subjects can help to combat noise in human responses, as well as giving some insight into the nature of similarity representation and response noise in humans. More generally, this work demonstrates that substantial noise and inconsistency corrupt similarity judgments, both within-and across-subjects, with consequent implications for experimental design and data interpretation.
An 'other-race effect' for categorizing faces by sex
Perception, 1996
It is well-known that people recognize faces of their own race more accurately than faces of other races-a phenomenon often referred to as the 'other-race effect'. Using brief presentations of faces, we show a similar effect for the task of discriminating the sex of a face. Specifically, Caucasian observers discriminated male and female Caucasian faces more accurately/efficiently than did Oriental observers, and Oriental observers discriminated male and female Japanese faces more accurately/efficiently than did Caucasian observers. This result indicates that, under suboptimal viewing conditions, the identification of even the most salient of facial characteristics-face sex-is impaired for other-race faces. This finding suggests, also, that the nature and diversity of our experience with faces may affect not only the quality of the face representation for later access by recognition processes, but also the efficiency of a perceptual discrimination process. Intriguingly, too, ...
Race Categorization Modulates Holistic Face Encoding
Cognitive Science, 2007
Recent studies have shown that same-race (SR) faces are processed more holistically than other-race (OR) faces, a difference that may underlie the greater difficulty at recognizing OR than SR faces (the “other-race effect”). This article provides original evidence suggesting that the holistic processing of faces may be sensitive to the observers' racial categorization of the face. In Experiment 1, Caucasian participants performed a face-composite task with Caucasian faces, Asian faces, and racially ambiguous morphed face stimuli. Identical morphed face stimuli were processed more holistically when categorized as SR than as OR faces. Experiment 2 further suggests that this finding was not underlain by strategic or training effects. Overall, these results support the view that one's categorization of a face as belonging to the same or another race plays a critical role in the holistic processing of this face.
The role of skin colour in face recognition
Perception, 2009
People have better memory for faces from their own racial group than for faces from other races. It has been suggested that this own-race recognition advantage depends on an initial categorisation of faces into own and other race based on racial markers, resulting in poorer encoding of individual variations in other-race faces. Here, we used a study^test recognition task with stimuli in which the skin colour of African and Caucasian faces was manipulated to produce four categories representing the cross-section between skin colour and facial features. We show that, despite the notion that skin colour plays a major role in categorising faces into own and other-race faces, its effect on face recognition is minor relative to differences across races in facial features.
The use of faces as stimuli in neuroimaging and psychological experiments: A procedure to standardize stimulus features
Behavior Research Methods, 2009
Contact and other‐race effects in configural and component processing of faces
2009
Other-race faces aregenerally recognized more poorly than own-race faces. Therehas been along-standing interest in the extent to which differences in contact contribute to this other-race effect (ORE). Here, we examined the effect of contact on two distinct aspects of face memory, memoryfor configuration and for components, both of which areb etter for own-race than other-race faces. Configural and component memory werem easured using recognition memoryt ests with intact study faces and blurred (isolates memoryfor configuration) and scrambled (isolates memoryfor components) test faces, respectively.O ur participants werealarge group of ethnically Chinese individuals who had resided in Australia for varying lengths of time,fromafew weeks to 26 years. We found that time in aW estern countrysignificantly (negatively) predicted the size of the ORE for configural, but not component, memory. There was also atrend for earlier age of arrival to predict smaller OREs in configural, but not component, memory. These results suggest that memoryf or configural information in other-race faces improves with experience with such faces. However, as found for recognition memorygenerally,the contact effects were small, indicating that other factors must play as ubstantial role in cross-race differences in face memory.
Category contingent aftereffects for faces of different races, ages and species
Cognition, 2008
Exposure to faces biases perceptions of subsequently viewed faces such that normality judgments of similar faces are increased. Simultaneously inducing such an aftereffect in opposite directions for two groups of faces might indicate discrete responding of the neural populations coding for those groups. Here we show such ''category contingent'' aftereffects following exposure to faces differing in eye-spacing (wide versus narrow) for European versus African faces, adult versus infant faces, and human versus monkey faces. As aftereffects reflect changes in responses of neural populations that code faces, our results may then suggest that functionally distinct neural populations code faces of different ages, races and species and that the human brain potentially contains discrete representations of these categories.
Same faces, different labels: generating the cross-race effect in face memory with social category information.
Memory & Cognition
Recognition of own-race faces is superior to recognition of other-race faces. In the present experiments, we explore the role of top-down social information in the encoding and recognition of racially ambiguous faces. Hispanic and African-American participants studied and were tested on computer-generated, ambiguous-race faces (composed of 50% Hispanic and 50% African- American features; MacLin & Malpass, 2001). In Experiment 1, faces were randomly assigned to two study blocks. In each block, a group label was provided that indicated that those faces belonged to African-American or to Hispanic individuals. Both participant groups exhibited superior memory for faces studied in the block with the own-race label. In Experiment 2, faces were studied in a single block with no labels, but tested in two blocks in which labels were provided. Recognition performance was not influenced by the labeled race at test. Taken together, these results confirm the claim that purely top-down information can yield the well documented cross-race effect in recognition, and additionally suggest that the bias takes place at encoding rather than testing.
Top down processing of faces in human brain: a behavioral study
2009 Proceeding of International Conference on Methods and Models in Computer Science (ICM2CS), 2009
Notwithstanding the extensive research effort has gone into understanding face perception by human brain. The concept of face recognition is established yet is selectively impaired relative to recognition of faces of equivalent difficulty. The objective of present study is to develop a theoretical model and a set of stipulations for understanding and discussing how we distinguish familiar faces, and the relationship between recognition and other aspects of face processing. Top down imagery stimuli of familiar and unfamiliar faces were shown to healthy individuals and were asked to recognize them as quickly and accurately as possible. The stimuli were formulated in such a manner that semantic memory and cognitive training does not play a significant role during the task execution. The responded stages by the subjects were recorded. Results obtained from the nonparametric analysis of the multivariate data recorded indicate that process of structural decoding of unfamiliar faces occurring inside the brain is delayed in comparison to familiar faces. It is speculated that brain structures, which have been associated with face recognition task countenance difficulty while identifying unfamiliar faces. Several distinctive information that we derive from seen faces appear to influence the processing performance of the brain during the task.
Loading Preview
Sorry, preview is currently unavailable. You can download the paper by clicking the button above.