Abstract
People could extract mean expression of multiple faces pretty precisely. However, the mechanism of how we make such ensemble representation was far from clear. This study aimed to explore how faces in the foveal and extrafoveal vision contribute to the ensemble representation and whether the emotion of faces modulates the contribution. In the experiment, the expressions of foveal and extrafoveal faces were independently manipulated by changing the ratio of happy vs. angry faces. The participants reported whether the overall emotion was positive or negative. The results showed that faces in the foveal vision were given more weight than those in the extrafoveal vision in ensemble emotional representation. In addition, the ensemble perception was more accurate when faces in the extrafoveal vision were positive. These findings have great implications for the emotional design in interactive systems, especially when there are multiple users or multiple avatars presented on the screen.
Chapter PDF
Similar content being viewed by others
References
Haberman, J., Harp, T., Whitney, D.: Averaging Facial Expression over Time. Journal of Vision 9(11), 1–13 (2009)
Haberman, J., Whitney, D.: Rapid Extraction of Mean Emotion and Gender from Sets of Faces. Current Biology 17(17), R751–R753 (2007)
Haberman, J., Whitney, D.: Seeing the Mean: Ensemble Coding for Sets of Faces. Journal of Experimental Psychology: Human Perception and Performance 35(3), 718–734 (2009)
Yang, J.W., Yoon, K.L., Chong, S.C., Oh, K.J.: Accurate but Pathological: Social Anxiety and Ensemble Coding of Emotion. Cognitive Therapy and Research 37, 572–578 (2013)
Atkinson, A.P., Smithson, H.E.: Distinct Contributions to Facial Emotion Perception of Foveated versus Nonfoveated Facial Features. Emotion Review 5(1), 30–35 (2013)
Bayle, D.J., Schoendorff, B., Henaff, M.A., Krolak-Salmon, P.: Emotion Facial Detection in the Peripheral Visual Field. PLoS ONE 6(6), e21584 (2011)
Rigulot, S., Delplanque, S., Despretz, P., Defoort-Dhellemmes, S., Honore, J., Sequeira, H.: A Spatiotemporal Analysis of Early ERP Responses. Brain Topography 20, 216–223 (2008)
Rigulot, S., D’Hondt, F., Honore, J., Sequeira, H.: Implicit Emotional Processing in Peripheral Vision: Behavioral and Neural Evidence. Neuropsychologia 50, 2887–2896 (2012)
Robson, J.G., Graham, N.: Probability Summation and Regional Variation in Contrast Sensitivity across the Visual Field. Vision Research 21, 409–418 (1981)
Dacey, D.M., Petersen, M.R.: Dendritic Field Size and Morphology of Midget and Parasol Ganglion Cells of the Human Retina. Proceedings of the National Academy of Sciences 89, 9666–9670 (1992)
Livingston, M.S., Hubel, D.H.: Psychophysical Evidence for Separate Channels for the Prception of Form, Color, Movement, and Depth. Journal of Neuroscience 7, 3416–3468 (1987)
Schiller, P.H., Logothetis, N.K., Charles, E.R.: Functions of The Colour-opponent and Broad-band Channels of the Visual System. Nature 343, 68–70 (1990)
Fielding, K.M., Carvey, R.J., Liu, C.H.: Singular or Summary: Averaging of Facial Expression in Sets is Modulated by Eccentricity. Journal of Vision 13(9), 588 (2013)
Calvo, M.G., Nummenmaa, L., Avero, P.: Recognition Advantage of Happy Faces in Extrafoveal Vision: Featural and Affective Processing. Visual Cognition 18, 1274–1297 (2010)
Reingold, E.M., Loschky, L.C., McConkie, G.W., Stampe, D.M.: Gaze-contingent Multi-resolutional Displays: An Integrative Review. Human Factors 45, 307–328 (2003)
Goren, D., Wilson, H.R.: Quantifying Facial Expression Recognition across Viewing Conditions. Vision Research 46, 1253–1262 (2006)
Calvo, M.G., Nummenmaa, L.: Eye-movement Assessment of the Time Course in Facial Expression Recognition: Neurophysiological Implications. Cognitive, Affective & Behavioral Neuroscience 9(4), 398–411 (2009)
Pourtois, G., Grandjean, D., Sander, D., Vuilleumier, P.: Electrophysiological Correlates of Rapid Spatial Orienting towards Fearful Faces. Cerebral Cortex 14, 619–633 (2004)
Vuilleumier, P., Schwartz, S.: Emotional Facial Expressions Capture Attention. Neurology 56, 153–158 (2001)
Yin, L., Wei, X., Sun, Y., Wang, J., Rosato, M.J.: A 3D facial Expression Database for Facial Behavior Research. In: 7th IEEE International Conference on Automatic Face and Gesture Recognition (FGR 2006), pp. 211–216. IEEE Press, Southampton (2006)
Bex, P.J., Makous, W.: Spatial Frequency, Phase, and the Contrast of Natural Images. Journal of the Optical Society of America 19, 1096–1106 (2002)
Riordan-Eva, P.: Anatomy & Embryology of the Eye. In: Riordan-Eva, P., Cunningham, E.T. (eds.) Vaughan & Asbury’s General Ophthalmology, 18th edn., p. 13. McGraw-Hill Medical (2011)
Rayner, K.: Eye Movements in Reading and Information Processing: 20Years of Research. Psychological Bulletin 124, 372–422 (1998)
de Fockert, J.W., Marchant, A.P.: Attention Modulates Set Representation by Statistical Properties. Perception & Psychophysics 70(5), 789–794 (2008)
Haberman, J., Whitney, D.: The Visual System Discounts Emotional Deviants When Extracting Average Expression. Attention, Perception, & Psychophysics 72(7), 1825–1838 (2010)
Wolfe, B., Kosovicheva, A.A., Leib, A.Y., Whitney, D.: Beyond Fixation: Ensemble Coding and Eye Movements. Journal of Vision 13(9), 710 (2013)
Koster, E.H.W., Crombez, G., Verschuere, B., DeHouwer, J.: Selective Attention to Threat in the Dot Probe Paradigm: Differentiating Vigilance and Difficulty to Disengage. Behaviour Research and Therapy 42(10), 1183–1192 (2004)
Bar-Haim, Y., Lamy, D., Pergamin, L., Bakermans-Kranenburg, M.J., van IJzendoorn, M.H.: Threat-related Attentional Bias in Anxious and Nonanxious Individuals: A Meta-Analytic Study. Psychological Bulletin 133(1), 1–24 (2004)
Fox, E., Russo, R., Bowles, R., Dutton, K.: Do Threatening Stimuli Draw or Hold Visual Attention in Subclinical Anxiety? Journal of Experimental Psychology: General 130(4), 681 (2001)
Luck, S.J., Vogel, E.K.: The Capacity of Visual Working Memory for Features and Conjunctions. Nature 390(6657), 279–281 (1997)
Scholl, B.J., Pylyshyn, Z.W.: Tracking Multiple Items through Occlusion: Clues to Visual Objecthood. Cognitive Psychology 38(2), 259–290 (1999)
Haberman, J., Whitney, D.: Ensemble Perception: Summarizing the Scene and Broadening the Limits of Visual Processing. Chapter to Appear in an Edited Volume. A Festschrift in Honor of Anne Treisman (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Ji, L., Chen, W., Fu, X. (2014). Different Roles of Foveal and Extrafoveal Vision in Ensemble Representation for Facial Expressions. In: Harris, D. (eds) Engineering Psychology and Cognitive Ergonomics. EPCE 2014. Lecture Notes in Computer Science(), vol 8532. Springer, Cham. https://doi.org/10.1007/978-3-319-07515-0_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-07515-0_17
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07514-3
Online ISBN: 978-3-319-07515-0
eBook Packages: Computer ScienceComputer Science (R0)