用户名: 密码: 验证码:
面部表情信息上下不对称性的研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
本研究旨在探索不同情绪类型面部情绪的识别水平,不同情绪类型面部表情识别中情绪信息上半脸与下半脸的不对称性以及不同情绪类型面部表情识别的眼动特征。研究运用JACFEEZ面部表情标准图片和对该面部表情标准图片进行遮盖处理而形成的上、下半脸面部表情图片包括愤怒、不屑、厌恶、恐惧、高兴、悲伤、惊奇面部表情,进行了一系列的研究,本研究包括三个实验,均采用匹配任务即迫选标签任务,要求被试对呈现的面部表情标准图片进行情绪类型判断,指出是以下7种情绪中的哪一个:愤怒、不屑、厌恶、恐惧、高兴、悲伤、惊奇。其中实验一和实验三采用不同情绪类型JACFEEZ面部表情标准图片,实验二采用对JACFEEZ面部表情标准图片遮盖处理形成的上、下半脸面部表情标准图片,获得结果如下:
     实验一考察面部表情识别的情绪类型效应。通过分析被试对不同情绪类型JACFEEZ面部表情标准图片的识别成绩,结果发现,面部表情识别的情绪类型主效应显著,不同情绪类型的面部表情识别存在显著差异,高兴面部表情比其他面部表情能更好地被识别。
     实验二探讨面部表情信息的上下不对称性。通过分析被试对经处理形成的上、下面部表情标准图片的识别成绩,结果发现,面部部位与情绪类型交互作用显著,被试对不同情绪类型上、下面部进行的情绪识别存在差异。对于悲伤、惊奇情绪的识别更多的依赖于面部上半部的信息,对不屑、厌恶、高兴情绪的识别更多的依赖于面部下半部的信息,而愤怒和恐惧的上、下半部信息对情绪识别的贡献差异不显著。
     实验三考察面部表情识别的眼动特征,验证面部表情信息的上下不对称性。记录被试识别不同情绪类型面部表情时的眼动指标,运用SPSS11.5及Data Viewer眼动分析软件进行分析。结果显示,(1)不同情绪类型面部表情识别的眼动特征存在显著差异。识别高兴面部表情时注视点少、眼跳次数少、瞳孔直径小、反应时短且识别率高;而愤怒、厌恶和悲伤相较其它情绪更难识别,正确率低、反应时长,注视点次数、眼跳次数和瞳孔直径都多于其它面部表情;(2)不同情绪类型面部表情识别时对不同兴趣区的注视程度不同。对悲伤、惊奇和厌恶识别时个体更多的对上半脸的情绪信息进行深加工,注视时间长且注视点次数较多;而识别高兴和不屑情绪时更多的加工下半脸的信息,注视时间长且注视点次数较多;愤怒和恐惧识别时上、下半脸的加工程度基本一致。
The covered and uncovered pictures of Japanese and Caucasian Facial Expressions of Emotion (JACFEE) was used to explore the difference of recognition of facial expressions, asymmetry of emotional information in upper and lower facial expression and the characteristics of eye movement of facial expression recognition. This study used the matching task namely forced choice label task, including three experiments. Subjects were presented with pictures in a randomized order. For each picture, the subjects were asked to categorize facial expressions. The first experiment and third experiment used the Japanese and Caucasian Facial Expressions of Emotion (JACFEE), and The second experiment used the lower faces and upper faces were covered respectively at the end of the center line from the hairline to the chin. The following conclusions are induced:
     The first experiment examined differences in recognition of various facial expressions by analyzing recognition scores of facial expression. Results indicated that there were different in recognition of different emotional facial expressions significantly, namely the happy facial expression were easy to distinguish than other facial expressions.
     The second experiment investigated asymmetry of emotional information in upper and lower facial expression by analyzing recognition scores of upper and lower facial expression. Results indicated that location of facial expression was associated with recognition of different emotions. The recognition of sadness and surprise were more dependent on the upper area of facial expression. The recognition of contempt, disgust and happiness were more dependent on the lower area of facial expression. The location of the facial expression was not associated with recognition of anger and fear.
     The third experiment investigated the characteristics of eye movement of facial expression recognition by analyzing eye movement data with SPSS 11.5 and Data Viewer. Results indicated that the characteristics of eye movement of various facial expressions were different. The happy face was accompanied by shorter fixations compared with other facial expressions. (2) subjects fixated the upper face in sadness、surprise and disgust. They redistributed fixations to the lower face when recognized happiness and contempt, and the upper and lower face of anger and fear attracted similar number of fixations.
引文
[1] Goldstein A G. Behavioral scientists' fascination with faces[J]. Journal of Nonverbal Behavior. 1983, 7 (4):223-225
    
    [2] Ekman P. Facial expression and emotion[J]. American Psychologist. 1992, 384 - 392
    
    [3] Keltner D, Ekman P. Facial expression of emotion[M]. Handbook of emotions (2nd ed.). New York : Guilford Press. 2000,236 - 249
    [4] Hasselmo M E, Rolls E T, Baylis G C. The role of expression and identity in the face - selective responses of neurons in the temporal visual cortex of the monkey[J]. Behavioral Brain Research. 1989,32:203-218
    [5] White M. Representation of facial expressions of emotion[J]. The American Journal of Psychology. 1999,112 (3): 371 - 381
    [6] Field T, Walden T. Production and discrimination of facial expressions by preschool children[J]. Child Development. 1982, 53 :1299 -1311
    [7] Walden T, Field T. Discrimination of facial expressions by preschool children[J]. Child Development. 1982, 53 : 1312 - 1319
    [8] Ekman P. Universals and cultural differences in facial expressions of emotion[M]. Nebraska Symposium on Motivation, Lincoln, NE : University of Nebraska Press. 1972
    [9] Leppanen J M, Hietanen J K. Positive facial expressions are recognized faster than negative facial expressions , but why ? [J] Psychological Research. 2004,69 : 22 - 29
    [10] Odom R, Lemond C. Developmental differences in the perception and production of facial expressions[J]. Child Development. 1972, 43 (2): 359 - 369
    
    [11] Hess U, Blairy S, Kleck R E. The intensity of emotional facial expressions and decoding accuracy[J]. Journal of Nonverbal Behavior. 1997, 21,241 - 257
    
    [12] Serrano J M, Iglesias J, Loeches A. Visual discrimination and recognition of facial expressions of anger, fear, and surprise in 4- to 6-month-old infants[J]. Development Psychobiology. 1992,25,411-425
    [13] Hansen C H, Hansen R D. Finding the face in the crowd : An anger superiority effect[J]. Journal of Personality and Social Psychology. 1988, 54,917 - 924
    [14] White M J. Preattentive analysis of facial expressions of emotion[J]. Cognition and Emotion, 1995,9,439-460
    
    [15] (O|¨)hman A, Dimberg U. Facial expressions as conditioned stimuli for electrodermal responses: A case of preparedness?[J]. Journal of Personality and Social Psychology. 1978, 36 : 1251 - 1258
    [16] Stanners R F, Byrd D M, Gabriel R. The time it takes to identify facial expressions: Effects of age , gender of subject , sex of sender , and type of expression[J]. Journal of Nonverbal Behavior. 1985,9:201-213
    [17] Young A W. Right cerebral hemisphere superiority for recognizing the internal and external features of famous faces[J]. British Journal of Psychology. 1984, 75 :161 - 169
    [18] Skinner M, Mullen B. Facial asymmetry in emotional expression: A meta-analysis of research[J]. British Journal of Social Psychology. 1991, 30 : 113 -124
    [19] Borod J C, Haywood C S, Koff E. Neuropsychological aspects of facial asymmetry during emotional expression: A review of the normal adult literature[J]. Neuropsychology Review. 1997,7:41-60
    [20] Ekman P. Telling Lies: Clues to Deceit in the Marketplace, Politics and Marriage[M]. New-York : Norton. 1992
    [21] Gouta K, Miyamoto M. Emotion recognition: Facial components associated with various emotions[J]. Shinrigaku Kenkyu. 2000, 71:211-218
    [22] Larsen J T, Mcgraw A P, Cacioppo J T. Can people feel happy and sad at the same time? [J] Journal of Personality and Social Psychology. 2001, 81 :684 - 696
    [23] Baron-Cohen S, Wheelwright S, Jolliffe T. Is there a"Language of the Eyes"? Evidence from normal adults , and adults with autism or Asperger Syndrome[J]. Visual Cognition. 1997,4 (3):311-331
    [24] Batki A, Baron-Coken S, Wheelwright S, Connellan J, Ahliwalia J. Is there an innate gaze module? Evidence from human neonates[J]. Infant Behaviour and Development. 2000, 23 : 223 -229
    [25] Dunlap K. The role of the eye muscles and mouth muscles in the expression of emotions[J]. Genetic Psychology Monographs, 1927, 2 : 199 - 233
    [26] Frois-Wittman J. The judgement of facial expression. Journal of Experimental Psychology. 1930,13: 113-151
    [27] Bassili J N. Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face[J]. Journal of Personality and Social Psychology. 1979, 37 :2049 - 2058
    [28] Hanawalt N G. The role of the upper and lower parts of the face as the basis for judging facial expressions: II In posed expressions and "candid camera" pictures[J]. Journal of General Psychology. 1944, 31 : 23 - 36
    [29]阎国利.眼动分析法在心理学中的应用(修订版)[M].天津:天津教育出版社,2004
    [30]Mackworth N H,Morandi A J.The gaze selects informative details within pictures[J].Perception and Psychophysics.1967,2,547 - 552
    [31]Antes J R.The time course of picture viewing[J].Journal of Experiment Psychology.1974,103(1):62-70
    [32]Guo K,Mahmoodi S,Robertson R G,Young M P.Longer fixation duration while viewing face images[J].Expriment Brain Research.2006,171:91 - 98
    [33]Rayner K.Eye Movements in Reading and Information Processing:20 Years of Research[J].Psychological Bulletin.1998,124(3):372 - 422
    [34]Barton J,Radcliffe N,Cherkasova M,Edelman J,Intriligator J.Information processing during face recognition:the effects of familiarity,inversion and morphing on scanning fixations[J].Perception.2006,353,1089 - 1105
    [35]Hsiao J H,Cottrell G.Two fixations suffice in face recognition[J].Psychological Science.(In Press)
    [36]Hunt A R,Cooper R M,et al.The effect of emotional faces on eye movements and attention[J].Visual Cognition.2007,15(5):513 - 531
    [37]李勇,阴国恩,陈燕丽.阅读中疲劳、心理负荷因素对瞳孔大小的调节作用[J].心理与行为研究,2004,2(3):545-54
    [38]隋雪,任延涛.面部表情识别的即时加工过程[J].心理学报,2007,39(1):64-70
    [39]Denham S A.Social cognition,prosocial behavior,and emotion in preschoolers:contextual validation[J].Child Development.1986,57:194 -201
    [40]Garner P W,Jones D C,Miner J L.Social competence among low - income preschoolers:Emotion socialization practices and social cognitive correlates[J].Child Development.1994,65:662-637
    [41]Mack A,Rock I.Inattentional blindness[M].Cambridge,MA:MIT Press.1998
    [42]Crews W D,Harrison D W.Cerebral asymmetry in facial affect perception by women:Neuropsychoiogical effects of depressive mood.Perceptual and Motor Skills.1994,79:1667 -1679
    [43](O|¨)hman A,Lundqvist D,Esteves F.The face in the crowd revisited:A threat advantage with schematic stimuli[J].Journal of Personality and Social Psychology.2001,80:381 - 396
    [44]Johnston P J,Katsikitis M,Carr V J.A generalised deficit can account for problems in facial emotion recognition in schizophrenia[J].Biological Psychology.2001,58:203 - 227
    [45]Adolphs R.Recognizing emotion from facial expressions:Psychological and neurological mechanisms[J]. Behavioral and Cognitive Neuroscience Reviews. 2002,1 : 21-62
    [46] O¨hman A, Lundqvist D, Esteves F. The face in the crowd revisited: A threat advantage with schematic stimuli[J]. Journal of Personality and Social Psychology. 2001, 80,381 - 396
    [47] McClelland J L. On the time relations of mental processes: An examination of systems of processes in cascade[J]. Psychological Review. 1979, 86, 287 - 330
    [48] Feyereisen P, Malet C, Martin Y. Is the faster processing of expressions of happiness modality-specific? [M] Aspects of face processing. Boston: Martinus Nijhoff. 1986, 349 - 355
    [49] Leppa" nen J M, Hietanen J K. Affect and face perception: Odors modulate the recognition advantage of happy faces[J]. Emotion. 2003, 3, (4): 315 - 326
    [50] Stenberg G, Wiking S, Dahl M. Judging words at face value: Interference in word processing reveals automatic processing of affective facial expressions[J]. Cognition and Emotion. 1998, 12,755-782
    [51] Gouta K, Miyamoto M. Emotion recognition: Facial components associated with various emotions[J]. Japanese Journal of Psychology. 2000, 71 (3): 211 -218
    [52] Calder A J, Young A W, Keane J, Dean M. Configural information in facial expression perception[J]. Journal of Experimental Psychology: Human Perception and Performance. 2000, 26(2):527-551
    [53] Camras L A, Oster H, Campos J, et al. Production of emotional and facial expressions in European American , Japanese , and Chinese infants[J]. Developmental Psychology. 1998, 34 (4):616-628
    [54] Beaupre M G, Hess U. An in - group advantage for confidence in emotion recognition judgments: The moderating effect of familiarity with the expressions of out - group members[J]. Personality and Social Psychology Bulletin. 2006, 32(1): 16 - 26
    [55] Biehl M, Matsumoto D, Ekman P, et al. Matsumoto and Ekman's Japanese and Caucasian Facial Expressions of Emotion (JACFEE): Reliability data and cross - national differences[J]. Journal of Nonverbal Behavior. 1997,21:3- 21
    [56] Russell J A, Suzuki N, Ishida N. Canadian , Greek , and Japanese freely produced emotion labels for facial expressions[J]. Motivation and Emotion. 1993,17 : 337 - 351
    [57] Elfenbein H A, Ambady N. On the universality and cultural specificity of emotion recognition: A meta - analysis[J]. Psychological Bulletin. 2002, 128 : 203 - 235
    [58] Beaupre M G, Hess U. Cross - cultural emotion recognition among Canadian ethnic groups[J]. Journal of Cross - Cultural Psychology. 2005, 36 (3): 355 - 370
    [59] Elfenbein H A, Mandal M K, Ambady N, Harizuka S, Kumar S. Hemifacial differences in the in - group advantage in emotion recognition[J].Cognition and Emotion,2004,18(5):613 -629
    [60]Lewis M,Michalson L.Children's emotions and moods:Developmental theory and measurement[C].New York:Plenum,1983
    [61]Ekman P,Friesen W V.Unmasking the face[M].Englewood Cliffs,NJ:Prentice Hall.1975
    [62]Nummenmaa T.The language of the face[M].Jyvaskyla studies in education,psychology and social research,Finland:Kustantajat Publ.1964,9
    [63]Ross E D,Reddy A L,Nair A,Mikawa K,Prodan C I.Facial expressions are more easily produced on the upper - lower compared to the right - left hemiface[J].Perceptual and Motor Skills.2007,104:155- 165
    [64]Buck R,WileyHuman J S.Motivation and Emotion,2nd Edition[M].New York.1988
    [65]Ekman P.Darwin,deception,and facial expression[J].Annals of the New York Academy of Sciences.2003,1000:205 - 221
    [66]Prodan C I,Orbelo D M,Testa J A,Ross E D.Hemispheric differences in recognizing upper and lower facial displays of emotion[J].Neuropsychiatry,Neuropsychology,and Behavioral Neurology.2001,14:206-212
    [67]Prodan C I,Orbelo D M,Ross E D.Processing of facial blends of emotion:support for right hemisphere cognitive aging[J].Cortex.2007,43(2):196-206
    [68]Etcoff N L,Ekman P,Magee J J,Frank M G.Lie detection and language comprehension[J].Nature.2000,405:139-141

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700