Warsaw set of emotional facial expression pictures: a validation study of facial display photographs

Michal Olszanowski, Grzegorz Pochwatko, Krzysztof Kuklinski, Michal Scibor-Rylski, Peter Lewinski, Rafal K Ohme, Michal Olszanowski, Grzegorz Pochwatko, Krzysztof Kuklinski, Michal Scibor-Rylski, Peter Lewinski, Rafal K Ohme

Abstract

Emotional facial expressions play a critical role in theories of emotion and figure prominently in research on almost every aspect of emotion. This article provides a background for a new database of basic emotional expressions. The goal in creating this set was to provide high quality photographs of genuine facial expressions. Thus, after proper training, participants were inclined to express "felt" emotions. The novel approach taken in this study was also used to establish whether a given expression was perceived as intended by untrained judges. The judgment task for perceivers was designed to be sensitive to subtle changes in meaning caused by the way an emotional display was evoked and expressed. Consequently, this allowed us to measure the purity and intensity of emotional displays, which are parameters that validation methods used by other researchers do not capture. The final set is comprised of those pictures that received the highest recognition marks (e.g., accuracy with intended display) from independent judges, totaling 210 high quality photographs of 30 individuals. Descriptions of the accuracy, intensity, and purity of displayed emotion as well as FACS AU's codes are provided for each picture. Given the unique methodology applied to gathering and validating this set of pictures, it may be a useful tool for research using face stimuli. The Warsaw Set of Emotional Facial Expression Pictures (WSEFEP) is freely accessible to the scientific community for non-commercial use by request at http://www.emotional-face.org.

Keywords: basic emotions; emotion; emotion recognition; face perception; facial expression recognition; facial expressions of emotion; pictures; validation.

Figures

Figure 1
Figure 1
Examples of photographs from WSEFEP with received ratings. Each mark represents a rating from a single participant. The letters indicate: N, number participants evaluating picture; A, accuracy of displayed emotion; P, purity of displayed emotion, and I, intensity of displayed emotion.
Figure 2
Figure 2
Ratings distribution for facial expression of anger, disgust, fear, joy, sadness, surprise, and neutral faces from WSEFEP.
Figure 3
Figure 3
Examples of purity and intensity scores. Purity scores were based on relative difference of angles between the radius line directly crossing the middle of the field of a given emotion field (e.g., fear) and the radius line crossing through the answer point. In this example the answer “A” received 1 point as it is located directly on the line. Answer “B” received 5 point as α1 is 5 smaller than α. Answer “C” received 0 points as it is located outside of the emotion field (displayed emotion is not recognized as intended). Intensity scores were calculated as the relative distance of segment “ab” starting from point “a” (border of internal wheel labeled neutral scored 0) to the wheel border—point “b” (scored 1). Thus, answer “A” was scored 58 on the intensity scale.

References

    1. Barrett L. F., Kensinger E. A. (2010). Context is routinely encoded during emotion perception. Psychol. Sci. 21, 595–599. 10.1177/0956797610363547
    1. Beaupre M. G., Hess U. (2005). Cross-cultural emotion recognition among Canadian ethnic groups. J. Cross Cult. Psychol. 36, 355–370 10.1177/0022022104273656
    1. Biehl M., Matsumoto D., Ekman P., Hearn V., Heider K., Kudoh T., et al. (1997). Matsumoto and Ekman's Japanese and Caucasian facial expressions of emotion (JACFEE): reliability data and cross-national differences. J. Nonverbal Behav. 21, 3–21 10.1023/A:1024902500935
    1. Bourke C., Douglas K., Porter R. (2010). Processing of facial emotion expression in major depression: a review. Aust. N.Z. J. Psychiatry 44, 681–696. 10.3109/00048674.2010.496359
    1. Cohn J. F., Schmidt K. L., Gross R., Ekman P. (2002). Individual differences in facial expression: stability over time, relation to self-reported emotion, and ability to inform person identification, in Proceedings of the International Conference on Multimodal User Interfaces (Pittsburgh, PA: IEEE; ), 491–496 10.1109/ICMI.2002.1167045
    1. Darwin C. H. (1872/1988). The Expression of the Emotions in Man and Animals. Oxford: University Press.
    1. Dimberg U., Andreasson P., Thunberg M. (2011). Emotional empathy and facial reactions to facial expressions. J. Psychophysiol. 25, 26–31 10.1027/0269-8803/a000029
    1. Ebner N. C., Riediger M., Lindenberger U. (2010). FACES–a database of facial expressions in young, middle-aged, and older women and men: development and validation. Behav. Res. Methods 42, 351–362. 10.3758/BRM.42.1.351
    1. Ekman P. (1992). Are there basic emotions? Psychol. Rev. 99, 350–353 10.1037/0033-295X.99.3.550
    1. Ekman P. (1993). Facial expression and emotion. Am. Psychol. 48, 384–392. 10.1037/0003-066X.48.4.384
    1. Ekman P. (1997). Should we call it expression or communication. Innov. Soc. Sci. Res. 10, 333–344 10.1080/13511610.1997.9968538
    1. Ekman P., Friesen W. V. (1976). Pictures of Facial Affect. San Francisco, CA: Human Interaction Laboratory, University of California Medical Center.
    1. Ekman P., Friesen W. V., Hager J. C. (2002). Facial Action Coding System: the Manual on CD ROM. Salt Lake City, UT: A Human Face.
    1. Ekman P., Rosenberg E. (eds.). (2005). What the Face Reveals, 2nd Edn. New York, NY: Oxford University Press.
    1. Fridlund A. J. (1994). Human Facial Expression: An Evolutionary View. San Diego, CA: Academic Press.
    1. Goeleven E., De Raedt R., Leyman L., Verschuere (2008). The Karolinska directed emotional faces: a validation study. Cognit. Emot. 22, 1094–1118. 10.1080/02699930701626582
    1. Hareli S., Shomrat N., Hess U. (2009). Emotional versus neutral expressions and perceptions of social dominance and submissiveness. Emotion 9, 378–384. 10.1037/a0015958
    1. Izard C. E. (1993). Four systems for emotional activation: cognitive and noncognitive processes. Psychol. Rev. 100, 68–90. 10.1037/0033-295X.100.1.68
    1. Kaulard K., Cunningham D. W., Bulthoff H. H., Wallraven C. (2012). The MPI facial expression database—a validated database of emotional and conversational facial expressions. PLoS ONE 7:e32321. 10.1371/journal.pone.0032321
    1. Kharat G. U., Dudul S. V. (2009). Emotion recognition from facial expression using neural networks. Hum. Comput. Syst. Interact. Adv. Intell. Soft Comput. 60, 207–219 10.1007/978-3-642-03202-8_17
    1. Langner O., Dotsch R., Bijlstra G., Wigboldus D. H. J., Hawk S. T., van Knippenberg A. (2010). Presentation and validation of the Radboud Faces Database. Cognit. Emot. 24, 1377–1388 10.1080/02699930903485076
    1. Mancini G., Agnoli S., Baldaro B., Bitti P. E. R., Surcinelli P. (2013). Facial expressions of emotions: recognition accuracy and affective reactions during late childhood. J. Psychol. 147, 599–617. 10.1080/00223980.2012.727891
    1. Matsumoto D., Ekman P. (1989). Japanese and Caucasian Expressions of Emotion (JACFEE) and Neutral Faces (JACNeuF). San Francisco, CA: Intercultural and Emotion Research Laboratory, Department of Psychology, San Francisco State University.
    1. Mattavelli G., Sormaz M., Flack T., Asghar A. U. R., Fan S., Frey J., et al. . (2014). Neural responses to facial expressions support the role of the amygdala in processing threat. Soc. Cognit. Affect. Neurosci. 9, 1684–1689. 10.1093/scan/nst162
    1. McLellan T., Johnston L., Dalrymple-Alford J., Porter R. (2010). Sensitivity to genuine versus posed emotion specified in facial displays. Cognit. Emot. 24, 1277–1292. 10.1080/02699930903306181
    1. McLellan T. L., Wilcke J. C., Johnston L. L., Watts R. R., Miles L. K. (2012). Sensitivity to posed and genuine displays of happiness and sadness: a fMRI study. Neurosci. Lett. 531, 149–154. 10.1016/j.neulet.2012.10.039
    1. Nelson N. L., Russell J. A. (2013). Universality revisited. Emot. Rev. 5, 8–15 10.1177/1754073912457227
    1. Parker A. E., Mathis E. T., Kupersmidt J. B. (2013). How is this child feeling? Preschool-aged children's ability to recognize emotion in faces and body poses. Early Educ. Dev. 24, 188–211 10.1080/10409289.2012.657536
    1. Plutchik R. (1980). Emotion: A Psychoevolutionary Synthesis. New York, NY: Harper & Row.
    1. Russell J. A. (1994). Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychol. Bull. 115, 102–141. 10.1037/0033-2909.115.1.102
    1. Schneider K. G., Hempel R. J., Lynch T. R. (2013). That “poker face” just might lose you the game! The impact of expressive suppression and mimicry on sensitivity to facial expressions of emotion. Emotion 13, 852–866. 10.1037/a0032847
    1. Stanislavski C. (1936/1988). An Actor Prepares. London: Methuen.
    1. Tomkins S. S. (1962). Affect, Imagery, Consciousness. New York, NY: Springer.
    1. Tottenham N., Tanaka J. W., Leon A. C., McCarry T., Nurse M., Hare T. A., et al. . (2009). The NimStim set of facial expressions: judgments from untrained research participants. Psychiatry Res. 168, 242–249. 10.1016/j.psychres.2008.05.006
    1. Tracy J. L., Robins R. W., Schriber R. A. (2009). Development of a FACS-verified set of basic and self-conscious emotion expressions. Emotion 9, 554–559. 10.1037/a0015766
    1. Van Der Schalk J., Hawk S. T., Fischer A. H., Doosje B. (2011). Moving faces, looking places: validation of the Amsterdam Dynamic Facial Expression Set (ADFES). Emotion 11, 907–920. 10.1037/a0023853
    1. Wierzbicka A. (1995). Emotion and facial expression: a semantic perspective. Cult. Psychol. 1, 227–258. 10.1177/1354067X9512005

Source: PubMed

Sponsors and Collaborators

Medical Conditions

Drug Interventions

3
Subscribe