Next Article in Journal
SMEA-YOLOv8n: A Sheep Facial Expression Recognition Method Based on an Improved YOLOv8n Model
Previous Article in Journal
Rank-Related Differences in Dogs’ Behaviours in Frustrating Situations
Previous Article in Special Issue
Making Noah’s Ark Work for Fishing Cat Conservation: A Blueprint for Connecting Populations across an Interactive Wild Ex Situ Spectrum
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Neurobiology and Anatomy of Facial Expressions in Great Apes: Application of the AnimalFACS and Its Possible Association with the Animal’s Affective State

by
Adriana Domínguez-Oliva
1,2,
Cuauhtémoc Chávez
3,
Julio Martínez-Burnes
4,
Adriana Olmos-Hernández
5,
Ismael Hernández-Avalos
6 and
Daniel Mota-Rojas
2,*
1
PhD Program in Biological and Health Sciences, Universidad Autónoma Metropolitana (UAM), Mexico City 04960, Mexico
2
Neurophysiology of Pain, Behavior and Animal Welfare Assessment, DPAA, Universidad Autónoma Metropolitana (UAM), Mexico City 04960, Mexico
3
Departamento de Ciencias Ambientales, CBS, Universidad Autónoma Metropolitana-Lerma, Lerma de Villada 52005, Mexico
4
Facultad de Medicina Veterinaria y Zootecnia, Universidad Autónoma de Tamaulipas, Victoria City 87000, Mexico
5
Bioterio and Experimental Surgery, Instituto Nacional de Rehabilitación-Luis Guillermo Ibarra Ibarra (INR-LGII), Mexico City 14389, Mexico
6
Biological Sciences Department, Facultad de Estudios Superiores Cuautitlán, Universidad Nacional Autónoma de México, Cuautitlán 54714, Mexico
*
Author to whom correspondence should be addressed.
Animals 2024, 14(23), 3414; https://doi.org/10.3390/ani14233414
Submission received: 25 September 2024 / Revised: 7 November 2024 / Accepted: 19 November 2024 / Published: 26 November 2024

Simple Summary

In humans, it is suggested that facial expressions reflect the emotional state of the individual but can also serve as a communicative signal. Chimpanzees, orangutans, and gorillas are the species closest to humans. Therefore, studying if nonhuman primate facial expression changes according to the affective state is relevant for research focused on the emotional responses of animals. The present review aims to discuss the neural correlates and anatomical components of emotional facial expression in great apes. It will focus on the use of Facial Action Coding Systems (FACSs) and the movements of the facial muscles (AUs) of chimpanzees, orangutans, and gorillas and their possible association with the affective state of great apes.

Abstract

The Facial Action Coding System (FACS) is an anatomically based system to study facial expression in humans. Currently, it is recognized that nonhuman animals, particularly nonhuman primates, have an extensive facial ethogram that changes according to the context and affective state. The facial expression of great apes, the closest species to humans, has been studied using the ChimpFACS and OrangFACS as reliable tools to code facial expressions. However, although the FACS does not infer animal emotions, making additional evaluations and associating the facial changes with other parameters could contribute to understanding the facial expressions of nonhuman primates during positive or negative emotions. The present review aims to discuss the neural correlates and anatomical components of emotional facial expression in great apes. It will focus on the use of Facial Action Coding Systems (FACSs) and the movements of the facial muscles (AUs) of chimpanzees, orangutans, and gorillas and their possible association with the affective state of great apes.

1. Introduction

Great apes are highly social species that communicate through acoustic, tactile, olfactory, and visual cues [1,2]. For primates, facial displays provide information about the animal’s motivation, intentions, and affiliative state [3,4,5]. Facial expressions are being widely studied in animals as a way to assess the response to negative/positive contexts or emotional valence through facial muscle movements [6,7,8,9]. Nonetheless, although facial expressions have a communicative role, this is highly influenced by the species and their social context [10].
An example of the challenges in associating facial expressions with an emotional context is the so-called facial feedback hypothesis (FFH) [11]. This hypothesis mentions that inhibiting certain facial expressions can attenuate the subjective emotional experience related to facial changes [11]. Humans smile when experiencing pleasant stimuli and frown when feeling sad [12,13]. In Mori et al.’s [14] study, raising the cheeks with bandages elicited a feeling of happiness in the participants, while other authors reported that facial feedback influences only emotions such as happiness, anger, and disgust [12,13,15]. In nonhuman primates, this has not been extensively researched. However, expressing and interpreting facial displays help them to appropriately respond to conspecifics and, possibly, their association with emotional states [1,16].
In humans, to objectively study facial displays, Paul Ekman and collaborators developed and standardized a coding system describing facial movements (AUs) or distinctive movements of facial muscles, according to the underlying action of facial or mimetic muscles, and named it the Facial Action Coding System (FACS) [17,18,19,20]. FACS is an anatomically based system that associates each FAU (e.g., upper lip raiser) to their specific muscle (e.g., levator labii superioris) [20,21]. Using the human FACS as a reference, AnimalFACS have been developed in dogs (DogFACS) [22], cats (CatFACS) [23], horses (EquiFACS) [24], rhesus monkeys (M. mulatta) (MaqFACS) [25], gibbons (Symphalangus syndactylus, Hylobates pileatus, Hylobates moloch, Nomascus siki, N. gabriellae, N leucogenys, H. muelleri) (GibbonFACS) [26], common marmosets (Callithrix jacchus) (CalliFACS), and great apes including chimpanzees (P. troglodytes) (ChimpFACS) [20] and orangutans (Pongo pygmaeus, Pongo abelii) (OrangFACS) [27]. The first AnimalFACS was ChimpFACS due to the resemblance of chimpanzees to human faces [20].
The study of facial expressions in great apes has been performed through facial ethograms. The current approaches try to combine AnimalFACS with facial displays frequently observed in primates such as open-mouth faces, silent bared-teeth displays, and alarm faces, among others, to provide an objective interpretation of facial movements and a possible perspective on the facial expression of emotion [28,29]. However, since the emotional face perception in great apes is challenging and not all species have a FACS (e.g., lowland gorilla), the present review aims to discuss the neural correlates and anatomical components of emotional facial expressions in great apes. It will focus on the use of AnimalFACS, specifically the AUs in chimpanzees, orangutans, and gorillas, and its possible association with the affective state of great apes.

2. Neurophysiology of Facial Expression in Animals

Facial expressions are being widely studied in animals as a way to assess the response to negative/positive context through facial muscle movements [6,7]. Currently, the term “facial behavior” refers to observable facial movements associated with a species-specific behavioral repertoire [30]. The neurophysiology of facial expression is not completely understood in mammals (including human and nonhuman primates). However, it is known that facial expressions do not depend solely on anatomical components but are the result of a circuit that integrates subcortical and cortical areas such as the amygdala, the primary motor cortex, the ventrolateral cortex, the motor area, the supplementary motor area, two dorsal motor areas of the middle cingulate, and the motor fibers responsible for innervating the facial muscles [10,16].
A proposed order to produce a certain facial expression starts with (1) somatosensory or proprioceptive neurons that send signals of the individual’s state; (2) a consequent connection from these neurons to emotion-related or limbic-related structures; (3) motor cortical neurons that project to last-order motor neurons; and (4) the efferent pathways from last-order motor neurons to mimetic facial muscles [31]. The afferent pathway related to a stimulus depends on its nature. An example is the exposition of an aversive auditory stimulus (e.g., predator vocalization) [32]. Auditory cues are projected from the cochlea to the thalamus, to subsequently project to the amygdala [33,34]. On the other hand, visual stimuli are processed by the thalamus, specifically by the dorsal lateral geniculate nucleus that receives information from the periphery to the amygdala [35]. In monkeys, 12% of the so-called “eye-fixation cells”, a type of specialized neuron in the amygdala, are activated within 80–140 ms during fixated gaze with unfamiliar conspecifics [36]. These processes are schematized in Figure 1 [32,33,34,35].
The perception and production of facial expressions are triggered by neuronal connections in the primate amygdala and midcingulate cortex, discriminating each facial expression into corresponding contexts [31,34]. The hypothalamus also coordinates some of the facial expressions that are present during sexual interactions, as well as other behavioral and physiological changes that can accompany facial expressions (e.g., tachycardia, hyperthermia, and cortisol increases, among others) [37]. In rhesus macaques (Macaca mulatta), processing facial expressions from conspecifics has been shown to activate areas in the amygdala and the superior temporal sulcus [38]. Although the amygdala is the main center where emotions are processed, the temporal and prefrontal cortex also process socio-emotional information in the mammal brain [31,39].
Facial expression is coordinated by the cerebral cortex and subcortical motor pathways [31]. Facial movements require motor control of the upper and lower muscles. This modulation comes from the interaction between the ventrolateral frontal cortex, the supplementary motor area, and two areas in the middle cingulate cortex. Last-order motor neurons are responsible for directly innervating facial muscle fibers according to signals from the cortical motor neuron circuit [40]. The amygdala and the middle cingulate cortex are structures that activate during the perception and production of facial expressions, showing that expressions depend on motor and limbic areas of the brain [16].
At the cortical level, five regions project to the facial nucleus: (1) the primary motor cortex (M1), from which connections arise to the entire facial nucleus, especially to the contralateral lower muscles; (2) the ventrolateral area of the premotor cortex (LPMCv) and the dorsolateral premotor cortex, which innervate the lower facial muscles; (3) the caudal area of the anterior middle cingulate (M4), which innervates the lower facial muscles; (4) the supplementary motor cortex (M2); and (5) the middle cingulate motor cortex (M3) [5,41]. M2 and M3 innervate the upper muscles of the face and are associated with afferents from the limbic system for motor control. These projections go from the amygdala to M3 and from M3 to the facial nucleus, where M3 is known as the major mediator center for the facial expression of emotions such as fear or happiness [41]. This neurobiological control is schematized in Figure 2, along with the facial muscles in chimpanzees [31,42].
The motor nucleus of the facial nerve is the largest in the brain stem. In humans, there are 24 facial muscles [43], but 17 are considered mimetic muscles [41]. In the case of nonhuman primates, 16 mimetic muscles have been reported in chimpanzees (Pan troglodytes) [21,42] and gorillas [4]. These mimetic muscles share innervation by the facial nerve, as well as a similar embryological origin and the absence of muscle spindles, which means that they lack stretch reflexes, requiring the process and integration of cutaneous receptors by the central nervous system to produce facial movements [41]. The extracranial facial nerve (along with its distal branches and the trigeminal nerve), a purely motor nerve, stimulates muscle movements. In contrast, sensory information is captured by mechanoreceptors in the facial skin [44].
Motor control of the lower face is coordinated by three motor areas: M1 or the primary motor cortex, the ventrolateral premotor cortex, and the caudal aspect of the middle cingulate cortex. On the other hand, the upper part depends on two motor areas: the supplementary motor area and the anterior aspect of the middle cingulate cortex [45]. Facial paralysis models have shown that contralateral paralysis is observed in the lower part of the face, meaning that the lower part of the face is innervated unilaterally and contralaterally, while the upper part has bilateral innervation [41].
To objectively identify specific muscle movements associated with certain events (e.g., pain, sadness, anger, fear, and disgust) [46], Ekman and Friesen [47] developed the Facial Action Coding System (FACS) in humans. The FACS describes 44 AUs in humans, which represent the activation of a muscle, for example, the medial or lateral frontalis to raise the eyebrow or the orbicularis oculi pars palpebralis to squint (AU44), and the depression of the eyebrows (AU4) is the combined action of the corrugator supercilli and procerus muscles or closing the eyes (AU43) [17,21,45]. The anatomical understanding of the FACS allows its application to different fields, including veterinary medicine, where the study of facial expression is gaining importance as a method to recognize animals’ behavioral and emotional responses.

3. Facial Expression in Nonhuman Mammals and AnimalFACS

Darwin was the first to mention that nonhuman animals can show emotions through facial expression, which constitutes an innate, adaptive, and evolutionarily conserved response [48]. In the last decade, the study of facial expression began to have more importance in the case of animals, particularly as a method to recognize the mental state of animals when exposed to certain stimuli [49].
As Darwin describes, facial expression can be assessed under three categories: (1) descriptive; (2) functional; and (3) causal [50]. Description often refers to the facial musculature of animals and can be composed of AUs, as discussed below [30,51]. Function refers to the intention of the facial expression. For example, in nonhuman primates, it could be to promote cohesive, friendly, playful, or aggressive responses to conspecifics [52,53].
This has been observed in macaques and great apes with the relaxed open-mouth (ROM) expression, often called “play face” (PF) because it is known as a reciprocal interaction during maternal interactions or play fighting [54]. This has been studied by observing interactions between Japanese macaques, in whom PF initiated play bouts and increased the duration of the playtime [55]. Similarly, in another primate species (Theropithecus gelada), PF and full PF (an expression where the individual exposes both the lower and upper teeth) were evaluated in juvenile and adult monkeys. In this study, it was reported that PFs are mainly performed by juvenile subjects but that adult animals were more sensitive to respond to PF, probably due to their previous playful experience and social maturity [56].
On the other hand, causes or determinants of facial expression comprise an array of interacting factors that determine the change [50]. Following the example of the PF, primates display ROM during dyadic encounters to convey to the playmate that the interaction is playing and that it has no intention of escalating to aggression [57,58,59].
The study of animal facial expressions has been used as a method to recognize the mental state of animals when exposed to certain stimuli, particularly to negative experiences such as pain [8]. This led to the development of “grimace scales” or scales focusing on the facial expressions that animals show when experiencing pain [6]. Validated grimace scales have been developed in several species such as rodents [60,61,62], sheep [63], horses [64], ferrets [65], piglets [7,66], pigs [67], rabbits [68], and cats [69,70]. Moreover, initial evaluations in marine mammals (Phoca vitulina) [71] and dogs [9,72] aim to evaluate the degree of pain in these species. For example, the grimace scale developed for rats has characterized the animal’s pain-face as a narrowing of the orbital area, flattening of the cheeks, ears angled forward, and stiff whiskers by performing observations during the postsurgical period or after the administration of inhalant anesthetics [62,73]. Likewise, in horses experiencing dental disorders without analgesic treatment, observations of the animal’s grimace determined that a facial expression of severe pain is denoted by lowered ears, contraction of the muscle above the eyes, dilated nostrils, tension of the facial muscles, and a muzzle with an edged shape [74].
Although some studies aim to identify changes in facial expression to assess the welfare and mental state of animals [75,76], studying facial expressions in animals is challenging because the same facial expression might differ across species and have different descriptions, functions, and causes [50]. To address this issue, a comprehensive and anatomically based system to distinguish all possible visible facial movements [17,47] has been adapted to animals: AnimalFACS.
FACS assists in the investigation of behavior and gestures, as well as their association with social context and animal interactions with conspecifics or objects [75]. It is noteworthy that the AnimalFACS is not an ethogram of facial expressions, and by solely using these systems, it is not possible to understand an animal’s emotional state. However, using the FACS to assign certain AUs to a facial expression and translate these to a practical environment could help to objectively associate the facial expression with a positive/negative environment. Furthermore, although the FACS is an objective assessment method to anatomically describe facial movements, a disadvantage is that it is based on clearly visible AUs, so subtle changes are not considered, and other facial phenomena such as skin coloration, tears, or sweating are also excluded [77].

4. AnimalFACS Systems Focused on Great Apes

Primates rely on facial expressions to communicate with conspecifics in their social networks [78]. Due to this, primates have quite complex facial musculature, involving perioral and periocular movements, producing a wide range of facial expressions [28,43]. Some authors mention that great apes use lips and mouth movements more frequently than orbital or auricular ones leading to the interest in studying their facial expression and their facial anatomy [79].
Currently, two AnimalFACS focusing on great apes have been developed. Both ChimpFACS and OrangFACS use facial muscle contractions (or AUs) to describe facial movements. Most AUs refer to the contraction of single mimetic muscles—muscles innervated by the facial nerve [80]—but some muscles are capable of producing different movements and, therefore, different AUs [30]. However, the presentation of the AUs and the frequency of the movements can differ or even be absent according to the species.

4.1. ChimpFACS

ChimpFACS was developed by Parr et al. [20] and is a system that describes 15 facial movements according to the anatomy, position, and movement of mimetic muscles. In chimpanzees, a total of 22–23 mimetic muscles have been found (e.g., risorius, depressor septi, corrugator supercilli, depressor supercilli, sphincter colli, and caninus muscle, among others, schematized in Figure 2) [4]. Although chimpanzees have similar AUs and mimetic muscles to humans (e.g., the risorius muscle, a structure that has only been reported in humans) [78], their anatomy is different by having more prognathic faces, elongated mouths, lower foreheads, and a flatter nasal area [21]. Moreover, Burrows et al. [79] mention that chimpanzees have thicker mimetic muscles around the oral cavity.
The 15 AUs described in chimpanzees are summarized in Table 1, considering their name, description, and musculature and comparing them with the original FACS developed for humans. An AU that is unique to the ChimpFACS is the lower lip relax (AU160) [20,21].
Further studies in chimpanzees have classified the AUs into eight categories, including bared-teeth display, pant-hoot, play face, scream, pout, and whimper [20,81,82] (Table 2) [20,82]. When evaluating the context, some of these AUs share the function and the cause. For example, bared teeth (BT) display is frequently compared with human smiles due to the morphological and functional similarities. All variants of BT display involve the movements of the zygomaticus major muscle [83]. Nonetheless, Kim et al. [28] found in captive chimpanzees that the meaning depends on several characteristics. One is the social ranking, where all chimpanzees exhibit BT display except the alpha male. The silent BT display, characterized by a slightly open or closed mouth with the corners retracted laterally, fully exposed teeth, and withdrawn lips, is mainly observed during affiliative subordinate-to-dominant interactions (0.98 probability). In contrast, the vocalized BT display where the mouth of the chimpanzees is partially open with retracted corners and fully exposed teeth, accompanied by high-pitched screams was present in both aggressive (probability of 1.0) and affiliative interactions (0.95). In contrast, other authors mention that BT displays are present during socio-sexual interactions between great apes as an appeasement signal to regulate tension [1].

4.2. OrangFACS

OrangFACS was the second AnimalFACS developed for great apes. Similar to ChimpFACS, OrangFACS comprises 17 AUs according to the musculature (Table 1) [27]. Some studies have detailed certain facial behaviors in orangutans, such as the play face (PF) associated with a relaxed open mouth (ROM). Similar to chimpanzees (AU12 + 25 + 26 or AU12 + 25 + 27) [20], in orangutans, this facial expression is described as AU10 + 12 + 25 + 27 [52]. However, differences are also present. While the authors found that no AUs are exclusively from orangutans, AU4 (an AU thought to be exclusive to humans) and AU18 (not found in chimpanzees) were clearly observed in this species [27].
As reported in chimpanzees, certain facial movements such as BT display (AU10 + 12 + 25) [27] have been associated with distinctive contexts such as fear followed by aggression in Sumatran orangutans (P. abelii) [84].

4.3. What About Gorillas?

In the case of gorillas, information regarding their facial anatomy is limited and, to date, there is not a designed FACS for the species. However, detailed facial dissections have been recently performed by Rotenstreich and Marom [4] to describe the gross and microanatomy of the supraorbital, lateral orbital, zygomatic, upper labial, and lower labial areas. By dissecting a female gorilla, 18 muscles were found, which closely resemble those reported in chimpanzees, orangutans (P. pygmaeus), gibbons (Hylobates species), baboons (Papio), macaques (M. mulatta), and humans. Significant differences were observed in gorillas, particularly in the lower facial anatomy. For example, the levator labii superioris alaeque nasi, the levator labii superioris, and the zygomaticus minor muscles are close together, in contrast to humans and chimpanzees. In contrast to orangutans, macaques, gibbons, and baboons, gorillas do not have a modiolar region—the area of the labial commissure. Gorillas also lacked the risorius muscle, a muscle found in chimpanzees and humans. Moreover, in the lower labial region, the depressor anguli oris muscle does not insert into the modiolus (as seen in humans and chimpanzees), but its fibers form a continuous arc that connects the maxillary canine fossa with the SMAS (a morphology observed in orangutans) [4].
In Gorilla gorilla, an attempt to describe the AUs was made by Dobson [51], who determined that 15 AUs were present in 13 individuals (AU1 + 2, AU9, AU10, AU12, AU13, AU14, AU15, AU16, AU17, AU18, AU22, AU23, AU24, AU25). Attempts to classify facial expressions have also been published, where a PF and full PF (FPF) are described as AU16 + 25 + 26 and AU AU10 + 16 + 25 + 26, respectively [52]. However, since there is no other study that has assessed the same AU, no comparison or confirmation is available.
The ability of each AnimalFACS to classify great apes’ facial expressions in AUs according to their underlying musculature can be used to further identify the facial changes involving exposure to emotional stimuli [20]. The current AnimalFACS is different from a facial ethogram; therefore, a single AU cannot and must not be used to represent an emotion or a mental state. The FACS helps to study in detail the movements of mimetic muscles instead of analyzing facial expressions [21], as a combination of certain AUs can produce an already known facial behavior (e.g., silent bared-teeth display) that might be part of a species facial ethogram. Although most studies focus on the identification of changes in facial expression when animals are exposed to different types of stimuli, this could help to give a more objective interpretation of the facial changes, as discussed below.

5. Facial Expression in Great Apes as a Possible Reflection of Their Affective Mental State

In humans, basic emotions such as anger, fear, happiness, sadness, surprise, and disgust have been identified, and some authors have suggested that emotional facial expressions are also present in nonhuman primates [85,86]. In contrast, in animals, no consensus has been reached so far on the role of facial displays in expressing emotional states as animals cannot self-report the intensity and valence of their own emotional experience [87]. However, current research in facial expression has suggested that facial movements and their expression could be a temporary and measurable indicator of the affective state (positive or negative) of an event [88].
Detailed descriptions of facial expression repertoires in great apes have been studied when animals respond to certain stimuli that are known to be positive or negative to them. Parr et al. [89] described a facial ethogram for chimpanzees that included expressions such as PF, pant-hoot, ambiguous faces, neutral expressions, scream, alert faces, pout, and whimper [20]. Although no FACS is available for gorillas, Tanner [90] mentions that this species is highly expressive, showing PF, pouts, tongue movements, and different degrees of BT displays. In further studies, the same author reported that after a gorilla expressed a PF, play bouts began within 4 s, showing the communication role that facial expression has for nonhuman primates [91].
In general, some authors state that great apes use tactile gestures more frequently than facial expressions (47.9 vs. 4.6%) [92], while others mention that vocalization is the main emotional expression method in primates [93]. The frequency of presentation and the gestures used by primates vary according to the context, such as dominance/submission, sexual, playful, parental, or affiliative behavior [92]. In the case of orangutans, they frequently use facial expressions during parental (11.9%) and agonistic interactions (11.1%). The low percentage of facial expressions in the species is also related to their social structure and environment, where orangutans are arboreal animals, making vocal cues more important to send information about social intentions and emotional states [79].
The most observed facial expression in great apes is open mouth face (OMF) [92]. It is described as the mouth completely open with full exposure of the canine teeth and the palate, without retracting the corners of the mouth [92]. Although there are variants of this facial expression and each has a different meaning, the OMF display is often related to playful contexts. Davila-Ross et al. [94] reported in orangutans that facial mimicry of OMFs within 1 s suggests a positive emotional state when observed during dyadic play bouts. Moreover, this facial expression tends to be shared between individuals who have a stronger bond or familiarity. In the case of bonobos (P. paniscus), Demuru et al. [95] found that animals involved in rough and gentle play exhibited OMFs to communicate a positive context, often exhibited by younger animals.
Play faces (PFs) are the most studied facial expressions related to the OMF. Great apes use two types of playful facial expression: the PF or relaxed open mouth (ROM) where only the lower teeth are exposed, and the full play face (FPF), which exposes both the upper and lower teeth, also known as OPM and considered an intense version of PF [87,96,97]. PFs are characterized by ROM, a display that is a unique trademark of play behavior that has been observed in many species of nonhuman primates [29]. All variants share the involvement of the zygomaticus major muscle [28] and the contraction of the levator labii superioris muscle, which pulls the corners of the lips backwards and upwards, opening the lips (AU12 + 25 + 26) [98].
PFs are the only primate facial behavior that shows morphological similarities with human laughing faces [29], where their lips are separated and pulled backward and upwards while dropping their jaws; they can raise their upper lip and the cheeks [99]. Indeed, in orangutans, an ROM display is associated with play context, and Waller et al. [98] have shown that when the receiver is attentive to the facial expression of the sender, the facial movements are more intense. This was observed in videotaped orangutans during spontaneous play interactions such as wrestling, hitting, or grappling. The animals maintained their OMF between 0.08 s and 10.56 s, and this time was significantly longer when the interaction was face-to-face (1.64 s ± 1.19) than when the sender did not receive direct attention (1.09 s ± 0.71). As such, the facial orientation of the receiver also plays an important role in the intensity of the AU, particularly AU27. A similar observation was made by Bresciani et al. [96] in captive groups of lowland gorillas, in whom the number of PFs/FPFs increased when both animals were looking at each other (5.54 ± 0.72). Additionally, the number of PFs/FPFs performed in each play bout was 4.236 ± 0.150, and, contrary to what was observed in other species, gorillas tend to perform ROM faces with conspecifics with whom they do not have a close bond.
In this sense, Waller and Cherry [52] reported that Western lowland gorillas use the ROM display during playful interactions. This response can also be elicited by caretakers, as shown in a study in P. pygmaeus that registered the facial and vocal responses of 21 orangutans to tickle-induced play by familiar caregivers. Play faces were observed in 70% of individuals, and the FPF was the most frequently observed (in 76.6% of the total play faces), followed by the bite face (15.8%), particularly in juvenile males, who tended to show more PFs than females (58 vs. 42%). Interestingly, 75% of orangutans produced silent play faces considering both sexes [97].
Palagi et al. [87] evaluated the facial expression and mimicry of captive chimpanzees and western lowland gorillas (Gorilla gorilla gorilla) during play fighting, finding significant differences between species that might be associated with their social dynamics. For example, gorillas performed more FPFs (0.021 ± 0.003 FPFs per s) than chimpanzees (0.013 ± 0.003 FPFs per s). Moreover, rapid facial mimicry (known as an involuntary, automatic, and rapid imitation of conspecific facial expressions [52]) prolonged play sessions in both species. This is relevant because play fighting can escalate into aggression, making it essential for primates to communicate their intentions. The difference in facial expressions between both species is also related to their social structure, where chimpanzees live in groups with several males and females forming high social bonds [100]. Contrarily, gorillas have low affiliative and inter-individual cohesion (with only one adult male and several adult females and their offspring) [101], where correct communication and facial expression are essential to avoid attacks.
On this matter, Cordoni et al. [102] reported that among playful sessions, the facial expressions of PF and FPF were present in 17.5% and were performed by the silverback male, while the rest were performed by an adult female (82.5%). Interestingly, FPF was immediately followed by play bite (76.7% of occurrence). This is also related to FPF being more common (80%) and longer during rough play as a possible way to communicate to the playmate that this is only a game and will not escalate to actual aggression [52]. This is a clear example of the importance of differentiating facial expressions because the FPF exposes both the upper and lower teeth but with a relaxed mouth, an expression that could be confused with or a mixture of the BT display known to be a signal of appeasement or submission [54,87].
The BT display is a facial expression where the lower and upper teeth are completely exposed (AU26 + 25 + 10 + 12 + 16) [20]. It could be confused with FPF; however, the corners of the mouth are retracted laterally, and the teeth are fully exposed. Additionally, the eyes are open or squinted [28]. BT displays are frequently observed during grooming, sexual interactions, or to avoid aggression and are performed by subordinate individuals when approaching a dominant individual [82]. The silent bared-teeth display (SBT) (also called grin, grimace, or fear face) is part of the facial expression repertoire of great apes [92,103] that has been observed during agonistic and submissive interactions that elicit fear and discomfort in subordinate animals [92,103,104].
A study in chimpanzees evaluated 337 BT during dyadic interactions. When considering an aggressive context, BT display was frequently directed towards dominants and during high-tension interactions (feeding) (100%), while SBT was most pronounced in a sexual context [28]. Similarly, a study in bonobos (Pan paniscus) showed that SBT displays occur during a sexual context (up to 22.8%) followed by affiliative interactions (up to 18.8%) in both adult and immature animals. They also found that SBT was not the most frequent facial expression during nonfeeding as a tension condition (1.3%). Similarly, vocalized BT was often present during a sexual context (48.6%) and did not increase during tension conditions (2.1%) [1].
BT screams or a screaming face with BT in great apes (AU10 + 12 + 16 + 25 + 27) [20] is a facial behavior related to fear [80,103]. Screams are exhibited during social contexts when there is nervousness, fear, and distress or during aggression bouts [105]. In Sumatran orangutans, the exposure to an audio recording of a long call produced facial expressions associated with fear, submission, aggression, and worry as part of their behavioral response to defend their territory [106]. Other studies have shown that Sumatran orangutans direct more attention to fear faces over angry and neutral faces, as well as the SBT expression during agonistic interactions [105].
Another facial expression reported in great apes is the pout face when the lips form a trumpet-like shape (AU17 + 22 + 25) [105]. This expression is mostly seen during affiliative (play behavior) and parental contexts [92], particularly in juvenile individuals [92]. Alert faces (AU16 + 25, AU25 + 26, or AU25 + 160) are frequently observed when chimpanzees respond to aggression or anxiety contexts [20,105], while pant-hoots, composed of AU22 + 25 + 26, express bivalent situations of excitement, whether a response to noises, distress, during play bouts, or food availability [105].
Several facial expressions have been identified in great apes, and external elements such as the context and individual factors such as the species, the age, the sex, or the social position within the group influence the meaning that the facial behavior has on animals. Although facial expressions can be related to a distinctive event, to date, it is uncertain whether they can express a solid emotion.

6. The Challenges of Assessing Emotional Facial Expressions in Great Apes

Great apes are not able to verbally convey their emotional state to humans. Some authors state that there is no strong evidence to guarantee that facial behaviors express internal states or are only produced during extreme emotional experiences [30]. Still, their neural and somatic pathways generate facial behaviors that are often associated with specific contexts that represent positive or negative stimuli (e.g., playing and agonistic interactions, respectively).
Assessing emotional responses through facial expression in primates is also challenging because the facial morphology of primates, their features, face shape, coloration, or presence of hair, could emphasize or camouflage certain facial movements [21]. For example, chimpanzee and orangutan infants tend to have bright skin circles around the eyes that could give the appearance that the eyes are fully open or the eyebrows are permanently raised [27]. While these facial features may interfere with human evaluation of facial expression, they serve as an evolutive communication trait for primates [80]. Additionally, other elements such as the environment of the animals (e.g., orangutans living in trees, where branches and leaves present obstacles to facial visualizing) could make facial evaluation difficult [27].
An alternative to further research on facial expressions to determine the underlying emotional state is to perform a comprehensive evaluation where not only facial behaviors are considered but also other elements that may indicate the level of arousal. Including physiological measures (e.g., heart rate, temperature, hormonal analysis, or behavioral assessment) could provide an exhaustive idea of the emotional display. However, as great apes (and primates in general) are not domestic species, their management demands highly controlled environments that might be stressful for the animals [93].
Currently, thermal imaging, a non-invasive method to assess changes in the surface temperature of a body as a response to sympathetic-mediated modulation, has been proposed as an alternative to evaluating emotional states [107,108]. Infrared thermography has been applied to measure emotional responses in humans, and this has been implemented in nonhuman primates. In monkey and great apes (common marmosets, capuchins, rhesus macaques, Bornean gibbons, and western lowland gorillas), Chotard et al. [109] compared two emotional states: positive during the interaction with toys and tickling; and negative during food delay and teasing. Positive stimulus caused a drop in the surface temperature of the nose tip (−0.5 °C in monkeys and −2 °C in great apes) and increases in the periorbital region (+0.4 °C in monkeys), while the negative event triggered increases in the upper lip temperature (+1.1 °C in monkeys and 0.3 °C in apes). The authors highlighted the evident thermal changes in both positive/negative contexts and mentioned that the increase in the upper lip was probably the result of blood flow increase due to tachycardia and α- and β-adrenergic influence. Moreover, the response during positive stimuli might be the result of blood flow redirection to the ocular region or increased breathing.
Similarly, decreases in the nasal temperature were reported in wild chimpanzees after exposure to conspecifics’ aversive vocalizations (−0.23 ± 0.45 °C), while non-aversive vocalizations increased ear surface temperature (+0.10 ± 0.25 °C) [110]. The authors discussed that more arousing stimuli cause a bigger blood flow shift or can increase the performance of the auditory system. This was also observed in wild adult chimpanzees during social competitive interactions, resulting in lower nasal surface temperatures (32–34 °C), in contrast to cooperative events (~33.5–34.5 °C) [111]. In the same species, Barrault et al. [112] concluded that social feeding on meat is perceived as a more stressful event (due to competition), according to the decreases in nose temperature. Nonetheless, as found by Heintz et al. [113] in lowland gorillas, thermal imaging can detect emotional arousal when exposed to positive reinforcement and cognitive tasks with familiar humans (nasal temperature decreased), but additional studies are required to determine the valence of the interaction. Additionally, there are practical limitations when evaluating thermal imagining in great apes (e.g., distance), and this needs to be considered, as well as using other parameters such as behavioral assessments [114].

7. Conclusions

Studying facial expressions in great apes is an intriguing topic due to their resemblance to human faces. Anatomically based studies using the human FACS as a base have shown that chimpanzees and orangutans share mimetic musculature and AUs; however, differences by species are reported (e.g., AUs exclusive to chimpanzees or the lack of a mimetic muscle). ChimpFACS and OrangFACS are reliable tools to code facial expressions objectively in different contexts. Although the FACS is different from a facial ethogram and does not infer animal emotions, making behavioral assessments when exposed to positive/negative contexts to further codify facial expressions according to AUs is a practical approach to further appraise facial behaviors in great apes as a contribution to facial emotion research.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data sharing is not applicable.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Vlaeyen, J.M.R.; Heesen, R.; Kret, M.E.; Clay, Z.; Bionda, T.; Kim, Y. Bared-teeth Displays in Bonobos (Pan Paniscus): An Assessment of the Power Asymmetry Hypothesis. Am. J. Primatol. 2022, 84, e23419. [Google Scholar] [CrossRef]
  2. Graham, K.E.; Badihi, G.; Safryghin, A.; Grund, C.; Hobaiter, C. A Socio-Ecological Perspective on the Gestural Communication of Great Ape Species, Individuals, and Social Units. Ethol. Ecol. Evol. 2022, 34, 235–259. [Google Scholar] [CrossRef]
  3. Parr, L.A. Facial Expression in Primate Communication. In Encyclopedia of Neuroscience; Elsevier: Amsterdam, The Netherlands, 2009; pp. 193–200. [Google Scholar]
  4. Rotenstreich, L.; Marom, A. “Untying the Knot”: The Primitive Orofacial Muscle Architecture in the Gorilla (Gorilla Gorilla) as a Key to the Evolution of Hominin Facial Movement. FASEB J. 2023, 37, e23137. [Google Scholar] [CrossRef]
  5. Waller, B.M.; Kavanagh, E.; Micheletta, J.; Clark, P.R.; Whitehouse, J. The Face Is Central to Primate Multicomponent Signals. Int. J. Primatol. 2022, 45, 526–542. [Google Scholar] [CrossRef]
  6. Domínguez-Oliva, A.; Mota-Rojas, D.; Hernández-Avalos, I.; Mora-Medina, P.; Olmos-Hernández, A.; Verduzco-Mendoza, A.; Casas-Alvarado, A.; Whittaker, A.L. The Neurobiology of Pain and Facial Movements in Rodents: Clinical Applications and Current Research. Front. Vet. Sci. 2022, 9, 1016720. [Google Scholar] [CrossRef]
  7. Di Giminiani, P.; Brierley, V.; Scollo, A. The Assessment of Facial Expressions in Piglets Undergoing Tail Docking and Castration: Toward the Development of the Piglet Grimace Scale. Front. Vet. Sci. 2016, 14, 100. [Google Scholar] [CrossRef]
  8. Lezama-García, K.; Orihuela, A.; Olmos-Hernández, A.; Reyes-Long, S.; Mota-Rojas, D. Facial Expressions and Emotions in Domestic Animals. CAB Rev. Perspect. Agric. Vet. Sci. Nutr. Nat. Resour. 2019, 14, 1–12. [Google Scholar] [CrossRef]
  9. Mota-Rojas, D.; Marcet-Rius, M.; Ogi, A.; Hernández-Ávalos, I.; Mariti, C.; Martínez-Burnes, J.; Mora-Medina, P.; Casas, A.; Domínguez, A.; Reyes, B.; et al. Current Advances in Assessment of Dog’s Emotions, Facial Expressions, and Their Use for Clinical Recognition of Pain. Animals 2021, 11, 3334. [Google Scholar] [CrossRef]
  10. Erickson, K.; Schulkin, J. Facial Expressions of Emotion: A Cognitive Neuroscience Perspective. Brain Cogn. 2003, 52, 52–60. [Google Scholar] [CrossRef]
  11. Davis, J.I.; Senghas, A.; Ochsner, K.N. How Does Facial Feedback Modulate Emotional Experience? J. Res. Pers. 2009, 43, 822–829. [Google Scholar] [CrossRef]
  12. Söderkvist, S.; Ohlén, K.; Dimberg, U. How the Experience of Emotion Is Modulated by Facial Feedback. J. Nonverbal Behav. 2018, 42, 129–151. [Google Scholar] [CrossRef] [PubMed]
  13. Coles, N.A.; March, D.S.; Marmolejo-Ramos, F.; Larsen, J.T.; Arinze, N.C.; Ndukaihe, I.L.G.; Willis, M.L.; Foroni, F.; Reggev, N.; Mokady, A.; et al. A Multi-Lab Test of the Facial Feedback Hypothesis by the Many Smiles Collaboration. Nat. Hum. Behav. 2022, 6, 1731–1742. [Google Scholar] [CrossRef] [PubMed]
  14. Mori, K.; Mori, H. Another Test of the Passive Facial Feedback Hypothesis: When Your Face Smiles, You Feel Happy. Percept. Mot. Skills 2009, 109, 76–78. [Google Scholar] [CrossRef] [PubMed]
  15. Coles, N.A.; Larsen, J.T.; Lench, H.C. A Meta-Analysis of the Facial Feedback Literature: Effects of Facial Feedback on Emotional Experience Are Small and Variable. Psychol. Bull. 2019, 145, 610–651. [Google Scholar] [CrossRef]
  16. Gothard, K.M. The Amygdalo-Motor Pathways and the Control of Facial Expressions. Front. Neurosci. 2014, 8, 43. [Google Scholar] [CrossRef]
  17. Clark, E.A.; Kessinger, J.; Duncan, S.E.; Bell, M.A.; Lahne, J.; Gallagher, D.L.; O’Keefe, S.F. The Facial Action Coding System for Characterization of Human Affective Response to Consumer Product-Based Stimuli: A Systematic Review. Front. Psychol. 2020, 11, 920. [Google Scholar] [CrossRef]
  18. Zych, A.D.; Gogolla, N. Expressions of Emotions across Species. Curr. Opin. Neurobiol. 2021, 68, 57–66. [Google Scholar] [CrossRef]
  19. Rosenberg, E.L.; Ekman, P. What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS), 3rd ed.; Oxford University Press: New York, NY, USA, 2020. [Google Scholar]
  20. Parr, L.A.; Waller, B.M.; Vick, S.J.; Bard, K.A. Classifying Chimpanzee Facial Expressions Using Muscle Action. Emotion 2007, 7, 172–181. [Google Scholar] [CrossRef]
  21. Vick, S.S.-J.; Waller, B.B.M.; Parr, L.A.; Smith Pasqualini, M.C.; Bard, K.A. A Cross-Species Comparison of Facial Morphology and Movement in Humans and Chimpanzees Using the Facial Action Coding System (FACS). J. Nonverbal Behav. 2007, 31, 1–20. [Google Scholar] [CrossRef]
  22. Bremhorst, A.; Mills, D.S.; Würbel, H.; Riemer, S. Evaluating the Accuracy of Facial Expressions as Emotion Indicators across Contexts in Dogs. Anim. Cogn. 2022, 25, 121–136. [Google Scholar] [CrossRef]
  23. Caeiro, C.C.; Burrows, A.; Waller, B.M. Development and Application of CatFACS: Are Human Cat Adopters Influenced by Cat Facial Expressions? Appl. Anim. Behav. Sci. 2017, 189, 66–78. [Google Scholar] [CrossRef]
  24. Wathan, J.; Burrows, A.A.M.; Waller, B.B.M.; McComb, K. EquiFACS: The Equine Facial Action Coding System. PLoS ONE 2015, 10, e0137818. [Google Scholar] [CrossRef]
  25. Parr, L.; Waller, B.; Burrows, A. MaqFACS: A Muscle-Based Facial Movement Coding System for the Rhesus Macaque. Am. J. Phys. Anthropol. 2010, 143, 625–630. [Google Scholar] [CrossRef] [PubMed]
  26. Waller, B.M.B.; Lembeck, M.; Kuchenbuch, P.; Burrows, A.M.; Liebal, K. GibbonFACS: A Muscle-Based Facial Movement Coding System for Hylobatids. Int. J. Primatol. 2012, 33, 809–821. [Google Scholar] [CrossRef]
  27. Caeiro, C.C.C.; Waller, B.M.B.; Zimmermann, E.; Burrows, A.M.; Davila-Ross, M. OrangFACS: A Muscle-Based Facial Movement Coding System for Orangutans (Pongo Spp.). Int. J. Primatol. 2013, 34, 115–129. [Google Scholar] [CrossRef]
  28. Kim, Y.; Vlaeyen, J.M.R.; Heesen, R.; Clay, Z.; Kret, M.E. The Association Between the Bared-Teeth Display and Social Dominance in Captive Chimpanzees (Pan Troglodytes). Affect. Sci. 2022, 3, 749–760. [Google Scholar] [CrossRef]
  29. Davila-Ross, M.; Dezecache, G. The Complexity and Phylogenetic Continuity of Laughter and Smiles in Hominids. Front. Psychol. 2021, 12, 648497. [Google Scholar] [CrossRef]
  30. Waller, B.M.; Julle-Daniere, E.; Micheletta, J. Measuring the Evolution of Facial ‘Expression’ Using Multi-Species FACS. Neurosci. Biobehav. Rev. 2020, 113, 1–11. [Google Scholar] [CrossRef]
  31. Zimmermann, B.; Castro, A.N.C.; Lendez, P.A.; Carrica Illia, M.; Carrica Illia, M.P.; Teyseyre, A.R.; Toloza, J.M.; Ghezzi, M.D.; Mota-Rojas, D. Anatomical and functional basis of facial expressions and their relationship with emotions in horses. Res. Vet. Sci. 2024, 180, 105418. [Google Scholar] [CrossRef]
  32. Adams, D.B.; Kitchen, D.M. Model vs. Playback Experiments: The Impact of Sensory Mode on Predator-specific Escape Responses in Saki Monkeys. Ethology 2020, 126, 563–575. [Google Scholar] [CrossRef]
  33. Putnam, P.T.; Chang, S.W.C. Toward a Holistic View of Value and Social Processing in the Amygdala: Insights from Primate Behavioral Neurophysiology. Behav. Brain Res. 2021, 411, 113356. [Google Scholar] [CrossRef] [PubMed]
  34. Mota-Rojas, D.; Lezama-García, K.; Domínguez-Oliva, A.; Olmos-Hernández, A.; Verduzco-Mendoza, A.; Casas-Alvarado, A.; Torres-Bernal, F.; Martínez-Burnes, J. Neurobiology of Emotions in Animal Relationships: Facial Expressions and Their Biological Functions in Mammals. J. Anim. Behav. Biometeorol. 2023, 11, e2023ss01. [Google Scholar] [CrossRef]
  35. Casanova, C.; Chalupa, L.M. The Dorsal Lateral Geniculate Nucleus and the Pulvinar as Essential Partners for Visual Cortical Functions. Front. Neurosci. 2023, 17, 1258393. [Google Scholar] [CrossRef] [PubMed]
  36. Mosher, C.P.; Zimmerman, P.E.; Gothard, K.M. Neurons in the Monkey Amygdala Detect Eye Contact during Naturalistic Social Interactions. Curr. Biol. 2014, 24, 2459–2464. [Google Scholar] [CrossRef] [PubMed]
  37. Ballotta, D.; Lui, F.; Porro, C.A.; Nichelli, P.F.; Benuzzi, F. Modulation of Neural Circuits Underlying Temporal Production by Facial Expressions of Pain. PLoS ONE 2018, 13, e0193100. [Google Scholar] [CrossRef]
  38. Taubert, J.; Japee, S.; Murphy, A.P.; Tardiff, C.T.; Koele, E.A.; Kumar, S.; Leopold, D.A.; Ungerleider, L.G. Parallel Processing of Facial Expression and Head Orientation in the Macaque Brain. J. Neurosci. 2020, 40, 8119–8131. [Google Scholar] [CrossRef]
  39. Brecht, M.; Freiwald, W.A. The Many Facets of Facial Interactions in Mammals. Curr. Opin. Neurobiol. 2012, 22, 259–266. [Google Scholar] [CrossRef]
  40. Freedman, D.J.; Ibos, G. An Integrative Framework for Sensory, Motor, and Cognitive Functions of the Posterior Parietal Cortex. Neuron 2018, 97, 1219–1234. [Google Scholar] [CrossRef]
  41. Müri, R.M. Cortical Control of Facial Expression. J. Comp. Neurol. 2016, 524, 1578–1585. [Google Scholar] [CrossRef]
  42. Waller, B.M.; Vick, S.-J.; Parr, L.A.; Bard, K.A.; Pasqualini, M.C.S.; Gothard, K.M.; Fuglevand, A.J. Intramuscular Electrical Stimulation of Facial Muscles in Humans and Chimpanzees: Duchenne Revisited and Extended. Emotion 2006, 6, 367–382. [Google Scholar] [CrossRef]
  43. Diogo, R.; Wood, B.A.; Aziz, M.A.; Burrows, A. On the Origin, Homologies and Evolution of Primate Facial Muscles, with a Particular Focus on Hominoids and a Suggested Unifying Nomenclature for the Facial Muscles of the Mammalia. J. Anat. 2009, 215, 300–319. [Google Scholar] [CrossRef] [PubMed]
  44. Tereshenko, V.; Dotzauer, D.C.; Maierhofer, U.; Festin, C.; Luft, M.; Laengle, G.; Politikou, O.; Klein, H.J.; Blumer, R.; Aszmann, O.C.; et al. Selective Denervation of the Facial Dermato-Muscular Complex in the Rat: Experimental Model and Anatomical Basis. Front. Neuroanat. 2021, 15, 650761. [Google Scholar] [CrossRef] [PubMed]
  45. Kunz, M.; Meixner, D.; Lautenbacher, S. Facial Muscle Movements Encoding Pain—A Systematic Review. Pain 2019, 160, 535–549. [Google Scholar] [CrossRef] [PubMed]
  46. Xu, X.; de Sa, V.R. Exploring Multidimensional Measurements for Pain Evaluation Using Facial Action Units. In Proceedings of the 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), Buenos Aires, Argentina, 16–20 November 2020; pp. 786–792. [Google Scholar]
  47. Ekman, P.; Friesen, W.V. Measuring Facial Movement. Environ. Psychol. Nonverbal Behav. 1976, 1, 56–75. [Google Scholar] [CrossRef]
  48. Darwin, C. The Expression of the Emotions in Man and Animals; John Murray: London, UK, 1872. [Google Scholar]
  49. Dolensek, N.N.; Gehrlach, D.A.; Klein, A.S.; Gogolla, N. Facial Expressions of Emotion States and Their Neuronal Correlates in Mice. Science 2020, 368, 89–94. [Google Scholar] [CrossRef]
  50. Chevalier-Skolnikoff, S. Facial Expression of Emotion in Nonhuman Primates. In Darwin and Facial Expression: A Century of Research in Review; Ekman, P., Ed.; Malor Books: San Jose, CA, USA, 2006; pp. 11–83. [Google Scholar]
  51. Dobson, S.D. Allometry of Facial Mobility in Anthropoid Primates: Implications for the Evolution of Facial Expression. Am. J. Phys. Anthropol. 2009, 138, 70–81. [Google Scholar] [CrossRef]
  52. Waller, B.M.; Cherry, L. Facilitating Play Through Communication: Significance of Teeth Exposure in the Gorilla Play Face. Am. J. Primatol. 2012, 74, 157–164. [Google Scholar] [CrossRef]
  53. Brockman, B.K.; Taylor, V.A.; Brockman, C.M. The Price of Unconditional Love: Consumer Decision Making for High-Dollar Veterinary Care. J. Bus. Res. 2008, 61, 397–405. [Google Scholar] [CrossRef]
  54. Palagi, E. Not Just for Fun! Social Play as a Springboard for Adult Social Competence in Human and Non-Human Primates. Behav. Ecol. Sociobiol. 2018, 72, 90. [Google Scholar] [CrossRef]
  55. Iki, S.; Kutsukake, N. Play Face in Japanese Macaques Reflects the Sender’s Play Motivation. Anim. Cogn. 2023, 26, 849–859. [Google Scholar] [CrossRef]
  56. Palagi, E.; Mancini, G. Playing with the Face: Playful Facial “Chattering” and Signal Modulation in a Monkey Species (Theropithecus Gelada). J. Comp. Psychol. 2011, 125, 11–21. [Google Scholar] [CrossRef] [PubMed]
  57. Palagi, E. Social Play in Bonobos (Pan Paniscus) and Chimpanzees (Pan Troglodytes): Implicationsfor Natural Social Systems and Interindividual Relationships. Am. J. Phys. Anthropol. 2006, 129, 418–426. [Google Scholar] [CrossRef] [PubMed]
  58. Palagi, E. Sharing the Motivation to Play: The Use of Signals in Adult Bonobos. Anim. Behav. 2008, 75, 887–896. [Google Scholar] [CrossRef]
  59. Palagi, E.; Cordoni, G. The Right Time to Happen: Play Developmental Divergence in the Two Pan Species. PLoS ONE 2012, 7, e52767. [Google Scholar] [CrossRef]
  60. Sotocinal, S.G.; Sorge, R.E.; Zaloum, A.; Tuttle, A.H.; Martin, L.J.; Wieskopf, J.S.; Mapplebeck, J.C.; Wei, P.; Zhan, S.; Zhang, S.; et al. The Rat Grimace Scale: A Partially Automated Method for Quantifying Pain in the Laboratory Rat via Facial Expressions. Mol. Pain 2011, 7, 55. [Google Scholar] [CrossRef]
  61. Domínguez-Oliva, A.; Olmos-Hernández, A.; Hernández-Ávalos, I.; Lecona-Butrón, H.; Mora-Medina, P.; Mota-Rojas, D. Rat Grimace Scale as a Method to Evaluate Animal Welfare, Nociception, and Quality of the Euthanasia Method of Wistar Rats. Animals 2023, 13, 3161. [Google Scholar] [CrossRef]
  62. Matsumiya, L.C.; Sorge, R.E.; Sotocinal, S.G.; Tabaka, J.M.; Wieskopf, J.S.; Zaloum, A.; King, O.D.; Mogil, J.S. Using the Mouse Grimace Scale to Reevaluate the Efficacy of Postoperative Analgesics in Laboratory Mice. J. Am. Assoc. Lab. Anim. Sci. 2012, 51, 42–49. [Google Scholar]
  63. Häger, C.; Biernot, S.; Buettner, M.; Glage, S.; Keubler, L.M.; Held, N.; Bleich, E.M.; Otto, K.; Müller, C.W.; Decker, S.; et al. The Sheep Grimace Scale as an Indicator of Post-Operative Distress and Pain in Laboratory Sheep. PLoS ONE 2017, 12, e0175839. [Google Scholar] [CrossRef]
  64. Dalla Costa, E.; Minero, M.; Lebelt, D.; Stucke, D.; Canali, E.; Leach, M.C. Development of the Horse Grimace Scale (HGS) as a Pain Assessment Tool in Horses Undergoing Routine Castration. PLoS ONE 2014, 9, e92281. [Google Scholar] [CrossRef]
  65. Reijgwart, M.L.M.M.L.; Schoemaker, N.J.N.; Pascuzzo, R.; Leach, M.C.; Stodel, M.; De Nies, L.; Hendriksen, C.F.M.M.; van der Meer, M.; Vinke, C.M.; van Zeeland, Y.R.A.A. The Composition and Initial Evaluation of a Grimace Scale in Ferrets after Surgical Implantation of a Telemetry Probe. PLoS ONE 2017, 12, e0187986. [Google Scholar] [CrossRef]
  66. Vullo, C.; Barbieri, S.; Catone, G.; Graïc, J.-M.; Magaletti, M.; Di Rosa, A.; Motta, A.; Tremolada, C.; Canali, E.; Dalla Costa, E. Is the Piglet Grimace Scale (PGS) a Useful Welfare Indicator to Assess Pain after Cryptorchidectomy in Growing Pigs? Animals 2020, 10, 412. [Google Scholar] [CrossRef] [PubMed]
  67. Hansen, M.F.; Baxter, E.M.; Rutherford, K.M.D.; Futro, A.; Smith, M.L.; Smith, L.N. Towards Facial Expression Recognition for On-Farm Welfare Assessment in Pigs. Agriculture 2021, 11, 847. [Google Scholar] [CrossRef]
  68. Hampshire, V.; Robertson, S. Using the Facial Grimace Scale to Evaluate Rabbit Wellness in Post-Procedural Monitoring. Lab. Anim. 2015, 44, 259–260. [Google Scholar] [CrossRef]
  69. Holden, E.; Calvo, G.; Collins, M. Evaluation of Facial Expression in Acute Pain in Cats. J. Small Anim. Pract. 2014, 55, 615–621. [Google Scholar] [CrossRef] [PubMed]
  70. Evangelista, M.; Watanabe, R.; Leung, V. Facial Expresions of Pain in Cats: The Development and Validation of a Feine Grimace Scale. Sci. Rep. 2019, 9, 19128. [Google Scholar] [CrossRef] [PubMed]
  71. MacRae, A.M.; Makowska, I.; Fraser, D.; Joanna Makowska, I.; Fraser, D.; Makowska, I.; Fraser, D. Initial Evaluation of Facial Expressions and Behaviours of Harbour Seal Pups (Phoca Vitulina) in Response to Tagging and Microchipping. Appl. Anim. Behav. Sci. 2018, 205, 167–174. [Google Scholar] [CrossRef]
  72. Kaminski, J.; Waller, B.M.; Diogo, R.; Hartstone-Rose, A.; Burrows, A.M. Evolution of Facial Muscle Anatomy in Dogs. Proc. Natl. Acad. Sci. USA 2019, 116, 14677–14681. [Google Scholar] [CrossRef]
  73. Mota-Rojas, D.; Strappini, A.; Whittaker, A.L.; Ghezzi, M.; Titto, C.G.; Calderón-Maldonado, N.; Mora-Medina, P.; Domínguez-Oliva, A.; Gómez-Prado, J.; Hernández-Ávalos, I.; et al. Controversial Topics in Animal Welfare in Latin America: A Focus on the Legislation Surrounding the Human-Companion Animal Relationship and Animals Used for Recreational Practices. Animals 2023, 13, 1463. [Google Scholar] [CrossRef]
  74. Marcantonio Coneglian, M.; Duarte Borges, T.; Weber, S.H.; Godoi Bertagnon, H.; Michelotto, P.V. Use of the Horse Grimace Scale to Identify and Quantify Pain Due to Dental Disorders in Horses. Appl. Anim. Behav. Sci. 2020, 225, 104970. [Google Scholar] [CrossRef]
  75. Bennett, V.; Gourkow, N.; Mills, D. Facial Correlates of Emotional Behaviour in the Domestic Cat (Felis Catus). Behav. Process. 2017, 141, 342–350. [Google Scholar] [CrossRef]
  76. Miller, A.; Leach, M. The Mouse Grimace Scale: A Clinically Useful Tool? PLoS ONE 2015, 10, e0136000. [Google Scholar] [CrossRef] [PubMed]
  77. Dawes, T.R.; Eden-Green, B.; Rosten, C.; Giles, J.; Governo, R.; Marcelline, F.; Nduka, C. Objectively Measuring Pain Using Facial Expression: Is the Technology Finally Ready? Pain Manag. 2018, 8, 105–113. [Google Scholar] [CrossRef] [PubMed]
  78. Burrows, A.A.M. The Facial Expression Musculature in Primates and Its Evolutionary Significance. BioEssays 2008, 30, 212–225. [Google Scholar] [CrossRef] [PubMed]
  79. Burrows, A.M.; Waller, B.M.; Parr, L.A.; Bonar, C.J. Muscles of Facial Expression in the Chimpanzee (Pan Troglodytes): Descriptive, Comparative and Phylogenetic Contexts. J. Anat. 2006, 208, 153–167. [Google Scholar] [CrossRef]
  80. Kret, M.; Prochazkova, E.; Sterck, H.; Clay, Z. Emotional Expressions in Human and Non-Human Great Apes. Neurosci. Biobehav. Rev. 2020, 115, 378–395. [Google Scholar] [CrossRef]
  81. Parr, L.A.; Waller, B.M.; Heintz, M. Facial Expression Categorization by Chimpanzees Using Standardized Stimuli. Emotion 2008, 8, 216–231. [Google Scholar] [CrossRef]
  82. Parr, L.A.; Waller, B.M. Understanding Chimpanzee Facial Expression: Insights into the Evolution of Communication. Soc. Cogn. Affect. Neurosci. 2006, 1, 221–228. [Google Scholar] [CrossRef]
  83. Rychlowska, M.; Jack, R.E.; Garrod, O.G.B.; Schyns, P.G.; Martin, J.D.; Niedenthal, P.M. Functional Smiles: Tools for Love, Sympathy, and War. Psychol. Sci. 2017, 28, 1259–1270. [Google Scholar] [CrossRef]
  84. Petersen, R.M.; Higham, J.P. The Role of Sexual Selection in the Evolution of Facial Displays in Male Non-Human Primates and Men. Adapt. Hum. Behav. Physiol. 2020, 6, 249–276. [Google Scholar] [CrossRef]
  85. Parr, L.A.; Waller, B.M.; Fugate, J. Emotional Communication in Primates: Implications for Neurobiology. Curr. Opin. Neurobiol. 2005, 15, 716–720. [Google Scholar] [CrossRef]
  86. Coria-Avila, G.A.; Pfaus, J.G.; Orihuela, A.; Domínguez-Oliva, A.; José-Pérez, N.; Hernández, L.A.; Mota-Rojas, D. The Neurobiology of Behavior and Its Applicability for Animal Welfare: A Review. Animals 2022, 12, 928. [Google Scholar] [CrossRef] [PubMed]
  87. Palagi, E.; Norscia, I.; Pressi, S.; Cordoni, G. Facial Mimicry and Play: A Comparative Study in Chimpanzees and Gorillas. Emotion 2019, 19, 665–681. [Google Scholar] [CrossRef] [PubMed]
  88. Descovich, K. Facial Expression: An under-Utilised Tool for the Assessment of Welfare in Mammals. ALTEX 2017, 34, 409–429. [Google Scholar] [CrossRef] [PubMed]
  89. Parr, L.A.; Cohen, M.; Waal, F. de Influence of Social Context on the Use of Blended and Graded Facial Displays in Chimpanzees. Int. J. Primatol. 2005, 26, 73–103. [Google Scholar] [CrossRef]
  90. Tanner, J.E. Gestural Phrases and Gestural Exchanges by a Pair of Zoo-Living Lowland Gorillas. Gesture 2004, 4, 1–24. [Google Scholar] [CrossRef]
  91. Tanner, J.E.; Byrne, R.W. Concealing Facial Evidence of Mood: Perspective-Taking in a Captive Gorilla? Primates 1993, 34, 451–457. [Google Scholar] [CrossRef]
  92. Liebal, K.; Pika, S.; Tomasello, M. Gestural Communication of Orangutans (Pongo Pygmaeus). Gesture 2006, 6, 1–38. [Google Scholar] [CrossRef]
  93. Nieuwburg, E.G.I.; Ploeger, A.; Kret, M.E. Emotion Recognition in Nonhuman Primates: How Experimental Research Can Contribute to a Better Understanding of Underlying Mechanisms. Neurosci. Biobehav. Rev. 2021, 123, 24–47. [Google Scholar] [CrossRef]
  94. Davila Ross, M.; Menzler, S.; Zimmermann, E. Rapid Facial Mimicry in Orangutan Play. Biol. Lett. 2008, 4, 27–30. [Google Scholar] [CrossRef]
  95. Demuru, E.; Ferrari, P.F.; Palagi, E. Emotionality and Intentionality in Bonobo Playful Communication. Anim. Cogn. 2015, 18, 333–344. [Google Scholar] [CrossRef]
  96. Bresciani, C.; Cordoni, G.; Palagi, E. Playing Together, Laughing Together: Rapid Facial Mimicry and Social Sensitivity in Lowland Gorillas. Curr. Zool. 2022, 68, 560–569. [Google Scholar] [CrossRef] [PubMed]
  97. Schepers, K. Do Orangutan Really Laugh? An Investigation into the Existence of Tickle-Induced Play Vocalizations among Pongo Pygmaeus at the Orangutan Care Centre and Quarantine in Kalimatan, Indonesia. Master’s Thesis, Simon Fraser University, Burnaby, BC, Canada, 2013. [Google Scholar]
  98. Waller, B.M.; Caeiro, C.C.; Davila-Ross, M. Orangutans Modify Facial Displays Depending on Recipient Attention. PeerJ 2015, 3, e827. [Google Scholar] [CrossRef] [PubMed]
  99. Davila-Ross, M.; Jesus, G.; Osborne, J.; Bard, K.A. Chimpanzees (Pan Troglodytes) Produce the Same Types of ‘Laugh Faces’ When They Emit Laughter and When They Are Silent. PLoS ONE 2015, 10, e0127337. [Google Scholar] [CrossRef] [PubMed]
  100. Reddy, R.B.; Sandel, A.A. Social Relationships between Chimpanzee Sons and Mothers Endure but Change during Adolescence and Adulthood. Behav. Ecol. Sociobiol. 2020, 74, 150. [Google Scholar] [CrossRef]
  101. Forcina, G.; Vallet, D.; Le Gouar, P.J.; Bernardo-Madrid, R.; Illera, G.; Molina-Vacas, G.; Dréano, S.; Revilla, E.; Rodríguez-Teijeiro, J.D.; Ménard, N.; et al. From Groups to Communities in Western Lowland Gorillas. Proc. R. Soc. B Biol. Sci. 2019, 286, 20182019. [Google Scholar] [CrossRef]
  102. Cordoni, G.; Pirarba, L.; Elies, S.; Demuru, E.; Guéry, J.-P.; Norscia, I. Adult–Adult Play in Captive Lowland Gorillas (Gorilla Gorilla Gorilla). Primates 2022, 63, 225–235. [Google Scholar] [CrossRef]
  103. Aldrich, B.C. Facial Expressions in Performing Primates: Could Public Perceptions Impact Primate Welfare? University of Edinburgh: Edinburgh, Scotland, 2015. [Google Scholar]
  104. Van Hooff, J.A.R.A.M.; Preuschoft, S. Laughter and Smiling: The Intertwining of Nature and Culture. In Animal Social Complexity; de Waal, F.B., Ed.; Harvard University Press: Cambridge, MA, USA, 2003; pp. 260–287. [Google Scholar]
  105. Pritsch, C.; Telkemeyer, S.; Mühlenbeck, C.; Liebal, K. Perception of Facial Expressions Reveals Selective Affect-Biased Attention in Humans and Orangutans. Sci. Rep. 2017, 7, 7782. [Google Scholar] [CrossRef]
  106. Nazif, R.; Gholib, G.; Rahmi, E.; Sayuti, A.; Lubis, T.M.; Balqis, U. The Effect of Audio Recording for Playback Experiment to the Alteration of Orangutan’s Territorial Behavior. J. Med. Vet. 2018, 12, 15–23. [Google Scholar] [CrossRef]
  107. Travain, T.; Valsecchi, P. Infrared Thermography in the Study of Animals’ Emotional Responses: A Critical Review. Animals 2021, 11, 2510. [Google Scholar] [CrossRef]
  108. Mota-Rojas, D.; Pereira, A.M.F.; Martínez-Burnes, J.; Domínguez-Oliva, A.; Mora-Medina, P.; Casas-Alvarado, A.; Rios-Sandoval, J.; de Mira Geraldo, A.; Wang, D. Thermal Imaging to Assess the Health Status in Wildlife Animals under Human Care: Limitations and Perspectives. Animals 2022, 12, 3558. [Google Scholar] [CrossRef]
  109. Chotard, H.; Ioannou, S.; Davila-Ross, M. Infrared Thermal Imaging: Positive and Negative Emotions Modify the Skin Temperatures of Monkey and Ape Faces. Am. J. Primatol. 2018, 80, e22863. [Google Scholar] [CrossRef] [PubMed]
  110. Dezecache, G.; Zuberbühler, K.; Davila-Ross, M.; Dahl, C.D. Skin Temperature Changes in Wild Chimpanzees upon Hearing Vocalizations of Conspecifics. R. Soc. Open Sci. 2017, 4, 160816. [Google Scholar] [CrossRef] [PubMed]
  111. de Vevey, M.; Bouchard, A.; Soldati, A.; Zuberbühler, K. Thermal Imaging Reveals Audience-Dependent Effects during Cooperation and Competition in Wild Chimpanzees. Sci. Rep. 2022, 12, 2972. [Google Scholar] [CrossRef] [PubMed]
  112. Barrault, C.; Soldati, A.; Hobaiter, C.; Mugisha, S.; De Moor, D.; Zuberbühler, K.; Dezecache, G. Thermal Imaging Reveals Social Monitoring during Social Feeding in Wild Chimpanzees. Philos. Trans. R. Soc. B Biol. Sci. 2022, 377, 20210302. [Google Scholar] [CrossRef]
  113. Heintz, M.R.; Fuller, G.; Allard, S. Exploratory Investigation of Infrared Thermography for Measuring Gorilla Emotional Responses to Interactions with Familiar Humans. Animals 2019, 9, 604. [Google Scholar] [CrossRef]
  114. Ross, S.R.; Lake, B.R.; Fultz, A.; Hopper, L.M. An Evaluation of Thermal Imaging as a Welfare Monitoring Tool for Captive Chimpanzees. Primates 2021, 62, 919–927. [Google Scholar] [CrossRef]
Figure 1. Modulation of visual and auditory stimuli and its influence on facial expression. After perceiving a threatening event (e.g., agonistic interactions with conspecifics), great apes respond to both visual and auditory stimuli. After the integration of both inputs, the connections from the thalamus to the amygdala are the first step in modifying the facial expression. From the amygdala, direct projections to the motor cortex and, subsequently, to the facial nerve modulate facial expression and mimetic muscles.
Figure 1. Modulation of visual and auditory stimuli and its influence on facial expression. After perceiving a threatening event (e.g., agonistic interactions with conspecifics), great apes respond to both visual and auditory stimuli. After the integration of both inputs, the connections from the thalamus to the amygdala are the first step in modifying the facial expression. From the amygdala, direct projections to the motor cortex and, subsequently, to the facial nerve modulate facial expression and mimetic muscles.
Animals 14 03414 g001
Figure 2. Motor control of facial expression and mimetic muscles in chimpanzees. M1: primary motor cortex; M3: anterior face area of the midcingulate motor cortex; M4: caudal area of the anterior middle cingulate; PMCVcl: premotor cortex ventrolateral division; SMA: supplementary motor area.
Figure 2. Motor control of facial expression and mimetic muscles in chimpanzees. M1: primary motor cortex; M3: anterior face area of the midcingulate motor cortex; M4: caudal area of the anterior middle cingulate; PMCVcl: premotor cortex ventrolateral division; SMA: supplementary motor area.
Animals 14 03414 g002
Table 1. Classification of AUs according to their name, description, and musculature in chimpanzees and orangutans.
Table 1. Classification of AUs according to their name, description, and musculature in chimpanzees and orangutans.
Action UnitNameDescriptionMusculatureChimpanzeeOrangutan
AU1Inner brow raiserPulls the medial and lateral parts of the brow upwardsFrontalis (medial)
AU2Outer brow raisePulls the medial and lateral parts of the brow upwardsFrontalis (lateral)
AU1 + 2Brow raiser Frontalis
AU4Brow lowererLowers the brow region and pulls downward the anterior part of the scalpProcerus
Depressor supercilli
Corrugator
AU5Upper lid raiserElevates the upper eyelidOrbicularis oculi
AU6Cheek raiserPulls the outer and upper areas of the cheeksOrbicularis oculi, pars orbitalis
AU7Lid tightenerPushes the skin under the eyelids towards the noseOrbicularis oculi, pars palpebralis
AU9Nose wrinkleHorizontal wrinkles above the noseLevator labii superioris alaeque nasi
AU10Upper lip raiserRaises the upper lipLevator labii superioris
AU11Nasiolabial furrow deepenerPulls the nasolabial furrow upwardsZygomatic minor
AU12Lip corner pullerPulls the corners of the lips backwardZygomatic major
AU13Sharp lip pullerPulls the corners of the lips upward without pulling them to the back Levator anguli oris
AU14DimplerTightens the corner of the lips with a visible oblique wrinkle in the cornerBuccinator
AU15Lip corner depressorPull the corners of the lips downwardTraingularis
AU16Lower lip depressorPulls the lower lip down, the lips partDepressor labii
AU17Chin raiserProtrudes the lipsMentalis
AU18Lip puckerPulls the lip corners medially causing the
mouth opening to shrink
Incisivii labii
AU20Lip stretcher Risorius
AU22Lip funnelerLips parted and everted in outward directionOrbicularis oris
AU23Lip tightenerTightens the lips causing vertical wrinkles below and above the mouthOrbicularis oris
AU24Lip presserPresses the lips together, bulging them above and belowOrbicularis oris
AU25Lips parted
AU26Jaw drop Nonmimetic muscle
AU27Mouth stretch Nonmimetic muscle
AU28Lip suckPulls the lips inward, stretching the skin over the teethOrbicularis oris
AU39Nostril compressorCompresses the nostrilsDepressor septi nasi, nasalis
AU43Eye closureCloses the eyesOrbicularis occuli
AU45BlinkCloses and opens the eyesOrbicularis occuli
Table 2. Facial expression of chimpanzees and their assigned AUs.
Table 2. Facial expression of chimpanzees and their assigned AUs.
Facial ExpressionAU
Bulging-lip displayAU17 + 24
Bared-teeth displayAU10 + 12 + 16 + 25
ScreamAU10 + 12 + 16 + 25 + 27
Pant-hootAU22 + 25 + 26
Relaxed open mouthAU12 + 25 + 26
Play faceAU12 + 25 + 26
Whimper AU12 + 22 + 25
PoutAU22 + 25
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Domínguez-Oliva, A.; Chávez, C.; Martínez-Burnes, J.; Olmos-Hernández, A.; Hernández-Avalos, I.; Mota-Rojas, D. Neurobiology and Anatomy of Facial Expressions in Great Apes: Application of the AnimalFACS and Its Possible Association with the Animal’s Affective State. Animals 2024, 14, 3414. https://doi.org/10.3390/ani14233414

AMA Style

Domínguez-Oliva A, Chávez C, Martínez-Burnes J, Olmos-Hernández A, Hernández-Avalos I, Mota-Rojas D. Neurobiology and Anatomy of Facial Expressions in Great Apes: Application of the AnimalFACS and Its Possible Association with the Animal’s Affective State. Animals. 2024; 14(23):3414. https://doi.org/10.3390/ani14233414

Chicago/Turabian Style

Domínguez-Oliva, Adriana, Cuauhtémoc Chávez, Julio Martínez-Burnes, Adriana Olmos-Hernández, Ismael Hernández-Avalos, and Daniel Mota-Rojas. 2024. "Neurobiology and Anatomy of Facial Expressions in Great Apes: Application of the AnimalFACS and Its Possible Association with the Animal’s Affective State" Animals 14, no. 23: 3414. https://doi.org/10.3390/ani14233414

APA Style

Domínguez-Oliva, A., Chávez, C., Martínez-Burnes, J., Olmos-Hernández, A., Hernández-Avalos, I., & Mota-Rojas, D. (2024). Neurobiology and Anatomy of Facial Expressions in Great Apes: Application of the AnimalFACS and Its Possible Association with the Animal’s Affective State. Animals, 14(23), 3414. https://doi.org/10.3390/ani14233414

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Article metric data becomes available approximately 24 hours after publication online.
Back to TopTop