Next Article in Journal
Genome-Wide Population Structure and Selection Signatures of Yunling Goat Based on RAD-seq
Previous Article in Journal
Autoclaved Diet with Inactivated Spores of Bacillus spp. Decreased Reproductive Performance of Muc2−/− and Muc2+/− Mice
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Facial Expressions of Horses Using Weighted Multivariate Statistics for Assessment of Subtle Local Pain Induced by Polylactide-Based Polymers Implanted Subcutaneously

by
Júlia R. G. Carvalho
1,
Pedro H. E. Trindade
2,
Gabriel Conde
1,
Marina L. Antonioli
3,
Michelli I. G. Funnicelli
4,
Paula P. Dias
5,
Paulo A. Canola
3,
Marcelo A. Chinelatto
5 and
Guilherme C. Ferraz
1,*
1
Department of Animal Morphology and Physiology, School of Agricultural and Veterinarian Sciences, São Paulo State University, FCAV/UNESP, Jaboticabal 14884-900, SP, Brazil
2
Department of Veterinary Surgery and Animal Reproduction, School of Veterinary Medicine and Animal Science, São Paulo State University, FMVZ/UNESP, Botucatu 18618-681, SP, Brazil
3
Department of Veterinary Clinical and Surgery, School of Agricultural and Veterinary Sciences, São Paulo State University, FCAV/UNESP, Jaboticabal 14884-900, SP, Brazil
4
Department of Technology, School of Agricultural and Veterinary Sciences, São Paulo State University, FCAV/UNESP, Jaboticabal 14884-900, SP, Brazil
5
Department of Materials Engineering, São Carlos School of Engineering, University of São Paulo, EESC/USP, São Carlos 13563-120, SP, Brazil
*
Author to whom correspondence should be addressed.
Animals 2022, 12(18), 2400; https://doi.org/10.3390/ani12182400
Submission received: 8 July 2022 / Revised: 7 September 2022 / Accepted: 8 September 2022 / Published: 13 September 2022
(This article belongs to the Section Equids)

Abstract

:

Simple Summary

Facial expression (FE) has been used for pain diagnosis in horses. The current study aimed to identify pain in horses undergoing under-skin polylactide-based polymer implantation. Five statistical methods for analyzing FE were used, including conventional and new approaches. First, we scored the seven FEs separately. Subsequently, the scores of the seven FEs were added (SUM). Subsequently, principal component analysis (PCoA) was performed using the scores of the seven FEs obtained using the first method. Afterwards, weights were created for each FE based on each variable’s contribution variability obtained from the PCoA (SUM.W). Finally, we applied a general score to the animal’s face (GFS). The horses were filmed before and 24 and 48 h after implantation. The tissue sensitivity to mechanical stimulation and skin temperature of the horses were assessed at the same time points. The results show no changes in the FEs analyzed separately or jointly. The horses with incision and suture but no polymer implant displayed a higher pain-related FE 48 h after implantation, while the horses implanted with polymers displayed more apparent alterations in the mechanical skin sensitivity and temperature. Our findings show that the five statistical methods used to analyze the faces of the horses were not able to detect low-grade inflammatory pain.

Abstract

Facial-expression-based analysis has been widely applied as a pain coding system in horses. Herein, we aimed to identify pain in horses undergoing subcutaneously polylactide-based polymer implantation. The sham group was submitted only to surgical incision. The horses were filmed before and 24 and 48 h after implantation. Five statistical methods for evaluating their facial expressions (FEs) were tested. Primarily, three levels of scores (0, 1, and 2) were applied to the seven FEs (ear movements, eyebrow tension, orbicularis tension, dilated nostrils, eye opening, muzzle tension, and masticatory muscles tension). Subsequently, the scores of the seven FEs were added (SUM). Afterwards, principal component analysis (PCoA) was performed using the scores of the seven FEs obtained using the first method. Subsequently, weights were created for each FE, based on each variable’s contribution variability obtained from the PCoA (SUM.W). Lastly, we applied a general score (GFS) to the animal’s face (0 = without pain; 1 = moderate pain; 2 = severe pain). The mechanical nociceptive threshold (MNT) and cutaneous temperature (CT) values were collected at the same moments. The results show no intra- or intergroup differences, when evaluating each FE separately or in the GFS. In the intragroup comparison and 48 h after implantation, the control group showed higher values for SUM, PCoA, and SUM.W, although the horses implanted with polymers displayed more obvious alterations in the CT and MNT. Our findings show that the five statistical strategies used to analyze the faces of the horses were not able to detect low-grade inflammatory pain.

1. Introduction

In recent decades, global society has shown more significant concern and care for the quality of life of non-human animals, in line with significant advances in the science of behavior and animal welfare [1]. The diagnosis or accurate quantification of a painful sensation represents a semiotic challenge due to the multidimensionality of pain, constituted by the combination of somatic, cognitive, and emotional components [2,3,4].
Better and early pain recognition and control are essential to improve welfare [5], as adequate pain management depends on the accuracy of pain assessment [6]. For pain diagnosis, physiological indicators such as heart rate, respiratory rate, and blood cortisol concentration could be used. However, these parameters are not specific to pain and can be changed due to many other situations. Thus, non-verbal communication, such as body language, has higher specificity and sensitivity to detect pain [7]. The behavioral expression of pain replaces the lack of verbal expression in animals [8] and is a useful tool because it is a non-invasive, non-intrusive, and practical method [9,10].
Studies have investigated pain based on behavior, showing generalizable indicators for several species (e.g., appetite, locomotion, activity). The behavior can also be species-specific, such as horses pawing, pigs wagging their tails intensely and continuously, and cattle lying in a prone position with the full or partial extension of one or both hind limbs [11,12,13]. A study recently showed that the spontaneous blink rate could also be a reliable method to measure stress and attention in horses subjected to a controlled “sham clipping” (sight and sound of hair clippers) [14]. Although many studies focus on identifying pain and other types of stressful stimuli in animals, no method is considered the gold standard for horses [15,16].
The challenge of measuring the degree of pain in animals is similar to that of measuring pain in human patients who have difficulty with verbal communication. One solution to this restriction was the creation of an ethogram of human facial tensions and contractions (Facial Action Coding System; FACS; [17]), which has presented promising results in detecting pain in individuals with dementia [18] and in children [19]. In recent years, studies with non-human animals have followed this medical trend. Therefore, enormous effort has been invested in recognizing subtle behavioral changes associated with pain in animals. Using a new approach, facial expressions have been identified in several species, and scales have been developed to measure pain in mice [20,21,22,23], rats [24,25,26], rabbits [27,28,29,30], ferrets [31], seal [32], cats [33,34], pigs [35,36,37,38], cattle [39,40,41], and sheep [8,42,43,44].
Facial features in horses have been studied after surgical castration procedures [45], in animals with acute colic syndrome [46], in pain inducement with the use of a tourniquet on the foreleg and a topical application of capsaicin [47], in animals with acute laminitis [48], in horses mounted during competitions [5,49], in the induction of positive emotions [50], and in the evaluation of the effect of exercise on ranch horses [51]. Recently, studies have used the face to evaluate dental disorders [52,53], the calming effect of aromatherapy [54], the effect of transportation and social isolation [55], sedation [56], and induced orthopedic pain [4,57]. Regarding pain, in general, studies have identified facial changes in horses subjected to moderate to severe pain conditions [45]. However, studies examining horses’ faces in clinical situations of subtle or mild pain are incipient.
Of all the studies that have examined facial changes in horses in painful situations, only one applied traditional methods to identify inflammation and local sensitivity [47]. The mechanical nociceptive threshold test may be performed using von Frey filaments, which reveals a nociceptive threshold used to mimic clinical conditions that present increased skin sensitivity, such as neuropathic pain, postoperative pain, inflammation, or osteoarthritis [58,59]. Furthermore, tissue lesions induce vasodilation and an increase in cellular exothermic metabolism, causing an increase in temperature at the injury site, a classic inflammation sign. The emission of heat from the body surface can be captured by infrared thermography, which may provide quantitative data on the degree of inflammation of the underlying tissues [60].
Despite the capacity of facial scales to discriminate between “pain-free” and “painful”, the developers of one scale questioned the ability to quantify pain using these instruments [47]. Facial expressions can present complex interpretations. For example, dilated nostrils are interpreted as postoperative pain [45] and orthopedic pain [57]. However, they were seen during transportation and social isolation [55] as well as after physical exercise, due to hyperventilation [51]. Another more complex example is partially or entirely closed eyes, which occurred after castration, being interpreted as pain [45], but which were also observed after physical exercise as signs of physical tiredness [51] and relaxation [50]. Closed eyes interpreted as pain can be related to exhaustion, due to the anesthetic and surgical procedure, and not exclusively to the pain process [47]. This characteristic is also expected to be displayed when the horse is asleep or resting [61]. Thus, it is evident that the same specific behavior can be exhibited due to different sensations.
This evidence suggests that a facial feature analyzed in isolation may result in a false-positive diagnosis or an overestimation of pain intensity. The recent literature reviews have indicated facial configuration analyses, represented by the joint assessment of facial features using multivariate statistical techniques [62,63], which have not yet been explored by previous studies. In this sense, it is possible that some facial features are more relevant than others in specific scenarios (different painful experiences, physical activity, rest, postoperative, etc.) [64], and that weights can be assigned to facial features to improve the diagnostic capacity of pain. These considerations have not yet been studied in the evaluation of facial expressions in horses.
Given the aforementioned information, studies have provided robust evidence that horses’ facial evaluations can be used as an important pain coding system [4,5,6,7,45,46,47,48,49,51,53,57,64]. However, it is still uncertain whether facial expressions are sensitive to classify pain quantitatively or if they can identify alterations associated with subtle pain, and if statistical approaches with weightings and multivariate methods can contribute to the quantification of pain.
In the present study, we investigated whether facial expressions could identify pain in horses submitted to subcutaneous implantation of polylactide-based materials, using different statistical strategies to analyze the face during the pain evaluation. We hypothesized that the evaluation of facial expressions allows for the diagnosis of facial expressions of horses, using weighted multivariate statistics to assess low-grade inflammatory pain in horses undergoing subcutaneous implantation of polylactide-based polymers, and that weighted multivariate approaches can diagnose subtle pain. It is important to highlight that this study is an opportunistic study, and the polymers used herein were previously tested to assess their biocompatibility and biodegradation in horses and were safe, with potential for use in equine medicine [65].

2. Materials and Methods

2.1. Ethics in the Use of Animals

All procedures performed followed the Ethical Principles in Animal Experimentation adopted by the National Council for Control in Animal Experimentation (CONCEA). The protocol was reviewed and approved by the Ethics Committee on the Use of Animals (CEUA, UNESP, Jaboticabal, Brazil (Protocol no. 006548/17)).

2.2. Preparation of Polymers

The blends were prepared according to Dias and Chinelatto (2019) [66]. A mixing process was carried out in the molten state, containing PLA Ingeo 3251D (Nature Works, Plymouth, MN, USA), PCL CapaTM 6500 (Perstorp, Malmö, Sweden), and compatibilizer Capa 7201ª (Perstorp, Malmö, Sweden). Before processing, the PLA was dried at 80 °C for 8 h in an air-circulating oven, and at 40 °C in a vacuum oven for at least 16 h. After drying the polymers, manual mechanical pre-mixing of the dried PLA/PCL granules with the compatibilizing agent was performed. The implants were made using hot pressing at 180 °C, with dimensions of 1 cm square (cm2) and 1 mm thick, and were sterilized with ethylene oxide [65].

2.3. Animals

Six adult mixed breed horses were used, three male and three female, with an average weight of 405 ± 37 kg and aged between 10 and 18 years, from the didactic herd of the Laboratory of Equine Exercise Physiology and Pharmacology (LAFEQ) at the Department of Animal Morphology and Physiology, FCAV/UNESP—Jaboticabal campus. The animals were kept in a paddock and fed 0.2% of their body weight in mash ration once a day, in addition to silage, mineral salt, and water ad libitum. Before the beginning of the experimental stages, to determine their health status, the animals were submitted to a complete physical examination. Hematological and biochemical exams were performed and may be observed in our previous study [65]. The horses were previously treated with anthelmintics, which was repeated every four months, and vaccinated against rabies, tetanus, Eastern and Western equine encephalomyelitis, and equine influenza types A1 and A2.

2.4. Experimental Groups

As the present work was an opportunistic study, we extracted information from content previously published by our research group [65]. The polymers were implanted subcutaneously on the lateral face of the neck in the prescapular region of the six horses in a balanced, randomized design, with a 14-day washout between implantations. This way, 12 lateral sides of the neck were used for implantation. The first group (PLA; n = 6) received a pure PLA implant on the right side of the neck. The second group (PLA/PCL; n = 6) received an implantation of the PLA/PCL blend on the left side of the neck. The third group, denoted the sham group (S; n = 12), was submitted only to the surgical incision, which was performed bilaterally, similarly to the groups implanted with the mentioned polymers (PLA or PLA/PCL).
In the present study, we used the implantation of the polymers (PLA and PLA/PCL) to form a single group, considering that, in the previous study [65], no changes in the cutaneous temperature or mechanical nociceptive threshold were detected throughout the experimental period between polymers. Thus, we studied two groups: the implanted group (IG; n = 12, with the two types of polymers—PLA and PLA/PCL) and the sham group (S; n = 12, only incision). The combination of the PLA and PLA/ PCL groups was possible because there was no statistical difference between them (as described below in the statistical analysis section).
The procedures for implanting the biomaterials (PLA or PLA/PCL), as well as obtention of the S group, were performed randomly, and, for the first procedure, two horses were used for the PLA group, two horses for the PLA/PCL group, and two horses for the S group. These procedures were repeated every 14 days until four implantations had been performed in each animal (PLA, PLA/PCL, and S in each lateral surface of the neck). This interval was stipulated so that there was no possible overlap of systemic inflammatory responses from previous implantations, and the plasma fibrinogen biomarker, an acute phase indicator of inflammation, was used as a guide. Thus, the procedures were performed if the fibrinogen concentrations were in the normal reference range for equine species [65].

2.5. Procedure for Implantation of Biopolymers

The hair was previously shaved in an area of approximately 8 cm2 of the lateral face of the neck, in the prescapular region (right or left). Subsequently, the animals were sedated by intravenous administration of detomidine hydrochloride (0.01 mg∙kg−1). An infiltrative anesthetic block around the incision site was performed with 2.0 mL of 2% lidocaine hydrochloride. A 2 cm horizontal skin incision was made with a No. 15 scalpel blade in the determined area on the lateral surface of the neck. Space was obtained between the skin and cutaneous muscle by blunt dissection, where the polymer was implanted. Subsequently, dermorraphy was performed in a simple interrupted pattern with nylon 0. At the end of the implantation procedure, sedation was reversed with the intravenous administration of yohimbine (0.12 mg∙kg−1). The postoperative period consisted of cleaning the area using gauze, 0.9% saline, and fly repellent ointment around the surgical wound once a day for 14 days. No type of analgesic and/or anti-inflammatory medication was provided during the experimental period. The stitches were removed on the 7th day after the surgical procedure. All surgical procedures were performed by the same surgeon (MLA).

2.6. Facial Expressions Evaluation

The horses’ faces were filmed with a video camera (XA10 A KIT, Canon, SP, Brazil) for 5 min. The horses were placed in a location that they were already acclimatized to and were not contained in horse stocks or tied up. The camera was positioned on a tripod approximately 2 m away from the animal and operated by a researcher familiar with the horses (JRGC). The researcher positioned themselves approximately three meters from the horses without looking at them (directly in the eyes), behaving in the most disinterested way possible. The videos were always recorded in the same place, 1 h before and 24 and 48 h after the implantation procedure. Two 30 s video clips from each evaluation moment were extracted from the raw videos (5 min), which were selected with the condition that there was adequate lighting, a good profile, and minimal external disturbances, thus providing a clear and accurate view of the horses’ heads and facial features to be studied [48]. It is worth mentioning that the editing and randomization of the 30 s video clips were carried out by one of the authors (J.R.G.C.), who did not evaluate the behavior. The two video clips from the same moment were understood as a repetition.
The 30 s video clips were analyzed using ELAN software (ELAN Linguistic Annotator, version 4.9.4, Nijmegen, The Netherlands) by a double-blinded evaluator (PHET), using the continuous focal animal method [67]. The evaluator had experience in horses’ facial evaluation in a previously published study [51]. Before starting the evaluation of the video clips, 10 video clips belonging to the data set were selected randomly (JRGC) and evaluated twice (PHET), with an interval of 30 days, to calculate the intraobserver reliability (repeatability), using the two methodologies described below.
The 30 s video clips were scored using two methodologies. In the first, seven facial features were scored individually, as shown in Table 1. For the individual evaluation of facial features, the evaluator was allowed to watch the video clip as many times as necessary. In the second method, the general expression of the face was measured through an additional evaluation of the video clips, which occurred 30 days after the first method, applying only a general score to the animal’s face with three levels (0 = without pain; 1 = moderate pain; 2 = severe pain), without considering each characteristic separately. It should be mentioned that, for this, the observer analyzed each 30 s video clip only once.
The facial features evaluated in this study were defined based on two previously described pain assessment scales in horses. The first one, described by Gleerup et al. (2015) [48], consists of changes in the position of the ears, eyes, nostrils, and muscle tension. The second scale used was described by Dalla Costa et al. (2014) [46] and comprised facial action units, namely stiffly backwards ears, orbital tightening, tension above the eye area, prominent strained chewing muscles, mouth strained and pronounced chin, strained nostrils, and flattening of the profile.
Table 1. Descriptions of the 7 facial features and their scores adapted from Dalla Costa et al. (2014) [45] and Gleerup et al. (2015) [47].
Table 1. Descriptions of the 7 facial features and their scores adapted from Dalla Costa et al. (2014) [45] and Gleerup et al. (2015) [47].
Facial FeaturesScoresDescriptions
Ear movements0Ears directed forward or to the side in most of the video clip.
1Ears directed backwards at least once or in less than half of the video clip.
2Ears directed backward in most of the video clip or pressed against the neck at least once.
Eyebrow tension0Eyebrows not contracted during the video clip.
1Moderately * contracted eyebrows in most of the video clip.
2Intensely * contracted eyebrows in most of the video clip.
Orbicularis tension0Orbicularis muscle not contracted when blinking during the video clip.
1Orbicularis muscle moderately contracted when blinking at least once during the video clip.
2Orbicularis muscle intensely # contracted when blinking at least once during the video clip.
Dilated nostrils0Nostrils not dilated in most of the video clip.
1Nostrils moderately dilated in most of the video clip.
2Nostrils intensely dilated in most of the video clip.
Eye opening0Eyes completely open in most of the video clip.
1Eyes partially closed in most of the video clip.
2Eyes completely closed in most of the video clip.
Muzzle tension0Muzzle without tension during the video clip.
1Muzzle moderately tense in most of the video clip.
2Muzzle intensely tense in most of the video clip.
Masticatory muscles tension0Masticatory muscles without tension during the video clip.
1Masticatory muscles moderately tense in most of the video clip.
2Masticatory muscles intensely tense in most of the video clip.
* The words moderately and intensely are subjective terms that refer to the intensity of a contraction or tension scored according to the evaluator’s expertise based on the duration and number of evident wrinkles (folds). #—Blinking behavior was not included in the characteristic “Orbicularis tension”.

2.7. Thermographic Evaluation

The animals were taken to a closed, ventilated area, free from drafts and direct exposure to the sun. The implantation site was cleaned with dry gauze 30 min before the images were taken, and the area was not touched after cleaning. These procedures were performed to allow the animal to acclimatize to the room temperature. The temperature and humidity of the environment were controlled to standardize the thermal measurements. The animals were not sedated during the evaluations. An infrared thermographic camera (model i50, Flir Systems, Wilsonville, OR, United States) was used, with a sensitivity value of less than 0.1 °C, emissivity of 0.98, temperature variation from −20 to 350 °C, and a resolution of 140 × 140 pixels. To obtain thermographic images, the camera was positioned 0.5 m away, perpendicularly to the implantation site. The evaluations were carried out after filming for the facial expression evaluations at the same moments: 1 h before and 24 and 48 h after the procedure. All images were obtained by the same evaluator (JRGC). FLIR Tools software (FLIR Systems Inc, Wilsonville, OR, USA) was used to analyze the images. The images were evaluated by a blinded observer. An area of 10 cm2 was drawn on the thermographic image (IG and S), and the evaluations of the thermographic images were performed blindly. The software calculated the mean cutaneous temperature (CT) of the defined area for each moment.

2.8. Evaluation of Mechanical Nociceptive Threshold

The mechanical nociceptive threshold (MNT) testing technique has a valuable capacity to recognize altered nociceptive responses. Herein, we used von Frey filaments (FVFs) (Touch-TestTM Sensory Evaluators, Stoelting Company, Wood Dale, IL, USA) to evaluate the cutaneous MNT. In accordance with the guidelines of the manufacturer, six filaments with sizes from 5.07 to 6.65 were utilized, representing an applied force of 11.8 to 446.7 g, respectively. The filaments were applied perpendicularly to the animal’s skin until the nylon thread started to bend. Four applications were performed around the implantation sites at approximately 1 cm, with intervals of 3 s. Initially, the thinnest filament was used, the next filament was used when it was not possible to observe an aversive response, and so on, until the animals demonstrated an aversive response or the largest filament was used. The aversive response was defined as moving the tail, ears, or head, kicking, or stepping to the side (Table 2). Simple reflexes of movement at the first touch of the filament on the skin were not accepted as an aversion response, and, in these cases, the test was repeated after 10 s. The evaluations were carried out immediately after thermographic evaluation, 1 h before and 24 and 48 h after the procedure. The same operator performed all measurements (JRGC), with the horses in a quadrupedal position, in an area without movement restrictions. The values obtained were converted into force (g), in accordance with the table provided by the manufacturer.

2.9. Statistical Analysis

All statistical analyses were performed in R software with the RStudio integrated development environment (Version 4.0.2 (2020-06-22), RStudio, Inc., Auckland, New Zealand) (PHET), presenting the functions and packages used in the format “function {package}”. For all analyses, an α of 5% was considered. A priori, three analyses were performed as prerequisites for analyzing the database. The experimental groups from a previous study [65] performed by our team (PLA, PLA/PCL, and S) were compared at each time of assessment by the Kruskal–Wallis test (kruskal {agricolae}). The repeatability of the evaluator’s score was verified with the intraobserver reliability by applying the quadratic weighted kappa coefficient (cohen.kappa {psych}) and the test retest with the two-tailed paired Wilcoxon test (stats {wilcox.test}) among the 30 s video clips extracted from the same video and moment (repetition).
Subsequently, the facial expressions were evaluated using five different strategies (Figure 1). In the first strategy, the seven facial features were assessed individually. In the second (SUM), the scores of the seven facial features were added together. In the third strategy, principal component analysis (PCoA; princomp {stats}) was performed using the scores of the seven facial features of all groups and moments together, and the scores of the PCoAs for each animal (get_pca_ind {factoextra}) from the dimension representative were extracted (eigenvalue > 1 and variance > 20%; in our case, only the first dimension). The score of the PCoA algorithm is a vector that concentrates the information of all the variables included in the analysis, referring to the same dimension in a single value that can be understood as an index [68]. The load values were also calculated for each variable in the first two dimensions (get_pca_var {factoextra}). In the fourth strategy (SUM.W), weights were estimated for each facial feature based on the load value of each variable obtained from the PCoA in the first dimension. Thus, the load value of the variables in the first dimension was subtracted from the square root of the corresponding eigenvalue, thus extracting a weight for each variable [69]. Next, the gross scores of the seven features were added to the estimated weights, and a new sum was performed. Finally, the fifth strategy (GFS) consisted of awarding a general score for the faces of the horses without considering individual facial features.
Intragroup and intergroup comparisons over time were performed by analysis of variance applying mixed linear models (lmer {lme4}) for the models that presented the Gaussian residual distribution (resid {stats}) and were analyzed by histograms (hist {stats}), box graphics (boxplot {graphics}), and quantile–quantile (qqnorm {stats}). When the assumption of residual normality was not met, generalized mixed linear models were applied (glmer {lme4}). In both cases, the moments and the side of the neck were included in the models as fixed effects, and the random effects included the individual and the repetition, using Tukey’s test as a post hoc analysis (lsmeans {lsmeans}). Finally, to evaluate the relationship between the strategies adopted to evaluate the facial expressions, the MNT, and the CT, Spearman’s rank correlation coefficient was used (rcorr {Hmisc}), considering all the moments and experimental groups together. Exclusively for the correlation, the MNT and CT information was duplicated to match the number of behavioral measurements, which were collected twice for each animal at the same time (repetition for the test retest).
The heatmap method is a practical method for evaluating the grouping and determining the relationships among the variables. Heatmap and hierarchical clustering were performed using the ‘pheatmap’ function with default parameters (clustering_distance_cols = euclidean, clustering_method = complete) implemented in R (v.3.6.3) (R Core Team, Vienna, Austria).

3. Results

The experimental groups (PLA, PLA/PCL, and S) from our previous study presented no statistical differences between the current study’s moments. The repeatability test was performed to evaluate whether the observer presented consistency in the assessments. The intraobserver reliability was classified as good to very good. Very high agreements (k = 0.80 to 1.0) were found for 71% of the variables, while substantial agreements (k = 0.60 to 0.79) were found for 29% of the variables (Table 3). There was no difference between the scores of the two video clips of the same animal at the same moment (test retest) (Table 4).
The FVFs were used to detect nociceptive responses to the implantation of polymers using the mechanical nociceptive threshold (MNT). In the intragroup evaluation, in both experimental groups, the MNT was lower 24 and 48 h after the procedure compared to the baseline (Figure 2 and Table 5). Thermographic evaluation was used to detect alterations in the temperature pattern of the skin surface due to the heat emitted from the inflammatory response induced by implantation. In the S group, the CT was greater 24 and 48 h after the procedure compared to the baseline, while in the IG group, the CT was greater 48 h after the procedure, although there was a significant increase at 24 h (Figure 2 and Table 5). The heatmap shows the clustering of the scores obtained from evaluating each facial expression (FE) and the general facial score (GFS). The black and white gradient analyzes the scores’ contrast, that is, the response intensities observed. The white color indicates a score of 0, and the gray and black colors indicate scores are equivalent to 1 and 2, respectively. The constructed heatmap did not reveal any specific clusters based on the moment and group variables. In addition, the dendrogram (top of the figure) represents the hierarchical grouping, showing the distances between the scoring profiles for each observed variable. In the intergroup evaluation, there were no differences in the facial expressions. However, the CT was higher in the IG group 24 and 48 h after the procedure, while the MNT was lower in the IG group 24 and 48 h after the procedure (Figure 2, Figure 3 and Figure 4 and Table 5). When evaluating each facial feature separately and the GFS, it was not possible to observe intra- or intergroup differences (Figure 3). The SUM, PCoA, and SUM.W were higher 48 h after the procedure for the S group. In the IG group, we did not observe alterations in the statistical analyses performed (Figure 4 and Table 5).
The first and second dimensions of the PCoA accumulated more than half of the total variance (52%), and the load values for each facial feature of these two main dimensions are presented in Table 6 and Figure 5.
The variables of the facial expressions showed a very small significant correlation (−0.24 to 0.10) with the CT and MNT. Despite this, other significant correlations were observed (Table 7).

4. Discussion

To the best of our knowledge, this is the first study to investigate the ability of facial expression scales to detect pain in horses submitted to polymer implantation. Our findings suggest that the facial expressions were not able to be used to detect pain in the horses, even though all horses implanted with the polymers showed a local acute inflammatory process and skin sensitivity.
The choice to evaluate through video clips was based on the fact that facial expressions are dynamic and often complex and can change rapidly in response to a variety of environmental stimuli and emotional states, with specific movements, such as eyebrow tension and eye tightness, only being accurately distinguished if evaluated in sequence. Thus, the observation of videos may be of higher value for pain assessment [64,70]. Different biases can influence behavioral studies; however, the two prerequisites established for this study were met. The intraobserver reliability demonstrated that our experienced evaluator’s facial evaluation presented substantial to almost perfect repeatability [71]. In addition, in the test retest, there was no difference between the scores of the video clips from the same animal filmed at the same moment, showing that the video clips used as repetitions were equivalent and representative of the state of the animal at the moments evaluated. Therefore, we could understand that the facial features evaluated would not be expressed at a specific time within the total 5 min of recording, representing the state of the horse itself. In general, the test retest is the type of analysis that has not been considered in studies on facial expressions, despite its importance due to the subtlety of facial alterations and the speed with which they can be displayed or not displayed by animals [67].
In a recent study by our research team [65], the same horses were evaluated for six months after the subcutaneous implantation of polylactide-based materials, using established methods to detect inflammation and local sensitivity (MNT and CT). There was an acute and transient low-grade inflammatory process. To characterize if there was painful stimulus here in our opportunistic study, we evaluated the moments 24 and 48 h after the procedure, which were considered the peak of inflammation, based on the previous study [65]. The present study utilized a small number of horses, due to restricted horse availability, since it was an opportunistic study. Since the original study, which aimed to evaluate the biocompatibility and biodegradability of these polymers, was carried out on horses, an animal species that is not discarded at the end of the experiment, few implantations were performed. We decided to perform this study for better use of the research data and animals. In the present study, for both groups, the increase in the CT and reduction in the MNT 24 h and 48 h after implantation indicated an inflammatory process, which was interpreted as originating from the surgical procedure itself. The higher temperatures and lower MNTs observed in the IG group suggested a higher degree of an inflammatory response, which was expected because the implant material is exogenous to the organism, despite having shown biocompatibility [65,72,73]. Another possible explanation for this could be that implanted polyester biomaterials, such as PLA and PCL, would progressively release some acidic degradation products [74]. It could reduce the local pH, which could induce chemical leads via the release of pro-inflammatory mediators, evoking pain and a more evident inflammatory process [75].
Despite the inflammatory process and increase in local sensitivity found in our study, the strategies customarily used to analyze facial expressions (SUM and individual alterations in facial features) showed few changes after the procedure. Here, it is important to highlight that the recording of the facial expressions was performed with the horses standing still and not when we were inducing stimulus with the FVF, so it is possible, even likely, that there was no spontaneous/ongoing pain during the filming. It was expected that the increase in SUM, SUM.W, and PCoA 48 h after the procedure, as shown for the S group, would also be observed in the IG group. However, this did not occur. In the group with a more evident inflammatory process (IG), the facial expressions did not alter after the procedure. This could partially be explained by confounding factors, which may hinder the estimation of pain in horses [7].
It is important to consider that some facial features of pain can be affected by other cognitive states, so caution is needed when using them in other situations, for example, stressful situations, since simple management procedures could induce similar facial expressions [55,64]. For example, dilated nostrils can be perceived as pain in the postoperative period [45] and in induced orthopedic pain [57]. On the other hand, dilated nostrils were also observed after intense physical exercise [51] or stressful management conditions [55]. This can be explained by the fact that the respiratory rate increases during stress, pain, and exercise [55]. Another example is partially or entirely closed eyes that have been associated with post-castration pain [45], physical tiredness [51], exhaustion due to anesthetic and surgical procedure [47], relaxation and positive emotions [50], sleep or rest [61], or sedation [56]. Finally, eyebrow tension, which can occur as a response to painful stimulus [47], can also be expressed when the horse is curious, attentive, afraid, or surprised [61]. Based on these interrelationships mentioned above, if facial expressions are used individually as an indicator of pain, it is possible they would have high sensitivity, as they can be expressed in painful moments, but low specificity, because they can be displayed in pain-free moments due to other sensations that would trigger them. Thus, facial features cannot be interpreted singularly [62,63], eliminating false-positive diagnoses and the overestimation of pain.
Furthermore, there are some behaviors that can be influenced by the time of the day, such as increased walking, standing still, looking out the window during the day, and increased pelvic limb resting during the night [7], and the same can happen with facial expressions. For example, partially closed eyes can happen at night, because the horses are sleeping or resting [61], or, as we saw in this study, in the early morning, and can be confused with pain.
In this sense, we tested different strategies for evaluating facial expressions to deeply understand the findings obtained. Some of these strategies have not previously been applied in studies that used the facial evaluation of horses, for example, the extraction of the principal component analysis (PCoA) scores, the application of specific weightings to each face characteristic (SUM.W), and a general face score (GFS). In the first dimension of the principal component analysis, the masticatory muscles tension showed the highest loading value, highlighting its greater importance in the data set, followed by muzzle tension. In the same way, studies that have investigated pain in horses using the face have indicated an increase in these features at painful moments [45,46,47,48,49]. Thus, among the facial features evaluated in our study, the masticatory muscles and muzzle tension may be more relevant for pain evaluation in horses.
The differential of the PCoAs or SUM.W is that they consider a set of facial features that, as far as we know, has never been tested before, and we could denote it as a facial configuration. As previously explained, eyes partially or fully closed may indicate pain but may also indicate other sensations. However, when this specific characteristic is being exhibited concurrently with others that also signal pain, such as tension in the muzzle, eyebrows, and masticatory muscles, we could say that there is a display of pain in the facial configuration that comprises an integrated investigation of facial action units, which is an innovation presented in our study.
Our proposal for pain facial configuration is also based on the fact that, in general, animals in pain remain more immobile but tense [6,11,76], as just immobility would apply to a facial configuration of sleepiness or relaxation when the animal has closed eyes, muzzle, or lips and relaxed masticatory muscles [50,54,55]. On the other hand, a study showed that horses were more restless during pain induction [47]. Besides the biological reasons for using the scores obtained from PCoA or SUM.W, in the interpretation of facial expressions, there are also mathematical gains, such as the transformation of discrete variables (e.g., scores of 0, 1, and 2 or scores referring to the sum of a scale) into continuous variables. With this, it would be possible to find less variability in the data set and the application of more robust parametric statistical analyses than non-parametric data.
In the current study, it was not possible to evidence the presence of a pain face configuration using any strategy, which suggests that the polymer implantation may not have induced subtle pain or low-grade inflammatory pain in our horses. This finding can be partially explained by the complexity of pain evaluation in horses, which involves somatic, cognitive, and emotional components [2,3], and could be more complicated in subtle or mild pain [4,7]. In humans, it has been reported that facial expression in response to painful stimuli is less prominent in weak stimuli compared to strong stimuli, so it was difficult for the observer to detect the pain grade when the subjects felt mild pain [77].
A possible explanation for the lack of efficiency in pain behavior detection, by all five facial expression evaluation strategies adopted herein, is that spontaneous and subtle pain may not be ongoing, unlike induced pain or pain that originates postoperatively in more invasive procedures, which are used as a pain model by other studies with facial expressions in horses [4,7,45,46,47,48,52,57,64]. It is assumed that when the horse remains with its neck still, as in our filming, it does not feel pain or, perhaps, only slight discomfort. The animal could more easily exhibit pain when there is movement or manipulation of the inflamed area, as during the MNT test. Corroborating our reasoning, some authors state that the reaction triggered by palpation does not necessarily correlate with the level of pain experienced when the area is left untouched and, therefore, should be interpreted with caution [6]. Studies comparing the effects of hot iron branding and microchip transponder injection in adult horses [78] and foals [79] detected behavioral alterations associated with stress/pain, since, in both studies, the animals were observed while the procedures were performed.
In the same way, facial expressions at rest for horses with induced orthopedic pain can vary between horses and are of less value, since lame horses can modify their pain at rest by avoiding situations that may increase pain intensity, e.g., by decreasing the load on the painful limb. Furthermore, several other factors can lead to pain not being detected, such as the animal’s personality, which can influence the way it expresses pain, the presence of possible threats in the environment, which can lead the animal to suppress pain, the animal’s age, the type of pain, other emotional states, etc. In addition, the small number of horses used herein could have led to individuals’ variations in facial expressions, since pain is an experience related to personality, and it is not expected that all horses show the same expressions [57]. Moreover, it is important to understand that all behaviors and facial expressions are part of the non-verbal communication system of healthy horses, and it is their combination and frequency that can indicate if pain is present [4]. Thus, the gap in the results for pain detection in our study demonstrates the complexity of pain evaluation in some cases and a clear need for further studies focusing on pain of this nature.
Some limitations and implications of our work need to be recognized. In future studies, the proposed mathematical approaches could be tested on horses submitted to different pain intensities, in a dose vs. response type of study, with the video clips being watched by more than one evaluator to estimate the reproducibility (interobserver reliability). Comparisons of video and loco evaluations could also be performed. The small number of animals or the 12 lateral surfaces of the neck used herein could be a limitation for the principal component analysis. However, the PCA was performed following the indications of at least five observations per variable [80], even though studies with a more significant number of animals should be accomplished.
Regarding practical implications, our findings suggest that the application of facial expressions as a generalized tool to recognize nociception or subtle pain in horses must be carried out with caution. Mild or subtle pain should be further studied because, although to a lesser extent, it can represent a source of animal suffering that may be overlooked or underestimated, since they may feel pain only when the lesion is being stimulated. Nonetheless, pain in relation to palpation is relevant data; for example, if palpation or manipulation is painful, the analgesic treatment protocol may be changed, or local analgesics may be implemented [6]. Finally, more and more, this care is becoming relevant in the current global scenario, due to growing concern by society for the quality of life of non-human animals.

5. Conclusions

The findings of this research show that none of the five methodological strategies used to evaluate facial configurations could detect nociception or subtle pain in horses. It is challenging to detect such pain, since the resulting pain behavior is also subtle, sparsely appearing, and varying, so it could be more easily exhibited by the animal when there is movement or manipulation in the inflamed area. Therefore, the relationship between facial configuration and nociception or subtle pain needs to be better studied in future studies.

Author Contributions

Conceptualization, G.C.F., J.R.G.C. and P.H.E.T.; methodology, G.C.F., J.R.G.C., P.H.E.T., G.C., M.L.A. and P.A.C.; development and supply of the polymers, P.P.D. and M.A.C.; formal analysis, J.R.G.C., M.I.G.F. and P.H.E.T.; investigation, G.C.F., J.R.G.C. and P.H.E.T.; data curation, G.C.F., J.R.G.C., P.H.E.T., G.C., M.L.A., P.P.D. and P.A.C.; writing—original draft preparation, J.R.G.C., G.C. and P.H.E.T.; writing—review and editing, G.C.F. and P.H.E.T.; supervision, G.C.F., P.A.C. and M.A.C.; project administration, G.C.F. and J.R.G.C.; funding acquisition, G.C.F. and J.R.G.C. All authors have read and agreed to the published version of the manuscript.

Funding

This work was funded by the São Paulo Research Foundation (FAPESP, process no. 2017/10959-4 and process no. 2015/26738-1) and the National Council for Scientific and Technological Development (CNPq, process no. 132700/2017-4). Additionally, this study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior, Brasil (CAPES)—Finance Code 001.

Institutional Review Board Statement

The study was conducted according to the Ethical Principles in Animal Experimentation, adopted by the Brazilian College of Animal Experimentation, and was approved and supervised by the Ethics Committee on Animal Use of the CEUA, FCAV/Universidade Estadual Paulista (UNESP), under protocol no. 006548/17.

Informed Consent Statement

Not applicable.

Data Availability Statement

The raw/processed data required to reproduce these findings are available from the corresponding author upon reasonable request.

Acknowledgments

We thank Áureo Evangelista Santana, the Clinical Pathology Laboratory of the Veterinary Hospital (FCAV/UNESP) and the Laboratory of Equine Exercise Physiology and Pharmacology (LAFEQ) for their excellent technical assistance. We also thank the Graduate Course Program in Veterinary Medicine (FCAV/UNESP), the Graduate Course Program in Animal Science (FCAV/UNESP), and the Department of Animal Morphology and Physiology (FCAV/UNESP) for their academic support.

Conflicts of Interest

The authors declare that the research was conducted in the absence of commercial or financial relationships that could be interpreted as potential conflicts of interest.

References

  1. Webster, J. Animal Welfare: Freedoms, Dominions and “A Life Worth Living”. Animals 2016, 6, 35. [Google Scholar] [CrossRef] [PubMed]
  2. Price, D.D. Psychological and Neural Mechanisms of the Affective Dimension of Pain. Science 2000, 288, 1769–1772. [Google Scholar] [CrossRef]
  3. McKune, C.M.; Murrel, J.C.; Nolan, A.M.; White, K.L.; Wright, B.D. Nociception and pain. In Lumb & Jones Veterinary Anesthesia and Analgesia, 5th ed.; Grimm, K.A., Lamont, L.A., Tranquilli, W.J., Greene, S.A., Robertson, S.A., Eds.; John Wiley & Sons, Inc.: Ames, IA, USA, 2015. [Google Scholar]
  4. Broomé, S.; Ask, K.; Rashid-Engström, M.; Andersen, P.H.; Kjellström, H. Sharing pain: Using pain domain transfer for video recognition of low grade orthopedic pain in horses. PLoS ONE 2022, 17, e0263854. [Google Scholar] [CrossRef] [PubMed]
  5. Mullard, J.; Berger, J.M.; Ellis, A.D.; Dyson, S. Development of an ethogram to describe facial expressions in ridden horses (FEReq). J. Veter Behav. 2017, 18, 7–12. [Google Scholar] [CrossRef]
  6. Gleerup, K.C.B.; Lindegaard, C. Recognition and quantification of pain in horses: A tutorial review. Equine Vet. Educ. 2015, 28, 47–57. [Google Scholar] [CrossRef]
  7. Trindade, P.H.E.; Taffarel, M.O.; Luna, S.P.L. Spontaneous Behaviors of Post-Orchiectomy Pain in Horses Regardless of the Effects of Time of Day, Anesthesia, and Analgesia. Animals 2021, 11, 1629. [Google Scholar] [CrossRef]
  8. Silva, N.E.O.F.; Trindade, P.H.E.; Oliveira, A.R.; Taffarel, M.O.; Moreira, M.A.P.; Denadai, R.; Rocha, P.B.; Luna, S.P.L. Validation of the Unesp-Botucatu composite scale to assess acute postoperative abdominal pain in sheep (USAPS). PLoS ONE 2020, 15, e0239622. [Google Scholar] [CrossRef]
  9. Broom, D.M. Animal welfare: Concepts and measurement2. J. Anim. Sci. 1991, 69, 4167–4175. [Google Scholar] [CrossRef]
  10. de Grauw, J.; van Loon, J. Systematic pain assessment in horses. Vet. J. 2016, 209, 14–22. [Google Scholar] [CrossRef]
  11. Taffarel, M.; Luna, S.P.L.; De Oliveira, F.A.; Cardoso, G.S.; Alonso, J.D.M.; Pantoja, J.C.; Brondani, J.T.; Love, E.; Taylor, P.; White, K.; et al. Refinement and partial validation of the UNESP-Botucatu multidimensional composite pain scale for assessing postoperative pain in horses. BMC Vet. Res. 2015, 11, 83. [Google Scholar] [CrossRef] [Green Version]
  12. Luna, S.P.L.; De Araújo, A.L.; Neto, P.I.D.N.; Brondani, J.T.; De Oliveira, F.A.; Azerêdo, L.M.D.S.; Telles, F.G.; Trindade, P.H.E. Validation of the UNESP-Botucatu pig composite acute pain scale (UPAPS). PLoS ONE 2020, 15, e0233552. [Google Scholar] [CrossRef] [PubMed]
  13. De Oliveira, F.A.; Luna, S.P.L.; Amaral, J.B.D.; Rodrigues, K.A.; Sant’Anna, A.C.; Daolio, M.; Brondani, J.T. Validation of the UNESP-Botucatu unidimensional composite pain scale for assessing postoperative pain in cattle. BMC Vet. Res. 2014, 10, 200. [Google Scholar] [CrossRef] [PubMed]
  14. Mott, R.O.; Hawthorne, S.J.; McBride, S.D. Blink rate as a measure of stress and attention in the domestic horse (Equus caballus). Sci. Rep. 2020, 10, 21409. [Google Scholar] [CrossRef] [PubMed]
  15. Cobianchi, L.; Gigliuto, C.; de Gregori, M.; Malafoglia, V.; Raffaeli, W.; Compagnone, C.; Visai, L.; Petrini, P.; Avanzini, M.A.; Muscoli, C.; et al. Pain assessment in animal models: Do we need further studies? J. Pain Res. 2014, 7, 227–236. [Google Scholar] [CrossRef]
  16. Guedes, A. Pain Management in Horses. Vet. Clin. Equine Pract. 2017, 33, 181–211. [Google Scholar] [CrossRef]
  17. Ekman, P.; Friesen, W.V. Facial Action Coding System: A Technique for the Measurement of Facial Movement, 1st ed.; Consulting Psychologists Press: London, UK, 1978. [Google Scholar]
  18. Jordan, A.; Hughes, J.; Pakresi, M.; Hepburn, S.; O’Brien, J.T. The utility of PAINAD in assessing pain in a UK population with severe dementia. Int. J. Geriatr. Psychiatry 2011, 26, 118–126. [Google Scholar] [CrossRef]
  19. Chang, J.; Versloot, J.; Fashler, S.R.; McCrystal, K.N.; Craig, K.D. Pain assessment in children: Validity of facial expression items in observational pain scales. Clin. J. Pain 2015, 31, 189–197. [Google Scholar] [CrossRef]
  20. Langford, D.J.; Bailey, A.L.; Chanda, M.L.; E Clarke, S.; E Drummond, T.; Echols, S.; Glick, S.; Ingrao, J.; Klassen-Ross, T.; LaCroix-Fralish, M.L.; et al. Coding of facial expressions of pain in the laboratory mouse. Nat. Methods 2010, 7, 447–449. [Google Scholar] [CrossRef]
  21. Leach, M.C.; Klaus, K.; Miller, A.L.; Di Perrotolo, M.S.; Sotocinal, S.G.; Flecknell, P.A. The Assessment of Post-Vasectomy Pain in Mice Using Behaviour and the Mouse Grimace Scale. PLoS ONE 2012, 7, e35656. [Google Scholar] [CrossRef]
  22. Matsumiya, L.C.; E Sorge, R.; Sotocinal, S.G.; Tabaka, J.M.; Wieskopf, J.S.; Zaloum, A.; King, O.D.; Mogil, J.S. Using the Mouse Grimace Scale to reevaluate the efficacy of postoperative analgesics in laboratory mice. J. Am. Assoc. Lab. Anim. Sci. 2012, 51, 42–49. [Google Scholar]
  23. Costa, E.D.; Pascuzzo, R.; Leach, M.C.; Dai, F.; Lebelt, D.; Vantini, S.; Minero, M. Can grimace scales estimate the pain status in horses and mice? A statistical approach to identify a classifier. PLoS ONE 2018, 13, e0200339. [Google Scholar] [CrossRef] [Green Version]
  24. Sotocinal, S.G.; E Sorge, R.; Zaloum, A.; Tuttle, A.H.; Martin, L.; Wieskopf, J.S.; Mapplebeck, J.C.; Wei, P.; Zhan, S.; Zhang, S.; et al. The Rat Grimace Scale: A Partially Automated Method for Quantifying Pain in the Laboratory Rat via Facial Expressions. Mol. Pain 2011, 7, 55. [Google Scholar] [CrossRef] [PubMed]
  25. Liao, L.; Long, H.; Zhang, L.; Chen, H.; Zhou, Y.; Ye, N.; Lai, W. Evaluation of pain in rats through facial expression following experimental tooth movement. Eur. J. Oral Sci. 2014, 122, 121–124. [Google Scholar] [CrossRef] [PubMed]
  26. Sperry, M.; Yu, Y.-H.; Welch, R.L.; Granquist, E.J.; Winkelstein, B.A. Grading facial expression is a sensitive means to detect grimace differences in orofacial pain in a rat model. Sci. Rep. 2018, 8, 13894. [Google Scholar] [CrossRef]
  27. Keating, S.C.J.; Thomas, A.A.; Flecknell, P.; Leach, M.C. Evaluation of EMLA Cream for Preventing Pain during Tattooing of Rabbits: Changes in Physiological, Behavioural and Facial Expression Responses. PLoS ONE 2012, 7, e44437. [Google Scholar] [CrossRef] [PubMed]
  28. Hedenqvist, P.; Trbakovic, A.; Thor, A.; Ley, C.; Ekman, S.; Jensen-Waern, M. Carprofen neither reduces postoperative facial expression scores in rabbits treated with buprenorphine nor alters long term bone formation after maxillary sinus grafting. Res. Vet. Sci. 2016, 107, 123–131. [Google Scholar] [CrossRef] [PubMed]
  29. Pinho, R.H.; Luna, S.P.L.; Trindade, P.H.E.; Justo, A.A.; Cima, D.S.; Fonseca, M.W.; Minto, B.W.; Rocha, F.D.L.; Miller, A.; Flecknell, P.; et al. Validation of the rabbit pain behaviour scale (RPBS) to assess acute postoperative pain in rabbits (Oryctolagus cuniculus). PLoS ONE 2022, 17, e0268973. [Google Scholar] [CrossRef]
  30. Miller, A.L.; Clarkson, J.M.; Quigley, C.; Neville, V.; Krall, C.; Geijer-Simpson, A.; Flecknell, P.A.; Leach, M.C. Evaluating Pain and Analgesia Effectiveness Following Routine Castration in Rabbits Using Behavior and Facial Expressions. Front. Vet. Sci. 2022, 9, 782486. [Google Scholar] [CrossRef]
  31. Reijgwart, M.L.; Schoemaker, N.J.; Pascuzzo, R.; Leach, M.C.; Stodel, M.; De Nies, L.; Hendriksen, C.F.M.; Van Der Meer, M.; Vinke, C.M.; Van Zeeland, Y.R.A. The composition and initial evaluation of a grimace scale in ferrets after surgical implantation of a telemetry probe. PLoS ONE 2017, 12, e0187986. [Google Scholar] [CrossRef]
  32. MacRae, A.M.; Makowska, I.J.; Fraser, D. Initial evaluation of facial expressions and behaviours of harbour seal pups (Phoca vitulina) in response to tagging and microchipping. Appl. Anim. Behav. Sci. 2018, 205, 167–174. [Google Scholar] [CrossRef]
  33. Holden, E.; Calvo, G.; Collins, M.; Bell, A.; Reid, J.; Scott, E.M.; Nolan, A.M. Evaluation of facial expression in acute pain in cats. J. Small Anim. Pract. 2014, 55, 615–621. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Evangelista, M.C.; Watanabe, R.; Leung, V.S.Y.; Monteiro, B.P.; O’Toole, E.; Pang, D.S.J.; Steagall, P.V. Facial expressions of pain in cats: The development and validation of a Feline Grimace Scale. Sci. Rep. 2019, 9, 19128. [Google Scholar] [CrossRef] [PubMed]
  35. Di Giminiani, P.; Brierley, V.L.M.H.; Scollo, A.; Gottardo, F.; Malcolm, E.M.; Edwards, S.A.; Leach, M.C. The Assessment of Facial Expressions in Piglets Undergoing Tail Docking and Castration: Toward the Development of the Piglet Grimace Scale. Front. Vet. Sci. 2016, 3, 100. [Google Scholar] [CrossRef] [PubMed]
  36. Viscardi, A.V.; Hunniford, M.; Lawlis, P.; Leach, M.; Turner, P.V. Development of a Piglet Grimace Scale to Evaluate Piglet Pain Using Facial Expressions Following Castration and Tail Docking: A Pilot Study. Front. Vet. Sci. 2017, 4, 51. [Google Scholar] [CrossRef] [PubMed]
  37. Navarro, E.; Mainau, E.; Manteca, X. Development of a Facial Expression Scale Using Farrowing as a Model of Pain in Sows. Animals 2020, 10, 2113. [Google Scholar] [CrossRef]
  38. Vullo, C.; Barbieri, S.; Catone, G.; Graïc, J.-M.; Magaletti, M.; Di Rosa, A.; Motta, A.; Tremolada, C.; Canali, E.; Costa, E.D. Is the Piglet Grimace Scale (PGS) a Useful Welfare Indicator to Assess Pain after Cryptorchidectomy in Growing Pigs? Animals 2020, 10, 412. [Google Scholar] [CrossRef]
  39. Gleerup, K.B.; Andersen, P.H.; Munksgaard, L.; Forkman, B. Pain evaluation in dairy cattle. Appl. Anim. Behav. Sci. 2015, 171, 25–32. [Google Scholar] [CrossRef]
  40. Müller, B.R.; Soriano, V.S.; Bellio, J.C.B.; Molento, C.F.M. Facial expression of pain in Nellore and crossbred beef cattle. J. Vet. Behav. 2019, 34, 60–65. [Google Scholar] [CrossRef]
  41. Yamada, P.H.; Codognoto, V.M.; de Ruediger, F.R.; Trindade, P.H.E.; da Silva, K.M.; Rizzoto, G.; Maestá, S.A.; Ferreira, J.C.P.; de Soutello, R.V.G.; Oba, E. Pain assessment based on facial expression of bulls during castration. Appl. Anim. Behav. Sci. 2021, 236, 105258. [Google Scholar] [CrossRef]
  42. McLennan, K.M.; Rebelo, C.J.; Corke, M.J.; Holmes, M.A.; Leach, M.C.; Constantino-Casas, F. Development of a facial expression scale using footrot and mastitis as models of pain in sheep. Appl. Anim. Behav. Sci. 2016, 176, 19–26. [Google Scholar] [CrossRef]
  43. Guesgen, M.; Beausoleil, N.; Leach, M.; Minot, E.; Stewart, M.; Stafford, K. Coding and quantification of a facial expression for pain in lambs. Behav. Process. 2016, 132, 49–56. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Häger, C.; Biernot, S.; Buettner, M.; Glage, S.; Keubler, L.M.; Held, N.; Bleich, E.M.; Otto, K.; Müller, C.W.; Decker, S.; et al. The Sheep Grimace Scale as an indicator of post-operative distress and pain in laboratory sheep. PLoS ONE 2017, 12, e0175839. [Google Scholar] [CrossRef] [PubMed]
  45. Dalla Costa, E.; Minero, M.; Lebelt, D.; Stucke, D.; Canali, E.; Leach, M.C. Development of the Horse Grimace Scale (HGS) as a Pain Assessment Tool in Horses Undergoing Routine Castration. PLoS ONE 2014, 9, e92281. [Google Scholar] [CrossRef]
  46. van Loon, J.P.; Van Dierendonck, M.C. Monitoring acute equine visceral pain with the Equine Utrecht University Scale for Composite Pain Assessment (EQUUS-COMPASS) and the Equine Utrecht University Scale for Facial Assessment of Pain (EQUUS-FAP): A scale-construction study. Vet. J. 2015, 206, 356–364. [Google Scholar] [CrossRef]
  47. Gleerup, K.B.; Forkman, B.; Lindegaard, C.; Andersen, P.H. An equine pain face. Vet. Anaesth. Analg. 2015, 42, 103–114. [Google Scholar] [CrossRef]
  48. Costa, E.D.; Stucke, D.; Dai, F.; Minero, M.; Leach, M.C.; Lebelt, D. Using the Horse Grimace Scale (HGS) to Assess Pain Associated with Acute Laminitis in Horses (Equus caballus). Animals 2016, 6, 47. [Google Scholar] [CrossRef]
  49. Dyson, S.; Berger, J.M.; Ellis, A.D.; Mullard, J. Can the presence of musculoskeletal pain be determined from the facial expressions of ridden horses (FEReq)? J. Vet. Behav. 2017, 19, 78–89. [Google Scholar] [CrossRef]
  50. Lansade, L.; Nowak, R.; Lainé, A.-L.; Leterrier, C.; Bonneau, C.; Parias, C.; Bertin, A. Facial expression and oxytocin as possible markers of positive emotions in horses. Sci. Rep. 2018, 8, 14680. [Google Scholar] [CrossRef]
  51. Trindade, P.H.E.; Hartmann, E.; Keeling, L.J.; Andersen, P.H.; Ferraz, G.D.C.; Da Costa, M.J.R.P. Effect of work on body language of ranch horses in Brazil. PLoS ONE 2020, 15, e0228130. [Google Scholar] [CrossRef]
  52. Coneglian, M.M.; Borges, T.D.; Weber, S.H.; Bertagnon, H.G.; Michelotto, P.V. Use of the horse grimace scale to identify and quantify pain due to dental disorders in horses. Appl. Anim. Behav. Sci. 2020, 225, 104970. [Google Scholar] [CrossRef]
  53. Haunhorst, F.R.; Hopster, K.; Schmicke, M.; Bienert-Zeit, A.; Kästner, S. Clinical effect of buprenorphine or butorphanol, in combination with detomidine and diazepam, on sedation and postoperative pain after cheek tooth extraction in horses. Can. Vet. J. 2022, 63, 39–46. [Google Scholar] [PubMed]
  54. Kosiara, S.; Harrison, A.P. The Effect of Aromatherapy on Equine Facial Expression, Heart Rate, Respiratory Tidal Volume and Spontaneous Muscle Contractures in M. Temporalis and M. Cleidomastoideus. Open J. Vet. Med. 2021, 11, 87–103. [Google Scholar] [CrossRef]
  55. Lundblad, J.; Rashid, M.; Rhodin, M.; Andersen, P.H. Effect of transportation and social isolation on facial expressions of healthy horses. PLoS ONE 2021, 16, e0241532. [Google Scholar] [CrossRef] [PubMed]
  56. de Oliveira, A.R.; Gozalo-Marcilla, M.; Ringer, S.K.; Schauvliege, S.; Fonseca, M.W.; Trindade, P.H.E.; Filho, J.N.P.P.; Luna, S.P.L. Development and validation of the facial scale (FaceSed) to evaluate sedation in horses. PLoS ONE 2021, 16, e0251909. [Google Scholar] [CrossRef]
  57. Ask, K.; Rhodin, M.; Tamminen, L.-M.; Hernlund, E.; Andersen, P.H. Identification of Body Behaviors and Facial Expressions Associated with Induced Orthopedic Pain in Four Equine Pain Scales. Animals 2020, 10, 2155. [Google Scholar] [CrossRef] [PubMed]
  58. Gregory, N.S.; Harris, A.L.; Robinson, C.R.; Dougherty, P.M.; Fuchs, P.N.; Sluka, K.A. An Overview of Animal Models of Pain: Disease Models and Outcome Measures. J. Pain 2013, 14, 1255–1269. [Google Scholar] [CrossRef] [PubMed]
  59. Gozalo-Marcilla, M.; Luna, S.; Gasthuys, F.; Schauvliege, S. Thermal, mechanical and electrical stimuli in antinociceptive studies in standing horses: An update. Vet. Anaesth. Analg. 2020, 47, 15–27. [Google Scholar] [CrossRef] [PubMed]
  60. Casas-Alvarado, A.; Mota-Rojas, D.; Hernández-Ávalos, I.; Mora-Medina, P.; Olmos-Hernández, A.; Verduzco-Mendoza, A.; Reyes-Sotelo, B.; Martínez-Burnes, J. Advances in infrared thermography: Surgical aspects, vascular changes, and pain monitoring in veterinary medicine. J. Therm. Biol. 2020, 92, 102664. [Google Scholar] [CrossRef]
  61. McDonnell, S. The Equid Ethogram: A Practical Field Guide to Horse Behavior, 1st ed.; Eclipse Press: Amman, Jordan, 2003. [Google Scholar]
  62. Descovich, K.A.; Wathan, J.; Leach, M.C.; Buchanan-Smith, H.M.; Flecknell, P.; Farningham, D.; Vick, S.J. Facial expression: An under-utilised tool for the assessment of welfare in mammals. ALTEX 2017, 34, 409–429. [Google Scholar] [CrossRef]
  63. Trindade, P.H.E.; Costa, F.D.O.; Da Costa, M.J.R.P. Expressões faciais em cavalos: Uma abordagem sobre os métodos de avaliação e as limitações de seu uso. Rev. Acad. Ciên. Anim. 2018, 16, e161109. [Google Scholar] [CrossRef]
  64. Rashid, M.; Silventoinen, A.; Gleerup, K.B.; Andersen, P.H. Equine Facial Action Coding System for determination of pain-related facial responses in videos of horses. PLoS ONE 2020, 15, e0231608. [Google Scholar] [CrossRef] [PubMed]
  65. de Carvalho, J.R.G.; Conde, G.; Antonioli, M.L.; Dias, P.P.; Vasconcelos, R.O.; Taboga, S.R.; Canola, P.A.; Chinelatto, M.A.; Pereira, G.T.; Ferraz, G.C. Biocompatibility and biodegradation of poly(lactic acid) (PLA) and an immiscible PLA/poly(ε-caprolactone) (PCL) blend compatibilized by poly(ε-caprolactone-b-tetrahydrofuran) implanted in horses. Polym. J. 2020, 52, 629–643. [Google Scholar] [CrossRef]
  66. Dias, P.P.; Chinelatto, M.A. Effect of Poly(ε-caprolactone-b-tetrahydrofuran) Triblock Copolymer Concentration on Morphological, Thermal and Mechanical Properties of Immiscible PLA/PCL Blends. J. Renew. Mater. 2019, 7, 129–138. [Google Scholar] [CrossRef]
  67. Martin, P.; Bateson, P.P.G. Measuring Behaviour: An Introductory Guide, 3rd ed.; Cambridge University Press: Cambridge, UK, 2007. [Google Scholar] [CrossRef]
  68. Wang, F.K.; Chen, J.C. Capability index using principal components analysis. Qual. Eng. 1998, 11, 21–27. [Google Scholar] [CrossRef]
  69. Kubrusly, L.S. Um procedimento para calcular índices a partir de uma base de dados multivariados. Pesqui. Oper. 2001, 21, 107–117. [Google Scholar] [CrossRef]
  70. Wathan, J.; Burrows, A.M.; Waller, B.M.; McComb, K. EquiFACS: The Equine Facial Action Coding System. PLoS ONE 2015, 10, e0131738. [Google Scholar] [CrossRef]
  71. Landis, J.R.; Koch, G.G. An Application of Hierarchical Kappa-type Statistics in the Assessment of Majority Agreement among Multiple Observers. Biometrics 1977, 33, 363–374. [Google Scholar] [CrossRef]
  72. Nóbrega, F.S.; Ferreira, M.P.; Facó, L.L.; Selim, M.B.; De Zoppa, A.L.V. Uso da termografia para avaliação da resposta tecidual após implante de polímero a base de poliuretana de mamona em osso III metacarpiano de equinos. Acta. Sci. Vet. 2014, 42, 1–5. [Google Scholar]
  73. Carvalho, J.R.G.; Conde, G.; Antonioli, M.L.; Santana, C.H.; Littiere, T.O.; Dias, P.P.; Chinelatto, M.A.; Canola, P.A.; Zara, F.J.; Ferraz, G.C. Long-Term Evaluation of Poly(lactic acid) (PLA) Implants in a Horse: An Experimental Pilot Study. Molecules 2021, 26, 7224. [Google Scholar] [CrossRef]
  74. Li, R.-Y.; Liu, Z.-G.; Liu, H.-Q.; Chen, L.; Liu, J.-F.; Pan, Y.-H. Evaluation of biocompatibility and toxicity of biodegradable poly (DL-lactic acid) films. Am. J. Transl. Res. 2015, 7, 1357–1370. [Google Scholar]
  75. Heber, S.; Ciotu, C.I.; Hartner, G.; Gold-Binder, M.; Ninidze, N.; Gleiss, A.; Kress, H.-G.; Fischer, M.J. TRPV1 antagonist BCTC inhibits pH 6.0-induced pain in human skin. Pain 2020, 161, 1532–1541. [Google Scholar] [CrossRef] [PubMed]
  76. Bussières, G.; Jacques, C.; Lainay, O.; Beauchamp, G.; Leblond, A.; Cadoré, J.-L.; Desmaizières, L.-M.; Cuvelliez, S.; Troncy, E. Development of a composite orthopaedic pain scale in horses. Res. Vet. Sci. 2008, 85, 294–306. [Google Scholar] [CrossRef]
  77. Hayashi, K.; Ikemoto, T.; Ueno, T.; Arai, Y.-C.P.; Shimo, K.; Nishihara, M.; Suzuki, S.; Ushida, T. Discordant Relationship Between Evaluation of Facial Expression and Subjective Pain Rating Due to the Low Pain Magnitude. Basic Clin. Neurosci. J. 2018, 9, 43–50. [Google Scholar] [CrossRef]
  78. Lindegaard, C.; Vaabengaard, D.; Christophersen, M.T.; Ekstøm, C.T.; Fjeldborg, J. Evaluation of pain and inflammation associated with hot iron branding and microchip transponder injection in horses. Am. J. Vet. Res. 2009, 70, 840–847. [Google Scholar] [CrossRef]
  79. Erber, R.; Wulf, M.; Becker-Birck, M.; Kaps, S.; Aurich, J.; Möstl, E.; Aurich, C. Physiological and behavioural responses of young horses to hot iron branding and microchip implantation. Vet. J. 2012, 191, 171–175. [Google Scholar] [CrossRef]
  80. Hair, J.J.F.; Black, W.C.; Babin, B.J.; Anderson, R.E. Multivariate Data Analysis, 7th ed.; Pearson Education: Upper Saddle River, NJ, USA, 2014. [Google Scholar]
Figure 1. Infographic presenting the strategies used to evaluate facial expressions in horses submitted to polymer implantation.
Figure 1. Infographic presenting the strategies used to evaluate facial expressions in horses submitted to polymer implantation.
Animals 12 02400 g001
Figure 2. Violin plot of medians and amplitude of the (a) mechanical nociceptive threshold (MNT) and (b) the cutaneous temperature (CT) of horses submitted to polymer implantation. IG, implanted group; S, sham group—skin incision only. Different letters indicate differences over time for the same group. * Indicates difference between groups at the same time (p < 0.05).
Figure 2. Violin plot of medians and amplitude of the (a) mechanical nociceptive threshold (MNT) and (b) the cutaneous temperature (CT) of horses submitted to polymer implantation. IG, implanted group; S, sham group—skin incision only. Different letters indicate differences over time for the same group. * Indicates difference between groups at the same time (p < 0.05).
Animals 12 02400 g002
Figure 3. Graphical representation of medians and amplitude of facial expressions and general facial score (GFS) of horses submitted to implantation of polymers. IG, implanted group; S, sham group: skin incision only. The dendrogram (top of the figure) represents the hierarchical grouping, showing the distances between the scoring profiles for each observed variable.
Figure 3. Graphical representation of medians and amplitude of facial expressions and general facial score (GFS) of horses submitted to implantation of polymers. IG, implanted group; S, sham group: skin incision only. The dendrogram (top of the figure) represents the hierarchical grouping, showing the distances between the scoring profiles for each observed variable.
Animals 12 02400 g003
Figure 4. Violin plot of medians and amplitude of PCoA (a), SUM (b), and SUM.W (c) of horses submitted to implantation of polymers. IG, implanted group; S, sham group: skin incision only. Different letters indicate differences over time for the same group (p < 0.05).
Figure 4. Violin plot of medians and amplitude of PCoA (a), SUM (b), and SUM.W (c) of horses submitted to implantation of polymers. IG, implanted group; S, sham group: skin incision only. Different letters indicate differences over time for the same group (p < 0.05).
Animals 12 02400 g004
Figure 5. Projections of the loading values in the two dimensions of the principal component analysis performed with the facial expressions evaluated in horses submitted to polymer implantation. IG, implanted group; S, sham group—only skin incision.
Figure 5. Projections of the loading values in the two dimensions of the principal component analysis performed with the facial expressions evaluated in horses submitted to polymer implantation. IG, implanted group; S, sham group—only skin incision.
Animals 12 02400 g005
Table 2. Behavioral categories considered aversive during the assessment of the mechanical nociceptive threshold.
Table 2. Behavioral categories considered aversive during the assessment of the mechanical nociceptive threshold.
Behavioral CategoriesDescriptions
Tail movementMoves the tail to the left or right above or below the groin or up and down at least 45 degrees quickly.
Ear movementBoth ears are turned laterally and dorsally/caudally. The inner ear opening faces outward.
Head movementThrows the head up or down, with or without moving the neck in the same direction simultaneously. Turns the head to the right or to the left, leaving the whites of the eye visible. Turns the head toward the stimulus.
Kick or step sidewaysMoves with two legs, forward, backward, or sideways, resulting in a new position, or raises the pelvic member and vigorously moves it backwards or sideways.
Table 3. Intraobserver reliability (repeatability) estimated by the quadratic weighted kappa coefficient and its 95% confidence interval calculated for the 7 facial features.
Table 3. Intraobserver reliability (repeatability) estimated by the quadratic weighted kappa coefficient and its 95% confidence interval calculated for the 7 facial features.
95% Confidence Interval
Facial FeaturesWeighted KappaMinimumMaximum
Ear movements0.780.391.00
Eyebrow tension0.710.470.96
Orbicularis tension1.001.001.00
Dilated nostrils1.001.001.00
Eye opening1.001.001.00
Muzzle tension0.860.661.00
Masticatory muscles tension1.001.001.00
Table 4. Median and amplitude (minimum–maximum) of the 7 facial features and the general facial score (GFS) in each of the two video clips of the same animal filmed at the same time to evaluate the retest.
Table 4. Median and amplitude (minimum–maximum) of the 7 facial features and the general facial score (GFS) in each of the two video clips of the same animal filmed at the same time to evaluate the retest.
Video Clip 1Video Clip 2
MedianRangeMedianRange
Ear movements00–200–2
Eyebrow tension10–200–2
Orbicularis tension00–100–1
Dilated nostrils10–210–2
Eye opening00–200–2
Muzzle tension00–200–2
Masticatory muscles tension00–200–2
GFS00–200–2
Table 5. Median and amplitude (minimum–maximum) of the nonparametric variables (A) and mean and standard deviation of the variables assumed to be parametric (B) before and 24 and 48 h after the procedure. Different capital letters indicate a statistical difference between the groups. Different lowercase letters indicate an intragroup statistical difference over time. p < 0.05. Being that a > b > c and A > B.
Table 5. Median and amplitude (minimum–maximum) of the nonparametric variables (A) and mean and standard deviation of the variables assumed to be parametric (B) before and 24 and 48 h after the procedure. Different capital letters indicate a statistical difference between the groups. Different lowercase letters indicate an intragroup statistical difference over time. p < 0.05. Being that a > b > c and A > B.
A
Before24 h After48 h After
GroupsVariablesMedianAmplitudeMedianAmplitudeMedianAmplitude
SEar movements0.000–10.000–21.000–2
Eyebrow tension0.000–10.000–10.000–2
Orbicularis tension0.000–00.000–10.000–0
Dilated nostrils0.000–10.000–10.500–2
Eye opening1.000–10.500–21.000–1
Muzzle tension0.000–10.000–10.000–2
Masticatory muscles
tension
0.000–10.000–20.000–2
SUM2.00 ab0–52.00 b0–53.00 a0–9
PCoA−0.15 ab−1.35–2.08−0.56 b−1.35–1.73−0.08 a−1.35–5.34
SUM.W−5.54 b−7.54–−2.54−5.54 b−7.54–−2.54−4.54 a−7.54–1.46
GFS0.000–200–10.50–2
MNT446.68 a446.68–446.68203.87 bA11.75–446.68281.84 bA15.14–446.68
IGEar movements0.000–20.000–20.000–2
Eyebrow tension1.000–21.000–20.000–2
Orbicularis tension0.000–00.000–00.000–1
Dilated nostrils0.000–20.000–20.000–2
Eye opening0.000–20.500–21.000–2
Muzzle tension0.000–20.000–20.000–2
Masticatory muscles
tension
0.000–20.000–20.000–2
SUM2.000–92.000–92.001–7
PCoA−0.59−1.42–5.34−0.57−1.35–4.39−0.52−1.42–4.60
SUM.W−5.54−7.54–1.46−5.54−7.54–1.46−5.54−6.54–−0.54
GFS0.000–20.000–20.000–2
MNT446.68 a446.68–446.6875.86 bB28.84–281.8477.37 bB11.75–281.84
B
Before24 h After48 h After
MeanSDMeanSDMeanSD
SCT32.92 b1.1034.38 aB0.6934.32 aB0.87
IGCT33.46 b0.9235.29 aA0.4835.75 aA0.58
Table 6. Loading values of each facial feature in the first two dimensions extracted from the principal component analysis.
Table 6. Loading values of each facial feature in the first two dimensions extracted from the principal component analysis.
Dimension 1Dimension 2
Ear movements0.590.39
Eyebrow tension−0.06−0.76
Orbicularis tension0.060.03
Dilated nostrils0.100.75
Eye opening0.87−0.07
Muzzle tension0.67−0.22
Masticatory muscles tension0.85−0.17
Eigenvalue2.291.36
Variance (%)32.8319.52
Table 7. Spearman rank correlation matrix between the mechanical nociceptive threshold, cutaneous temperature, and strategies for evaluating facial expressions (the 7 individual features, SUM, SUM.W, PCoA, GFS).
Table 7. Spearman rank correlation matrix between the mechanical nociceptive threshold, cutaneous temperature, and strategies for evaluating facial expressions (the 7 individual features, SUM, SUM.W, PCoA, GFS).
MNTCTEar MovementsEyebrow TensionOrbicularis TensionDilated NostrilsEye OpeningMuzzle TensionMasticatory Muscles TensionGFSSUMPCSUM.W
MNT
CT−0.55 *
Ear movements−0.130.02
Eyebrow tension0.05−0.08−0.22 *
Orbicularis tension−0.130.060.030.00
Dilated nostrils−0.02−0.100.130.07−0.01
Eye opening−0.20 *0.030.18 *−0.30*0.030.02
Muzzle tension0.03−0.060.27 *0.070.080.38 *0.02
Masticatory muscles tension−0.16−0.060.28 *−0.060.030.40 *0.020.62 *
GFS−0.24 *−0.020.45 *−0.080.120.34 *0.27 *0.54 *0.62 *
SUM−0.13−0.070.51 *0.22*0.090.61 *0.36 *0.69 *0.62 *0.63 *
PCoA−0.11−0.050.52 *−0.140.090.62 *0.26 *0.79 *0.71 *0.65 *0.87 *
SUM.W−0.13−0.070.51 *0.22*0.090.61 *0.36 *0.69 *0.62 *0.63 *1.00 *0.87 *
The numbers in bold represent correlation > 0.50 or < −0.50, and * indicates p < 0.05.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Carvalho, J.R.G.; Trindade, P.H.E.; Conde, G.; Antonioli, M.L.; Funnicelli, M.I.G.; Dias, P.P.; Canola, P.A.; Chinelatto, M.A.; Ferraz, G.C. Facial Expressions of Horses Using Weighted Multivariate Statistics for Assessment of Subtle Local Pain Induced by Polylactide-Based Polymers Implanted Subcutaneously. Animals 2022, 12, 2400. https://doi.org/10.3390/ani12182400

AMA Style

Carvalho JRG, Trindade PHE, Conde G, Antonioli ML, Funnicelli MIG, Dias PP, Canola PA, Chinelatto MA, Ferraz GC. Facial Expressions of Horses Using Weighted Multivariate Statistics for Assessment of Subtle Local Pain Induced by Polylactide-Based Polymers Implanted Subcutaneously. Animals. 2022; 12(18):2400. https://doi.org/10.3390/ani12182400

Chicago/Turabian Style

Carvalho, Júlia R. G., Pedro H. E. Trindade, Gabriel Conde, Marina L. Antonioli, Michelli I. G. Funnicelli, Paula P. Dias, Paulo A. Canola, Marcelo A. Chinelatto, and Guilherme C. Ferraz. 2022. "Facial Expressions of Horses Using Weighted Multivariate Statistics for Assessment of Subtle Local Pain Induced by Polylactide-Based Polymers Implanted Subcutaneously" Animals 12, no. 18: 2400. https://doi.org/10.3390/ani12182400

APA Style

Carvalho, J. R. G., Trindade, P. H. E., Conde, G., Antonioli, M. L., Funnicelli, M. I. G., Dias, P. P., Canola, P. A., Chinelatto, M. A., & Ferraz, G. C. (2022). Facial Expressions of Horses Using Weighted Multivariate Statistics for Assessment of Subtle Local Pain Induced by Polylactide-Based Polymers Implanted Subcutaneously. Animals, 12(18), 2400. https://doi.org/10.3390/ani12182400

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop