1. Introduction
The measurement of the level of affective intensity is a relevant issue for both theoretical and practical reasons. Affect plays a central role in how individuals make sense of experience [
1,
2,
3] as well as in how executive [
4] and higher-order cognitive processes [
5] operate. A high level of affect intensity is associated with psychopathological conditions [
6,
7,
8] as well as maladjusted forms of behaviors, such as gambling [
9,
10,
11,
12] or academic drop-out [
13]; again, the elaboration of affect and the mode of variation of its intensity within and throughout sessions is a core focus of the analysis of the psychotherapeutic process and clinical change [
14,
15,
16,
17,
18]. Affect is also involved in psychosocial and socio-political phenomena. Social representations of forms of alterity have proven to frame their objects in terms of affect-laden meanings—e.g., the securitization frame, i.e., the view of alterity as an incumbent radical threat, is the most common way migration is conveyed by Western media [
19]. In/out-group polarization, populism, xenophobia, hate speech, and conspiracy theories are phenomena that, though different in content and determinants, are all characterized by the role played by affect, and, more specifically, by the affect-laden friend–foe schema [
20,
21,
22]. More generally, affective activation has been considered a major response by which individuals and social groups cope with uncertainty [
23,
24,
25,
26]; accordingly, the analysis of the impact and design of social communication (in contexts such as politics, media, but also health, education, marketing, security, urban planning, and civic engagement) benefit from understanding the capacity of the message to pander to and/or oppose the target’s affective response [
27].
Due to the relevance of the topic to so many areas of psychological investigation, it is not surprising that numerous attempts have been made to measure the main characteristics of affect. Measures can be collected in three broad clusters: physiological, self-report, and, behavioral measures.
Physiological measures focus on both central (e.g., electroencephalography) and peripheral (e.g., electrodermal conductance, heart rate variability (HRV)) signals to estimate bodily affective activation (for a review, see [
28]). The validity of these indexes is generally robust, given that they can be considered direct measures of the intensity of the body’s physiological activation. However, physiological measures are generally not easy to use, given that, in most cases, their application and computation require technical devices and skilled researchers. Moreover, they often require implementation in controlled conditions, and this limits their ecological validity.
Self-report measures skip some of these limitations. Yet, although these kinds of measures are widely used in many domains of investigation, their validity is considerably jeopardized by the subjects’ inherently low capability to reliably detect their own inner state [
29,
30]. This limitation is reflected in the weak association with both psychophysiological [
31] and behavioral measures [
32].
Behavioral measures offer an alternative to self-report. Many aspects of overt behavior—such as vocal fundamental frequency [
33], speech rate [
34], facial expressions [
35], and whole-body posture [
36]—have been proposed, conceived as markers of one or more features of the intensity of the affective state. However, these measures have been criticized because the association between behavior and affective states is not invariant but depends on contextual conditions [
37,
38,
39,
40,
41,
42,
43]. Above all, it must be considered that it is not always possible to involve participants in individual tasks, or even that certain analyses are not based on participants as direct sources of data. For instance, in many areas of investigation—e.g., psychotherapy process, media representations of social objects (migration, Islam, COVID-19, etc.), organizational dynamics, and marketing communication—many studies cannot but be based on textual data such as verbatim transcripts of sessions, interviews, focus groups, newspaper articles, etc. Thus, the estimation of affect in research contexts of this kind requires a measure based on textual data, rather than on behavioral responses.
The present paper intends to address this need. It presents the Affective Saturation Index (ASI), a textual-based measure of the intensity of affect. To this end, we first present the ASI, the definition of affect it is grounded on, and its rationale; then, an initial validation study is reported. Three aspects of the ASI make it relevant from a dynamic systems theory standpoint. First, the ASI is based on a semiotic interpretation of affect, which is in turn grounded on a field-dynamic conception of meaning, which models it as an emergent property of sensemaking [
44]. Second, dynamic systems theory informs the methodological framework on which the ASI’s computation is based (in particular, the dimensional model of meaning). Third, the ASI is designed to detect the ongoing flow of meaning-making, enabling the application of strategies for data analysis (e.g., Time Series Analysis) aimed at modeling the dynamic evolution of communication and cognitive processes.
3. Aims and Hypotheses
A preliminary version of the ASI was used in a recent study analyzing the evolution of meaning characterizing the dreams of a patient through the course of psychotherapy [
77]. In the context of that study, the ASI proved successful in estimating the saturation of the affect-laden meanings in the patient’s dreams. Analyses showed that the saturation followed a meaningful, though nonlinear, trajectory, globally indicative of the progressive increase in the patient’s capacity to elaborate unconscious, affectively relevant areas of her mental landscape. Such findings can be viewed as encouraging, preliminary, indirect evidence in support of the ASI; however, results are based on a single case study and do not provide information on the relationship between the ASI and other measures of affect.
The present study starts from these preliminary findings and is aimed at providing an initial validation of the ASI, with a specific focus on its validity as a measure of affective intensity. More particularly, it intends to test the two core assumptions underlying the ASI: (i) the ASI is able to detect the affective saturation of a text, and (ii) the affective saturation of the text reflects the intensity of the affective state characterizing the meaning-maker involved in producing the text. This gives rise to the following three hypotheses.
First, an association between the ASI and an independent, content-based textual index of the affective saturation of the text is expected. Given that no other direct measure of a text’s affective saturation was found in the literature, we developed an ad hoc indirect index of this characteristic, not related to the ASI:
semantic complexity. Semantic complexity is the degree of variability of textual content, namely the heterogeneity of the spectrum of content active within the text—the more heterogeneous it is, the greater its semantic complexity. We assume that semantic complexity is inversely associated with affective saturation: the lower the former, the higher the latter. This assumption derives from the definition of affective saturation; insofar as one assumes that affective saturation consists of the magnitude of the contribution of affective meaning compared to other meanings, then the greater the affective saturation, the less the contribution provided by other semantic components, and therefore the lower the global variability of the text. Two studies provide support for the interpretation of semantic complexity as a proxy of affective saturation. First, in the context of the analysis of a therapist–patient exchange, the semantic complexity of narratives proved to be associated inversely with an index of the relevance of generalized affective meanings [
78]. Second, in the context of a study of European societies’ cultural milieus, secondary quali-quantitative analyses highlighted that the semantic richness of the cultural worldviews identified proved to be inversely associated with their affective saturation [
20] (see above paragraph,
A geometric model of affective saturation). An analysis of the association between the ASI and semantic complexity was carried out, paying attention to checking the potential effect of the lengths of the texts under investigation (estimated in terms of the number of words).
Second, the ASI is expected to be associated with an independent measure of the intensity of the meaning-maker’s affective state related to text production. To this end, a physiological index of propensity to engage in context-appropriate affective responses or affective arousal was adopted: heart rate variability (HRV), a measure of parasympathetic autonomic nervous system function. The relationship between the ASI and HRV was estimated by parsing out the potential effect of the individual’s capacity for affective regulation. This was done because it is plausible to think that the impact of the intensity of the affective state on the meaning-making underpinning the production of the text, namely the affective saturation, is moderated by the meaning-maker’s capacity to “filter” her/his affective activation. One can expect that the lower the capacity for affective regulation, the weaker the elaborative filter, and, therefore, the stronger the relationship between affective intensity and saturation.
Third, the ASI is expected to be associated with an independent, content-unrelated impact of the affective intensity on the text. To this end, we implemented lexical-syntactic complexity as a proxy of that impact. This choice is based on the combination of the following ideas. First, the lexical-syntactic complexity reflects the efficiency of the meaning-making underpinning the text production [
79,
80]. The production of lexically and syntactically complex texts (e.g., texts comprising long sentences, based on networks of multi-level hierarchized statements) requires computational efficiency (e.g., working memory and abstract conceptualization); correspondingly, low-efficiency meaning-making reduces the text’s lexical-syntactic complexity. Second, affective intensity prevents the computational and functional efficiency of meaning-making—e.g., it reduces metacognitive processes, the availability of working memory, and access to abstract reasoning [
4,
81,
82]. Thus, affective intensity has a negative impact on syntactic complexity, via the reduction in the efficiency of the underpinning meaning-making. There is already indirect empirical evidence of the inversely proportional association between lexical-syntactic complexity and affective mental state. (A) It has been shown that in patients with schizophrenia—i.e., patients who are characterized by overwhelming affective states—the number of words per sentence in spontaneous speech is significantly lower than in patients with less severe psychiatric diseases and in non-clinical samples. It is worth adding that this is not due to an impairment in the global production of narratives, as shown by the fact that individuals with schizophrenia produce narratives with approximately the same number of words as control groups do [
83]. (B) DePaulo and colleagues [
84] reviewed empirical studies of deception cues. They moved from the well-supported premise that lie-telling is more emotionally challenging than telling the truth [
85]. On this basis, they highlighted that research converges on the finding that the self-presentations of liars, in their free verbal narratives, are characterized by shorter responses and simpler syntactical configurations. (C) In the context of the Terror Management Theory [
86], it was found that individuals who received prime activating meanings related to one’s death—assumed to trigger deep states of anxiety—generated shorter (in terms of fewer words and fewer letters per word) autobiographical narratives compared to controls. The analysis of the relationship between the ASI and syntactic complexity was carried out while paying attention to controlling the level of affective regulation. This control is expected to address potential bias due to the fact that the affective saturation measured by the ASI and syntactic complexity can be influenced by differing abilities to regulate affect. In summary, the alternative hypotheses tested against the null hypotheses were:
Hypothesis 1 (H1).
ASI is negatively associated with text semantic complexity.
Hypothesis 2 (H2).
ASI is positively associated with affective intensity.
Hypothesis 3 (H3).
ASI is negatively associated with lexical-syntactic complexity.
The first hypotheses concern the ASI’s convergent validity; the others concern concurrent validity.
5. Results
Table 2 reports descriptive statistics of the variables adopted. As shown by the values of kurtosis and skewness, the indexes (in the case of the rMSSD, after logarithmic transformation) proved to approximate the normal distribution (the distribution of ASI is shown in
Figure 1).
No significant differences resulted between males and females as to the level of the ASI (ANOVA test: F [
1,
38] = 0.337,
p = 0.565). Accordingly, and considering that the sample is characterized by a higher proportion of women than men, we did not carry out separate analyses. The length of the interview (in number of words) did not correlate with any of the indexes examined. However, we have used this as a control variable in regression models 1 and 3, given that these models have a text-based index as the dependent variable.
Table 3 reports the correlations between the main variables of the study. The ASI proved to be negatively associated with the SEI (r = −0.657), rMSSD (r = −0.468), and FVI (r = −0.426). No significant correlations emerged for Age, Words, DERS, and SCL-90R. The log-transformed rMSSD and the FVI proved to correlate robustly (r = 0.489).
All three multiple regression models proved to be significant (
p < 0.001,
p < 0.004, and
p < 0.005, respectively; cf.
Table 4).
Table 5 and
Table 6 report the main parameters of regression model 1, with SEI as the dependent variable and the ASI and Words (i.e., the number of words in the interview) as predictors. The model did not suffer from problems of collinearity (VIF = 1.007); the adjusted R square was 0.428 (std. err. of estimation = 0.101). The inclusion of Words did not modify the parameters of the model significantly (change of R from model 1 and model 2:
p = 0.199; cf.
Table 5). The ASI beta coefficient was −0.644 (t = −5.296,
p < 0.000); the Words beta coefficient (0.159) was not significant (cf.
Table 6). The distribution of residuals approximated the normal distribution (
Figure 2).
Table 7 and
Table 8 report the main parameters of regression model 2, with the rMSSD as the dependent variable and the ASI and DERS as the predictors. The model did not suffer from problems of collinearity (VIF = 1.001); the adjusted R square was 0.214 (std. err. of estimation = 0.549). The inclusion of the DERS did not modify the parameters of the model significantly (change of R from model 1 and model 2:
p= 0.192; cf.
Table 7). The ASI beta coefficient was −0.472 (t = −3.325;
p < 0.002); the DERS beta coefficient was not significant (0.189; cf.
Table 8). The distribution of residuals approximates the normal distribution (
Figure 3).
Table 9 and
Table 10 report the main parameters of regression model 3, with the FVI as the dependent variable and the ASI, DERS, and age as the predictors (we included age as a covariate, due to its high correlation with the FVI; this means that in this case the model was calculated on n = 39 group, given that 1 participant had unknown age). The model did not suffer from problems of collinearity (VIFs close to 1); the adjusted R square was 0.241 (std. err. of estimation = 5.409). The inclusion of the DERS and age did not modify the parameters of the model significantly (
p = 0.064; cf.
Table 9). The ASI beta coefficient is −0.301 (t = −2.187;
p < 0.035); the age beta coefficient is also significant (−0.364,
p < 0.002). The DERS beta coefficient (.029) was not significant; (cf.
Table 10). The distribution of residuals approximates the normal distribution (
Figure 4).
6. Discussion and Conclusions
As hypothesized, the ASI proved to be significantly and inversely associated with the SEI, the independent proxy of affective saturation. The association was robust, in the expected direction (ASI beta = −0.644), and was not weakened by the control of the potential effect of the length of the interviews.
Second, the ASI was significantly and inversely correlated with the rMSSD, the physiological index of the disposition for affective arousal. This relationship was in the expected direction (once one considers that a lower rMSSD indicates higher arousal), and robust, both when estimated directly (r = −0.468) and once the index of affective regulation (DERS) was introduced in the regression model (ASI beta = −0.472). This finding suggests that the ASI is able to detect the intensity of the affective state of the meaning-making involved in the production of the text, in a way that is not influenced by the individual’s capability to regulate affective arousal.
Finally, these findings are consistent with the idea that the ASI is able to detect the lexical-syntactic complexity of the text, assumed as an independent correlate of the affective intensity. As to this latter assumption, it is worth highlighting that it was supported by the high correlation between the index of lexical-syntactic complexity (FVI) and the rMSSD (r = 0.489). These results are consistent with and further support lines of thinking that view lexical-syntactic complexity as a property of the textual output that is subject to the influence of the affective state over the meaning-making underpinning its production. The ASI proved to be associated with the FVI (ASI beta = −0.323), in the expected direction. Moreover, in this case, the effect was estimated after the individual’s capability for affective regulation was checked.
Taken as a whole, the present findings support both the aspects of the ASI construct and the criterion validity investigated. The ASI proved to be a measure capable of detecting the structural organization of textual meaning—more specifically, of estimating to what extent the text is saturated by affective meaning. Moreover, the ASI’s measurement of affective saturation proved to be a valid estimator of the producer’s physiological affective state at rest as well as of the impact of affective intensity on meaning-making (as marked by the text’s syntactic complexity).
These findings are promising for their theoretical, methodological, and practical implications. From a theoretical standpoint, they enforce the semiotic framework upon which the ASI is based. What needs to be highlighted here is that the intensity of the meaning-maker’s affective state proved to be associated not only with the efficiency of the cognitive process underpinning the text production—as signaled by the relationship between affective intensity and lexical-syntactic complexity—but also with the inherent structural organization of the textual meaning—i.e., the relevance of the primary dimensions of meaning over the others, which is the specific property on which the ASI focuses. This legitimates the semiotic view of affect—namely, the idea that affect is an embodied form of meaning that, due to its nature, operates directly on the text’s semantic organization. In other words, the findings are consistent with the ASI viewpoint, which does not see affect as an exogenous factor influencing the text from the outside. Rather, it conceives affect as an inherent characteristic of the text; affect does not work on meaning-making by constraining or channeling it but is part and parcel of it [
20]. From a methodological standpoint, the ASI opens new opportunities for measuring affect. Two characteristics of the ASI are worth mentioning here. First, the ASI is almost completely insensitive to the size of the data—this means that it can be implemented on a large textual dataset, therefore enabling large-scale studies that can link individual and social levels of analyses as well as studies based on the density of units of observation required for dynamic time series. Second, the affective meaning is frozen, as it were, in the text. Therefore, the ASI’s use of texts as a source of the measurement of affective intensity enables the off-line detection of that dimension, namely the possibility for measuring affect in an independent spatio-temporal setting with respect to the setting in which it was activated. The combination of these characteristics envisages thrilling new opportunities—e.g., large-scale retrospective time-series analyses, to model the dynamics of affective activation characterizing the socio-cultural historical evolution of given social groups, and time-series analyses to map the dynamic evolution of meaning-making over the psychotherapy process [
77]. The ASI’s methodological flexibility has practical implications, too. One can envisage a plurality of applications of the method, in the many fields where the measurement of affect and its impact on meaning-making can be relevant for both interpretative and interventional aims—e.g., fields such as clinical and community interventions, social communication, marketing, and media monitoring (on the role of affective sensemaking in society [
27]).
However, the fact that the findings are encouraging must not lead us to underestimate the limitations of the study. There are three main shortcomings to highlight. First, the study was based on a convenience sample of Italian students in a degree course in psychology characterized by homogeneous age and a higher proportion of women. This made it impossible to test the role of language, age, and gender on the relationship between the ASI and other indexes and therefore generalize the findings beyond this specific group.
Second, the study adopted a psychophysiological index (rMSSD) assessed at rest, which is a trait measure. It was implemented before the interview to estimate the participants’ baseline disposition to a given level of affective intensity and capacity for affective regulation, respectively. Thus, it is not a direct measure of the level of affective intensity— and its variation—during the interview. We did this because the adoption of a state measure, mapping the ongoing physiological state of the participants alongside the interview, would have involved a level of computational complexity (e.g., the necessity to match the ASI values that took the whole interview as a unit of analysis and the instant-by-instant physiological values) which would have been outside the scope of the current study, which is aimed at the first stage of the validation of the ASI. Furthermore, while it must be recognized that the HRV index only partially captures the affective state occurring during the interview, it must also be highlighted that the use of this index is a conservative choice, which underestimates the relationship between the ASI and the participants’ affective intensity manifested during the interview. This is because it is plausible to think that, in response to the interview, individuals would differ in how much their affective state varies from the baseline, as a result of individual differences in personality and other psychological characteristics. Thus, insofar as the ASI is a measure of the current affective intensity on the text, the use of a trait measure weakens the chance to detect the capacity of the ASI to estimate the physiological state underpinning text production.
The third hypothesis was based on an indirect proxy of the impact of affective intensity on meaning-making—the text’s lexical-syntactic complexity. Thus, hypothesis 3 of the study—i.e., the fact that the ASI is able to detect the impact of affective intensity on meaning-making—must be considered only indirectly tested, insofar as one accepts the assumption that lexical-syntactic complexity is a valid marker of the efficiency of meaning-making. This assumption is fostered by the findings of the study (i.e., the high correlation between the FVI and the rMSSD), but is not systematically supported by the literature, which lacks specific studies on this issue.
These issues need to be addressed by the next steps of the ASI’s validation. Further studies will be implemented to test the ASI’s validity on other groups (e.g., lower educated people and clinical populations) and other kinds of texts (e.g., highly affect-laden communications and texts characterized by positive vs. negative affective valence). Finally, deeper analyses of the specific mechanisms underpinning the relationship between the textual and physiological components of affect, as well as the role played by the regulative cognitive processes in that relationship, will be brought into focus.