2. Materials and Methods
2.1. Organization of the Web-Based Survey
The exploratory web-based survey was carried out in a selected group of professional (PF) and volunteer (VF) firefighters who took part in suppression operations during the Pedrógão Grande fire and/or October fires and belonged to teams operating in the Central Region of Portugal. This participation was explicitly requested as a necessary and mandatory prerequisite.
Thanks to the authorization granted by the General Command of the Fire Brigade of Portugal, 149 fire stations in the Central Region of Portugal were contacted by email explaining the scope and mode of implementation of the survey. The email provided a link to access an ad hoc questionnaire, administered online via Google Forms. The questionnaire presented the objective of the study and the authors’ affiliations, ensured confidentiality, and presented the way in which the authors were going to use the information collected, assuring the absolute anonymity of the information collected. The survey was conducted during the spring of 2022 (April through June).
2.2. Building the Questionnaire: Its Structure and Content
Since no validated questionnaire is currently available in the literature for surveys similar to ours, we followed general guidelines for questionnaire building [
56,
57,
58], taking our cue from previously used questionnaires, e.g., for investigating the perception of wildfire risk among Kabyle residents in Algeria [
34] and perceptions on knowledge [
50].
Questions in a survey questionnaire can be “close-ended” or “open-ended”. The former provides the respondents with options and simply requires them to choose one or more items from a checkbox-type list. Open-ended questions allow respondents to freely express their opinions without being restricted by options. The former type is preferred if the range of answers are well known and the options are limited; the latter is preferred if the answer options are numerous and unknown [
56].
In building the questionnaire, we favored close-ended questions that demanded less involvement and time for compilation, and thus are much more accepted by respondents because they reduce the so-called LOI—Length of the Interview—and respondents’ fatigue. Answering open-ended questions can be laborious for respondents and calls for more energy than the typical respondent wants to use. Thus, we limited the maximum of this type of question, with all the sections of the questionnaire being close-ended except for two. However, given the number and complexity of the responses to the two open-ended questions, the results are not presented and discussed in this paper, since they will be the subject of a separate paper that is exclusively focused on them. In building the questionnaire, we wrote it with clarity and neutrality, to keep it succinct but interesting; of course, the questionnaire was circulated in Portuguese (See
File S1 in the Supplementary Materials). The order of the questions follows the logical steps of our conceptual model for a survey of firefighting crews: (i) the description of firefighters’ experience with the 2017 wildfire events and extreme fire behavior; (ii) the description of suppression operations, and any difficulties they entailed; (iii) the introspective analysis of the emotional reactions of the respondents; (iv) and the initiatives taken in response to the lessons learned.
The resulting ad hoc questionnaire thus consisted of the following sections, topics, and items, and was preceded by a brief explanation of the initiative, its features, and the conditions for participation.
Section I. Generalities of respondents (age; sex; type of activity—professional or volunteer; level of instruction; seniority of service; position in the hierarchy), the worst fire experienced in general (year and place of occurrence), and the worst fire experienced in 2017 (municipality/location of the fire).
Section II. Wildfires’ physical characterization from firefighters’ perspectives. This section includes only Topic 1—Facing the inferno: the perception of EWEs characteristics. It includes nine items related to 2017 events, with integrative information about: (i) the maximum estimated height/length of the flames in the 2017 fires, from a checklist with six values ranging from <4 m to >15 m; (ii) what mainly impressed the respondent (this section permitted yes/no multiple answers from a check-list of 14 items); (iii) and the worst fire experienced by the respondent.
Section III. Wildfire suppression activities related to the 2017 June or/and October fires; it includes four topics and one open-ended question: Topic 2—Efficacy, difficulties, and weaknesses of wildfire operations (13 items); Topic 3—At the flame front (six items); Topic 4—Difficulties, emotions, and personal reactions faced during the June and/or October 2017 wildfire operations, in terms of feelings, fear, doubts, and hidden thoughts (eight items); and Topic 5—Psychological support (four items). The open-ended question was: Considering your personal experience, what are the main lessons you draw from the 2017 fire season?
Section IV. How the 2017 wildfire season changed the approach and procedures to fires. This section includes just Topic 6 and one open-ended question. Topic 6 is concerned with the lessons learned from the 2017 wildfire season and the procedure changes, if any, after the experience of the 2017 wildfire season (14 items). The open-ended question was: In your opinion, after the experience of the 2017 fires, what changes would you like to see implemented in the organization of the Civil Protection system?
Respondents were invited to reply to items on a five-point Likert scale. This commonly used scale provides a measure of strength for every item, of which it is possible to calculate the mean and SD of scores treated as ordinal values. For open-ended questions, the respondents had the opportunity to insert personal observations and remarks. The open-ended questions were categorized in NVivo 17 and analyzed using descriptive statistics and a chi-square test, but as already mentioned, these results are not presented in this paper. They will be presented in a separate paper.
2.3. Responses
From the 149 operational stations, we obtained 186 anonymous responses, in compliance with national and European data protection laws for scientific and statistical purposes (General Data Protection Regulation, EU GDPR Regulation 2016/679). Of these, only one was considered invalid because the respondent had not taken part in the suppression operations of the 2017 season; thus, our sample comprised 185 people.
No reminder emails were sent, considering the nature of the work performed by the respondents in a potential H24 continuous emergency. Thus, the ratio of replies was 155%, since in some cases we received more than one answer from each firefighters’ station.
2.4. Statistical Analysis
In the analysis of the data, descriptive and inferential statistics were used. Descriptive statistics were calculated for each reply to items, namely the mean, SD, chi-square or χ2, and
p value. As the distributions of the score values do not have the same shapes, the means and SD (parametric elements) were used to highlight the differences in the distributions of responses [
50,
59,
60]. The general survey sample (
n = 185) was grouped into two subsamples: PF (
n = 62) and VF (
n = 123). To establish differences in the responses between pairs of subsamples, the Kruskal–Wallis test (Kruskal and Wallis, 1952) was applied, a nonparametric test alternative to the analysis of variance (ANOVA) when heteroscedastic (i.e., with different dispersion) and non-normally distributed data are given. The use of a nonparametric test is justified by the fact that the variables examined do not have a normal distribution and the observations were represented by ordinal classifications, such as Likert scores. The test was performed using the statistics package of the R software.
2.5. Index of Agreement
In order to demonstrate the differences between responses within an entire set of items, we propose the values of the Index of agreement [
61] built with the items of a five-point Likert scale. This index measures how much the sum of the positive values (Agree and Strongly Agree) is greater than the sum of the negative values plus the value of the undecided or doubtful ones:
4. Discussion
4.1. Sample Characterization
As per data, which are presented in
Table 1, the group of respondents (
n = 185) is made up of VF for about 67% of its consistency; the figure highlights the role and strategic importance of VF in the country’s rural firefighting organizations. In actuality, VF teams represent, at a national level, the main component of the service of rural firefighting [
67]. The groups of respondents are characterized by a dominant male presence at over 75%. As expected, females are mainly present in the VF group, an expression of the so-called “civil society” and, only recently, have begun appearing in the wildfire context of the country. Respondents have a good education level (secondary school, Bachelor’s or License, and Master’s), which is higher, as expected, in the VF—a transversal group with different social backgrounds and professions, who, in addition, engage in a risky volunteering activity perhaps resulting from environmental commitment and sensitivity. The job start dates are recent, more so for the VF group. Positions in the hierarchy are well distributed, and the number of replies from people in apical positions are high and similar in the two groups.
4.2. Facing the Inferno
As per data, which are presented in
Table 2, when facing the inferno of the 2017 wildfires, there are clear and statistically high significant differences between VF and PF, but means >4 in eight out of nine items demonstrate that respondents are impressed in the same but not contrasting way by the terrifying wildfire scenario, which triggers fear and a feeling of powerlessness. All firefighters faced completely unheard-of new events that were unexperienced before and representing a challenge for everybody. No wonder, despite some differences, they feel the same but not contrasting way about the inferno.
The group of VF always presents the highest average mean if compared to the group of PF, which means that their answer is closer to value 5 of the Likert scale, i.e., full agreement. The highest values in means are referred to the rate of spread and to the situation of fires exceeding the control capacity, which has the maximum value. This confirms that the VF group perceives fires with a significant difference from PF, arguably due to a lesser experience on the ground.
For the same reason, when dealing with EWEs, VF’s perception and feelings are amplified, probably also in this case due to having less knowledge and awareness of fire characteristics.
4.2.1. Flame Length/Height Classes
As per data, which are presented in
Table 3, the values observed and reported are consistent with an EWE [
1]: when adopting the simple equation, I = 300 L
2 [
68] for the assessment of intensity (L in m, I in kWm
−1), flames about 6 m long (in practical terms, the height of two buses on top of each other) can produce an intensity > 10,000 kWm
−1, typical of an EWE [
1]. High values were observed more by PF than VF, but the modal value for both groups clearly depicts a terrifying scenario of uncontrollable events, where flames of 15 to 30 m long are recorded by 45.90% of observations. VF express higher percentages than PF for the appraisal of flame length >6 m, but less for the most highly rated 15 >30 m class (40.65% vs. 56.45% by PF). We note that flames of <1.2 m in height (intensity < 346 kWm
−1) can generally be directly attacked at the head or flanks by persons using hand tools. With flames of 1.2 to 2.4 m in height (intensity 346–1730 kWm
−1), fires are too intense for a direct, head-on attack by persons using hand tools. Handlines cannot be relied on to hold fire [
69]. The maximum values of intensity <500 kWm
−1 for ground crews with hand tools and 500–2000 kWm
−1 for water under pressure and heavy machinery are given [
70]. During direct attack, personnel and resources work at, or are very close to, the burning edge of the fire; firefighters try to hit the fire aggressively by using hand tools and beaters and/or by applying water and/or retardants from knapsack sprayers. It is impossible to work near the flames of extreme fires with direct attack, due to the extreme radiation whose values can be lethal. EWEs have an intensity >10,000 kWm
−1 [
1] that is blatantly higher than the possibility of direct attack on the flames. Indeed, in “Classes of Flame Length”, 58 replies out of 62 reported flame lengths of >6 m for the extreme fires of the 2017 season in Portugal, which are consistent with the intensity typical of fires exceeding the control capacity, such as extreme wildfire events. Such values are further confirmed by “Fire Characteristics That Particularly Impressed Respondents”, where a high rate of spread with 71 replies (38.37%) receives most of the score.
4.2.2. Characteristics of 2017 Wildfires That Particularly Impressed
As per data, which are presented in
Table 4, respondents are mainly impressed by the high rate of spread, which amplifies the fear of being trapped and the impossibility of escape, followed by fatalities and injured people, and scenes of panic. At a distance, they mention the noise of roaring flames, wind, and spotting activity (all 4%). All other characteristics have values of <4.00%, with a maximum of 3.78% for the high number of buildings burning. The highest values are observed for a high rate of spread (71 observations, i.e., 38.37% of the total: 21 for PF, 33.87%, vs. 50 for VF, 40.65%) followed by the number of fatalities and injured people (49 observations, i.e., 26.48 of the total; 20 for PF, 32.25%, vs. 29 for VF, 23.57% of the total). Data confirm that EWE characteristics are well perceived as particularly impressive and dangerous.
4.2.3. Year of the Worst Event
As per data, which are presented in
Table 5 and
Table 6, with almost 73% of replies, the extreme events that occurred in 2017 are the worst that had been experienced by respondents. With 9.72%, the fires in the period 2000–2010 followed, when disastrous fires affected Portugal, with more than 300,000 hectares burned in 2003 and 2005. More recent fires, from 2018 to 2021, represent only 3.24% of the total.
When answering the question about the worst extreme fire experienced in 2017, firefighters refer to having operated in 44 municipalities. Of these, Pedrógão Grande alone was mentioned 33 times, followed by Arganil (six times) and a few others.
In the other periods, the number of affected municipalities is lower, but some of them have a recurrent presence in more than one period.
Regarding wildfire manifestation, there is no possibility of objectively defining the term “worst”, which could be interpreted in terms of burned area, burned buildings, duration, operational difficulties, etc. We cannot use frontline intensity as a factor, as this metric appeared for the first time in certain official reports concerning the 2017 extreme wildfires [
8,
10], but there is no information regarding preceding episodes; thus, “
worst” could be related, among other things, to the large size of the fire (e.g., megafires) or the difficulty of suppression. However, the 2017 wildfires receive the maximum score by both groups of respondents, because among other characteristics (fatalities, extremeness of behavior, etc.) they affected more hectares than any preceding years in the recent period of 2009–2021, namely, 563,532 hectares vs. affected surfaces at always <200,000 [
71].
4.3. Operational Activities and Problems
As per data, which are presented in
Table 7, concerning operational activities and the problems of the efficacy of fire suppression in its different phases, the rather scattered mean values demonstrate different perceptions by the two groups. This means that both groups have similar perceptions with respect to the many weaknesses of the organization, the chain of command, control, and, above all, the operational management of suppression operations.
High values of mean, >4, arguably express a greater awareness of the situations that arise in the emergency phases of complex fires (in this case, concerning communication and the ability to effectively manage extreme fires in 2017). We can observe, in synthesis, that with some differences due to experience, both groups are somewhat critical in identifying weaknesses in the operational management, suppression activities, and operational orders by the command-and-control chain. They underline the inefficacy of manual tools, difficulties in communication, and insufficient aerial resources, confirming that extreme events largely exceed control capacity, as is well known [
1].
4.4. At the Flame Front: The Feelings of Firefighters in Action
As per data, which are presented in
Table 8, the six questions in Topic 3 are related to the feelings of firefighters in action. Both groups confirm that they receive orders from the command-and-control chain and thus do not feel alone in the operational context. On the other hand, they perceive problems of communication, which are well-known and have already been made public by different inquiry commissions, responsible for the ex post analysis of the 2017 wildfires [
8,
10].
A lack of water for suppression with a low mean value but a rather high SD (mainly for PF) with dispersed and non-polarized replies and with some differences, even if not significant, means that the two groups perceive problems regarding water shortage during suppression operations, and thus, in direct and indirect attacks. The values of mean >4 also confirm that firefighters use PPE and care for their personal safety. Values of >3 and a low SD also confirm that firefighters in general felt physically well prepared.
For replies related to communication and lack of water, it is worth remembering that the size of operational scenarios in 2017 could have produced local differences in fire behavior and local problems that help to explain differences between groups and inside groups.
4.5. Emotions and Inner Feelings
As per data, which are presented in
Table 9, the set of eight items in Topic 4 explores the inner emotional reactions of firefighters in the presence of unexpected violent and large wildfires with the highest record of fatalities for the country and for the whole EU.
No paper, to our knowledge, has ever surveyed this type of topic in Portugal: respondents express understandable and human reactions of helplessness and fear, with higher values of the mean in the VF group. The significance of the different means can certainly be interpreted as due to the higher experience of the PF group, whose means are always lesser than the VF group: thus, they appear “hardened” by experience and less impressionable.
Item 8, related to the temptation to escape from danger and run, receives the least Likert score of all the survey, without significant differences between the two groups. We highlight the importance of this item, which refers to the behavior of individuals on duty in very difficult and risky conditions. Values of <2, meaning no agreement, reveal a unanimous sense of belonging, attachment to work and assigned tasks, and an appreciable sense of pride.
4.6. Psychological Support
As per data, which are presented in
Table 10, Topic 5, with four items, analyses the psychological conditions of firefighters ahead of the extraordinary events of 2017, as well as the need for psychological support immediately after the 2017 events, still needing psychological support long time after the events, their psychological conditions in 2017, and their willingness to remember 2017 events.
It seems that these type of questions have also never been examined for Portugal, and from what we can infer from the significant reference gathering, these aspects also seem to be not at all considered in other countries. The replies are statistically different, although with low significance, only in items 3 and 4 (psychological conditions in 2017, willingness to remember 2017 events). Three out of the four questions have means of <3 expressing disagreement. Means are <2 in the two first items, with a very reduced SD. The three questions should thus be interpreted in the sense that firefighters did not need psychological support at the time of the events, that they were psychologically prepared, and do not need psychological support years after the event. In our opinion, such replies with low values of means, indicating disagreement, seem rather strange, considering that the fire events in 2017 were extraordinary in size and extreme in terms of the violence of flames and the number of fatalities, as well being depicted as such in Topic 1 by the same firefighters.
We suppose that since this topic is rarely an object of discussion between firefighters, their replies could be interpreted as exactly contrary to their expressions: regarding the item referred to as little willingness (i.e., reluctance or avoidance) to remember the 2017 events, we realize that the well-known symptom of PTSD (post-traumatic stress disorder, the mental health condition that is triggered by a terrifying event, either experiencing it or witnessing it [
72]) is present in both groups, where people seem not ready or available to remember or discuss events.
Avoiding reminders of the event is actually one of the symptoms of PTSD and those who seem affected are encouraged to seek professional trauma treatment [
73]. This latter reply, although with a low mean (<3) but a high SD, reinforces our doubt that the results in this topic could be read as the inverse of the statement, induced by a misunderstanding of the relative questions.
4.7. Lessons Learned (Consequences)
As per data, which are presented in
Table 11, Topic 6 proposes a list of possible changes in the organization, training, safety, activities, and career of both groups. We could say that, in a transversal way, the two groups confirm the implementation of certain initiatives in their organization, safety, and training as a positive consequence of an unheard-of wildfire season.
The cold language of statistical parameters shows that, due to the tragic and deadly 2017 wildfire season and its heavy burden of fatalities, relevant changes have involved the actors of suppression activities. Lessons learned resulted in different and relevant changes in an effort to make suppression more efficient and updated in order to better cope with the evolution of the phenomenon of EWEs, which is rapidly becoming beyond the control capacity.
More relevant changes appear in the replies of the PF group and are much more limited or entirely absent in the replies by VF. Indeed, items with common similar responses are from the VF group: changes in crews’ organization, more efficient training, more specialized training, improved communication protocol among/with crews, more involvement in monitoring and prevention, more data sharing, more institutional collaboration, and firefighter career revision.
In synthesis, and in response to the working hypotheses:
- (i)
The two groups of respondents appear to be fairly close to each other: PF and VF could be significantly different for values of means, which represent the intensity of the perception but not the sense or direction of it, because there were no contrasting values, i.e., values in the lower part of the Likert scale for one group and, conversely, values in the upper part in the other.
- (ii)
The wildfires of Pedrógão Grande and October in the 2017 season were confirmed to be the worst experienced by most respondents.
- (iii)
The lessons learned from the 2017 season translated into certain changes and updates regarding the organization, training, and other measures in the Portuguese wildfire defense apparatus, but much remains to be done.
5. Conclusions
In conclusion, we point out the originality and interest of our paper, which, for the first time, gives voice to the actors of wildfire defense on the ground, having to cope with a phenomenon of increasing complexity such as the EWEs, which are not yet well understood and are therefore still dealt with using techniques and approaches that are no longer appropriate to its seriousness, as is well known.
From the answers, it emerges that the firefighters, whether PF or VF, are emotionally involved in the suppression activities and the complex dynamics of the events taking place. Their answers, although from only a modest number (n = 185) of participants, may be a prelude to a radical update and modernization of the rural fire defense service. The results of the survey allow sharp conclusions, the first being that this research fills a knowledge gap in the country.
Voluntary firefighters are a very important and strategic presence in the complex multi-structure and parceled-out organization of rural fire control in Portugal. The groups have significant differences in several aspects, whereas there is no difference in others. The most marked difference is in the topic regarding the perceptive manifestation of the phenomenon, where scores on the Likert scale by the VF group always have a mean greater than PF and are significantly different. This means that they perceive more amplified impressions of the complex scenario of fires as a whole and in its specific components. Probably this is a result of lesser experience.
Regarding the evaluation of distinct phases of activity, the two groups only partially have significant differences in score assessment, because in more than half of the items, they have similar and not different critical opinions.
Regarding the psychological aspects of fear and impressions, the groups differ, certainly as a result of different experiences on the ground, which implies that the PF group is harder and less impressionable. An important exception is related to the thought of abandoning the fight and fleeing to safety, for which no difference exists between the lowest averages in the whole survey expressed by the two groups, that is to say, a total disagreement and rejection of what is perhaps perceived as a treacherous and insidious suggestion.
Regarding Hypothesis 2, the Pedrógão Grande and October fires in 2017 remain the worst-ever events that occurred in Portugal both in the mind and perceptions of firefighters. Mentions of other fires in the past and after 2017 until 2021 remain largely distant from events where the extremeness of fires resulted in the heaviest burden in terms of fatalities, injuries, and damages to assets in the country records. Previous worst fires in the period 2011–2010 were mainly mentioned by PF, whereas VF preferably remembered more recent episodes, also after 2017. This is certainly a consequence of different experiences on the ground and arguably also regarding the age of respondents.
Finally, regarding Hypothesis 3 across all sections, regarding lessons learned and the consequences thereof, no significant differences exist between the two groups that unanimously evaluate the implementation of certain new initiatives after the deadly 2017 events.
This is a focal point, because it means rearranging the organization of defense against rural fires in line with the Decree-Law (DL) no. 82/2021 from 13 October. This recent DL clearly announced that the dramatic impact of large rural fires in Portuguese communities (with loss of human lives, property, and thousands of hectares of forest) has determined the firm will to change the national paradigm on the prevention and fight against rural fires, which are expressed in the guidelines approved by the Resolution of the Council of Ministers No. 157-A/2017 on 27 October and the principles expressed in the Single Directive of Prevention and Control, approved by the Council of Ministers Resolution No. 20/2018 on 1 March.
This new regime introduces the integrated management of rural territories and the mobilization of the agricultural and livestock sectors to integrate prevention with suppression. The adoption of good landscape planning and management practices, including the implementation and maintenance of fuel management belts, the disposal and reuse of residues, pasture renewal, and agro-forestry-pastoral mosaics, are crucial for a more resilient, viable, and value-generating territory, accepting the principles of Fire Smart Territory [
74,
75].
The replies of the respondents, although with no significantly different values of means, confirm that public powers have invested in resolving many of the consequences of the 2017 wildfire season. Both groups’ replies included values of no agreement in their responses, demonstrating that much is still to be done in the critical and crucial fields of changes in crew organization, more specialized training, improved communication protocol among/with crews, more involvement in monitoring and prevention, and firefighter career revision.
While this paper is clearly Portugal-centric, its approach could apply to other countries by properly adapting the questionnaire prepared in this research.