Next Article in Journal
Exploring the Functioning of Online Self-Organizations during Public Health Emergencies: Patterns and Mechanism
Previous Article in Journal
Differences in Drug Use among Persons Experiencing Homelessness According to Gender and Nationality
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Quantitative Study on Employees’ Experiences of a Support Model for Systematic Work Environment Management in Swedish Municipalities

1
Department of Medical Sciences, Occupational and Environmental Medicine, Uppsala University, 752 37 Uppsala, Sweden
2
Uppsala University Hospital, Occupational and Environmental Medicine, 751 85 Uppsala, Sweden
3
IPF, The Institute for Organizational and Leadership Development at Uppsala University, 753 20 Uppsala, Sweden
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2023, 20(5), 4010; https://doi.org/10.3390/ijerph20054010
Submission received: 18 January 2023 / Revised: 19 February 2023 / Accepted: 21 February 2023 / Published: 23 February 2023
(This article belongs to the Section Occupational Safety and Health)

Abstract

:
Today’s working life is constantly changing, and work environmental risk factors can alter swiftly. Besides the traditional physical work environment risk factors, somewhat more abstract organizational and social work environment factors also play an ever-increasing role, both in preventing and causing work-related illness. This requires a preventive work environment management that can respond to rapid changes, and where the assessment and remedies rely more on employee participation than on predetermined threshold limits. This study aimed to investigate if the use of a support model (the Stamina model) for workplace improvements could render the same positive effects in quantitative measures that have previously been shown in qualitative studies. Employees from six municipalities used the model for 12 months. They answered a questionnaire at baseline and after six and 12 months, to detect any changes in how they characterized their current work situation and perceived their influence, productivity, short-term recovery, and organizational justice. The results showed that employees felt more influential in work situations related to communication/collaboration and roles/tasks at the follow-up compared to the baseline. These results are consistent with previous qualitative studies. We found no significant changes in the other endpoints. The results strengthen previous conclusions, namely that the Stamina model can be used as part of inclusive, modern, and systematic work environment management.

1. Introduction

Working life has changed dramatically over the past decades [1], affecting the panorama of work-related ill-health. While workplace accidents have decreased by 25% over the last ten years [2], mental disorders have become the main cause of sickness absence in a number of economically developed countries, including Sweden [3]. Organizational and social risk factors are increasingly common causes of mental and physical work-related illnesses [4]. Preventive measures are needed to counter-act this trend. Several reviews have shown that having influence at work is one of the most important factors in employee’s mental health [5,6]. Methods that support participation and influence at work are therefore highly interesting. This study investigated the use of such a method in six Swedish municipals. Municipalities are of particular interest, as the public sector is one of the risk sectors for work related mental illness [3].
For more than three decades, European employers have been required to conduct preventive work environment management as part of their daily operations. This means implementing systems to identify and assess risks at work, and implementing measures aimed at reducing them [7]. In Sweden, national legislation specifies that employers must integrate what is called Systematic Work Environment Management into their day-to-day activities [8]. The term “systematic” refers to this being a constantly ongoing process (Figure 1).
Traditionally, systematic work environment management has focused on identifying physical risks, making risk assessments based on established threshold limits and taking action to reduce the exposure towards a zero value. In contemporary working life, aspects such as how work is organized, employee influence, and social interaction are increasingly important for workers’ health [1,9]. This calls for new approaches regarding how to identify, assess, and minimize risks in preventive work environment management, which, in itself, promotes participation, influence, belonging, joint reflection, and communication [1]. Both participatory approaches and employee influence have been shown to be crucial ingredients for the success of workplace interventions [10,11] and to improve workers’ well-being [12]. Participatory approaches have a built-in adaptability to the context and needs of the workplace, job tasks, and workers [10], keeping the intervention constantly updated. Participatory approaches are closely connected to influence at work, which is considered one of the most important psychosocial working conditions for employees’ mental health [5,6].
Participation and influence can be linked to the control dimension in the Karasek and Theorell job-strain model. This model has its roots in the late 1970s [13,14] and plays a prominent role in occupational health research. Simplified, the model describes how job demands (e.g., workload, work pace) should be placed in relation to job control (e.g., influence on task solving) [14]. The model was later supplemented with the dimension social support [15]. If the demands exceed the perceived control, job-strain occurs, which has been linked to several adverse health effects [14]. Later studies showed that the control dimension in particular (including the concept of influence) seems linked to mental health [6,16,17]. The vast body of knowledge about control and influence at work is based on quantitative studies using one of two questionnaires: JCQ (Job Content Questionnaire [18]) and DCQ (Demand Control Questionnaire [19]). In recent years, the question has been raised if such traditional scales are obsolete or if they adequately reflect the demands in modern knowledge-intensive jobs [1]. One example is the concept of work-autonomy, which traditionally has been considered as a positive resource for well-being, but where studies in contemporary contexts have shown that open-ended and self-directed work may at the same time contribute to work-family conflicts and sleep problems [20,21]. In an attempt to describe how employees in contemporary work life experience and understand the concept of influence at work, Andersen and colleagues conducted a recent qualitative study [22]. They concluded that the interviewed employees had a multifaceted understanding of influence at work and that influence mattered to them in important ways. In the analysis, three different themes of influence were detected, divided into: (1) work tasks and performance, (2) relations and belonging, and (3) identity and becoming. The second aspect of influence, related to relations and belonging, was experienced through discussion and mutual exchange of views and knowledge in dynamic processes with co-workers and managers. These thoughts about how influence is something that is shaped and formed in relation to others in the workplace evoke concepts such as “voice behavior”, defined as employee’s sharing ideas, information, and thoughts on improvement of work tasks and the organization [23]. Another concept of “tied autonomy” was suggested by Väänänen and Toivanen (2018), to describe the fact that contemporary employees have a high level of individual freedom to make decisions and plan their work, but at the same time are dependent on co-workers, who also have a high degree of influence. Employee influence at work is, therefore, embedded in multiple social and organizational relationships. This leads back to the need for interventions that create conditions for workers’ shared voice and participation [12].
In this study, the Stamina model (further explained in the section Materials and Methods) was used to support managers to facilitate employee participation and influence on workplace improvement. The model addresses the individual employee’s experience of the work situation in an exploratory manner, without predetermined questions, and where the employees themselves decide which topics they want to cover. The emphasis of the model lies in the group’s joint reflection, choice of a common goal, and responsibility for improving the everyday work situation. The model can be described as an exploratory participatory support model, to be used as part of preventive work environment management.
The model builds upon the Model of Integrated Group Development, a model that describes how groups achieve maturity and develop skills such as dependency, counter-dependency, and trust over time [24,25]. The Stamina model includes a measure, Human Resource Index (HRI), for giving rapid and recurrent feedback to the participants and first-line managers. Previous qualitative studies on the Stamina model showed positive results regarding its implementation and use among employees and managers in Swedish municipalities [26,27,28,29].
Besides influence at work, another important aspect of the social work environment, is perceived fairness in the organization [30]. Fairness is often referred to as “organizational justice”, a concept than can be divided into four dimensions: distributive justice, procedural justice, relational justice, and informative justice [30,31,32]. In the present study, the focus was on relational justice, which emphasizes the superior’s relationship to the employees. Relational justice is associated with health in the workplace [33], and mental illness specifically [30,34].
In stress prevention, recovery is an important factor that is negatively correlated with emotional exhaustion [35], by giving greater resilience to challenges in everyday life. Quality of sleep is an important part of recovery and is connected to feeling refreshed when waking up [36]. Psychosocially favorable variables at work such as organizational justice, social support, and control have been linked to less sleep disturbances among employees [37]. On the contrary, there is a negative association between sleep quality and stress [36,38]. Impaired sleep quality is linked to adverse health outcomes, such as sick absence, diabetes, and cardiovascular disease [39].
Sickness absence is frequently used to describe reduced working ability. To capture earlier signs of reduced working capacity, e.g., due to illness or work environment-related factors that hinder the individual from performing at full potential, other aspects of production loss can be of interest. This type of production loss at work is also referred to as presenteeism [40]. Previous studies showed that the employee’s perception of their production loss can be used to screen organizations regarding production loss related to the work environment [41]. It has been suggested that this measure can function as an outcome measure for interventions aimed at improving the organizational work environment [42].
The present study aimed to examine if quantitative measures captured any perceived changes in the work environment, which had previously been described using qualitative measures among employees within Swedish municipalities, using a model that focused on employee participation and influence. Quantitative measures have the advantage of being easier to follow over time by management and employees in real-life settings.

2. Materials and Methods

This study was carried out as part of a larger project, focusing on the use and implementation of the Stamina model in various municipalities across Sweden, which was thoroughly described in a protocol study [43].

2.1. Study Design and Settings

The current study was conducted in six municipalities located in the southern and middle part of Sweden. These six municipalities were included in the study after the management had participated in a pre-program focused on establishing commitment, preparation, and planning, and then decided to use the Stamina model for a period of two years, which is considered the minimum time frame for changes to occur in this context [44]. An important perspective of the whole project was to use the model in a real-world context, mainly administrated by the municipalities themselves. This, for example, allowed the participating municipalities to choose the number of employees included in the project. Another consequence of this principle was that the questionnaires were delivered and data gathered through a web-questionnaire that was distributed via an open link. Participants were invited to take the online survey by their supervisor via e-mail. Employees were informed that participation in Stamina involved participation in a research project where all data were handled anonymously and could not be traced to specific individuals (details of the online survey can be found in Appendix A).
No individual data were gathered, only data on a group level, stating the results of a number of participants in each work group. This is in line with other employee surveys aimed at business development, due to anonymity aspects. This, however, made repeated measures on an individual level impossible. Since the permissive framework allowed the municipalities themselves to redefine how the groups were divided during the course of the study, it also became difficult to follow the results in certain work groups over time. All in all, this led to all municipalities’ data being summed into one total result.

2.2. Stamina Model

Stamina is an acronym for “structured and time-effective approach through methods for an inclusive and active working life” and refers to the perseverance required for continuous improvement work. The model builds upon the Model of Integrated Group Development [24], with a participatory systematic approach and has been thoroughly described elsewhere [43]. In short, the model has a specific structure that brings support and stability, but at the same time allows for a high degree of employee participation through flexibility regarding the content and actions. The starting point is the gathering of anonymous reflections about the current work situation from every employee. Respondents can enter an unlimited number of reflections, and the employee then rates each reflection as positive/negative (valence) and as influenceable or not. By using an algorithm, each employee receives a total individual score on how the work environment is graded on a scale of 0 to 100 (where 0 is as negative/not influenceable as possible and 100 is as positive/influenceable as possible). The individual score is not communicated to the employee or to the manager. The employee tags each reflection with one of nine pre-defined categories. The category design was inspired by Wheelan’s theories of group development [24]. The individual scores are summarized into the group’s score, called the Human Resource Index (HRI), also ranging from 0 to 100, and a report is generated for each group. The report serves as working material to support the work group’s reflections and discussions during a subsequent workshop, where problems and suggestions are prioritized and formalized in an action plan. There is also an integrated system for issues targeted in other parts of the organization (secondments). Figure 2 shows the workflow, where every workshop is followed by two follow-up-sessions. On each occasion, a new HRI is calculated and reported, as feedback to managers and employees. The model mimics the mandatory steps of the systematic work environment management described in Figure 1, through investigation (open web-question), risk assessment and action plan (created by the group during the workshop), and built-in sessions for follow-up. A key element is that the first-line manager oversees the process but is instructed to let the group lead the discussion, set up priorities and an action plan, and assign tasks. The implementation process has been thoroughly described in several previous publications [26,27,28,45,46].

2.3. Measures

2.3.1. Human Resource Index

The Human Resource Index (HRI) measures employees’ perceptions of their current work situation on a scale of 0 to 100. The index is created using an algorithm where each employee receives a total individual score based on how they rate every free-text answer they use to describe their current work situation, where 0 is as negative/not influenceable as possible and 100 is as positive/influenceable as possible. The individual scores are summed into a group score, also ranging from 0 to 100. This has been thoroughly described in a previous protocol study [43]. The index has been shown to predict the risk of negative health outcomes [47].

2.3.2. Perceived Productivity

The employees’ experience of their own productivity was measured using validated questions that capture the effect of health problems and work-related problems on work performance [48]. Employees were asked to answer the question: “Over the past 7 days, have you experienced any health-related problems while at work? Health problems refer to any physical or emotional problems or symptoms”. Response options were either “yes” or “no”. Health-related production loss was then measured using the question: “During the past seven days, how much did your health problems affect your performance while you were working?”. Response options ranged from 0 to 10, where 0 = “Health problems had no effect on my work” and 10 = “Health problems completely prevented me from working”. Similarly, employees were asked if they had experienced work environment-related problems (“yes” or “no”) and how these problems had affected their performance on a scale of 0 to 10, where 0 = “Work environment problems had no effect on my work” and 10 = “Work environment problems completely prevented me from working”. Work environment problems were explained as: “Work environment problems refer to any physical, psychological, or social problems that might arise in the work environment”.

2.3.3. Organizational (Relational) Justice

Organizational justice targets the perceived fairness in the organization and shows links to mental illness [30,34] and other aspects of health, such as long-term inflammatory markers [49], well-being [50,51], low sickness absence, and the ability to predict future ill health [34]. The concept of organizational justice can be divided into four dimensions: distributive, procedural, relational, and informative justice [30,31,32]. In the present study, the focus was on relational justice (also referred to as interpersonal or interactional justice). This sub-domain involves the superior’s relationship with their employees; how the manager handles the employees’ personal views and rights; if the employees are treated impartially, truthfully, and with kindness. There were five statements concerning relational justice, where the participants indicated to what degree they agreed or disagreed with the statements. The scale ranged from 1 to 5, where 1 = strongly disagree and 5 = strongly agree. The five subscales were then summed into an index, which is referred to in the following as the Relational justice index.

2.3.4. Short-Term Recovery during Sleep

Recovery, or rather lack of recovery, has been suggested to be a likely mediator between a stressful work situation and related health effects [35,52]. As long as you are able to recover on a regular basis, you are more likely to cope with stressful exposures and less likely to become emotionally exhausted. One important aspect in recovery is a high quality of sleep [36]. Impaired sleep quality is linked to health outcomes such as sickness absence [53], diabetes, and cardiovascular disease [39]. Organizational work conditions such as high organizational justice, social support, and control are linked to fewer sleep disturbances among employees [37]. In this study, sleep quality was assessed using a single item from the Karolinska Sleep Questionnaire [54], since “feeling refreshed when waking up” is positively associated with objective sleep quality [36]. The instructions given to the participants were that they should rate whether they have experienced the following complaint during the past three months “Do not feel refreshed when waking up”, and this was assessed on a rating scale with six response alternatives, from never to always. Hence, the question about sleep was used as a proxy for short-term recovery.

2.4. Data Analysis

The measurements of HRI, short time recovery, relational justice, and productivity are all variables without normal distribution, which is why descriptive statistics present the mean (M), standard deviation (SD), median (Md), and interquartile range (IQR). Change over time in output measures (T1–T3, see Table 1) was analyzed using Student’s t-test for HRI and Wilcoxon rank sum test for categorical variables. Changes in the proportions over time were analyzed using a two-sample Z-test for equality of proportions. The significance level was set at p < 0.05. Due to drop-outs, the results from the fourth time point (T4) were excluded from the statistical analysis but are shown in Table 1 for transparency. R Studio (version 27–28) was used for the descriptive and statistical analyses.

3. Results

3.1. Participants

Table 1 outlines the descriptive data regarding number of participants and number of free-text answers during the study procedure.
Table 1. Timepoint for data collection (period and mean number of days since baseline), number of participants at each timepoint (summarized for all municipals), and total number of free-text answers given by the participants.
Table 1. Timepoint for data collection (period and mean number of days since baseline), number of participants at each timepoint (summarized for all municipals), and total number of free-text answers given by the participants.
Baseline (T1)Time Point 2 (T2)Time Point 3 (T3)Time Point 4
(T4)
Data collectionSpring 2017Autumn 2017Spring 2018Autumn 2018
Days after T1 (mean)-228 days357 days550 days
No. of participants
(all municipals)
11911005558329
No. of free-text answers in total5 036368819991863

3.2. Work Situation Categorisation, Attitude, and Perceived Influence

Table 2 illustrates the changes in the number of reflections made by the participants and how they categorized the aspects that characterize the current work situation at baseline (T1) and at the third measurement point (T3). The categories are shown in the left column (1–10) and were pre-defined by the model. The corresponding numbers in the second column show the proportion of the total amount of reflections at baseline (T1) that contributed to each category. This sums up to 100%. The same applies to T3 in the third column. At both time points, the vast majority, about one-third of the reflections, were categorized as “work environment and health”. The second most common category was “communication and collaboration”, and in third place was “Roles and tasks”. There was a significant increase in the proportion of reflections categorized as “Implementation and follow-up” (from 5.2% to 6.6%; p < 0.05) and a decrease in reflections categorized as “Demands and feedback” (from 2.3% to 1.5%, p < 0.05).
The columns on the right in Table 2 show the proportion of reflections within each category that are considered positive and influenceable, respectively. For example, 66.3% of the reflections categorized as “results and goal fulfilment” are considered to be positive at T1 and 68.4% at T3. Among the same reflections, 59.8% are considered to be influenceable at T1 and 67.3% at T3, a non-significant increase (p > 0.05). Work issues categorized as “Roles and tasks” are considered significantly more positive and influenceable (increases from 57.9% to 68.7% and from 50.0% to 65.0%, respectively, p < 0.05). In addition, issues regarding “Communications and collaboration” are considered more influenceable (increases from 66.1% to 72.8%, p < 0.05).

3.3. HRI, Perceived Productivity, Short-Term Recovery, and Relational Justice

Table 3 summarizes the change in the rest of the outcome measures, showing that there was no significant change in the human resources index, relational justice index, short-term recovery, health-related production loss, or work environment related production loss during the study period (T1–T3).
The proportion that reported health related and work environment related production loss decreased slightly (51–46% and 48–44%, respectively), but not significantly. The proportion of employees with HRI lower or equal to 50.0 decreased slightly from 31.9% at T1 to 30.1% at T3 (p > 0.05).
Regarding relational justice, the index showed no significant change over time (index 24.8–25.0, p > 0.05). The sub-domain “supervisor’s ability to suppress personal biases”, however, showed a tendency towards a small positive change (from a mean at 3.82 (SD 1.08)–3.94 (SD 1.03), p < 0.05).
Table 4 shows the relationship between low HRI, relational justice index, and short-term recovery at T1. There seemed to be a connection between considering the work situation as negative and difficult to affect (low HRI), being less recovered, and not considering the organization as being fair. This connection remained at T3.

4. Discussion

The main findings of this study of a real-life use of an explorative participatory support model for work environment improvement are that, after using the model for one year, the employees perceived increased influence regarding aspects of “communication and collaboration” and “roles and tasks”.
This is congruent with previous qualitative results showing that working according to the model changed the dialogue and communication within the work groups. Specifically, it changed from a person-oriented, and often individually focused type of criticism, towards a task-oriented communication, focusing on the group’s common goals and tasks, and increasing the employees’ understanding of their role in relation to the whole work situation [27]. The close relationship between perceived influence and one’s perspective of one’s role at the workplace was recently discussed by Andersen et al., who stated that to contemporary employees, the meaning of influence is multifaceted, where one aspect is how it can shift the employees’ self-understanding from being a passive object to an active subject [22].
The results showed no significant change in HRI, although there was a positive change in six out of nine subcomponents regarding influence and five out of nine regarding attitude, as presented in Table 2. In other words, the change to influence or attitude had not altered sufficiently to affect the HRI significantly. In no category had the attitude or influence switched sides of the 50-marker. That is, there was no shift in valence (negative/positive) regarding attitude or influence.
Similarly, perceived productivity, short-term recovery, and organizational justice did not show any significantly changes, even if the trend showed subtle positive changes in all of those outcomes. This insignificant result differed from a previous study on the model in a hospital perioperative context [29], where the HRI improved significantly from a low level, production-loss decreased significantly, and short-term recovery improved (although it was not statistically significant). One explanation for this might be the poor starting position and other contextual factors in this previously studied organization. The current study had wider and more heterogenous settings, which were not characterized by one and the same organizational work environment. It may be that, in those groups, there was a need for a change in influence and more time to get used to the concept of group reflection before any results in HRI, productivity, recovery, or organizational justice could be detected. A previous qualitative study on the model showed that some employees/groups experienced an improvement after the first session, while others did not notice any change until the last interview, two years from the start [27]. Such differences in the implementation process may be explained by many factors [44]. “Organizational readiness for change” is suggested to be one important factor for an intervention to be effectively implemented, described as “a shared psychological state in which organizational members feel committed to implementing an organizational change and confident in their collective abilities to do so” [55]. In this study context, the dynamic relationship between relations, influence, and voice behavior, as described by Andersen et al. [22], may play a role. For practicing voice behavior, it is suggested that influence might both be a pre-condition and a result. Perhaps the perception of a certain level of influence is required before the group can reflect together at a level that leads to work environment improvements large enough to have an impact on the HRI value, productivity, recovery, and organizational justice. Previous results in the project indicated that in this particular context, giving more responsibility to the employees was a new experience for many of the managers, and thus having the mandate to identify problems and solutions was often a new experience for the employees [45]. A recent study in the Swedish construction industry, where an intervention to target stress and psychosocial working conditions was co-created with different stakeholders, showed similar results. After 24 months, the primary outcome of stress had not improved, unlike aspects of role clarity [56]. The authors suggested the time aspect as one explanation, since the main improvement in role clarity took place in the second year, and that its possible effect on stress might emerge later.
One limitation of this study is that there was a substantial drop-out. This was mainly due to a reorganization in the company that managed and distributed the questionnaires. This led to concerns and a reluctance for the included municipalities. Another limitation is the explorative design, with a focus on the process and quantitative measures, but scarce knowledge of what happens in groups not using the model and limited control over the effect of other changes in the organizations. A control group design would, therefore, be preferable in future studies on quantitative data. In addition, the summation of the results from all employees and work groups may have led to a dilution of the results, where positive results from certain work groups could not be detected in the cumulative data.

5. Conclusions

The results in this study showed no change in HRI, perceived productivity, short-term recovery, or relational justice, possibly partly because of a shorter follow-up period than planned. Furthermore, the lack of a control group leads to uncertainty about how other external factors affected the results. More studies are needed, preferably with a control group design, a longer follow-up period, and in other business sectors.
The results of this study, using current quantitative measures, were consistent with previous qualitative results, strengthening the finding that the use of an explorative participatory support models for work environment improvement can contribute to increased influence at work in the aspects of “communication and collaboration” and “roles and tasks”. Since influence at work is one of the most important psychosocial working conditions for employees’ mental health, such a model may have a valuable role in contemporary systematic work environment management.

Author Contributions

All authors have substantially contributed to this publication. Conceptualization, M.S. and T.H.; methodology M.S., T.H., F.M. and S.P.; validation, M.S., T.H. and F.M.; investigations S.P. and F.M.; software, F.M.; formal analysis, F.M.; resources, M.S.; data curation, F.M. and S.P.; writing—original draft preparation, S.P.; writing—review and editing, M.S., T.H. and F.M.; supervision, F.M.; project administration, T.H.; funding acquisition, M.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by AFA Insurance, grant number 160271. The APC was funded by Uppsala University and the Region of Uppsala.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Regional Ethics Committee in Uppsala, Sweden (Project reference number 2017/093); and the regional agreement on medical training and clinical research between Uppsala University and University Hospital (ALF), Uppsala, Sweden.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

Magnus Svartengren (M.S.) has been Chairman of the Board of Directors for the Human Resources Institute AB, the organization that has owned the legal rights to the Human Resources Index measurement tool since 13 November 2020. However, this had no influence on the research design, analysis, and results. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Appendix A

  • Step 1. Introduction
The STAMINA model’s web question examines what you consider relevant to describe your current work situation, without using guiding questions or questions that someone else has come up with. Instead, you respond to an open-ended question that reads: “What characterizes your work situation right now?” You answer by writing down what you think of until you get a bullet list:
  • Your first answer—A thought or perception;
  • Your second answer;
  • Your third answer;
  • Your fourth answer;
  • Etc.
When you are finished, the bullet list is saved, and each bullet reappears on the screen. Now mark what you think of each point. Does it stand for something you experience as positive or negative and how much do you think you can influence what you have written? You mark your setting using the step-less scale. Each answer should be linked to an area that you select from a drop-down list before proceeding to the next item on your list. Your and your colleagues’ answers are compiled in a report. In the report, you can read all the answers from the group, but no one can see who wrote what. Before you finish, you will be asked to answer a few short questions. They are part of a large research project on how the work environment affects our health and productivity. A research group at Uppsala University follows different workplaces in a large study. You will not be able to see your answers in the group reports, as they are only intended for research.
  • Step 2. How would you describe your current work situation?
Make a list: Give your personal picture of your work. Describe your experiences, both positive and negative. Make a note of what you will think of in the fields to the right. Use one field for each point. You have seven fields at your disposal. Try to use at least three of the fields. Answer as spontaneously and sincerely as possible. Remember that your answers are anonymous and confidential.
  • Step 3. Evaluation
We now ask you to evaluate what you have written by clicking or dragging the selection on the scale.
  • 1. You wrote: [STRESS]
  • What attitude do you have to this that you wrote?
  • Negative—Positive.
  • To what extent can you influence what you have written?
  • Not at all—Completely.
  • How important is this for you?
  • Not at all important—Very important.
In which of the following areas/categories do you think what you have written belongs?
  • Results and goal fulfilment;
  • External circumstances and the outside world;
  • Implementation and follow-up;
  • Work environment and health;
  • Roles and tasks;
  • Skills and learning;
  • Demands and feedback;
  • Time use and working methods;
  • Communication and collaboration;
  • Other.
  • Step 4. Research questions
The STAMINA model contains research questions that Uppsala University poses in order to develop Swedish working life. The answers are compiled in a national database that is part of a multiyear national study. Only the researchers have access to the collected material. Your and your group’s answers will therefore not be reported and are thus not included in the group report that you and your group will have access to. The research questions begin with questions about how you view life in general. Then follows questions about your health and sleep and ends with questions about your relationship with your boss.

References

  1. Väänänen, A.; Toivanen, M. The Challenge of Tied Autonomy for Traditional Work Stress Models. Work Stress 2018, 32, 1–5. [Google Scholar] [CrossRef] [Green Version]
  2. Work-Related Diseases|Safety and Health at Work EU-OSHA. Available online: https://osha.europa.eu/en/themes/work-related-diseases (accessed on 13 February 2023).
  3. Försäkringskassan [Swedish Social Insurance Agency]. Sjukfrånvaro i Psykiatriska Diagnoser: En Registerstudie av Sveriges Arbetande Befolkning i åldern 20–69 år [Sick Leave due to Mental Disorders: A Register Based Study of the Working Population 20–69 Years in Sweden. Social Insurance Report 2020:8]; Swedish Social Insurance Agency: Stockholm, Sweden, 2020. [Google Scholar]
  4. Statens Beredning för Medicinsk Utvärdering (SBU); [Swedish Council on Health Technology Assessment]. Arbetsmiljöns Betydelse för Symtom på Depression Och Utmattningssyndrom. En Systematisk Litteraturöversikt. [The Importance of the Work Environment for Symptoms of Depression and Fatigue Syndrome. A Systematic Literature Review]; Swedish Council on Health Technology Assessment: Stockholm, Sweden, 2014; p. 461. [Google Scholar]
  5. Kivimäki, M.; Nyberg, S.T.; Pentti, J.; Madsen, I.E.H.; Hanson, L.L.M.; Rugulies, R.; Vahtera, J.; Coggon, D. IPD-Work consortium Individual and Combined Effects of Job Strain Components on Subsequent Morbidity and Mortality. Epidemiology 2019, 30, e27–e29. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Madsen, I.E.H.; Nyberg, S.T.; Hanson, L.L.M.; Ferrie, J.E.; Ahola, K.; Alfredsson, L.; Batty, G.D.; Bjorner, J.B.; Borritz, M.; Burr, H.; et al. Job Strain as a Risk Factor for Clinical Depression: Systematic Review and Meta-Analysis with Additional Individual Participant Data. Psychol. Med. 2017, 47, 1342–1356. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. European Council Directive. Council Directive 89/391/EEC of 12 June 1989 on the Introduction of Measures to Encourage Improvements in the Safety and Health of Workers at Work. Off. J. Eur. Communities 1989, 183, 1–11, Directive 89/391/EEC. [Google Scholar]
  8. Arbetsmiljöverket [Swedish Work Environment Authority]. Provision AFS 2001:1: Systematiskt Arbetsmiljöarbete. [Systematic Work Environment Management]; Swedish Work Environment Authority: Stockholm, Sweden, 2001; Volume 1. [Google Scholar]
  9. Harvey, S.B.; Modini, M.; Joyce, S.; Milligan-Saville, J.S.; Tan, L.; Mykletun, A.; Bryant, R.A.; Christensen, H.; Mitchell, P.B. Can Work Make You Mentally Ill? A Systematic Meta-Review of Work-Related Risk Factors for Common Mental Health Problems. Occup. Environ. Med. 2017, 74, 301–310. [Google Scholar] [CrossRef]
  10. Van Eerd, D.; Cole, D.; Irvin, E.; Mahood, Q.; Keown, K.; Theberge, N.; Village, J.; St. Vincent, M.; Cullen, K. Process and Implementation of Participatory Ergonomic Interventions: A Systematic Review. Ergonomics 2010, 53, 1153–1166. [Google Scholar] [CrossRef]
  11. Nielsen, K.; Randall, R.; Holten, A.-L.; González, E. Conducting Organizational-Level Occupational Health Interventions: What Works? Work Stress 2010, 24, 234–259. [Google Scholar] [CrossRef]
  12. Fox, K.E.; Johnson, S.T.; Berkman, L.F.; Sianoja, M.; Soh, Y.; Kubzansky, L.D.; Kelly, E.L. Organisational-and Group-Level Workplace Interventions and Their Effect on Multiple Domains of Worker Well-Being: A Systematic Review. Work Stress 2022, 36, 30–59. [Google Scholar] [CrossRef]
  13. Fransson, E.I.; Nyberg, S.T.; Heikkilä, K.; Alfredsson, L.; Bacquer, D.D.; Batty, G.D.; Bonenfant, S.; Casini, A.; Clays, E.; Goldberg, M.; et al. Comparison of Alternative Versions of the Job Demand-Control Scales in 17 European Cohort Studies: The IPD-Work Consortium. BMC Public Health 2012, 12, 62. [Google Scholar] [CrossRef] [Green Version]
  14. Karasek, R.A. Job Demands, Job Decision Latitude, and Mental Strain: Implications for Job Redesign. Adm. Sci. Q. 1979, 24, 285–308. [Google Scholar] [CrossRef]
  15. Johnson, J.V.; Hall, E.M. Job Strain, Work Place Social Support, and Cardiovascular Disease: A Cross-Sectional Study of a Random Sample of the Swedish Working Population. Am. J. Public Health 1988, 78, 1336–1342. [Google Scholar] [CrossRef] [Green Version]
  16. Theorell, T.; Hammarström, A.; Aronsson, G.; Träskman Bendz, L.; Grape, T.; Hogstedt, C.; Marteinsdottir, I.; Skoog, I.; Hall, C. A Systematic Review Including Meta-Analysis of Work Environment and Depressive Symptoms. BMC Public Health 2015, 15, 738. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Theorell, T.; De Manzano, Ö.; Lennartsson, A.-K.; Pedersen, N.L.; Ullén, F. Self-Reported Psychological Demands, Skill Discretion and Decision Authority at Work: A Twin Study. Scand. J. Public Health 2016, 44, 354–360. [Google Scholar] [CrossRef] [PubMed]
  18. Karasek, R.; Brisson, C.; Kawakami, N.; Houtman, I.; Bongers, P.; Amick, B. The Job Content Questionnaire (JCQ): An Instrument for Internationally Comparative Assessments of Psychosocial Job Characteristics. J. Occup. Health Psychol. 1998, 3, 322–355. [Google Scholar] [CrossRef]
  19. De Jonge, J.; Kompier, M.A.J. A Critical Examination of the Demand-Control-Support Model from a Work Psychological Perspective. Int. J. Stress Manag. 1997, 4, 235–258. [Google Scholar] [CrossRef]
  20. Rugulies, R.; Martin, M.H.T.; Garde, A.H.; Persson, R.; Albertsen, K. Deadlines at Work and Sleep Quality. Cross-Sectional and Longitudinal Findings among Danish Knowledge Workers. Am. J. Ind. Med. 2012, 55, 260–269. [Google Scholar] [CrossRef]
  21. Väänänen, A.; Kumpulainen, R.; Kevin, M.V.; Ala-Mursula, L.; Kouvonen, A.; Kivimäki, M.; Toivanen, M.; Linna, A.; Vahtera, J. Work-Family Characteristics as Determinants of Sickness Absence: A Large-Scale Cohort Study of Three Occupational Grades. J. Occup. Health Psychol. 2008, 13, 181–196. [Google Scholar] [CrossRef] [PubMed]
  22. Andersen, M.F.; Svendsen, P.A.; Nielsen, K.; Brinkmann, S.; Rugulies, R.; Madsen, I.E.H. Influence at Work Is a Key Factor for Mental Health—But What Do Contemporary Employees in Knowledge and Relational Work Mean by “Influence at Work”? Int. J. Qual. Stud. Health Well-Being 2022, 17, 2054513. [Google Scholar] [CrossRef]
  23. Dyne, L.V.; Ang, S.; Botero, I.C. Conceptualizing Employee Silence and Employee Voice as Multidimensional Constructs*. J. Manag. Stud. 2003, 40, 1359–1392. [Google Scholar] [CrossRef]
  24. Wheelan, S.A. Creating Effective Teams. A Guide for Members and Leaders, 4th ed.; SAGE Publications Inc.: Thousand Oaks, CA, USA, 2013; ISBN 978-1-4833-4612-0. [Google Scholar]
  25. Wheelan, S.A.; Kesselring, J. Link Between Faculty Group: Development and Elementary Student Performance on Standardized Tests. J. Educ. Res. 2005, 98, 323–330. [Google Scholar] [CrossRef]
  26. Hellman, T.; Molin, F.; Svartengren, M. A Mixed-Method Study of Providing and Implementing a Support Model Focusing on Systematic Work Environment Management. J. Occup. Environ. Med. 2020, 62, e160–e166. [Google Scholar] [CrossRef] [PubMed]
  27. Hellman, T.; Molin, F.; Svartengren, M. A Qualitative Study on Employees’ Experiences of a Support Model for Systematic Work Environment Management. Int. J. Environ. Res. Public Health 2019, 16, 3551. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Molin, F.; Hellman, T.; Svartengren, M. Implementing New Working Practices Through a Structured Support Model for Systematic Work Environment Management: A Qualitative Study From Swedish Municipalities. J. Occup. Environ. Med. 2021, 63, e259–e266. [Google Scholar] [CrossRef] [PubMed]
  29. Arakelian, E.; Paulsson, S.; Molin, F.; Svartengren, M. How Human Resources Index, Relational Justice, and Perceived Productivity Change after Reorganization at a Hospital in Sweden That Uses a Structured Support Model for Systematic Work Environment Management. Int. J. Environ. Res. Public Health 2021, 18, 11611. [Google Scholar] [CrossRef] [PubMed]
  30. Ndjaboué, R.; Brisson, C.; Vézina, M. Organisational Justice and Mental Health: A Systematic Review of Prospective Studies. Occup. Environ. Med. 2012, 69, 694–700. [Google Scholar] [CrossRef] [PubMed]
  31. Greenberg, J. A Taxonomy of Organizational Justice Theories. Acad. Manag. Rev. 1987, 12, 9–22. [Google Scholar] [CrossRef] [Green Version]
  32. Greenberg, J. Organizational Justice: Yesterday, Today, and Tomorrow. J. Manag. 1990, 16, 399–432. [Google Scholar] [CrossRef]
  33. Greenberg, J. Organizational Injustice as an Occupational Health Risk. Acad. Manag. Ann. 2010, 4, 205–243. [Google Scholar] [CrossRef]
  34. Kivimäki, M.; Elovainio, M.; Vahtera, J.; Ferrie, J.E. Organisational Justice and Health of Employees: Prospective Cohort Study. Occup. Environ. Med. 2003, 60, 27–33, discussion 33-34. [Google Scholar] [CrossRef] [Green Version]
  35. Sonnentag, S.; Fritz, C. The Recovery Experience Questionnaire: Development and Validation of a Measure for Assessing Recuperation and Unwinding from Work. J. Occup. Health Psychol. 2007, 12, 204–221. [Google Scholar] [CrossRef] [Green Version]
  36. Åkerstedt, T.; Hume, K.; Minors, D.; Waterhouse, J. The Subjective Meaning of Good Sleep, An Intraindividual Approach Using the Karolinska Sleep Diary. Percept. Mot. Skills 1994, 79, 287–296. [Google Scholar] [CrossRef] [PubMed]
  37. Linton, S.J.; Kecklund, G.; Franklin, K.A.; Leissner, L.C.; Sivertsen, B.; Lindberg, E.; Svensson, A.C.; Hansson, S.O.; Sundin, Ö.; Hetta, J.; et al. The Effect of the Work Environment on Future Sleep Disturbances: A Systematic Review. Sleep Med. Rev. 2015, 23, 10–19. [Google Scholar] [CrossRef] [PubMed]
  38. Morphy, H.; Dunn, K.M.; Lewis, M.; Boardman, H.F.; Croft, P.R. Epidemiology of Insomnia: A Longitudinal Study in a UK Population. Sleep 2007, 30, 274–280. [Google Scholar] [PubMed] [Green Version]
  39. Buysse, D.J.; Grunstein, R.; Horne, J.; Lavie, P. Can an Improvement in Sleep Positively Impact on Health? Sleep Med. Rev. 2010, 14, 405–410. [Google Scholar] [CrossRef] [PubMed]
  40. Brooks, A.; Hagen, S.E.; Sathyanarayanan, S.; Schultz, A.B.; Edington, D.W. Presenteeism: Critical Issues. J. Occup. Environ. Med. 2010, 52, 1055–1067. [Google Scholar] [CrossRef]
  41. Karlsson, M.L.; Bergström, G.; Björklund, C.; Hagberg, J.; Jensen, I. Measuring Production Loss Due to Health and Work Environment Problems: Construct Validity and Implications. J. Occup. Environ. Med. 2013, 55, 1475–1483. [Google Scholar] [CrossRef]
  42. Lohela-Karlsson, M.; Hagberg, J.; Bergström, G. Production Loss among Employees Perceiving Work Environment Problems. Int. Arch. Occup. Environ. Health 2015, 88, 769–777. [Google Scholar] [CrossRef] [Green Version]
  43. Svartengren, M.; Hellman, T. Study Protocol of an Effect and Process Evaluation of the Stamina Model; a Structured and Time-Effective Approach through Methods for an Inclusive and Active Working Life. BMC Public Health 2018, 18, 1070. [Google Scholar] [CrossRef] [Green Version]
  44. Moore, G.F.; Evans, R.E.; Hawkins, J.; Littlecott, H.; Melendez-Torres, G.J.; Bonell, C.; Murphy, S. From Complex Social Interventions to Interventions in Complex Social Systems: Future Directions and Unresolved Questions for Intervention Development and Evaluation. Evaluation 2019, 25, 23–45. [Google Scholar] [CrossRef] [Green Version]
  45. Molin, F.; Hellman, T.; Svartengren, M. First-Line Managers’ Experiences of Working with a Structured Support Model for Systematic Work Environment Management. Int. J. Environ. Res. Public Health 2020, 17, 3884. [Google Scholar] [CrossRef]
  46. Molin, F.; Paulsson, S.Å.; Hellman, T.; Svartengren, M. Can the Human Resources Index (HRI) Be Used as a Process Feedback Measurement in a Structured Support Model for Systematic Work Environment Management? Int. J. Environ. Res. Public Health 2021, 18, 6509. [Google Scholar] [CrossRef]
  47. Josephson, M.; Vingård, E. Zest for Work? Assessment of Enthusiasm and Satisfaction with the Present Work Situation and Health—A 1.5-Year Follow-up Study. Work 2007, 29, 225–231. [Google Scholar] [PubMed]
  48. Aboagye, E.; Jensen, I.; Bergström, G.; Hagberg, J.; Axén, I.; Lohela-Karlsson, M. Validity and Test–Retest Reliability of an at-Work Production Loss Instrument. Occup. Med. 2016, 66, 377–382. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  49. Elovainio, M.; Heponiemi, T.; Sinervo, T.; Magnavita, N. Organizational Justice and Health; Review of Evidence. G. Ital. Med. Lav. Ergon. 2010, 32, B5–B9. [Google Scholar] [PubMed]
  50. Stoetzer, U.; Bergman, P.; Aborg, C.; Johansson, G.; Ahlberg, G.; Parmsund, M.; Svartengren, M. Organizational Factors Related to Low Levels of Sickness Absence in a Representative Set of Swedish Companies. Work 2014, 47, 193–205. [Google Scholar] [CrossRef] [PubMed]
  51. Stoetzer, U.; Åborg, C.; Johansson, G.; Svartengren, M. Organization, Relational Justice and Absenteeism. Work 2014, 47, 521–529. [Google Scholar] [CrossRef] [PubMed]
  52. Aronsson, G.; Theorell, T.; Grape, T.; Hammarström, A.; Hogstedt, C.; Marteinsdottir, I.; Skoog, I.; Träskman-Bendz, L.; Hall, C. A Systematic Review Including Meta-Analysis of Work Environment and Burnout Symptoms. BMC Public Health 2017, 17, 264. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  53. Lallukka, T.; Haaramo, P.; Rahkonen, O.; Sivertsen, B. Joint Associations of Sleep Duration and Insomnia Symptoms with Subsequent Sickness Absence: The Helsinki Health Study. Scand. J. Public Health 2013, 41, 516–523. [Google Scholar] [CrossRef] [PubMed]
  54. Nordin, M.; Åkerstedt, T.; Nordin, S. Psychometric Evaluation and Normative Data for the Karolinska Sleep Questionnaire. Sleep Biol. Rhythm. 2013, 11, 216–226. [Google Scholar] [CrossRef]
  55. Weiner, B.J. A Theory of Organizational Readiness for Change. Implement. Sci. 2009, 4, 67. [Google Scholar] [CrossRef] [Green Version]
  56. Cedstrand, E.; Augustsson, H.; Alderling, M.; Sánchez Martinez, N.; Bodin, T.; Nyberg, A.; Johansson, G. Effects of a Co-Created Occupational Health Intervention on Stress and Psychosocial Working Conditions within the Construction Industry: A Controlled Trial. Front. Public Health 2022, 10, 973890. [Google Scholar] [CrossRef] [PubMed]
Figure 1. A wheel that illustrates the constantly ongoing key points in systematic work environment management (graphics from the Swedish Work Environment Authority, translated into English).
Figure 1. A wheel that illustrates the constantly ongoing key points in systematic work environment management (graphics from the Swedish Work Environment Authority, translated into English).
Ijerph 20 04010 g001
Figure 2. Workflow of the Stamina Model.
Figure 2. Workflow of the Stamina Model.
Ijerph 20 04010 g002
Table 2. Respondent’s categorization and rating of free-text answers. Statistical testing was performed using a two-sample Z-test for equality of proportions (presented as p-value, difference).
Table 2. Respondent’s categorization and rating of free-text answers. Statistical testing was performed using a two-sample Z-test for equality of proportions (presented as p-value, difference).
CategoryFree-Text Answers Assigned to
Each Category * (%)
Positive Attitude within
Each Category (%) †
Perceived Influence within
Each Category (%) ‡
T1T3p-Value, DifferenceT1T3p-Value, DifferenceT1T3p-Value, Difference
(1) Results and goal fulfilment6.47.6p = 0.08166.368.4p = 0.71659.867.8p = 0.114
(2) External circumstances and the outside world4.74.4p = 0.60341.639.8p = 0.86528.228.4p = 1.00
(3) Implementation and follow-up5.26.6p = 0.02768.170.5p = 0.71265.068.9p = 0.506
(4) Work environment and health34.834.7p = 1.0042.746.5p = 0.09640.043.1p = 0.176
(5) Roles and tasks10.810.7p = 0.97857.968.7p = 0.00850.065.0p < 0.001
(6) Skills and learning9.08.2p = 0.30479.277.9p = 0.82573.272.4p = 0.929
(7) Demands and feedback2.31.5p = 0.03743.034.5p = 0.53637.724.1p = 0.249
(8) Time use and working methods7.98.3p = 0.70145.038.2p = 0.16345.841.2p = 0.371
(9) Communication and collaboration15.814.7p = 0.26667.370.1p = 0.43266.172.8p = 0.042
(10) Other3.23.4p = 0.65456.652.9p = 0.71747.251.5p = 0.654
* Proportion of free-text answers assigned to each category. The columns sum up to 100%. † Proportion of free-text answers in each category that are considered as positive/negative (%). A proportion > 50% indicates a majority of positive attitudes towards the free-text answer. A proportion < 50.0% indicates a majority of negative attitudes. ‡ Proportion of free-text answers in each category that are perceived as influenceable (%). A proportion >50% indicates that a majority of the free-text answers are perceived as influenceable. A proportion <50.0% indicates that the free-text answer is not influenceable.
Table 3. Descriptive statistics for T1 to T3 and difference between baseline and follow-up.
Table 3. Descriptive statistics for T1 to T3 and difference between baseline and follow-up.
VariableT1
M (SD)
T2
M (SD)
T3
M (SD)
Difference T1 and T3p-Value
Human Resources Index, HRI60.02 (20.93)59.76 (22.70)60.64 (23.67)0.620.593 †
Relational Justice Index, RJI *24.77
(4.42)
24.98
(4.29)
24.95
(4.40)
0.180.416 ‡
Short-term recovery *3.74
(1.24)
3.81
(1.20)
3.88
(1.25)
0.140.253 ‡
Health-related production loss3.12
(2.45)
3.49
(2.85)
3.30
(2.61)
0.180.337 ‡
Work environment related production loss3.39
(2.43)
3.31
(2.49)
3.58
(2.54)
0.190.099 ‡
* Reversed items: high value indicates good relational justice and good recovery. † t-test ‡ Wilcoxon rank sum with continuity correction.
Table 4. The relationship between HRI (individual level), relational justice, and short-term recovery at T1. n = number of employees.
Table 4. The relationship between HRI (individual level), relational justice, and short-term recovery at T1. n = number of employees.
HRI <= Median
n = 596
M(SD)
HRI > Median
n = 595
M(SD)
Cohen’s D
Relational Justice
Index
23.7 (4.78)25.8 (3.72)0.490
Short-term recovery3.46 (1.23)4.02 (1.20)0.461
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Paulsson, S.; Hellman, T.; Svartengren, M.; Molin, F. A Quantitative Study on Employees’ Experiences of a Support Model for Systematic Work Environment Management in Swedish Municipalities. Int. J. Environ. Res. Public Health 2023, 20, 4010. https://doi.org/10.3390/ijerph20054010

AMA Style

Paulsson S, Hellman T, Svartengren M, Molin F. A Quantitative Study on Employees’ Experiences of a Support Model for Systematic Work Environment Management in Swedish Municipalities. International Journal of Environmental Research and Public Health. 2023; 20(5):4010. https://doi.org/10.3390/ijerph20054010

Chicago/Turabian Style

Paulsson, Sofia, Therese Hellman, Magnus Svartengren, and Fredrik Molin. 2023. "A Quantitative Study on Employees’ Experiences of a Support Model for Systematic Work Environment Management in Swedish Municipalities" International Journal of Environmental Research and Public Health 20, no. 5: 4010. https://doi.org/10.3390/ijerph20054010

APA Style

Paulsson, S., Hellman, T., Svartengren, M., & Molin, F. (2023). A Quantitative Study on Employees’ Experiences of a Support Model for Systematic Work Environment Management in Swedish Municipalities. International Journal of Environmental Research and Public Health, 20(5), 4010. https://doi.org/10.3390/ijerph20054010

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop