Next Article in Journal
Childhood Bereavement, Adverse and Positive Childhood Experiences, and Flourishing among Chinese Young Adults
Next Article in Special Issue
Academic Burnout, Family Functionality, Perceived Social Support and Coping among Graduate Students during the COVID-19 Pandemic
Previous Article in Journal
Comment on Vázquez-Gandullo et al. Inspiratory Muscle Training in Patients with Chronic Obstructive Pulmonary Disease (COPD) as Part of a Respiratory Rehabilitation Program Implementation of Mechanical Devices: A Systematic Review. Int. J. Environ. Res. Public Health 2022, 19, 5564
Previous Article in Special Issue
Cardiovascular Risk Factors in Hospital Workers during the COVID-19 Pandemic: A Hospital-Based Repeated Measures Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Applying Structural Equation Modelling to Understand the Implementation of Social Distancing in the Professional Lives of Healthcare Workers

by
Muhammad Fayyaz Nazir
1,* and
Shahzadah Fahed Qureshi
2
1
Department of Public Governance and Management, Faculty of Economics and Business Administration, Ghent University, 9000 Ghent, Belgium
2
Institute of Social and Cultural Studies, Faculty of Arts and Social Sciences, Bahauddin Zakariya University, Multan 60800, Pakistan
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2023, 20(5), 4630; https://doi.org/10.3390/ijerph20054630
Submission received: 30 November 2022 / Revised: 27 February 2023 / Accepted: 1 March 2023 / Published: 6 March 2023

Abstract

:
This study, based on the normalization process theory (NPT), explores the implementation of nonpharmaceutical interventions (NPIs)—specifically social distancing (SD)—in the professional lives of healthcare workers in three Pakistani hospitals. We collected and analysed health workers’ data using partial least squares structural equation modelling (PLS-SEM) and assessed the policy implications of the results. Violations of normality assumptions in the quantitative data and the need for scores of independent variables for follow-up analysis guided the researchers to adopt a structural equation modelling process that involved a stepwise evaluation process for convergent validity, individual item validity, discriminant validity, the structural model relationship, and overall model fitness. Theoretical constructs coherence, cognitive participation, collective action, and reflexive monitoring were found to influence the normalization of SD. The results show that SD was normalized in the professional lives of healthcare workers through strong collective action (resources required) and reflexive monitoring (appraisal) but weak cognitive participation (actors’ engagement) and coherence (sense-making). Low and middle-income countries (LMICs) should work more on actors’ sense-making and engagement in dealing with healthcare crises that require SD. The research findings can aid policy institutions in better understanding the loopholes in the implementation process and making better policies.

1. Introduction

This study explores the normalization of social distancing (SD) in the professional lives of healthcare workers. The COVID-19 pandemic has strained global healthcare systems and caused extreme worldwide socioeconomic disruptions, such as the deferment and termination of educational, political, cultural, and religious events [1], ultimately opening a new pandora’s box. The pandemic has motivated policy institutions to provide scientific support. In the absence of pharmaceutical interventions, the World Health Organization (WHO) provides policy guidelines for implementing nonpharmaceutical interventions (NPIs). These include (but are not limited to) contact tracing, quarantine, and SD.
While explaining the importance of SD for low- and middle-income countries (LMICs), Guimaraes et al. [2] demonstrated that other NPIs have greater financial consequences. In Pakistan, the doctor-to-patient ratio in 2019 was 1.1 doctors per one thousand patients. The ratio increased from 0.93 in 2015 and 0.96 in 2016 to 1.0 in 2017 and decreased to 0.98 in 2018 before increasing again in 2019 [3]. However, ratios of these levels are considered to be minimal in terms of the human resources needed to meet human health needs and are below the WHO standards [4]. The lack of human health resources in a country with a large population makes implementing social measures difficult, specifically for healthcare workers in their professional lives. Therefore, it is pertinent for Pakistan to understand the implementation of NPIs and, more specifically, social measures such as SD. Healthcare workers must follow SD because they are more exposed to the disease because of the nature of their work. Razaq et al. [5] observed that 10% of the reported infections were among healthcare workers. If healthcare workers do not follow SD, they could be disease carriers. Considering the importance of SD in the context of healthcare workers’ professional lives, we took SD as a core social measure in this study.
Policy implementation researchers focus on various aspects of policy implementation and explore its context, enablers, challenges, innovation, and multi-actor perspectives [6]. In studying the pandemic, Lotta et al. [7] observed the vital role of frontline workers. To comprehend the implementation context, it is pertinent to involve the policy actors. Anthony [8] concluded that it is important for healthcare workers to observe SD. It is pertinent to explore the normalization of SD in the professional lives of healthcare workers in local contexts so that developing countries can develop and implement better policies in the event of any future pandemic. Our study focused on the following core research question: What is the normalization process of SD in the professional lives of healthcare workers?
The implementation of healthcare interventions can be disrupted in multiple ways: patient examination protocols, the nature of the disease, the patient–doctor relationship, and the broader policy context. Consequently, there is a need to examine how social measures are implemented by policy institutions and adopted by the target population. This study focused on the implementation of a complex healthcare intervention in a focused and micro context, i.e., in the professional lives of healthcare workers. This paper describes how the relevant policy actors (the healthcare workers) made sense of the intervention, how they engaged with it, what resources were required, and how they could appraise the intervention. This study focused on the implementation of a specific social intervention, SD, in clinical settings.
Healthcare intervention is considered a complex intervention. Over the last few decades, many conceptual frameworks, models, and theories have been proposed, tested, and recommended to understand and explore complex interventions [9,10], making the study of healthcare interventions an interesting and challenging domain. Understanding the overall process of implementing SD requires a robust methodological design. For this study, we adopted the normalization process theory (NPT), which is discussed extensively in the implementation literature and in explaining the implementation of complex and innovative healthcare interventions [11]. The implementation of SD in managing COVID-19 is a unique and complex healthcare intervention. NPT provided the theoretical framework for understanding the implementation and normalization of SD in the professional lives of healthcare workers. For the purpose of data collection, we selected one district in Pakistan that was in the red zone regarding COVID-19 infections. Data analysis was performed using the SmartPLS software and following a stepwise process. The study results explain the relationships between the independent variables in the implementation of SD in a focused and micro context, i.e., in the professional lives of healthcare workers.
The complex environment of the COVID-19 pandemic, the importance of SD for LMICS, and the policy actors (healthcare workers) involved provided the impetus for this study. The study contributes to the methodological aspect of the application of NPT and quantitative design and explores the current implementation dilemma of COVID-19. This study addresses translational gaps, including know–do, policy research practice, and think–do. The study was intended to provide guidance to LMICs in successfully implementing complex healthcare interventions in the current and future healthcare crises and better orienting frontline workers and healthcare workers towards implementing healthcare interventions. The study satisfies the current implementation paradigms and contributes to implementation, pandemic, and structural equation modelling (SEM) in the literature.
Section 1.1 explains the need for and objectives of the study. Section 2 presents a review of the literature on the normalization of healthcare interventions. Section 3 and Section 4 present the theoretical model, constructs, and hypotheses tested. Section 5 describes the methods and data used—specifically, the research design, ethical procedures statement, study area, research instrument, sample design, data coding, data collection, testing for a common source bias, ANOVA-based tests (assumptions of normality and non-parametric analysis), and finally, the application of SEM and its reasoning. Section 6 presents the results obtained. Section 7 presents a summary and discussion of the results, the limitations of the study, the contributions of the study, management, and policy implications of the findings, and recommendations for future research. Section 8 presents a concise conclusion summarizing the study methods and key findings.

1.1. Need for and Objectives of the Study

Calls from policy implementation researchers (about the need for more studies on theory testing, theory building, and quantitative approaches) and contemporary research trends on various aspects of the COVID-19 pandemic have motivated researchers to explore the implementation of NPIs, specifically SD, as in our case, according to sound theoretical designs. To address this need, we conducted a scientific inquiry with the following objectives:
  • To explore the contemporary dilemma of how to satisfy the calls of policy implementation researchers with sound theoretical support and quantitative research design.
  • To develop guidance for other low and middle-income countries by identifying the weak areas in order to normalize and ultimately implement healthcare intervention as a novel and complex intervention and address translational gaps.

2. Previous Research on Healthcare Intervention and SD

For this study, we employed a systematic inquiry of the web of science using the keyword “COVID-19” to search for articles that were published from 2019 to 2021 (10,438) in journals of health policy and public administration (2267), focused on social distancing (141). We excluded 86 articles unrelated to policy perspectives and obtained a list of 55 articles for the full review.
Because the goal of this study was to examine the normalization of SD, we also conducted a search of the web of science database for the literature on normalization using the keyword “normalization.” We found 325 articles published in public administration journals but eliminated 294 that were not related to healthcare intervention, obtaining a list of 31 articles for the full review. Combining the 55 papers on SD with the 31 papers on the normalization of healthcare intervention, excluding duplication, and including additional sources gave us a complete list of 86 publications for a full-text review, as illustrated in Figure 1.
SD refers to increasing space between people to minimize disease spread [12]. SD is an important measure that has worldwide acceptability in managing the COVID-19 pandemic [13]. Researchers, practitioners, and policy institutions have shown interest in exploring various aspects of SD in the context of the pandemic, such as the observance of SD [14,15,16,17]. Some studies have focused on the effects of SD on disease patterns [18], in homeless people [19], and on mental health [20], and access to healthcare facilities [21]. The literature also illustrates the relation of SD to ageism [22], economy [17], healthcare system capacity [23], politics [24], belief systems [25], executive orders of state [26], and the role of the press in implementing SD [27].
A large number of studies were found on various aspects of SD, such as compliance with SD [28,29,30,31,32], the impact of SD [33,34], and the need for SD to protect healthcare workers [8]. However, no study was found on the normalization of SD as a complex healthcare or novel nonpharmaceutical intervention in the professional lives of healthcare workers.
The implementation of the literature explains the normalization of healthcare interventions with various theories, including NPT. This theory helps us understand how any healthcare interventions become part of normal life activities. NPT has four constructs: coherence, cognitive participation, collective action, and reflexive monitoring. The literature illustrates that researchers understand coherence as the extent to which policy actors develop an understanding and the sense of a new practice or intervention [35,36,37,38] and how the new practice or intervention is similar to or different from existing ones [38,39,40]. Cognitive participation can be interpreted as the extent to which policy actors are inclined toward new practice or intervention [41,42], are engaged or involved with the intervention [37,43,44], and are committed to the intervention [35,39]. Collective action is the allocation of individual and collective or organizational resources to the new intervention [39,42], how the intervention is operationalised [45,46], and how the roles and responsibilities of policy actors in implementing the intervention are defined [42]. Reflexive monitoring represents the extent to which the intervention is subject to appraisal [37,46], assessing the impact of the intervention [44], and ensuring the sustainability of change [35].

3. Theoretical Model

In the implementation research, one theory that has been discussed broadly is the ‘NPT’, which has been widely promoted to understand policy implementation [11]. Theory framework is given in Figure 2. NPT accentuates differences in the implementation process between the context, actors, and objects, consistent with social and interactive research models [47]. The theory originated from studies that explored the implementation of complex and innovative interventions within healthcare settings [48]. NPT is highly relevant to our research interest, namely, due to the understanding it provides for the implementation of SD as a complex and innovative intervention. The four constructs on which NPT is based—coherence, cognitive participation, collective action, and reflexive monitoring—are discussed below.
The coherence construct represents the planning phase. Sense-making work that is concerned with exploring what people undertake to comprehend a new intervention or practice can be conducted individually or in partnership with other participants. This construct comprises four distinct working processes, i.e., differentiation, communal specification, individual specification, and internalization. For strong coherence, there should be a shared understanding across the policy actors of what this work will entail for individuals. There should be a mutual understanding of the value and purpose of SD.
Cognitive participation is another planning phase construct that is concerned with participation that explains people’s relational activities in reaching a shared agreement for a new practice or intervention. This construct is related to identifying and exploring the specific work that people perform when they try to organize themselves or others to begin a new practice or intervention. Its four working mechanisms are initiation, enrolment, legitimation, and activation. There should be legitimate reasons and strong motivation for policy actors to engage with SD for strong cognitive participation.
Collective action represents the doing phase. It concerns the policy actor’s self-monitoring of their work and exploring what policy actors or people undertake while enacting an intervention or a new practice. This construct comprises four working mechanisms: interactional workability, relational integration, skill-set workability, and contextual integration. For decisive collective action, there should be a shared understanding of the roles and responsibilities of policy actors, and the required resources should be available.
Reflexive monitoring represents the appraisal phase. It is concerned with the evaluation of work that has been performed in the preceding phase. This can be understood as the formal and informal processes that are involved in monitoring and evaluating the work performed in the collective action phase. This stage can be commenced both individually and collectively. This stage comprises four working mechanisms: systematization, communal appraisal, individual appraisal, and reconfiguration. There should be precise evaluation mechanisms for strong reflexive monitoring, and policy actors should be aware of the changes required to adopt SD.

4. Hypothesis Development

In this study, coherence is defined as the extent to which healthcare workers understand SD as a healthcare intervention [42]. This involves creating a sense of the intervention through the work that policy actors do individually or collectively to understand the complex intervention. In our case, this illustrates the work of healthcare workers to understand SD. If healthcare workers understand SD, the result is higher coherence, leading to the normalization of SD.
H1. 
Coherence to Normalization of Social Distancing
Cognitive participation is the extent to which healthcare workers become engaged or involved in implementing SD [37], including engagement through investment in understanding and implementing SD. If healthcare workers are engaged in implementing SD, there is a higher level of cognitive participation, ultimately leading to the normalization of SD.
H2. 
Cognitive Participation to Normalization of Social Distancing
Collective action is defined as allocating individual and collective or organizational resources to implementing SD [39]. This involves bringing SD into practice through its adaptation of the collective efforts of healthcare workers through the allocation of the resources and development of the skills required to adopt this intervention. If healthcare workers are provided with the organizational or individual resources needed to implement SD, there will be a higher level of collective action, which can lead to the normalization of SD.
H3. 
Collective Action to Normalization of Social Distancing
Reflexive monitoring is the extent to which SD is subject to appraisal [41]. This involves evaluating interventions by appraising the acceptance of SD among healthcare workers. If there is a higher degree of acceptance for SD among healthcare workers, there will be higher reflexive monitoring, ultimately leading to higher reflexive monitoring.
H4. 
Reflexive Monitoring to Normalization of Social Distancing

5. Methods and Data

5.1. Research Design

This study was conducted to investigate the relationship between the pre-defined NPT latent variables and the normalization of SD for the purpose of understanding the process normalization of SD in the professional lives of healthcare workers. Our goal was to explore the weak segments of SD implementation in the local context in Pakistan. We selected latent variables based on their frequency of use and the availability of statistical tools for their assessment [49]. We needed to emphasize the latent variables’ scores for follow-up analysis, so we selected partial least squares structural equation modelling (PLS-SEM) for data analysis, consistent with the recommendation of Hair et al. [50], that researchers should select PLS-SEM when research is based on inquiring about the scores of latent variables for further analysis and identifying the relationships between the dependent and independent variables. Conceptual framework of the study is given in Figure 3. We found PLS-SEM to be suitable for use in this study to quantify the results and draw conclusions. To focus on the local context, we selected one district (Multan) in a highly populated province of Pakistan that was in the red zone regarding COVID-19 infections. In Pakistan, the healthcare structure has three layers. We targeted one hospital from each healthcare domain: Nishter Medical University (NMU) Hospital, a tertiary healthcare facility; District Headquarters (DHQ) Hospital, a primary and secondary healthcare facility; and Fatima Jinnah Women (FJWH) Hospital, a specialized healthcare facility.

5.2. Ethical Procedures Statement

Researchers collected data from healthcare professionals. No minors were involved. The data were collected under informed consent protocols and analysed and reported anonymously. Necessary permission from the authors of the NoMAD survey instrument was obtained for its use in our study. Ethical approval was granted by the Faculty of Economics and the Business Administration’s Ethical Review Committee of the first author’s university.

5.3. Research Instrument

We used the NoMAD survey instrument, attached as Appendix B, to collect quantitative data. This survey instrument contains four constructs with 23 implementation assessment items or questions on an eight-point Likert scale. NoMAD has been reported to have good face validity, construct validity, and internal consistency and is a highly reliable scale [51]. However, Meier and O’Toole [52] explored a limitation of the survey method in the public administration field, known as common source bias (CSB).

5.4. Common Source Bias

CSB is a bias in results that are triggered by variables demonstrating a measurement error because of the common survey method. George and Pandey [53] disputed the existence of CSB and illustrated the response of public administration scholars with four critical arguments. They argued that claims about the effects of CSB might be overstated, endorsed by selective evidence, depend upon the nature of variables, and support the survey data in response to the unsoundness of archival data. We adopted their flow diagram (attached as Figure A1) to assess CSB in our study.

5.5. Justification of Research Instrument

George and Pandey [22] presented a flow chart to address the issue of survey selection as a single source. Following their flowchart as a guide, we concluded that the survey method for data collection was suitable for use in this study. This is consistent with George and Pandey’s [22] conclusion, based on work by Podsakoff et al. [54], which states that surveys are suitable data collection methods for variables that are intended to capture individuals’ feelings, perceptions, judgments, and beliefs, as in our case.

5.6. Sampling

Three hospitals allowed us to collect data. The purposive/convenience sampling technique was used to collect data from a representative set of healthcare workers, including the managers, medical professionals, and allied healthcare professionals working in the COVID-19 wards of the three hospitals. All of the healthcare workers were initially contacted by email and telephone.

5.7. Data Coding and Collection

Before the data collection, we designed a specific coding framework for this research, attached as Table A2. Face-to-face surveys were conducted with 288 healthcare workers in accordance with informed consent protocols. The demographics of the survey respondents are summarised in Table A3. The data used in this research are available from the corresponding author upon reasonable request.

5.8. Testing Common Source Bias

To validate the selection of the data collection instrument in light of the recent discussion of CSB in public administration scholarship, we adopted Harman’s single-factor test for CSB. The results (attached as Table A4) indicate values with a 42% variance, which is less than the threshold value of 50% [55]. This confirms the lack of CSB in our case.

5.9. Descriptive Statistics and ANOVA-Based Tests

We calculated descriptive statistics for the gender, education, age, location, and designation of the respondents and the normalization of SD. We then conducted ANOVA-based tests concerning the outcome variable. Assumptions of normality were considered and resulted in the selection of non-parametric ANOVA-based tests.

5.10. Assumptions of Normality

To test the data distribution for our outcome variable and the process of the normalization of SD in the professional lives of healthcare workers, we conducted Kolmogorov–Smirnov and Shapiro–Wilk normality tests [56]. Both tests assume that a significance value of less than 0.05 represents a violation of normality. We tested the normal distribution of the normalization of SD among all the locations, genders, age groups, education levels, and designations of the survey respondents.
Normality tests for gender, education, organization, and designation resulted in p-values of 0.000, indicating non-normality and the need for non-parametric ANOVA-based tests [57]. The results for age subgroups resulted in a p-value of 0.000 for the first two sub-groups but 0.272 for the third sub-group. The results (given in Table A5) confirm the non-normality of the data distribution.

5.11. Non-Parametric Analysis

Given the non-normality of the data, we applied the non-parametric Mann–Whitney U Test [58] for gender and education and the non-parametric Kruskal–Wills test [59] for age, location, and designation. The Mann–Whitney U tests for gender and education yielded significance values of 0.38 and 0.34, respectively: both less than the threshold value of 0.05. The Kruskal–Wills test for organization/location and designation yielded significance values of 0.030 and 0.001, respectively, but for age, the significance value was 0.672. The results of the tests are given in Table A6.

5.12. Application of SEM

The structural equation modelling (SEM) approach was adopted for data analysis in light of the non-normality of the data and the requirement of individual scores for the latent variables for analysis. SEM is a second-generation multivariate technique for data analysis and helps in the evaluation of multifaceted relationships [60,61]. We used the SmartPLS software to provide a visualization of the relationships of the variables. We ran three iterations to analyse the PLS model and compared the results for strong analysis. In the first iteration, we detected an issue of multicollinearity (see Table A7), and after resolving this, we ran the second iteration and found that some items’ values were less than the threshold values. After removing these items, we obtained the final SEM model. The results and models that were obtained in the three iterations are given in Figure A2, Figure A3 and Figure A4.

6. Results

The SmartPLS software was used to assess the strength of each latent variable/factor affecting the normalization of SD in the local context. The data analysis was based on descriptive statistics and model assessment followed by a stepwise evaluation process, including (i) the determination of convergent validity and individual item validity, (ii) the determination of discriminant validity, (iii) the development of the structural model relationship, and (iv) assessment of the overall fitness of the model. The stepwise evaluation process yielded values of convergent validity and individual item validity through composite reliability (CR) and average variance extracted (AVE) scores for the three iterations, as shown in Figure 4, Figure 5, Figure 6, Figure 7, Figure 8 and Figure 9. The figures illustrate the values of the manifest and latent variables. The CR or AVE is plotted on the y-axis in each figure. The coherence, cogniti (cognitive participation), collecti (collective action), reflexi (reflexive monitoring), or normaliza (normalization) are plotted on the x-axis.

6.1. Individual Item Validity and Convergent Validity

The validity and consistency of the variables were analysed using the measurement model. This model verified the convergent validity primarily by evaluating the factor loadings, CR, and AVE. The CR term engages the standardized loadings of the construct’s indicators/items, so it is a better measure of internal consistency [62]. The values of CR represent the levels at which manifest variables indicate the constructs of the latent variables based on the calculation of the homogeneous outer loadings of the indicators for the constructs. Manifest variables with outer loading values > 0.7 are considered highly suitable [63,64], illustrated with green colours in Figure 4, Figure 5, Figure 6, Figure 7, Figure 8 and Figure 9 However, Siqueira et al. [65] showed that loading values as low as 0.4 should be considered acceptable. If omitting manifest variables with values less than 0.4 increases the value of CR, then it is reasonable to omit them in the second iteration. The results are shown in Figure 4 and Figure 5.
After removing item RM1 to resolve the issue of multicollinearity, we ran the second iteration and found that the values of items CA2, CA3, and CA6 were less than 0.4. We, therefore, tested whether removing these items for the final iteration increased the value of CR. The results, which confirm that the value of the manifest variable’s CR increases (see Table 1), are shown in Figure 6 and Figure 7.
However, item RM2 was deleted for the third (final) iteration to achieve the required threshold value of the CR and AVE values representing the convergent validity of the model [66]. The results are shown in Figure 8 and Figure 9.
The change in the latent variable that was relative to its indicator variable is indicated by the AVE value. Hair et al. [62] and Barclay et al. [67] suggest that the latent variables must extract the least amount of 50% of the variance related to their relative construct indicators, making its value > 0.5.

6.2. Discriminant Validity

In the next step, the discriminant validity of the measurement model was evaluated. After evaluating the convergent validity and individual item reliability of the measurement model, the discriminant validity of the latent variables was analysed through the values of cross-loadings.
The discriminant validity indicates the degree to which a particular construct is unique from other constructs [68], based on the rule that ‘items must have a greater value of correlation with the specific latent variable that they are believed to gauge in comparison with all other latent variables presented in the model, specifically Chin’s [69]. The discriminant validity evaluation results are shown in Table 2.
The results specify that the values of item indicators are greater for their constructs than all other constructs. The greater values confirm that the manifest variables in each construct represent the assigned construct, confirming the measurement model’s discriminant validity.

6.3. Structural Model Relationship

We used the structural model relationship to evaluate the significance of the individual path and the exploratory power of the model. To analyse the strength of a structural model, Hair et al. [70] suggested considering the values of the path coefficient β (beta) and the coefficient of determination (R squared). However, it is necessary to test the significance of the β value when using a t-test. As Kushary [71] recommended, we performed this test with the SmartPLS software through a non-parametric bootstrapping procedure that computes t-values using a prespecified number of samples. According to Hair et al. [72], acceptable t-values are 1.65 at the 10% significance level, 1.96 at the 5% significance level, and 2.58 at the 1% significance level. We used the SmartPLS software to generate 5000 bootstrapping samples to calculate the t-values, as presented in Table 3, along with the path coefficients.
The structural model illustrated in Figure 10 indicates the relationships between the exogenous and endogenous constructs. The model represents the relationships by allocating components of R-squared and path coefficients [62]. The value of β refers to the effect of an exogenous variable on the endogenous variable. The R-squared value represents the amount of variation described by the structural model [73,74]. According to Cohen et al. [75], a suitable model fit must possess an R-squared value greater than 0.26. On the third iteration, our model yielded an R-squared value of 0.872, indicating that the model explains, to a large degree, the normalization of SD with the latent variables. Athab [76] achieved an R-squared value of 0.844 in another study, and a study on the European customer satisfaction index. Askariazad and Babakhani [77] yielded an R-squared value of 0.706, illustrating that high values of R-squared are certainly possible in some cases.
The next step involved assessing and comparing the latent variable’s path coefficients. All the path coefficients had t-values greater than the cut-off values for a significance level of 1%, suggesting that all the path coefficients in the assessed model greatly influenced the normalization of SD in the local context of Pakistan.

6.4. Overall Fitness of the Model

We next assessed the goodness of fit (GoF) of the model in terms of the geometric mean of the average R2 for all endogenous latent variables and the average communality [28,78]. The primary intent of evaluating the GoF was to examine the PLS model’s performance at both the structural and measurement levels, focusing on the model’s predictive power [78]. Previous studies [79,80] have produced guidelines and GoF threshold values for the global validation of PLS models, with a suggested value of 0.50 as the threshold for commonality diverse effect sizes R 2 .
Epostio and Chin [64] suggested the threshold values of GoF-large (0.36), GoF-medium (0.25), and GoF-small (0.10). The overall fitness of the PLS model was calculated using Equation (1).
GoF = A V E ¯ × R 2 ¯
The value of R 2 ¯ is 0.871. A V E ¯ is the average of all AVE values, as shown in Table 3. By using the AVE values of all of the exogenous latent variables in the final iteration, the average obtained is 0.617.
GoF = 0.617 × 0.872
GoF = 0.538
Since the GoF value calculated in Equation (3) was greater than the cut-off value of 0.36, the model developed for this research study was considered effective in explaining the relationships between the latent variables and the normalization of SD.

7. Discussion

7.1. Summary of Results

To achieve the cut-off values of CR and AVE, items CA2, CA3, CA6, and RM2 were omitted from the PLS model in the final iteration. For collective action, the value of CR increased from 0.689 to 0.879, and the value of AVE increased from 0.383 to 0.650. For the case of reflexive monitoring, the value of CR increased from 0.870 to 0.911, and the value of AVE increased from 0.589 to 0.729. For CR, values of 0.813, 0.830, 0.879, and 0.911 were obtained for the latent variables CO, CP, CA, and RM, respectively, and for AVE, values of 0.526, 0.558, 0.650, and 0.729, respectively, were obtained. The higher values of cross-loadings on the latent variables confirm that the variables in each construct signify the consigned construct, confirming the discriminant validity of the model.
All the β values had t-values that were larger than the cut-off value for the 1% significance level, indicating that the path coefficients of the latent variables substantially impacted the normalization of SD. The highest β value of 0.331 for collective action indicates its highest significance in the model. Finally, the overall fitness of the model, as measured by the GoF, was 0.535, higher than the threshold value of 0.36 and indicative of a model with good predictive capability.

7.2. Discussion

Our research findings point to a vital aspect of the implementation of SD, namely, its normalization in the professional lives of healthcare workers. These study findings contribute to the existing body of knowledge by providing empirical support for the normalization of SD under the pre-defined theoretical constructs of the normalization process theory through its NoMAD survey instrument [51]. In addition, the study examines the relationships of latent variables for the implementation of SD, ultimately applying the normalization process theory in a novel situation.
Our study contributes methodologically to the literature on PLS-SEM by analysing the relationship of theoretically pre-defined latent NPT variables [81,82] to the normalization of SD. PLS-SEM can model latent variables under the conditions of non-normality for small to medium sample sizes [83], amplifying the clarified variation in endogenous constructs and forecast measures for the latent constructs through multiple regressions [84]. Although previous research has revealed the normalization of several healthcare interventions in various healthcare settings [85], the normalization of SD as a nonpharmaceutical healthcare intervention has not been explored extensively. This study is the first attempt to explain the normalization of SD with empirical support and structural equation modelling.
We conducted tests for common source bias, normality, and multicollinearity under the assumption that the items representing the model should be moderately correlated [86]. Initially, the common source bias was assessed through Harman’s single-factor test, and the results confirmed the absence of CSB. Based on the results of normality tests of the collected data, non-parametric tests were selected for use in the data analysis. We tested the normality of the data for all three locations (MNU HJospital, DHQ Hospital, and FJW Hospital), gender (male, female), age groups (21–30, 31–40, and above 40), education (graduate, post-graduate), and designations (doctors, nurses, and allied health professionals) of the survey respondents with Kolmogorov–Smirnov and Shapiro–Wilk tests. The tests for gender, education, organization, and designation detected non-normality because of the nature of the pandemic and the resources engaged in managing the pandemic. The non-parametric Mann–Whitney U tests for gender and education and the non-parametric Kruskal–Wills tests for organization/location and designation yielded values below the threshold values, illustrate the different representations of the gender groups, education, location, and designations of the respondents that existed alongside the implementation of SD into the local context in Pakistan.
To meet the research objectives, we tested four hypotheses (see results in Table 4). However, we considered the path coefficient values of the latent variables or the theoretical constructs for the significance level among the four constructs. The path coefficient values in order from highest to lowest were for collective action (0.299), reflexive monitoring (0.294), cognitive participation (0.226), and coherence (0.202). The omitted variables for the final iteration represented weak relationships among the latent variables and the implementation of SD. We based our conclusions on the path coefficient values, which were obtained after the omission of the weak variables. The PLS-SEM results support all the hypotheses. We conclude that the latent variables that were identified in this research influenced the normalization of SD.
It is worth mentioning that Alimohamadi et al. [18], Moraes [87], and Battiston [88], also detected a positive relation between SD and the latent variables considered in their studies. The results of our study describe a significant relationship between the latent variables and the implementation of SD. The results of this study also indicate a weak level of coherence, i.e., healthcare workers’ understanding of the value and purpose of SD, and weak cognitive participation, i.e., legitimate reasons and strong motivation of the healthcare workers to engage with SD. However, the results indicate a high level of collective action, i.e., understanding of the role, responsibilities, and resources required for healthcare workers to implement SD, and a high level of reflexive monitoring, i.e., a precise evaluation mechanism and healthcare workers’ awareness of the changes required to adopt SD into their professional lives.
Elf et al. [89] demonstrated a good model fit after deleting three items (CA2, CA3, and RM4) in the second iteration for latent variables that were related to collective action and reflexive monitoring, which is consistent with our results. May et al. [90] found that the latent construct of reflexive monitoring was the least applied theoretical construct in the studies, which is a result inconsistent with our specific case.

7.3. Limitations of the Study

Limitations of the study include the following:
  • NPT is a widely discussed theory in the policy implementation of the literature. The theory originated in a developed country, and limited evidence of its applicability in an LMIC is a limitation of this study.
  • The application of NPT in a novel and complex situation such as COVID-19 is another limitation of the study.
  • The study was conducted at the peak of COVID-19 infections, which greatly impacted the data collection activity regarding the number of responses.

7.4. Contribution of the Study

The study applied NPT to a specific case through PLS-SEM and explored the implementation and normalization of SD among healthcare workers in the local context in Pakistan. The study addresses the calls of policy implementation researchers about the need for theoretical designs and quantitative work in understanding implementation. The study takes the implementation of SD as a case study to understand the normalization of a complex healthcare intervention in the context of a pandemic. The study contributes to normalization, implementation, PLS-SEM, and the pandemic literature in the following ways.
  • The study explores a healthcare intervention’s implementation, contributing to the implementation literature.
  • The study explores how SD is normalized in healthcare workers’ professional lives, ultimately contributing to the normalization literature.
  • The study applies NPT in the unique and complex situation of a healthcare crisis, and the results confirm the applicability of NPT. The study thereby validates the utility of the NPT in situations of a novel and complex nature.
  • The study is the first attempt to understand the implementation–normalization of a healthcare intervention (SD) in a healthcare crisis according to a sound theory and multivariate statistical modelling to develop a basis for the policy learning of LMICs. The study results have policy implications which are detailed in the next section.

7.5. Implications of the Study

Our study findings have management and policy implications. The study addresses translational gaps: the know–do, policy research practice, and think–do.
  • Well-known and subtle gaps exist when translating research results into policy and practice [91], such as the know–do gap: the development and implementation of innovative healthcare interventions in practice with the intended users [92], such as, in our case, healthcare workers. Our study identifies loopholes in the implementation process by examining the normalization of an innovative healthcare intervention, addressing the know–do gap.
  • Another well-known gap relates to the use of health research results to inform health policy [93]. The results of our study illustrate the weak coherence (sense-making) and cognitive participation (engagement) on the part of healthcare workers that should inform policy institutions to put more effort into the sense-making and engagement of healthcare workers in Pakistan. This can lead to stronger relationships among the latent variables and the implementation–normalization of a healthcare intervention.
  • However, the think–do gap shows that the groups or individuals involved in the implementation should consider the nature and complexity of the implementation work to better inform their actions. Our study explores the implementation of a complex healthcare intervention through the resources they need to enact it and whether they can appraise it. The resources required and the outcome of the appraisal depend upon the nature and complexity of the intervention. Our study also provides an insight into the think–do gap while understanding the normalization of a complex healthcare intervention in the healthcare workers’ professional roles.
Implementation research suggests that the more significant and rational utilization of theoretical approaches can address translational gaps [94] and develop, enhance, and confirm information about the theories [95]. From a theoretical or methodological perspective, our study contributes to the theory application and quantitative design and explores the contemporary implementation dilemma. We applied NPT to understand the implementation of healthcare interventions, and these results could positively contribute to managing future pandemic/healthcare crises. LMICs can learn from this research, conducted in the local context of Pakistan. Policy institutions can improve their policies, and the target audience can better understand loopholes in the implementation process. The study tested and accepted four hypotheses confirming the applicability of NPT (application of the theory) and SEM (quantitative design) on the examination of CCOVID-19 DP&C policy and, specifically, the normalization of SD.

7.6. Future Research

The study explains the normalization of SD in the professional lives of healthcare workers in the local context of Pakistan through PLS-SEM. However, the literature argues that more theoretical [79] and quantitative [96] PLS-SEM-based [70] work is required to understand the role of healthcare workers [8]. The literature also illustrates the importance of contextual factors to policy actors when implementing a policy. Therefore, we recommend the exploration of the role of policy actors’ contextual factors in implementing a healthcare intervention with sound theoretical support, either qualitatively or quantitatively.

8. Conclusions

In this study, the PLS-SEM stepwise evaluation process (including an assessment of the convergent validity, individual item validity, discriminant validity, structural model relationship, and overall fitness of the model) yielded significant results that ultimately represent the significant relationships of the pre-defined NPT variables with SD. However, items omitted in the iterative process represented a weak relationship in normalizing SD. The study accepted the four hypotheses that were posed after the critical evaluation. The results indicate that SD normalizes healthcare workers’ professional lives through coherence, cognitive participation, collective action, and reflexive monitoring. Collective action had the greatest influence on the normalization of SD in the local context of Multan, Pakistan. Coherence had the least impact. SD was normalized in the professional lives of healthcare workers through strong collective action and reflexive monitoring but was weak in cognitive participation and coherence.

Author Contributions

M.F.N. and S.F.Q. conceived the idea of the research. However, the corresponding author collected the analysed the data, applied the structural equation modelling to understand the implementation of social distancing in Pakistan, and drafted the manuscript; both authors critically reviewed the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

The Higher Education Commission of Pakistan provided a Ph.D. scholarship to the corresponding author (No.5-1/HRD/UESTPI(Batch-VI)/5241/2018/HEC), and the Faculty of Economics and Business Administration of the author’s institute provided the Short-Term Research Mobility Funding for data collection.

Institutional Review Board Statement

Ethical approval was granted by the Faculty of Economics and Business Administration Ethical Review Committee, under reference No. FEB-2021-S, from the author’s institute.

Informed Consent Statement

Before the survey, all the study participants were informed about the study’s objectives and their role under the informed consent protocols.

Data Availability Statement

It is pertinent to mention that the survey data underlying this research will be shared on rational demand with the corresponding author. However, for the reviewers, the data, including the updated/amended survey instrument, coding framework, and PLS-SEM model results, are available at the link: https://drive.google.com/drive/folders/1mbK8y_RZX3WvMxfJL6-xZ6tJKbhzpBBa?usp=sharing. It is declared that the authors obtained permission to use the NoMAD survey instrument tool from its original authors and this can be provided on demand.

Acknowledgments

1. Higher Education Commission of Pakistan and Faculty Council of the author’s institute. 2. Members of the Doctoral Advisory Committee and officers in the health department in Punjab-Pakistan.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

AVEAverage Variance Extracted
CACollective Action
CoCoherence
CPCognitive Participation
CRComposite Reliability
CSBCommon Source Bias
DHQDistrict Headquarters Hospital
FJWHFatima Jinnah Women’s Hospital
GOFGoodness of Fit
NMUNishtar Medical University
NoMADNormalization Measure Assessment
NPINonpharmaceutical Intervention
NPTNormalization Process Theory
RMReflexive Monitoring
SDSocial Distancing
SEMStructural Equation Modelling
SPLSSmart Partial Least Squares
WHOWorld Health Organization

Appendix A. Conceptualization

Table A1. Understanding the Study Variables.
Table A1. Understanding the Study Variables.
ConstructsPrevious ResearchOperationalization
CoherenceGiven in the literature reviewCan policy actors make sense of SD? For strong coherence, there should be a shared understanding across the policy actors of what this work will entail for individuals. There should be a mutual understanding of the value and purpose of SD.
Cognitive ParticipationGiven in the literature reviewAre the policy actors engaged with SD? There should be legitimate reasons and strong motivation for policy actors to engage with SD for strong cognitive participation.
Collective ActionGiven in the literature reviewWhat do the policy actors need to enact SD? For decisive collective action, there should be a shared understanding of the roles and responsibilities of policy actors, and required resources should be available.
Reflexive MonitoringGiven in the literature reviewCan policy actors formally or informally appraise the impact of SD? There should be precise evaluation mechanisms for strong reflexive monitoring, and policy actors should be aware of the changes required to adopt SD.

Appendix B. Data Collection

Survey Form

NOMAD Instrument [51]
Note:
Table A2. Coding Framework for Quantitative Data Analysis.
Table A2. Coding Framework for Quantitative Data Analysis.
NoMAD Quantitative Data Coding Framework
GroupsThemeDescriptionCode
Respondents General InformationOrganizationRI-1Nishter Medical University Hospital1
Civil Hospital/DHQ2
FJ Women Hospital,3
GenderRI-2Male1
Female2
Age GroupsRI-321 years to 30 years1
31 years to 40 years2
Above 40 years3
EducationRI-4Graduate1
Postgraduate2
DesignationRI-5Charge Nurses,1
Consultant Medicine,2
Dy Medical Superintendents,3
Doctor-Medical Officer,4
Doctor-Pathology,5
Doctor-Post Graduate Registrar,6
Doctor-Pulmonology,7
Head Nurse,8
Lab Technologist,9
Male Nurse,10
Member NCOC11
Member PTC12
Principal Medical Officer13
Psychologist,14
Respiratory Therapist/Technologist15
Senior Respiratory Therapist16
Senior Lab Technologist,17
Senior Medical Officer,18
Senior Registrar Pulmonology19
Ward Registrar20
Women Medical Officer21
Theoretical ConstructsGeneral QuestionsGQFirst general question from the surveyGQ-1
Second general question from the surveyGQ-2
Third general question from the surveyGQ-3
NormalizationNThe first question on normalizationNP-1
The second question on normalizationNP-2
The third question on normalizationNP-3
CoherenceCOThe first question on CoherenceCO-1
The second question on CoherenceCO-2
The third question on CoherenceCO-3
Fourth question on CoherenceCO-4
Cognitive ParticipationCPThe first question on Cognitive ParticipationCP-1
The second question on Cognitive participationCP-2
The third question on Cognitive participationCP-3
Fourth question on Cognitive ParticipationCP-4
Collective ActionCAThe first question on Collective ActionCA-1
The second question on Collective ActionCA-2
The third question on Collective ActionCA-3
The fourth question on Collective ActionCA-3
The fifth question on Collective ActionCA-5
The sixth question on Collective ActionCA-6
The seventh question on Collective ActionCA-7
Reflexive MonitoringRMThe first question of Reflexive MonitoringRM-1
The second question of Reflexive monitoringRM-2
The third question of Reflexive monitoringRM-3
The fourth question of Reflexive monitoringRM-4
The fifth question of Reflexive MonitoringRM-5
Level of ResponseStrongly agree1
Agree2
Neither Agree nor Disagree3
Disagree4
Strongly Disagree5
Not relevant to my role6
Not relevant at this stage7
Not relevant to the intervention8
Notes: Any amendment required during data analysis: or ANOVA base tests, we need to organize the data. So, in the coding framework, the group designation has 21 codes that were difficult to manage in SPSS. So, we arranged these codes into a set of three for nurses, doctors, and allied healthcare professionals; the further description is given below.
GroupsThemeDescriptionCode
Respondents General InformationDesignationRI-5Nurses (Charge Nurse, Head Nurse, Male Nurse)1
Doctors (Consultant Medicine, Dy. Medical Superintendent, Medical Officer, Pathology, PGR, Pulmonology, Member NCOC, Member PTC, PMO, Senior Medical Officer, SR Pulmonology, Ward Registrar, WMO)2
Allied Health Professional (Lab Technologist, Psychologist, Respiratory Therapist/Technologist, Senior Respiratory Therapist, Senior Lab Technologist)3
Table A3. Demographic Information of Survey Respondents.
Table A3. Demographic Information of Survey Respondents.
CharacteristicsNMU HospitalDHQ
Hospital
FJW
Hospital
Total% of Total Responses
Age Group:
21 years to 30 years100/13266/8553/71219/28876.04%
31 years to 40 years30/13217/8517/7164/28822.22%
Above 40 years02/13202/8501/7105/2881.74%
Gender:
Male68/13240/854/71112/28838.89%
Female64/13245/8567/71176/28861.11%
Designations:
Charge Nurses,3015156020.833
Consultant Medicine,2-131.041
Dy Medical Superintendents,42282.777
Doctor-Medical Officer,282815719.791
Doctor-Pathology,21141.388
Doctor-Post Graduate Registrar,12-9217.291
Doctor-Pulmonology,42282.777
Head Nurse,534124.166
Lab Technologist,21141.388
Male Nurse,84-124.166
Member NCOC---10.347
Member PTC----0%
Principal Medical Officer-1--0%
Psychologist,33282.777
Respiratory Therapist/Technologist74-113.819
Senior Respiratory Therapist1--10.347
Senior Lab Technologist,31-41.388
Senior Medical Officer,42282.777
Senior Registrar Pulmonology21141.388
Women Medical Officer1517306221.527
Total1328571288

Appendix C. Tests

Figure A1. Flow Chart for Tackling the Common Source Bias. Source: George et al. [22].
Figure A1. Flow Chart for Tackling the Common Source Bias. Source: George et al. [22].
Ijerph 20 04630 g0a1
Table A4. Harman’s Single Factor of Common Source Bias.
Table A4. Harman’s Single Factor of Common Source Bias.
Total Variance Explained
FactorInitial EigenvaluesExtraction Sums of Squared Loadings
Total% of VarianceCumulative %Total% of VarianceCumulative %
110.05243.70643.7069.67942.08442.084
21.8578.07651.782
31.8257.93759.718
41.4646.36466.082
51.1004.78370.865
60.9884.29775.162
70.8903.86979.031
80.7693.34482.375
90.6842.97485.349
100.5632.44887.797
110.5362.33090.127
120.4712.04992.175
130.4251.84994.024
140.3431.49195.515
150.3041.32396.837
160.2381.03397.870
170.1790.77998.650
180.0970.42399.073
190.0730.31999.392
200.0560.24199.633
210.0490.21499.847
220.0250.11099.958
230.0100.042100.000
Extraction Method: Principal Axis Factoring.
Table A5. Kolmogorov–Smirnov a and Shapiro–Wilk b Test for Normality.
Table A5. Kolmogorov–Smirnov a and Shapiro–Wilk b Test for Normality.
Case Processing Summary
GenderCases
ValidMissingTotal
NPercentNPercentNPercent
NormalityMale112100.0%00.0%112100%
Female176100.0%00.0%176100%
Tests of Normality
GenderKolmogorov–Smirnov aShapiro–Wilk b
StatisticdfSig.StatisticdfSig
Male0.1941120.0000.8771120.000
Female0.2291760.0000.8481760.000
Case Processing Summary
EducationCases
ValidMissingTotal
NPercentNPercentNPercent
NormalityGraduate220100.0%00.0%220100%
Post-Graduate68100.0%00.0%68100%
Tests of Normality
EducationKolmogorov–Smirnov aShapiro–Wilk b
StatisticdfSig.StatisticdfSig
Male0.2362200.0000.8292200.000
Female0.170680.0000.889680.000
Case Processing Summary
AgeCases
ValidMissingTotal
NPercentNPercentNPercent
Normality21–30220100.0%00.0%220100%
31–4064100.0%00.0%64100%
40 and above4100.0%00.0%4100%
Tests of Normality
AgeKolmogorov–Smirnov aShapiro–Wilk b
StatisticdfSig.StatisticdfSig
Male0.2132200.0000.8602200.000
Female0.241640.0000.845640.000
0.28340.0000.86340.272
Case Processing Summary
OrganizationCases
ValidMissingTotal
NPercentNPercentNPercent
NormalityNMU131100.0%00.0%131100%
DHQ85100.0%00.0%85100%
FJWH72100.0%00.0%72100%
Tests of Normality
OrganizationKolmogorov–Smirnov aShapiro–Wilk b
StatisticdfSig.StatisticDfSig
NMU0.2451310.0000.8461310.000
DHQ0.242850.0000.827850.000
FJWH0.156720.0000.901720.000
Case Processing Summary
DesignationCases
ValidMissingTotal
NPercentNPercentNPercent
NormalityNurses85100.0%00.0%85100%
Doctors176100.0%00.0%176100%
AHP27100.0%00.0%27100%
Tests of Normality
DesignationKolmogorov–Smirnov aShapiro–Wilk b
StatisticdfSig.StatisticDfSig
Nurses0.308850.0000.693850.000
Doctors0.1631760.0000.8911760.000
AHP0.301270.0000.784270.000
Notes: Parametric procedures depend upon the suppositions regarding the allocation characteristics in the underlying population and the parameters of the assumed distribution. However, nonparametric procedures depend upon no or few suppositions regarding the shape or parameters of the population distribution from which the sample is drawn. Resultantly, the non-normality that exists in the data suggests opting for nonparametric tests. Conclusively, the nonparametric test, the Mann–Whitney U test for gender and education, and the Kruskal-wills test for organization/location and designation represent values less than the threshold values, illustrating the different representation of gender groups, education, location, and designations of the respondents that exist in the implementation of SD in the local context in Pakistan.
Table A6. Mann Whitney U Test Kruskal-Wills Test for Nonparametric Analysis.
Table A6. Mann Whitney U Test Kruskal-Wills Test for Nonparametric Analysis.
Hypothesis Test Summary
Null HypothesisTestSignificanceDecision
1The distribution of the normalization of SD is the same across the categories of the genderIndependent-Samples Mann–Whitney U Test0.038Reject the null hypothesis
Asymptotic significances are displayed. The significance level is 0.05.
Hypothesis Test Summary
Null HypothesisTestSignificanceDecision
1The distribution of the normalization of SD is the same across the categories of educationIndependent-Samples Mann–Whitney U Test0.034Reject the null hypothesis
Asymptotic significances are displayed. The significance level is 0.05.
Hypothesis Test Summary
Null HypothesisTestSignificanceDecision
1The distribution of the normalization of SD is the same across the categories of ageIndependent-Samples Kruskal–Wallis Test0.672Retain the null hypothesis
Asymptotic significances are displayed. The significance level is 0.05.
Hypothesis Test Summary
Null HypothesisTestSignificanceDecision
1The distribution of the normalization of SD is the same across the categories of the organizationIndependent-Samples Kruskal–Wallis Test0.030Reject the null hypothesis
Asymptotic significances are displayed. The significance level is 0.05.
Hypothesis Test Summary
Null HypothesisTestSignificanceDecision
1The distribution of the normalization of SD is the same across the categories of designationIndependent-Samples Kruskal–Wallis Test0.001Reject the null hypothesis
Asymptotic significances are displayed. The significance level is 0.05.
Table A7. Collinearity Statistics.
Table A7. Collinearity Statistics.
Collinearity Statistics
Outer VIF Values
Items1st Iteration2nd Iteration3rd Iteration
ValueValueValue
NP122142.2142.214
NP22.0482.0482.048
NP31.2801.2801.280
CO11.2331.2331.233
CO21.3921.3921.392
CO31.3611.3611.361
CO41.4741.4741.474
CP11.7261.7261.726
CP21.1481.1481.148
CP31.4381.4381.438
CP41.6361.6361.636
CA11.4531.4531.254
CA21.1601.160Deleted
CA31.0541.054Deleted
CA44.4044.4044.372
CA51.6041.6041.522
CA61.1961.196Deleted
CA74.7894.7894.774
RM110.874Deleted-
RM21.0951.089Deleted
RM31.1191.1141.112
RM49.1903.5463.523
RM54.4023.6603.501

Appendix D. Results/Models

Figure A2. Model Generated on the First Iteration.
Figure A2. Model Generated on the First Iteration.
Ijerph 20 04630 g0a2
Figure A3. Model Generated on the Second Iteration after Removing Multicollinearity (Removing RM1).
Figure A3. Model Generated on the Second Iteration after Removing Multicollinearity (Removing RM1).
Ijerph 20 04630 g0a3
Figure A4. Model Generated on the Third Iteration after Removing CA2, CA3, CA6, and RM2.
Figure A4. Model Generated on the Third Iteration after Removing CA2, CA3, CA6, and RM2.
Ijerph 20 04630 g0a4

References

  1. Sarwar, S.; Waheed, R.; Sarwar, S.; Khan, A. COVID-19 challenges to Pakistan: Is GIS analysis useful to draw solutions? Sci. Total Environ. 2020, 730, 139089. [Google Scholar] [CrossRef]
  2. Guimarães, R.M.; Monteiro da Silva, J.H.; Brusse, G.P.; Martins, T.C. Effect of physical distancing on COVID-19 incidence in Brazil: Does the strictness of mandatory rules matter? Health Policy Plan. 2021, 36, 1605–1612. [Google Scholar] [CrossRef] [PubMed]
  3. World Health Organization. World Health Organization’s Global Health Workforce Statistics, OECD, Supplemented by Country Data. In Physicians (per 1000 People)—Pakistan. Data; 2019. Available online: https://data.worldbank.org/indicator/SH.MED.PHYS.ZS?locations=PK (accessed on 15 October 2022).
  4. Khan, S.A. Situation analysis of health care system of Pakistan: Post 18 amendments. Health Care Curr. Rev. 2019, 7, 244. [Google Scholar] [CrossRef] [Green Version]
  5. Razaq, A.; Harrison, D.; Barr, B.; Asaria, M.; Routen, A.; Khunti, K. BAME COVID-19 Deaths-What Do We Know? Rapid Data & Evidence Review. 2020. Available online: https://www.cebm.net/covid-19/bame-covid-19-deaths-what-do-we-know-rapid-data-evidence-review/ (accessed on 20 October 2021).
  6. Rostami, P.; Ashcroft, D.M.; Tully, M.P. A formative evaluation of the implementation of a medication safety data collection tool in English healthcare settings: A qualitative interview study using normalization process theory. PLoS ONE 2018, 13, e0192224. [Google Scholar] [CrossRef] [PubMed]
  7. Lotta, G.; Coelho, V.S.; Brage, E. How COVID-19 Has Affected Frontline Workers in Brazil: A Comparative Analysis of Nurses and Community Health Workers. J. Comp. Policy Anal. Res. Pract. 2020, 23, 63–73. [Google Scholar] [CrossRef]
  8. Anthony Jnr, B. Integrating telemedicine to support digital health care for the management of COVID-19 pandemic. Int. J. Healthc. Manag. 2021, 14, 280–289. [Google Scholar] [CrossRef]
  9. Damschroder, L.; Aron, D.; Keith, R.; Kirsh, S.; Alexander, J.; Lowery, J. Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implement. Sci. 2009, 4, 50. [Google Scholar] [CrossRef] [Green Version]
  10. Greenhalgh, T.; Wherton, J.; Papoutsi, C.; Lynch, J.; Hughes, G.; A’Court, C.; Hinder, S.; Fahy, N.; Proctor, R.; Shaw, S. Beyond adoption: A new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread and sustainability of health and care technologies. J. Med. Internet Res. 2017, 19, e367. [Google Scholar] [CrossRef] [Green Version]
  11. Morrison, D.; Mair, F.S. Telehealth in practice: Using normalisation process theory to bridge the Translational Gap. Prim. Care Respir. J. 2011, 20, 351–352. [Google Scholar] [CrossRef] [Green Version]
  12. Sen-Crowe, B.; McKenney, M.; Elkbuli, A. Social distancing during the COVID-19 pandemic: Staying home save lives. Am. J. Emerg. Med. 2020, 38, 1519–1520. [Google Scholar] [CrossRef]
  13. Prem, K.; Liu, Y.; Russell, T.W.; Adam, J.K.; Rosalind, M.E.; Nicholas, D.; Centre for the Mathematical Modelling of Infectious Diseases COVID-19 Working Group. The effect of control strategies to reduce social mixing on outcomes of the COVID-19 epidemic in Wuhan, China: A modeling study. Lancet Public Health 2020, 5, e261–e270. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Barberia, L.G.; Cantarelli, L.G.; Oliveira, M.L.C.D.F.; Moreira, N.D.P.; Rosa, I.S.C. The effect of state-level social distancing policy stringency on mobility in the states of Brazil. Rev. De Adm. Pública 2021, 55, 27–49. [Google Scholar] [CrossRef]
  15. Iwaya, G.H.; Cardoso, J.G.; Sousa JH, D.; Steil, A.V. Predictors of the intention to maintain social distancing. Rev. De Adm. Pública 2020, 54, 714–734. [Google Scholar] [CrossRef]
  16. Mishra, M.; Majumdar, P. Social distancing during COVID-19: Will it change the Indian society? J. Health Manag. 2020, 22, 224–235. [Google Scholar] [CrossRef]
  17. Ramos, G.; Vieites, Y.; Jacob, J.; Andrade, E.B. Political orientation and support for social distancing during the COVID-19 pandemic: Evidence from Brazil. Rev. De Adm. Pública 2020, 54, 697–713. [Google Scholar] [CrossRef]
  18. Alimohamadi, Y.; Holakouie-Naieni, K.; Sepandi, M.; Taghdir, M. Effect of social distancing on COVID-19 incidence and mortality in Iran since February 20 to May 13, 2020: An interrupted time series analysis. Risk Manag. Healthc. Policy 2020, 13, 1695–1700. [Google Scholar] [CrossRef]
  19. Jadidzadeh, A.; Kneebone, R. Homeless Shelter Flows in Calgary and the Potential Impact of COVID-19. Can. Public Policy 2020, 46, S160–S165. [Google Scholar] [CrossRef]
  20. Asiamah, N.; Opuni, F.F.; Mends-Brew, E.; Mensah, S.W.; Mensah, H.K.; Quansah, F. Short-Term changes in behaviors resulting from COVID-19-Related social isolation and their influences on mental health in Ghana. Community Ment. Health J. 2021, 57, 79–92. [Google Scholar] [CrossRef]
  21. Iwuoha, V.C.; Aniche, E.T.; Obiora, C.A.; Umeifekwem, U.T. Citizens lack access to healthcare facilities: How COVID-19 lockdown and social distancing policies boost roadside chemist businesses in South-Eastern Nigeria. Int. J. Health Plan. Manag. 2021, 36, 2411–2423. [Google Scholar] [CrossRef]
  22. George, B.; Pandey, S.K. We know the Yin—But where is the Yang? Toward a balanced approach on common source bias in public administration scholarship. Rev. Public Pers. Adm. 2017, 37, 245–270. [Google Scholar] [CrossRef] [Green Version]
  23. Pereira, A.K.; Oliveira, M.S.; Sampaio, T.D.S. Asymmetries of state government social distancing policies in the face of COVID-19: Political and technical-administrative aspects. Rev. De Adm. Pública 2020, 54, 678–696. [Google Scholar] [CrossRef]
  24. Rahman, S.Y. “Social distancing’during COVID-19: The metaphors and politics of pandemic response in India. Health Sociol. Rev. 2020, 29, 131–139. [Google Scholar] [CrossRef] [PubMed]
  25. Hornik, R.; Kikut, A.; Jesch, E.; Woko, C.; Siegel, L.; Kim, K. Association of COVID-19 misinformation with face mask wearing and social distancing in a nationally representative US sample. Health Commun. 2021, 36, 6–14. [Google Scholar] [CrossRef] [PubMed]
  26. Schaefer, B.M.; Resende, R.C.; Epitácio, S.D.S.F.; Aleixo, M.T. Government actions against the new coronavirus: Evidence from the Brazilian states. Rev. De Adm. Pública 2020, 54, 1429–1445. [Google Scholar] [CrossRef]
  27. Jiang, X.; Hwang, J.; Shah, D.V.; Ghosh, S.; Brauer, M. News attention and social-distancing behavior amid COVID-19: How media trust and social norms moderate a mediated relationship. Health Commun. 2021, 37, 768–777. [Google Scholar] [CrossRef]
  28. Alotaibi, N.; Almutairi, S.; Alotaibi, M.; Alotaibi, M.M.; Alsufian, T. The Extent of Commitment of Saudis During Holy Ramadan to Social Distancing Measures Required for the Prevention of Transmission of COVID-19. J. Community Health 2021, 46, 693–702. [Google Scholar] [CrossRef] [PubMed]
  29. Cronin, C.J.; Evans, W.N. Total shutdowns, targeted restrictions, or individual responsibility: How to promote social distancing in the COVID-19 Era? J. Health Econ. 2021, 79, 102497. [Google Scholar] [CrossRef]
  30. Jehn, A.; Stackhouse, M.; Zajacova, A. COVID-19 Health Precautions: Identifying Demographic and Socioeconomic Disparities and Changes over Time. Can. Public Policy 2021, 47, 252–264. [Google Scholar] [CrossRef]
  31. Roy, S.; Ghosh, P. A Comparative Study on Distancing, Mask and Vaccine Adoption Rates from Global Twitter Trends. In Healthcare; Multidisciplinary Digital Publishing Institute: Basel, Switzerland, 2021; Volume 9, p. 488. [Google Scholar]
  32. Yeom, M.; Stewart, F.; Stewart, A. The impact of social distancing on community case count in the United States: Testing the efficacy of protection motivation theory during early stages of the COVID-19 pandemic. Risk Hazards Crisis Public Policy 2021, 12, 303–327. [Google Scholar] [CrossRef]
  33. Cunha, M.; Domingos, A.; Rocha, V.; Torres, M. How many could have been saved? Effects of social distancing on COVID-19. Rev. De Adm. Pública 2021, 55, 12–26. [Google Scholar] [CrossRef]
  34. Yu, D.; Anser, M.K.; Peng, M.Y.P.; Nassani, A.A.; Askar, S.E.; Zaman, K.; Jabor, M.K. Nationwide Lockdown, Population Density, and Financial Distress Brings Inadequacy to Manage COVID-19: Leading the Services Sector into the Trajectory of Global Depression. In Healthcare; Multidisciplinary Digital Publishing Institute: Basel, Switzerland, 2021; Volume 9, p. 220. [Google Scholar]
  35. Buckingham, S.; Kendall, M.; Ferguson, S.; MacNee, W.; Sheikh, A.; White, P.; Worth, A.; Boyd, K.; Murray, S.A.; Pinnock, H. HELPing older people with very severe chronic obstructive pulmonary disease (HELP-COPD): Mixed-method feasibility pilot randomized controlled trial of a novel intervention. NPJ Prim. Care Respir. Med. 2015, 25, 15020. [Google Scholar] [CrossRef] [Green Version]
  36. Stevenson, F. The use of electronic patient records for medical research: Conflicts and contradictions. BMC Health Serv. Res. 2015, 15, 124. [Google Scholar] [CrossRef] [Green Version]
  37. Carter, M.; Davey, A.; Wright, C.; Elmore, N.; Newbould, J.; Roland, M.; Campbell, J.; Burt, J. Capturing patient experience: A qualitative study of implementing real-time feedback in primary care. Br. J. Gen. Pract. 2016, 66, e786–e793. [Google Scholar] [CrossRef] [Green Version]
  38. Porter, A.; Kingston, M.R.; Evans, B.A.; Hutchings, H.; Whitman, S.; Snooks, H. It could be a “Golden goose”: A qualitative study of views in primary care on an emergency admission risk prediction tool prior to implementation. BMC Fam. Pract. 2016, 17, 1. [Google Scholar]
  39. Bayliss, K.; Riste, L.; Band, R.; Peters, S.; Wearden, A.; Lovell, K.; Fisher, L.; Chew-Graham, C.A. Implementing resources to support the diagnosis and management of chronic fatigue syndrome/Myalgic encephalomyelitis (CFS/ME) in primary care: A qualitative study. BMC Fam. Pract. 2016, 17, 66. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Ricketts, E.J.; Francischetto, E.O.C.; Wallace, L.M.; Hogan, A.; McNulty, C.A. Tools to overcome potential barriers to chlamydia screening in general practice: Qualitative evaluation of the implementation of a complex intervention. BMC Fam. Pract. 2016, 17, 33. [Google Scholar] [CrossRef] [Green Version]
  41. Blickem, C.; Kennedy, A.; Jariwala, P.; Morris, R.; Bowen, R.; Vassilev, I.; Brooks, H.; Blakeman, T.; Rogers, A. Aligning everyday life priorities with people’s self-management support networks: An exploration of the work and implementation of a needs-led telephone support system. BMC Health Serv. Res. 2014, 14, 262. [Google Scholar] [CrossRef] [PubMed]
  42. Bouamrane, M.-M.; Mair, F.S. A qualitative evaluation of general practitioners’ views on protocol-driven eReferral in Scotland. BMC Med. Inf. Decis. Mak. 2014, 14, 30. [Google Scholar] [CrossRef] [Green Version]
  43. Reeve, J.; Britten, N.; Byng, R.; Fleming, J.; Heaton, J.; Krska, J. Identifying enablers and barriers to individually tailored prescribing: A survey of healthcare professionals in the UK. BMC Fam. Pract. 2018, 19, 17. [Google Scholar] [CrossRef] [Green Version]
  44. Teunissen, E.; Gravenhorst, K.; Dowrick, C.; van Weel-Baumgarten, E.; Van den Driessen, M.F.; de Brún, T.; Burns, N.; Lionis, C.; Mair, F.S.; O’Donnell, C.; et al. Implementing guidelines and training initiatives to improve cross-cultural communication in primary care consultations: A qualitative participatory European study. Int. J. Equity Health 2017, 16, 32. [Google Scholar] [CrossRef] [Green Version]
  45. Browne, S.; Macdonald, S.; May, C.R.; Macleod, U.; Mair, F.S. Patient, carer and professional perspectives on barriers and facilitators to quality care in advanced heart failure. PLoS ONE 2014, 9, e93288. [Google Scholar] [CrossRef] [Green Version]
  46. Coupe, N.; Anderson, E.; Gask, L.; Sykes, P.; Richards, D.A.; Chew-Graham, C. Facilitating professional liaison in collaborative care for depression in UK primary care; a qualitative study utilizing normalization process theory. BMC Fam. Pract. 2014, 15, 78. [Google Scholar] [CrossRef] [Green Version]
  47. Nutley, S.; Walter, I.; Davies, H. Using Evidence: How Research can Inform Public Services; Policy Press: Bristol, UK, 2007. [Google Scholar]
  48. Greenhalgh, T.; Robert, G.; MacFarlane, F. Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Q. 2004, 82, 581–629. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  49. Henseler, J.; Schuberth, F. Using confirmatory composite analysis to assess emergent variables in business research. J. Bus. Res. 2020, 120, 147–156. [Google Scholar] [CrossRef]
  50. Hair, J.F., Jr.; Sarstedt, M.; Hopkins, L.; Kuppelwieser, V.G. Partial least squares structural equation modeling (PLS-SEM). Eur. Bus. Rev. 2014, 26, 106–121. [Google Scholar] [CrossRef]
  51. Finch, T.L.; Girling, M.; May, C.R.; Mair, F.S.; Murray, E.; Treweek, S.; Rapley, T. Improving the normalization of complex interventions: Part 2-validation of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT). BMC Med. Res. Methodol. 2018, 18, 135. [Google Scholar] [CrossRef] [Green Version]
  52. Meier, K.J.; O’Toole, L.J., Jr. I think (I am doing well), therefore I am: Assessing the validity of administrators’ self-assessments of performance. Int. Public Manag. J. 2013, 16, 1–27. [Google Scholar] [CrossRef]
  53. Garson, D. Partial Least Squares: Regression & Structural Equation Modeling; Statistical Associates Publishing: Asheboro, NC, USA, 2016. [Google Scholar]
  54. Podsakoff, P.M.; MacKenzie, S.B.; Podsakoff, N.P. Sources of method bias in social science research and recommendations on how to control it. Annu. Rev. Psychol. 2012, 63, 539–569. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Kock, N. Harman’s single factor test in PLS-SEM: Checking for common method bias. Data Anal. Perspect. J. 2021, 2, 1–6. [Google Scholar]
  56. Razali, N.M.; Wah, Y.B. Power comparisons of shapiro-wilk, kolmogorov-smirnov, lilliefors and anderson-darling tests. J. Stat. Model. Anal. 2011, 2, 21–33. [Google Scholar]
  57. Harwell, M.R. Choosing between parametric and nonparametric tests. J. Couns. Dev. 1988, 67, 35–38. [Google Scholar] [CrossRef]
  58. Fagerland, M.W.; Sandvik, L. The ilcoxon–mann–whitney test under scrutiny. Stat. Med. 2009, 28, 1487–1497. [Google Scholar] [CrossRef] [PubMed]
  59. Hecke, T.V. Power study of anova versus Kruskal-Wallis test. J. Stat. Manag. Syst. 2012, 15, 241–247. [Google Scholar] [CrossRef]
  60. Graf, A.S.; Knepple Carney, A. Ageism as a Modifying Influence on COVID-19 Health Beliefs and Intention to Social Distance. J. Aging Health 2021, 33, 518–530. [Google Scholar] [CrossRef] [PubMed]
  61. Henseler, J.; Chin, W.W. A Comparison of Approaches for the Analysis of Interaction Effects Between Latent Variables Using Partial Least Squares Path Modeling. Struct. Equ. Model. A Multidiscip. J. 2010, 17, 82–109. [Google Scholar] [CrossRef]
  62. Hair, J.F.; Ringle, C.M.; Sarstedt, M. PLS-SEM: Indeed a Silver Bullet. J. Mark. Theory Pract. 2011, 19, 139–152. [Google Scholar] [CrossRef]
  63. Ali, F.; Kim, W.G.; Ryu, K. The effect of physical environment on passenger delight and satisfaction: Moderating effect of national identity. Tour. Manag. 2016, 57, 213–224. [Google Scholar] [CrossRef]
  64. Esposito Vinzi, V.; Chin, W.W.; Henseler, J.; Wang, H. Handbook of Partial Least Squares: Concepts, Methods and Applications; Springer: Berlin/Heidelberg, Germany, 2010. [Google Scholar]
  65. Siqueira, G.D.; Adeel, A.; Pasha, P.; Balushi, A.A.; Shah, S.A.R. Sustainable transportation and policy development: A study for impact analysis of mobility patterns and neighborhood assessment of walking behavior. Sustainability 2021, 13, 1871. [Google Scholar] [CrossRef]
  66. Fornell, C.; Larcker, D.F. Evaluating structural equation models with unobservable variables and measurement error. J. Mark. Res. 1981, 18, 39–50. [Google Scholar] [CrossRef]
  67. Barclay, C.; Thompson, D.; dan Higgins, R. The Partial Least Squares (PLS) Approach to Causal Modeling: Personal Computer Adoption and Use an Illustration. Technol. Stud. 1995, 2, 285–309. [Google Scholar]
  68. Liu, Y. A new antihypertensive drug ameliorate insulin resistance. Acta Pharmacol. Sin. 2012, 33, 429–430. [Google Scholar] [CrossRef]
  69. Chin, W.W. The partial least squares approach to structural equation modeling. Mod. Methods Bus. Res. 1998, 295, 295–336. [Google Scholar]
  70. Hair, J.F.; Risher, J.J.; Sarstedt, M.; Ringle, C.M. When to use and how to report the results of PLS-SEM. Eur. Bus. Rev. 2019, 31, 2–24. [Google Scholar] [CrossRef]
  71. Kushary, D. Bootstrap Methods and their Application. Technometrics 2000, 42, 216–217. [Google Scholar] [CrossRef]
  72. Hair, J.F.; Sarstedt, M.; Ringle, C.M.; Mena, J.A. An assessment of the use of partial least squares structural equation modeling in marketing research. J. Acad. Mark. Sci. 2012, 40, 414–433. [Google Scholar] [CrossRef]
  73. Aibinu, A.A.A.A.; Al-Lawati, A.M. Using PLS-SEM technique to model construction organizations’ willingness to participate in e-bidding. Autom. Constr. 2010, 19, 714–724. [Google Scholar] [CrossRef]
  74. Akter, S.; D’Ambra, J.; Ray, P. An Evaluation of PLS-based Complex Models: The Roles of Power Analysis, Predictive Relevance and GoF Index. In Proceedings of the Renaissance of Information Technology for Sustainability and Global Competitiveness, 17th Americas Conference on Information Systems (AMCIS 2011), Detroit, MI, USA, 4–8 August 2011. [Google Scholar]
  75. Cohen, J.; Cohen, P.; West, S.G.; Aiken, L.S. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences; Routledge: London, UK, 2013. [Google Scholar]
  76. Athab, N.A. An analytical study of cervical spine pain according to the mechanical indicators of the administrative work staff. Indian J. Public Health 2019, 10, 1348–1353. [Google Scholar] [CrossRef]
  77. Askariazad, M.H.; Babakhani, N. An application of European Customer Satisfaction Index (ECSI) in business to business (B2B) context. J. Bus. Ind. Mark. 2015, 30, 17–31. [Google Scholar] [CrossRef]
  78. Henseler, J.; Sarstedt, M. Goodness-of-fit indices for partial least squares path modeling. Comput. Stat. 2013, 28, 565–580. [Google Scholar] [CrossRef] [Green Version]
  79. Davies, P.; Walker, A.E.; Grimshaw, J.M. A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement. Sci. 2010, 5, 14. [Google Scholar] [CrossRef] [Green Version]
  80. Wetzels, M.; Odekerken-Schröder, G.; Van Oppen, C. Using PLS path modeling for assessing hierarchical construct models: Guidelines and empirical illustration. MIS Q. 2009, 33, 177–195. [Google Scholar] [CrossRef]
  81. Finch, T.L.; Girling, M.; May, C.R.; Mair, F.S.; Murray, E.; Treweek, S.; Rapley, T. NoMAD: Implementation Measure Based on Normalization Process Theory. [Measurement Instrument]. 2015. Available online: http://www.normalizationprocess.org (accessed on 11 November 2021).
  82. May, C. Implementing, embedding and integrating practices: An outline of normalization process theory. Sociology 2009, 43, 535–554. [Google Scholar] [CrossRef]
  83. Hair, J.F.; Hult, G.T.M.; Ringle, C.; Sarstedt, M. A Primer on Partial Least Squares Structural Equation Modelling (PLS-SEM); Sage Publications: Los Angeles, CA, USA, 2013. [Google Scholar]
  84. Chin, W.W.; Peterson, R.A.; Brown, P.S. Structural equation modelling in marketing: Some practical reminders. J. Mark. Theory Pract. 2008, 16, 287–298. [Google Scholar] [CrossRef]
  85. Huddlestone, L.; Turner, J.; Eborall, H.; Hudson, N.; Davies, M.; Martin, G. Application of normalisation process theory in understanding implementation processes in primary care settings in the UK: A systematic review. BMC Fam. Pract. 2020, 21, 52. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  86. Streiner, D.L.; Norman, G.R. Health Measurement Scales. A Practical Guide to Their Development and Use; Oxford University Press: Oxford, UK, 2004. [Google Scholar]
  87. Moraes, R.F.D. Determinants of physical distancing during the COVID-19 epidemic in Brazil: Effects from mandatory rules, numbers of cases and duration of rules. Ciência Saúde Coletiva 2020, 25, 3393–3400. [Google Scholar] [CrossRef] [PubMed]
  88. Battiston, P.; Gamba, S. COVID-19: R0 is lower where outbreak is larger. Health Policy 2021, 125, 141–147. [Google Scholar] [CrossRef]
  89. Elf, M.; Nordmark, S.; Lyhagen, J.; Lindberg, I.; Finch, T.; Åberg, A.C. The Swedish version of the Normalization Process Theory Measure S-NoMAD: Translation, adaptation, and pilot testing. Implement. Sci. 2018, 13, 146. [Google Scholar] [CrossRef] [PubMed]
  90. May, C.R.; Cummings, A.; Girling, M.; Bracher, M.; Mair, F.S.; May, C.M.; Finch, T. Using Normalization Process Theory in feasibility studies and process evaluations of complex healthcare interventions: A systematic review. Implement. Sci. 2018, 13, 80. [Google Scholar] [CrossRef] [PubMed]
  91. Eccles, M.P.; Armstrong, D.; Baker, R.; Cleary, K.; Davies, H.; Davies, S.; Sibbald, B. An implementation research agenda. Implement. Sci. 2009, 4, 18. [Google Scholar] [CrossRef] [Green Version]
  92. Woolf, S.H. The meaning of translational research and why it matters. JAMA 2008, 299, 211–213. [Google Scholar] [CrossRef] [PubMed]
  93. Mackenzie, M.; O’Donnell, C.; Halliday, E.; Sridharan, S.; Platt, S. Do health improvement programmes fit with MRC guidance on evaluating complex interventions? BMJ 2010, 340, c185. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  94. Eccles, M.P.; Weijer, C.; Mittman, B. Requirements for ethics committee review for studies submitted to Implementation Science. Implement. Sci. 2011, 6, 32. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  95. de Brún, T.; O’Reilly-de Brún, M.; O’Donnell, C.A.; MacFarlane, A. Learning from doing: The case for combining normalisation process theory and participatory learning and action research methodology for primary healthcare implementation research. BMC Health Serv. Res. 2016, 16, 346. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  96. Eckhard, S.; Parizek, M. Policy implementation by international organizations: A comparative analysis of strengths and weaknesses of national and international staff. J. Comp. Policy Anal. Res. Pract. 2020, 24, 254–270. [Google Scholar] [CrossRef]
Figure 1. Search strategy of the literature.
Figure 1. Search strategy of the literature.
Ijerph 20 04630 g001
Figure 2. Theoretical framework.
Figure 2. Theoretical framework.
Ijerph 20 04630 g002
Figure 3. Conceptual framework.
Figure 3. Conceptual framework.
Ijerph 20 04630 g003
Figure 4. Values of composite reliability in the first iteration.
Figure 4. Values of composite reliability in the first iteration.
Ijerph 20 04630 g004
Figure 5. Values of average variance extracted in the first iteration.
Figure 5. Values of average variance extracted in the first iteration.
Ijerph 20 04630 g005
Figure 6. Values of composite reliability in the second iteration.
Figure 6. Values of composite reliability in the second iteration.
Ijerph 20 04630 g006
Figure 7. Values of average variance extracted in the second iteration.
Figure 7. Values of average variance extracted in the second iteration.
Ijerph 20 04630 g007
Figure 8. Values of composite reliability in the third iteration.
Figure 8. Values of composite reliability in the third iteration.
Ijerph 20 04630 g008
Figure 9. Values of average variance extracted in the third iteration.
Figure 9. Values of average variance extracted in the third iteration.
Ijerph 20 04630 g009
Figure 10. Structural model relationship.
Figure 10. Structural model relationship.
Ijerph 20 04630 g010
Table 1. Individual item validity and convergent validity.
Table 1. Individual item validity and convergent validity.
ConstructsItemsFirst IterationSecond IterationThird Iteration
LoadingCRAVELoadingCRAVELoadingCRAVE
SD
Normalization
NP1
NP2
NP3
0.911
0.897
0.635
0.8610.6800.911
0.894
0.642
0.8620.6800.915
0.898
0.626
0.8600.678
CoherenceCO1
CO2
CO3
CO4
0.614
0.684
0.679
0.892
0.8130.5260.614
0.684
0.679
0.892
0.81305260.615
0.684
0.680
0.892
0.8130.526
Cognitive
Participation
CP1
CP2
CP3
CP4
0.851
0.496
0.764
0.824
0.8300.558
0.851
0.496
0.794
0.823
0.8300.558
0.851
0.496
0.764
0.824
0.8300558
Collective
Action
CA1
CA2
CA3
CA4
CA5
CA6
CA7
0.610
-0.319
0.143
0.859
0.806
0.102
0.890
0.6890.3830.611
−0.320
0.143
0.859
0.806
0.102
0.890
0.689
0.383
0.602
Omitted
Omitted
0.878
0.802
Omitted
0.907
0.8790.650
Reflexive MonitoringRM1
RM2
RM3
RM4
RM5
0.942
0.379
0.484
0.933
0.925
0.8700.598Omitted
0.449
0.537
0.896
0.916
0.8070.533-
Omitted
0.556
0.925
0.927
0.8560.675
Table 2. Analysis of discriminant validity.
Table 2. Analysis of discriminant validity.
Analysis of Discriminant Validity through Cross-Loadings
ConstructsNormalization of Social DistancingCoherenceCognitive ParticipationCollective ActionReflexive Monitoring
NP10.9150.8350.8130.8370.759
NP20.8980.5980.8420.8130.830
NP30.6260.3160.4090.4290.367
CO10.3490.6150.2670.2630.283
CO20.3470.6840.2960.2500.347
CO30.3670.6800.3260.3380.348
CO40.8460.8920.8090.7750.738
CP10.7900.6340.8510.8080.717
CP20.3180.2120.4960.3600.345
CP30.6590.4910.7640.6010.558
CP40.7340.6000.8240.6910.814
CA10.4640.4010.4400.6020.419
CA40.6790.5240.7010.8780.670
CA50.7380.5270.7840.8020.790
CA70.7710.6420.7560.9070.698
RM30.4960.5080.3930.4750.556
RM40.7900.5900.8280.7300.925
RM50.8410.5110.8370.8620.927
Table 3. Structural model significance.
Table 3. Structural model significance.
ConstructsPath CoefficientsSample MeanStandard Deviationt-Valuep-ValuesResult
CO0.2020.2010.0603.3590.000Significant
CP0.2260.2330.0603.7720.001Significant
CA0.2990.2970.0913.2890.001Significant
RM0.2940.2900.0684.3460.000Significant
Table 4. Descriptive statistics and hypothesis testing.
Table 4. Descriptive statistics and hypothesis testing.
Original Sample (O)Sample Mean (M)Standard DeviationT Statisticsp ValuesHypothesis Testing
NP1—Normalization of SD0.9150.9150.009105.2030.000
NP2—Normalization of SD0.8980.8980.01277.2410.000
NP3—Normalization of SD0.6260.6220.04514.0210.000
CO1—Coherence0.6150.6160.05311.6570.000
CO2—Coherence0.6840.6870.04714.5090.000
CO3—Coherence0.6800.6780.05312.9320.000
CO4—Coherence0.8920.8930.008116.1330.000
Coherence to Normalization of SDSupported
CP1—Cognitive Participation0.8510.8510.01750.1690.000
CP2—Cognitive Participation0.4960.4980.0975.0940.000
CP3—Cognitive Participation0.7640.7620.03522.0940.000
CP4—Cognitive Participation0.8240.8230.03126.9580.000
Cognitive Participation to Normalization of SDSupported
CA1—Collective Action0.6020.6040.06010.0970.000
CA4—Collective Action0.8780.8780.02633.4660.000
CA5—Collective Action0.8020.8030.02433.7110.000
CA7—Collective Action0.9070.9040.02142.3450.000
Collective Action to Normalization of SDSupported
RM3—Reflexive Monitoring0.5560.5560.0648.6360.000
RM4—Reflexive Monitoring0.9250.9250.01949.7390.000
RM5—Reflexive Monitoring0.9270.9280.01092.5820.000
Reflexive Monitoring to Normalization of SDSupported
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Nazir, M.F.; Qureshi, S.F. Applying Structural Equation Modelling to Understand the Implementation of Social Distancing in the Professional Lives of Healthcare Workers. Int. J. Environ. Res. Public Health 2023, 20, 4630. https://doi.org/10.3390/ijerph20054630

AMA Style

Nazir MF, Qureshi SF. Applying Structural Equation Modelling to Understand the Implementation of Social Distancing in the Professional Lives of Healthcare Workers. International Journal of Environmental Research and Public Health. 2023; 20(5):4630. https://doi.org/10.3390/ijerph20054630

Chicago/Turabian Style

Nazir, Muhammad Fayyaz, and Shahzadah Fahed Qureshi. 2023. "Applying Structural Equation Modelling to Understand the Implementation of Social Distancing in the Professional Lives of Healthcare Workers" International Journal of Environmental Research and Public Health 20, no. 5: 4630. https://doi.org/10.3390/ijerph20054630

APA Style

Nazir, M. F., & Qureshi, S. F. (2023). Applying Structural Equation Modelling to Understand the Implementation of Social Distancing in the Professional Lives of Healthcare Workers. International Journal of Environmental Research and Public Health, 20(5), 4630. https://doi.org/10.3390/ijerph20054630

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop