Next Article in Journal
A Process Evaluation Protocol for Examining the Impact of Instructions for Correct Use of Child Car Seats Designed through a Consumer-Driven Process and Evaluated in a Field-Based Randomised Controlled Trial
Next Article in Special Issue
Is Irritable Bowel Syndrome Considered in Clinical Trials on Physical Therapy Applied to Patients with Temporo-Mandibular Disorders? A Scoping Review
Previous Article in Journal
Internalized Stigmatization, Social Support, and Individual Mental Health Problems in the Public Health Crisis
Previous Article in Special Issue
Physician-Delivered Pain Neuroscience Education for Opioid Tapering: A Case Report
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Behavior Change Following Pain Neuroscience Education in Middle Schools: A Public Health Trial

1
Evidence in Motion, Story City, IA 50248, USA
2
Big Stone Therapies, Hendricks, MN 56136, USA
3
Evidence in Motion Pain Fellowship, San Antonio, TX 78232, USA
4
Confluent Health, Siesta Key, FL 34242, USA
5
180 Therapy and Wellness, Alexandria, VA 22314, USA
6
St. Croix Regional Medical Center, St Croix Falls, WI 54024, USA
7
SERC Physical Therapy, Webb City, MO 64870, USA
8
Physical Therapy of Concordia, Concordia, MO 64020, USA
9
Ortho Spine and Pain Clinic, Story City, IA 50248, USA
10
Department of Physical Therapy, School of Health Sciences, University of South Dakota, Vermillion, SD 57069, USA
11
Doctor of Physical Therapy Program, Robbins College of Health and Human Sciences, Baylor University, Waco, TX 76798-7303, USA
12
Department of Physical Therapy, School of Allied Health Sciences, University of Nevada Las Vegas, Las Vegas, NV 89154-3029, USA
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(12), 4505; https://doi.org/10.3390/ijerph17124505
Submission received: 1 June 2020 / Revised: 17 June 2020 / Accepted: 19 June 2020 / Published: 23 June 2020
(This article belongs to the Special Issue Pain Neuroscience Education, Chronic Pain, and Health Care)

Abstract

:
Chronic pain and the opioid epidemic need early, upstream interventions to aim at meaningful downstream behavioral changes. A recent pain neuroscience education (PNE) program was developed and tested for middle-school students to increase pain knowledge and promote healthier beliefs regarding pain. In this study, 668 seventh-grade middle-school students either received a PNE lecture (n = 220); usual curriculum school pain education (UC) (n = 198) or PNE followed by two booster (PNEBoost) sessions (n = 250). Prior to, immediately after and at six-month follow-up, pain knowledge and fear of physical activity was measured. Six months after the initial intervention school, physical education, recess and sports attendance/participation as well as healthcare choices for pain (doctor visits, rehabilitation visits and pain medication use) were measured. Students receiving PNEBoost used 30.6% less pain medication in the last 6 months compared to UC (p = 0.024). PNEBoost was superior to PNE for rehabilitation visits in students experiencing pain (p = 0.01) and UC for attending school in students who have experienced pain > 3 months (p = 0.004). In conclusion, PNEBoost yielded more positive behavioral results in middle school children at six-month follow-up than PNE and UC, including significant reduction in pain medication use.

1. Introduction

The global pain epidemic is well-documented. For example, in the United States (US), it is currently reported that 25.3 million adults suffer from daily chronic pain and it is estimated that 126.1 million adults in the US experience some pain over a three-month reporting period [1,2]. Children and adolescents also struggle with persistent pain with various studies reporting approximately one in six experiencing persistent pain [3,4,5]. In the US, the resulting opioid epidemic has also reached a critical point. It is reported that in 2012, US healthcare providers wrote 259 million prescriptions for opioid pain medications [6] with the US consuming 80% of the global opioid supply, and 99% of the global hydrocodone supply [7]. These staggering numbers, including US daily opioid-related deaths exceeding 130, warrant urgent and extensive attention.
The exact reason for the pain and opioid epidemic is multi-factorial, complicated, and political [3,8]. To address this epidemic, much attention is being given to the current chronic pain and opioid-using sufferer [9,10]. There must, however, be a comprehensive, national, and global initiative to prevent this epidemic. One such initiative may be to teach children more about the neurophysiology and neurobiology of pain, referred to as pain neuroscience education (PNE) [8,11,12]. In clinical practice, PNE is an educational strategy used by healthcare providers that focuses on teaching people in pain about the biological and physiological processes involved in their pain experience [13,14,15]. Current best-evidence provides strong support for PNE used in conjunction with exercise and other healthy lifestyle behaviors to positively influence pain ratings, dysfunction, fear-avoidance, pain catastrophization, limitations in movement, pain knowledge and healthcare utilization [12,16]. PNE researchers have argued that current biomedical models, which are very prevalent in medicine, may be a substantial factor behind the pain epidemic [17,18,19]. In the biomedical model, the health of a person’s tissues is powerfully connected to their pain experience, yet it is well documented that the health of tissues and pain do not necessarily correlate [20,21,22]. As long as patients, healthcare providers, and the general population connect the health of tissues to how much pain someone will experience, it can increase fear-avoidance and pain catastrophization. These beliefs have been shown to be powerful predictors of persistent pain, including use of opioids [23,24].
In line with this reasoning, a series of PNE studies have been designed and conducted for middle school students in the US [8,11,25]. In this approach, it is reasoned that if children are taught healthier beliefs and attitudes about pain and its treatment options, it may in fact have downstream effects later in life [8]. A series of studies ensued to build, test and validate the program, before testing the long-term behavioral changes. In the first study, a PNE curriculum was built and tested on 147 middle-school students in regard to their knowledge of pain as well as attitudes and beliefs regarding pain. In this simple pre-, post-PNE study, knowledge of pain shifted significantly, in line with clinical studies as well as fostering healthier attitudes and beliefs regarding pain, especially chronic pain [8]. In a second follow-up study (Benz, et al.—submitted for publication), PNE delivered to middle-school students was able to powerfully influence fear-avoidance of physical activity in the presence of pain. In terms of delivery, Podolak et al. [25], showed that an animated, video-delivery of the same PNE content yielded similar results to live, in-person, physical therapist-delivered PNE, thus showcasing an ability to scale such a PNE middle school project. More recently, Louw et al. [11], compared the newly-designed PNE middle school program to current content taught to middle school children regarding pain. The results supported current clinical studies whereby PNE-delivered content reduced fear, while current biomedically driven middle-school content increase fear and fear-avoidance [12]. Additionally, as expected, the PNE program yielded superior results in terms of pain knowledge compared to current school curricula.
However, an important question remains unanswered. Will a program such as this yield any downstream positive behavioral results? In all mass-education, population-based studies, behavior change is the key to success [26]. For example, in smoking-cessation programs, the ultimate result is smoking cessation [27]. To truly determine if such a PNE program results in behavior change would need to be demonstrated. It is important to realize that education typically as a stand-alone intervention for behavior change is very limited. For example, the US spends $2.1 trillion annually on smoking-cessation programs and yields a 20–25% success rate [27,28,29]. With the development and validation of the PNE middle school program complete, this study set out to examine if PNE delivered to middle-school students would yield positive behavior changes during/after the school year, as measured six-months later. In line with previous PNE studies, three educational approaches were established for testing: one-time, in-person PNE delivered session (PNE); one-time, in-person educational session using current school or ‘usual curriculum’ content on pain (UC) and PNE session followed by two booster sessions (PNEBoost). Three aims were formulated. Aim One was to determine if there would be any difference between the three groups, six months later in terms of school, physical education (PE), sports and recess attendance/participation as well as healthcare choices (doctors’ visits, rehabilitation visits and/or pain medication use). The second aim was to compare the three groups’ six-month outcomes taking into consideration demographic variables (gender, pain at the time of the intervention, having experienced pain >3 months, knowing someone with chronic pain, high level of fear-avoidance and pain knowledge). The third and final aim was to determine which demographic variables were most associated with school attendance, PE participation, recess participation, and sports participation in the ensuing six months.

2. Materials and Methods

2.1. Participants and Recruitment

In previous middle school PNE studies [8,11,25], it has been shown that 6th and 7th grade school children (aged 11 to 13) are better equipped to take on more complex thoughts, and therefore, more likely to benefit from education about pain. We chose to recruit 7th graders in public and private schools in various states in the US because of this and also because they would be more likely to participate in more physical activities and sustain more sporting or recreational injuries than their younger counterparts [2,11,25]. For the purpose of this study, clinicians who were familiar with PNE, met minimum training requirements and who had access to middle schools were recruited similar to previous middle school PNE studies [8,11,25]. Written consent from the schools for participation in this study was obtained by each clinician participating in the study. In all, 6 clinicians met the criteria for delivering the PNE, and obtaining consent from the schools. Each school was provided with the goals of the educational programming, layout, and necessary examples of the proposed lecture and outcome measures. Since each school had a different approval process (private, public, different states, etc.), it was left up to each school’s administration to determine its own internal procedure for approval, varying between school board approvals, superintendent approvals and/or individualized parental consent. Consent forms were collected from each location prior to the start of the study. All students in the studies had the option to opt out of the study. No personal identifiable data was collected. Once each school consented, teachers were instructed and familiarized with the intended study and the one-time 45-min session was entered into the class schedule, with the exception of the PNEBoost group, which scheduled 2 additional booster sessions (see intervention section). Classes were randomly assigned per concealed envelope system to either receive a PNE lecture or usual care (UC) or PNE plus booster sessions (PNEBoost) (Figure 1). Some clinicians were only able to secure one class/location, while others delivered education at multiple sites. The only exclusions set for the study were students who did not want to attend the class, parents objecting to their child attending the class, or students not proficient in writing and reading English. The research project was conducted according to the Declaration of Helsinki and was approved by the Institutional Review Board for research involving human subjects (University of South Dakota – IRB-19-149).

2.2. Intervention

2.2.1. Pain Neuroscience Education (PNE)

The content of middle-school PNE program is well documented [8,11,25]. Given the short duration of the class period, an abbreviated 30-min, 32-slide PowerPoint™ (Microsoft Corporation, Redmond, WA, USA) presentation was developed, allowing ample time for survey completion prior to and following the PNE lecture. The PowerPoint™ presentation’s main themes included a discussion of peripheral sensitization, central sensitization, and biopsychosocial factors associated with pain, threat appraisal of the brain, nociception, stress and endocrine responses in pain as well as various therapeutic endogenous strategies to ease pain [30,31,32,33]. Various images, metaphors and examples were used to convey the PNE to the students [34]. Following the formal presentation by the attending clinician and completion of the immediate post-PNE surveys, participants were encouraged to ask questions. The presentation did not specifically address or target any questions contained in the outcome measures.

2.2.2. Pain Neuroscience Education Plus Booster (PNEBoost)

The second group of students (PNEBoost) received the exact same intervention and procedures as the PNE group, except 2 and 4 months later, a booster session was provided for the students via video-delivery (Figure 1). A previously tested video-presentation of the PNE was broken into 2 parts (approximately 10 min each) and shown at the two designated time-periods by the teachers as a means to provide a refresher of the content.

2.2.3. Usual Care (UC)

Teaching students their current content pertaining to biology, pain and injuries constituted usual care. The content has been established and tested in a previous PNE middle school study [11]. The UC contained descriptions of acute and chronic pain, chronic injuries, acute injuries, soft (muscle, tendon) injuries and hard injuries (bones, fractures), cuts, sprains and strains, fractures, concussions as well as dehydration and hypothermia. In essence, the UC constituted a biomedical sports medicine presentation. Care was taken to ensure the exact verbiage of the curricula were intact to represent UC that current 7th grade students receive in the US. The UC presentation was 34 color PowerPoint™ slides, similar in duration as PNE and with images from the current curricula.

2.3. Outcome Measures

Prior to formal outcome measures, students completed a demographic section capturing their age, gender, grade, and participation in sports. Additionally, the demographic survey also enquired about various personal aspects pertaining to pain including: (a) currently experiencing pain; (b) pain rating (numeric pain rating scale [NPRS]); (c) past experiences about pain; and (d) family with persistent pain. No personally identifiable information was captured, and pages were coded to allow matching pre-, immediate post- and 6-month follow-up surveys. Two outcome measures were used for the student to examine their knowledge of pain and fear of physical activity in the presence of pain.

2.3.1. Pain Knowledge

Pain knowledge was measured using the revised neurophysiology of pain questionnaire (rNPQ). The original NPQ is a 19-point questionnaire requesting ‘true’; ‘false’; or ‘not sure’ answers to statements, with higher scores indicating more correct answers. Since the development of the NPQ a statistical analysis of the NPQ has led to the development of a revised NPQ with 12 questions which removed ambiguous questions [35]. The revised 12-question rNPQ was used in this study. The questionnaire was adapted similar to a previous study to make it easier for students to understand, e.g., “nociception” was replaced with “danger messages” [30]. No information is currently available on what constitutes a meaningful shift in rNPQ score. The mean increase in rNPQ for PNE middle school studies using the current curriculum is 27.4% (range 23.6–31.3%) [8,11,25].

2.3.2. Fear Avoidance of Physical Activity

To assess the student’s fear of physical activity, the physical activity sub-scale of the fear-avoidance beliefs questionnaire (FABQ) was used. The FABQ is a 16-item questionnaire that was designed to quantify fear and avoidance beliefs in individuals with low back pain. The FABQ has two subscales: (1) a 4-item Physical Activity (PA) scale to measure fear avoidance beliefs about physical activity, and (2) a 7-item Work (W) scale to measure fear-avoidance beliefs about work. Given this study was administered to school students without low back pain, only the FABQ-PA was used. Each item is scored from 0 to 6 with possible scores ranging between 0 and 24 for the physical activity subscale, with higher scores representing an increase in fear-avoidance beliefs. The FABQ has demonstrated acceptable levels of reliability and validity in previous studies [36,37,38]. Presence of avoidance behavior is associated with increased risk of prolonged disability and work loss. It is proposed that FABQ-PA >14 is associated with a higher likelihood of not returning to work [39,40], and a score >15/24 is classified as a “high score” [41]. Given that the FABQ was developed for people in pain, the wording was altered to reflect their agreement to physical activity in the event they “were to experience pain”, versus “currently experiencing pain”. This methodology has been used in previous PNE middle school studies [11,25].

2.3.3. Behaviors

In line with the aims of the study, a survey was developed by the researchers to assess various behavioral changes 6 months after the initial intervention (end of the school year). The survey asked students:
  • Did they miss school in the last 6 months due to pain—yes/no; if yes, how many days?
  • Did they miss PE in the last 6 months due to pain—yes/no; if yes, how many days?
  • Did they miss recess in the last 6 months due to pain—yes/no; if yes, how many days?
  • Did they miss participation in sports in the last 6 months due to pain—yes/no; if yes, how many days?
  • Did they see a doctor in the last 6 months due to pain—yes/no; if yes, how many times?
  • Did they attend rehabilitation (physical therapy, chiropractic, occupational therapy and/or massage therapy) in the last 6 months due to pain—yes/no; if yes, how many times?
  • Did they take any pain medication in the last 6 months due to pain—yes/no?
The rNPQ and FABQ-PA were administered before, immediately after the PNE, UC and PNEBoost lecture and at 6-month follow-up (Figure 1). Six months after the initial intervention, teachers with guidance from the attending clinicians asked students to complete the behavior change survey. To avoid influencing answers to the outcome measures, any questions that arose during the completion of these forms were addressed by the attending teachers and not the presenters of the PNE or UC. Upon completion, the surveys were placed into envelopes, sealed and sent to an independent research assistant who was blinded to group allocation and who entered the data into an Excel document for analysis.

2.4. Statistical Analysis

Data were analyzed using SPSS version 24.0 (IBM SPSS Statistics for Windows, Armonk, NY, USA) and α = 0.05.

2.4.1. Aim 1: 6-Month Outcomes

To determine if there was a difference among the 3 groups (PNE, PNEBoost, and UC), non-parametric Kruskal–Wallis tests were used to analyze each of the following outcome variables—school attendance (days missed), PE attendance (days missed), participation in recess (days missed), and participation in sports (days missed). A non-parametric approach was used to decrease the influence of outliers. Since there were no outliers for pain knowledge (rNPQ score) and fear of physical activity (FABQ-PA score), those two outcomes were analyzed using one-way ANOVAs. For the 6-month outcome variables that were categorical (i.e., taking medication for pain (yes or no), seeing a doctor for pain (yes or no), and attending rehabilitation for pain (yes or no)), the proportions among the 3 groups was analyzed using chi square analyses.

2.4.2. Aim 2: Interactions

Interactions among group by demographic variables were analyzed using 3 (group: PNE, PNEBoost, and UC) X 2 (detailed next) ANOVAs for each of the 6-month outcomes. The following demographic variables were analyzed for an interaction with group: gender (boy or girl), pain at time of intervention (yes or no), chronic pain (>3 months) at time of intervention (yes or no), knowing someone with chronic pain (yes or no), fear of physical activity at time of intervention (>15 or ≤15 points on the FABQ-PA), and pain knowledge change from intervention (>2 or ≤2 points improvement on the rNPQ). To decrease the influence of outliers, outliers with z scores beyond +/− 3.0 were omitted from the analyses.

2.4.3. Aim 3: Prediction

Linear multiple regression was used to determine which of the following variables were most associated with school attendance—PE participation, recess participation, and sports participation in the ensuing 6 months: gender, duration of pain at time of intervention, knowing someone with chronic pain, NPRS at time of intervention, FABQ-PA change score, and rNPQ change score.

3. Results

3.1. Participants

During the course of the study, 668 middle-school students received one of the designated interventions and were followed for 6 months post-initial intervention (Table 1; Figure 1). In all, 16 schools in six different states (Kentucky, Minnesota, Missouri, South Dakota, Virginia and Wisconsin) participated in the study, delivered by six clinicians (five physical therapists and one occupational therapist).

3.2. Aim 1: 6-Month Outcomes

There were no differences among the 3 groups (PNE, PNEBoost, and UC) for any of the following 6 month outcome variables except for rNPQ score (p = 0.023): school attendance (p = 0.949), PE participation (p = 0.909), recess participation (p = 0.671), sports participation (p = 0.779), and FABQ-PA (p = 0.871). Descriptive statistics for these analyses are in Table 2.
Tukey post hoc analysis revealed that PNEBoost had higher scores on the rNPQ at 6 months compared to the UC group (p = 0.017). There were no other statistically significant pairwise comparisons (p > 0.310). There were no differences in the proportions of participants among the 3 groups for those seeing a doctor for pain (p = 0.585) and attending rehabilitation for pain (p = 0.972); however, there was a significant difference among the 3 groups in the proportion of participants (PNE = 32.4%; PNEBoost = 28.4%; UC = 40.9%) who took medication for pain in the 6 month period following the intervention (p = 0.024). The absolute difference in proportions between the UC and the PNEboost groups was 12.5% (UC-PNEboost); however, the relative difference in the proportions was 30.6% (UC-PNEboost/UC) (Figure 2).

3.3. Aim 2: Interactions

All p values for the interactions and main effects from the analyses below are located in Table 3.
Descriptive statistics for Aim Two can be found in the Appendix.
Statistically significant results for each analysis are detailed below.
Group by gender. There were no group by gender interactions for any of the 8 outcome variables at 6 months; however, there was a gender main effect for PE participation with girls missing more days (mean days = 1.2, 95% CI: 0.9 to 1.4) than boys (mean days = 0.5, 95% CI: 0.3 to 0.8) regardless of group membership. There was another gender main effect for FABQ with girls exhibiting more fear avoidance beliefs (FABQ = 15.1, 95% CI: 14.5 to 15.6) than boys (FABQ = 13.5, 95% CI: 13.0 to 14.0) regardless of group membership. Lastly, there was a group main effect for rNPQ with those in the PNEBoost group exhibiting higher pain knowledge (rNPQ = 5.1, 95% CI: 4.8 to 5.4) compared to those in the UC group (rNPQ = 4.5, 95% CI: 4.2 to 4.8), p = 0.025. There were no other pairwise differences for that main effect.
Group by pain at intervention. The only interaction for the group by pain at intervention analysis was for the number of rehabilitation visits for pain (p = 0.010). To break down this interaction, two one-way ANOVAs were run, one for those who did not have pain at the intervention (p = 0.544) and one for those who did (p = 0.028). Post hoc pairwise analyses revealed that the PNEBoost group had significantly fewer visits to rehabilitation (mean visits = 0.4, 95% CI: 0.2 to 0.6) compared to the PE group (mean visits = 1.2, 95% CI: 0.7 to 1.8). There were no group main effects except for the rNPQ outcome (p = 0.025) with pairwise comparisons revealing that the PNEBoost had significantly more pain knowledge at 6 months (rNPQ = 5.2, 95% CI: 4.9 to 5.5) compared to the UC group (rNPQ = 4.5, 95% CI: 4.1 to 4.9), p = 0.020. There were 3 statistically significant main effects for pain at intervention: school attendance (p = 0.005), doctor visits for pain (p = 0.013), and rNPQ score (p = 0.025). Those with pain at the intervention missed more days of school (missed days = 0.7, 95% CI: 0.5 to 0.8) than those without pain (missed days = 0.4, 95% CI: 0.3 to 0.5) regardless of group membership. Those with pain at the intervention also had more visits to the doctor for pain (visits = 1.5, 95% CI: 1.2 to 1.8) compared to those without pain (visits = 1.1, 95% CI: 0.9 to 1.3) regardless of group membership.
Group by chronic pain at intervention. The only statistically significant interaction was for school attendance (p = 0.004). To break down this interaction, two one-way ANOVAs were run, one for those who did not have chronic pain at the intervention (p = 0.583) and one for those who did (p = 0.046). Those with chronic pain in the PNE group missed less days of school (mean days = 0.6, 95% CI: 0.2 to 1.0) than the UC group (mean days = 1.6, 95% CI: 0.5 to 2.7), p = 0.037. There were no other statistically significant pairwise differences for those who had chronic pain at the intervention. The only statistically significant group main effect was for PE participation (p = 0.039). The only significant pairwise comparison demonstrated that the PNEBoost group missed more days of PE (missed days = 1.7, 95% CI: 1.3 to 2.1) compared to the PE group (missed days = 0.9, 95% CI: 0.5 to 1.3), p = 0.034, regardless of the presence of chronic pain at the intervention. There were several statistically significant main effects for chronic pain at intervention (Table 2). Those with chronic pain missed more days of PE (chronic pain = 1.8, 95% CI: 1.3 to 2.4; no chronic pain = 0.7, 95% CI: 0.5 to 0.9) and sports participation (chronic pain = 1.8, 95% CI: 1.3 to 2.3; no chronic pain = 0.9, 95% CI: 0.7 to 1.0). In addition, they had more doctor visits for pain (chronic pain = 2.3, 95% CI: 1.9 to 2.7; no chronic pain = 1.1, 95% CI: 0.9 to 1.3) and more rehabilitation visits for pain (chronic pain = 1.1, 95% CI: 0.7 to 1.5; no chronic pain = 0.5, 95% CI: 0.4 to 0.7). Lastly, those with chronic pain also had lower rNPQ scores at the end of 6 months (chronic pain = 4.6, 95% CI: 4.1 to 5.1; no chronic pain = 4.8, 95% CI: 4.7 to 5.0).
Group by knowing someone with chronic pain. Of the 8 outcomes, there were two statistically significant groups by knowing someone with chronic pain interactions, rNPQ (p = 0.010) and FABQ-PA (p < 0.001). To break down the interaction for rNPQ, two one-way ANOVAs were run, one for those who did not know someone with chronic pain (p = 0.317) and one for those who did know someone (p = 0.001). For those who did know someone, both the PNEBoost group (rNPQ = 5.2, 95% CI: 4.8 to 5.5) and the PNE group (rNPQ = 4.8, 95% CI: 4.5 to 5.2) had better pain knowledge than the UC group (rNPQ = 4.2, 95% CI: 3.8 to 4.6), p < 0.001 and p = 0.041, respectively. There were no other statistically significant pairwise differences. For those in the UC group, knowing someone meant lower pain knowledge (rNPQ = 4.2, 95% CI: 3.8 to 4.6) than those who did not know someone (rNPQ = 5.6, 95% CI: 4.6 to 6.5), p = 0.009. To break down the interaction for FABQ-PA, two one-way ANOVAs were also run, one for those who did not know someone with chronic pain (p = 0.009) and one for those who did know someone (p = 0.269). For those not knowing someone with chronic pain, those in the UC group had more fear avoidance beliefs (FABQ-PA = 15.6, 95% CI: 13.9 to 17.4) than the PNE group (FABQ-PA = 12.1, 95% CI: 10.7 to 13.5), p = 0.002. There were no other pairwise differences. Knowing someone with chronic pain had a statistically significant effect on missed days of school (knowing someone = 0.6, 95% CI: 0.5 to 0.7; not knowing someone = 0.3, 95% CI: 0.1 to 0.4), missed days of PE participation (knowing someone = 1.0, 95% CI: 0.8 to 1.2; not knowing someone = 0.5, 95% CI: 0.2 to 0.9), and missed days of sports participation (knowing someone = 1.1, 95% CI: 0.9 to 1.3; not knowing someone = 0.6, 95% CI: 0.3 to 0.9). Knowing someone with chronic pain also meant more visits to the doctors for pain (knowing someone = 1.4, 95% CI: 1.2 to 1.6; not knowing someone = 0.9, 95% CI: 0.6 to 1.2) and more visits to rehabilitation for pain (knowing someone = 0.7, 95% CI: 0.6 to 0.9; not knowing someone = 0.4, 95% CI: 0.1 to 0.7).
Group by fear of physical activity at time of intervention. There were no statistically significant interactions between group and fear of physical activity at time of intervention on any of the 8 outcome variables. However, there was a statistically significant group main effect for rNPQ with the PNEBoost group having significantly better pain knowledge (rNPQ = 5.1, 95% CI: 4.8 to 5.4) compared to the UC group (rNPQ = 4.5, 95% CI: 4.1 to 4.8), p = 0.013. Those with high fear of physical activity missed more days of PE (mean days = 1.3, 95% CI: 1.0 to 1.6) than those with low fear of physical activity (mean days = 0.6, 95% CI: 0.4 to 0.9). Those with high fear of physical activity also missed more days of sports participation (mean days = 1.4, 95% CI: 1.1 to 1.6) compared to those with low fear of physical activity (mean days = 0.8, 95% CI: 0.6 to 1.0). Those with high fear of physical activity at the intervention also had more fear of physical activity at the 6-month point (FABQ-PA = 16.3, 95% CI: 15.7 to 16.9) than those with low fear of physical activity (FABQ-PA = 13.1, 95% CI: 12.7 to 13.6).
Group by pain knowledge change from intervention. There were two statistically significant interactions between group and pain knowledge change for school attendance (p = 0.023) and rNPQ (p = 0.049). To break down the school attendance interaction, two one-way ANOVAs were run, one for those whose pain knowledge improved (p = 0.122) and one for those whose pain knowledge did not (p = 0.167). Since neither were statistically significant, 3 t-tests for the comparison of those who improved and those who did not for each of the three intervention groups were conducted and revealed only one significant difference for the PNEBoost group. Specifically, those participants who improved due to the PNEBoost intervention missed less days of school (mean days = 0.4, 95% CI: 0.2 to 0.6) compared to students who did not improve (mean days = 0.8, 95% CI: 0.4 to 1.1), p = 0.033. For the rNPQ interaction, two one-way ANOVAs were also run, one for those one for those whose pain knowledge improved (p = 0.027) and one for those whose pain knowledge did not (p = 0.137). For those whose pain knowledge improved, the PNEBoost group had higher rNPQ scores (mean = 5.4, 95% CI: 5.0 to 5.7) compared to the PNE group (mean = 4.6, 95% CI: 4.3 to 5.1), p = 0.025. There were no other pairwise differences. There was a statistically significant main effect for rNPQ improvement with those who improved having fewer missed recesses (mean days = 0.5, 95% CI: 0.4 to 0.6) than those whose pain knowledge did not improve (mean days = 0.2, 95% CI: 0.1 to 0.4), p = 0.004, regardless of group membership.

3.4. Aim 3: Prediction

Detailed results for each of the regression analyses are in Table 4. Summary of each regression analysis are broken down below by dependent variable.
School attendance. Three variables (duration, rNPQ improvement, and knowing someone with chronic pain) were associated with school attendance (p < 0.001) (Table 5); however, the variance explained was only 6.4% (R2 = 0.64). These results suggest that longer duration of pain at the intervention, knowing someone with chronic pain, and improved score on pain knowledge before and after the intervention were associated with more days missed from school in the 6 months following the interventions.
PE participation. Three variables (gender, duration of pain, and FABQ change) were significantly associated with PE participation (p < 0.001) and explained 6.8% of the variance in PE participation (Table 5). These results suggest that being a girl, having longer duration of pain, and having more fear avoidance beliefs were associated with more missed days from PE at school in the subsequent 6 months from the interventions.
Sports participation. Only one variable, duration of pain, was associated with sports participation (p < 0.001) (Table 5). This variable explained 5.9% of the variance in sports participation and suggests that the longer the duration of pain at the intervention the more likely one would miss participating in sports in the subsequent 6 months.
Recess participation. Two variables, duration and rNPQ improvement, were both significantly associated with recess participation (p = 0.003) (Table 5); however, these variables only explained 2.7% of the variance in recess participation. Again, the longer the duration of pain and more knowledge improvement were both associated with more missed recesses in the 6 months after the intervention.

4. Discussion

This is the first public health trial using PNE in middle schools with long-term follow-up to assess behavior change. A single PNE session with subsequent booster sessions (PNEBoost) results in significant less use of pain medication during the school year for middle school students. Additionally, taking demographic variables into consideration, PNEBoost yielded superior results in regard to school attendance and attending fewer rehabilitation visits for pain, compared to PNE and UC. Students having experienced pain more than three months were significantly more likely to miss school, recess, PE and sports participation six-months later.
The biggest positive finding of the study is that the students in the PNEBoost group used significantly less pain medication in the subsequent school year compared to the UC group. This result solidifies the argument that upstream efforts for downstream effects, especially for medication use, is an area that needs more attention [8]. Even though the type of medication was not studied and not specific to opioids, early exposure to pain medication, including non-opioids, has been cited as a major concern for later use, misuse and addiction to opioid pain medication [42,43,44,45]. It is also imperative to understand that non-opioid medication, i.e., anti-inflammatory medication, has significant risk by itself, thus highlighting again the positive result from this study [46,47]. From a behavioral perspective, the type of medication use is also not as important as the behavior tying use of pain medication to a pain experience. Over time, habitual, repetitive use of pain medication (regardless the type) when someone experiences pain, may develop into a habit, which may have devastating consequences long-term. In this study, the PNEBoost students used less pain medication and even though its true long-term effect (years later) was not studied, it warrants additional and future research with true long-term follow-up.
In addition, of note in this study is the fact that one-third of the students at the time of the intervention were experiencing pain and one-in-seven had experienced pain more than 3 months. Pain is not isolated to adults, but is common in middle school students and may drive their choice of treatments, including use of pain medication [3,4,5]. An interesting observation is that many behaviors related to pain in adolescents are often driven by parents and caregivers [48,49]. In this study, there was no difference in general between the groups for school attendance, PE attendance, recess attendance, sports participation, doctor’s visits and rehabilitation visits, but there was for use of pain medication. It could be argued that parents are intricately involved with decisions and actions associated with attending school, sports and medical appointments, while teachers may guide PE and recess participation, which may explain why no difference was observed. The question then arises why pain medication use was different, especially since the PNEBoost and UC group had similar exposure to family members with chronic pain. Future studies exploring the influence of parents and caregivers in decision-making of pain medication-use in adolescents are needed to further examine this phenomenon.
The students attending the various sessions presented with various demographic variables that may have impacted, positively and negatively, their learning experience for the three educational approaches. These included gender, currently experiencing pain, having experienced pain more than three months themselves, living with/knowing someone with chronic pain, high levels of fear of physical activity and pain knowledge. These variables underscore individual human nature, including the individual pain experience that is unique to every human being [18,50]. In general, the PNEBoost group responded more favorably to the educational session when taking these variables into consideration. For example, students who attended the PNEBoost session while experiencing pain had significantly fewer visits to rehabilitation in the next six months compared to the PNE group. Students who had experienced pain for more than three months that attended the PNEBoost session missed less school than similar students in the UC group. The results also show that PNEBoost students whose pain knowledge improved missed less days at school than PNEBoost students whose pain knowledge did not improve. These results are important, as they imply that improved pain knowledge may be a key element to drive behavior change, concurring with preliminary work done in this area [8,11,25].
An intriguing aspect of this study is that in all of the results, PNEBoost seem to be superior to a single-stand-alone PNE session. This finding is in line with current learning theory of repeat exposure and booster sessions to solidify key messages during educational exposure [26,51]. Behavior change is challenging and repeat exposure is a key element [26]. These results would imply that a curriculum with repeat procedures, interactive tasks, teaching guides, etc., are needed to truly impact change. In clinical practice treating patients with chronic pain, it is uncommon to have immediate, significant changes after one treatment session using PNE [52,53,54]. This sample was not a pain-free population, but resembled current statistics showing children in school have high rates of pain, experience pain for quite some time, and live with/around people with pain. It would thus make sense that, just like in clinical practice, a more robust program (PNEBoost) is needed to change behavior than a single-session PNE. Even more intriguing is the notion of building a pain program for children in school suffering from pain, again to potentially influence downstream choices into adulthood [8].
The main goals of this study were to examine the efficacy of three different educational models. The results, however, also yielded valuable “pain” insight into the life of a middle school student, which can/should be used to build future programs to continue this line of study. Past experiences powerfully influence future experiences and, in this study, having experienced pain more than 3 months powerfully predicted school attendance, PE attendance, recess attendance and sports participation [24,55]. Various studies have shown that school, PE, recess and sports participation/attendance have significant influences on various outcomes including drug use, teen-pregnancy, substance abuse, etc., down the road [7,56]. The results of this study show that various factors such as having experienced pain, pain knowledge, knowing someone in pain and fear-avoidance predict school, PE, recess and sports participation/attendance. These factors, in turn, are positively influenced by PNE and PNEBoost, again substantiating the fact that a dedicated pain program/curriculum must be explored in schools. This concurs with the fact that students having experienced chronic pain had lower rNPQ scores at the end of the six-month follow-up, compared to students having not experienced pain more than three months. Parents and caregivers powerfully influence decisions made by children, including health-related choices [5,48,49]. In this study, three out of four children knew/lived with/around someone with chronic pain, which may instill certain care-seeking behaviors related to pain, including medication use.

Limitations

This study contains various limitations. The sampling was not a true randomization, but rather a convenience randomization of groups of students versus individual students. This results in a heterogenous sample between the three groups, i.e., UC group experienced less pain at the time of the intervention than PNE and PNEBoost. The duration of each intervention was the same at the start of the study (30 min) but the PNEBoost group did receive two additional 10-min video presentations. These booster sessions fit with current educational studies demonstrating that repeating education provides some advantages in knowledge recall and retention. The results only pertain to six-month follow-up, with no indication how these results transfer to true long-term follow-up, i.e., years later. The six-month behavioral changes were subjective data which are influenced by bias, ability to recall information, etc.

5. Conclusions

A PNE session, followed by booster sessions yield more positive behavioral results in middle school children at six-month follow-up than a single PNE session or current school curriculums on pain, including significant reduction in pain medication use. Early pain experiences powerfully influence school, PE, recess and sports attendance/participation, which can be positively influenced by a PNEBoost program.

Author Contributions

Concept, A.L., J.P., K.Z., P.B. and C.L.; data collection, R.L., P.B., J.D., C.D., A.R. and K.C.; data entry, A.L., J.P., C.L. and K.Z.; data analysis, A.L., K.Z. and M.L.; writing, A.L., E.J.P., M.R.L. and K.Z.; editing and review—all authors. All authors have read and agreed to the published version of the manuscript.

Funding

No external funding was obtained for this study.

Acknowledgments

We thank the various schools; school administrators; principles; teachers and students for helping us with this study.

Conflicts of Interest

Authors A.L., K.Z., C.L. and E.J.P. publish books on pain for patients and healthcare professionals. These conflicts do not impact the findings or submission of this paper.

Appendix A

Table A1. Descriptive statistics for Aim 2.
Table A1. Descriptive statistics for Aim 2.
School AttendancePE Participation
GroupGenderMeanSDNGroupGenderMeanSDN
PNEBoy0.410.82112PNEBoy0.561.70111
Girl0.581.04104Girl0.881.96104
UCBoy0.480.98100UCBoy0.440.9997
Girl0.591.2493Girl0.972.4694
PNEBoostBoy0.471.11103PNEBoostBoy0.631.89105
Girl0.591.26106Girl1.673.91111
Sports participationRecess participation
GroupGenderMeanSDNGroupGenderMeanSDN
PNEBoy1.111.90112PNEBoy0.451.28111
Girl0.761.44103Girl0.381.14101
UCBoy1.092.1095UCBoy0.371.1794
Girl1.132.4690Girl0.191.0993
PNEBoostBoy0.611.28102PNEBoostBoy0.270.85103
Girl1.253.02107Girl0.270.68110
Visits to the doctor for painVisits to rehabilitation for pain
GroupGenderMeanSDNGroupGenderMeanSDN
PNEBoy1.131.85103PNEBoy0.581.82111
Girl1.432.03102Girl0.092.13102
UCBoy1.181.8289UCBoy0.591.7896
Girl1.101.6087Girl0.601.6693
PNEBoostBoy1.272.2693PNEBoostBoy0.311.05101
Girl1.451.84102Girl0.812.00113
rNPQFABQ
GroupGenderMeanSDNGroupGenderMeanSDN
PNEBoy5.062.36115PNEBoy13.505.27115
Girl4.552.20105Girl14.604.91105
UCBoy4.542.3999UCBoy13.425.59100
Girl4.512.6595Girl15.684.6096
PNEBoostBoy4.962.11109PNEBoostBoy13.554.52109
Girl5.272.06116Girl14.904.24116
School attendancePE participation
GroupGenderMeanSDNGroupGenderMeanSDN
PNENo0.390.84131PNENo0.611.96131
Yes0.651.0683Yes0.891.6382
UCNo0.511.12141UCNo0.491.08137
Yes0.601.1151Yes1.263.0653
PNEBoostNo0.351.00119PNEBoostNo1.153.48125
Yes0.781.3690Yes1.202.6191
Sports participationRecess participation
GroupGenderMeanSDNGroupGenderMeanSDN
PNENo0.781.60131PNENo0.321.07129
Yes1.111.7482Yes0.581.4281
UCNo0.962.19133UCNo0.271.14135
Yes1.532.4751Yes0.271.1051
PNEBoostNo0.952.65120PNEBoostNo0.230.70120
Yes0.911.9089Yes0.300.8393
Visits to the doctor for painVisits to rehabilitation for pain
GroupGenderMeanSDNGroupGenderMeanSDN
PNENo0.911.57124PNENo0.421.45129
Yes1.812.3279Yes1.242.5582
UCNo1.091.64125UCNo0.541.39136
Yes1.201.8550Yes0.752.3952
PNEBoostNo1.252.14110PNEBoostNo0.631.82123
Yes1.501.9484Yes0.411.1191
rNPQFABQ
GroupGenderMeanSDNGroupGenderMeanSDN
PNENo4.792.32134PNENo13.935.17134
Yes4.902.2884Yes14.145.1184
UCNo4.562.62140UCNo14.455.57142
Yes4.432.2353Yes14.744.3553
PNEBoostNo4.952.19131PNEBoostNo14.094.52131
Yes5.372.0094Yes14.394.2994
School attendancePE participation
GroupChronic painMeanSDNGroupChronic painMeanSDN
PNENo0.430.85180PNENo0.621.69180
Yes0.811.2436Yes1.202.4535
UCNo0.430.93177UCNo0.591.53174
Yes1.632.0916Yes1.823.8817
PNEBoostNo0.531.19177PNEBoostNo0.922.58186
Yes0.581.1136Yes2.474.9734
Sports participationRecess participation
GroupChronic painMeanSDNGroupChronic painMeanSDN
PNENo0.831.56178PNENo0.371.22177
Yes1.492.2137Yes0.661.1935
UCNo1.012.20170UCNo0.271.09172
Yes2.332.8015Yes0.471.5515
PNEBoostNo0.812.22181PNEBoostNo0.280.70180
Yes1.592.8632Yes0.271.0537
TotalNo0.301.02529
Yes0.461.2087
Recess participationVisits to the doctor for pain
GroupChronic painMeanSDNGroupChronic painMeanSDN
PNENo0.371.22177PNENo1.051.65168
Yes0.661.1935Yes2.322.7037
UCNo0.271.09172UCNo1.001.58160
Yes0.471.5515Yes2.562.2816
PNEBoostNo0.280.70180PNEBoostNo1.231.95163
Yes0.271.0537Yes1.972.3335
TotalNo0.301.02529
Yes0.461.2087
Visits to rehabilitation for painrNPQ
GroupChronic painMeanSDNGroupChronic painMeanSDN
PNENo0.541.75177PNENo4.822.30182
Yes1.692.6836Yes4.822.3438
UCNo0.581.75173UCNo4.602.51177
Yes0.811.3816Yes3.712.4217
PNEBoostNo0.531.55183PNEBoostNo5.132.13191
Yes0.741.9635Yes5.162.0138
FABQSchool attendance
GroupChronic painMeanSDNGroupKnow someoneMeanSDN
PNENo14.095.11182PNENo0.360.6968
Yes13.715.2238Yes0.541.02147
UCNo14.665.30179UCNo0.210.4546
Yes13.064.4917Yes0.651.24144
PNEBoostNo14.484.28191PNEBoostNo0.230.5948
Yes13.054.8338Yes0.621.29161
PE participationSports participation
GroupKnow someoneMeanSDNGroupKnow someoneMeanSDN
PNENo0.310.9367PNENo0.611.2367
Yes0.892.17147Yes1.051.82147
UCNo0.340.8046UCNo0.491.2545
Yes0.842.12142Yes1.292.47138
PNEBoostNo0.972.6350PNEBoostNo0.672.1649
Yes1.223.27166Yes1.032.41160
Total1.163.13216
Recess participationVisits to the doctor for pain
GroupKnow someoneMeanSDNGroupKnow someoneMeanSDN
PNENo0.541.3567PNENo0.721.2965
Yes0.361.15144Yes1.502.10139
UCNo0.220.9446UCNo0.861.3942
Yes0.311.20139Yes1.191.78132
PNEBoostNo0.100.3749PNEBoostNo1.041.9647
Yes0.320.84164Yes1.412.05147
Visits to rehabilitation for painrNPQ
GroupKnow someoneMeanSDNGroupKnow someoneMeanSDN
PNENo0.240.7566PNENo4.822.5368
Yes0.942.30146Yes4.832.19151
UCNo0.220.8845UCNo5.563.1145
Yes0.731.91142Yes4.212.24146
PNEBoostNo0.741.8950PNEBoostNo5.041.8351
Yes0.521.55165Yes5.152.19174
FABQSchool attendance
GroupKnow someoneMeanSDNGroupFABQ groupMeanSDN
PNENo12.075.8568PNENo0.480.9370
Yes14.994.40151Yes0.510.95141
UCNo15.635.8746UCNo0.571.2171
Yes14.214.97147Yes0.501.07117
PNEBoostNo13.964.3951PNEBoostNo0.601.2991
Yes14.304.37174Yes0.481.09121
PE participationSports participation
GroupFABQ groupMeanSDNGroupFABQ groupMeanSDN
PNENo1.282.7769PNENo1.372.1067
Yes0.461.10142Yes0.731.45143
UCNo0.852.1771UCNo1.352.7066
Yes0.641.72115Yes1.032.04114
PNEBoostNo1.664.0692PNEBoostNo1.332.9690
Yes0.792.13127Yes0.631.70122
Recess participationVisits to the doctor for pain
GroupFABQ groupMeanSDNGroupFABQ groupMeanSDN
PNENo0.431.4065PNENo1.452.0565
Yes0.421.14142Yes1.211.91135
UCNo0.391.5167UCNo1.151.7164
Yes0.230.87116Yes1.151.74107
PNEBoostNo0.451.0292PNEBoostNo1.482.2081
Yes0.140.45124Yes1.261.93116
Visits to rehabilitation for painrNPQ
GroupFABQ groupMeanSDNGroupFABQ groupMeanSDN
PNENo0.751.9868PNENo4.702.2271
Yes0.711.98140Yes4.812.34144
UCNo0.701.9366UCNo4.392.4371
Yes0.501.48118Yes4.562.49118
PNEBoostNo0.511.7791PNEBoostNo5.142.0797
Yes0.611.52126Yes5.132.14131
FABQSchool attendance
GroupFABQ groupMeanSDNGrouprNPQ improvementMeanSDN
PNENo16.874.5071PNENo0.470.96136
Yes12.724.88144Yes0.530.8980
UCNo16.654.6872UCNo0.791.4138
Yes13.325.21119Yes0.471.02155
PNEBoostNo15.453.9197PNEBoostNo0.400.96136
Yes13.334.54131Yes0.761.4776
PE participationSports participation
GrouprNPQ improvementMeanSDNGrouprNPQ improvementMeanSDN
PNENo0.631.91136PNENo0.851.51135
Yes0.871.7179Yes1.091.9880
UCNo0.872.5238UCNo1.532.6036
Yes0.661.69153Yes1.012.19149
PNEBoostNo1.113.07144PNEBoostNo0.992.43137
Yes1.243.2175Yes0.812.1875
Recess participationVisits to the doctor for pain
GrouprNPQ improvementMeanSDNGrouprNPQ improvementMeanSDN
PNENo0.260.87135PNENo1.171.84130
Yes0.691.6277Yes1.472.1175
UCNo0.260.6938UCNo1.271.9933
Yes0.291.22149Yes1.111.65143
PNEBoostNo0.140.47140PNEBoostNo1.101.67129
Yes0.501.0876Yes1.822.5668
Visits to rehabilitation for painrNPQ
GrouprNPQ improvementMeanSDNGrouprNPQ improvementMeanSDN
PNENo0.601.63134PNENo4.662.39138
Yes0.962.4579Yes5.092.1382
UCNo0.731.4737UCNo4.762.5738
Yes0.571.78152Yes4.462.50156
PNEBoostNo0.721.92145PNEBoostNo5.372.14147
Yes0.260.6572Yes4.701.9981
FABQ
GrouprNPQ improvementMeanSDN
PNENo13.935.02138
Yes14.185.3282
UCNo14.265.3639
Yes14.595.23157
PNEBoostNo14.374.05147
Yes13.984.9881

References

  1. Medicine, Institute of Relieving Pain in America: A Blueprint for Transforming Prevention, Care, Education, and Research; National Academies Press: Washington, DC, USA, 2011. [CrossRef]
  2. Nahin, R.L. Estimates of pain prevalence and severity in adults: United States, 2012. J. Pain 2015, 16, 769–780. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Eccleston, C.; Malleson, P.N.; Clinch, J.; Connell, H.; Sourbut, C. Chronic pain in adolescents: Evaluation of a programme of interdisciplinary cognitive behaviour therapy. Arch. Dis. Child. 2003, 88, 881–885. [Google Scholar] [CrossRef] [Green Version]
  4. Eccleston, C.; Malleson, P. Managing chronic pain in children and adolescents. We need to address the embarrassing lack of data for this common problem. BMJ 2003, 326, 1408–1409. [Google Scholar] [CrossRef] [PubMed]
  5. Perquin, C.W.; Hazebroek-Kampschreur, A.A.; Hunfeld, J.A.; Bohnen, A.M.; van Suijlekom-Smit, L.W.; Passchier, J.; van der Wouden, J.C. Pain in children and adolescents: A common experience. Pain 2000, 87, 51–58. [Google Scholar] [CrossRef]
  6. Paulozzi, L.J. Prescription drug overdoses: A review. J. Saf. Res. 2012, 43, 283–289. [Google Scholar] [CrossRef]
  7. Manchikanti, L.; Fellows, B.; Ailinani, H.; Pampati, V. Therapeutic use, abuse, and nonmedical use of opioids: A ten-year perspective. Pain Physician 2010, 13, 401–435. [Google Scholar]
  8. Louw, A.; Podalak, J.; Zimney, K.; Schmidt, S.; Puentedura, E.J. Can pain beliefs change in middle school students? A study of the effectiveness of pain neuroscience education. Physiother. Theory Pract. 2018, 34, 542–550. [Google Scholar] [CrossRef]
  9. Hauser, W.; Petzke, F.; Radbruch, L.; Tolle, T.R. The opioid epidemic and the long-term opioid therapy for chronic noncancer pain revisited: A transatlantic perspective. Pain Manag. 2016, 6, 249–263. [Google Scholar] [CrossRef]
  10. Birke, H.; Kurita, G.P.; Sjogren, P.; Hojsted, J.; Simonsen, M.K.; Juel, K.; Ekholm, O. Chronic non-cancer pain and the epidemic prescription of opioids in the Danish population: Trends from 2000 to 2013. Acta Anaesthesiol. Scand. 2016, 60, 623–633. [Google Scholar] [CrossRef]
  11. Louw, A.; Podolak, J.; Benz, P.; Landrus, R.; DeLorenzo, J.; Davis, C.; Rogers, A.; Cooper, K.; Kruse, A.; Kruse, B.; et al. A Randomized controlled trial of different single pain education sessions in middle school students: Immediate effects. J. Physiother. Pain Assoc. 2019, 47, 14–24. [Google Scholar]
  12. Louw, A.; Zimney, K.; Puentedura, E.J.; Diener, I. The efficacy of pain neuroscience education on musculoskeletal pain: A systematic review of the literature. Physiother. Theory Pract. 2016, 32, 332–355. [Google Scholar] [CrossRef] [PubMed]
  13. Moseley, G.L.; Hodges, P.W.; Nicholas, M.K. A randomized controlled trial of intensive neurophysiology education in chronic low back pain. Clin. J. Pain 2004, 20, 324–330. [Google Scholar] [CrossRef] [PubMed]
  14. Moseley, L. Combined physiotherapy and education is efficacious for chronic low back pain. Aust. J. Physiother. 2002, 48, 297–302. [Google Scholar] [CrossRef] [Green Version]
  15. Meeus, M.; Nijs, J.; Van Oosterwijck, J.; Van Alsenoy, V.; Truijen, S. Pain Physiology Education Improves Pain Beliefs in Patients with Chronic Fatigue Syndrome Compared With Pacing and Self-Management Education: A Double-Blind Randomized Controlled Trial. Arch. Phys. Med. Rehabil. 2010, 91, 1153–1159. [Google Scholar] [CrossRef] [PubMed]
  16. Louw, A.; Diener, I.; Butler, D.S.; Puentedura, E.J. The effect of neuroscience education on pain, disability, anxiety, and stress in chronic musculoskeletal pain. Arch. Phys. Med. Rehabil. 2011, 92, 2041–2056. [Google Scholar] [CrossRef] [PubMed]
  17. Nijs, J.; Roussel, N.; Paul van Wilgen, C.; Koke, A.; Smeets, R. Thinking beyond muscles and joints: Therapists’ and patients’ attitudes and beliefs regarding chronic musculoskeletal pain are key to applying effective treatment. Man Ther. 2012, 18, 96–102. [Google Scholar] [CrossRef]
  18. Moseley, G.L. Reconceptualising pain acording to modern pain sciences. Phys. Ther. Rev. 2007, 12, 169–178. [Google Scholar] [CrossRef]
  19. Gifford, L.S. Pain, the tissues and the nervous system. Physiotherapy 1998, 84, 27–33. [Google Scholar] [CrossRef]
  20. Haldeman, S. Presidential address, North American Spine Society: Failure of the pathology model to predict back pain. Spine 1990, 15, 718–724. [Google Scholar] [CrossRef]
  21. Spielmann, A.L.; Forster, B.B.; Kokan, P.; Hawkins, R.H.; Janzen, D.L. Shoulder after rotator cuff repair: MR imaging findings in asymptomatic individuals—Initial experience. Radiology 1999, 213, 705–708. [Google Scholar] [CrossRef]
  22. Kjaer, P.; Leboeuf-Yde, C.; Korsholm, L.; Sorensen, J.S.; Bendix, T. Magnetic resonance imaging and low back pain in adults: A diagnostic imaging study of 40-year-old men and women. Spine 2005, 30, 1173–1180. [Google Scholar] [CrossRef] [PubMed]
  23. Linton, S.J.; Buer, N.; Vlaeyen, J.; Hellsing, A.-L. Are fear-avoidance beliefs related to the inception of an episode of back pain? A prospective study. Psychol. Health 2000, 14, 1051–1059. [Google Scholar] [CrossRef] [PubMed]
  24. Vlaeyen, J.W.S.; Linton, S.J. Fear-avoidance and its consequences in chronic musculoskeletal pain: A state of the art. Pain 2000, 85, 317–322. [Google Scholar] [CrossRef] [Green Version]
  25. Podolak, J.; Louw, A.; Benz, P.; Kruse, A.; Louw, C.; Zimney, K. A Randomized Trial of Live versus Video Delivery of Pain Neuroscience Education for Middle School Children. Psychol. Disord. Distress 2019, 2, 1–10. [Google Scholar]
  26. Buchbinder, R.; Jolley, D. Population based intervention to change back pain beliefs: Three year follow up population survey. Br. Med. J. 2004, 328, 321. [Google Scholar] [CrossRef] [Green Version]
  27. Raherison, C.; Marjary, A.; Valpromy, B.; Prevot, S.; Fossoux, H.; Taytard, A. Evaluation of smoking cessation success in adults. Respir. Med. 2005, 99, 1303–1310. [Google Scholar] [CrossRef] [Green Version]
  28. Aguiar, M.T.-B.F.; Felizardo, M.; Macedo, R.; Caeiro, F.; Sotto-Mayor, R.; Bugalho de Almeida, A. Four years’ follow up at a smoking cessation clinic. Rev. Port. Pneumol. 2009, 15, 179–197. [Google Scholar] [CrossRef] [Green Version]
  29. Oztuna, F.; Can, G.; Ozlu, T. Five-year outcomes for a smoking cessation clinic. Respirology 2007, 12, 911–915. [Google Scholar] [CrossRef]
  30. Moseley, G.L. Unravelling the barriers to reconceptualisation of the problem in chronic pain: The actual and perceived ability of patients and health professionals to understand the neurophysiology. J. Pain 2003, 4, 184–189. [Google Scholar] [CrossRef]
  31. Louw, A.; Butler, D.S.; Diener, I.; Puentedura, E.J. Development of a preoperative neuroscience educational program for patients with lumbar radiculopathy. Am. J. Phys. Med. Rehabil. 2013, 92, 446–452. [Google Scholar] [CrossRef] [Green Version]
  32. Louw, A. Therapeutic neuroscience education via e-mail: A case report. Physiother. Theory Pract. 2014, 30, 588–596. [Google Scholar] [CrossRef] [PubMed]
  33. Zimney, K.; Louw, A.; Puentedura, E.J. Use of Therapeutic Neuroscience Education to address psychosocial factors associated with acute low back pain: A case report. Physiother. Theory Pract. 2014, 30, 202–209. [Google Scholar] [CrossRef] [PubMed]
  34. Louw, A. Why Do I Hurt? A Neuroscience Approach to Pain; OPTP: Minneapolis, MN, USA, 2013. [Google Scholar]
  35. Catley, M.J.; O’Connell, N.E.; Moseley, G.L. How good is the neurophysiology of pain questionnaire? A Rasch analysis of psychometric properties. J. Pain 2013, 14, 818–827. [Google Scholar] [CrossRef] [PubMed]
  36. Cleland, J.A.; Fritz, J.M.; Childs, J.D. Psychometric properties of the Fear-Avoidance Beliefs Questionnaire and Tampa Scale of Kinesiophobia in patients with neck pain. Am. J. Phys. Med. Rehabil. 2008, 87, 109–117. [Google Scholar] [CrossRef] [PubMed]
  37. Grotle, M.; Vollestad, N.K.; Brox, J.I. Clinical course and impact of fear-avoidance beliefs in low back pain: Prospective cohort study of acute and chronic low back pain: II. Spine 2006, 31, 1038–1046. [Google Scholar] [CrossRef]
  38. Poiraudeau, S.; Rannou, F.; Baron, G.; Le Henanff, A.; Coudeyre, E.; Rozenberg, S.; Huas, D.; Martineau, C.; Jolivet-Landreau, I.; Garcia-Mace, J.; et al. Fear-avoidance beliefs about back pain in patients with subacute low back pain. Pain 2006, 124, 305–311. [Google Scholar] [CrossRef]
  39. Fritz, J.M.; George, S.Z. Identifying psychosocial variables in patients with acute work-related low back pain: The importance of fear-avoidance beliefs. Phys. Ther. 2002, 82, 973–983. [Google Scholar] [CrossRef] [Green Version]
  40. Burton, A.K.; Waddell, G.; Tillotson, K.M.; Summerton, N. Information and advice to patients with back pain can have a positive effect. A randomized controlled trial of a novel educational booklet in primary care. Spine 1999, 24, 2484–2491. [Google Scholar] [CrossRef]
  41. Crombez, G.; Vlaeyen, J.W.; Heuts, P.H.; Lysens, R. Pain-related fear is more disabling than pain itself: Evidence on the role of pain-related fear in chronic back pain disability. Pain 1999, 80, 329–339. [Google Scholar] [CrossRef]
  42. Zheng, P.; Kao, M.C.; Karayannis, N.V.; Smuck, M. Stagnant Physical Therapy Referral Rates Alongside Rising Opioid Prescription Rates in Patients with Low Back Pain in the United States 1997–2010. Spine 2017, 42, 670–674. [Google Scholar] [CrossRef]
  43. Jeffrey Kao, M.C.; Minh, L.C.; Huang, G.Y.; Mitra, R.; Smuck, M. Trends in ambulatory physician opioid prescription in the United States, 1997–2009. PMR J. Inj. Funct. Rehabil. 2014, 6, 575–582. [Google Scholar] [CrossRef] [PubMed]
  44. Seyedzadeh Sabounchi, S.; Cosler, L.E.; Atav, A.S. Opioid prescribing and misuse among dental patients in the US: A literature-based review. Quintessence Int. 2020, 51, 64–76. [Google Scholar]
  45. Thornhill, M.H.; Suda, K.J.; Durkin, M.J.; Lockhart, P.B. Is it time US dentistry ended its opioid dependence? J. Am. Dent. Assoc. 2019, 150, 883–889. [Google Scholar] [CrossRef] [PubMed]
  46. Boissonnault, W.G.; Meek, P.D. Risk factors for anti-inflammatory-drug- or aspirin-induced gastrointestinal complications in individuals receiving outpatient physical therapy services. J. Orthop. Sports Phys. Ther. 2002, 32, 510–517. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Luo, X.; Pietrobon, R.; Curtis, L.H.; Hey, L.A. Prescription of nonsteroidal anti-inflammatory drugs and muscle relaxants for back pain in the United States. Spine 2004, 29, E531–E537. [Google Scholar] [CrossRef] [PubMed]
  48. Vetter, T.R.; Bridgewater, C.L.; Ascherman, L.I.; Madan-Swain, A.; McGwin, G.L., Jr. Patient versus parental perceptions about pain and disability in children and adolescents with a variety of chronic pain conditions. Pain Res. Manag. 2014, 19, 7–14. [Google Scholar] [CrossRef]
  49. Hoftun, G.B.; Romundstad, P.R.; Rygg, M. Association of parental chronic pain with chronic pain in the adolescent and young adult: Family linkage data from the HUNT Study. JAMA Pediatr. 2013, 167, 61–69. [Google Scholar] [CrossRef] [Green Version]
  50. Melzack, R. Pain and the neuromatrix in the brain. J. Dent. Educ. 2001, 65, 1378–1382. [Google Scholar] [CrossRef]
  51. Gainforth, H.L.; Berry, T.; Faulkner, G.; Rhodes, R.E.; Spence, J.C.; Tremblay, M.S.; Latimer-Cheung, A.E. Evaluating the uptake of Canada’s new physical activity and sedentary behavior guidelines on service organizations’ websites. Transl. Behav. Med. 2013, 3, 172–179. [Google Scholar] [CrossRef] [Green Version]
  52. Malfliet, A.; Kregel, J.; Coppieters, I.; De Pauw, R.; Meeus, M.; Roussel, N.; Cagnie, B.; Danneels, L.; Nijs, J. Effect of Pain Neuroscience Education Combined With Cognition-Targeted Motor Control Training on Chronic Spinal Pain: A Randomized Clinical Trial. JAMA Neurol. 2018, 75, 808–817. [Google Scholar] [CrossRef]
  53. Wood, L.; Hendrick, P.A. A systematic review and meta-analysis of pain neuroscience education for chronic low back pain: Short-and long-term outcomes of pain and disability. Eur. J. Pain 2019, 23, 234–249. [Google Scholar] [CrossRef] [PubMed]
  54. Watson, J.A.; Ryan, C.G.; Cooper, L.; Ellington, D.; Whittle, R.; Lavender, M.; Dixon, J.; Atkinson, G.; Cooper, K.; Martin, D.J. Pain Neuroscience Education for Adults With Chronic Musculoskeletal Pain: A Mixed-Methods Systematic Review and Meta-Analysis. J. Pain 2019, 20, 1140e1–1140e22. [Google Scholar] [CrossRef] [PubMed]
  55. Staud, R.; Robinson, M.E.; Price, D.D. Do past pain events systematically impact pain ratings of healthy subjects or fibromyalgia patients? J. Pain 2010, 11, 142–148. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  56. Henry, K.L.; Thornberry, T.P. Truancy and escalation of substance use during adolescence. J. Stud. Alcohol. Drugs 2010, 71, 115–124. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. Study Flow Diagram.
Figure 1. Study Flow Diagram.
Ijerph 17 04505 g001
Figure 2. Self-reported use of pain medication in the 6-month period following initial intervention.
Figure 2. Self-reported use of pain medication in the 6-month period following initial intervention.
Ijerph 17 04505 g002
Table 1. Participant Demographics.
Table 1. Participant Demographics.
PNE
(n = 220)
UC
(n = 198)
PNEBoost
(n = 250)
Overall
(n = 668)
Age, mean, years12.312.312.212.3
Female, n (%)105 (47.7)96 (48.5)126 (50.4)327 (49)
Currently experiencing pain pre-test, n (% yes)84 (38.0)53 (26.7)101 (40.4)238 (35.6)
Mean pain rating of those presenting with pain (NPRS)1.50.81.81.3
Have experienced pain >3 months, n (%)38 (17.3)16 (8.1)42 (16.8)96 (14.4)
Know someone with chronic pain, n (%)151 (68.6)149 (75.3)188 (75.2)488 (73.1)
Participate in sports, n (%)195 (88.6)158 (79.8)205 (82)558 (83.5)
Mean NPQ score3.23.23.13.2
Mean FABQ-PA score12.913.514.513.7
FABQ-PA above cut-off, n (%)93 (42.3)91 (46)135 (54)319 (47.8)
Table 2. Descriptive statistics, with and without outliers, for the comparison among the 3 treatment groups for each of the 6-month outcome variables.
Table 2. Descriptive statistics, with and without outliers, for the comparison among the 3 treatment groups for each of the 6-month outcome variables.
NMeanSDSE95% Confidence IntervalMinimumMaximum
LowerUpper
School attendance—days missedPNE2180.561.210.080.400.73010
UC1950.661.840.130.400.92020
PNEBoost2180.852.600.180.511.20024
School attendance—days missed (outliers removed)PNE2160.490.9330.060.370.6205
UC1930.531.110.080.370.6906
PNEBoost2130.541.180.080.380.6906
Physical education—days missedPNE2160.842.610.180.491.19028
UC1920.883.100.220.441.32035
PNEBoost2222.3413.380.900.574.110174
Physical education—days missed (outliers removed)PNE2150.721.840.130.470.96015
UC1910.701.880.140.440.97016
PNEBoost2201.163.110.210.741.57021
Sports participation—days missedPNE2161.062.500.170.731.40028
UC1871.363.270.240.891.83024
PNEBoost2201.867.170.480.912.82090
Sports participation—days missed (outliers removed)PNE2150.941.700.120.711.17010
UC1851.112.280.170.781.44015
PNEBoost2130.922.340.160.611.24014
Recess participation—days missedPNE2160.783.040.210.371.19028
UC1911.025.240.380.271.77042
PNEBoost2180.412.150.150.130.70030
Recess participation—days missed (outliers removed)PNE2120.421.220.080.250.5807
UC1870.281.130.080.120.45010
PNEBoost2170.280.770.050.170.3806
Doctor visits for painPNE2081.634.080.281.082.19050
UC1781.322.400.180.961.67019
PNEBoost2021.703.280.231.242.15030
Doctor visits for pain (outliers removed)PE2051.281.940.141.011.55010
UC1761.141.710.130.881.3908
PNEBoost1981.362.040.151.071.64010
Rehab visits for painPNE2151.437.860.540.382.490100
UC1900.752.680.190.361.13029
PNEBoost2190.712.670.180.351.06032
Rehab visits for pain
(outliers for pain)
PNE2130.731.980.140.471.00014
UC1890.601.720.130.350.84012
PNEBoost2180.561.620.110.350.78010
NPQ 6 monthPNE2204.822.300.164.515.12012
UC1944.522.510.184.164.88012
PNEBoost2295.142.100.144.865.41011
FABQ-PA 6 monthPNE2201.580.500.031.511.6412
UC1961.580.500.041.511.6512
PNEBoost2291.600.490.031.531.6612
Table 3. p-Values for the interactions and main effects among group by demographic variables for each of the 6-month outcomes.
Table 3. p-Values for the interactions and main effects among group by demographic variables for each of the 6-month outcomes.
Group X GenderGroup Main EffectGender Main Effect
School attendancep = 0.946p = 0.918p = 0.117
PE participationp = 0.269p = 0.092p = 0.001 *
Sports participationp = 0.052p = 0.618p = 0.518
Recess participationp = 0.695p = 0.314p = 0.325
Doctor visits for painp = 0.607p = 0.534p = 0.398
Rehab visits for painp = 0.370p = 0.554p = 0.052
rNPQp = 0.173p = 0.030 *p = 0.667
FABQ-PAp = 0.448p = 0.577p < 0.001 *
Group X Pain at InterventionGroup Main EffectPain at Intervention Main Effect
School attendancep = 0.343p = 0.907p = 0.005 *
PE participationp = 0.358p = 0.177p = 0.070
Sports participationp = 0.393p = 0.313p = 0.115
Recess participationp = 0.466p = 0.156p = 0.221
Doctor visits for painp = 0.111p = 0.486p = 0.013 *
Rehab visits for painp = 0.010 *p = 0.198p = 0.074
rNPQp = 0.509p = 0.025 *p = 0.482
FABQ-PAp = 0.996p = 0.567p = 0.519
Group X Chronic Pain at InterventionGroup Main EffectChronic Pain at Intervention Main effect
School attendancep = 0.004 *p = 0.015 *p < 0.001 *
PE participationp = 0.276p = 0.039 *p < 0.001 *
Sports participationp = 0.611p = 0.290p < 0.001 *
Recess participationp = 0.539p = 0.213p = 0.220
Doctor visits for painp = 0.332p = 0.829p < 0.001 *
Rehab visits for painp = 0.082p = 0.088p = 0.014 *
rNPQp = 0.381p = 0.291p = 0.021 *
FABQ-PAp = 0.616p = 0.976p = 0.052
Group X Knowing Someone with Chronic PainGroup Main EffectKnowing Someone with Chronic Pain Main Effect
School attendancep = 0.501p = 0.970p = 0.001 *
PE participationp = 0.807p = 0.104p = 0.045 *
Sports participationp = 0.633p = 0.972p = 0.007 *
Recess participationp = 0.212p = 0.096p = 0.641
Doctor visits for painp = 0.503p = 0.670p = 0.006 *
Rehab visits for painp = 0.053p = 0.739p = 0.048 *
rNPQp = 0.010 *p = 0.531p = 0.051
FABQ-PAp < 0.001 *p = 0.036 *p = 0.166
Group X Fear of Physical Activity at Time of InterventionGroup Main EffectFear of Physical Activity at Time of Intervention Main Effect
School attendancep = 0.779p = 0.892p = 0.541
PE participationp = 0.330p = 0.108p = 0.002 *
Sports participationp = 0.658p = 0.642p = 0.002 *
Recess participationp = 0.374p = 0.409p = 0.079
Doctor visits for painp = 0.816p = 0.534p = 0.361
Rehab visits for painp = 0.708p = 0.602p = 0.777
rNPQp = 0.923p = 0.015 *p = 0.657
FABQ-PAp = 0.085p = 0.423p < 0.001 *
Group X Pain Knowledge Change from InterventionGroup Main EffectPain Knowledge Change from Intervention Main Effect
School attendancep = 0.023 *p = 0.538p = 0.727
PE participationp = 0.705p = 0.147p = 0.793
Sports participationp = 0.296p = 0.313p = 0.430
Recess participationp = 0.223p = 0.186p = 0.004 *
Doctor visits for painp = 0.157p = 0.492p = 0.114
Rehab visits for painp = 0.072p = 0.275p = 0.604
rNPQp = 0.049 *p = 0.264p = 0.373
FABQ-PAp = 0.735p = 0.806p = 0.887
All statistically significant results are highlighted with an asterisk (*).
Table 4. Detailed findings for each of the regression analyses.
Table 4. Detailed findings for each of the regression analyses.
Unstandardized
Coefficients
Standardized
Coefficients
tp Value
BStandard ErrorBeta
School attendance
p < 0.001
R = 0.252
R2 = 0.064
(Constant)−0.2070.206 −1.0060.315
Gender0.1870.1020.0811.8300.068
Duration0.2420.0680.1593.567<0.001 *
Knowing someone0.2650.1250.0942.1290.034 *
rNPQ improvement0.0500.020−0.113−2.5570.011 *
FABQ change0.0020.0090.0100.2180.828
Pain rating0.0350.0240.0651.4550.146
PE participation
p < 0.001
R = 0.261
R2 = 0.068
(Constant)−1.1190.459 −2.4380.015
Gender0.8340.2270.1613.666<0.001 *
Duration0.5460.1520.1593.579<0.001 *
Knowing someone0.1180.2790.0190.4220.674
rNPQ improvement0.0120.043−0.012−0.2650.791
FABQ change0.0530.0210.1122.5390.011 *
Pain rating0.0040.0530.0040.0830.934
Sports participation
p < 0.001
R = 0.243
R2=0.059
(Constant)−0.2620.394 −0.6660.506
Gender0.1610.1940.0370.8290.408
Duration0.5580.1300.1944.283<0.001 *
Knowing someone0.4030.2370.0761.7020.089
rNPQ improvement0.0120.037−0.014−0.3130.754
FABQ change0.0340.0180.0851.8870.060
Pain rating−0.0200.045−0.020−0.4330.665
Recess participation
p = 0.033
R = 0.165
R2 = 0.027
(Constant)0.4010.206 1.9440.052
Gender−0.0420.102−0.019−0.4160.678
Duration0.1560.0680.1052.3030.022 *
Knowing someone0.1450.1240.053−1.1620.246
rNPQ improvement0.0420.020−0.097−2.1430.033 *
FABQ change0.0140.0090.0671.4820.139
Pain rating0.0150.0240.0290.6260.532
All statistically significant results are highlighted with an asterisk (*).
Table 5. Factor predictive of school attendance, physical education (PE) attendance, recess attendance and sports participation 6 months later.
Table 5. Factor predictive of school attendance, physical education (PE) attendance, recess attendance and sports participation 6 months later.
Having Experienced Pain >3 MonthsKnowledge of Pain (rNPQ)Knowing Someone with Chronic PainGenderHigh Fear of Physical Activity (FABQ-PA)
School attendance Ijerph 17 04505 i001 Ijerph 17 04505 i002 Ijerph 17 04505 i003
PE attendance Ijerph 17 04505 i004 Ijerph 17 04505 i005 Ijerph 17 04505 i006
Sports participation Ijerph 17 04505 i007
Recess attendance Ijerph 17 04505 i008 Ijerph 17 04505 i009

Share and Cite

MDPI and ACS Style

Louw, A.; Landrus, R.; Podolak, J.; Benz, P.; DeLorenzo, J.; Davis, C.; Rogers, A.; Cooper, K.; Louw, C.; Zimney, K.; et al. Behavior Change Following Pain Neuroscience Education in Middle Schools: A Public Health Trial. Int. J. Environ. Res. Public Health 2020, 17, 4505. https://doi.org/10.3390/ijerph17124505

AMA Style

Louw A, Landrus R, Podolak J, Benz P, DeLorenzo J, Davis C, Rogers A, Cooper K, Louw C, Zimney K, et al. Behavior Change Following Pain Neuroscience Education in Middle Schools: A Public Health Trial. International Journal of Environmental Research and Public Health. 2020; 17(12):4505. https://doi.org/10.3390/ijerph17124505

Chicago/Turabian Style

Louw, Adriaan, Regina Landrus, Jessie Podolak, Patricia Benz, Jen DeLorenzo, Christine Davis, Alison Rogers, Kathy Cooper, Colleen Louw, Kory Zimney, and et al. 2020. "Behavior Change Following Pain Neuroscience Education in Middle Schools: A Public Health Trial" International Journal of Environmental Research and Public Health 17, no. 12: 4505. https://doi.org/10.3390/ijerph17124505

APA Style

Louw, A., Landrus, R., Podolak, J., Benz, P., DeLorenzo, J., Davis, C., Rogers, A., Cooper, K., Louw, C., Zimney, K., Puentedura, E. J., & Landers, M. R. (2020). Behavior Change Following Pain Neuroscience Education in Middle Schools: A Public Health Trial. International Journal of Environmental Research and Public Health, 17(12), 4505. https://doi.org/10.3390/ijerph17124505

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop