Next Article in Journal
Psychological Well-Being Increment as Post-Traumatic Growth in Women with Breast Cancer: A Controlled Comparison Design Using Propensity Score Matching
Next Article in Special Issue
Effectiveness of Guided Breathing and Social Support for the Reduction of Pre-Exam Anxiety in University Students: A Factorial Study
Previous Article in Journal
Optical Coherence Tomography and Optical Coherence Tomography with Angiography in Multiple Sclerosis
Previous Article in Special Issue
Mediating Mindfulness-Based Interventions with Virtual Reality in Non-Clinical Populations: The State-of-the-Art
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Protocol

Examining the Acceptability and Feasibility of the Compassionate Mindful Resilience (CMR) Programme in Adult Patients with Chronic Kidney Disease: The COSMIC Study Protocol

1
School of Nursing and Midwifery, Queen’s University Belfast, Belfast BT7 1NN, UK
2
MindfulnessUK, Tauton TA1 1SW, UK
3
Faculty of Medicine, University of Oulu, 90570 Oulu, Finland
4
Northern Ireland Kidney Patients Association, Belfast BT9 7AB, UK
5
Department of Psychiatry, McGill University, Montreal, QC H3A OG4, Canada
*
Author to whom correspondence should be addressed.
Healthcare 2022, 10(8), 1387; https://doi.org/10.3390/healthcare10081387
Submission received: 7 June 2022 / Revised: 20 July 2022 / Accepted: 21 July 2022 / Published: 25 July 2022
(This article belongs to the Collection Mindfulness in Healthcare)

Abstract

:
Kidney disease is often progressive, and patients experience diminished health-related quality of life. In addition, the impact of the coronavirus (COVID-19) pandemic, and its associated restrictions, has brought many additional burdens. It is therefore essential that effective and affordable systems are explored to improve the psychological health of this group that can be delivered safely during the COVID-19 pandemic. The aim of this study is to support a new service development project in partnership with the UK’s leading patient support charity Kidney Care UK by implementing the four-session Compassionate Mindful Resilience (CMR) programme, developed by MindfulnessUK, and explore its effectiveness for patients with stage 4 or 5 chronic kidney disease or have received a kidney transplant. The study will utilise a quasi-experimental, pretest/posttest design to measure the effect of the CMR programme on anxiety, depression, self-compassion, the ability to be mindful, wellbeing, and resilience, using pre- and posttests, alongside a qualitative exploration to explore factors influencing the feasibility, acceptability, and suitability of the intervention, with patients (and the Mindfulness Teacher) and their commitment to practice. Outcomes from this study will include an evidence-based mindfulness and compassion programme for use with people with kidney disease, which is likely to have applicability across other chronic diseases.

1. Introduction

Patients living with end-stage kidney disease (ESKD), or who have received a kidney transplant, experience difficult physical and psychological symptoms. Depression affects up to one quarter of these patients [1] and the prevalence rate for anxiety, estimated between 12% to 52%, is much higher than the general population [2]. These symptoms result in reduced quality of life [1], suicidal ideation [3], and increased risk of nonadherence to haemodialysis [4]. Despite the burden caused by this psychological distress on patients, and the associated risks, it often remains undetected. Even if depression and anxiety are uncovered there is limited availability of specialist psychological or social support services. In addition, patients may not report concerns because of this deficit [5]. A recent report identifying the UK Renal Psychosocial Workforce [6] found inadequate provision of psychological and social work support with large variations and disparities across the country. Only 5% of 84 units employ the recommended number of psychologists (one whole time equivalent (WTE) psychologist per 1000 renal replacement therapy (RRT) patients in units with adequate renal social work and renal counselling support, or one WTE per 500 RRT patients in the absence of additional support), and 14% of units have no psychosocial staff dedicated to patients with kidney disease [6].
More recently, the coronavirus disease 2019 (COVID-19) outbreak has been designated a public health emergency of international concern [7], which has severely impacted the mental wellbeing of many people with kidney disease. The highest mortality rates have been in people over the age of 60 and those who are immunocompromised or have underlying health conditions [8]. Patients who have kidney disease, or who have received a kidney transplant, are at an increased risk of severe COVID-19 and, therefore, are advised to take extra precautions to reduce their risk of exposure to the virus [9]. This includes shielding, a form of strict social distancing that requires patients not to leave their home for any reason and make alternative arrangements for food and medications to be delivered [10], a difficult feat for patients typically attending multiple hospital appointments. Patients who undergo haemodialysis are unable to adhere to shielding guidelines, as they usually attend hospital three times a week for their treatment, increasing their risk of contracting COVID-19 and incurring psychological morbidity. Many patients already have diminished health-related quality of life [11], and the impact of COVID-19 brings additional burdens. It is therefore essential that effective and affordable systems are explored to improve the psychological health of this group [1], which can be delivered safely during the ongoing COVID-19 pandemic and beyond.
One such intervention is mindfulness, which has increased in popularity over recent years as the scientific evidence base grows [12]. Mindfulness is defined by Thich Nhat Hanh as “the energy of attention” [13]. It involves focused, purposeful, nonjudgmental attention on the present moment and embraces practices that include meditation. Mindfulness has long been used as a stress-reduction technique, is practiced globally, and is accessible, free, and inclusive [14]. The Mindfulness-Based Stress Reduction (MBSR) programme was developed at the University of Massachusetts’s Medical Center by Professor Jon Kabat-Zinn, as an 8-week course initially intended to complement ongoing treatment plans for patients living with a wide range of conditions and to support individuals’ personal wellbeing [15]. The MBSR has evolved into a programme that can be delivered in a wide range of settings such as education [16], workplaces [17], and prisons [18] as well as hospitals and healthcare settings. The programme focuses on training an individual’s attention on feelings and sensations within the body, and acceptance of these feelings and sensations without judgement [19]. Participants consciously focus their attention on both internal and external stimuli in order to remain in the present moment and reduce disruptive thoughts about the past or future. Benefits include reduced stress and anxiety levels, improved sleep, improved mood, and an increase in resilience and coping skills [20,21], all factors that contribute to improved mental health, wellbeing, and quality of life. In addition, people who meditate have been shown to have less age-related brain atrophy [22]. Unlike cognitive behavioural therapy, which is goal oriented, mindfulness meditation relies on nonjudgmental observation. By distancing themselves from difficult sensations and thoughts patients can achieve a greater acceptance of their condition [12].
Mindfulness has been used effectively to treat mental health conditions, including anxiety [23], depression [24], and addiction [25] most often via the eight-session MBSR programme. In addition, it has been incorporated into the treatment of chronic physical diseases such as cancer [26], inflammatory bowel disease [27], diabetes and coronary heart disease [28], and in pain management [29] to improve quality of life. Within nephrology, there have been relatively few studies examining the effects of mindfulness [30,31,32,33,34,35,36], but results from recent studies have been promising, with many patients reporting similar benefits to those with other chronic diseases. However, these studies have been limited by difficulties in the delivery of mindfulness sessions, including a lack of qualified practitioners, space for practical based mindfulness activities, noisy environments, cost considerations, and lack of standardised approach [30,31,32,33,34,35,36]. In one study, which took place in a haemodialysis unit, barriers to intervention delivery included frequent haemodialysis shift changes, staff or alarm interruptions, space constraints, fluctuating medical status of participants, and patient fatigue [31]. To overcome these limitations, effective and affordable alternatives are required to ensure that patients can experience the benefits of mindfulness and compassion which can support increased resilience [37]. In addition, with the onset of COVID-19, it is important that wherever possible, delivery is provided online.
This protocol presents a collaborative, new service development study, delivered as a partnership between Kidney Care UK (KCUK), Queen’s University Belfast, and MindfulnessUK, to pilot, including full evaluation, a new virtual mindfulness programme for patients with kidney disease. Presently, access to psychological and emotional support is not well provided or funded, which is one reason that KCUK provides a universal telephone counselling service. The charity is keen to explore the feasibility of delivering mental health support via virtual means as a cost-effective way to significantly reach and support more patients with mental health needs. While the study is not a formal economic evaluation of the intervention, costs incurred (e.g., Mindfulness Teacher, supervision sessions, PPI representation) will be shared in future publications.
An eight-session mindfulness programme is considered the gold-standard and shown to be most effective; however, recruitment and retention have been problematic as it is not always practical for people with ill-health or caring duties to attend [26]. Condensed programmes have excellent potential, but such bespoke courses require rigorous evaluation. MindfulnessUK has recently developed a new programme to help manage stress, develop resilience, and enhance wellbeing using evidence-based mindfulness and compassion skills and techniques, which can be delivered as a four-session course (the Compassionate Mindful Resilience programme) and is being offered nationally [38]. The study intends to trial this four-session programme with patients who have reached stage 4 and 5 CKD and patients who have received kidney transplants. The aim is to increase equitable access to evidence-based mindfulness practices with the potential to improve the lives of people impacted by kidney disease. The programme will be implemented, with the support of an Expert Advisory Group, and obtain preliminary data with standardised measures of anxiety, depression, self-compassion, mindfulness, wellbeing, and resilience in order to progress with a larger scale efficacy and effectiveness trial. We hypothesized that following the introduction of the CMR intervention, there would be an improvement in anxiety as measured by the Generalised Anxiety Disorder questionnaire (GAD-7) immediately postintervention.

1.1. Aim

The aim of this work is to support a new service development project with KCUK by implementing the Compassionate Mindful Resilience (CMR) programme developed by MindfulnessUK and explore its effectiveness for patients who have kidney disease.

1.2. Objectives

(1)
To implement the Compassionate Mindful Resilience (CMR) programme with an interdisciplinary Advisory Group including representatives from MindfulnessUK and KCUK for use with people with kidney disease.
(2)
To measure the effect of the CMR on anxiety, depression, self-compassion, mindfulness, wellbeing, and resilience using pre- and posttests.
(3)
To explore factors influencing the feasibility, acceptability, and suitability of the intervention with patients (and the Mindfulness Teacher) and their commitment to practice.
(4)
To develop strategies for sustainability of the programme once the study is completed via a Partnership Board including representatives from KCUK, MindfulnessUK, and Queen’s University Belfast.

2. Expert Advisory Group and Partnership Board

The Expert Advisory Group will include: all members of the research team - Dr Helen Noble, Nephrology Nurse and Academic; Professor Joanne Reid, Academic Professor of Nursing; Dr Claire Carswell, Research Fellow; Dr Clare McVeigh, Lecturer in Nursing; Ms Anna Wilson, Research Assistant; Dr Clare McKeaveney, Lecturer in Nursing; Mr Ian Walsh, Consultant Surgeon and Clinical Academic; Dr Lisa Graham-Weiser, Psychologist; Ms Karen Atkinson, Co-Founder MindfulnessUK; Dr Erika Jääskeläinen, Psychiatrist, Finland; Mr William Johnston, KCUK Advocacy Officer Patient; Mr Daniel O’Rourke, Transplant Recipient; and Dr Sohem Raj, Consultant Psychiatrist from the “Geri-PARTy” Lab at the McGill-Affiliated Jewish General Hospital, Canada. Dr Raj has completed mindfulness research with patients receiving haemodialysis and has an established relationship with the research team.
A Partnership Board will be established including representatives from KCUK (P Bristow, S Yianni, J Gough, and J Pilcher), MindfulnessUK (K Atkinson), and Queen’s University Belfast (H Noble). Others will be requested to join as indicated. This board will prioritise sustainability of a mindfulness intervention to ensure mindfulness is made more readily accessible to patients via KCUK once the study completes. This would feed into phase two of this study to commence once the present study is completed, which would see an expansion of mindfulness programmes to patients and carers.

3. Methods

3.1. Study Design

A quasi-experimental, pretest/posttest design will be used alongside a qualitative exploration of acceptability. The outcome of interest will be measured before and after participants receive the intervention, and qualitative interviews will be conducted with a sample of participants.

3.2. Participants

Kidney Care UK will promote the CMR programme with details of the study for up to 75 participants. The study will initially be advertised in the KCUK Facebook Support Group which has over 9000 members (approximately 70% female/30% male). The average number of visits to the Facebook page per month in 2020 was 86,505. If required the information can be sent to all 8500 individual subscribers to the KCUK email mailing lists (40% male, 58% female, 2% other; split: 95% patient or carer, 5% health care professional). Additionally, the study can be advertised via social media. Approximately 20,000 people follow KCUK’s social media channels (Facebook/Instagram/Twitter).

3.3. Preliminary Work

Prior to the study commencing, the research team will undertake preliminary work with the Expert Advisory Group in consultation with the Partnership Board to ensure that the preintervention assessment is appropriate for a kidney disease population. The Full Client Assessment, which is carried out before participants undertake the CMR programme, will be refined in consultation with members of the KCUK counselling service, MindfulnessUK and people living with kidney disease to ensure the assessment considers the unique needs of people with kidney disease. Appropriate adaptations will be made to the delivery of the CMR programme in consultation with representatives of the Advisory Group who are living with kidney disease, the Mindfulness Teacher, and Partnership Board to ensure it is suitable for people living with kidney disease. For example, patients may tire easily and may need more regular breaks than the general public. Dr Helen Noble, an experienced nephrology nurse and registered Mindfulness Teacher will deliver the first CMR programme, as agreed with KCUK, and the subsequent programmes will be delivered by the trained Mindfulness Teacher.

3.4. Participant Recruitment

People with kidney disease interested in participating in the CMR programme and associated study will be asked to complete an online form to register their interest and confirm that they understand and meet the inclusion and exclusion criteria for the study. Participants over 18 years, living in the UK and in stage 4 or 5 kidney disease or have received a kidney transplant, who are not currently undergoing psychotherapy or experiencing severe periods of anxiety, depression, mental illness, addiction, recent bereavement, or a traumatic life event and have the capacity to provide consent will be eligible for inclusion.
Potential participants will be sent an information sheet about the study and a consent form. The information sheet will explain that anonymity will be guaranteed. Participants will then be referred to the registered Mindfulness Teacher employed for the study, for a standardised formal assessment, which has been adapted in consultation with the Expert Advisory Group to suit the population, to be undertaken to assess their suitability for the CMR programme. Participants will then be sent the questionnaires and instructions on how to complete them before commencing the CMR programme. The Research Assistant will be available to help those requiring assistance to complete the forms. Each CMR programme will include up to 10 participants, with a total of 75 participants.

3.5. Procedure of Data Collection

The study will take place over 18 months. All participants in the CMR programme will complete measurements at four time points: a pretest measurement two weeks before the start of the CMR programme and a posttest measurement immediately post-CMR programme and at 3 and 6 months. Demographic information will be collected at the start of the study, which will include age, gender, ethnicity, socioeconomic status, relationship status, highest level of education, current occupation, chronic kidney disease (CKD) status, length of time since diagnosis and estimated glomerular filtration rate (eGFR), along with data from the participant assessment. Instruments will be sent to the participants by email or post and the Research Assistant will be available to assist where required.

3.6. The Intervention

The CMR course is designed to be delivered for two hours per week for four consecutive weeks, in a group setting, online. This can be adapted to fit with client training needs, but MindfulnessUK recommend that at least one week is allowed in between sessions to allow home practice to take place. The programme was developed by Karen Atkinson of MindfulnessUK, executive committee member for the British Association of Mindfulness Based Approaches, which upholds standards and builds integrity in the mindfulness field [39]. It was developed in response to a growing need for people to access mindfulness and compassion practices in an easy, accessible way and was adapted from the industry standard MBSR programme [15]. The CMR was developed to provide an introductory mindfulness course teaching simple, effective, evidence-based practices, skills, and techniques found in the MBSR programme. Like the MBSR, the CMR was developed to help people manage stress, but has a specific focus on enhancing self-compassion and resilience. Self-compassion is a core component of mindfulness, which provides individuals with improved emotional resilience and reduced self-judgement, and a source of strength and resilience when dealing with life stressors [40]. The CMR programme was developed from the understanding that supporting development of mindfulness, self-compassion, and resilience can help individuals in navigating their world.
The CMR creatively delivers evidence based long term and sustainable teaching of mindfulness and compassion to build resilience in individuals and throughout organisations. Courses are delivered via the Zoom online meeting platform. If a participant is unable to attend a session, they should inform the Research Assistant. The Mindfulness Teacher can record the teaching elements of the session to send to the participant who missed the session. No other participants will be recorded, and written consent will be obtained from all participants to ensure they are aware why the Mindfulness Teacher is recording these sections of the session.

3.6.1. Who Is the CMR Course for?

The CMR can be delivered to any organisation/group of individuals/individual that teach, supports, and/or cares for others. No previous experience of mindfulness is necessary. This is an introductory course that teaches simple, effective, evidence-based practices, skills, and techniques to help manage stress, develop resilience and enhance wellbeing using mindfulness and compassion. The CMR programme offers a blend of learning through concepts, short practises, and exercises and will be delivered online.

3.6.2. CMR Resources for Participants

(1)
CMR Participants Resources Pack, either emailed or printed.
(2)
Downloadable Mindfulness and Compassion Meditation Practices.
  • Compassionate body scan;
  • Compassionate mindful movement;
  • Affectionate Breathing.
(3)
A PowerPoint is used for some of the course content but not distributed to participants.
To deliver the CMR programme, the Teacher must have one of the following educational backgrounds:
(1)
Have gained registration with the British Association of Mindfulness-Based Approaches as a qualified Mindfulness Teacher.
(2)
Have gained a Level 4 qualification ‘Integrating Mindfulness and Compassion in Professional Practice’.
(3)
Have qualified as a Compassion Teacher through the Centre for Mindful Self-Compassion.
In addition, they must have completed the CMR training with MindfulnessUK. A member of the research team will be present in each of the CMR sessions to support the Mindfulness Teacher and to ensure participant safeguarding.

3.7. Managing Risk

No psychological risk is anticipated for participants. However, the research team are cognisant of the fact that it is important to reduce any potential risk of emotional distress. Engaging in the CMR programme will enable participants to place themselves in the present moment and focus on their thoughts, emotions, and feelings. This may cause participants to feel increased stress and anxiety if they are overwhelmed with their true emotions and feelings. In order to manage this, skilled and qualified Mindfulness Teachers will be employed who will be trained to assist participants to deal with difficult emotions that arise. Distress and disclosure protocols will be in place to ensure the safety of participants while taking part in the study.

3.8. Data Collection

Measurements

The outcomes of interest in the current study are the effect of the CMR programme on anxiety, depression, self-compassion, mindfulness, wellbeing, and resilience. The primary outcome is anxiety immediately postintervention.
(a)
Anxiety: The GAD-7 is a brief seven-item self-report scale based on the Diagnostic and Statistical Manual of Mental Disorders-IV criteria for generalized anxiety disorder, with items scored from 0 (not at all) to 3 (nearly every day). It has excellent internal consistency (Cronbach’s α = 0.92) and test–retest reliability (intraclass correlation = 0.83) [41].
(b)
Depression: The PHQ-9 is a brief nine-item self-report scale based on the Diagnostic and Statistical Manual of Mental Disorders-IV criteria for major depressive disorder, in which each item is scored from 0 (not at all) to 3 (nearly every day). Similar to the GAD-7, construct validity studies have demonstrated its internal consistency (Cronbach’s α = 0.89) and test–retest reliability (intraclass correlation = 0.87) to be excellent [42].
(c)
The Self-Compassion Scale (SCS) is the most commonly used measure of self-compassion; however, concerns have been raised that the 26-item SCS is burdensome for some individuals [43]. The shortened 12-item Self-Compassion Scale-Short Form (SCS-SF) [44] will therefore be utilised in this study.
(d)
The Five Facet Mindfulness Questionnaire (FFMQ) is a self-report measure that is based on a five-facet model (i.e., Observe, Describe, Act with Awareness, Nonjudge, and Nonreact). The test consists of 39 items that measure the five facets, and the scores provide an estimate of where we stand in terms of mindfulness and self-awareness [45]. Results show that the Italian FFMQ (which has a similar factor structure to the English version) has good to excellent internal consistency as a whole (alpha  =  0.86) with subscale consistency ranging from 0.65 to 0.81, and test–retest stability for the total score is 0.71 [46].
(e)
Tennant et al. [47] modified the Warwick–Edinburgh Mental Well-Being Scale (WEMWBS) into the Short Warwick–Edinburgh Mental Well-Being Scale (SWEMWBS). The SWEMWBS consists of seven positively worded items related to mental wellbeing, focusing on psychological and eudemonic wellbeing. It has been translated, validated, and used globally to evaluate levels of wellbeing in different populations, and has been used as an outcome measure for evaluations of interventions aimed at improving mental wellbeing. Robust measurement properties alongside brevity makes SWEMWBS preferable to WEMWBS for monitoring mental wellbeing. The scale is easily understood, practical, and inexpensive.
(f)
The Mental Toughness Questionnaire (MTQ48), a self-report measure of mental toughness, and an accompanying model comprising 4 core components, challenge, commitment, control, and confidence, with responses graded on a 5-point Likert-type scale anchored from 1 (strongly disagree) to 5 (strongly agree) [48]. It is the most widely used and researched resilience measure. The scale is currently being used in a number of mindfulness research studies at Queen’s University and Newcastle University. Whilst there remains debate regarding using MTQ48 in some areas, it can be viewed as the standard mental toughness measure to date with an overall test–retest coefficient of 0.90 [49,50].

3.9. Data Analysis

The Statistical Package for the Social Sciences (SPSS v.28) will be used to assist with data analysis. Recruitment, participation, and retention rate of participants will be recorded. Baseline demographic data including age, gender, ethnicity, socioeconomic status, relationship status, highest level of education, current occupation, CKD status, and eGFR will be collected to gain an exploratory understanding of the demographics of participants. Descriptive statistics will be used to present baseline demographic data. Categorical data will be presented as frequencies and percentages, while continuous data will be presented as means and standard deviations.
A repeated measures t-test will be conducted to compare the mean scores of the outcome measures before and after receiving the intervention to inform future evaluation of efficacy. A repeated measures ANOVA will be used to compare the difference in mean scores across the four data collection time points (pre, post, 3 months post and 6 months postintervention). A range of graphs and tables will also be used to present study findings.

3.10. Sample Size

A sample size calculation was conducted using G*Power software to determine the size of the sample necessary to detect a minimal clinically important difference [51] in the Generalised Anxiety Disorder questionnaire (GAD-7) [41]. The calculation was based on data from a study evaluating a complex intervention for the management of anxiety and depression in a chronic disease population [52]. A sample size of 75 will have 95% power to detect a difference in the primary outcome measure of 3 [52], assuming the common standard deviation is 6 [52], using a paired t-test with a 0.05 two-sided significance level, whilst also allowing for a 20% attrition rate. The aim is to recruit 75 participants to the study to account for a higher rate of attrition expected of the population and intervention [53,54]. Based on this calculation, the sample size of 75 is expected to be sufficient to detect a difference minimal clinically important difference across the outcome measures.

4. Qualitative Evaluation

The study will utilise a mixed-methods approach, in the form of a sequential explanatory design, which is characterized by the collection and analysis of quantitative data followed by a qualitative descriptive investigation [55]. The purpose of the qualitative investigation is to further explore the quantitative results in more detail, in particular how these relate to factors affecting the acceptability and suitability of the intervention with patients and the Mindfulness Teacher. The quantitative and qualitative results will be integrated when considering the outcomes of the study and proposing strategies for future sustainability of the programme [56]. The interview schedule will be guided by the RE-AIM framework, developed in 1999 in response to a need to have a framework to evaluate the potential for, or actual, public health and population impact [57]. The RE-AIM QuEST framework proposes open ended qualitative questions across the five RE-AIM dimensions of Reach, Effectiveness, Adoption, Implementation and Maintenance to guide evaluation [58].
Participants will be asked to maintain a diary to record home practice during the study. This is optional for the participant’s own record, may be referred to in the qualitative interviews, but will not be used in the data collection for the study.

4.1. Participant Recruitment

Patients and the Mindfulness Teacher will be offered the opportunity to participate in the evaluation. When a participant completes the CMR programme, they will be asked by the Research Assistant if they would be interested in taking part in a qualitative interview. If they are interested, they will be sent a participant information sheet containing contact details for the researcher. Participants will be given 48 h to consider participation, and a consent form will be provided for completion at the start of each interview. Participants will be recruited for the qualitative evaluation by purposive sampling and will include a range of participants considering gender, ethnicity, age, and stage of CKD. At least one participant from each CMR programme will be included in the interview process.

4.2. Data Collection and Management

There are no formal criteria for determining sample size in qualitative research, and as a result there are no rules to confirm if a sample is sufficiently small or large [59]. The participants will be purposively selected to participate in the study. A sample of approximately 20 patients will be recruited. According to Guest et al. [60], a sample of 12 participants is appropriate to saturate data. However, these are approximate sample sizes, and it is important to note that data collection will continue until no new information or issues are presented by participants and data saturation has been achieved.

4.3. Data Analysis

Semi-structured interviews will be recorded and transcribed verbatim and analysed thematically. Thematic analysis is a method of analysing qualitative data involving the searching for recurring ideas (called themes), within a dataset [61]. It is a “method of identifying, analysing and reporting pattern themes within the data” [61]. The interviews will be professionally transcribed. The data will then be stored electronically, allowing for coding and analysis. Data will be managed and coded using NVivo 11 qualitative data analysis software. Data analysis will follow a six-stage process: familiarization with data, generating initial codes, searching for themes, reviewing themes, defining and naming themes, and producing the reporting themes [62]. A sample of interviews will be coded by members of the research team led by the Chief investigator, Dr Noble, and the Research Assistant, all of whom have wide experience in qualitative research methodology, including thematic analysis.

5. Dissemination Strategy

Outcomes from this study will include an evidence-based mindfulness programme for use with people with kidney disease. It may also have applicability across other chronic diseases. Using a multi-faceted strategy that targets local, national, and international interdisciplinary audiences, findings and outcomes will be disseminated across clinical and tertiary healthcare sectors and through renal policy decision makers and patient organisations. This will occur through publications, conference presentations, and workshops. The protocol for the study, and the implementation and evaluation of the CMR programme will be submitted for publication in high quality peer reviewed journals and presented at national and international conferences including the British Renal Symposium and the EDTNA/ERCA annual conference. Service users will also be involved in the dissemination of findings, and researchers will collaborate with Patient Associations including the Northern Ireland Kidney Patient Association and KCUK throughout the study. A social media plan will be created to incorporate platforms such as Twitter and Facebook to disseminate information, progress, events, and findings from the study. The study will be promoted via the Renal Arts Group, which has an established website and an excellent social media presence. An annual progress report will be sent to the KCUK research committee. Any publications and conferences arising from the research will be communicated direct to the KCUK Secretariat. At the end of the study a clear lay summary of the study findings will be compiled to disseminate to patients, carers, healthcare staff, NHS, and HSC trusts and policy makers.

6. Conclusions

A full research-led evaluation of the CMR programme will not only provide additional psychological support to patients during the COVID-19 pandemic, but also assess whether this programme could be rolled out more widely to many more patients. This would supplement the in-depth and personal counselling service provided by KCUK and expand the charity’s direct patient support services in this core area of the charity’s work. While the benefits of mindfulness for patients with ESKD have been examined in previous studies [30,31,32,33,34,35,36], there is further scope for exploration of the feasibility, acceptability, and suitability of a condensed programme, which can be delivered online for this patient group. Additionally, the effect size estimates generated from this study have the potential to inform future definitive clinical trials in this area of research.

Author Contributions

Conceptualization, H.N., K.A., S.B., C.C., L.G.-W., E.J., W.J., C.M. (Clare McKeaveney), C.M. (Clare McVeigh), D.O., J.R., S.R., I.W., M.M. and A.W.; methodology, H.N., C.C., L.G.-W., E.J., C.M. (Clare McKeaveney), C.M. (Clare McVeigh) and A.W.; writing—original draft preparation, H.N., C.C., C.M. (Clare McKeaveney), C.M. (Clare McVeigh) and A.W.; writing—review and editing, H.N., K.A., S.B., C.C., L.G.-W., E.J., W.J., C.M. (Clare McKeaveney), C.M. (Clare McVeigh), D.O., J.R., S.R., I.W., M.M. and A.W.; project administration, H.N. and A.W.; funding acquisition, H.N. All authors have read and agreed to the published version of the manuscript.

Funding

The study has been funded by Kidney Care UK, grant reference HQ 215.

Institutional Review Board Statement

The study will be conducted according to the guidelines of the Declaration of Helsinki and has been approved by the Queen’s University Belfast Medicine, Health and Life Sciences Faculty Ethics Committee (9 March 2022).

Informed Consent Statement

Informed consent will be obtained from all subjects involved in the study.

Data Availability Statement

Not applicable.

Acknowledgments

The research team would like to extend our grateful thanks to members of the Partnership Board Paul Bristow, Suzan Yianni, Jan Gough, Jane Lessiter, and Lauren Mercer, for their support for this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Hackett, M.L.; Jardine, M.J. We need to talk about Depression and Dialysis: But what questions should we ask, and does anyone know the answers? Clin. J. Am. Soc. Nephrol. 2017, 12, 222–224. [Google Scholar] [CrossRef] [PubMed]
  2. Murtagh, F.E.; Addington-Hall, J.; Higginson, I.J. The prevalence of symptoms in end-stage renal disease: A systematic review. Adv. Chronic Kidney Dis. 2007, 14, 82–99. [Google Scholar] [CrossRef] [PubMed]
  3. Pompili, M.; Venturini, P.; Montebovi, F.; Forte, A.; Palermo, M.; Lamis, D.A.; Serafini, G.; Amore, M.; Girardi, P. Suicide risk in dialysis: Review of current literature. Int. J. Psychiatry Med. 2013, 46, 85–108. [Google Scholar] [CrossRef] [PubMed]
  4. García-Llana, H.; Remor, E.; Del Peso, G.; Selgas, R. The role of depression, anxiety, stress and adherence to treatment in dialysis patients’ health-related quality of life: A systematic review of the literature. Nefrologia 2014, 34, 637–657. [Google Scholar] [CrossRef]
  5. Pena-Polanco, J.E.; Mor, M.K.; Tohme, F.A.; Fine, M.J.; Palvesky, P.M.; Weisbord, S.D. Acceptance of antidepressant treatment by patients on hemodialysis and their renal providers. Clin. J. Am. Soc. Nephrol. 2017, 12, 298–303. [Google Scholar] [CrossRef] [Green Version]
  6. Seekles, M.L.; Coyne, E.; Ormandy, P.; Wells, L.; Bevin, A.; Danbury-Lee, A. The UK Renal Psychosocial Workforce: A Mapping Exercise. 2018. Available online: https://www.kidneycareuk.org/news-and-campaigns/news/kidney-patients-lack-psychological-and-social-support/ (accessed on 10 April 2021).
  7. Wong, J.; Goh, Q.Y.; Tan, Z.; Lie, S.A.; Tay, Y.C.; Ng, S.Y.; Soh, C.R. Preparing for a COVID-19 pandemic: A review of operating room outbreak response measures in a large tertiary hospital in Singapore. Can. J. Anesth. 2020, 67, 732–745. [Google Scholar] [CrossRef] [Green Version]
  8. Zhou, P.; Yang, X.L.; Wang, X.G.; Hu, B.; Zhang, L.; Zhang, W.; Si, H.R.; Zhu, Y.; Li, B.; Huang, C.L.; et al. A pneumonia outbreak associated with a new coronavirus of probable bat origin. Nature 2020, 579, 270–273. [Google Scholar] [CrossRef] [Green Version]
  9. Henry, B.M.; Lippi, G. Chronic kidney disease is associated with severe coronavirus disease 2019 (COVID-19) infection. Int. Urol. Nephrol. 2020, 52, 1193–1194. [Google Scholar] [CrossRef] [Green Version]
  10. Kidney Care UK. Coronavirus (COVID-19) Guidance for Patients with Kidney Disease. 2020. Available online: https://www.kidneycareuk.org/news-and-campaigns/coronavirus-advice/ (accessed on 10 April 2021).
  11. Böhmert, M.; Kuhnert, S.; Nienhaus, A. Psychological stress and strain in dialysis staff—A systematic review. J. Ren. Care 2011, 37, 178–189. [Google Scholar] [CrossRef]
  12. Gu, J.; Strauss, C.; Bond, R.; Cavanagh, K. How do mindfulness-based cognitive therapy and mindfulness-based stress reduction improve mental health and wellbeing? A systematic review and meta-analysis of mediation studies. Clin. Psychol. Rev. 2015, 37, 1–12. [Google Scholar] [CrossRef]
  13. Hanh, T.N. The Miracle of Mindfulness: The Classic Guide to Meditation by the World’s Most Revered Master, Classic ed.; Rider: London, UK, 2008. [Google Scholar]
  14. Kabat-Zinn, J.; Wheeler, E.; Light, T.; Skillings, A.; Scharf, M.J.; Cropley, T.G.; Hosmer, D.; Bernhard, J.D. Influence of a mindfulness meditation-based stress reduction intervention on rates of skin clearing in patients with moderate to severe psoriasis undergoing phototherapy (UVB) and photochemotherapy (PUVA). Psychosom. Med. 1998, 60, 625–632. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Kabat-Zinn, J. Mindfulness-based interventions in context: Past, present, and future. Clin. Psychol. Sci. Pract. 2003, 10, 144–156. [Google Scholar] [CrossRef]
  16. Saltzman, A.; Goldin, P. Mindfulness-based stress reduction for school-age children. In Acceptance and Mindfulness Treatments for Children and Adolescents: A Practitioner’s Guide; Greco, L.A., Hayes, S.C., Eds.; New Harbinger Publications: Oakland, CA, USA, 2008; Chapter 7; p. 139. [Google Scholar]
  17. Wolever, R.Q.; Bobinet, K.J.; McCabe, K.; Mackenzie, E.R.; Fekete, E.; Kusnick, C.A.; Baime, M. Effective and viable mind-body stress reduction in the workplace: A randomized controlled trial. J. Occup. Health Psychol. 2012, 17, 246–258. [Google Scholar] [CrossRef]
  18. Samuelson, M.; Carmody, J.; Kabat-Zinn, J.; Bratt, M.A. Mindfulness-Based Stress Reduction in Massachusetts Correctional Facilities. Prison. J. 2007, 87, 254–268. [Google Scholar] [CrossRef]
  19. American Psychological Association. Mindfulness Meditation: A Research-Proven Way to Reduce Stress. 2020. Available online: https://www.apa.org/topics/mindfulness/meditation (accessed on 5 May 2022).
  20. Kim, Y.H.; Kim, H.J.; Ahn, S.D.; Seo, Y.J.; Kim, S.H. Effects of mediation on anxiety, depression, fatigue, and quality of life of women undergoing radiation therapy for breast cancer. Complement. Ther. Med. 2013, 21, 379–387. [Google Scholar] [CrossRef] [PubMed]
  21. Carlson, L.E.; Doll, R.; Stephen, J.; Faris, P.; Tamagawa, R.; Drysdale, E.; Speca, M. Randomised controlled trial of Mindfulness-based cancer recovery versus supportive expressive group therapy for distressed survivors of breast cancer. J. Clin. Oncol. 2013, 31, 3119–3126. [Google Scholar] [CrossRef] [PubMed]
  22. Luders, E.; Cherbuin, N.; Kurth, F. Forever Young(er): Potential age-defying effects of long-term meditation on gray matter atrophy. Front. Psychol. 2015, 5, 1551. [Google Scholar] [CrossRef] [Green Version]
  23. Keng, S.; Smoski, M.J.; Robins, C.J. Effects of mindfulness on psychological health: A review of empirical studies. Clin. Psychol. 2011, 31, 1041–1056. [Google Scholar] [CrossRef] [Green Version]
  24. Bower, J.E.; Crosswell, A.D.; Stanton, A.L.; Crespi, C.M.; Winston, D.; Arevalo, J.; Ma, J.; Cole, S.W.; Ganz, P.A. Mindfulness meditation for younger breast cancer survivors: A randomised controlled trial. Cancer 2015, 121, 1231–1240. [Google Scholar] [CrossRef]
  25. Zgierska, A.; Rabago, D.; Chawla, N.; Kushner, K.; Koehler, R.; Marlatt, A. Mindfulness mediation for substance use disorders: A systematic review. Subst. Abus. 2009, 30, 266–294. [Google Scholar] [CrossRef] [Green Version]
  26. Kubo, A.; Kurtovich, E.; McGinnis, M.A.; Aghaee, S.; Altschuler, A.; Quesenberry, C., Jr.; Kolevska, T.; Avins, A.L. A randomized controlled trial of mHealth mindfulness intervention for cancer patients and informal cancer caregivers: A feasibility study within an integrated health care delivery system. Integr. Cancer Ther. 2019, 18, 1534735419850634. [Google Scholar] [CrossRef] [PubMed]
  27. Kuo, B.; Bhasin, M.; Jacquart, J.; Scult, M.A.; Slipp, L.; Riklin, E.I.; Lepoutre, V.; Comosa, N.; Norton, B.; Dassatti, A.; et al. Genomic and clinical effects associated with a relaxation response mind-body intervention in patients with irritable bowel syndrome and inflammatory bowel disease. PLoS ONE 2015, 10, e0123861. [Google Scholar] [CrossRef] [PubMed]
  28. Keyworth, C.; Knopp, J.; Roughley, K.; Dickens, C.; Bold, S.; Coventry, P. A mixed-methods pilot study of the acceptability and effectiveness of a brief meditation and mindfulness intervention for people with diabetes and coronary heart disease. J. Behav. Med. 2014, 40, 53–64. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Ball, E.; Newton, S.; Kahan, B.C.; Forbes, G.; Wright, N.; Calvete, C.C.; Gibson, H.; Rogozinska, E.; Rivas, C.; Taylor, S.J.C.; et al. Smartphone App Using Mindfulness Meditation for Women with Chronic Pelvic Pain (MEMOHIS): Protocol for a Randomized Feasibility Trial. JMIR Res. Protoc. 2018, 7, e8. [Google Scholar] [CrossRef] [Green Version]
  30. Sohn, B.K.; Oh, Y.K.; Choi, J.S.; Song, J.; Lim, A.; Lee, J.P.; An, J.N.; Choi, H.J.; Hwang, J.Y.; Jung, H.Y.; et al. Effectiveness of group cognitive behavioral therapy with mindfulness in end-stage renal disease hemodialysis patients. Kidney Res. Clin. Pract. 2018, 37, 77–84. [Google Scholar] [CrossRef] [Green Version]
  31. Thomas, Z.; Novak, M.; Platas, S.G.T.; Gautier, M.; Holgin, A.P.; Fox, R.; Segal, M.; Looper, K.J.; Lipman, M.; Selchen, S.; et al. Brief mindfulness meditation for depression and anxiety symptoms in patients undergoing hemodialysis: A pilot feasibility study. Clin. J. Am. Soc. Nephrol. 2017, 12, 2008–2015. [Google Scholar] [CrossRef]
  32. Moosavi Nejad, M.; Shahgholian, N.; Samouei, R. The effect of mindfulness program on general health of patients undergoing hemodialysis. J. Educ. Health Promot. 2018, 7, 74. [Google Scholar] [CrossRef]
  33. Bennett, P.; Ngo, T.; Kalife, C.; Schiller, B. Improving wellbeing in patients undergoing dialysis: Can meditation help? Semin. Dial. 2018, 31, 59–64. [Google Scholar] [CrossRef]
  34. Igarashi, N.S.; Karam, C.H.; Afonso, R.F.; Carneiro, F.D.; Lacerda, S.S.; Santos, B.F.; Kozasa, E.H.; Rangel, E.B. The effects of a short-term meditation-based mindfulness protocol in patients receiving hemodialysis. Psychol. Health Med. 2022, 27, 1286–1295. [Google Scholar] [CrossRef]
  35. Assarian, F. Efficacy of Mindfulness-based Stress Reduction in Hemodialysis Patients with Anxiety and Depression: A randomized, double-blind, parallel-group trial. Electron. Physician 2021, 11, 7370–7377. Available online: http://medtech.ichsmt.org/index.php/EPJ/article/view/690 (accessed on 26 January 2022).
  36. Carver, J.A.; Cheung, K.L. Feasibility and Acceptability of a Yogic Breathing/Mindfulness Meditation e-Intervention on Symptoms and COVID-19—Associated Anxiety in Patients Receiving Dialysis. J. Palliat. Med. 2021, 24, 1124–1125. [Google Scholar] [CrossRef] [PubMed]
  37. Bluth, K.; Neff, K.D. New frontiers in understanding the benefits of self-compassion. Self Identity 2018, 17, 605–608. [Google Scholar] [CrossRef]
  38. Atkinson, K. Compassionate Mindful Inquiry in Therapeutic Practice; Singing Dragon: London, UK, 2020. [Google Scholar]
  39. Compassionate Mindful Resilience|Mindfulness UK. 2021. Available online: https://mindfulnessuk.com/course/compassionate-mindful-resilience/ (accessed on 31 January 2022).
  40. British Association of Mindfulness-Based Approaches. 2022. Available online: https://bamba.org.uk/ (accessed on 26 January 2022).
  41. Spitzer, R.L.; Kroenke, K.; Williams, J.B.; Löwe, B. A brief measure for assessing generalized anxiety disorder: The GAD-7. Arch. Intern. Med. 2006, 166, 1092–1097. [Google Scholar] [CrossRef] [Green Version]
  42. Kroenke, K.; Spitzer, R.L.; Williams, J.B. The PHQ-9: Validity of a brief depression severity measure. J. Gen. Intern. Med. 2001, 16, 606–613. [Google Scholar] [CrossRef]
  43. Kemppainen, V.; Kerttu, T.; Hannele, T. Nurses’ roles in health promotion practice: An integrative review. Health Promot. Int. 2013, 28, 490–501. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Raes, F.; Pommier, E.; Neff, K.D.; Van Gucht, D. Construction and factorial validation of a short form of the self-compassion scale. Clin. Psychol. Psychother. 2011, 18, 250–255. [Google Scholar] [CrossRef] [PubMed]
  45. Baer, R.A.; Smith, G.T.; Likins, E.; Button, D.; Krietemeyer, J.; Sauer, S.; Walsh, E. Construct Validity of the Five Facet Mindfulness Questionnaire in Meditating and Nonmeditating Samples. Assessment 2008, 15, 329–342. [Google Scholar] [CrossRef] [PubMed]
  46. Giovannini, C.; Giromini, L.; Bonalume, L.; Tagini, A.; Lang, M.; Amadei, G. The Italian five facet mindfulness questionnaire: A contribution to its validity and reliability. J. Psychopathol. Behav. Assess. 2014, 36, 415–423. [Google Scholar] [CrossRef]
  47. Tennant, R.; Hiller, L.; Fishwick, R.; Platt, S.; Joseph, S.; Weich, S.; Parkinson, J.; Secker, J.; Stewart-Brown, S. The Warwick-Edinburgh mental well-being scale (WEMWBS): Development and UK validation. Health Qual. Life Outcomes 2007, 5, 63. [Google Scholar] [CrossRef] [Green Version]
  48. Perry, J.; Clough, P.; Crust, L.; Earle, K.; Nicholls, A. Factorial validity of the Mental Toughness Questionnaire-48. Personal. Individ. Differ. 2013, 54, 587–592. [Google Scholar] [CrossRef]
  49. Clough, P.; Earle, K.; Sewell, D. Mental toughness: The concept and its measurement. In Solutions in Sport Psychology; Thomson: London, UK, 2002; pp. 32–46. [Google Scholar]
  50. Lin, Y.; Mutz, J.; Clough, P.; Papageorgiou, K. Mental Toughness and Individual Differences in Learning, Educational and Work Performance, Psychological Well-being, and Personality: A Systematic Review. Front. Psychol. 2017, 8, 1345. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  51. Kounali, D.; Button, K.S.; Lewis, G.; Gilbody, S.; Kessler, D.; Araya, R.; Duffy, L.; Lanham, P.; Peters, T.J.; Wiles, N.; et al. How much change is enough? Evidence from a longitudinal study on depression in UK primary care. Psychol. Med. 2020, 1–8. [Google Scholar] [CrossRef] [PubMed]
  52. Stoop, C.H.; Nefs, G.; Pommer, A.M.; Pop, V.J.M.; Pouwer, F. Effectiveness of a stepped care intervention for anxiety and depression in people with diabetes, asthma or COPD in primary care: A randomized controlled trial. J. Affect. Disord. 2015, 184, 269–276. [Google Scholar] [CrossRef] [PubMed]
  53. Meyerowitz-Katz, G.; Ravi, S.; Arnolda, L.; Feng, X.; Maberly, G.; Astell-Burt, T. Rates of Attrition and Dropout in App-Based Interventions for Chronic Disease: Systematic Review and Meta-Analysis. J. Med. Internet. Res. 2020, 22, e20283. [Google Scholar] [CrossRef]
  54. Ling, C.; Evans, D.; Zhang, Y.; Luo, J.; Hu, Y.; Ouyang, Y.; Tang, J.; Kuang, Z. The effects of cognitive behavioural therapy on depression and quality of life in patients with maintenance haemodialysis: A systematic review. BMC Psychiatry 2020, 20, 369. [Google Scholar] [CrossRef]
  55. Johnson, R.B.; Onwuegbuzie, A.J.; Turner, L.A. Toward a definition of mixed methods research. J. Mix. Methods Res. 2007, 1, 112–133. [Google Scholar] [CrossRef]
  56. Ivankova, N.V.; Creswell, J.W.; Stick, S.L. Using Mixed-Methods Sequential Explanatory Design: From Theory to Practice. Field Methods 2006, 18, 3–20. [Google Scholar] [CrossRef]
  57. Glasgow, R.E.; Vogt, T.M.; Boles, S.M. Evaluating the public health impact of health promotion interventions: The RE-AIM framework. Am. J. Public Health 1999, 89, 1322–1327. [Google Scholar] [CrossRef] [Green Version]
  58. Forman, J.; Heisler, M.; Damschroder, L.J.; Kaselitz, E.; Kerr, E.A. Development and application of the RE-AIM QuEST mixed methods framework for program evaluation. Prev. Med. Rep. 2017, 6, 322–328. [Google Scholar] [CrossRef]
  59. Polkinghorne, D.E. Language and meaning: Data collection in qualitative research. J. Couns. Psychol. 2005, 52, 137. [Google Scholar] [CrossRef] [Green Version]
  60. Guest, G.; Bunce, A.; Johnson, L. How many interviews are enough? An experiment with data saturation and variability. Field Methods 2006, 18, 59–82. [Google Scholar] [CrossRef]
  61. Riger, S.T.; Sigurvinsdottir, R.A. Thematic analysis. In Handbook of Methodological Approaches to Community-Based Research: Qualitative, Quantitative, and Mixed Methods; Oxford University Press: Oxford, UK, 2016; pp. 33–41. [Google Scholar] [CrossRef]
  62. Braun, V.; Clarke, V. Using thematic analysis in psychology. Qual. Res. Psychol. 2006, 3, 77–101. [Google Scholar] [CrossRef] [Green Version]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wilson, A.; McKeaveney, C.; Carswell, C.; Atkinson, K.; Burton, S.; McVeigh, C.; Graham-Wisener, L.; Jääskeläinen, E.; Johnston, W.; O’Rourke, D.; et al. Examining the Acceptability and Feasibility of the Compassionate Mindful Resilience (CMR) Programme in Adult Patients with Chronic Kidney Disease: The COSMIC Study Protocol. Healthcare 2022, 10, 1387. https://doi.org/10.3390/healthcare10081387

AMA Style

Wilson A, McKeaveney C, Carswell C, Atkinson K, Burton S, McVeigh C, Graham-Wisener L, Jääskeläinen E, Johnston W, O’Rourke D, et al. Examining the Acceptability and Feasibility of the Compassionate Mindful Resilience (CMR) Programme in Adult Patients with Chronic Kidney Disease: The COSMIC Study Protocol. Healthcare. 2022; 10(8):1387. https://doi.org/10.3390/healthcare10081387

Chicago/Turabian Style

Wilson, Anna, Clare McKeaveney, Claire Carswell, Karen Atkinson, Stephanie Burton, Clare McVeigh, Lisa Graham-Wisener, Erika Jääskeläinen, William Johnston, Daniel O’Rourke, and et al. 2022. "Examining the Acceptability and Feasibility of the Compassionate Mindful Resilience (CMR) Programme in Adult Patients with Chronic Kidney Disease: The COSMIC Study Protocol" Healthcare 10, no. 8: 1387. https://doi.org/10.3390/healthcare10081387

APA Style

Wilson, A., McKeaveney, C., Carswell, C., Atkinson, K., Burton, S., McVeigh, C., Graham-Wisener, L., Jääskeläinen, E., Johnston, W., O’Rourke, D., Reid, J., Rej, S., Walsh, I., McArdle, M., & Noble, H. (2022). Examining the Acceptability and Feasibility of the Compassionate Mindful Resilience (CMR) Programme in Adult Patients with Chronic Kidney Disease: The COSMIC Study Protocol. Healthcare, 10(8), 1387. https://doi.org/10.3390/healthcare10081387

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop