Next Article in Journal
A Multi-Year Study of Mycotoxin Co-Occurrence in Wheat and Corn Grown in Ontario, Canada
Previous Article in Journal
Nanofractionation Analytics for Comparing MALDI-MS and ESI-MS Data of Viperidae Snake Venom Toxins
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Delphi Analysis: Optimizing Anatomy Teaching and Ultrasound Training for Botulinum Neurotoxin Type A Injection in Spasticity and Dystonia

by
Kimberly Heckert
1,*,
Bo Biering-Sørensen
2,*,
Tobias Bäumer
3,
Omar Khan
4,
Fernando Pagan
5,
Mitchell Paulin
6,
Todd Stitik
7,
Monica Verduzco-Gutierrez
8 and
Rajiv Reebye
9,*
1
Department of Rehabilitation Medicine, Thomas Jefferson University, Philadelphia, PA 19107, USA
2
Department of Neurology, Rigshospitalet, Glostrup, DK-2600 Copenhagen, Denmark
3
Institute of System Motor Science, Center of Brain, Behavior and Metabolism, University of Lübeck, 23562 Lübeck, Germany
4
Hotel Dieu Shaver Health and Rehabilitation Centre, St. Catharines, ON L2T 4C2, Canada
5
Department of Neurology, Georgetown University, Washington, DC 20007, USA
6
Rehabilitation Associates of the Main Line, Main Line Health, Paoli, PA 19301, USA
7
Department of Physical Medicine and Rehabilitation, Rutgers New Jersey Medical School, Newark, NJ 07103, USA
8
Rehabilitation Medicine, UT Health San Antonio, San Antonio, TX 78229, USA
9
Department of Medicine, University of British Columbia, Vancouver, BC V5Z 2G9, Canada
*
Authors to whom correspondence should be addressed.
Toxins 2024, 16(8), 371; https://doi.org/10.3390/toxins16080371
Submission received: 8 May 2024 / Revised: 16 August 2024 / Accepted: 16 August 2024 / Published: 21 August 2024

Abstract

:
Our objective was to provide expert consensus on best practices for anatomy teaching and training on ultrasound-guided botulinum neurotoxin type A (BoNT-A) injection for specialists involved in treating spasticity and dystonia. Nine experts (three neurologists; six physical medicine and rehabilitation physicians) participated in a three-round modified Delphi process. Over three rounds, experts reached consensus on 15 of 16 statements describing best practices for anatomy and BoNT-A injection training. They unanimously agreed that knowledge of the target audience, including their needs and current competency, is crucial when designing training programs. Experts also agreed that alignment between instructors is essential to ensure consistency of approach over time and between regions, and that training programs should be simple, adaptable, and “hands-on” to enhance engagement and learning. Consensus was also reached for several other key areas of training program development. The best-practice principles identified by expert consensus could aid in the development of effective, standardized programs for anatomy teaching and BoNT-A injection training for the purposes of treating spasticity and dystonia. This will enhance the exchange of knowledge, skills, and educational approaches between global experts, allowing more specialists to treat important movement disorders and ultimately improving patient outcomes.
Key Contribution: This article reports the use of a modified Delphi approach to establish best-practice principles for anatomy teaching and training on ultrasound-guided botulinum neurotoxin type A injection for specialists involved in treating spasticity and dystonia.

1. Introduction

Botulinum neurotoxin type A (BoNT-A) is a well-established treatment for movement disorders characterized by muscle hyperactivity [1]. Indeed, based on Level A evidence from high-quality clinical trials, BoNT-A is recommended as first-line treatment for spasticity and cervical dystonia, as its use in these disorders improves outcomes and functional recovery [2,3].
As BoNT-A is injected directly into the muscles involved in the movement disorder, accurate muscle targeting is essential [4]. Precise localization ensures that BoNT-A reaches the right muscle and minimizes both the risks of the injection procedure and side effects from toxin spread [1,5]. As BoNT-A may induce muscle weakness, a side effect of BoNT-A with poor localization is weakness in unintended muscles [6], which may have functional consequences that defer patients from returning for additional treatments [7]. Needling of neurovascular structures or multiple needle passes to reach targets are likely to further defer patients from returning due to discomfort, post-injection bleeding/bruising, and pain [7]. Several injection guidance techniques are available to aid muscle localization in BoNT-A treatment, including manual palpation based on surface landmarks and instrumented guidance techniques, such as electromyography (EMG), electrical stimulation (e-stim), and ultrasound (US) [1,5]. The benefits of instrumented guidance methods (versus manual palpation alone) are now widely acknowledged and documented [3,8,9,10,11,12,13,14], and have recently been confirmed in a quantitative analysis [5].
Achieving effective treatment outcomes with BoNT-A in spasticity and dystonia therefore requires physicians to develop not only a detailed knowledge of muscle anatomy and surrounding structures [1,8,15,16], but also a comprehensive understanding of injection guidance techniques [4]. Accordingly, guidelines such as those from the Royal College of Physicians in the UK recommend that BoNT-A injections should be administered only by trained physicians with appropriate expertise [17]. However, to the best of our knowledge, there are currently no standardized, widely accepted best practices for how to effectively design training programs for BoNT-A injection or how to incorporate anatomy teaching into such programs. Therefore, the aim of this study was to provide expert consensus on best practices for anatomy and BoNT-A injection training, and to investigate whether cadaveric anatomy teaching has a place in these programs.

2. Results

2.1. Round 1

All nine experts attended the face-to-face advisory board meeting in Round 1. Based on discussions from this meeting, experts generated 16 primary statements regarding best practices for designing anatomy and BoNT-A injection training courses (Table S1). The statements addressed a variety of components for training programs, including objectives, eligibility criteria for both instructors and participants, curriculum design, engagement and assessment, and course content. Sub-statements were generated for six of the primary statements. The 16 statements were circulated to the expert panel for voting in Round 2.

2.2. Round 2

Eight of the nine experts participated in Round 2 voting. Experts reached unanimous agreement (100% consensus) on 11 of 16 (69%) primary statements (statements 1–6, 10, and 12–15); consensus was also reached for eight of 12 (67%) sub-statements (sub-statements 1a, 1b, 2b, 5a, 6a, 9a, 9b, and 16a), at agreement levels of 88–100%. Five of 16 (31%) primary statements (statements 7–9, 11, and 16) and 4 of 12 (33%) sub-statements (sub-statements 2a, 2c, 5b, and 16b) failed to achieve consensus (25–75% consensus) (Table S2).
All statements that reached consensus were added to the list of final statements (Table 1), while those that failed to reach consensus were modified according to the experts’ feedback and sent out for re-evaluation in the Round 3 questionnaire.

2.3. Round 3

All nine experts participated in Round 3. In this round, experts reached consensus on four of the five primary statements and all four sub-statements that did not reach consensus in Round 2 (all at a level of 88–100% agreement). Therefore, by the end of Round 3, 15/16 (94%) primary statements and 12/12 (100%) sub-statements had achieved consensus (Table 1).

2.4. Consensus Recommendations

Finalized statements and consensus levels are presented in Table 1. Experts unanimously agreed (100%) that the core learning objectives of a training program for anatomy and BoNT-A injection techniques should be tailored to the target audience and region by considering how existing educational programs could be enhanced and the audience’s knowledge and competency levels improved. As such, experts also agreed that the target audience is a crucial component of program design (100%) and that course participants may need to meet certain qualifications or be recommended for inclusion (100%). Depending on the local scope of practice, most experts felt that physiotherapists and occupational therapists should be eligible to participate in training programs to enhance their knowledge of anatomy related to post-stroke spasticity (89%), as this group often refers patients to specialists for treatment (including BoNT-A injection). However, it is widely acknowledged that in many countries, allied health professionals are legally restricted from administering BoNT-A injections to patients, in accordance with local regulations. Experts discussed that while there may be benefits to allowing nurses, physiotherapists, and occupational therapists to administer BoNT-A injections, the ultimate responsibility must always rest with the consulting physician (neurologist or physical medicine and rehabilitation [PM&R] specialist), as mandated by law.
There was widespread agreement that an optimal training curriculum should be simple and adaptable (100%), that it should impart skills that can be assessed objectively (100%), and that it would ideally incorporate hands-on activities to facilitate and demonstrate engagement (100%), including the opportunity to use injection-guidance techniques (100%). Experts agreed that training programs should remain uniform over time and between different regions, with consistent content and use of nomenclature (100%), and that trainers should be selected on the basis of competency using principles of inclusion and diversity (89%).
When considering the level of prior knowledge of US required for participation in training programs, experts broadly agreed that participants should understand the foundational principles (such as knobology and ergonomics) before attending the training (89%). This background knowledge could be acquired through the participants’ educational or clinical backgrounds or through pre-training educational materials. Experts also agreed that the benefits and limitations of other injection-guidance techniques, such as EMG and e-stim, should be discussed in programs that focus on US (88%). There was unanimous agreement (100%) that BoNT-A injections should be considered an important part of a broader, holistic, multimodal treatment approach. Similarly, unanimous consensus (100%) was also reached for several additional recommendations: Namely, training programs should offer instruction on treatment goal-setting and patient evaluation, “train the trainer” meetings should be used to ensure alignment between instructors, training programs would benefit from leveraging strengths in local university or hospital departments, and program participants should have an opportunity to assess their instructors.
All experts agreed that, when available, cadavers (whole-body or prosected) are the optimal specimens to enhance anatomy teaching for the purposes of US-guided BoNT-A injection in spasticity and dystonia (100%). Virtual models might be an appropriate alternative, to some extent, if no cadaveric specimens or prosections are available (88%). Artificial models are additional tools for teaching US and other injection-guidance techniques alongside cadavers (100%).
Just one statement (“As part of a holistic multimodal approach to treat movement disorders, the word ‘injector’ should be replaced with ‘experts in the management of spasticity and movement disorders’”) failed to reach consensus after Round 3.

3. Discussion

Currently, several programs offer training in anatomy and BoNT-A injection techniques, such as the international Ixcellence Network® [18,19]; the European Musculoskeletal Ultrasound Study Group (EURO-MUSCULUS)/Ultrasound Study Group in Physical and Rehabilitation Medicine (USPRM) program [20]; the Scandinavian Diploma Education in Dystonia and Spasticity Treatment (SKANDYSPAS) program in Denmark, Norway, and Sweden [21]; country-specific training programs in Germany [22] and France [23]; society-specific training programs (such as the STEP Interventional Spasticity Certificate Program from the American Academy of Physical Medicine and Rehabilitation [24]); and a recently piloted, inter-institutional, hybrid training curriculum for PM&R residents in the USA [25]. However, whether training programs are tailored towards physicians in university and specialty education settings or towards neurologists and PM&R specialists in clinical practice, there are currently no standardized guidelines for curriculum design to ensure that the programs are adequate. We believe the current research therefore addresses a significant gap, and we hope that our best-practice recommendations will enhance and standardize existing training programs and guide the development of such programs in countries where they are currently lacking.
Experts unanimously affirmed the crucial importance of considering the target audience. Taking into account the participants’ knowledge and skill levels will help trainers and faculty to tailor educational activities to the audience’s learning needs, thus maximizing immediate benefits and instilling confidence in the participants to put their skills into practice.
Unanimous agreement was also reached concerning the need for instructors to align on training techniques, nomenclature, and messaging; this could be facilitated by a pre-training faculty meeting. Experts also agreed that training programs should be as simple as possible, using only what most physicians would typically have in their office (such as a US machine, a needle, and a “patient”). Simplicity in terms of curriculum content ensures that training goals are clear, succinct, and easily assessed (for an example, see Figure 1). Where participants require comprehensive information about assessment and/or management of specific movement disorders, pre-existing educational materials may be used, such as the Toxnet curriculum. Toxnet is a global education initiative that aims to raise awareness of best clinical practices in spasticity and offers a comprehensive “blueprint” training course [10,15,26,27,28]. Training programs should also be adaptable so they can accommodate country-specific needs (e.g., product labeling) and audience characteristics, such as skill level. While learners can be stratified prior to training, levels of skill and understanding may be different than anticipated, and in such cases the trainer would need to adapt training to the learners’ needs.
Another core principle of effective training programs is maximization of engagement and learning by prioritizing hands-on, practical training over didactic sessions and by incorporating gamification techniques [29].
Substantial evidence and experience attests to the superiority of instrumented guidance versus manual palpation alone [1,5,14,30,31,32]. Accordingly, experts agreed that instructors should explain that manual palpation alone is not preferred for targeting muscles for BoNT-A injection, and the sole use of manual palpation should be considered only when other guidance methods are unavailable [11]. Most experts felt that course participants should be trained to use other techniques (e.g., EMG, e-stim) in programs that focus on US so that they become equipped to treat patients regardless of the available resources [5].
There was full agreement that, when available, cadavers are the optimal specimens for instruction on anatomy and US-guided injection (Table 2). However, prosected limbs could be used instead of whole-body cadavers and extensive dissection to save both time and money. Live models might also be helpful for demonstrating US guidance on real-life anatomy and for allowing participants to practice using EMG, which cannot be used on cadaveric specimens.
One statement failed to achieve consensus (“As part of a holistic multimodal approach to treat movement disorders, the word ‘injector’ should be replaced with ‘experts in the management of spasticity and movement disorders’”). While most panel members agreed that “injector” neither represents the skill and expertise necessary to administer BoNT-A injections nor recognizes that BoNT-A is part of a broader treatment approach, one expert did not agree with the suggested replacement term and another felt that “injector” was appropriate.
As a consensus approach, Delphi methodology is particularly useful in areas with limited empirical evidence, as it can form initial opinion and set the direction for scientific research [33]. One advantage of the method is anonymity [34,35]. In our modified Delphi, anonymity was implemented during Rounds 2 and 3, but not in Round 1. However, it is common for modified Delphi studies to include expert interaction, often as the first stage in the process [33,36] and typically taking the form of meetings and group discussions [37,38,39], advisory boards [40], or workshops [41]. In such cases, the benefits of face-to-face interaction, such as the ability to clarify reasons for disagreements, compensate for the lack of anonymity [36].
While our Delphi panel comprised only nine experts, all have extensive teaching and clinical experience and are representative of academic physiatrists involved in teaching BoNT-A injection techniques using US guidance. Several panelists have been authors of expert opinion papers in this area [3,42], and all use injection-guidance techniques in their clinical practice. Further, a Delphi panel of five to 10 participants is generally considered adequate [43,44].
One potential limitation of our study is that expert panel members only represented the USA, Canada, and Europe; unrepresented regions may have different educational needs and resources. Heterogeneous panels are generally recommended to obtain a wider range of perspectives with global relevance. This limitation could be overcome by inviting experts from other regions to repeat Round 2 and 3 questionnaires with subsequent analysis of aggregate data. Additionally, one expert was unable to participate in Round 2. However, this panel member reviewed the anonymized voting results from Round 2, agreed with the outcome, and went on to complete Round 3. Including panel members who missed a previous round in subsequent rounds of a Delphi process may reduce the risk of false consensus and enhance representation of the original panel’s opinions, without affecting the final outcome [45]. A further potential limitation was that no empirical validation of the findings of the Delphi process was performed to evaluate their effectiveness in improving clinical outcomes. Future work could aim to gather real-world evidence to ensure the effectiveness and applicability of these best-practice principles across a variety of healthcare settings, and expand on technical aspects to cover in the training programs.

4. Conclusions

In conclusion, and to the best of our knowledge, this is the first time a modified Delphi approach has been used to establish best practices for anatomy teaching and BoNT-A injection training for physicians who treat spasticity and dystonia. Knowledge of the target audience, instructor alignment, and use of a simple, adaptable curriculum were identified as core principles in designing effective training. It is hoped that the best-practice principles identified by this process will be used to develop effective, standardized training programs, with the goal of enhancing the exchange of knowledge, skills, and educational approaches between experts around the world, allowing more physicians to treat important conditions such as spasticity or dystonia, and ultimately improving patient outcomes.

5. Materials and Methods

5.1. Study Design

A three-round modified Delphi process (November 2022–April 2023) was used to build expert consensus on optimal approaches for training on anatomy and US guidance for BoNT-A injections in spasticity and dystonia. The Delphi technique is a widely accepted method for establishing consensus among experts on a specific issue or problem, especially where published evidence is limited or contradictory [43,46,47]. In this iterative process, experts rank their agreement with a series of statements in several rounds of voting until consensus is reached; while up to four rounds of voting may be used, two are usually sufficient [48].
In the basic Delphi technique, experts provide feedback anonymously via self-administered questionnaires in all voting rounds [36]. In a modified Delphi process, however, self-administered questionnaires are typically combined with a face-to-face meeting to facilitate expert interaction [36,43], usually in the first round [33]. We used a modified Delphi process comprising one face-to-face meeting and two subsequent rounds of self-administered questionnaires (Figure 2).

5.2. Participants

Experts were selected on the basis of their academic background and experience in using BoNT. One major criterion was their involvement in designing and managing spasticity training programs, such as university, local, or national curricula. Given that more than half of the expert panel had extensive knowledge of dystonia and that best-practice principles for training program design would likely apply to both spasticity and dystonia, dystonia was also considered in the modified Delphi process. Another criterion was that each expert should have >10 years of experience with injecting BoNT and should be familiar with all available injection-guidance techniques, as well as still treating patients. Experts were selected from North America and Europe, as healthcare professionals in these regions have, on average, the greatest experience in treating spasticity with BoNT. The size of the expert panel was limited to allow constructive discussions in Round 1.
The expert panel was composed of nine healthcare professionals, comprising three neurologists and six PM&R physicians from the USA (n = 5), Canada (n = 2), Denmark (n = 1), and Germany (n = 1). These experts have a wealth of professional knowledge and experience in treating spasticity and dystonia, with >187 years of combined experience in using BoNT injection to treat these and other movement disorders. All panelists have academic appointments at universities and teaching hospitals, and all serve as faculty members, chairs, or co-chairs on national or international teaching programs on anatomy and/or the use of US. Example expert opinion publications from panelists include an article evaluating the ergonomics of US-guided BoNT-A injection in spasticity (O.K., M.V-G., R.R.) [42] and an article exploring the role of US in cervical dystonia treatment (T.B.) [3].

5.3. Delphi Survey Rounds

5.3.1. Round 1

Round 1 was a face-to-face advisory board meeting, convened in November 2022 and attended by all nine experts. In a series of presentations and discussions, experts explored anatomy and BoNT-A injection training programs in the geographical regions represented by the panel (USA, Canada, Germany, Scandinavia). There was also a practical session in which experts injected different agents into the muscles of cadaveric specimens to simulate BoNT-A injection, both with and without US guidance. This helped guide the experts’ deliberations about how anatomy, muscle localization, and BoNT-A injection techniques should be taught in training courses.
There was no voting in Round 1. Instead, experts generated a set of initial statements describing key best practices for developing training courses for anatomy teaching and BoNT-A injection techniques for spasticity and dystonia treatment. These initial statements were refined in subsequent rounds.

5.3.2. Round 2

In Round 2, conducted in February 2023, the initial 16 statements generated in the advisory board meeting (Round 1) were circulated to experts as an online questionnaire via Typeform. Experts were requested to vote on the statements by marking each with “agree” or “disagree,” and were encouraged to revise any statements they disagreed with. Consensus for any statement was achieved if 80% of experts agreed with it. Statements that achieved consensus were retained without modification, while statements that did not achieve consensus (<80% agreement) were modified according to experts’ feedback and used to develop the questionnaire for Round 3. Experts remained anonymous throughout Round 2.

5.3.3. Round 3

Round 3 was conducted in March/April 2023. After modification, statements that did not reach consensus in Round 2 were circulated to experts in another online questionnaire via Typeform (the original statements were also provided so that experts could reflect on the previous statements). Experts voted in the same way as in Round 2, with consensus again defined as 80% agreement for any given statement and with experts remaining anonymous throughout the voting process. A final list of statements describing best-practice principles for developing training courses for anatomy teaching and BoNT-A injection techniques was generated at the end of Round 3, comprising all statements that achieved consensus and those that did not.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/toxins16080371/s1, Table S1: Statements generated at the advisory board meeting (Round 1); Table S2: Statements reaching consensus/no consensus after Round 2 voting.

Author Contributions

Conceptualization, methodology, validation, formal analysis, investigation, resources, data curation, writing—original draft preparation, writing—review and editing, visualization, supervision, project administration, funding acquisition, K.H., B.B.-S., T.B., O.K., F.P., M.P., T.S., M.V.-G., and R.R. All authors have read and agreed to the published version of the manuscript.

Funding

The advisory board and Delphi panel were funded by Merz Therapeutics GmbH.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data are contained within the article or Supplementary Material.

Acknowledgments

Sam Reed and Julie Smith provided medical writing support funded by Merz Therapeutics GmbH.

Conflicts of Interest

K.H. has been a paid consultant to AbbVie, Ipsen, and Merz Therapeutics. B.B-S. has received lecture/advisory board honoraria from Ipsen, Merz Therapeutics, Desitin, Allergan/AbbVie, UCB Pharma, Medtronic, Nordic Infucare, Berlin-Chemie AG, Orion Pharma, Almirall Nordic, Innoventa Medica, and Bial, and unconditional grants/funding for investigator-initiated trials from Allergan/AbbVie, Nordic Infucare, Merz Therapeutics, Desitin, Toyota Foundation, and the Danish Parkinson Association. T.B. has received speaker and consultant fees from Pelzerhaken Children’s Centre, Allergan/AbbVie, Ipsen Pharma, and Merz Therapeutics. O.K. has received grants/consulting fees from Merz Therapeutics, Ipsen, and Allergan/AbbVie. F.P. has received speaker/consultant fees from Acorda, Amneal, AbbVie, Adamas, Kyowa Kirin, Merz Therapeutics, Neurocrine, Sunovion, Supernus, Teva, and US World Meds, and educational or research grants from Medtronic, US World Meds, Novartis, Sun Pharma, NIH/NIA, and ADDF. M.P. has been a paid consultant to AbbVie, Ipsen, Merz Therapeutics, and Revanse. T.S. has received speaker/consultant fees and grants from Merz Therapeutics. M.V.-G. has paid research to her institution from Ipsen, and has been a paid consultant to Merz Therapeutics, Ipsen, AbbVie, and Piramal. R.R. has received consulting/advisory board fees from Merz Therapeutics, Ipsen, and AbbVie. The funders facilitated the collection and analyses of data and had no role in the design of the study; in interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Alter, K.E.; Karp, B.I. Ultrasound guidance for botulinum neurotoxin chemodenervation procedures. Toxins 2017, 10, 18. [Google Scholar] [CrossRef]
  2. Simpson, D.M.; Hallett, M.; Ashman, E.J.; Comella, C.L.; Green, M.W.; Gronseth, G.S.; Armstrong, M.J.; Gloss, D.; Potrebic, S.; Jankovic, J.; et al. Practice guideline update summary: Botulinum neurotoxin for the treatment of blepharospasm, cervical dystonia, adult spasticity, and headache: Report of the Guideline Development Subcommittee of the American Academy of Neurology. Neurology 2016, 86, 1818–1826. [Google Scholar] [CrossRef] [PubMed]
  3. Fietzek, U.M.; Nene, D.; Schramm, A.; Appel-Cresswell, S.; Košutzká, Z.; Walter, U.; Wissel, J.; Berweck, S.; Chouinard, S.; Bäumer, T. The role of ultrasound for the personalized botulinum toxin treatment of cervical dystonia. Toxins 2021, 13, 365. [Google Scholar] [CrossRef] [PubMed]
  4. Chung, T.M.; Jacinto, L.J.; Colosimo, C.; Bhatia, K.P.; Tiley, J.; Bhidayasiri, R. Botulinum neurotoxin-A injection in adult cervical dystonia and spastic paresis: Results from the INPUT (INjection Practice, Usage and Training) survey. Front. Neurol. 2020, 11, 570671. [Google Scholar] [CrossRef] [PubMed]
  5. Asimakidou, E.; Sidiropoulos, C. A Bayesian network meta-analysis and systematic review of guidance techniques in botulinum toxin injections and their hierarchy in the treatment of limb spasticity. Toxins 2023, 15, 256. [Google Scholar] [CrossRef]
  6. Lapatki, B.G.; van Diyk, J.P.; van de Warrenburg, B.P.C.; Zwarts, M.J. Botulinum toxin has an increased effect when targeted toward the muscle’s endplate zone: A high-density surface EMG guided study. Clin. Neurophysiol. 2011, 122, 1611–1616. [Google Scholar] [CrossRef]
  7. Heckert, K. (Department of Rehabilitation Medicine, Thomas Jefferson University, Philadelphia, PA, USA); Personal communication, 2024.
  8. Walter, U. Muscle ultrasound in clinical neurology: Diagnostic uses and guidance of botulinum toxin injection. J. Neurosonol. Neuroimag. 2023, 15, 38–53. [Google Scholar] [CrossRef]
  9. Wissel, J.; Ward, A.B.; Erztgaard, P.; Bensmail, D.; Hecht, M.J.; Lejeune, T.M.; Schnider, P. European consensus table on the use of botulinum toxin type A in adult spasticity. J. Rehabil. Med. 2009, 41, 13–25. [Google Scholar] [CrossRef]
  10. Reebye, R.; Balbert, A.; Bensmail, D.; Walker, H.; Wissel, J.; Deltombe, T.; Francisco, G.E. Module 2: Nonsurgical management of spasticity. J. Int. Soc. Phys. Rehabil. Med. 2022, 5, S23–S37. [Google Scholar] [CrossRef]
  11. Francisco, G.E.; Balbert, A.; Bavikatte, G.; Bensmail, D.; Carda, S.; Deltombe, T.; Draulans, N.; Escaldi, S.; Gross, R.; Jacinto, J.; et al. A practical guide to optimizing the benefits of post-stroke spasticity interventions with botulinum toxin A: An international group consensus. J. Rehabil. Med. 2021, 53, jrm00134. [Google Scholar] [CrossRef]
  12. Loens, S.; Brüggemann, N.; Steffen, A.; Bäumer, T. Localization of salivary glands for botulinum toxin treatment: Ultrasound versus landmark guidance. Mov. Disord. Clin. Pract. 2019, 7, 194–198. [Google Scholar] [CrossRef] [PubMed]
  13. Orsini, M.; Leite, M.A.; Chung, T.M.; Bocca, W.; de Souza, J.A.; de Souza, O.G.; Moreira, R.P.; Bastos, V.H.; Teixeira, S.; Oliveira, A.B.; et al. Botulinum neurotoxin type A in neurology: Update. Neurol. Int. 2015, 7, 5886. [Google Scholar] [CrossRef] [PubMed]
  14. Wissel, J.; Camões-Barbosa, A.; Carda, S.; Hoad, D.; Jacinto, J. A practical guide to botulinum neurotoxin treatment of shoulder spasticity 2: Injection techniques, outcome measurement scales, and case studies. Front. Neurol. 2022, 13, 1022549. [Google Scholar] [CrossRef] [PubMed]
  15. Escaldi, S.; Bianchi, F.; Bavikatte, G.; Molteni, F.; Moraleda, S.; Deltombe, T.; Francisco, G.E. Module 1: Pathophysiology and assessment of spasticity; goal setting. J. Int. Soc. Phys. Rehabil. Med. 2022, 5, S3–S22. [Google Scholar] [CrossRef]
  16. Fitterer, J.W.; Picelli, A.; Winston, P. A novel approach to new-onset hemiplegic shoulder pain with decreased range of motion using targeted diagnostic nerve blocks: The ViVe algorithm. Front. Neurol. 2021, 12, 668370. [Google Scholar] [CrossRef]
  17. Royal College of Physicians, British Society of Rehabilitation Medicine, The Chartered Society of Physiotherapy, Association of Chartered Physiotherapists in Neurology and the Royal College of Occupational Therapists. Spasticity in Adults: Management Using Botulinum Toxin. National Guidelines. 2018. Available online: https://www.rcp.ac.uk/improving-care/resources/spasticity-in-adults-management-using-botulinum-toxin/ (accessed on 30 July 2024).
  18. Fheodoroff, K.; Bhidayasiri, R.; Jacinto, L.J.; Chung, T.M.; Bhatia, K.; Landreau, T.; Colosimo, C. Ixcellence Network®: An international educational network to improve current practice in the management of cervical dystonia or spastic paresis by botulinum toxin injection. Funct. Neurol. 2017, 32, 103–110. [Google Scholar] [CrossRef]
  19. Colosimo, C.; Bhidayasiri, R.; Fheodoroff, K.; Bhatia, K.; Chung, T.M.; Landreau, T.; Jacinto, L.J. Management of spastic paresis and cervical dystonia: Access to therapeutic innovations through an international program of practical courses. Clin. Ther. 2019, 41, 2321–2330.e4. [Google Scholar] [CrossRef]
  20. International Society of Physical and Rehabilitation Medicine. EURO-MUSCULUS Course in Lisbon in December 2019. Available online: https://isprm.org/euro-musculus-course-in-lisbon-in-december-2019/ (accessed on 30 July 2024).
  21. Scandinavian Education Society for Dystonia and Spasticity Treatment. Courses. Available online: https://www.skandyspas.com/en/kurser (accessed on 30 July 2024).
  22. DGN (The Botulinum Toxin Working Group of the German Society for Neurology). Available online: https://www.ak-botulinumtoxin.de/ (accessed on 30 July 2024).
  23. Jourdan, C.; Bévalot, J.; Denormandie, P.; Dionnet, A.; Parratte, B. Training evaluation for a practice in spasticity-related techniques. Ann. Phys. Rehabil. Med. 2015, 58, 114–115. [Google Scholar] [CrossRef]
  24. American Academy of Physical Medicine and Rehabilitation. STEP Interventional Spasticity Certificate Program. Available online: https://www.aapmr.org/education/step-certificate-programs/step-interventional-spasticity-certificate-program (accessed on 30 July 2024).
  25. Raja, A.E.; Emam, M.; Shustorovich, A.; Tatini, A.L.; Coslick, A.; Dreher, G.M.; Singh, A.D.; Friedlander, T.; Morice, K.; Kim, S.Y. A hybrid musculoskeletal ultrasound curriculum for physical medicine and rehabilitation residents-a multi-center pilot program. Curr. Phys. Med. Rehabil. Rep. 2023, 11, 51–61. [Google Scholar] [CrossRef]
  26. Deltombe, T.; Francisco, G.E. Comprehensive curriculum on spasticity assessment and management. J. Int. Soc. Phys. Rehabil. Med. 2022, 5, S1–S2. [Google Scholar] [CrossRef]
  27. Gross, R.; Verduzco-Gutierrez, M.; Draulans, N.; Zimerman, M.; Francisco, G.E.; Deltombe, T. Module 3: Surgical management of spasticity. J. Int. Soc. Phys. Rehabil. Med. 2022, 5, S38–S49. [Google Scholar] [CrossRef]
  28. Ketchum, N.; Carda, S.; O’Dell, M.W.; Säterö, P.; Jacinto, J.; Deltombe, T.; Francisco, G.E. Module 4: Optimizing outcomes in spasticity treatment. J. Int. Soc. Phys. Rehabil. Med. 2022, 5, S50–S60. [Google Scholar] [CrossRef]
  29. Ali, M.F.; Nadeem, N.; Khalid, F.; Anwar, N.M.; Nabie, G.; Docherty, C. SonoGames: Sounds of the right kind introducing gamification into radiology training. BMC Res. Notes 2021, 14, 341. [Google Scholar] [CrossRef]
  30. Picelli, A.; Tamburin, S.; Bonetti, P.; Fontana, C.; Barausse, M.; Dambruoso, F.; Gajofatto, F.; Santilli, V.; Smania, N. Botulinum toxin type A injection into the gastrocnemius muscle for spastic equinus in adults with stroke: A randomized controlled trial comparing manual needle placement, electrical stimulation and ultrasonography-guided injection techniques. Am. J. Phys. Med. Rehabil. 2012, 91, 957–964. [Google Scholar] [CrossRef]
  31. Chan, A.K.; Finlayson, H.; Mills, P.B. Does the method of botulinum neurotoxin injection for limb spasticity affect outcomes? A systematic review. Clin. Rehabil. 2017, 31, 713–721. [Google Scholar] [CrossRef]
  32. Grigoriu, A.I.; Dinomais, M.; Rémy-Néris, O.; Brochard, S. Impact of injection-guiding techniques on the effectiveness of botulinum toxin for the treatment of focal spasticity and dystonia: A systematic review. Arch. Phys. Med. Rehabil. 2015, 96, 2067–2078.e1. [Google Scholar] [CrossRef]
  33. Shang, Z. Use of Delphi in health sciences research: A narrative review. Medicine 2023, 102, e32829. [Google Scholar] [CrossRef] [PubMed]
  34. Hodgson, S.H.; Khan, M.M.; Patrick-Smith, M.; Martinez-Devesa, P.; Stapleton, E.; Williams, O.M.; Pretorius, P.; McNally, M.; Andersson, M.I. UK consensus definitions for necrotising otitis externa: A Delphi study. BMJ Open 2023, 13, e061349. [Google Scholar] [CrossRef]
  35. Rahaghi, F.F.; Baughman, R.P.; Saketkoo, L.A.; Sweiss, N.J.; Barney, J.B.; Birring, S.S.; Costabel, U.; Crouser, E.D.; Drent, M.; Gerke, A.K.; et al. Delphi consensus recommendations for a treatment algorithm in pulmonary sarcoidosis. Eur. Respir. Rev. 2020, 29, 190146. [Google Scholar] [CrossRef]
  36. Boulkedid, R.; Abdoul, H.; Loustau, M.; Sibony, O.; Alberti, C. Using and reporting the Delphi method for selecting healthcare quality indicators: A systematic review. PLoS ONE 2011, 6, e20476. [Google Scholar] [CrossRef]
  37. Krämer, J.; Baerwald, C.; Heimbold, C.; Kamrath, C.; Parhofer, K.G.; Reichert, A.; Rutsch, F.; Stolz, S.; Weinhold, N.; Muntau, A.C. Two years of pegvaliase in Germany: Experiences and best practice recommendations. Mol. Genet. Metab. 2023, 139, 107564. [Google Scholar] [CrossRef] [PubMed]
  38. Watson, K.E.; Dhaliwal, K.; Robertshaw, S.; Verdin, N.; Benterud, E.; Lamont, N.; Drall, K.M.; McBrien, K.; Donald, M.; Tsuyuki, R.T.; et al. Consensus recommendations for sick day medication guidance for people with diabetes, kidney, or cardiovascular disease: A modified Delphi process. Am. J. Kidney Dis. 2023, 81, 564–574. [Google Scholar] [CrossRef] [PubMed]
  39. Hai, Y.; Liu, J.; Liu, Y.; Liu, T.; Zhang, X.; Pan, A.; Zhang, Y.; Ding, H.; Wu, Y.; Han, B.; et al. Expert consensus on clinical application of lateral lumbar interbody fusion: Results from a modified Delphi study. Global Spine J. 2023, 13, 995–1004. [Google Scholar] [CrossRef] [PubMed]
  40. Bodó, I.; Amine, I.; Boban, A.; Bumbea, H.; Kulagin, A.; Lukina, E.; Piekarska, A.; Zupan, I.P.; Sokol, J.; Windyga, J.; et al. Complement inhibition in paroxysmal nocturnal hemoglobinuria (PNH): A systematic review and expert opinion from central Europe on special patient populations. Adv. Ther. 2023, 40, 2752–2772. [Google Scholar] [CrossRef]
  41. Feo, R.; Conroy, T.; Jangland, E.; Muntlin Athlin, Å.; Brovall, M.; Parr, J.; Blomberg, K.; Kitson, A. Towards a standardised definition for fundamental care: A modified Delphi study. J. Clin. Nurs. 2018, 27, 2285–2299. [Google Scholar] [CrossRef]
  42. Lagnau, P.; Lo, A.; Sandarage, R.; Alter, K.; Picelli, A.; Wissel, J.; Verduzco-Gutierrez, M.; Suputtitada, A.; Munin, M.C.; Carda, S.; et al. Ergonomic recommendations in ultrasound-guided botulinum neurotoxin chemodenervation for spasticity: An international expert group opinion. Toxins 2021, 13, 249. [Google Scholar] [CrossRef]
  43. Eubank, B.H.; Mohtadi, N.G.; Lafave, M.R.; Wiley, J.P.; Bois, A.J.; Boorman, R.S.; Sheps, D.M. Using the modified Delphi method to establish clinical consensus for the diagnosis and treatment of patients with rotator cuff pathology. BMC Med. Res. Methodol. 2016, 16, 56. [Google Scholar] [CrossRef]
  44. Barlassina, A.; González-López, T.J.; Cooper, N.; Zaja, F. European Delphi panel to build consensus on tapering and discontinuing thrombopoietin receptor agonists in immune thrombocytopenia. Platelets 2023, 34, 2170999. [Google Scholar] [CrossRef]
  45. Boel, A.; Navarro-Compán, V.; Landewé, R.; van der Heijde, D. Two different invitation approaches for consecutive rounds of a Delphi survey led to comparable final outcome. J. Clin. Epidemiol. 2021, 129, 31–39. [Google Scholar] [CrossRef]
  46. Jones, J.; Hunter, D. Consensus methods for medical and health services research. BMJ 1995, 311, 376–380. [Google Scholar] [CrossRef]
  47. Hsu, C.-C.; Sandford, B.A. The Delphi technique: Making sense of consensus. Pract. Assess. Res. Eval. 2007, 12, 10. [Google Scholar] [CrossRef]
  48. Nasa, P.; Jain, R.; Juneja, D. Delphi methodology in healthcare research: How to decide its appropriateness. World J. Methodol. 2021, 11, 116–129. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Example goals for a simple curriculum design 1 for anatomy and BoNT-A injection training courses. 1 Based on the Scandinavian Diploma Education in Dystonia and Spasticity Treatment (SKANDYSPAS) training program [21].
Figure 1. Example goals for a simple curriculum design 1 for anatomy and BoNT-A injection training courses. 1 Based on the Scandinavian Diploma Education in Dystonia and Spasticity Treatment (SKANDYSPAS) training program [21].
Toxins 16 00371 g001
Figure 2. Modified Delphi process.
Figure 2. Modified Delphi process.
Toxins 16 00371 g002
Table 1. Final statements after a three-round modified Delphi consensus process.
Table 1. Final statements after a three-round modified Delphi consensus process.
StatementConsensus Level
Consensus
  • The core learning objectives should be based on target audience and region.
100%
 1a.
How can we enhance existing educational programs? 1
100%
 1b.
How can we improve knowledge and competency of the target audience? 1
100%
2.
The target audience is important for the program design (e.g., university-level faculty, residents, or any educator).
100%
 2a.
Depending on the level of the training (basic or advanced) and limited availability, a recommendation or qualification for participation in trainings should be considered.
100%
 2b.
Programs should look beyond physiatrists and neurologists as participants.
88%
 2c.
Depending on local scope of practice, programs can be tailored for allied health colleagues (i.e., physiotherapists, occupational therapists) to enhance their knowledge of anatomy related to post-stroke spasticity.
89%
3.
A curriculum with a simple design and an adaptable framework is needed.
100%
4.
The training should provide participants with skills for which objective improvement can be demonstrated after the conclusion of the course.
100%
5.
Trainers and participants should be able to demonstrate their engagement during the training program through hands-on activities.
100%
 5a.
Participants should have the opportunity to perform guidance techniques (e.g., ultrasound [US]) in the training.
100%
 5b.
If possible, trainers should provide trainees with (pre- and) post-training assessments.
89%
6.
A program needs to assure uniformity of the teaching approach and consistency in coverage of key topics in the training program across different dates and regions.
100%
 6a.
Instructors in all trainings should align on the use of similar nomenclature to describe critical procedures and anatomy.
100%
7.
All educational programs should strive for diversity, equity, and inclusion of trainers by considering the competencies in the specific areas trained.
89%
8.
Participants should have a basic understanding of US in case those basics (like knobology or ergonomics) are not part of the training.
89%
9.
The training program should include additional instruction on the importance of other techniques (electromyography [EMG], electrical stimulation [e-stim], computed tomography [CT]) besides US-guided injection to ensure that the participants learn about other techniques.
89%
 9a.
What are the limitations and pitfalls of the different techniques? 1
88%
 9b.
What evidence supports these techniques? 1
88%
10.
Botulinum neurotoxin injections represent an important part of a broader holistic multimodal approach to treating movement disorders.
100%
12.
A training program should include how to implement goal-setting and how to evaluate patients.
100%
13.
The lead organizer/trainer should conduct, if possible, “Train the trainer” meetings (e.g., lunches/dinners) to ensure alignment between all instructors before the training.
100%
14.
When designing a program, identify available strengths in local university/hospital departments and find ways to leverage them for teaching.
100%
15.
Participants should have the opportunity to complete a post-training survey to rate the instructors in their role as educators.
100%
16.
If available, cadaveric specimens (full body or prosection) should be used to enhance anatomy teaching for spasticity management and US-guided techniques.
100%
 16a.
Virtual models can, to some degree, substitute for actual cadaveric specimens for teaching anatomy.
88%
 16b.
Artificial models can be used as an additional training tool besides cadaveric specimens for teaching US and injection techniques.
100%
No consensus
11.
As part of a holistic multimodal approach to treat movement disorders, the word “injector” should be replaced with “experts in the management of spasticity and movement disorders”.
78%
1 Sub-statements that take the form of open-ended questions indicate issues that should be considered in light of the corresponding primary statement. Specifically, sub-statements 1a and 1b indicate that experts responsible for developing and delivering training programs should consider how to enhance existing educational programs (1a) and how to improve the knowledge and competency of the target audience (1b) when selecting core learning objectives based on target audience and region. Sub-statements 9a and 9b indicate that when experts are deciding which guidance techniques to include in the training program, they should also consider adding instruction about the limitations and pitfalls of the techniques (9a) and the evidence supporting these techniques (9b).
Table 2. Advantages of using cadaveric specimens in the development of injection approach: authors’ perspectives and experiences.
Table 2. Advantages of using cadaveric specimens in the development of injection approach: authors’ perspectives and experiences.
Advantages of Using Cadavers
  • Aids understanding of muscle anatomy
Cadaver dissection allows for a detailed understanding of muscle anatomy, including the size, shape, and location of individual muscles and their relationship to surrounding structures. This is crucial when targeting specific muscles for injection of BoNT-A.
2.
Aids understanding of nerve supply
Cadaver dissection can help clinicians understand the nerve supply to different muscles. This is important for BoNT-A injections, as the toxin must be injected directly into affected muscles to maximize effectiveness. Furthermore, comprehensive understanding of muscle nerve supply allows clinicians to practice diagnostic nerve blocks, which can be an important part of patient assessment. This knowledge also has broader implications for current and developing spasticity treatments, such as chemoneurolysis and cryolysis.
3.
Allows practicing injection techniques
Cadavers can provide an opportunity to practice injection techniques in a realistic setting. This can help clinicians improve their skills and become more comfortable with the procedure.
4.
Aids understanding of variations
Each human body is unique. By studying cadavers, clinicians can gain a better understanding of the variations that exist in human anatomy, which can help them tailor their injection techniques to individual patients.
5.
Allows visualization of deep structures
In some cases, the muscles affected by post-stroke spasticity may be deep within the body. Cadaver dissection can help clinicians visualize these deep structures and understand how to target them with BoNT-A injections.
6.
Aids injection safety
Understanding the precise location of muscles, nerves, and blood vessels can help prevent complications, such as injecting the toxin into blood vessels or causing damage to nerves during BoNT-A administration.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Heckert, K.; Biering-Sørensen, B.; Bäumer, T.; Khan, O.; Pagan, F.; Paulin, M.; Stitik, T.; Verduzco-Gutierrez, M.; Reebye, R. Delphi Analysis: Optimizing Anatomy Teaching and Ultrasound Training for Botulinum Neurotoxin Type A Injection in Spasticity and Dystonia. Toxins 2024, 16, 371. https://doi.org/10.3390/toxins16080371

AMA Style

Heckert K, Biering-Sørensen B, Bäumer T, Khan O, Pagan F, Paulin M, Stitik T, Verduzco-Gutierrez M, Reebye R. Delphi Analysis: Optimizing Anatomy Teaching and Ultrasound Training for Botulinum Neurotoxin Type A Injection in Spasticity and Dystonia. Toxins. 2024; 16(8):371. https://doi.org/10.3390/toxins16080371

Chicago/Turabian Style

Heckert, Kimberly, Bo Biering-Sørensen, Tobias Bäumer, Omar Khan, Fernando Pagan, Mitchell Paulin, Todd Stitik, Monica Verduzco-Gutierrez, and Rajiv Reebye. 2024. "Delphi Analysis: Optimizing Anatomy Teaching and Ultrasound Training for Botulinum Neurotoxin Type A Injection in Spasticity and Dystonia" Toxins 16, no. 8: 371. https://doi.org/10.3390/toxins16080371

APA Style

Heckert, K., Biering-Sørensen, B., Bäumer, T., Khan, O., Pagan, F., Paulin, M., Stitik, T., Verduzco-Gutierrez, M., & Reebye, R. (2024). Delphi Analysis: Optimizing Anatomy Teaching and Ultrasound Training for Botulinum Neurotoxin Type A Injection in Spasticity and Dystonia. Toxins, 16(8), 371. https://doi.org/10.3390/toxins16080371

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop