Magnetic Resonance Simulation in Education: Quantitative Evaluation of an Actual Classroom Experience †
Abstract
:1. Background
2. Methods
2.1. The MRI Simulator
- The system should be able to simulate images created from a set of acquisition sequences that constitute a protocol. The user should also be able to create and execute those protocols. Patient positioning and coil selection should also be available.
- The user should be able to change basic acquisition parameters, such as (echo time), (repetition time) and, where applicable, (inversion time), flip angle, (echo train length) and others.
- Geometrical planning should be included in the simulation workflow, from slice orientation to the determination of the FOV (field of view), slice thickness, slice separation, and selection of phase/frequency encoding directions.
- Acquisition artifacts should be generated at trainer demand.
- k-space manipulation should be supported.
- Different educational roles should be supported, allowing trainers to create educational scenarios and trainees to work on those scenarios and report their results.
- Short simulation times are needed so that action/reaction is possible in acceptable times for an educational session.
- The system should be easy to access/install and able to work over a wide range of platforms.
- The system will avoid, whenever possible, the specificities associated to each manufacturer as well as to use vendor-associated sequence names.
2.1.1. Architectural Design and Technologies for Implementation
2.1.2. Interface Overview
2.1.3. Simulation Overview
2.2. Participants
2.3. Experimental Design
- An introductory lecture was given to all participants, where the essentials of the experimental design were explained. We clearly stated its optional character and students were guaranteed of anonymity preservation, and null effects on this experiment in their final grades. Then, participant written consents were collected, following the university ethics standards.
- The pre-test was performed using the instrument that is described in the Section 2.4.
- A 90-min lecture supported by slides was given to all the participants; the covered topics were: Magnetic properties of the tissues, concept of magnetic resonance, pulses and gradients in MRI, the k-space formalism and image formation, spin-echo (SE) and gradient-echo (GE) sequences and safety guidelines.
- Students were randomly assigned to the EG/CG. The EG was guided to a computer room located in a nearby building by the former, while the CG remained in the classroom and was awarded a short break in order to allow a perfect synchronization between both groups. Then, a 90-min lecture was given to both groups including the following topics: k-space formation, relevant time parameters in MRI sequences (mainly, and ), geometrical planning and related parameters, and image artifacts. In the CG, these topics were covered by means of a slides presentation where the effects of parameter choices were illustrated. In the EG, participants employed the MRI simulator through hands-on guided exercises to see the topics.Both lectures contents were agreed with the school faculty as a trade-off between the topics that could be covered by the simulator and the expected learning outcomes of the school in terms of magnetic resonance imaging. The material used for preparing these contents were both well-known academic references [25,26] and popular web sites related to MRI fundamentals (https://mrimaster.com/, http://mriquestions.com/, http://xrayphysics.com/ the three of them last accessed on 30 July 2021).
- The post-test was given to both groups.
2.4. Measure Instrument
2.5. Statistical Analysis
3. Results
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
field inhomogeinity | |
API | Application Program Interface |
CG | Control Group |
EG | Experimental Group |
ETL | Echo Train Length |
FOV | Field Of View |
GE | Gradient-Echo |
GUI | Graphical User Interface |
MRI | Magnetic Resonance Imaging |
MVVM | Model-View-ViewModel |
NE | Null Expectation |
P part | Practical part |
PD | Proton Density |
REST | Representational State Transfer |
SD | Standard Deviation |
SE | Spin-Echo |
SOA | Service-Oriented Architecture |
SOAP | Simple Access Protocol |
T part | Theoretical part |
Longitudinal Relaxation Time | |
Transverse Relaxation Time | |
Echo Time | |
Inversion Time | |
Repetition Time |
Appendix A. Simulation Engine Implementation Details
Appendix A.1. Anatomical Model and Model Re-Slicing
Appendix A.2. Image Contrast
Appendix A.3. Spatial Planning and Fold over Effects
Appendix A.4. Motion and Noise
Appendix B. Instrument
References
- Edelman, R.R. The history of MR imaging as seen through the pages of radiology. Radiology 2014, 273, S181–S200. [Google Scholar] [CrossRef] [Green Version]
- Jorritsma, W.; Cnossen, F.; Dierckx, R.A.; Oudkerk, M.; Ooijen, P.M.V. Post-deployment usability evaluation of a radiology workstation. Int. J. Med. Inform. 2016, 85, 28–35. [Google Scholar] [CrossRef]
- Hanson, L.G. A graphical simulator for teaching basic and advanced MR imaging techniques. Radiographics 2007, 27, e27. [Google Scholar] [CrossRef] [PubMed]
- McKagan, S.; Perkins, K.K.; Dubson, M.; Malley, C.; Reid, S.; LeMaster, R.; Wieman, C. Developing and researching PhET simulations for teaching quantum mechanics. Am. J. Phys 2008, 76, 406–417. [Google Scholar] [CrossRef] [Green Version]
- Hackländer, T.; Mertens, H. Virtual MRI: A PC-based simulation of a clinical MR scanner. Acad. Radiol. 2005, 12, 85–96. [Google Scholar] [CrossRef] [PubMed]
- Torheim, G.; Rinck, P.A.; Jones, R.A.; Kvaerness, J. A simulator for teaching MR image contrast behavior. Magn. Reson. Mater. Phys. Biol. Med. 1994, 2, 515–522. [Google Scholar] [CrossRef]
- Liu, F.; Kijowski, R.; Block, W. MRiLab: Performing fast 3D parallel MRI numerical simulation on a simple PC. In Proceedings of the ISMRM Scientific Meeting & Exhibition, Salt Lake City, UT, USA, 20–26 April 2013; Volume 2072. [Google Scholar]
- Liu, F.; Velikina, J.V.; Block, W.F.; Kijowski, R.; Samsonov, A.A. Fast Realistic MRI Simulations Based on Generalized Multi-Pool Exchange Tissue Model. IEEE Trans. Med. Imaging 2017, 36, 527–537. [Google Scholar] [CrossRef] [Green Version]
- Stöcker, T.; Vahedipour, K.; Pflugfelder, D.; Shah, N.J. High-performance computing MRI simulations. Magn. Reson. Med. 2010, 64, 186–193. [Google Scholar] [CrossRef]
- Layton, K.J.; Kroboth, S.; Jia, F.; Littin, S.; Yu, H.; Leupold, J.; Nielsen, J.F.; Stöcker, T.; Zaitsev, M. Pulseq: A rapid and hardware-independent pulse sequence prototyping framework. Magn. Reson. Med. 2017, 77, 1544–1552. [Google Scholar] [CrossRef]
- Fortin, A.; Salmon, S.; Baruthio, J.; Delbany, M.; Durand, E. Flow MRI simulation in complex 3D geometries: Application to the cerebral venous network. Magn. Reson. Med. 2018, 80, 1655–1665. [Google Scholar] [CrossRef]
- Benoit-Cattin, H.; Collewet, G.; Belaroussi, B.; Saint-Jalmes, H.; Odet, C.L. The SIMRI project: A versatile and interactive MRI simulator. J. Magn. Reson. 2005, 173, 97–115. [Google Scholar] [CrossRef]
- Xanthis, C.G.; Ioannis, E.V.; Chalkias, A.; Aletras, A. MRISIMUL: A GPU-Based Parallel Approach to MRI Simulations. IEEE Trans. Med. Imaging 2014, 33, 607–617. [Google Scholar] [CrossRef]
- Cao, Z.; Oh, S.; Sica, C.T.; McGarrity, J.M.; Horan, T.; Luo, W.; Collins, C.M. Bloch-based MRI system simulator considering realistic electromagnetic fields for calculation of signal, noise, and specific absorption rate. Magn. Reson. Med. 2014, 72, 237–247. [Google Scholar] [CrossRef]
- Kose, R.; Kose, K. BlochSolver: A GPU-optimized fast 3D MRI simulator for experimentally compatible pulse sequences. J. Magn. Reson. 2017, 281, 51–65. [Google Scholar] [CrossRef]
- Jochimsen, T.H.; von Mengershausen, M. ODIN: Object-oriented development interface for NMR. J. Magn. Reson. 2004, 170, 67–78. [Google Scholar] [CrossRef]
- Drobnjak, I.; Gavaghan, D.; Süli, E.; Pitt-Francis, J.; Jenkinson, M. Development of a functional magnetic resonance imaging simulator for modeling realistic rigid-body motion artifacts. Magn. Reson. Med. 2006, 56, 364–380. [Google Scholar] [CrossRef]
- Graham, M.S.; Drobnjak, I.; Zhang, H. Realistic simulation of artefacts in diffusion MRI for validating post-processing correction techniques. NeuroImage 2016, 125, 1079–1094. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Graham, M.S.; Drobnjak, I.; Jenkinson, M.; Zhang, H. Quantitative assessment of the susceptibility artefact and its interaction with motion in diffusion MRI. PLoS ONE 2017, 12, e0185647. [Google Scholar] [CrossRef] [PubMed]
- Klepaczko, A.; Szczypiński, P.; Dwojakowski, G.; Strzelecki, M.; Materka, A. Computer simulation of magnetic resonance angiography imaging: Model description and validation. PLoS ONE 2014, 9, e93689. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Treceño-Fernández, D.; Calabia-del Campo, J.; Bote-Lorenzo, M.L.; Sánchez, E.G.; de Luis-García, R.; Alberola-López, C. A Web-Based Educational Magnetic Resonance Simulator: Design, Implementation and Testing. J. Med. Syst. 2020, 44, 9. [Google Scholar] [CrossRef]
- Treceño-Fernández, D.; Calabia-del Campo, J.; Bote-Lorenzo, M.L.; Gómez-Sánchez, E.; de Luis-García, R.; Alberola-López, C. Integration of an intelligent tutoring system in a magnetic resonance simulator for education: Technical feasibility and user experience. Comput. Methods Programs Biomed. 2020, 195, 105634. [Google Scholar] [CrossRef]
- Burch, C. Django: A Web Framework Using Python: Tutorial Presentation. J. Comput. Sci. Colleges 2010, 25, 154–155. [Google Scholar]
- Anderson, C. The Model-View-ViewModel (MVVM) Design Pattern. In Pro Business Applications with Silverlight 5; Apress: Berkeley, CA, USA, 2012; pp. 461–499. [Google Scholar]
- Liang, Z.-P.; Lauterbur, P.C. Principles of Magnetic Resonance Imaging: A Signal Processing Perspective; IEEE Press Series on Biomedical Engineering; IEEE: New York, NY, USA, 2000. [Google Scholar]
- Bernstein, M.A.; King, K.F.; Zhou, X.J. Handbook of MRI Pulse Sequences; Academic Press: Burlington, NJ, USA, 2004. [Google Scholar]
- Fraenkel, J.R.; Wallen, N.E.; Hyun, H.H. How to Design and Evaluate Research in Education, 8th ed.; McGraw-Hill Education: New York, NY, USA, 2011; p. 704. [Google Scholar]
- Kuder, G.F.; Richardson, M.W. The theory of the estimation of test reliability. Psychometrika 1937, 2, 151–160. [Google Scholar] [CrossRef]
- Cronbach, L.J. Coefficient alpha and the internal structure of tests. Psychometrika 1951, 16, 297–334. [Google Scholar] [CrossRef] [Green Version]
- Royston, J.P. Algorithm AS 181: The W Test for Normality. J. R. Stat. Soc. Ser. C (Appl. Stat.) 1982, 31, 176–180. [Google Scholar] [CrossRef]
- Torchiano, M. Effsize: Efficient Effect Size Computation R package version 0.7.4; ReserchGate: Berlin, Germany, 2018. [Google Scholar]
- Tavakol, M.; Dennick, R. Making sense of Cronbach’s alpha. Int. J. Med. Educ. 2011, 2, 53–55. [Google Scholar] [CrossRef]
- Frey, B.B. The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation; SAGE Publications, Inc.: Thousand Oaks, CA, USA, 2018. [Google Scholar]
- Ramos-Llorden, G.; Arnold, J.; Van Steenkiste, G.; Jeurissen, B.; Vanhevel, F.; Van Audekerke, J.; Verhoye, M.; Sijbers, J. A unified maximum likelihood framework for simultaneous motion and T1 estimation in quantitative MR T1 mapping. IEEE Trans. Med. Imaging 2016, 36, 433–446. [Google Scholar] [CrossRef] [Green Version]
- Ramos-Llordén, G.; Vegas-Sánchez-Ferrero, G.; Björk, M.; Vanhevel, F.; Parizel, P.M.; Estépar, R.S.J.; Arnold, J.; Sijbers, J. NOVIFAST: A fast algorithm for accurate and precise VFA MRI T1 mapping. IEEE Trans. Med. Imaging 2018, 37, 2414–2427. [Google Scholar] [CrossRef]
Hits | HT | Exp. Group | Ctrl. Group | E. Size | ||
(p-Val) | Med | Mean ± S D | Med | Mean ± SD | (Cohen’s d) | |
T | 0.588 | 0.50 | 1.13 ± 1.28 | 0.50 | 0.90 ± 1.16 | 0.191 |
P | 0.938 | 0.00 | 0.53 ± 0.82 | 0.00 | 0.57 ± 0.86 | −0.040 |
NE | HT | Exp. Group | Ctrl. Group | E. Size | ||
(p-Val) | Med | Mean ± SD | Med | Mean ± SD | (Cohen’s d) | |
T | 0.552 | 0.33 | 0.74 ± 1.29 | 0.00 | 0.51 ± 1.23 | 0.185 |
P | 0.915 | 0.00 | 0.13 ± 0.88 | 0.00 | 0.22 ± 0.98 | −0.096 |
Hits | HT | Exp. Group | Ctrl. Group | E. Size | |||
(p-Val) | Med | Mean ± SD | Med | Mean ± SD | (Cohen’s d) | ||
PT | T | 0.540 | 1.50 | 1.93 ± 1.48 | 2.00 | 2.17 ± 1.51 | −0.156 |
P | 0.018 | 2.00 | 2.53 ± 1.36 | 2.00 | 1.63 ± 1.27 | 0.684 | |
Gain | T | 0.309 | 1.00 | 0.80 ± 1.27 | 1.00 | 1.27 ± 1.48 | -0.338 |
P | 0.036 | 2.00 | 2.00 ± 1.62 | 1.00 | 1.07 ± 1.36 | 0.624 | |
NE | HT | Exp. Group | Ctrl. Group | E. Size | |||
(p-Val) | Med | Mean ± SD | Med | Mean ± SD | (Cohen’s d) | ||
PT | T | 0.581 | 0.83 | 1.28 ± 1.78 | 1.17 | 1.54 ± 1.94 | −0.143 |
P | 0.013 | 1.83 | 1.99 ± 1.67 | 1.17 | 0.93 ± 1.55 | 0.655 | |
Gain | T | 0.29 | 0.67 | 0.53 ± 1.67 | 1.00 | 1.03 ± 2.66 | −0.276 |
P | 0.01 | 1.67 | 1.86 ± 1.79 | 0.67 | 0.71 ± 1.95 | 0.686 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Treceño-Fernández, D.; Calabia-del-Campo, J.; Matute-Teresa, F.; Bote-Lorenzo, M.L.; Gómez-Sánchez, E.; de Luis-García, R.; Alberola-López, C. Magnetic Resonance Simulation in Education: Quantitative Evaluation of an Actual Classroom Experience. Sensors 2021, 21, 6011. https://doi.org/10.3390/s21186011
Treceño-Fernández D, Calabia-del-Campo J, Matute-Teresa F, Bote-Lorenzo ML, Gómez-Sánchez E, de Luis-García R, Alberola-López C. Magnetic Resonance Simulation in Education: Quantitative Evaluation of an Actual Classroom Experience. Sensors. 2021; 21(18):6011. https://doi.org/10.3390/s21186011
Chicago/Turabian StyleTreceño-Fernández, Daniel, Juan Calabia-del-Campo, Fátima Matute-Teresa, Miguel L. Bote-Lorenzo, Eduardo Gómez-Sánchez, Rodrigo de Luis-García, and Carlos Alberola-López. 2021. "Magnetic Resonance Simulation in Education: Quantitative Evaluation of an Actual Classroom Experience" Sensors 21, no. 18: 6011. https://doi.org/10.3390/s21186011
APA StyleTreceño-Fernández, D., Calabia-del-Campo, J., Matute-Teresa, F., Bote-Lorenzo, M. L., Gómez-Sánchez, E., de Luis-García, R., & Alberola-López, C. (2021). Magnetic Resonance Simulation in Education: Quantitative Evaluation of an Actual Classroom Experience. Sensors, 21(18), 6011. https://doi.org/10.3390/s21186011