A National Quality Improvement Program on Ultrasound Department in China: A Controlled Cohort Study of 1297 Public Hospitals
Abstract
:1. Introduction
2. Methods
2.1. Intervention
2.2. Setting
2.3. Quality Control Indicators
2.4. Statistical Analysis
3. Results
3.1. Characteristics of Enrolled Hospitals
3.2. Effects of the QI Program on Ultrasound Departments
3.3. Subgroup Analysis of Secondary and Tertiary Hospitals
3.4. Subgroup Analysis Based on Provincial GDP per Capita
4. Discussion
5. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Narayan, A.; Cinelli, C.; Carrino, J.A.; Nagy, P.; Coresh, J.; Riese, V.G.; Durand, D.J. Quality Measurements in Radiology: A Systematic Review of the Literature and Survey of Radiology Benefit Management Groups. J. Am. Coll. Radiol. 2015, 12, 1173–1181. [Google Scholar] [CrossRef] [PubMed]
- Hillman, B.J.; Amis, E.S.; Neiman, H.L. The Future Quality and Safety of Medical Imaging: Proceedings of the Third Annual ACR FORUM. J. Am. Coll. Radiol. 2004, 1, 33–39. [Google Scholar] [CrossRef] [PubMed]
- Kruskal, J.B.; Eisenberg, R.; Sosna, J.; Yam, C.S.; Kruskal, J.D.; Boiselle, P.M. Quality Initiatives Quality Improvement in Radiology: Basic Principles and Tools Required to Achieve Success. Radiographics 2011, 31, 1499–1509. [Google Scholar] [CrossRef] [PubMed]
- Dick, J.; Darras, K.E.; Lexa, F.J.; Denton, E.; Ehara, S.; Galloway, H.; Jankharia, B.; Kassing, P.; Kumamaru, K.K.; Mildenberger, P.; et al. An International Survey of Quality and Safety Programs in Radiology. Can. Assoc. Radiol. J. 2021, 72, 135–141. [Google Scholar] [CrossRef]
- Brandrud, A.S.; Nyen, B.; Hjortdahl, P.; Sandvik, L.; Helljesen Haldorsen, G.S.; Bergli, M.; Nelson, E.C.; Bretthauer, M. Domains Associated with Successful Quality Improvement in Healthcare—A Nationwide Case Study. BMC Health Serv. Res. 2017, 17, 648. [Google Scholar] [CrossRef] [Green Version]
- Marriner, M. Sonographer Quality Management. J. Echocardiogr. 2020, 18, 44–46. [Google Scholar] [CrossRef] [Green Version]
- Yaqub, M.; Kelly, B.; Stobart, H.; Napolitano, R.; Noble, J.A.; Papageorghiou, A.T. Quality-Improvement Program for Ultrasound-Based Fetal Anatomy Screening Using Large-Scale Clinical Audit. Ultrasound Obstet. Gynecol. 2019, 54, 239–245. [Google Scholar] [CrossRef]
- Hui, J.S.; Kramer, D.J.; Blackmore, C.C.; Hashimoto, B.E.; Coy, D.L. A Quality Improvement Initiative to Reduce Unnecessary Follow-up Imaging for Adnexal Lesions. J. Am. Coll. Radiol. 2014, 11, 373–377. [Google Scholar] [CrossRef]
- China National Ultrasound Quality Control Center; Ultrasound Medicine Branch of Chinese Medical Association. Expert Consensus on Quality Control Indicators for Medical Ultrasound (2018). Chin. J. Ultrason. 2018, 27, 921–923. [Google Scholar]
- Mandell, J.C.; Wrobel, W.C.; Laur, O.; Shah, N.; Robinson-Weiss, C.; Weaver, M.J.; Khurana, B. A Simplified Classification of Proximal Femoral Fractures Improves Accuracy, Confidence, and Inter-Reader Agreement of Hip Fracture Classification by Radiology Residents. Emerg. Radiol. 2019, 26, 179–187. [Google Scholar] [CrossRef] [PubMed]
- Delzell, P.B.; Boyle, A.; Schneider, E. Dedicated Training Program for Shoulder Sonography: The Results of a Quality Program Reverberate with Everyone. J. Ultrasound Med. 2015, 34, 1037–1042. [Google Scholar] [CrossRef] [PubMed]
- Davis, D.P.; Campbell, C.J.; Poste, J.C.; Ma, G. The Association between Operator Confidence and Accuracy of Ultrasonography Performed by Novice Emergency Physicians. J. Emerg. Med. 2005, 29, 259–264. [Google Scholar] [CrossRef] [PubMed]
- Adedayo, A.; Igashi, J.; Mshelbwala, P.; Nasir, A.; Ameh, E.; Adeniran, J. Accuracy of Ultrasonography in the Evaluation of Abdominal Masses in Children in Nigeria. African J. Paediatr. Surg. 2019, 16, 1. [Google Scholar] [CrossRef] [PubMed]
- Swartzberg, K.; Goldstein, L.N. High Positive Computed Tomography Yields in the Emergency Department Might Not Be a Positive Finding. S. Afr. Med. J. 2018, 108, 230–234. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Baghdanian, A.H.; Baghdanian, A.A.; Armetta, A.; Krastev, M.; Dechert, T.; Burke, P.; Le Bedis, C.A.; Anderson, S.W.; Soto, J.A. Effect of an Institutional Triaging Algorithm on the Use of Multidetector CT for Patients with Blunt Abdominopelvic Trauma over an 8-Year Period. Radiology 2017, 282, 84–91. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Guo, R.; Jiang, Y. The History and Meaning of Standarized Training for Ultrasound Residents. Chin. J. Ultrason. 2015, 24, 645–647. [Google Scholar]
- Nguyen, X.V.; Adams, S.J.; Hobbs, S.K.; Ganeshan, D.; Wasnik, A.P. Radiologist as Lifelong Learner: Strategies for Ongoing Education. Acad. Radiol. 2019, 26, 1120–1126. [Google Scholar] [CrossRef]
- Liu, X.; Hou, Z.; Towne, S.D.; He, M.; Tan, A.; Jiang, D.; Mohammed, A.S.H.; Mao, Z. Knowledge, Attitudes, and Practices Related to the Establishment of the National Hierarchical Medical System (NHMS) among Outpatients in Chinese Tertiary Hospitals. Medicine 2018, 97, e11836. [Google Scholar] [CrossRef]
- Zhou, Z.; Zhao, Y.; Shen, C.; Lai, S.; Nawaz, R.; Gao, J. Evaluating the Effect of Hierarchical Medical System on Health Seeking Behavior: A Difference-in-Differences Analysis in China. Soc. Sci. Med. 2021, 268, 113372. [Google Scholar] [CrossRef]
- Loving, V.A.; Ellis, R.L.; Rippee, R.; Steele, J.R.; Schomer, D.F.; Shoemaker, S. Time Is Not on Our Side: How Radiology Practices Should Manage Customer Queues. J. Am. Coll. Radiol. 2017, 14, 1481–1488. [Google Scholar] [CrossRef]
- Waiting Your Turn: Wait Times for Health Care in Canada, 2019 Report. Available online: https://www.fraserinstitute.org/studies/waiting-your-turn-wait-times-for-health-care-in-canada-2019 (accessed on 10 December 2019).
- Northern Ireland Waiting Time Statistics: Diagnostic Waiting Times Quarter Ending June. 2021. Available online: https://www.health-ni.gov.uk/sites/default/files/publications/health/hs-niwts-diagnostic-waiting-times-q1-21-22.pdf (accessed on 26 August 2021).
- Zhang, T.; Xu, Y.; Ren, J.; Sun, L.; Liu, C. Inequality in the Distribution of Health Resources and Health Services in China: Hospitals versus Primary Care Institutions. Int. J. Equity Health 2017, 16, 42. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Fishbein, D.; Nambiar, S.; McKenzie, K.; Mayorga, M.; Miller, K.; Tran, K.; Schubel, L.; Agor, J.; Kim, T.; Capan, M. Objective Measures of Workload in Healthcare: A Narrative Review. Int. J. Health Care Qual. Assur. 2020, 33, 1–17. [Google Scholar] [CrossRef] [PubMed]
- Fu, L.; Xu, K.; Liu, F.; Liang, L.; Wang, Z. Regional Disparity and Patients Mobility: Benefits and Spillover Effects of the Spatial Network Structure of the Health Services in China. Int. J. Environ. Res. Public Health 2021, 18, 1096. [Google Scholar] [CrossRef] [PubMed]
- Harvey, H.B.; Hassanzadeh, E.; Aran, S.; Rosenthal, D.I.; Thrall, J.H.; Abujudeh, H.H. Key Performance Indicators in Radiology: You Can’t Manage What You Can’t Measure. Curr. Probl. Diagn. Radiol. 2016, 45, 115–121. [Google Scholar] [CrossRef] [PubMed]
- Reis, S.P.; White, B.; Sutphin, P.D.; Pillai, A.K.; Kalva, S.P.; Toomay, S.M. Approaching the Practice Quality Improvement Project in Interventional Radiology. J. Am. Coll. Radiol. 2015, 12, 1337–1344. [Google Scholar] [CrossRef]
- Purssell, E.; Drey, N.; Chudleigh, J.; Creedon, S.; Gould, D.J. The Hawthorne Effect on Adherence to Hand Hygiene in Patient Care. J. Hosp. Infect. 2020, 106, 311–317. [Google Scholar] [CrossRef]
- Chatterjee, P.; Joynt, K.E. Do Cardiology Quality Measures Actually Improve Patient Outcomes? J. Am. Heart Assoc. 2014, 3, e000404. [Google Scholar] [CrossRef]
- China National Ultrasound Quality Control Center; Beijing Ultrasound Quality Control Center. Quality Control Management Standards of Medical Ultrasound; People’s Medical Publishing House: Beijing, China, 2017. [Google Scholar]
Quality Control Indicators | Definition and Formula |
---|---|
Doctor-to-patient ratio (1:10,000) | Definition: the ratio of ultrasound doctors to ultrasound examinations completed during the same period |
Formula: (ultrasound doctors)/(ultrasound examinations completed during the same period) × 10,000 | |
Examination-room-to-examination ratio (1:10,000) | Definition: the ratio of ultrasound examination rooms to ultrasound examinations completed during the same period |
Formula: (ultrasound examination rooms)/(ultrasound examinations completed during the same period) × 10,000 | |
Doctor-to-ultrasound-equipment ratio | Definition: the ratio of ultrasound doctors to ultrasound equipment during the same period |
Formula: (ultrasound doctors)/(ultrasound equipment during the same period) | |
Average workload per doctor per working day | Definition: the average number of ultrasound examinations (including exams of inpatient, outpatient, emergency room) completed by each ultrasound doctor per working day |
Formula: (ultrasound examinations completed in a year)/(ultrasound doctors during the same period)/(working days during the same period) | |
Average workload of outpatient service per hospital per working day | Definition: the average number of ultrasound examinations of outpatient service completed by each hospital per working day |
Formula: (ultrasound examinations of outpatient service completed in a year)/(working days during the same period) | |
Average waiting days for inpatient appointment | Definition: the average number of days spent waiting for inpatient ultrasound examination from being ordered to being conducted |
Formula: (waiting days of all inpatient ultrasound examinations)/(inpatient ultrasound examinations during the same period) | |
Positive rate of ultrasound examinations (%) | Definition: the proportion of ultrasound examinations with any positive finding among all ultrasound examinations during the same period |
Formula: (ultrasound examinations with positive findings)/(ultrasound examinations during the same period) | |
Accuracy of ultrasound diagnosis (%) | Definition: the proportion of ultrasound examinations with accurate diagnosis compared to the result of pathology or clinical diagnosis among all randomly chosen ultrasound examinations with results of pathology or clinical diagnosis (20 ultrasound examinations per doctor were required to be inspected at least) |
Formula: (ultrasound examinations with accurate diagnosis compared to the result of pathology or clinical diagnosis)/(all randomly chosen ultrasound examinations with the result of pathology or clinical diagnosis) |
Quality Control Indicators | 2017 | 2019 | p-Value |
---|---|---|---|
Doctor-to-patient ratio (1:10,000) | 1.05 | 0.96 | 0.026 |
Examination-room-to-examination ratio (1:10,000) | 0.68 | 0.63 | <0.001 |
Doctor-to-ultrasound-equipment ratio | 1.35 | 1.34 | 0.245 |
Average workload per doctor per working day | 37.83 | 41.72 | 0.846 |
Average workload of outpatient service per hospital per working day | 345.59 | 388.17 | 0.472 |
Average waiting days for inpatient appointment | 1.39 | 1.34 | 0.473 |
Positive rate of ultrasound examination (%) | 66.21 | 73.91 | <0.001 |
Accuracy of ultrasound diagnosis (%) | 85.37 | 89.74 | <0.001 |
Quality Control Indicators | 2017 | 2019 | p-Value |
---|---|---|---|
Doctor-to-patient ratio | |||
Secondary hospital | 0.98 | 1.29 | 0.084 |
Tertiary hospital | 1.09 | 0.88 | 0.003 |
Examination-room-to-examination ratio | |||
Secondary hospital | 0.59 | 0.79 | 0.011 |
Tertiary hospital | 0.72 | 0.60 | 0.002 |
Doctor-to-ultrasound-equipment ratio | |||
Secondary hospital | 1.51 | 1.48 | 0.923 |
Tertiary hospital | 1.31 | 1.30 | 0.013 |
Average workload per doctor per working day | |||
Secondary hospital | 40.83 | 30.91 | <0.001 |
Tertiary hospital | 36.76 | 45.42 | <0.001 |
Average workload of outpatient service per hospital per working day | |||
Secondary hospital | 262.00 | 176.18 | 0.403 |
Tertiary hospital | 416.84 | 568.40 | 0.021 |
Average waiting days for inpatient appointment | |||
Secondary hospital | 1.37 | 1.22 | 0.443 |
Tertiary hospital | 1.40 | 1.40 | 0.791 |
Positive rate of ultrasound examinations | |||
Secondary hospital | 63.39 | 73.76 | <0.001 |
Tertiary hospital | 68.57 | 74.03 | <0.001 |
Accuracy of ultrasound diagnosis | |||
Secondary hospital | 74.85 | 87.82 | <0.001 |
Tertiary hospital | 89.70 | 92.39 | <0.001 |
Quality Control Indicators | 2017 | 2019 | p-Value |
---|---|---|---|
Doctor-to-patient ratio | |||
High-GDP | 1.08 | 1.02 | 0.006 |
Medium-GDP | 0.92 | 0.76 | 0.114 |
Low-GDP | 1.26 | 1.20 | 0.167 |
Examination-room-to-examination ratio | |||
High-GDP | 0.73 | 0.70 | 0.006 |
Medium-GDP | 0.58 | 0.50 | 0.025 |
Low-GDP | 0.77 | 0.73 | 0.151 |
Doctor-to-ultrasound-equipment ratio | |||
High-GDP | 1.29 | 1.28 | 0.098 |
Medium-GDP | 1.41 | 1.36 | 0.378 |
Low-GDP | 1.44 | 1.45 | 0.689 |
Average workload per doctor per working day | |||
High-GDP | 37.20 | 39.40 | 0.150 |
Medium-GDP | 43.55 | 52.32 | 0.791 |
Low-GDP | 31.86 | 33.44 | 0.761 |
Average workload of outpatient service per hospital per working day | |||
High-GDP | 368.41 | 431.38 | <0.001 |
Medium-GDP | 424.62 | 437.51 | 0.940 |
Low-GDP | 220.36 | 262.07 | 0.001 |
Average waiting days for inpatient appointment | |||
High-GDP | 1.45 | 1.44 | 0.282 |
Medium-GDP | 1.16 | 1.41 | 0.091 |
Low-GDP | 1.57 | 1.11 | 0.195 |
Positive rate of ultrasound scans | |||
High-GDP | 64.64 | 72.76 | <0.001 |
Medium-GDP | 68.06 | 76.53 | <0.001 |
Low-GDP | 66.77 | 72.89 | <0.001 |
Accuracy of ultrasound diagnosis | |||
High-GDP | 91.81 | 92.17 | <0.001 |
Medium-GDP | 92.79 | 90.27 | <0.001 |
Low-GDP | 67.95 | 87.54 | <0.001 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Tao, X.; Li, J.; Gu, Y.; Ma, L.; Xu, W.; Wang, R.; Gao, L.; Zhang, R.; Wang, H.; Jiang, Y. A National Quality Improvement Program on Ultrasound Department in China: A Controlled Cohort Study of 1297 Public Hospitals. Int. J. Environ. Res. Public Health 2023, 20, 397. https://doi.org/10.3390/ijerph20010397
Tao X, Li J, Gu Y, Ma L, Xu W, Wang R, Gao L, Zhang R, Wang H, Jiang Y. A National Quality Improvement Program on Ultrasound Department in China: A Controlled Cohort Study of 1297 Public Hospitals. International Journal of Environmental Research and Public Health. 2023; 20(1):397. https://doi.org/10.3390/ijerph20010397
Chicago/Turabian StyleTao, Xixi, Jianchu Li, Yang Gu, Li Ma, Wen Xu, Ruojiao Wang, Luying Gao, Rui Zhang, Hongyan Wang, and Yuxin Jiang. 2023. "A National Quality Improvement Program on Ultrasound Department in China: A Controlled Cohort Study of 1297 Public Hospitals" International Journal of Environmental Research and Public Health 20, no. 1: 397. https://doi.org/10.3390/ijerph20010397
APA StyleTao, X., Li, J., Gu, Y., Ma, L., Xu, W., Wang, R., Gao, L., Zhang, R., Wang, H., & Jiang, Y. (2023). A National Quality Improvement Program on Ultrasound Department in China: A Controlled Cohort Study of 1297 Public Hospitals. International Journal of Environmental Research and Public Health, 20(1), 397. https://doi.org/10.3390/ijerph20010397