Utilization of Machine Learning Algorithms for the Strengthening of HIV Testing: A Systematic Review
Abstract
:1. Introduction
2. Materials and Methods
2.1. Approach of the Systematic Review
2.2. Inclusion and Exclusion Criteria
2.2.1. Inclusion Criteria
2.2.2. Exclusion Criteria
2.3. Databases and Search Strategy
2.4. Screening Process
2.4.1. Phase I: Title and Abstract Screening
2.4.2. Phase II: Full-Text Screening
2.5. Data Extraction and Evidence Synthesis
2.6. Quality Appraisal
2.7. Analysis
2.8. Summary of the Systematic Review Process Using the PRISMA Guidelines
3. Results
3.1. Characteristics of the Selected Studies
3.1.1. Geographical Distributions of the Selected Studies
3.1.2. Yearly Publication of the Selected Studies 2010–2024
3.1.3. Additional Characteristics of the Selected Studies
3.2. Machine Learning Interventions for Enhanced HIV Testing
3.2.1. The Machine Learning Algorithms Applied
Most Frequently Utilized Machine Learning Algorithms in HIV Testing Interventions
Best Performing Machine Learning Algorithms
3.2.2. Machine Learning Interventions Employed to Enhance HIV Testing
- Predicting HIV risk/testing: As summarized in Table 3, numerous studies predicted individuals at the highest risk of HIV, as well as those who were likely to undergo HIV testing. This study’s central focus on predictive modeling within the context of HIV testing has unearthed compelling evidence showcasing the effectiveness of ML in enhancing HIV testing interventions. For instance, [15] utilized LASSO models, LR, and RF to predict the HIV status of individuals based on nationwide electronic data. The findings demonstrated enhanced predictive performance, estimating that 384 individuals would need to be tested to identify one undiagnosed person with HIV [15]. A parallel study by [51] used DL models to forecast HIV incidence between 2022 and 2023 in the Philippines. The study predicted a cumulative case count of 145,273 by 2030 [51].
- Accurate and efficient HIV testing interventions utilizing machine learning techniques: This review encompasses studies that employed novel technologies and algorithms to enhance HIV testing accuracy and efficiency. In a study conducted in France, Demey et al. [25] employed DL techniques to enhance the efficiency of HIV diagnostic tests. The research involved a retrospective analysis of “Centaur® CHIV” assays and confirmatory tests conducted at Amiens University Medical Center between 2012 and 2018 [25]. The findings revealed the detection of 38% false positives and 62% confirmed true positives [25]. Remarkably, the models demonstrated high accuracy by significantly reducing the number of false-positive CHIV assay results from 171 to 12 [25]. Similar studies conducted in the USA developed models that effectively reduced HIV false-positive results [22,57]. One of the South African studies we reviewed developed AI conversational agents for automated HIV self-counseling and testing [17]. The AI conversational agents/models were developed on Android phones, enabling participants to conduct self-HIV counseling, risk determination, rapid testing, and linkage to care for positive cases. Out of the ten participants in the study, six testers found that talking to the agent felt natural and equivalent to chatting with a human. At the same time, seven said they would feel comfortable taking a real HIV test with the agent. The study argues that this method is more effective than traditional HIV testing and counseling due to its anonymity, privacy, speed, and easy access [17].
- Enhancing the uptake of HIV self-testing among MSM using machine learning: The WHO recommends HIVST as a convenient and confidential option for HIV testing, especially among KPs who are often reluctant to access facilities for counseling and testing services [7]. This review synthesized studies that used ML to improve the uptake and utilization of HIVST among MSM from different countries. In China, an ML approach increased the efficiency of HIVST by 17.7%, and the distribution of HIVST kits was improved by 18% [39]. In a mixed study from Malaysia, an AI Chatbot was compared with human HIVST counseling and testing [60]. The study revealed that 93% of the participants perceived that the AI Chatbot provided more comprehensive information about testing, 100% of them stated that the chatbot was more convenient, and 79% were willing to continue using it [60]. Jing et al. [63] used a Greedy algorithm to increase the economic benefits of the secondary distribution of HIVST kits by more than 23% compared to those achieved by conventional methods. However, the uptake of HIVST is still low in many developing countries as the services are more friendly to individuals who can read and comprehend English. One of the recommendations from Cheah et al. [60] is to develop ML-aided HIVST technologies suitable for illiterate people. This study agrees with these recommendations since the novel technique is required more in developing countries like SSA, with its high HIV prevalence and high rates of illiteracy among its population.
3.3. Comparison between Traditional and Machine Learning Predictive Modeling in HIV Testing
3.3.1. Empirical Difference between Traditional and Machine Learning Methods
3.3.2. Statistical Differences between Traditional and Machine Learning Models
3.4. Successes of Machine Learning Interventions in HIV Testing
3.5. Gaps Identified via the Application of Machine Learning Interventions in HIV Testing
3.6. Future Directions with the Utilization of Machine Learning for Enhanced HIV Testing
4. Discussion
4.1. Main Findings
4.2. Successes and Opportunities of Machine Learning Interventions in HIV Testing
4.3. Gaps and Challenges Identified in the Implementation of Machine Learning in HIV Testing
4.4. Strengths and Limitations of the Study
5. Conclusions
Supplementary Materials
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- World Health Organization. H.I.V. 2024. Available online: https://www.who.int/data/gho/data/themes/hiv-aids (accessed on 11 February 2024).
- World Health Organization. Consolidated Guidelines on HIV Prevention, Testing, Treatment, Service Delivery, and Monitoring: Recommendations for a Public Health Approach. 2021. Available online: https://www.who.int/publications/i/item/9789240031593 (accessed on 17 February 2024).
- UNAIDS. Prevailing against Pandemics by Putting People at the Centre—World AIDS Day Report 2020; UNAIDS: Geneva, Switzerland, 2020; pp. 1–92. Available online: https://www.unaids.org/sites/default/files/media_asset/prevailing-against-pandemics_en.pdf (accessed on 17 February 2024).
- UNAIDS. FACT SHEET 2023 Global HIV Statistics People Living with HIV People Living with HIV Accessing Antiretroviral Therapy New HIV Infections AIDS-Related Deaths Key Populations; UNAIDS: Geneva, Switzerland, 2023. [Google Scholar]
- Mannoh, I.; Amundsen, D.; Turpin, G.; Lyons, C.E.; Viswasam, N.; Hahn, E.; Ryan, S.; Baral, S.; Hansoti, B. A Systematic Review of HIV Testing Implementation Strategies in Sub-Saharan African Countries. AIDS Behav. 2022, 26, 1660–1671. [Google Scholar] [CrossRef] [PubMed]
- Fieggen, J.; Smith, E.; Arora, L.; Segal, B. The role of machine learning in HIV risk prediction. Front. Reprod. Health 2022, 4, 1062387. [Google Scholar] [CrossRef]
- World Health Organization. WHO Recommends HIV Self-Testing—Evidence Update and Considerations for Success. 2024. Available online: https://www.who.int/publications/i/item/WHO-CDS-HIV-19.36#:~:text=In%202016%20WHO%20recommended%20HIVST%20as%20a%20safe%2C,performance%20comparable%20to%20that%20of%20trained%20health-care%20workers (accessed on 14 July 2024).
- Van Staden, Q.; Laurenzi, C.A.; Toska, E. Two years after lockdown: Reviewing the effects of COVID-19 on health services and support for adolescents living with HIV in South Africa. J. Int. AIDS Soc. 2022, 25, e25904. [Google Scholar] [CrossRef]
- Xiang, Y.; Du, J.; Fujimoto, K.; Li, F.; Schneider, J.; Tao, C. Application of artificial intelligence and machine learning for HIV prevention interventions. Lancet HIV 2022, 9, e54–e62. [Google Scholar] [CrossRef] [PubMed]
- Mutai, C.K.; McSharry, P.E.; Ngaruye, I.; Musabanganji, E. Use of machine learning techniques to identify HIV predictors for screening in sub-Saharan Africa. BMC Med. Res. Methodol. 2021, 21, 159. [Google Scholar] [CrossRef] [PubMed]
- Dubey, A. Biophotonics and machine learning model for the diagnosis and treatment of HIV. Biosci. Biotechnol. Res. Commun. 2018, 11, 5–10. [Google Scholar] [CrossRef]
- Turk, G.; Ghiglione, Y.; Hormanstorfer, M.; Laufer, N.; Coloccini, R.; Salido, J.; Trifone, C.; Ruiz, M.J.; Falivene, J.; Holgado, M.P.; et al. Biomarkers of progression after HIV acute/early infection: Nothing compares to CD4+ T-cell count? Viruses 2018, 10, 34. [Google Scholar] [CrossRef]
- Chikusi, H.; Leo, J.; Kaijage, S. Machine Learning Model for Prediction and Visualization of HIV Index Testing in Northern Tanzania. Int. J. Adv. Comput. Sci. Appl. 2022, 13, 391–399. [Google Scholar] [CrossRef]
- Oladokun, O.O. Predicting HIV Status among Women in South Africa Using Machine Learning: Comparing Decision Tree Model and Logistic Regression; WIReDSpace: Johannesburg, South Africa, 2019; Available online: https://wiredspace.wits.ac.za/bitstreams/d6c6cc37-2e79-4f6a-a35c-b978ed067842/download (accessed on 14 July 2024).
- Ahlström, M.G.; Ronit, A.; Omland, L.H.; Vedel, S.; Obel, N. Algorithmic prediction of HIV status using nation-wide electronic registry data. EClinicalMedicine 2019, 17, 100203. [Google Scholar] [CrossRef]
- Alehegn, M. Application of machine learning and deep learning for the prediction of HIV/AIDS. HIV AIDS Rev. 2022, 21, 17–23. [Google Scholar] [CrossRef]
- Van Heerden, A.; Ntinga, X.; Vilakazi, K. The potential of conversational agents to provide a rapid HIV counseling and testing services. In Proceedings of the 2017 International Conference on the Frontiers and Advances in Data Science (FADS), Xi’an, China, 23–25 October 2017; IEEE: Piscataway, NJ, USA, 2018; pp. 80–85. [Google Scholar]
- Wood, C.S.; Thomas, M.R.; Budd, J.; Mashamba-Thompson, T.P.; Herbst, K.; Pillay, D.; Peeling, R.W.; Johnson, A.M.; McKendry, R.A.; Stevens, M.M. Taking connected mobile-health diagnostics of infectious diseases to the field. Nature 2019, 566, 467–474. [Google Scholar] [CrossRef] [PubMed]
- Pan, Y.; Liu, H.; Metsch, L.R.; Feaster, D.J. Factors Associated with HIV Testing Among Participants from Substance Use Disorder Treatment Programs in the US: A Machine Learning Approach. AIDS Behav. 2017, 21, 534–546. [Google Scholar] [CrossRef]
- Ovalle, A.; Goldstein, O.; Kachuee, M.; Wu, E.S.C.; Hong, C.; Holloway, I.W.; Sarrafzadeh, M. Leveraging social media activity and machine learning for HIV and substance abuse risk assessment: Development and validation study. J. Med. Internet Res. 2021, 23, e22042. [Google Scholar] [CrossRef]
- Xiang, Y.; Fujimoto, K.; Schneider, J.; Jia, Y.; Zhi, D.; Tao, C. Network context matters: Graph convolutional network model over social networks improves the detection of unknown HIV infections among young men who have sex with men. J. Am. Med. Informatics Assoc. 2019, 26, 1263–1271. [Google Scholar] [CrossRef]
- Elkhadrawi, M.; Bryan, A.S.; Bradley, J.W.; Murat, A.S.W. Challenges in communication from referring clinicians to pathologists in the electronic health record era. J. Pathol. Inform. 2021, 9, 8. [Google Scholar]
- Burns, C.M.; Pung, L.; Witt, D.; Gao, M.; Sendak, M.; Balu, S.; Krakower, D.; Marcus, J.L.; Okeke, N.L.; E Clement, M. Development of a Human Immunodeficiency Virus Risk Prediction Model Using Electronic Health Record Data From an Academic Health System in the Southern United States. Clin. Infect. Dis. 2023, 76, 299–306. [Google Scholar] [CrossRef]
- Xu, X.; Fairley, C.K.; Chow, E.P.F.; Lee, D.; Aung, E.T.; Zhang, L.; Ong, J.J. Using machine learning approaches to predict timely clinic attendance and the uptake of HIV/STI testing post clinic reminder messages. Sci. Rep. 2022, 12, 8757. [Google Scholar] [CrossRef]
- Demey, B.; Usureau, C.; Boillod, P.; Bodeau, S.; François, C.; Roussel, C.; Duverlie, G.; Castelain, S.; Brochot, E. Analytical performance evaluation and enhancement of the ADVIA Centaur® HIV Ag/Ab Combo assay. J. Clin. Virol. 2019, 118, 36–40. [Google Scholar] [CrossRef]
- Equator Network. The PRISMA 2020 Statement: The Updated Guideline for Reporting Systematic Reviews. 2024. Available online: https://www.equator-network.org/reporting-guidelines/prisma/ (accessed on 18 April 2024).
- Amir-Behghadami, M.; Janati, A. Population, Intervention, Comparison, Outcomes and Study (PICOS) design as a framework to formulate eligibility criteria in systematic reviews. Emerg. Med. J. 2020, 37, 387. [Google Scholar] [CrossRef] [PubMed]
- RefWorks. RefWorks. Making Research Easier. 2024. Available online: https://refworks.proquest.com/ (accessed on 22 February 2024).
- Saha, R.; Malviya, L.; Jadhav, A.; Dangi, R. Early stage HIV diagnosis using optimized ensemble learning technique. Biomed. Signal Process. Control. 2024, 89, 105787. [Google Scholar] [CrossRef]
- Cobre, A.; Morais, A.; Selege, F.; Stremel, D.; Wiens, A.; Ferreira, L.; Tonin, F.; Pontarolo, R. Use of Biochemical Tests and Machine Learning in the Search for Potential Diagnostic Biomarkers of COVID-19, HIV/AIDS, and Pulmonary Tuberculosis. J. Braz. Chem. Soc. 2024, 35, e-20240020. [Google Scholar] [CrossRef]
- Alie, M.S.; Negesse, Y. Machine learning prediction of adolescent HIV testing services in Ethiopia. Front. Public Health 2024, 12, 1341279. [Google Scholar] [CrossRef]
- He, J.; Li, J.; Jiang, S.; Cheng, W.; Jiang, J.; Xu, Y.; Yang, J.; Zhou, X.; Chai, C.; Wu, C. Application of machine learning algorithms in predicting HIV infection among men who have sex with men: Model development and validation. Front. Public Health 2022, 10, 967681. [Google Scholar] [CrossRef]
- Balzer, L.B.; Havlir, D.V.; Kamya, M.R.; Chamie, G.; Charlebois, E.D.; Clark, T.D.; A Koss, C.; Kwarisiima, D.; Ayieko, J.; Sang, N.; et al. Machine Learning to Identify Persons at High-Risk of Human Immunodeficiency Virus Acquisition in Rural Kenya and Uganda. Clin. Infect. Dis. 2020, 71, 2326–2333. [Google Scholar] [CrossRef]
- Bao, Y.; Medland, N.A.; Fairley, C.K.; Wu, J.; Shang, X.; Chow, E.P.F.; Xu, X.; Ge, Z.; Zhuang, X.; Zhang, L. Predicting the diagnosis of HIV and sexually transmitted infections among men who have sex with men using machine learning approaches. J. Infect. 2021, 82, 48–59. [Google Scholar] [CrossRef]
- Birri Makota, R.B.; Musenge, E. Predicting HIV infection in the decade (2005–2015) pre-COVID-19 in Zimbabwe: A supervised classification-based machine learning approach. PLOS Digit. Health 2023, 2, e0000260. [Google Scholar] [CrossRef]
- Chingombe, I.; Musuka, G.; Mbunge, E.; Chemhaka, G.; Cuadros, D.F.; Murewanhema, G.; Chaputsira, S.; Batani, J.; Muchemwa, B.; Mapingure, M.P.; et al. Predicting HIV Status Using Machine Learning Techniques and Bio-Behavioural Data from the Zimbabwe Population-Based HIV Impact Assessment (ZIMPHIA15-16). In LNNS, Lecture Notes in Networks and Systems; Springer International Publishing: Cham, Switzerland, 2022; Volume 502, pp. 247–258. [Google Scholar] [CrossRef]
- Dong, Y.; Liu, S.; Xia, D.; Xu, C.; Yu, X.; Chen, H.; Wang, R.; Liu, Y.; Dong, J.; Hu, F.; et al. Prediction Model for the Risk of HIV Infection among MSM in China: Validation and Stability. Int. J. Environ. Res. Public Health 2022, 19, 1010. [Google Scholar] [CrossRef]
- Friedman, E.E.; Shankaran, S.; Devlin, S.A.; Kishen, E.B.; Mason, J.A.; Sha, B.E.; Ridgway, J.P. Development of a predictive model for identifying women vulnerable to HIV in Chicago. BMC Womens Health 2023, 23, 313. [Google Scholar] [CrossRef] [PubMed]
- Jing, F.; Ye, Y.; Zhou, Y.; Ni, Y.; Yan, X.; Lu, Y. Identification of Key Influencers for Secondary Distribution of HIV Self-Testing Kits Among Chinese Men Who Have Sex With Men: Development of an Ensemble Machine Learning Approach. J. Med. Internet Res. 2023, 25, e37719. [Google Scholar] [CrossRef] [PubMed]
- Orel, E.; Esra, R.; Estill, J.; Thiabaud, A.; Marchand-Maillet, S.; Merzouki, A.; Keiser, O. Prediction of HIV status based on sociobehavioural characteristics in East and Southern Africa. PLoS ONE 2022, 17, e0264429. [Google Scholar] [CrossRef]
- Ni, Y.; Lu, Y.; Jing, F.; Wang, Q.; Xie, Y.; He, X. A Machine Learning Model for Identifying Sexual Health Influencers to Promote the Secondary Distribution of HIV Self-Testing Among Gay, Bisexual, and Other Men Who Have Sex With Men in China: Quasi-Experimental Study. JMIR Public Health Surveill. 2024, 10, e50656. [Google Scholar] [CrossRef]
- Majam, M.; Segal, B.; Fieggen, J.; Smith, E.; Hermans, L.; Singh, L.; Phatsoane, M.; Arora, L.; Lalla-Edward, S. Informatics in Medicine Unlocked Utility of a machine-guided tool for assessing risk behaviour associated with contracting HIV in three sites in South Africa. Inform. Med. Unlocked 2023, 37, 101192. [Google Scholar] [CrossRef]
- Hoenigl, M.; Weibel, N.; Mehta, S.R.; Anderson, C.M.; Jenks, J.; Green, N.; Gianella, S.; Smith, D.M.; Little, S.J. Development and Validation of the San Diego Early Test Score to Predict Acute and Early HIV Infection Risk in Men Who Have Sex With Men. Clin. Infect. Dis. 2015, 61, 468–475. [Google Scholar] [CrossRef] [PubMed]
- Hoots, B.E.; MacDonald, P.D.; Hightow-Weidman, L.B.; Leone, P.A.; Miller, W.C. Developing a predictive model to prioritize human immunodeficiency virus partner notification in North Carolina. Sex. Transm. Dis. 2012, 39, 65–71. [Google Scholar] [CrossRef]
- Wade, B.S.C.; Valcour, V.G.; Wendelken-riegelhaupt, L.; Esmaeili-firidouni, P.; Joshi, S.H.; Gutman, B.A.; Thomson, P.M. Clinical Mapping abnormal subcortical brain morphometry in an elderly HIV + cohort. YNICL 2015, 9, 564–573. [Google Scholar] [CrossRef]
- Van Nguyen, T.P.; Yang, W.; Tang, Z.; Xia, X.; Mullens, A.B.; Dean, J.A.; Li, Y. Lightweight federated learning for STIs/HIV prediction. Sci. Rep. 2024, 14, 6560. [Google Scholar] [CrossRef]
- Chingombe, I.; Dzinamarira, T.; Cuadros, D.; Mapingure, M.P.; Mbunge, E.; Chaputsira, S.; Madziva, R.; Chiurunge, P.; Samba, C.; Herrera, H.; et al. Predicting HIV Status among Men Who Have Sex with Men in Bulawayo & Harare, Zimbabwe Using Bio-Behavioural Data, Recurrent Neural Networks, and Machine Learning Techniques. Trop. Med. Infect. Dis. 2022, 7, 231. [Google Scholar] [CrossRef]
- Turbé, V.; Herbst, C.; Mngomezulu, T.; Meshkinfamfard, S.; Dlamini, N.; Mhlongo, T.; Smit, T.; Cherepanova, V.; Shimada, K.; Budd, J.; et al. Deep learning of HIV field-based rapid tests. Nat. Med. 2021, 27, 1165–1170. [Google Scholar] [CrossRef]
- Belete, D.; Huchaiah, M.D. A Deep Learning Approaches for Modeling and Predicting of HIV Test Results Using EDHS Dataset. In Infectious Diseases; IntechOpen: London, UK, 2023. [Google Scholar] [CrossRef]
- Gupta, K.; Ruan, Y.; Ibrahim, A.; Mendonca, R.; Cooper, S.; Morris, S.; Hattery, D. Transforming Rapid Diagnostic Tests into Trusted Diagnostic Tools in LMIC using AI. In Proceedings of the 2023 IEEE Conference on Artificial Intelligence (CAI), Santa Clara, CA, USA, 5–6 June 2023; IEEE: Piscataway, NJ, USA, 2023; pp. 306–308. [Google Scholar]
- Aribe, S.G.; Gerardo, B.D.; Medina, R.P. Time Series Forecasting of HIV/AIDS in the Philippines Using Deep Learning: Does COVID-19 Epidemic Matter? Int. J. Emerg. Technol. Adv. Eng. 2022, 12, 144–157. [Google Scholar]
- Bender Ignacio, R.A.; Dasgupta, S.; Valdez, R.; Pandey, U.; Pasalar, S.; Alfaro, R.; Hladik, F.; Gornalusse, G.; Lama, J.R.; Duerr, A. Dynamic immune markers predict HIV acquisition and augment associations with sociobehavioral factors for HIV exposure. iScience 2022, 25, 105632. [Google Scholar] [CrossRef]
- Laybohr Kamara, I.; Wang, L.; Guo, Y.; Huo, S.; Guo, Y.; Xu, C.; Liao, Y.; Liu, W.J.; Ma, W.; Gao, G.F. Spatial–temporal heterogeneity and determinants of HIV prevalence in the Mano River Union countries. Infect. Dis. Poverty. 2022, 11, 116. [Google Scholar] [CrossRef]
- Wang, X.; Yang, M.; Li, W. Efficient Data Reduction Strategies for Big Data and High-Dimensional LASSO Regressions. arXiv 2024, arXiv:2401.11070. [Google Scholar] [CrossRef]
- Roche, S.D.; Ekwunife, O.I.; Mendonca, R.; Kwach, B.; Omollo, V.; Zhang, S.; Ongwen, P.; Hattery, D.; Smedinghoff, S.; Morris, S.; et al. Measuring the performance of computer vision artificial intelligence to interpret images of HIV self-testing results. Front. Public Health 2024, 12, 1334881. [Google Scholar] [CrossRef]
- Latt, P.M.; Soe, N.N.; Xu, X.; Ong, J.J.; Chow, E.P.F.; Fairley, C.K.; Zhang, L. Identifying Individuals at High Risk for HIV and Sexually Transmitted Infections With an Artificial Intelligence-Based Risk Assessment Tool. Open Forum Infect. Dis. 2024, 11, ofae011. [Google Scholar] [CrossRef] [PubMed]
- Zucker, J.; Carnevale, C.; Gordon, P.; Sobieszczyk, M.E.; Rai, A.J. Am i Positive? Improving Human Immunodeficiency Virus Testing in the Era of Preexposure Prophylaxis and Immediate Antiretroviral Therapy Using Machine Learning. Open Forum Infect. Dis. 2022, 9, ofac259. [Google Scholar] [CrossRef]
- Mutai, C.K.; McSharry, P.E.; Ngaruye, I.; Musabanganji, E. Use of unsupervised machine learning to characterise HIV predictors in sub-Saharan Africa. BMC Infect. Dis. 2023, 23, 482. [Google Scholar] [CrossRef]
- Feller, D.J.; Zucker, J.; Yin, M.T.; Gordon, P.; Elhadad, N. Using Clinical Notes and Natural Language Processing for Automated HIV Risk Assessment. J. Acquir. Immune Defic. Syndr. 2018, 77, 160–166. [Google Scholar] [CrossRef]
- Cheah, M.H.; Gan, Y.N.; Altice, F.L.; Wickersham, J.A. Testing the Feasibility and Acceptability of Using an Artificial Intelligence Chatbot to Promote HIV Testing and Pre-Exposure Prophylaxis in Malaysia: Mixed Methods Study. JMIR Hum. Factors 2024, 11, e52055. [Google Scholar] [CrossRef]
- Xu, X.; Yu, Z.; Ge, Z.; Chow, E.P.F.; Bao, Y.; Ong, J.J.; Li, W.; Wu, J.; Fairley, C.K.; Zhang, L. Web-Based Risk Prediction Tool for an Individual’s Risk of HIV and Sexually Transmitted Infections Using Machine Learning Algorithms: Development and External Validation Study. J. Med. Internet Res. 2022, 24, e37850. [Google Scholar] [CrossRef]
- Haas, O.; Maier, A.; Rothgang, E. Machine Learning-Based HIV Risk Estimation Using Incidence Rate Ratios. Front. Reprod. Health 2021, 3, 1–10. [Google Scholar] [CrossRef]
- Jing, F.; Zhang, Q.; Ong, J.J.; Xie, Y.; Ni, Y.; Cheng, M.; Huang, S.; Zhou, Y.; Tang, W. Optimal resource allocation in HIV self-testing secondary distribution among Chinese MSM: Data-driven integer programming models. Philos. Trans. R. Soc. A 2021, 380, 20210128. [Google Scholar] [CrossRef] [PubMed]
- Scott, H.; Vittinghoff, E.; Irvin, R.; Liu, A.; Nelson, L.; Del, C.; Magnus, M.; Mannheimer, S.; Fields, S.; Van Tieu, H.; et al. Development and Validation of the Personalized Sexual Health Promotion (SexPro) HIV Risk Prediction Model for Men Who Have Sex with Men in the United States. AIDS Behav. 2020, 24, 274–283. [Google Scholar] [CrossRef]
- Adeli, E.; Zahr, N.M.; Pfefferbaum, A.; Sullivan, E.V.; Pohl, K.M. Novel Machine Learning Identifies Brain Patterns Distinguishing Diagnostic Membership of Human Immunodeficiency Virus, Alcoholism, and Their Comorbidity of Individuals. Biol. Psychiatry Cogn. Neurosci. Neuroimaging 2019, 4, 589–599. [Google Scholar] [CrossRef]
- Rice, E.; Yoshioka-Maxwell, A.; Petering, R.; Onasch-Vera, L.; Craddock, J.; Tambe, M.; Yadav, A.; Wilder, B.; Woo, D.; Winetrobe, H.; et al. Piloting the Use of Artificial Intelligence to Enhance HIV Prevention Interventions for Youth Experiencing Homelessness. J. Soc. Soc. Work. Res. 2018, 9, 551–573. [Google Scholar] [CrossRef]
- Menza, T.W.; Hughes, J.P.; Celum, C.L.; Golden, M.R. Prediction of HIV acquisition among men who have sex with men. Sex. Transm. Dis. 2009, 36, 547–555. [Google Scholar] [CrossRef]
- Weissman, S.; Yang, X.; Zhang, J.; Chen, S.; Olatosi, B.; Li, X. Using a machine learning approach to explore predictors of healthcare visits as missed opportunities for HIV diagnosis. AIDS 2021, 35 (Suppl. S1), S7–S18. [Google Scholar] [CrossRef]
- Marcus, J.L.; Sewell, W.C.; Balzer, L.B.; Krakower, D.S. Artificial Intelligence and Machine Learning for HIV Prevention: Emerging Approaches to Ending the Epidemic. Curr. HIV/AIDS Rep. 2020, 17, 171–179. [Google Scholar] [CrossRef]
- Rasheed, K.; Qayyum, A.; Ghaly, M.; Al-Fuqaha, A.; Razi, A.; Qadir, J. Explainable, trustworthy, and ethical machine learning for healthcare: A survey. Comput. Biol. Med. 2022, 149, 106043. [Google Scholar] [CrossRef]
- Lainjo, B. Artificial intelligence with machine learning and the enigmatic discovery of HIV cure. J. Auton. Intell. 2024, 7, 1–16. [Google Scholar] [CrossRef]
- Runde, D.F.; Bandura, R.; Ramanujam, S. The United States Has an Opportunity to Lead in Digital Development; Center for Strategic & International Studies: Washington, DC, USA, 2021; pp. 1–17. Available online: https://www.csis.org/analysis/united-states-has-opportunity-lead-digital-development (accessed on 5 July 2024).
- Pythonista Planet. Pros and Cons of Supervised Machine Learning. 2024. Available online: https://pythonistaplanet.com/pros-and-cons-of-supervised-machine-learning/#google_vignette (accessed on 1 February 2024).
- Rogers. Captera. Supervised vs Unsupervised Learning: Which Machine Learning Model Is Right for You? 2021. Available online: https://www.capterra.com/resources/supervised-vs-unsupervised-learning/ (accessed on 1 February 2024).
- Ferreira, L.; Pilastri, A.; Martins, C.M.; Pires, P.M.; Cortez, P. A Comparison of AutoML Tools for Machine Learning, Deep Learning and XGBoost. In Proceedings of the 2021 International Joint Conference on Neural Networks (IJCNN), Shenzhen, China, 1–8 July 2021. [Google Scholar]
- Mamo, D.N.; Yilma, T.M.; Fekadie, M.; Sebastian, Y.; Bizuayehu, T.; Melaku, M.S.; Walle, A.D. Machine learning to predict virological failure among HIV patients on antiretroviral therapy in the University of Gondar Comprehensive and Specialized Hospital, in Amhara Region, Ethiopia, 2022. BMC Med Inform. Decis. Mak. 2023, 23, 75. [Google Scholar] [CrossRef]
- Ray, S. Ways to Improve Accuracy of Machine Learning Models (Updated 2024); Analytics Vidhya: Gurugram, India, 2024. [Google Scholar]
- Bognár, L.; Fauszt, T. Factors and conditions that affect the goodness of machine learning models for predicting the success of learning. Comput. Educ. Artif. Intell. 2022, 3, 100100. [Google Scholar] [CrossRef]
- Chenneville, T.; Drake, H. Gender Differences in Psychosocial Predictors of Sexual Activity and HIV Testing Among Youth in Kenya. Front. Reprod. Health 2021, 3, 636462. [Google Scholar] [CrossRef]
- Kalichman, S.C.; Shkembi, B.; Wanyenze, R.K.; Naigino, R.; Bateganya, M.H.; Menzies, N.A.; Lin, C.-D.; Lule, H.; Kiene, S.M. Perceived HIV stigma and HIV testing among men and women in rural Uganda: A population-based study. Lancet HIV 2020, 7, e817–e824. [Google Scholar] [CrossRef]
- Hlongwa, M.; Mashamba-Thompson, T.; Makhunga, S.; Hlongwana, K. Barriers to HIV testing uptake among men in sub-Saharan Africa: A scoping review. Afr. J. AIDS Res. 2020, 19, 13–23. [Google Scholar] [CrossRef]
- Zhou, N.; Zhang, Z.; Nair, V.N.; Singhal, H.; Chen, J. Bias, Fairness and Accountability with Artificial Intelligence and Machine Learning Algorithms. Int. Stat. Rev. 2022, 90, 468–480. [Google Scholar] [CrossRef]
- Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ 2021, 372, n71. [Google Scholar] [CrossRef]
No | Items | Search Strategy |
---|---|---|
#1 | HIV testing OR HIV diagnosis) OR HIV prevention | (“HIV testing” [Mesh] OR “Testing, HIV” [Mesh]) OR “AIDS Testing” [Mesh] OR “HIV Diagnosis” [Mesh] OR “Testing HIV-AIDS” [Mesh] OR “Rapid HIV testing” OR “HIV Self-Testing” OR “HIV Prevention” OR “HIV Screening” OR “Human Immunodeficiency Virus Testing”) |
#2 | Machine learning AND algorithms | (“Machine Learning” [Mesh] OR “Artificial Intelligence” [Mesh] OR “Unsupervised Machine Learning” [Mesh] OR “Supervised Machine Learning” [Mesh] OR “Algorithms” [Mesh] OR “Models” [Mesh] OR “Deep Learning” [Mesh] OR “Neural Networks, Computer” [Mesh] OR “Support Vector Machine” [Mesh] OR “Random Forest” [Mesh] OR “Decision Trees” [Mesh] OR “Convolutional Neural Networks” OR “Recurrent Neural Networks” OR “XGBoost”) |
#3 | #1 AND #2 | (“HIV testing” [Mesh] OR “Testing, HIV” [Mesh]) OR “AIDS Testing” [Mesh] OR “HIV Diagnosis” [Mesh] OR “Testing HIV-AIDS” [Mesh] OR “Rapid HIV testing” OR “HIV Self-Testing” OR “HIV Prevention” OR “HIV Screening” OR “Human Immunodeficiency Virus Testing”) AND (“Machine Learning” [Mesh] OR “Artificial Intelligence” [Mesh] OR “Unsupervised Machine Learning” [Mesh] OR “Supervised Machine Learning” [Mesh] OR “Algorithms” [Mesh] OR “Models” [Mesh] OR “Deep Learning” [Mesh] OR “Neural Networks, Computer” [Mesh] OR “Support Vector Machine” [Mesh] OR “Random Forest” [Mesh] OR “Decision Trees” [Mesh] OR “Convolutional Neural Networks” OR “Recurrent Neural Networks” OR “XGBoost”) |
ML Algorithms | No. of Studies | Largest Dataset Size/Reference | Best Performance/Reference | Binned Size | References |
---|---|---|---|---|---|
LR | 19 | 4,348,178 [15] | 90.5% highest accuracy Best model in [14,36] | Large | [14,15,19,20,21,24,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44] |
RF | 15 | 4,348,178 [15] | 94.4% highest accuracy Best model in [13,19,32,34,36] | Large | [10,13,15,19,20,21,24,29,31,32,34,35,36,41,42,45,46] |
SVM | 13 | 124,777 [40] | 95.1% highest accuracy Best model in [22] | Large | [10,20,22,24,30,31,32,36,39,40,41,42,47,48] |
XGBoost | 9 | 124,777 [40] | 99% highest sensitivity Best model in [10,23,24,35,40] | Large | [10,13,23,24,29,30,34,35,40] |
DL models (ANN, RNN, CNN, LSTM) | 9 | 88,642 [13] | 98% highest accuracy Best model in [47,48,49] | Large | [13,24,30,31,47,48,49,50,51] |
LASSO model | 7 | 4,348,178 [15] | 82% highest accuracy | Large | [15,22,23,24,37,52,53] |
DT | 7 | 56,682 [25] | 81.9% highest accuracy Best model in [31] | Large | [14,25,31,32,35,39,50] |
KNN | 6 | 6672 [35] | 80% highest accuracy | Small | [10,24,29,30,31,35] |
Machine Learning Interventions | Key Findings | References |
---|---|---|
| Models were developed; ML models that accurately predicted individuals at the highest risk of HIV for prioritized testing were validated -HIV diagnosis was accurately predicted from secondary data A study predicted monthly incidences of HIV from 2020 to 2030 -Biomarker indicators for HIV diagnosis were identified Dynamic changes in the immune state were associated with HIV Age, gender, race, wealth index, province, contraceptive use, sexual behavior, condom use, alcohol/drug usage, knowledge of HIV, intimate partner violence, hepatitis diagnosis, pregnancy, depression, male circumcision, being male, MSM, and STI history/diagnosis as key predictors of HIV Studies developed models such as MySTIRisk and SexPro for self-HIV risk assessment -The number of those who needed to be tested to find one undiagnosed PLHIV from certain communities/countries was predicted HIV diagnosis from magnetic resonance imaging (MRI) was predicted using ML -HIV prevalence and incidence was forecasted | [10,13,15,19,20,21,22,24,30,31,32,33,35,36,37,38,40,43,44,45,46,47,48,50,51,52,53,56,58,59,61,62,65,66,67,68] |
| Models that enhance early HIV diagnosis using multiple ML from secondary data were developed Models predicted the number of people to be diagnosed with HIV in the next decade by analyzing their socio-behavioral data Individuals’ HIV statuses were predicted using DHS, EHRs, and hospital records HIV hotspots in multiple countries were identified ML models improved workflow with the ability to report immediately to reduce infection | [22,23,24,25,29,49,53,68] |
| ML is more likely to correctly interpret true-negative HIV test results (NPV = 100%) ML models improve diagnostics performance and reduce false-positive/-negative results HealthPulse AI provides accurate and consistent results in interpreting HIV RDT test results ML models that are efficient and effective for HIV testing among KPs such as MSM were developed ML methods outperformed traditional approaches in several studies Studies developed ML algorithms that can accurately facilitate HIV counseling and testing as well as interpret HIV test results with and without internet connectivity Cost-effective HIV testing for low-income countries was achieved An ML method increased the economic benefits of HIVST kit distribution by more than 23% | [22,29,33,34,48,49,50,57,59,63] |
| ML models enhance SHIVT and improve interpretations of results Chatbots and conversational agents with mHealth solutions improve convenience for using HIVST Models diagnosed HIV from MRI using ML | [17,29,41,60,64,65] |
Studies | Traditional Methods | Machine Learning | Outcome |
---|---|---|---|
Roche et al. [55] | Human interpretation of HIVST | AI algorithm interpretation of HIVST | Humans are more likely to correctly interpret true-positive HIV test results (PPV = 100%) compared to the AI algorithm (PPV = 82%) The AI algorithm (NPV-100%) is more likely to correctly interpret true negatives in comparison to humans (NPV-99.9%) |
Ni et al. [41] | Human interpretation and empirical models | ML models | The ML model motivated more individuals to conduct HIVST The difference between the ML model and the empirical scale was not significant |
Jing et al. [39] | Human | ML models | The ML model outperformed human identifications and distribution of HIVST kits The ML approach increased HIVST kit distribution by 18% |
He et al. [32] | TMs | ML models | -The ML models outperformed TMs in HIV risk prediction among MSM -ML achieved 94% accuracy |
Jing et al. [63] | TMs | ML | The ML method outperformed TMs The ML method increased the economic benefits of HIVST kit distribution by more than 23% |
Bao et al. [34] | TMs | ML | The ML models consistently outperformed the TM used The ML achieved an accuracy of 76.3% compared to that of TMs (68%) |
Oladokun et al. [14] | TMs | ML | The TM used outperformed the ML model Both models did not achieve high accuracy |
Rice et al. [66] | TMs | ML | The ML model outperformed the TM used HIV testing was increased by 18.8% in the AI group compared to the comparison group (8.1%) |
Balzer et al. [33] | TMs | ML | ML outperformed TMs ML model achieved an accuracy of 78% compared to TM (68%) |
Conclusion | TMs outperformed ML in only two studies | ML outperformed TMs in seven studies | ML models outperformed TMs based on the empirical evidence from the study’s sample |
Predictive Model | Studies | Mean | Std. Err | Std. Dev | 95% CI |
---|---|---|---|---|---|
Machine Learning | 35 | 86.66 | 1.79 | 10.61 | 82.01–89.03 |
Traditional Method | 8 | 73.13 | 2.29 | 6.47 | 67.72–78.54 |
Combined Values | 43 | 83.33 | 1.69 | 11.07 | 79.92–87.73 |
Difference in Values | 12.53 | 2.91 | 6.39–18.66 |
Features | Successes/Strengths | Gaps/Limitations | Future Research and Development |
---|---|---|---|
Study design | 14 studies utilized primary data, and most of them prospectively predicted HIV testing. This is essential for the following: Minimizing missing information Preventing recall bias Capturing important sociodemographic and socio-behavioral data | Most of the studies employed cross-sectional retrospective designs using secondary data, which are subject to the following: Recall bias Incomplete information Imbalanced data | More studies should evaluate the effectiveness of ML models by using prospective designs Primary studies are essential for capturing real-time information and ensuring high data quality |
Data quality and sources | Some studies used large samples, providing enough data to train the ML models Studies that collected primary data were more likely to have quality data to provide accurate predictions | EHRs and hospital records sometimes have limited patient information Many studies used cross-sectional survey data Self-reported information is subject to recall bias Secondary data, in general, are subject to missing information Many studies experienced data imbalances | Data used for HIV testing predictive modeling should be cleaned Missing data from datasets should be properly treated The use of primary data should be encouraged for this kind of predictive modeling |
ML models | Studies developed and validated models that are highly accurate in predicting HIV testing Studies developed novel models for the first time with high accuracy | Some ML models were overfitted Some models are complex to interpret Poorly developed models can lead to false prediction | New models need to be trained and validated with different sets of data Training on different sets of models, especially in developing countries, needs to be improved |
Generalizability | Studies evaluated the accuracy of several MLs on a single dataset Studies utilized very large sample sizes Studies used datasets from multiple countries to predict HIV testing | Many studies applied a single ML algorithm Some samples were very small for predictive modeling Many studies were conducted on a single population/country | ML models should be trained using large amounts of data with a variety of variables ML models with high accuracy should be evaluated using multiple-country data |
Ethical Considerations of ML | Some ML models analyzed large amounts of data while addressing data security and privacy concerns ML enhances HIVST for individuals with privacy concerns | ML, in general, raises ethical concerns, and many studies fail to address this There is a lack of trust in and acceptability of ML methods Some ML models still require improvement to facilitate self-counseling and effective testing for HIV | ML models should be improved, ensuring high data protection and privacy-conscious ML applications used for HIVST should be improved to avoid ethical concerns with HIV testing |
Accuracy and performance | ML models are highly accurate and outperformed TMs in several studies ML models accurately classify false-positive/-negative results | -Some ML models were less accurate than traditional predictions Some ML models are only effective in predicting either false positives or false negatives | ML models require more improvements with adequate data to achieve consistent accuracy beyond human capacity |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Jaiteh, M.; Phalane, E.; Shiferaw, Y.A.; Voet, K.A.; Phaswana-Mafuya, R.N. Utilization of Machine Learning Algorithms for the Strengthening of HIV Testing: A Systematic Review. Algorithms 2024, 17, 362. https://doi.org/10.3390/a17080362
Jaiteh M, Phalane E, Shiferaw YA, Voet KA, Phaswana-Mafuya RN. Utilization of Machine Learning Algorithms for the Strengthening of HIV Testing: A Systematic Review. Algorithms. 2024; 17(8):362. https://doi.org/10.3390/a17080362
Chicago/Turabian StyleJaiteh, Musa, Edith Phalane, Yegnanew A. Shiferaw, Karen Alida Voet, and Refilwe Nancy Phaswana-Mafuya. 2024. "Utilization of Machine Learning Algorithms for the Strengthening of HIV Testing: A Systematic Review" Algorithms 17, no. 8: 362. https://doi.org/10.3390/a17080362
APA StyleJaiteh, M., Phalane, E., Shiferaw, Y. A., Voet, K. A., & Phaswana-Mafuya, R. N. (2024). Utilization of Machine Learning Algorithms for the Strengthening of HIV Testing: A Systematic Review. Algorithms, 17(8), 362. https://doi.org/10.3390/a17080362