Next Article in Journal
Towards an Automatic Test Generation Method for Systems of Systems Based on Fault Injection and Model-Based Systems Engineering
Next Article in Special Issue
Factors Affecting Information Security and the Implementation of Bring Your Own Device (BYOD) Programmes in the Kingdom of Saudi Arabia (KSA)
Previous Article in Journal
A Study on the Efficiency in the Energy Harvesting Device Using Resonance of Pendulum
Previous Article in Special Issue
Decision-Refillable-Based Two-Material-View Fuzzy Classification for Personal Thermal Comfort
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Trends and Application of Artificial Intelligence Technology in Orthodontic Diagnosis and Treatment Planning—A Review

by
Farraj Albalawi
1,2,* and
Khalid A. Alamoud
1,2
1
Preventive Dental Science Department, College of Dentistry, King Saud Bin Abdulaziz University for Health Sciences, Riyadh 11426, Saudi Arabia
2
King Abdullah International Medical Research Centre, Ministry of National Guard Health Affairs, Riyadh 11481, Saudi Arabia
*
Author to whom correspondence should be addressed.
Appl. Sci. 2022, 12(22), 11864; https://doi.org/10.3390/app122211864
Submission received: 19 September 2022 / Revised: 18 November 2022 / Accepted: 19 November 2022 / Published: 21 November 2022
(This article belongs to the Special Issue Applied and Innovative Computational Intelligence Systems)

Abstract

:
Artificial intelligence (AI) is a new breakthrough in technological advancements based on the concept of simulating human intelligence. These emerging technologies highly influence the diagnostic process in the field of medical sciences, with enhanced accuracy in diagnosis. This review article intends to report on the trends and application of AI models designed for diagnosis and treatment planning in orthodontics. A data search for the original research articles that were published over the last 22 years (from 1 January 2000 until 31 August 2022) was carried out in the most renowned electronic databases, which mainly included PubMed, Google Scholar, Web of Science, Scopus, and Saudi Digital Library. A total of 56 articles that met the eligibility criteria were included. The research trend shows a rapid increase in articles over the last two years. In total: 17 articles have reported on AI models designed for the automated identification of cephalometric landmarks; 12 articles on the estimation of bone age and maturity using cervical vertebra and hand-wrist radiographs; two articles on palatal shape analysis; seven articles for determining the need for orthodontic tooth extractions; two articles for automated skeletal classification; and 16 articles for the diagnosis and planning of orthognathic surgeries. AI is a significant development that has been successfully implemented in a wide range of image-based applications. These applications can facilitate clinicians in diagnosing, treatment planning, and decision-making. AI applications are beneficial as they are reliable, with enhanced speed, and have the potential to automatically complete the task with an efficiency equivalent to experienced clinicians. These models can prove as an excellent guide for less experienced orthodontists.

1. Introduction

Artificial intelligence (AI) is a new breakthrough in technological advancements based on the concept of simulating human intelligence. AI models are designed to assist humans in completing tasks more efficiently and are developed through training and programming, using a large number of datasets, and then executing these models to turn the data into actionable information in performing a specific task [1]. These emerging technologies highly influence the diagnostic process in medical sciences, with enhanced accuracy in diagnosis [2]. AI models have been applied in healthcare in order to assist healthcare professionals and enhance the accuracy in diagnosis, decision making, and predicting prognosis, with the ultimate goal of enhancing patient care and treatment outcomes. AI models have also demonstrated performances that are on par with trained and experienced healthcare professionals [3].
AI technology has been widely applied in dentistry. These models are based on Machine Learning (ML) systems, which are designed using algorithms that can be trained using a large number of data sets and later applied to new sets of data for testing and evaluation. ML based AI models have displayed excellent accuracies in making predictions based on the datasets without human interventions [4,5,6]. AI models based on the newly developed and advanced system known as Deep Learning (DL) are designed to mimic the functioning of the neural system of the human brain; hence they are termed artificial neural networks [7].
The AI system has been gaining high popularity in dentistry, as they have been widely applied for diagnosing and predicting oral diseases such as dental caries, periodontal diseases, and oral cancer [8,9,10,11]. AI models have demonstrated exceptional performances in diagnosis, determining the treatment needs, and predicting the prognosis of diseases [1,5,8,9,10,11,12,13]. Along with this, AI models have also been designed and applied in the field of forensic odontology, where the models have demonstrated excellent precision in performing tasks [14]. Considering these developments in AI, this review article intends to report on the trends and application of AI models designed for diagnosis and treatment planning in orthodontics.

2. Materials and Methods

2.1. Search Strategy

Data search for the articles that have reported on the application of AI models in orthodontics was carried out in the most renowned electronic databases. These databases mainly included PubMed, Google Scholar, Web of Science, Scopus, and Saudi Digital Library. This search was mainly carried out for original research articles published over the last 22 years, from 1 January 2000 until 31 August 2022. Several Medical Subheadings (MeSH terms) were used for searching the articles in the electronic databases. MeSH terms included: artificial intelligence, automated diagnosis, computer-assisted diagnosis, digital diagnosis, supervised learning, orthodontics, dentofacial orthopedics, unsupervised learning, diagnosis, prognosis, prediction, deep learning, machine learning, artificial neural networks, and convolutional neural networks. Boolean operators AND/OR were used to generate a combination of these key words in the advanced search. Language filters for the English language were also used. A manual search for articles was also performed simultaneously in the college central library after screening the references of the articles obtained from the electronic search.
At this stage, article selection was based on the title and abstract; 628 articles related to our research topic were extracted. Later, 436 articles were excluded due to duplication. The remaining 192 articles were applied for the eligibility criteria for being included in this review article.

2.2. Eligibility Criteria and Study Selection

Original research articles that reported on the application of AI models in orthodontics were included in this systematic review. Articles with no full text, narrative reviews, scoping reviews, letters to editors, opinion letters, case reports, short communications, conference proceedings, and articles other than English, were excluded (Figure 1).
A total of 56 articles that fulfilled the eligibility criteria were subjected to qualitative synthesis (Table 1).
Summary of AI models designed for different diagnostic tasks is presented in Table 2.

3. Results

3.1. Qualitative Synthesis of the Included Studies

The research trend shows a gradual increase in the number of research publications over the last two decades. However, in the last two years, the number of articles reported on the application of AI models in orthodontics has rapidly increased (Figure 2).

3.2. Study Characteristics

AI models developed for application in orthodontics have mainly focused on: the automated identification of cephalometric landmarks [15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31]; the estimation of bone age and maturity using cervical vertebra and hand-wrist radiographs [32,33,34,35,36,37,38,39,40,41,42,43]; palatal shape analysis [44,45]; determining the need for orthodontic tooth extractions [46,47,48,49,50,51,52]; automated skeletal classification [53,54]; and the diagnosis and planning of orthognathic surgeries [55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70] (Figure 3).

4. Discussion

Digitalization in medical diagnosis is a new breakthrough in the field of health sciences. In dentistry, digital technology has been widely applied in clinical practice, especially with the use of 3D intra oral scanners designed for scanning dental arches. These technical advancements have simplified the process of impression making and fabrication of prostheses [71,72]. The recent advancements in the field of medical sciences and computer technology have resulted in significant developments in AI based models that have been designed for diagnosing oral diseases, treatment planning, clinical decision making, and predicting treatment outcomes; these models have demonstrated excellent performances [1,9,10,11].

4.1. AI Models Designed for Automatically Identifying Cephalometric Landmarks

In orthodontics, cephalometric analysis is considered one of the most significant tools for evaluating the skeletal profile of the craniofacial region. The manual tracing of X-ray films and plotting the landmarks requires skill and expertise. Advancements in AI technology have resulted in the development of automated models that can predict landmarks without human assistance. Nishimoto S et al. [15] reported on an automated landmark predicting system based on a deep learning neural network, where the model demonstrated a performance equivalent to manual plotting. Park JH et al. [16] reported on the performance of two automatic deep learning models You-Only-Look-Once version 3 (YOLOv3) and Single Shot Multibox Detector (SSD) designed for identifying cephalometric landmarks. The YOLOv3 algorithm outperformed SSD in accuracy and displayed 5% higher accuracy than the benchmark methods reported in the literature. Kunz F et al. [18] reported on an automatic cephalometric identification model using an (AI) algorithm; this model demonstrated quality levels equivalent to experienced professional examiners. Hwang HW et al. [19] reported on the performance of an automated identification system, You-Only-Look-Once version 3 (YOLOv3), for the automatic identification of cephalometric landmarks. This model displaced excellent accuracies, which were similar to experienced human examiners. Zeng M et al. [20] reported on an AI based model designed for automatically predicting cephalometric landmarks; this model demonstrated competitive performance compared with other models. Bulatova G et al. [22] reported on an AI based model for automated cephalometric landmark identification; this model demonstrated a performance similar to a calibrated senior orthodontist. Hwang HW et al. [23] compared the performance of a deep learning based AI model with previously reported AI models in the literature designed to identify cephalometric landmarks automatically. This model demonstrated superior results in comparison with the previously reported AI models. Kim J et al. [24] reported that a CNN model designed to identify cephalometric landmarks displayed excellent accuracies. Kim YH et al. [25] reported on a deep learning based fully automatic AI model for identifying cephalometric landmarks; this model demonstrated better performance than two calibrated and experienced examiners. Kim MJ et al. [26] reported on a CNN model designed for the automated identification of cephalometric landmarks using cone-beam computed tomography (CBCT) scans; this model displayed better consistency in identifying the landmarks in comparison with the experienced human examiners. Another study conducted by Kim MJ et al. [27] reported on an automatic cephalometric landmark identification system using CBCT images; this model displayed a performance equivalent to the experienced examiners. Yao J et al. [28] reported on a CNN based AI based model for automatically identifying the cephalometric landmarks; this model demonstrated a higher accuracy. Le VNT et al. [29] reported on a human-AI collaboration for identifying cephalometric landmarks. The collaborative system was effective in identifying landmarks. Gil SM et al. [30] reported on a convolution neural network (CNN) based AI model for identifying cephalometric landmarks; this model demonstrated excellent performance, similar to a human examiner’s performance.

4.2. AI Models Designed for Bone Age and Maturity Estimation

The timing of orthodontic treatment is crucial in achieving the desired clinical outcomes. In treatment planning, quantifying the skeletal growth, mainly the mandible, impacts the diagnosis, treatment planning, and treatment outcomes [73]. Therefore, if orthodontic treatment is initiated during the optimum development phase, it will produce more favorable results. Otherwise, a much longer treatment time and surgical intervention may be needed to correct the deformities of the jaw [74,75]. The standard method for estimating bone maturity uses a hand-wrist radiograph and a lateral cephalogram to estimate cervical vertebral maturity (CVM). However, studies have reported that the reproducibility of the CVM varies among examiners [76,77]. In recent developments, AI has been widely used to estimate bone maturation using hand-wrist radiographs or CVM. Kok H et al. [32] reported on the efficiency of seven AI classifiers designed to determine growth; based on cervical vertebrae stages. These models demonstrated acceptable performance in determining the stages. Another study conducted by Kok H et al. [33] also reported the application of an artificial neural network (ANN) model for determining growth based on cervical vertebrae. This model demonstrated satisfactory results in determining the growth-development periods. Kok H et al. [34] also reported on the success rates of two AI models, artificial neural network models (NNMs) and naïve Bayes models (NBMs), designed for determining the growth and development based on the cervical vertebrae. NNMs displayed a higher success rate than the NBMs. Amasya H et al. [35] reported on the performance of five AI based Machine Learning (ML) models designed for CVM analysis. These AI models displayed more accuracy in comparison with the human observer. Amasya H et al. [36] also reported on the validation of the ANN model designed for CVM analysis; this model displayed better performance in comparison with four trained human observers. Seo H et al. [37] reported on the performance of six CNN based deep learning models designed for CVM analysis on cephalometric radiographs. These six models demonstrated more than 90% accuracy in performing the task. Zhou J et al. [38] reported on the performance of an AI model designed for automatically determining the CVM status using cephalometric radiographs. This model demonstrated good agreement with the human examiners. Kim DW et al. [39] reported on the AI model designed for predicting the hand-wrist skeletal maturation stages. The model demonstrated excellent accuracy in predicting the skeletal maturation stages. Kim EG et al. [40] reported on an AI based CNN model designed for estimating the CVM using lateral cephalograms. The model displayed 93% accuracy in performing the task. Mohammad-Rahimi H et al. [41] reported on an AI model for determining CVM and growth spurts using lateral cephalograms. The model demonstrated reasonable accuracy in determining the CVM stage and displayed high reliability in estimating the pubertal stage. Li H et al. [42] reported on AI based CNN model for CVM classification. This model demonstrated good accuracy in classifying the CVM. Atici SF et al. [43] reported on an AI based deep learning model designed for estimating the CVM stages; this model displayed higher accuracy in determining the CVM stages.

4.3. AI Models Designed for Palatal Shape Analysis

The palate has a complex structure, and its shape varies among individuals. The palate’s shape is related to the facial pattern and a wide range of factors such as breathing pattern and occlusion [78,79,80]. The shape of the palate is of great interest to orthodontists as it is a potential area for evaluation and assessing the outcome of orthodontic procedures like maxillary expansion [81,82].
Palatal measurements usually include palatal surface area, volume, and depth [78]. These measurements often require greater experience and are often subjected to observer errors. The recent technological advancements have resulted in the development of AI based models designed for palatal shape analysis. Croquet B et al. [44] reported on a deep learning model designed for analyzing the palatal shape. This automatic model demonstrated excellent repeatability with promising accuracy. Nauwelaers N et al. [45] reported on the application of an AI based deep learning model for palatal shape analysis, and this model achieved results similar to conventional approaches.

4.4. AI Models Designed for Determining the Need for Extractions

Determining the need for tooth extraction and deciding which teeth need to be extracted is a critical decision in orthodontic treatment planning as it is irreversible [83]. The orthodontists’ decision regarding extraction is based on their training, clinical experience, and treatment philosophies [84]. AI technology has been applied to designing models which can be used as an axillary tool for deciding on the need for orthodontic extractions. Xie X et al. [46] reported on the AI based ANN model for determining the need for extraction; this model was very efficient and displayed an accuracy of 80% in determining the need for extraction. Jung SK et al. [47] reported on the performance of an AI model designed to diagnose the need for orthodontic extraction. The model was very efficient in diagnosing extraction and non-extraction cases. Li P et al. [48] reported on the multilayer perceptron ANN model for predicting extraction and non-extraction cases. The model demonstrated an excellent accuracy of 94% for predicting the extraction and non-extraction cases. Choi HI et al. [49] reported on an AI based model designed to determine the need for extraction. This model displayed a success rate of 91% for determining extraction decisions. Suhail Y et al. [50] reported on a machine learning model to diagnose the need for extraction. The model demonstrated a performance that was in agreement with the trained examiners. Etemad L et al. [51] reported on a machine learning model for predicting the need for extraction and non-extraction. The model displayed acceptable results; however, the authors suggested a need for improvisation in the algorithms to improve generalizability.

4.5. AI Models Designed for Planning Orthognathic Surgeries

Individuals presenting dentofacial deformities, either due to congenital or acquired conditions, may require orthognathic surgeries in order to reposition the jaws into a functional relationship. In recent years, several articles have reported on the application of automated computerized methods designed for analyzing dentofacial deformities and elaborating treatment plans [85]. Patcas R et al. [57] reported on an AI model designed for predicting facial appearance post orthognathic surgery; this model displayed an acceptable performance in predicting facial attractiveness and appearance. Knoops PGM et al. [58] reported on a machine learning model designed for automated diagnosis and treatment planning. This model demonstrated an excellent sensitivity of 95.5% and specificity of 95.2% in diagnosing the patients. Stehrer R et al. [59] reported on an AI model for predicting perioperative blood loss following orthognathic surgery. The model demonstrated an excellent result and efficiently predicted the perioperative blood loss prior to surgery. Jeong SH et al. [60] reported on an AI model designed for judging the soft tissue profiles requiring orthognathic surgery. The model displayed an accuracy of 89.3% in judging the soft tissue profiles requiring surgery. Lee K-S et al. [61] reported on an AI based deep CNN model for differential diagnosis of orthognathic surgery. The model was successful and can be applied for differential diagnosis of orthognathic surgery. Tanikawa C et al. [62] reported on an AI model designed for predicting facial morphology post orthognathic surgery. The model demonstrated an excellent success rate in predicting facial morphology and can be applied for clinical purposes. Xiao D et al. [63] reported on an AI model designed for virtually simulating the surgical plan. The model showed higher accuracy in generating the shape models. Shin W et al. [68] reported on an AI model that automatically predicts the need for orthognathic surgery. The model was efficient with relative accuracy in predicting the need for surgery. Kim YH et al. [69] reported on an AI based deep learning model designed to diagnose orthognathic surgery. The model demonstrated excellent performance in predicting the diagnosis of orthognathic surgery.
A few of the limitations of this paper might be with the search strategy. Even though we have performed a comprehensive search for articles, some might have been missed. In general, these AI models’ limitations are mainly due to the limited amount of data sets that have been applied for training these models, and validating and testing. Another limitation of the data sets is the standardization since the data sets applied for assessing the performance of these AI models are obtained from one diagnostic center in most cases. Hence, the performance of these models may vary when exposed to different data sets from multiple centers. However, considering the performance of these AI models, there is an urgent need to develop and implement policies to accelerate the process of approval of these models for marketing and usage in clinical scenarios, which can help clinicians in the diagnosis and decision making process.

5. Conclusions

The past decade has witnessed tremendous advancements in digital diagnostic techniques. AI is a major development that has been successfully implemented in a wide range of image-based applications. These applications can facilitate clinicians in diagnosing, treatment planning, and decision making. These applications are extremely useful as they are reliable and fast methods that have the potential of automatically completing the task with an efficiency equivalent to experienced clinicians. These models can prove to be an excellent guide for less experienced orthodontists. However, there are a few limitations with most of these models, with respect to the limited number of datasets used for training and validating these models, and the reliability of the data, as they are obtained from a single hospital/institution or a single machine. Hence, greater improvisation needs to be conducted in this area for better reliability and generalizability.

Author Contributions

Conceptualization, F.A.; methodology, F.A. and K.A.A.; software, F.A.; validation, F.A.; formal analysis, F.A.; investigation, F.A.; resources, F.A.; data curation, F.A.; writing—original draft preparation, F.A. and K.A.A.; writing—review and editing, F.A. and K.A.A.; visualization, F.A.; supervision, F.A.; project administration, F.A. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Khanagar, S.B.; Al-Ehaideb, A.; Maganur, P.C.; Vishwanathaiah, S.; Patil, S.; Baeshen, H.A.; Sarode, S.C.; Bhandi, S. Developments, Application, and Performance of Artificial Intelligence in Dentistry—A Systematic Review. J. Dent. Sci. 2020, 16, 508–522. [Google Scholar] [CrossRef] [PubMed]
  2. Chen, Y.-W.; Stanley, K.; Att, W. Artificial Intelligence in Dentistry: Current Applications and Future Perspectives. Quintessence Int. 2020, 51, 248–257. [Google Scholar] [CrossRef] [PubMed]
  3. Basu, K.; Sinha, R.; Ong, A.; Basu, T. Artificial Intelligence: How Is It Changing Medical Sciences and Its Future? Indian J. Dermatol. 2020, 65, 365–370. [Google Scholar] [CrossRef]
  4. Kwon, O.; Yong, T.-H.; Kang, S.-R.; Kim, J.-E.; Huh, K.-H.; Heo, M.-S.; Lee, S.-S.; Choi, S.-C.; Yi, W.-J. Automatic Diagnosis for Cysts and Tumors of Both Jaws on Panoramic Radiographs Using a Deep Convolution Neural Network. Dentomaxillofac. Radiol. 2020, 49, 20200185. [Google Scholar] [CrossRef] [PubMed]
  5. Hung, K.; Montalvao, C.; Tanaka, R.; Kawai, T.; Bornstein, M.M. The Use and Performance of Artificial Intelligence Applications in Dental and Maxillofacial Radiology: A Systematic Review. Dentomaxillofac. Radiol. 2019, 49, 20190107. [Google Scholar] [CrossRef]
  6. LeCun, Y.; Bengio, Y.; Hinton, G. Deep Learning. Nature 2015, 521, 436–444. [Google Scholar] [CrossRef]
  7. Sayres, R.; Taly, A.; Rahimy, E.; Blumer, K.; Coz, D.; Hammel, N.; Krause, J.; Narayanaswamy, A.; Rastegar, Z.; Wu, D.; et al. Using a Deep Learning Algorithm and Integrated Gradients Explanation to Assist Grading for Diabetic Retinopathy. Ophthalmology 2019, 126, 552–564. [Google Scholar] [CrossRef] [Green Version]
  8. Li, S.; Liu, J.; Zhou, Z.; Zhou, Z.; Wu, X.; Li, Y.; Wang, S.; Liao, W.; Ying, S.; Zhao, Z. Artificial Intelligence for Caries and Periapical Periodontitis Detection. J. Dent. 2022, 122, 104107. [Google Scholar] [CrossRef] [PubMed]
  9. Mohammad-Rahimi, H.; Motamedian, S.R.; Rohban, M.H.; Krois, J.; Uribe, S.E.; Mahmoudinia, E.; Rokhshad, R.; Nadimi, M.; Schwendicke, F. Deep Learning for Caries Detection: A Systematic Review. J. Dent. 2022, 122, 104115. [Google Scholar] [CrossRef] [PubMed]
  10. Khanagar, S.B.; Alfouzan, K.; Awawdeh, M.; Alkadi, L.; Albalawi, F.; Alfadley, A. Application and Performance of Artificial Intelligence Technology in Detection, Diagnosis and Prediction of Dental Caries (DC)—A Systematic Review. Diagnostics 2022, 12, 1083. [Google Scholar] [CrossRef] [PubMed]
  11. Khanagar, S.B.; Naik, S.; Al Kheraif, A.A.; Vishwanathaiah, S.; Maganur, P.C.; Alhazmi, Y.; Mushtaq, S.; Sarode, S.C.; Sarode, G.S.; Zanza, A.; et al. Application and Performance of Artificial Intelligence Technology in Oral Cancer Diagnosis and Prediction of Prognosis: A Systematic Review. Diagnostics 2021, 11, 1004. [Google Scholar] [CrossRef] [PubMed]
  12. Lee, J.-H.; Kim, D.-H.; Jeong, S.-N.; Choi, S.-H. Detection and Diagnosis of Dental Caries Using a Deep Learning-Based Convolutional Neural Network Algorithm. J. Dent. 2018, 77, 106–111. [Google Scholar] [CrossRef] [PubMed]
  13. Yang, H.; Jo, E.; Kim, H.J.; Cha, I.; Jung, Y.-S.; Nam, W.; Kim, J.-Y.; Kim, J.-K.; Kim, Y.H.; Oh, T.G.; et al. Deep Learning for Automated Detection of Cyst and Tumors of the Jaw in Panoramic Radiographs. J. Clin. Med. 2020, 9, 1839. [Google Scholar] [CrossRef] [PubMed]
  14. Khanagar, S.B.; Vishwanathaiah, S.; Naik, S.; Al-Kheraif, A.A.; Devang Divakar, D.; Sarode, S.C.; Bhandi, S.; Patil, S. Application and Performance of Artificial Intelligence Technology in Forensic Odontology—A Systematic Review. Leg. Med. 2021, 48, 101826. [Google Scholar] [CrossRef]
  15. Nishimoto, S.; Sotsuka, Y.; Kawai, K.; Ishise, H.; Kakibuchi, M. Personal Computer-Based Cephalometric Landmark Detection with Deep Learning, Using Cephalograms on the Internet. J. Craniofacial Surg. 2019, 30, 91–95. [Google Scholar] [CrossRef] [PubMed]
  16. Park, J.-H.; Hwang, H.-W.; Moon, J.-H.; Yu, Y.; Kim, H.; Her, S.-B.; Srinivasan, G.; Aljanabi, M.N.A.; Donatelli, R.E.; Lee, S.-J. Automated Identification of Cephalometric Landmarks: Part 1—Comparisons between the Latest Deep-Learning Methods YOLOV3 and SSD. Angle Orthod. 2019, 89, 903–909. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Chen, S.; Wang, L.; Li, G.; Wu, T.-H.; Diachina, S.; Tejera, B.; Kwon, J.J.; Lin, F.-C.; Lee, Y.-T.; Xu, T.; et al. Machine Learning in Orthodontics: Introducing a 3D Auto-Segmentation and Auto-Landmark Finder of CBCT Images to Assess Maxillary Constriction in Unilateral Impacted Canine Patients. Angle Orthod. 2020, 90, 77–84. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Kunz, F.; Stellzig-Eisenhauer, A.; Zeman, F.; Boldt, J. Artificial Intelligence in Orthodontics. J. Orofac. Orthop. Fortschr. Der Kieferorthopädie 2019, 81, 52–68. [Google Scholar] [CrossRef]
  19. Hwang, H.-W.; Park, J.-H.; Moon, J.-H.; Yu, Y.; Kim, H.; Her, S.-B.; Srinivasan, G.; Aljanabi, M.N.A.; Donatelli, R.E.; Lee, S.-J. Automated Identification of Cephalometric Landmarks: Part 2—Might It Be Better than Human? Angle Orthod. 2020, 90, 69–76. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  20. Zeng, M.; Yan, Z.; Liu, S.; Zhou, Y.; Qiu, L. Cascaded Convolutional Networks for Automatic Cephalometric Landmark Detection. Med. Image Anal. 2021, 68, 101904. [Google Scholar] [CrossRef] [PubMed]
  21. Lee, J.-H.; Yu, H.-J.; Kim, M.-J.; Kim, J.-W.; Choi, J. Automated Cephalometric Landmark Detection with Confidence Regions Using Bayesian Convolutional Neural Networks. BMC Oral Health 2020, 20, 270. [Google Scholar] [CrossRef] [PubMed]
  22. Bulatova, G.; Kusnoto, B.; Grace, V.; Tsay, T.P.; Avenetti, D.M.; Sanchez, F.J.C. Assessment of Automatic Cephalometric Landmark Identification Using Artificial Intelligence. Orthod. Craniofacial Res. 2021, 24, 37–42. [Google Scholar] [CrossRef] [PubMed]
  23. Hwang, H.-W.; Moon, J.-H.; Kim, M.-G.; Donatelli, R.E.; Lee, S.-J. Evaluation of Automated Cephalometric Analysis Based on the Latest Deep Learning Method. Angle Orthod. 2021, 91, 329–335. [Google Scholar] [CrossRef] [PubMed]
  24. Kim, J.; Kim, I.; Kim, Y.-J.; Kim, M.; Cho, J.-H.; Hong, M.; Kang, K.-H.; Lim, S.-H.; Kim, S.-J.; Kim, Y.H.; et al. Accuracy of Automated Identification of Lateral Cephalometric Landmarks Using Cascade Convolutional Neural Networks on Lateral Cephalograms from Nationwide Multi-Centres. Orthod. Craniofacial Res. 2021, 24 (Suppl. 2), 59–67. [Google Scholar] [CrossRef] [PubMed]
  25. Kim, Y.H.; Lee, C.; Ha, E.-G.; Choi, Y.J.; Han, S.-S. A Fully Deep Learning Model for the Automatic Identification of Cephalometric Landmarks. Imaging Sci. Dent. 2021, 51, 299–306. [Google Scholar] [CrossRef] [PubMed]
  26. Kim, M.-J.; Liu, Y.; Oh, S.H.; Ahn, H.-W.; Kim, S.-H.; Nelson, G. Evaluation of a Multi-Stage Convolutional Neural Network-Based Fully Automated Landmark Identification System Using Cone-Beam Computed Tomographysynthesized Posteroanterior Cephalometric Images. Korean J. Orthod. 2021, 51, 77–85. [Google Scholar] [CrossRef]
  27. Kim, M.-J.; Liu, Y.; Oh, S.H.; Ahn, H.-W.; Kim, S.-H.; Nelson, G. Automatic Cephalometric Landmark Identification System Based on the Multi-Stage Convolutional Neural Networks with CBCT Combination Images. Sensors 2021, 21, 505. [Google Scholar] [CrossRef] [PubMed]
  28. Yao, J.; Zeng, W.; He, T.; Zhou, S.; Zhang, Y.; Guo, J.; Tang, W. Automatic Localization of Cephalometric Landmarks Based on Convolutional Neural Network. Am. J. Orthod. Dentofac. Orthop. Off. Publ. Am. Assoc. Orthod. Const. Soc. Am. Board Orthod. 2022, 161, e250–e259. [Google Scholar] [CrossRef]
  29. Le, V.N.T.; Kang, J.; Oh, I.-S.; Kim, J.-G.; Yang, Y.-M.; Lee, D.-W. Effectiveness of Human-Artificial Intelligence Collaboration in Cephalometric Landmark Detection. J. Pers. Med. 2022, 12, 387. [Google Scholar] [CrossRef]
  30. Gil, S.-M.; Kim, I.; Cho, J.-H.; Hong, M.; Kim, M.; Kim, S.-J.; Kim, Y.-J.; Kim, Y.H.; Lim, S.-H.; Sung, S.J.; et al. Accuracy of Auto-Identification of the Posteroanterior Cephalometric Landmarks Using Cascade Convolution Neural Network Algorithm and Cephalometric Images of Different Quality from Nationwide Multiple Centers. Am. J. Orthod. Dentofac. Orthop. Off. Publ. Am. Assoc. Orthod. Const. Soc. Am. Board Orthod. 2022, 161, e361–e371. [Google Scholar] [CrossRef]
  31. Dot, G.; Schouman, T.; Chang, S.; Rafflenbeul, F.; Kerbrat, A.; Rouch, P.; Gajny, L. Automatic 3-Dimensional Cephalometric Landmarking via Deep Learning. J. Dent. Res. 2022, 101, 1380–1387. [Google Scholar] [CrossRef] [PubMed]
  32. Kök, H.; Acilar, A.M.; İzgi, M.S. Usage and Comparison of Artificial Intelligence Algorithms for Determination of Growth and Development by Cervical Vertebrae Stages in Orthodontics. Prog. Orthod. 2019, 20, 41. [Google Scholar] [CrossRef]
  33. Kök, H.; Izgi, M.S.; Acilar, A.M. Determination of Growth and Development Periods in Orthodontics with Artificial Neural Network. Orthod. Craniofacial Res. 2020, 24, 76–83. [Google Scholar] [CrossRef] [PubMed]
  34. Kök, H.; İzgi, M.S.; Acılar, A.M. Evaluation of the Artificial Neural Network and Naive Bayes Models Trained with Vertebra Ratios for Growth and Development Determination. Turk. J. Orthod. 2021, 34, 2–9. [Google Scholar] [CrossRef] [PubMed]
  35. Amasya, H.; Yildirim, D.; Aydogan, T.; Kemaloglu, N.; Orhan, K. Cervical Vertebral Maturation Assessment on Lateral Cephalometric Radiographs Using Artificial Intelligence: Comparison of Machine Learning Classifier Models. Dentomaxillofac. Radiol. 2020, 49, 20190441. [Google Scholar] [CrossRef] [PubMed]
  36. Amasya, H.; Cesur, E.; Yıldırım, D.; Orhan, K. Validation of Cervical Vertebral Maturation Stages: Artificial Intelligence vs Human Observer Visual Analysis. Am. J. Orthod. Dentofac. Orthop. Off. Publ. Am. Assoc. Orthod. Const. Soc. Am. Board Orthod. 2020, 158, e173–e179. [Google Scholar] [CrossRef] [PubMed]
  37. Seo, H.; Hwang, J.; Jeong, T.; Shin, J. Comparison of Deep Learning Models for Cervical Vertebral Maturation Stage Classification on Lateral Cephalometric Radiographs. J. Clin. Med. 2021, 10, 3591. [Google Scholar] [CrossRef] [PubMed]
  38. Zhou, J.; Zhou, H.; Pu, L.; Gao, Y.; Tang, Z.; Yang, Y.; You, M.; Yang, Z.; Lai, W.; Long, H. Development of an Artificial Intelligence System for the Automatic Evaluation of Cervical Vertebral Maturation Status. Diagnostics 2021, 11, 2200. [Google Scholar] [CrossRef]
  39. Kim, D.-W.; Kim, J.; Kim, T.; Kim, T.; Kim, Y.-J.; Song, I.-S.; Ahn, B.; Choo, J.; Lee, D.-Y. Prediction of Hand-Wrist Maturation Stages Based on Cervical Vertebrae Images Using Artificial Intelligence. Orthod. Craniofacial Res. 2021, 24 (Suppl. 2), 68–75. [Google Scholar] [CrossRef] [PubMed]
  40. Kim, E.-G.; Oh, I.-S.; So, J.-E.; Kang, J.; Le, V.N.T.; Tak, M.-K.; Lee, D.-W. Estimating Cervical Vertebral Maturation with a Lateral Cephalogram Using the Convolutional Neural Network. J. Clin. Med. 2021, 10, 5400. [Google Scholar] [CrossRef] [PubMed]
  41. Mohammad-Rahimi, H.; Motamadian, S.R.; Nadimi, M.; Hassanzadeh-Samani, S.; Minabi, M.A.S.; Mahmoudinia, E.; Lee, V.Y.; Rohban, M.H. Deep Learning for the Classification of Cervical Maturation Degree and Pubertal Growth Spurts: A Pilot Study. Korean J. Orthod. 2022, 52, 112–122. [Google Scholar] [CrossRef] [PubMed]
  42. Li, H.; Chen, Y.; Wang, Q.; Gong, X.; Lei, Y.; Tian, J.; Gao, X. Convolutional Neural Network-Based Automatic Cervical Vertebral Maturation Classification Method. Dentomaxillofac. Radiol. 2022, 51, 20220070. [Google Scholar] [CrossRef] [PubMed]
  43. Atici, S.F.; Ansari, R.; Allareddy, V.; Suhaym, O.; Cetin, A.E.; Elnagar, M.H. Fully Automated Determination of the Cervical Vertebrae Maturation Stages Using Deep Learning with Directional Filters. PLoS ONE 2022, 17, e0269198. [Google Scholar] [CrossRef] [PubMed]
  44. Croquet, B.; Matthews, H.; Mertens, J.; Fan, Y.; Nauwelaers, N.; Mahdi, S.; Hoskens, H.; El Sergani, A.; Xu, T.; Vandermeulen, D.; et al. Automated Landmarking for Palatal Shape Analysis Using Geometric Deep Learning. Orthod. Craniofacial Res. 2021, 24 (Suppl. 2), 144–152. [Google Scholar] [CrossRef] [PubMed]
  45. Nauwelaers, N.; Matthews, H.; Fan, Y.; Croquet, B.; Hoskens, H.; Mahdi, S.; El Sergani, A.; Gong, S.; Xu, T.; Bronstein, M.; et al. Exploring Palatal and Dental Shape Variation with 3D Shape Analysis and Geometric Deep Learning. Orthod. Craniofacial Res. 2021, 24 (Suppl. 2), 134–143. [Google Scholar] [CrossRef] [PubMed]
  46. Xie, X.; Wang, L.; Wang, A. Artificial Neural Network Modeling for Deciding If Extractions Are Necessary prior to Orthodontic Treatment. Angle Orthod. 2010, 80, 262–266. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Jung, S.-K.; Kim, T.-W. New Approach for the Diagnosis of Extractions with Neural Network Machine Learning. Am. J. Orthod. Dentofac. Orthop. Off. Publ. Am. Assoc. Orthod. Const. Soc. Am. Board Orthod. 2016, 149, 127–133. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  48. Li, P.; Kong, D.; Tang, T.; Su, D.; Yang, P.; Wang, H.; Zhao, Z.; Liu, Y. Orthodontic Treatment Planning Based on Artificial Neural Networks. Sci. Rep. 2019, 9, 2037. [Google Scholar] [CrossRef] [Green Version]
  49. Choi, H.-I.; Jung, S.-K.; Baek, S.-H.; Lim, W.H.; Ahn, S.-J.; Yang, I.-H.; Kim, T.-W. Artificial Intelligent Model with Neural Network Machine Learning for the Diagnosis of Orthognathic Surgery. J. Craniofacial Surg. 2019, 30, 1986–1989. [Google Scholar] [CrossRef] [PubMed]
  50. Suhail, Y.; Upadhyay, M.; Chhibber, A.; Kshitiz. Machine Learning for the Diagnosis of Orthodontic Extractions: A Computational Analysis Using Ensemble Learning. Bioengineering 2020, 7, 55. [Google Scholar] [CrossRef]
  51. Etemad, L.; Wu, T.-H.; Heiner, P.; Liu, J.; Lee, S.; Chao, W.-L.; Zaytoun, M.L.; Guez, C.; Lin, F.-C.; Jackson, C.B.; et al. Machine Learning from Clinical Data Sets of a Contemporary Decision for Orthodontic Tooth Extraction. Orthod. Craniofacial Res. 2021, 24 (Suppl. 2), 193–200. [Google Scholar] [CrossRef] [PubMed]
  52. Real, A.D.; Real, O.D.; Sardina, S.; Oyonarte, R. Use of Automated Artificial Intelligence to Predict the Need for Orthodontic Extractions. Korean J. Orthod. 2022, 52, 102–111. [Google Scholar] [CrossRef] [PubMed]
  53. Yu, H.J.; Cho, S.R.; Kim, M.J.; Kim, W.H.; Kim, J.W.; Choi, J. Automated Skeletal Classification with Lateral Cephalometry Based on Artificial Intelligence. J. Dent. Res. 2020, 99, 249–256. [Google Scholar] [CrossRef] [PubMed]
  54. Wang, H.; Minnema, J.; Batenburg, K.J.; Forouzanfar, T.; Hu, F.J.; Wu, G. Multiclass CBCT Image Segmentation for Orthodontics with Deep Learning. J. Dent. Res. 2021, 100, 943–949. [Google Scholar] [CrossRef] [PubMed]
  55. Lu, C.-H.; Ko, E.W.-C.; Liu, L. Improving the Video Imaging Prediction of Postsurgical Facial Profiles with an Artificial Neural Network. J. Dent. Sci. 2009, 4, 118–129. [Google Scholar] [CrossRef] [Green Version]
  56. Lin, H.-H.; Lo, L.-J.; Chiang, W.-C.; Chen, C.-F. IJASEAT an Automatic Assessment of Facial Symmetry before and after Orthognathic Surgery Based on Three-Dimensional Contour Features Using Deep Learning System. Available online: http://iraj.in/journal/IJASEAT/paper_detail.php?paper_id=12033&name=An_Automatic_Assessment_of_Facial_Symmetry_before_and_after_Orthognathic_Surgery_based_on_Three-Dimensional_Contour_Features_using_Deep_Learning_System (accessed on 12 September 2022).
  57. Patcas, R.; Bernini, D.A.J.; Volokitin, A.; Agustsson, E.; Rothe, R.; Timofte, R. Applying Artificial Intelligence to Assess the Impact of Orthognathic Treatment on Facial Attractiveness and Estimated Age. Int. J. Oral Maxillofac. Surg. 2019, 48, 77–83. [Google Scholar] [CrossRef] [Green Version]
  58. Knoops, P.G.M.; Papaioannou, A.; Borghi, A.; Breakey, R.W.F.; Wilson, A.T.; Jeelani, O.; Zafeiriou, S.; Steinbacher, D.; Padwa, B.L.; Dunaway, D.J.; et al. A Machine Learning Framework for Automated Diagnosis and Computer-Assisted Planning in Plastic and Reconstructive Surgery. Sci. Rep. 2019, 9, 13597. [Google Scholar] [CrossRef] [Green Version]
  59. Stehrer, R.; Hingsammer, L.; Staudigl, C.; Hunger, S.; Malek, M.; Jacob, M.; Meier, J. Machine Learning Based Prediction of Perioperative Blood Loss in Orthognathic Surgery. J. Cranio Maxillofac. Surg. 2019, 47, 1676–1681. [Google Scholar] [CrossRef]
  60. Jeong, S.H.; Yun, J.P.; Yeom, H.-G.; Lim, H.J.; Lee, J.; Kim, B.C. Deep Learning Based Discrimination of Soft Tissue Profiles Requiring Orthognathic Surgery by Facial Photographs. Sci. Rep. 2020, 10, 16235. [Google Scholar] [CrossRef]
  61. Lee, K.-S.; Ryu, J.-J.; Jang, H.S.; Lee, D.-Y.; Jung, S.-K. Deep Convolutional Neural Networks Based Analysis of Cephalometric Radiographs for Differential Diagnosis of Orthognathic Surgery Indications. Appl. Sci. 2020, 10, 2124. [Google Scholar] [CrossRef]
  62. Tanikawa, C.; Yamashiro, T. Development of Novel Artificial Intelligence Systems to Predict Facial Morphology after Orthognathic Surgery and Orthodontic Treatment in Japanese Patients. Sci. Rep. 2021, 11, 15853. [Google Scholar] [CrossRef] [PubMed]
  63. Xiao, D.; Deng, H.; Lian, C.; Kuang, T.; Liu, Q.; Ma, L.; Lang, Y.; Chen, X.; Kim, D.; Gateno, J.; et al. Unsupervised Learning of Reference Bony Shapes for Orthognathic Surgical Planning with a Surface Deformation Network. Med. Phys. 2021, 48, 7735–7746. [Google Scholar] [CrossRef] [PubMed]
  64. Lin, G.; Kim, P.-J.; Baek, S.-H.; Kim, H.-G.; Kim, S.-W.; Chung, J.-H. Early Prediction of the Need for Orthognathic Surgery in Patients with Repaired Unilateral Cleft Lip and Palate Using Machine Learning and Longitudinal Lateral Cephalometric Analysis Data. J. Craniofacial Surg. 2021, 32, 616–620. [Google Scholar] [CrossRef] [PubMed]
  65. Lin, H.-H.; Chiang, W.-C.; Yang, C.-T.; Cheng, C.-T.; Zhang, T.; Lo, L.-J. On Construction of Transfer Learning for Facial Symmetry Assessment before and after Orthognathic Surgery. Comput. Methods Programs Biomed. 2021, 200, 105928. [Google Scholar] [CrossRef] [PubMed]
  66. Lo, L.-J.; Yang, C.-T.; Ho, C.-T.; Liao, C.-H.; Lin, H.-H. Automatic Assessment of 3-Dimensional Facial Soft Tissue Symmetry before and after Orthognathic Surgery Using a Machine Learning Model. Ann. Plast. Surg. 2021, 86, S224–S228. [Google Scholar] [CrossRef]
  67. Ter Horst, R.; van Weert, H.; Loonen, T.; Bergé, S.; Vinayahalingam, S.; Baan, F.; Maal, T.; de Jong, G.; Xi, T. Three-Dimensional Virtual Planning in Mandibular Advancement Surgery: Soft Tissue Prediction Based on Deep Learning. J. Cranio Maxillofac. Surg. 2021, 49, 775–782. [Google Scholar] [CrossRef]
  68. Shin, W.; Yeom, H.-G.; Lee, G.H.; Yun, J.P.; Jeong, S.H.; Lee, J.H.; Kim, H.K.; Kim, B.C. Deep Learning Based Prediction of Necessity for Orthognathic Surgery of Skeletal Malocclusion Using Cephalogram in Korean Individuals. BMC Oral Health 2021, 21, 130. [Google Scholar] [CrossRef]
  69. Kim, Y.-H.; Park, J.-B.; Chang, M.-S.; Ryu, J.-J.; Lim, W.H.; Jung, S.-K. Influence of the Depth of the Convolutional Neural Networks on an Artificial Intelligence Model for Diagnosis of Orthognathic Surgery. J. Pers. Med. 2021, 11, 356. [Google Scholar] [CrossRef]
  70. Dot, G.; Schouman, T.; Dubois, G.; Rouch, P.; Gajny, L. Fully Automatic Segmentation of Craniomaxillofacial CT Scans for Computer-Assisted Orthognathic Surgery Planning Using the NnU-Net Framework. Eur. Radiol. 2022, 32, 3639–3648. [Google Scholar] [CrossRef]
  71. Amornvit, P.; Rokaya, D.; Sanohkan, S. Comparison of Accuracy of Current Ten Intraoral Scanners. BioMed Res. Int. 2021, 2021, 2673040. [Google Scholar] [CrossRef]
  72. Amornvit, P.; Sanohkan, S.; Peampring, C. Studying the Optical 3D Accuracy of Intraoral Scans: An in Vitro Study. J. Healthc. Eng. 2020, 2020, 5739312. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  73. Baccetti, T.; Franchi, L.; McNamara, J.A. The Cervical Vertebral Maturation (CVM) Method for the Assessment of Optimal Treatment Timing in Dentofacial Orthopedics. Semin. Orthod. 2005, 11, 119–129. [Google Scholar] [CrossRef]
  74. Hunter, C.J. The Correlation of Facial Growth with Body Height and Skeletal Maturation at Adolescence. Angle Orthod. 1966, 36, 44–54. [Google Scholar] [CrossRef] [PubMed]
  75. McNamara, J.A.; Franchi, L. The Cervical Vertebral Maturation Method: A User’s Guide. Angle Orthod. 2018, 88, 133–143. [Google Scholar] [CrossRef] [Green Version]
  76. Gabriel, D.B.; Southard, K.A.; Qian, F.; Marshall, S.D.; Franciscus, R.G.; Southard, T.E. Cervical Vertebrae Maturation Method: Poor Reproducibility. Am. J. Orthod. Dentofac. Orthop. 2009, 136, 478.e1–478.e7. [Google Scholar] [CrossRef]
  77. Nestman, T.S.; Marshall, S.D.; Qian, F.; Holton, N.; Franciscus, R.G.; Southard, T.E. Cervical Vertebrae Maturation Method Morphologic Criteria: Poor Reproducibility. Am. J. Orthod. Dentofac. Orthop. 2011, 140, 182–188. [Google Scholar] [CrossRef]
  78. Lione, R.; Franchi, L.; Huanca Ghislanzoni, L.T.; Primozic, J.; Buongiorno, M.; Cozza, P. Palatal Surface and Volume in Mouth-Breathing Subjects Evaluated with Three-Dimensional Analysis of Digital Dental Casts—A Controlled Study. Eur. J. Orthod. 2014, 37, 101–104. [Google Scholar] [CrossRef]
  79. Saadeh, M.E.; Haddad, R.V.; Ghafari, J.G. Morphometric Analysis of Palatal Rugae in Different Malocclusions. J. Orofac. Orthop./Fortschr. Der Kieferorthopädie 2020, 82, 111–120. [Google Scholar] [CrossRef]
  80. Parcha, E.; Bitsanis, E.; Halazonetis, D.J. Morphometric Covariation between Palatal Shape and Skeletal Pattern in Children and Adolescents: A Cross-Sectional Study. Eur. J. Orthod. 2016, 34, 377–385. [Google Scholar] [CrossRef] [Green Version]
  81. Heiser, W.; Niederwanger, A.; Bancher, B.; Bittermann, G.; Neunteufel, N.; Kulmer, S. Three-Dimensional Dental Arch and Palatal Form Changes after Extraction and Nonextraction Treatment. Part 1. Arch Length and Area. Am. J. Orthod. Dentofac. Orthop. 2004, 126, 71–81. [Google Scholar] [CrossRef]
  82. Matsuyama, Y.; Motoyoshi, M.; Tsurumachi, N.; Shimizu, N. Effects of Palate Depth, Modified Arm Shape, and Anchor Screw on Rapid Maxillary Expansion: A Finite Element Analysis. Eur. J. Orthod. 2014, 37, 188–193. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  83. Evrard, A.; Tepedino, M.; Cattaneo, P.; Cornelis, M. Which Factors Influence Orthodontists in Their Decision to Extract? A Questionnaire Survey. J. Clin. Exp. Dent. 2019, 15, e432–e438. [Google Scholar] [CrossRef] [PubMed]
  84. Jackson, T.H.; Guez, C.; Lin, F.-C.; Proffit, W.R.; Ko, C.-C. Extraction Frequencies at a University Orthodontic Clinic in the 21st Century: Demographic and Diagnostic Factors Affecting the Likelihood of Extraction. Am. J. Orthod. Dentofac. Orthop. 2017, 151, 456–462. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  85. Alkhayer, A.; Piffkó, J.; Lippold, C.; Segatto, E. Accuracy of Virtual Planning in Orthognathic Surgery: A Systematic Review. Head Face Med. 2020, 16, 34. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Flow chart for screening and selection of articles.
Figure 1. Flow chart for screening and selection of articles.
Applsci 12 11864 g001
Figure 2. Trends in research publications.
Figure 2. Trends in research publications.
Applsci 12 11864 g002
Figure 3. Application of AI in orthodontics.
Figure 3. Application of AI in orthodontics.
Applsci 12 11864 g003
Table 1. Details of the studies that reported in application of AI based models in orthodontics.
Table 1. Details of the studies that reported in application of AI based models in orthodontics.
Serial NoAuthors and ReferenceYear of PublicationType of Algorithm
Architecture
Objective of the StudyNo. of Patients/Images/Photographs for Training TestingStudy FactorModalityComparison If AnyEvaluation Accuracy/Average Accuracy/Statistical SignificanceResults
(+)Effective,
(−)Non Effective
(N) Neutral
Limitations of the StudyAuthors Suggestions/Conclusions
1Nishimoto s et al. [15]2019CNNsAutomatic cephalometric landmark detection153 samples for training, 66 for validatingLandmarksLateral cephalogramSpecialistNot clear (N) neutralCNNs based model predicted cephalometric analysis were not significantly different from those plotted manuallyThis model still in the state of development
2Park JH et al. [16]2019ANNsAutomatic identification of cephalometric landmarks1028 samples for training, 283 for validatingLandmarksLateral cephalogramBenchmarks in the literatureYOLOv3 algorithm outperformed SSD in accuracy(+)EffectiveThe accuracy was inferior to other methods when the size of objects is smallThis model can be of great use for use in clinical practice.
3Chen S et al. [17]2020MLAutomatic landmarks identification60 samplesLandmarksCone-Beam Computed Tomography
(CBCT) images
Not mentioned Not clear (+)Effective Not mentioned Fast and efficient CBCT image segmentation will be analyzed more efficiently
4Kunz F et al. [18]2020CNNsAutomated cephalometric X-ray analysis50 samplesLandmarksCephalometric X-rays12 experienced examinersNo statistically significant differences(+)Effective Not mentioned Results were of the same quality level as
experienced examiners
5Hwang HW et al. [19]2020CNNsAutomated identification of cephalometric landmarks1028 samples for training and 283 samples for testingLandmarksCephalogramsHuman examinersAccuracy similar to human examiners(+)EffectiveWhen the data set was less than 500 the AI model did not identify the landmarks correctlyLarger quantity of datasets will be required in the future.
6Zeng M et al. [20]2020CNNsAutomatic cephalometric landmark detection150 for training dataset and 250 test imagesLandmarksCephalogramsNot mentionedSignificant performance(+)EffectiveThe model needs improvement in the future work.This is a good model for detecting landmarks
7Lee JH et al. [21]2020 BCNNs Locating cephalometric landmarks150 images for training, 250 test imagesLandmarksCephalograms Two expert Examiners Significantly higher performance (+)EffectiveThe model was trained on regional geometrical
features only
Improves the accuracy and reliability of decisions of the specialists
8Bulatova G et al. [22]2021CNNsAutomatic cephalometric landmark identification110 samplesLandmarksCephalograms Senior orthodontic resident No statistical difference between the two(+)EffectiveThe operator is supposed to put a digital ruler which can be subjected to human errors.Can increase efficiency in routine clinical practice
9Hwang HW et al. [23]2021CNNsAutomated cephalometric analysis 1983 for training, 200 for testingLandmarksCephalograms Expert Examiner Superior than Human examiner(+)EffectiveThe performance of the model can be affected with the noise issues inherent in medical imaging.Superior performance than those reported in literature
10Kim J et al. [24]2021CNNsAutomated identification of cephalometric
landmarks
3150 for training, 100 for testing LandmarksCephalogramsTwo orthodontists Significant performance(+)EffectiveOnly hard tissue landmarks for trainingThis model can replace human task
11Kim YH et al. [25]2021CNNsAutomatic cephalometric landmark identification 800 for training, 100 for testingLandmarksCephalogramsTwo Calibrated examinersSignificant performance(+)EffectiveNot mentionedThis model achieved better results than examiners
12Kim MJ et al. [26]2021CNNsAutomatic cephalometric landmark identification860 samplesLandmarksCBCT imagesOne experienced orthodontistSignificant performance(+)EffectiveDid not compare the prediction accuracy of a model trained by a more experienced clinicianThis model showed better consistency than manual identification
13Kim MJ et al. [27]2021CNNsAutomatic cephalometric landmark identification860 samples 80% training, 20% validatingLandmarksCBCT imagesOne experienced orthodontistSignificant performance(+)EffectiveAmount of data required to achieve the expected accuracy could not be explainedThis model showed superior results compared to previous studies
14Yao J et al. [28]2022CNNsAutomatic cephalometric landmark location512 samples training, 200 for testing and validatingLandmarksCephalogramsTwo experienced orthodontistsHigher accuracy(+)EffectiveAmount of data volume was less and need to increased This model meets the requirements of different cephalometric analysis methods.
15Le VNT et al. [29] 2022CNNsHuman–AI collaboration for the identifying cephalometric landmarks1193 samples training, 100 for testingLandmarksCephalogramsTwenty dental studentsAccuracy was higher than dental students(+)EffectiveAmount of dataset was small and obtained for very young patients This beginner–AI collaboration model was effective in detecting the landmarks
16Gil SM et al. [30]2022CNNsAutomated identification of cephalometric
landmarks
2075 samples for training, 343 for validating LandmarksCephalogramsOne experienced examiner Demonstrated an high successful detection rate(+)EffectiveThe comparison was made with one single examinerThis model is an effective
alternative to manual identification
17Dot G et al. [31]2022CNNs Automatic localization ocephalometric landmarks 160 samples for training, 38 for validating Landmarks Computed tomography (CT) scans One experienced operator Excellent agreement with the human examiner (+)Effective This model still requires improvement as the data sets were limited This reliability of the model is par with that of the clinician
18Kök H et al. [32]2019 ANNs Determining
growth and development by cervical vertebrae stages
300 samplesReference pointsCephalometric radiographsOne trained orthodontist and Seven different AI algorithms This model displayed second-highest accuracy (+)EffectiveMore datasets needed for training and evaluation This model can be used as decision support to clinicians
19Kök H et al. [33]2020 ANNs Growth and development periods and gender
from the cervical vertebrae
419 samples
70% for training, 15% testing and,
15% for validating
Reference pointsCephalometric and hand-wrist radiographsResearcher Displayed high accuracy (+)EffectiveMore datasets needed for training and evaluationThe success of this model was satisfactory
20Kök H et al. [34]2020 ANNs Determining growth and development based on
cervical vertebra ratios
360 samplesReference pointsCephalometric radiographs Naïve Bayes models (NBMs)More successful than the reference model(+)EffectiveDatasets belonged to one population, need to study different and multi-racial This model was more successful than the previous models
21Amasya H et al. [35]2020ANNsDetermining cervical vertebral maturation (CVM) analysis647 samplesReference pointsCephalometric radiographsOne examiner Five different ML modelsBest results was achieved by ANN model(+)EffectiveAbsence of hand-wrist
radiographs
This model can be used for prediction of cervical vertebrae morphology
22Amasya H et al. [36]2020ANNsCervical vertebral maturation analysis647 samplesReference pointsCephalometric radiographsThree experienced dentomaxillofacial radiologists and one experienced orthodontistDisplayed better performance(+)EffectiveThe data obtained was from the wide age range (10–30 years)This model performed close to or even better than human observers
23Seo H et al. [37]2021CNNsCervical vertebral maturation analysis600 samplesReference pointsLateral cephalometric radiographsExperienced radiologist, Six deep learning modelsAll models demonstrated excellent accuracy Inception-ResNet-v2 performing the best (+)EffectiveSmall number of data set used This model will help practitioners in making accurate diagnoses and treatment plans
24Zhou J et al. [38]2021CNNsCervical vertebral maturation status1080 samples (980 for training and 100 for testing)Reference pointsCephalometric radiographsTwo experienced examinersThere was a good agreement between AI the
Human examiners
(+)EffectiveSmaller size of data set for testingThis model is a useful and reliable tool for assessing CVM.
25Kim DW et al. [39]2021MLPredicting the hand-wrist maturation stages based on the cervical vertebrae
(CV) images,
499 samplesReference pointsHand-wrist
radiographs and lateral
cephalograms
Three specialistsBetter prediction accuracy(+)EffectiveSmaller size of data set along with more pediatric patientsThis model can aid as a decision supporting tool
26Kim EG et al. [40]2022CNNsEstimating cervical vertebral maturation600 samples Reference pointsLateral cephalograms Four experienced specialists Demonstrated best accuracy(+)EffectiveDatasets were developed using radiographs from single institution This model displayed best accuracy and is of practical applicability
27Mohammad-Rahimi H et al. [41]2022CNNsCervical vertebral maturation (CVM) degree and growth spurts890 samplesReference pointsLateral cephalometric radiographsTwo orthodontistsSubstantial agreement between the experienced examiners and the AI model(+)EffectiveImprovements need to be done in data qualityThis model can provide practical
assistance to practicing dentists
28Li H et al. [42]2022CNNsEstimating cervical vertebral maturation6079 samples (70% for training, 15% testing and,
15% for validating)
Reference pointsCephalometric radiographsTwo experienced orthodontists ResNet152, DenseNet161, GoogLeNet,
VGG16
ResNet152 demonstrated best accuracy(+)EffectiveQuality and quantity of the datasets was severely affected This model can be used as an automatic auxiliary diagnostic tool
29Atici SF et al. [43]2022CNNsClassification of the Cervical Vertebrae Maturation1018 samplesReference pointsCephalometric radiographsExpert Orthodontist, CNN, MobileNetV2, ResNet101, and XceptionThis CNN model provide higher accuracy than the models(+)EffectiveNot mentioned This model can be used as effective tool for analyzing the skeletal maturity stage and timing of the treatment.
30Croquet B et al. [44]2021CNNsAutomated land –marking for palatal shape analysis1045 samples (732 for training, 209 for testing and 104 for validating)LandmarksDental castsSingle operatorThere was no difference between automatic and manual analysis with promising accuracy and
reliability,
(+)EffectiveThe data was of individuals with dentition till second molars may not reflect the true diversity of individuals of interest to orthodontistsThis model can be used for land-marking of digitized dental casts for clinical and research purpose.
31Nauwelaers N et al. [45]2021CNNsPalatal and dental shape estimation1324 samplesLandmarks3D Dental castsDifferent modelsSingular auto-encoder achieved competitive performance in
terms of accuracy, generalization, specificity, and variance
(+)EffectiveThe model was limited
to shapes that underwent an elaborate pre-processing
This model can a useful tool for shape analysis in the future
32Xie X et al. [46]2010ANNsDetermining the need for orthodontic tooth extraction 200 samples (180 for training, 20 for testing)IndicesCasts and cephalometrics Humans80% accuracy in determining the need for extraction(+)EffectiveLimited amount of samples This model can be considered a decision-making tool
33Jung SK et al. [47]2016ANNsDiagnosis of orthodontic tooth extractions156 samples (96 for training, 60 for testing)IndicesCasts and cephalometricsExperienced orthodontistHigh performance Excellent success rates(+)EffectiveDiagnosis of extractions was confined to nonsurgical proceduresCan be used as an new approach in orthodontics
34Li P et al. [48]2019ANNsDetermining the need of orthodontic tooth extraction302 samplesFeature variablesCasts and cephalometricsTwo experienced orthodontistsExcellent performance with 94.0% accuracy(+)EffectiveLimited amount of samplesThis model can provide a good guidance for less experienced orthodontists.
35Choi HI et al. [49]2019MLDetermining the need of orthodontic tooth extraction316 samplesDatasets Casts and cephalometricsOne experienced orthodontistHigh performance with 91% accuracy(+)EffectiveExclusion of skeletal asymmetry casesCan be applied for the diagnosis of cases
36Suhail Y et al. [50]2020MLDiagnosis of orthodontic tooth extraction287 samplesDatasetsCasts and cephalometricsFive experienced orthodontistIn agreement with the experienced orthodontists(+)EffectiveLimited feature set where the treatment outcomes were confined to only non-surgical orthodontic proceduresCan be considered a decision-making tool in clinical practice
37Etemad L et al. [51]2021MLDecision on orthodontic tooth extraction838 samplesDatasetsCasts and cephalometricsPrevious modelsPerformance was lesser than the previous models(+)EffectiveNot mentionedThis model lacks generalizability and in order to improve it needs advanced artificial
intelligence algorithms
38Real AD et al. [52]2022MLDetermining the need of orthodontic tooth extraction214 samplesDatasetsCasts and cephalometricsTwo experienced orthodontistsDemonstrated an accuracy of 93.9%(+)EffectiveDegree of over fitting that may have occurred in the modelsThis model achieved best performance when model and cephalometric
data are combined
39Yu HJ et al. [53]2020CNNsAutomated Skeletal Classification5890 samples (70% for training, 15% testing and,
15% for validating)
DatasetsClinical data and cephalometricsFive experienced orthodontistsDemonstrated an highest accuracy at 96.40%(+)EffectiveThe data were collected from a single organizationThis model has a potential for skeletal orthodontic diagnosis
40Wang H et al. [54]2021CNNsAutomated multiclass segmentation of the jaw and teeth30 samplesLandmarksCBCT scans4 experienced dentistsAccurate in its performance(+)EffectiveData of complicated dental status need to be consideredThis model can reduce the amount of time and effort spent in clinical settings and increase the efficiency and performance of dentists
41C.H Lu et al. [55]2009ANNs Image prediction post orthognathic surgery (OGS) 30 samplesLandmarksLateral Cephalogram
Facial images
Profile post- surgery profileVery less prediction errors (+)Effective Not mentioned Can be applied for predicting post-surgical facial profile
42H. H Lin et al. [56]2018CNNs Assessing facial asymmetry in patients undergone OGS 100 samplesLandmarks3D facial imagesSpecialistPredications were statistically significant p < 0.05(+)EffectiveSmall sample size was used for developing the modelHuman like efficient tool for decision making
43R. Patcas et al. [57]2019CNNs Assessing post OGS facial attractiveness 146 samples
Landmarks Facial photographs Profile post- surgery profileWas in comparison with the actual improvement(+)EffectiveDissimilarities between the subjective patient’s view and the computed score could existIs an efficient tool for assessing facial attractiveness
44P. G. M. Knoops et al. [58]2019CNNsDiagnosing of OGS4261 samplesLandmarksData sets
3D face scans
Not mentioned95.5% sensitivity, 95.2% specificity,(+)EffectiveLarger data sets needed for training the modelsAn efficient tool for diagnosing OGS
45R.Stehrer et al. [59]2019CNNsPredicting perioperative blood loss950 subjectsComparing with actual blood lossData setsData on actual blood lossStatistical significance (p< 0.001).(+)EffectiveData for the model was developed from records from one single clinicAn efficient tool for estimating perioperative blood loss
46S.H.Jeong et al. [60]2020CNNsPredicting soft tissue profiles that require OGS822 samplesLandmarksFacial photographs
2 orthodontist, 3 maxillofacial surgeons,
1 maxillofacial radiologist.
An Accuracy of 0.893(+)EffectiveCertain level of false positives and false negatives cases were revealed by the modelAn efficient tool predicting soft tissue profiles
47K.S. Lee et al. [61]2020DCNNsDifferential diagnosis of OGS220 samplesLandmarks Lateral Cephalogram Four different modelsModified-Alexnet displayed an
Accuracy of 0.919
(+)EffectiveComparison was done with a limited dataModified-Alexnet displayed the highest level performance
48C.Tanikawa et al. [62]2020ANNsPredicting facial morphology post OGS137 samplesLandmarksLateral
cephalogram and 3-D facial images
2 AI modelsExcellent success rates(+)EffectiveThe model was developed and tested with data from only two clinics.
An efficient tool predicting post OGS facial morphology
49D. Xiao et al. [63]2021CNNsFor planning of OGS47 samplesLandmarksCT Scans
Clinical data sets
Sparse representation methodSignificant (p <0.05).(+)EffectiveThe model trained on simulated pairs of deformed-normal bones and the number was limitedThis model outperformed an existing sparse representation method
50G. Lin et al. [64]2021CNNsAssessing the need for OGS in Unilateral Cleft Lip and Palate patients56 samplesLandmarks Lateral Cephalogram Boruta methodAn excellent accuracy of 87.4%.(+)EffectiveThe data used was limited and was from a single centerThis model is capable of predicting the need for surgery
51H.H.Lin et al. [65]2021CNNsAssessing pre and post OGS facial symmetry71 samplesLandmarksCBCT images4 orthodontists and 4 plastic surgeons and also with previously reported modelsAccuracy of 90%.(+)EffectiveThis model was trained with a limited data setsThis model exhibited high performance.
52L.J. Lo et al. [66]2021CNNsAssessing facial soft tissue symmetry before and after OGS158 samplesLandmarks3-D facial photographsPre and post- operativeStatistically Significant(+)Effective Dissimilarities might exist between the patient’s subjective view and the machine scoring The model can aid clinicians in assessing facial symmetry
53R.Horst et al. [67]2021CNNsPredicting the virtual soft tissue profile post-surgery133 samples (119 for training, 14 for testing)Landmarks3D photographs and CBCT imagesMass Tensor Model (MTM)Statistically significant (p = 0.02)(+)EffectiveIn asymmetric cases
and extreme cranial or caudal displacements, the model under predicted these displacements
This model can accurately predict the soft tissue profile post-surgery
54W.S.Shin et al. [68]2021CNNsPredicting the need for OGS413 samplesLandmarks Cephalogram 2 orthodontists,
3 maxillofacial surgeons, 1 maxillofacial
Radiologist.
An excellent accuracy of 0.954(+)EffectiveThis model involved only Korean patients from only one hospital
Displayed higher accuracy in predicting the need for OGS
55Y.H Kim et al. [69]2021CNNsDiagnosing orthodontic surgery960 samples (810 for training, 150 for testing)Landmarks Cephalogram ResNet-18, 34, 50, and 101Success rate was displayed by ResNet-18 = 93.80%,
ResNet-34 = 93.60%
(+)EffectiveThe data used was from a single centerThis model can diagnose whether to conduct orthognathic
surgery
56G. Dot et. al. [70]2022CNNsMulti-task segmentation of cranio-maxillofacial structures for OGS453 samples (300 for training, 153 for testing)LandmarksCT Scans2 OperatorsExcellent performance(+)EffectiveCannot assess the reliability of the results as the data was from one single centerThis model need to be trained from other databases for better reliability
Footnotes: ML = Machine Learning, ANNs = Artificial Neural Networks, CNNs = Convolutional Neural Networks, DCNNs = Deep Neural Networks, Bayesian Convolutional Neural Networks (BCNN), CT- scans-Computed Tomography, CBCT- Cone-Beam Computed Tomography, OCT-Optical Coherence Tomography.
Table 2. Summary of AI models designed for different diagnostic tasks.
Table 2. Summary of AI models designed for different diagnostic tasks.
AI Technique/Algorithm
Architecture
Diagnostic Tasks Functionality of the AI Model Input Features
Machine Learning (ML)Automated identification of landmarksLandmarksCone-Beam Computed Tomography
(CBCT) images [17]
Predicting the hand-wrist maturation stages based on the cervical vertebrae (CV) imagesReference pointsHand-wrist radiographs and lateral
cephalograms [39]
Determining the need of orthodontic tooth extractionDatasetsCasts and cephalometrics [49,50,51,52]
Artificial Neural Network (ANNs)Automated identification of landmarksLandmarks, Reference pointsLateral cephalogram [16], Cephalograms [18,35]
Cervical vertebral maturation analysisReference pointsCephalometric radiographs [36]
Determining growth and development by cervical vertebrae stages IndicesCephalometric radiographs [32], Cephalometric and hand-wrist radiographs [33,34]
Determining the need for orthodontic tooth extractionIndicesCasts and cephalometrics [46,47,48]
Predicting facial morphology post OGSLandmarksLateral cephalogram and 3-D facial images [62]
Deep Learning/Convolutional Neural Networks (CNNs)Automated identification of landmarksLandmarksCone-Beam Computed Tomography
(CBCT) images [15,18,26,27,31], Cephalograms [19,20,21,22,23,24,25,28,29,30]
Cervical vertebral maturation analysisReference pointsLateral cephalometric radiographs [37,38,40], Cephalometric radiographs [42]
Cervical vertebral maturation (CVM) degree and growth spurtsReference pointsLateral cephalometric radiographs [41]
Classification of the Cervical Vertebrae MaturationReference pointsCephalometric radiographs [43]
Automated land –marking for palatal shape analysisLandmarksDental casts [44,45]
Automated Skeletal ClassificationDatasetsClinical data and cephalometrics [53]
Automated multiclass segmentation of the jaw and teethLandmarksCBCT scans [54,70]
Image prediction post orthognathic surgery (OGS) LandmarksLateral Cephalogram
Facial images [55]
Assessing facial asymmetry in patients undergone OGS Landmarks3D facial images [56]
Assessing post OGS facial attractiveness LandmarksFacial photographs [57]
Diagnosing of OGS LandmarksData sets 3D face scans [58], Lateral Cephalogram [61,68,69], CT Scans and Clinical data sets [63]
Predicting perioperative blood lossData setsData on actual blood loss [59]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Albalawi, F.; Alamoud, K.A. Trends and Application of Artificial Intelligence Technology in Orthodontic Diagnosis and Treatment Planning—A Review. Appl. Sci. 2022, 12, 11864. https://doi.org/10.3390/app122211864

AMA Style

Albalawi F, Alamoud KA. Trends and Application of Artificial Intelligence Technology in Orthodontic Diagnosis and Treatment Planning—A Review. Applied Sciences. 2022; 12(22):11864. https://doi.org/10.3390/app122211864

Chicago/Turabian Style

Albalawi, Farraj, and Khalid A. Alamoud. 2022. "Trends and Application of Artificial Intelligence Technology in Orthodontic Diagnosis and Treatment Planning—A Review" Applied Sciences 12, no. 22: 11864. https://doi.org/10.3390/app122211864

APA Style

Albalawi, F., & Alamoud, K. A. (2022). Trends and Application of Artificial Intelligence Technology in Orthodontic Diagnosis and Treatment Planning—A Review. Applied Sciences, 12(22), 11864. https://doi.org/10.3390/app122211864

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop