Next Article in Journal
Early Myocardial Changes in Patients with Rheumatoid Arthritis without Known Cardiovascular Diseases—A Comprehensive Cardiac Magnetic Resonance Study
Next Article in Special Issue
Root Resorptions on Adjacent Teeth Associated with Impacted Maxillary Canines
Previous Article in Journal
Estimating Glomerular Filtration Rate from Serum Myo-Inositol, Valine, Creatinine and Cystatin C
Previous Article in Special Issue
Real-Time Monitoring and Quantitative Evaluation of Resin In-Filtrant Repairing Enamel White Spot Lesions Based on Optical Coherence Tomography
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Diagnostics
Volume 11
Issue 12
10.3390/diagnostics11122292
diagnostics-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Reliability of Two- and Three-Dimensional Cephalometric Measurements: A CBCT Study

by
Chenshuang Li
1,*,†,
Hellen Teixeira
1,†,
Nipul Tanna
1,
Zhong Zheng
2,3,
Stephanie Hsiang Yi Chen
1,
Min Zou
4,5,6 and
Chun-Hsi Chung
1,*
1
Department of Orthodontics, School of Dental Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA
2
David Geffen School of Medicine, University of California, Los Angeles, CA 90095, USA
3
School of Dentistry, University of California, Los Angeles, CA 90095, USA
4
Key Laboratory of Shannxi Province for Craniofacial Precision Medicine Research, College of Stomatology, Xi’an Jiaotong University, 98 XiWu Road, Xi’an 710004, China
5
Clinical Research Center of Shannxi Province for Dental and Maxillofacial Diseases, College of Stomatology, Xi’an Jiaotong University, 98 XiWu Road, Xi’an 710004, China
6
Department of Orthodontics, College of Stomatology, Xi’an Jiaotong University, 98 XiWu Road, Xi’an 710004, China
*
Authors to whom correspondence should be addressed.
†
These two authors contributed equally.
Diagnostics 2021, 11(12), 2292; https://doi.org/10.3390/diagnostics11122292
Submission received: 18 October 2021 / Revised: 21 November 2021 / Accepted: 3 December 2021 / Published: 7 December 2021
(This article belongs to the Special Issue Advanced Diagnostic Imaging in Dentistry)
Browse Figures
Versions Notes

Abstract

:
Cephalometry is a standard diagnostic tool in orthodontic and orthognathic surgery fields. However, built-in magnification from the cephalometric machine produces double images from left- and right-side craniofacial structures on the film, which poses difficulty for accurate cephalometric tracing and measurements. The cone-beam computed tomography (CBCT) images not only allow three-dimensional (3D) analysis, but also enable the extraction of two-dimensional (2D) images without magnification. To evaluate the most reliable cephalometric analysis method, we extracted 2D lateral cephalometric images with and without magnification from twenty full-cranium CBCT datasets; images were extracted with magnification to mimic traditional lateral cephalograms. Cephalometric tracings were performed on the two types of extracted 2D lateral cephalograms and on the reconstructed 3D full cranium images by two examiners. The intra- and inter-examiner intraclass correlation coefficients (ICC) were compared between linear and angular parameters, as well as between CBCT datasets of adults and children. Our results showed that overall, tracing on 2D cephalometric images without magnification increased intra- and inter-examiner reliability, while 3D tracing reduced inter-examiner reliability. Angular parameters and children’s images had the lowest inter- and intra-examiner ICCs compared with adult samples and linear parameters. In summary, using lateral cephalograms extracted from CBCT without magnification for tracing/analysis increased reliability. Special attention is needed when analyzing young patients’ images and measuring angular parameters.

1. Introduction

Dr. Broadbent first established reproducible head positioning of the cephalostat in 1930 [1], which set a precedent for using lateral cephalometric radiographs in orthodontics. When Dr. Brodie used cephalometric X-rays to investigate craniofacial growth factors affecting orthodontic treatment in 1941 [2], and Dr. Margolis evaluated the relationship between incisor inclinations and various craniofacial factors in 1943 [3], cephalometric analysis started to evolve. In 1948, Dr. Downs developed the first cephalometric analysis method [4]. Since then, multiple methods have been established, and lateral cephalometric X-rays have been used as the standardized, reproducible tool for orthodontic diagnosis and treatment planning [5].
Initially, lateral cephalograms were developed on film, and analyses were performed manually using acetate tracing paper over a lighted view box. Despite having served the medical community well for many years, this conventional screen-film radiology technique required stringent exposure factors to produce a diagnostic-quality radiograph. Slight underexposure or overexposure could yield an unacceptable image, which significantly increased tracing difficulty [6]. Another drawback of conventional film was that errors during exposure could not be remedied. For example, improper head orientation would cause distortion of craniofacial structures, which negatively affected clinical diagnosis [7]. Retaking radiographs due to errors led to an increase in radiation exposure to the technician and patient, increased cost of the examination, and required additional technician and clinician time [8]. In addition, the procedure required to develop film delayed clinical diagnosis and increased cost [9]. Notably, due to the divergent pattern of the x-ray beam and the distance between the subject and image-receptor in the cephalometric machine system [10], built-in magnification enlarged the left and right craniofacial structures at different ratios. Thus, even with proper exposure and head positioning, double images were present on the film, which made accurate cephalometric tracing difficult and led to tracing errors among orthodontic residents and clinicians [11]. More importantly, the magnification of X-rays was not consistent across different machines [12], which limited the ability to compare study results among different research groups.
The introduction of digitalized radiographs not only eliminates the time-consuming steps of film development, but also allows image contrast adjustment, which mitigates exposure problems and reduces the likelihood of repeated exposure [13]. More importantly, digitalized radiographs enable digital cephalometric analysis, which make tracing and diagnosis faster and easier, without reducing accuracy [14,15,16]. However, digitalized radiograph systems do not solve the problems caused by improper head orientation, or the magnification inherent to 2D imaging. Furthermore, magnification ratios among different digital cephalometric machines remain inconsistent [17,18], which leaves comparison among studies conducted with different machines not completely reliable.
Over the past decade, cone-beam computed tomography (CBCT) systems have been broadly adapted in orthodontic and orthognathic surgery fields, which allow three-dimensional analysis without magnification and distortion [5]. With radiation exposure and cost significantly reduced since the initial introduction of CBCT, 3D imaging has become more widely used to replace several 2D X-rays images for diagnosis and progress evaluation [19]. Although the radiation doses from dental CBCT exams are generally lower than other CT exams, dental CBCT exams typically deliver more radiation than conventional dental X-ray exams [20]. Concerns about radiation exposure are greater for younger patients because they are more sensitive to radiation, and they have a longer lifetime for ill-effects to develop. This consideration is important in the orthodontic field, as the majority of orthodontic patients are children and teenagers, and multiple routine radiation exposures are planned during orthodontic treatment to evaluate growth and development as well as treatment progress [21]. A recent study estimated the cancer risk from CBCT in orthodontic patients, and reported that the risk of exposure-induced death values in the 10-year-old subjects were approximately double those in the 30-year-old subjects for all cancers, especially in breast cancer of females [22]. Thus, radiation protection protocols should be rigorously followed when prescribing radiological images to patients.
Since 2D cephalometric tracing and superimposition are still the standard methods for orthodontic and orthopedic treatment evaluation [23], great efforts have been dedicated to comparing 2D and 3D cephalometric analysis globally [19,24,25,26]. As several 2D cephalometric analysis landmarks are artificial structures defined from overlapped sagittal plane images, the same landmarks are harder to identify in 3D reconstructed images [19,27]. Thus, some clinicians and researchers suggest establishing new landmarks on CBCTs, and setting up a new 3D cephalometric tracing and analysis system [19]. There is no doubt that 3D cephalometric tracing and analysis can provide more information for comprehensive clinical evaluation and diagnosis, but an inevitable challenge will be comparing the results of new studies with the well-validated and accepted knowledge in the orthodontic field.
CBCT not only allows for 3D evaluation of craniofacial structures, but also enables the generation of 2D images with or without magnification. Although great efforts have gone into the comparison of conventional 2D and 3D tracings, no evaluation has been done using 2D lateral cephalometric images extracted from CBCTs without magnification. Additionally, whether patients’ maturation stages affect tracing reliability has not been assessed. Thus, in the current study, we compared the intra- and inter-examiner reliability of 2D cephalometric analysis conducted with CBCT extracted lateral cephalometric images with magnification, which mimic traditional lateral cephalograms taken with proper head position; 2D cephalometric analysis conducted with CBCT extracted lateral cephalometric images without magnification; and 3D cephalometric analysis conducted with CBCT reconstructed images. The intra- and inter-examiner correlations were calculated and compared between linear and angular parameters, as well as between adults’ and children’s CBCT datasets. Overall, the current study aims to provide more information about the factors influencing tracing reliability, which could potentially improve clinical data analysis and comparison.

2. Materials and Methods

CBCT scans for this study were derived from a pre-existing clinical database of pre-orthodontic treatment records, and the study protocol was approved by the institution review board (protocol #848424). No additional radiographic images were taken for study purposes. Images were taken with a voxel size of 0.400 × 0.400 × 0.400 mm3. CBCTs from 20 patients without craniofacial syndromes or large facial asymmetry were included. Among these 20 patients, 10 were adults with permanent dentition (five females [mean age 22.4 years, range 19.3 years–25.3 years], five males [mean age 22.4 years, range 19.6 years–25.7 years]), and 10 were children with early mixed dentition (five females [mean age 8.8 years, range 8.2 years–9.2 years], five males [mean age 8.7 years, range 8.1 years–9.2 years]) (Figure 1).
All CBCT DICOM files were imported into Dolphin 3D software (Dolphin Imaging; version 11.95 Premium, Chatsworth, CA, USA) and oriented using the Frankfort plane as the horizontal plane (Figure 2A). The orientation was adjusted axially, so that lateral borders of the orbits from a lateral view overlapped each other (Figure 2A), and coronally so that inferior borders of both orbits sat on the same plane from a frontal view (Figure 2B). Utilizing the “Build X-Rays Tool” in Dolphin 3D, lateral cephalometric X-Rays were created using both sides of the volume. Under the “X-ray Building preferences” option, “Perspective” was selected to create an X-Ray with the measured distortion and warping effects of a traditional X-Ray (Figure 2C,E), and “Orthogonal” was selected to create a non-distorted X-Ray (Figure 2D,F). According to “Dolphin Imaging User’s Guide (Version 11.95)”, the settings for “Perspective” were set as follows to match with the Bolton-Broadbent dimensions:
  • Fictitious Magnification Factor: 9.7%;
  • Emitter to Patient’s Mid Plane (Distance in millimeters from the emitter to the patient’s mid-plane to use when generating X-rays using perspective projection): 1550 mm;
  • Mid-Plane to Film (Distance in millimeters from patient’s mid-plane to the film to use when generating X-Rays using perspective projection): 150 mm.
The generated 2D lateral cephalometric X-Rays were traced in the “Digitize” function module in Dolphin Imaging (Figure 2G,H). At the same time, tracings of 3D reconstructed images were performed by using the “Digitize/Measurement” function in Dolphin 3D (Figure 2I). Ricketts (comprehensive) [28], Steiner + Wits [29,30], Sassouni+ [31], and McNamara [32] cephalometric analysis systems were used. After removing repeated parameters, 63 (28 linear, 35 angular) parameters were used for further analysis.
Image extraction and tracing were performed by two examiners, both American Board of Orthodontics certified clinicians and full-time educators in an academic institution. Calibration between the two examiners was performed twice before formal analysis. The two examiners performed cephalometric analysis separately, and each image was analyzed twice by each examiner at least one month apart.
The values from two sets of cephalometric analyses were used to calculate the intra-examiner intraclass correlation coefficient (ICC), and the average value of two sets of cephalometric analyses from each examiner was used to calculate the inter-examiner ICC. The intra- and inter-examiner ICCs of each parameter were calculated utilizing the IBM SPSS software (Statistical Package for Social Sciences version 26.0, Chicago, IL, USA), and compared between linear and angular parameters, as well as between adults’ and children’s CBCT datasets. A Shapiro-Wilk normality test was performed by OriginPro 8 (Origin Lab Corp., Northampton, MA, USA). A two-tailed t-test was used for statistical analysis of the patients’ age comparison. Since some of the ICC data did not pass the normal distribution test, all ICC data were presented with a violin plot. A Wilcoxon matched-pairs signed-rank test was used for statistical analysis of the overall comparison of intra- and inter-examiner ICCs, and the comparison within each type of parameter. A Mann-Whitney U test was used for statistical analysis for the comparison between the two types (linear and angular) of parameters. For all data presented in this manuscript, p < 0.05 (*) was considered a suggestive difference, while p < 0.005 (**) was recognized as a statistically significant difference based on a recent recommendation [33].

3. Results

3.1. Comparisons of the Intra- and Inter-Examiner Reliability among the Tracings of Different Images

We first compared the intra- and inter-examiner ICCs for all measurement parameters with 20 samples together. The intra-examiner ICCs for each parameter are listed in Table 1, and the inter-examiner ICCs are listed in Table 2.
For examiner 1 (Figure 3A), the median of the ICCs in the 2D tracings of extracted lateral cephalometric images with magnification was 0.968. Removing magnification could statistically significantly increase the median of the ICCs to 0.978 (p < 0.001). When evaluating the 3D tracings of examiner 1, the median of the ICCs was 0.971, which was statistically significantly higher than that of 2D tracings with magnification (p = 0.002), but not different to that of 2D tracings without magnification.
For examiner 2 (Figure 3A), the median of the ICCs in the 2D tracings with magnification was 0.872, and the median of the ICCs in the 2D tracings without magnification was 0.854. No statistical significance was detected when comparing the intra-examiner ICC of examiner 2 for the two types of 2D tracings. For the 3D tracings of examiner 2, the median of the ICCs was 0.850. There is no statistical significance between the intra-examiner ICC of examiner 2 in the 2D tracings without magnification and 3D tracing, but the 3D tracing had suggestively significantly lower intra-examiner ICC than the 2D tracings with magnification (p = 0.0461).
We then evaluated the inter-examiner reliability for each type of cephalometric analysis method (Figure 3B). In the 2D tracings with magnification, the median of the ICCs was 0.824. In the 2D tracings without magnification, the median of the inter-examiner ICCs was 0.903. In the 3D tracings, the median of the inter-examiner ICCs was 0.780. Comparison among the three types of cephalometric analysis methods showed that 2D tracings without magnification had the highest inter-examiner reliability (p < 0.0001), in the range of excellent [34]. Both 2D tracings with magnification and 3D tracings had good inter-examiner ICCs [34], while 2D tracings with magnification suggested a higher inter-examiner ICC than that of 3D tracings (p = 0.0066).

3.2. Comparison between Linear and Angular Parameters

Previous studies showed that different cephalometric tracing methods may affect the measured results of linear and angular parameters differently [18,35,36]. Thus, in the current study, we compared the intra- and inter-examiner reliabilities of linear and angular parameters for all three types of tracing methods.
For examiner 1 (Figure 4A), the intra-examiner ICC of linear parameters was suggestively higher than that of angular parameters (p = 0.0052) in the 2D tracings of extracted lateral cephalometric images with magnification. Tracing on 2D images without magnification could improve the intra-examiner ICCs for both linear (p = 0.0210) and angular parameters (p = 0.0017), while linear parameters still had higher intra-examiner ICCs than angular parameters (p = 0.0146). 3D tracings did not alter the intra-examiner ICCs of the linear parameters when compared with the two types of 2D tracings, but significantly increased the intra-examiner ICCs of the angular parameters when compared with the 2D tracings with magnification (p = 0.0029). However, there was no statistical significance when comparing angular and linear parameters in 3D tracings.
For examiner 2 (Figure 4B), there was no statistical significance between linear and angular parameters. Changing tracing methods did not alter the intra-examiner ICCs for both linear and angular parameters.
Moving to the inter-examiner reliability (Figure 4C), in the 2D tracings with magnification, there was no statistical significance when comparing the inter-examiner ICC of linear and angular parameters. In the 2D tracings without magnification, linear parameters had suggestively higher inter-examiner ICCs than angular parameters (p = 0.0240). 2D tracings without magnification had statistically significantly higher inter-examiner ICCs for both linear and angular parameters than 2D tracings with magnification (p < 0.0001). 3D tracings influenced the inter-examiner reliability differently: it decreased the inter-examiner ICC of the linear parameters (p = 0.0017), while it did not affect that of the angular parameters when compared to 2D tracings with magnification. 3D tracings had statistically significantly lower inter-examiner ICCs for both linear and angular ICCs than 2D tracings without magnification (p < 0.0001).

3.3. Comparison between the Images from Adult Patients and the Images from Children Patients

In the current study, we included 10 young patients in early mixed dentition to represent the patient population seeking early orthodontic intervention, and 10 adult patients in permanent dentition to represent patients needing comprehensive orthodontic treatment. The intra-examiner ICCs for each parameter in different age groups were listed in Supplemental Tables S1 and S2, and the inter-examiner ICCs were listed in Supplemental Table S3. For examiner 1 (Figure 5A), in the 2D tracings of extracted lateral cephalometric images with magnification, the intra-examiner ICC for images from adult patients was higher than that from children patients (p = 0.0059). Tracing 2D images without magnification could improve the intra-examiner ICCs for both adults (p = 0.0247) and children (p = 0.0002), while tracings from adult patients still had higher intra-examiner ICCs than that of children (p = 0.0015). 3D tracings could further improve the intra-examiner ICCs of the tracings of images from children, but not for that of adults. There was no statistical significance when comparing the intra-examiner ICCs of 3D tracings with images from adult and children patients.
For examiner 2 (Figure 5B), there was no statistical significance when comparing the intra-examiner ICCs of 2D tracings with images from adult and children patients. Interestingly, 3D tracings could increase the intra-examiner ICCs of images from adult patients, but decreased the intra-examiner ICCs of images from children patients.
When looking at the inter-examiner reliability (Figure 5C), there was no statistical significance when comparing the inter-examiner ICCs of 2D tracings with images from adult and children patients. In both age groups, 2D tracings without magnification had higher ICCs than 2D tracings with magnification. 3D tracings had higher ICC than 2D tracings with magnification in the adult group (p = 0.0035), but lower ICC than 2D tracings with magnification in the children group (p = 0.0348).

3.4. Combined Influent Effects of Parameter Types and Patients’ Age on Tracing Reliabilities

Since both parameter types and patients’ age affected the reliability of cephalometric analysis as mentioned above, we performed a more detailed comparison with the consideration of both factors in each type of tracing method.
For examiner 1 (Figure 6A), in the 2D tracings of extracted lateral cephalometric images with magnification, there was no statistical significance between linear and angular parameters of images from adult patients. However, statistical significance was detected between linear and angular parameters of images from children patients (p = 0.0024). In addition, angular parameters of images from children patients had significantly lower intra-examiner ICCs than those from adult patients (p = 0.0383). Thus, angular parameters of images from children patients had the lowest intra-examiner ICCs in the 2D tracings with magnification. The same trends can also be observed in the 2D tracings without magnification. In the 3D tracings, no statistical significance was detected among groups. When comparing among different types of tracings for examiner 1, angular parameters of images from children in 2D tracings with magnification had the lowest intra-examiner ICCs.
Similarly, for examiner 2 (Figure 6B), in the 2D tracings with magnification, there was no statistical significance between linear and angular parameters of images from adult patients, and statistical significance was detected between linear and angular parameters of images from children patients (p = 0.0118). In the 2D tracings without magnification, examiner 2 also had the lowest intra-examiner ICC with angular parameters of images from children patients. In the 3D tracings, both linear and angular parameters of images from children patients had lower intra-examiner ICCs than did images from adult patients.
For inter-examiner reliabilities (Figure 7), linear parameters for the images from children patients had suggestively higher inter-examiner ICC than did the images from adult patients (p = 0.0445), while no statistical significance was detected for other comparisons in the 2D tracings with magnification. 2D tracings without magnification had higher inter-examiner ICCs than 2D tracings with magnification in linear parameters of images from both adults and children, and in angular parameters of images from adult patients, but not in angular parameters of images from children patients. In fact, angular parameters of images from children patients had the lowest inter-examiner ICCs when compared to other groups in the 2D tracings without magnification. 3D tracing could only increase the inter-examiner ICCs of linear parameters of images from adult patients, and the ICCs were significantly higher than in linear parameters of images from children patients and in angular parameters of images from both age groups in 3D tracings.

4. Discussion

In this study, we compared three types of digital tracings and evaluated the influence of parameter types and patients’ age on the intra- and inter-examiner reliabilities.
When comparing the intra-examiner ICCs for each type of cephalometric analysis between the two examiners, examiner 1 had statistically significantly higher ICCs than examiner 2 (p < 0.0001, Figure 3A), which may be because examiner 1 has more imaging analysis experience. However, both examiners had ICC medians for all three types of cephalometric analysis methods higher than 0.75, indicating that all methods had good (between 0.75 and 0.9) to excellent (greater than 0.9) intra-examiner reliability [34]. The ICCs are similar to or higher than those reported in previous publications by other groups [37,38,39,40], demonstrating consistency and accuracy of the present study.
As expected, reducing double images on lateral cephalometric X-rays by eliminating magnification and distortion significantly improved the inter-examiner reliability from good (0.8240) to excellent (0.9030) (Figure 3B). Interestingly, 3D tracing had the lowest inter-examiner ICC among all three types of tracing methods, even though the median ICC was still in the range of good (0.7800) (Figure 3B). Both examiners experienced difficulty identifying certain landmarks during 3D tracings, such as orbitale, porion, DC point, and PT point. These landmarks are formed by overlapping craniofacial structures from different sagittal layers in 2D images. In addition, both examiners had low confidence identifying incisor root tips during 3D tracings. These difficulties are consistent with those encountered in previous studies where the authors compared landmark identification errors on cone-beam computed tomography and conventional digital cephalograms. They found that gonion, condylion, and porion were located on flat or curved surfaces and thus difficult to precisely reference/define on CBCT images [27]. Additionally, certain locations with lower densities, such as the mandibular incisor apex, will have high measurement errors because they could not be visualized with 3D reconstruction [27]. The current study further supports the idea that traditional 2D landmarks do not completely map to 3D tracings, and new landmarks need to be identified in three axial planes to establish a more reliable 3D tracing system [19,41].
When looking at each parameter in detail, cranial deflection angle consistently had low intra- and inter-examiner ICCs in 2D tracings. Thus, the current study suggests that caution is needed while interpreting this measurement clinically.
Both linear and angular parameters have been evaluated by comparing 2D and 3D tracings, with more focus on angular parameters. However, the conclusion on whether angular parameters have similar ICCs in 2D and 3D tracing is controversial [37,42,43]. In the current study, no dramatic difference was found in the intra- or inter- examiner ICCs between linear and angular parameters. Using 2D tracings of extracted lateral cephalometric images without magnification could improve the intra- and inter-examiner ICCs for both linear and angular parameters when compared to 2D tracings with magnification. 3D tracings had low inter-examiner ICCs for linear and angular parameters relative to 2D tracings, but there was no difference between linear and angular parameters within 3D tracings (Figure 4). Thus, linear parameters are more reliable than angular parameters in 2D tracings.
Unerupted permanent teeth overlap with maxillary and mandibular alveolar bone, which increases difficulty when tracing lateral cephalometric X-rays of children with mixed dentition. The low bone density of the children compared to adults may also add difficulty to landmark identification during the cephalometric analysis of young patients. Thus, in the current study, we evaluated whether there is any difference in the intra- and inter-examiner reliabilities of cephalometric analysis on X-rays from patients of different ages and dentition types. To the best of our knowledge, this is the first study making this comparison. For intra-examiner reliability, a small but statistically significant difference was found between the adult (ICC median 0.9690) and children groups (ICC median 0.9400) in the 2D tracings with magnification in one examiner (Figure 5A). Removing the magnification and distortion from the 2D X-rays could improve both intra- and inter-examiner reliability of the cephalometric analysis (Figure 5), but the adult group still had higher intra-examiner ICC than the children group with the same examiner (Figure 5A). For the 3D tracing, opposite trends were observed with different age groups: compared to the 2D tracings with magnification, 3D tracing could increase the intra- (Figure 5B) and inter-examiner ICCs (Figure 5C) in the adult group, but decrease the intra-examiner ICC with the examiner who has less experience with 3D imaging analysis in the children group (Figure 5B), and further decrease the inter-examiner ICCs of the children group (Figure 5C). With all the medians of ICCs for each type of cephalometric analysis in both age groups higher than 0.75, all tracing methods were reliable for both children and adult patients. However, the current study suggests clinical caution is needed while evaluating the images from children patients.
With the consideration of tracing methods, parameter types, and patients’ ages, a detailed comparison was performed. We found that angular measurements of the images from children patients had the lowest intra-examiner reliabilities for both examiners in all three types of cephalometric analysis methods (Figure 6). This subgroup also had the lowest inter-examiner reliability (Figure 7).
There is no doubt that this study had limitations. First, the CBCT datasets used in the current study did not have craniofacial syndromes or significant skeletal asymmetries. In a scenario with significant facial asymmetry, different borders of left- and right-side craniofacial structures may be distinguished on the extracted 2D lateral cephalometric X-rays even when using the setting of “orthogonal.” Thus, whether 2D tracings without magnification have higher reliability than tracings with conventional lateral cephalometric images for such patients’ needs to be verified. Additionally, only two American Board of Orthodontics certified clinicians were evaluated as examiners in the current study. The tracing performance of less experienced postgraduate program trainees in all three types of cephalometric analysis methods is worth considering to guide future clinical education and training.
We would like to emphasize that the CBCT datasets used in the current study were obtained from a pre-existing database of the patients who were prescribed with a full-volume CBCT for the initial purpose of evaluating impacted tooth/teeth, temporary anchorage device placement, orthognathic-orthodontic treatment plan, periodontal lesion, or endodontic lesion based on the clinical observation during the initial orthodontic consultation. In other words, no participants had a full-volume CBCT taken solely to extract lateral cephalometric images. We believe that all the radiological images in the orthodontic field should be taken with strict adherence to the ALARA (as low as reasonably achievable) principle. It is worth noting that, worldwide, substantial efforts have gone into further reducing radiation to the patients who need radiographic evaluation for orthodontic purposes. For example, a biplanar low-dose X-ray imaging system has been developed to take anteroposterior and lateral 2D images simultaneously, which can be used for 3D reconstruction based on statistical models [42]. Primarily used in the orthopedic field, this biplanar low-dose X-ray imaging system is capable of reliable cephalometric analysis [43]. Thus, for the patients who already have biplanar images for orthopedic purposes, no additional regular lateral/posterior-anterior cephalometric X-rays are needed if the patients are also seeking orthodontic and orthognathic management [43]. In addition, an ultra-low-dose CBCT imaging system has also been introduced in the dental field [44,45]. Excitingly, outside the range of 2 mm or degrees, there is no statistical difference in performing cephalometric analysis on the full-volume CBCTs taken under the ultra-low-dose protocol and standard protocol [38,45]. However, it has been noted that measurements based on images taken with the standard protocol have significantly smaller standard deviations than those taken with the ultra-low-dose protocol [38]. Moreover, previous studies indicate the patient scanning positions influence the accuracy of 3D cephalometry analysis, which could be sufficient to attract clinical attention [46,47]. Taken together, under current circumstances, commercially available 3D imaging systems cannot completely replace the 2D imaging systems regarding radiation exposure and analysis accuracy, and a large field CBCT scan for the sole reason of extracting a 2D pseudo-teleradiographic image is not good practice at the moment.

5. Conclusions

In summary, all three types of cephalometric analysis methods were reliable, with 2D tracings of extracted lateral cephalometric images without magnification having the highest intra- and inter-examiner reliabilities. However, since the current cephalometric norms were established using conventional lateral cephalometric images with built-in magnifications and distortions, 2D tracings of extracted lateral cephalometric images without magnification may not directly replace conventional cephalometric analysis. Further studies are needed to compare the tracing values between these two cephalometric analysis methods. Additionally, new landmarks are needed for 3D cephalometric tracing to improve the reliability of the 3D cephalometric analysis. Along with magnification, types of measurement parameters and patients’ ages are also influential factors in the accuracy and reliability of the cephalometric analysis. Clinical attention is needed when interpreting the angular measurements of images from children patients. Last but not least, the radiological images in the orthodontic field should be taken by strictly following the ALARA principle. Exposing a large field CBCT scan for the sole reason of extracting a 2D pseudo-teleradiographic image is not recommended.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/diagnostics11122292/s1, Supplemental Table S1: The intra-examiner intraclass correlation coefficient (ICC) of examiner 1 of all measurement parameters for the radiographic images from different age groups of the patients; Supplemental Table S2: The intra-examiner intraclass correlation coefficient (ICC) of examiner 2 of all measurement parameters for the radiographic images from different age groups of the patients; Supplemental Table S3: The inter-examiner intraclass correlation coefficient (ICC) of all measurement parameters for the radiographic images from different age groups of the patients.

Author Contributions

Conceptualization, C.L. and C.-H.C.; methodology, C.L. and Z.Z.; software, C.L.; validation, C.L. and H.T.; formal analysis, C.L. and H.T.; investigation, C.L.; resources, M.Z.; data curation, C.L.; writing—original draft preparation, C.L.; writing—review and editing, H.T., N.T., Z.Z., S.H.Y.C., M.Z. and C.-H.C.; supervision, C.L.; project administration, C.L.; funding acquisition, C.L. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by the American Association of Orthodontists Foundation (AAOF) Orthodontic Faculty Development Fellowship Award, American Association of Orthodontists (AAO) Full-Time Faculty Fellowship Award, University of Pennsylvania School of Dental Medicine Joseph and Josephine Rabinowitz Award for Excellence in Research, and the J. Henry O’Hern Jr. Pilot Grant from the Department of Orthodontics, University of Pennsylvania School of Dental Medicine for Chenshuang Li.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of University of Pennsylvania (protocol code 848424 and date of approval 4 March 2021).

Informed Consent Statement

Patient consent was waived as CBCT scans for this study were derived from pre-existing clinical database of pre-orthodontic treatment records, no additional radiologic images were taken for the current study, and no personal identification information was included in the current study.

Data Availability Statement

The data presented in this study are contained within this article and Supplementary Materials.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Broadbent, B.H. A new x-ray technique and its application to orthodontia. Angle Orthod. 1931, 1, 45–66. [Google Scholar]
  2. Brodie, A.G. On the growth pattern of the human head. From the third month to the eighth year of life. Am. J. Anat. 1941, 68, 209–262. [Google Scholar] [CrossRef]
  3. Margolis, H.I. The axial inclination of the mandibular incisors. Am. J. Orthod. Oral Surg. 1943, 29, 571–594. [Google Scholar] [CrossRef]
  4. Downs, W.B. Variations in facial relationships: their significance in treatment and prognosis. Am. J. Orthod. 1948, 34, 812–840. [Google Scholar] [CrossRef]
  5. Hans, M.G.; Palomo, J.M.; Valiathan, M. History of imaging in orthodontics from Broadbent to cone-beam computed tomography. Am. J. Orthod. Dentofacial. Orthop. 2015, 148, 914–921. [Google Scholar] [CrossRef] [Green Version]
  6. McNicol, A.; Stirrups, D.R. Assessment of screen/film combinations for cephalometric radiography. Br. J. Orthod. 1985, 12, 117–121. [Google Scholar] [CrossRef] [PubMed]
  7. Spolyar, J.L. Head positioning error in cephalometric radiography--an implant study. Angle Orthod. 1987, 57, 77–88. [Google Scholar] [CrossRef]
  8. Vano, E.; Fernandez, J.M.; Ten, J.I.; Prieto, C.; Gonzalez, L.; Rodriguez, R.; de las Heras, H. Transition from screen-film to digital radiography: evolution of patient radiation doses at projection radiography. Radiology 2007, 243, 461–466. [Google Scholar] [CrossRef] [PubMed]
  9. Mattoon, J.S. Digital radiography. Vet. Comp. Orthop. Traumatol. 2006, 19, 123–132. [Google Scholar] [CrossRef] [PubMed]
  10. Graham, D.T.; Cloke, P.J. Principles of Radiological Physics, 4th ed.; Churchill Livingstone: Edinburgh, NY, USA, 2003; 448 p. [Google Scholar]
  11. Miyashita, K.; Dixon, A.D. Contemporary Cephalometric Radiography; Quintessence Publishing Co, Inc.: Batavia, IL, USA, 1996. [Google Scholar]
  12. Dibbets, J.M.; Nolte, K. Effect of magnification on lateral cephalometric studies. Am. J. Orthod. Dentofacial. Orthop. 2002, 122, 196–201. [Google Scholar] [CrossRef]
  13. Ng, K.H.; Rehani, M.M. X ray imaging goes digital. BMJ 2006, 333, 765–766. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Tsorovas, G.; Karsten, A.L. A comparison of hand-tracing and cephalometric analysis computer programs with and without advanced features--accuracy and time demands. Eur. J. Orthod. 2010, 32, 721–728. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Polat-Ozsoy, O.; Gokcelik, A.; Toygar Memikoglu, T.U. Differences in cephalometric measurements: a comparison of digital versus hand-tracing methods. Eur. J. Orthod. 2009, 31, 254–259. [Google Scholar] [CrossRef]
  16. Roden-Johnson, D.; English, J.; Gallerano, R. Comparison of hand-traced and computerized cephalograms: landmark identification, measurement, and superimposition accuracy. Am. J. Orthod. Dentofacial. Orthop. 2008, 133, 556–564. [Google Scholar] [CrossRef] [PubMed]
  17. Song, G.Y.; Li, G.; Lu, W.H.; Han, B.; Xu, T.M. Distortion and magnification of four digital cephalometric units. Niger. J. Clin. Pract. 2019, 22, 1644–1653. [Google Scholar] [CrossRef]
  18. Rino Neto, J.; de Paiva, J.B.; Queiroz, G.V.; Attizzani, M.F.; Miasiro Junior, H. Evaluation of radiographic magnification in lateral cephalograms obtained with different X-ray devices: experimental study in human dry skull. Dental. Press J. Orthod. 2013, 18, 17e1–17e7. [Google Scholar] [CrossRef] [Green Version]
  19. Kula, K.; Ghoneima, A. Cephalometry in Orthodontics: 2D and 3D; Quintessence Publishing Co, Inc.: Batavia, IL, USA, 2020. [Google Scholar]
  20. Benn, D.K.; Vig, P.S. Estimation of x-ray radiation related cancers in US dental offices: Is it worth the risk? Oral Surg. Oral Med. Oral Pathol. Oral Radiol. 2021, 132, 597–608. [Google Scholar] [CrossRef] [PubMed]
  21. Kapetanovic, A.; Oosterkamp, B.C.M.; Lamberts, A.A.; Schols, J. Orthodontic radiology: development of a clinical practice guideline. Radiol. Med. 2021, 126, 72–82. [Google Scholar] [CrossRef]
  22. Yeh, J.K.; Chen, C.H. Estimated radiation risk of cancer from dental cone-beam computed tomography imaging in orthodontics patients. BMC Oral Health 2018, 18, 131. [Google Scholar] [CrossRef]
  23. American Board of Orthodontics. Scenario-based Exam Preparation. Available online: https://www.americanboardortho.com/orthodontic-professionals/about-board-certification/clinical-examination/scenario-based-clinical-examination/scenario-based-exam-preparation/ (accessed on 25 September 2021).
  24. Van Vlijmen, O.J.; Maal, T.; Berge, S.J.; Bronkhorst, E.M.; Katsaros, C.; Kuijpers-Jagtman, A.M. A comparison between 2D and 3D cephalometry on CBCT scans of human skulls. Int. J. Oral Maxillofac. Surg. 2010, 39, 156–160. [Google Scholar] [CrossRef]
  25. Farronato, G.; Salvadori, S.; Nolet, F.; Zoia, A.; Farronato, D. Assessment of inter- and intra-operator cephalometric tracings on cone beam CT radiographs: comparison of the precision of the cone beam CT versus the latero-lateral radiograph tracing. Prog. Orthod. 2014, 15, 1. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Bholsithi, W.; Tharanon, W.; Chintakanon, K.; Komolpis, R.; Sinthanayothin, C. 3D vs. 2D cephalometric analysis comparisons with repeated measurements from 20 Thai males and 20 Thai females. Biomed. Imaging Interv. J. 2009, 5, e21. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Lagravere, M.O.; Low, C.; Flores-Mir, C.; Chung, R.; Carey, J.P.; Heo, G.; Major, P.W. Intraexaminer and interexaminer reliabilities of landmark identification on digitized lateral cephalograms and formatted 3-dimensional cone-beam computerized tomography images. Am. J. Orthod. Dentofacial. Orthop. 2010, 137, 598–604. [Google Scholar] [CrossRef] [PubMed]
  28. Ricketts, R.M. A foundation for cephalometric communication. Am. J. Orthod. 1960, 46, 330–357. [Google Scholar] [CrossRef]
  29. Steiner, C.C. Cephalometrics In Clinical Practice. Angle Orthod. 1959, 29, 8–29. [Google Scholar] [CrossRef]
  30. Jacobson, A. Application of the "Wits" appraisal. Am. J. Orthod. 1976, 70, 179–189. [Google Scholar] [CrossRef]
  31. Sassouni, V. A roentgenographic cephalometric analysis of cephalo-facio-dental relationships. Am. J. Orthod. 1955, 41, 735–764. [Google Scholar] [CrossRef]
  32. McNamara Jr, J.A. A method of cephalometric evaluation. Am. J. Orthod. 1984, 86, 449–469. [Google Scholar] [CrossRef]
  33. Benjamin, D.J.; Berger, J.O.; Johannesson, M.; Nosek, B.A.; Wagenmakers, E.J.; Berk, R.; Bollen, K.A.; Brembs, B.; Brown, L.; Camerer, C.; et al. Redefine statistical significance. Nat. Hum. Behav. 2018, 2, 6–10. [Google Scholar] [CrossRef] [PubMed]
  34. Koo, T.K.; Li, M.Y. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Yitschaky, O.; Redlich, M.; Abed, Y.; Faerman, M.; Casap, N.; Hiller, N. Comparison of common hard tissue cephalometric measurements between computed tomography 3D reconstruction and conventional 2D cephalometric images. Angle Orthod. 2011, 81, 11–16. [Google Scholar] [CrossRef] [PubMed]
  36. Nalcaci, R.; Ozturk, F.; Sokucu, O. A comparison of two-dimensional radiography and three-dimensional computed tomography in angular cephalometric measurements. Dentomaxillofac. Radiol. 2010, 39, 100–106. [Google Scholar] [CrossRef] [Green Version]
  37. Hariharan, A.; Diwakar, N.R.; Jayanthi, K.; Hema, H.M.; Deepukrishna, S.; Ghaste, S.R. The reliability of cephalometric measurements in oral and maxillofacial imaging: Cone beam computed tomography versus two-dimensional digital cephalograms. Indian J. Dent. Res. 2016, 27, 370–377. [Google Scholar] [CrossRef] [PubMed]
  38. Van Bunningen, R.H.; Dijkstra, P.U.; Dieters, A.; van der Meer, W.J.; Kuijpers-Jagtman, A.M.; Ren, Y. Precision of orthodontic cephalometric measurements on ultra low dose-low dose CBCT reconstructed cephalograms. Clin. Oral Investig. 2021. [Google Scholar] [CrossRef]
  39. Mohan, A.; Sivakumar, A.; Nalabothu, P. Evaluation of accuracy and reliability of OneCeph digital cephalometric analysis in comparison with manual cephalometric analysis-a cross-sectional study. BDJ Open 2021, 7, 22. [Google Scholar] [CrossRef] [PubMed]
  40. Meric, P.; Naoumova, J. Web-based Fully Automated Cephalometric Analysis: Comparisons between App-aided, Computerized, and Manual Tracings. Turk. J. Orthod. 2020, 33, 142–149. [Google Scholar] [CrossRef] [PubMed]
  41. Liberton, D.K.; Verma, P.; Contratto, A.; Lee, J.S. Development and Validation of Novel Three-Dimensional Craniofacial Landmarks on Cone-Beam Computed Tomography Scans. J. Craniofac.Surg. 2019, 30, e611–e615. [Google Scholar] [CrossRef] [PubMed]
  42. Melhem, E.; Assi, A.; El Rachkidi, R.; Ghanem, I. EOS((R)) biplanar X-ray imaging: concept, developments, benefits, and limitations. J. Child Orthop. 2016, 10, 1–14. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Berg, B.I.; Laville, A.; Courvoisier, D.S.; Rouch, P.; Schouman, T. Experiences with a new biplanar low-dose X-ray device for imaging the facial skeleton: A feasibility study. PLoS ONE 2020, 15, e0235032. [Google Scholar] [CrossRef]
  44. Liljeholm, R.; Kadesjo, N.; Benchimol, D.; Hellen-Halme, K.; Shi, X.Q. Cone-beam computed tomography with ultra-low dose protocols for pre-implant radiographic assessment: An in vitro study. Eur. J. Oral Implantol. 2017, 10, 351–359. [Google Scholar]
  45. Kusnoto, B.; Kaur, P.; Salem, A.; Zhang, Z.; Galang-Boquiren, M.T.; Viana, G.; Evans, C.A.; Manasse, R.; Monahan, R.; BeGole, E. Implementation of ultra-low-dose CBCT for routine 2D orthodontic diagnostic radiographs: Cephalometric landmark identification and image quality assessment. Semin. Orthod. 2015, 21, 233–247. [Google Scholar] [CrossRef]
  46. Frongia, G.; Piancino, M.G.; Bracco, P. Cone-beam computed tomography: accuracy of three-dimensional cephalometry analysis and influence of patient scanning position. J. Craniofac. Surg. 2012, 23, 1038–1043. [Google Scholar] [CrossRef] [PubMed]
  47. Hassan, B.; van der Stelt, P.; Sanderink, G. Accuracy of three-dimensional measurements obtained from cone beam computed tomography surface-rendered images for cephalometric analysis: influence of patient scanning position. Eur. J. Orthod. 2009, 31, 129–134. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Diagnostics 11 02292 g001 550
Figure 1. The age information of the samples included in the current study. Data are presented as raw data overlapped with mean ± standard deviation (SD). Two-tailed t-test was used for statistical analysis. No statistically significant difference was detected between genders for each age group.
Figure 1. The age information of the samples included in the current study. Data are presented as raw data overlapped with mean ± standard deviation (SD). Two-tailed t-test was used for statistical analysis. No statistically significant difference was detected between genders for each age group.
Diagnostics 11 02292 g001
Diagnostics 11 02292 g002 550
Figure 2. The imaging processing flow chart of the current study. (A,B) The orientation of a CBCT image. (C,D) Under the “X-ray Building preferences” option, “Perspective” was selected to create an X-Ray with the measured distortion and warping effects mimicking a traditional X-Ray (C), and “Orthogonal” was selected to create a non-distorted X-Ray (D). The red arrows represent the direction of X-Rays beams simulated by computer calculation. (E,F) The generated lateral cephalometric X-Rays with (E) or without (F) magnification and distortion. Note the two mandibular posterior borders visible in (E), but not in (F). (G,H) Digital cephalometric tracing and analysis were performed with the extracted 2D lateral cephalometric images. (I) Tracings with 3D reconstructed images were performed by using the “Digitize/Measurement” function in Dolphin 3D.
Figure 2. The imaging processing flow chart of the current study. (A,B) The orientation of a CBCT image. (C,D) Under the “X-ray Building preferences” option, “Perspective” was selected to create an X-Ray with the measured distortion and warping effects mimicking a traditional X-Ray (C), and “Orthogonal” was selected to create a non-distorted X-Ray (D). The red arrows represent the direction of X-Rays beams simulated by computer calculation. (E,F) The generated lateral cephalometric X-Rays with (E) or without (F) magnification and distortion. Note the two mandibular posterior borders visible in (E), but not in (F). (G,H) Digital cephalometric tracing and analysis were performed with the extracted 2D lateral cephalometric images. (I) Tracings with 3D reconstructed images were performed by using the “Digitize/Measurement” function in Dolphin 3D.
Diagnostics 11 02292 g002
Diagnostics 11 02292 g003 550
Figure 3. The intra- and inter-examiner intraclass correlation coefficient (ICC) of all measurement parameters. (A) The intra-examiner ICCs were calculated for each examiner based on two sets of cephalometric tracing measurements performed with at least a one-month interval. (B) The inter-examiner ICC of the two examiners was calculated by comparing the mean value of the two sets of cephalometric tracing measurements from each examiner. All data presented with violin plots. The solid black line in each violin plot indicates the median, and the colored dotted lines in each violin plot indicates the quartiles. A Wilcoxon matched-pairs signed-rank test was used for statistical analysis. *: p < 0.05; **: p < 0.005.
Figure 3. The intra- and inter-examiner intraclass correlation coefficient (ICC) of all measurement parameters. (A) The intra-examiner ICCs were calculated for each examiner based on two sets of cephalometric tracing measurements performed with at least a one-month interval. (B) The inter-examiner ICC of the two examiners was calculated by comparing the mean value of the two sets of cephalometric tracing measurements from each examiner. All data presented with violin plots. The solid black line in each violin plot indicates the median, and the colored dotted lines in each violin plot indicates the quartiles. A Wilcoxon matched-pairs signed-rank test was used for statistical analysis. *: p < 0.05; **: p < 0.005.
Diagnostics 11 02292 g003
Diagnostics 11 02292 g004 550
Figure 4. Comparison of intra- and inter-examiner intraclass correlation coefficient (ICC) in different measurement parameters. (A,B) The intra-examiner ICCs of examiner 1 (A) and examiner 2 (B) were calculated for each examiner based on two sets of cephalometric tracing measurements performed with at least a one-month interval. (C) The inter-examiner ICC of the two examiners was calculated by comparing the mean value of the two sets of cephalometric tracing measurements from each examiner. All data presented with violin plots. The solid black line in each violin plot indicates the median, and the colored dotted lines in each violin plot indicates the quartiles. Wilcoxon matched-pairs signed-rank test was used for statistical analysis for the comparison within each type of the parameters, and Mann-Whitney U test was used for statistical analysis for the comparison between two types of the parameters. *: p < 0.05; **: p < 0.005.
Figure 4. Comparison of intra- and inter-examiner intraclass correlation coefficient (ICC) in different measurement parameters. (A,B) The intra-examiner ICCs of examiner 1 (A) and examiner 2 (B) were calculated for each examiner based on two sets of cephalometric tracing measurements performed with at least a one-month interval. (C) The inter-examiner ICC of the two examiners was calculated by comparing the mean value of the two sets of cephalometric tracing measurements from each examiner. All data presented with violin plots. The solid black line in each violin plot indicates the median, and the colored dotted lines in each violin plot indicates the quartiles. Wilcoxon matched-pairs signed-rank test was used for statistical analysis for the comparison within each type of the parameters, and Mann-Whitney U test was used for statistical analysis for the comparison between two types of the parameters. *: p < 0.05; **: p < 0.005.
Diagnostics 11 02292 g004
Diagnostics 11 02292 g005 550
Figure 5. Comparison of intra- and inter-examiner intraclass correlation coefficient (ICC) of all measurement parameters for the radiographic images from different age groups of the patients. (A,B) The intra-examiner ICCs of examiner 1 (A) and examiner 2 (B) were calculated for each examiner based on two sets of cephalometric tracing measurements performed with at least a one-month interval. (C) The inter-examiner ICC of the two examiners was calculated by comparing the mean value of the two sets of cephalometric tracing measurements from each examiner. All data presented with violin plots. The solid black line in each violin plot indicates the median, and the colored dotted lines in each violin plot indicates the quartiles. Wilcoxon matched-pairs signed-rank test was used for statistical analysis. *: p < 0.05; **: p < 0.005.
Figure 5. Comparison of intra- and inter-examiner intraclass correlation coefficient (ICC) of all measurement parameters for the radiographic images from different age groups of the patients. (A,B) The intra-examiner ICCs of examiner 1 (A) and examiner 2 (B) were calculated for each examiner based on two sets of cephalometric tracing measurements performed with at least a one-month interval. (C) The inter-examiner ICC of the two examiners was calculated by comparing the mean value of the two sets of cephalometric tracing measurements from each examiner. All data presented with violin plots. The solid black line in each violin plot indicates the median, and the colored dotted lines in each violin plot indicates the quartiles. Wilcoxon matched-pairs signed-rank test was used for statistical analysis. *: p < 0.05; **: p < 0.005.
Diagnostics 11 02292 g005
Diagnostics 11 02292 g006 550
Figure 6. Comparison of intra-examiner intraclass correlation coefficient (ICC) of different measurement parameters for the radiographic images from different patient age groups. (A,B) The intra-examiner ICCs of examiner 1 (A) and examiner 2 (B) were calculated for each examiner based on two sets of cephalometric tracing measurements performed with at least a one-month interval. All data presented with violin plots. The solid black line in each violin plot indicates the median, and the colored dotted lines in each violin plot indicates the quartiles. Wilcoxon matched-pairs signed-rank test was used for statistical analysis for the comparison within each type of the parameters, and Mann-Whitney U test was used for statistical analysis for the comparison between two types of the parameters. *: p < 0.05; **: p < 0.005.
Figure 6. Comparison of intra-examiner intraclass correlation coefficient (ICC) of different measurement parameters for the radiographic images from different patient age groups. (A,B) The intra-examiner ICCs of examiner 1 (A) and examiner 2 (B) were calculated for each examiner based on two sets of cephalometric tracing measurements performed with at least a one-month interval. All data presented with violin plots. The solid black line in each violin plot indicates the median, and the colored dotted lines in each violin plot indicates the quartiles. Wilcoxon matched-pairs signed-rank test was used for statistical analysis for the comparison within each type of the parameters, and Mann-Whitney U test was used for statistical analysis for the comparison between two types of the parameters. *: p < 0.05; **: p < 0.005.
Diagnostics 11 02292 g006
Diagnostics 11 02292 g007 550
Figure 7. Comparison of inter-examiner intraclass correlation coefficient (ICC) of different measurement parameters for the radiographic images from different patient age groups. The inter-examiner ICC of the two examiners was calculated by comparing the mean value of the two sets of cephalometric tracing measurements from each examiner. All data presented with violin plots. The solid black line in each violin plot indicates the median, and the colored dotted lines in each violin plot indicates the quartiles. Wilcoxon matched-pairs signed-rank test was used for statistical analysis for the comparison within each type of the parameters, and Mann-Whitney U test was used for statistical analysis for the comparison between two types of the parameters. *: p < 0.05; **: p < 0.005.
Figure 7. Comparison of inter-examiner intraclass correlation coefficient (ICC) of different measurement parameters for the radiographic images from different patient age groups. The inter-examiner ICC of the two examiners was calculated by comparing the mean value of the two sets of cephalometric tracing measurements from each examiner. All data presented with violin plots. The solid black line in each violin plot indicates the median, and the colored dotted lines in each violin plot indicates the quartiles. Wilcoxon matched-pairs signed-rank test was used for statistical analysis for the comparison within each type of the parameters, and Mann-Whitney U test was used for statistical analysis for the comparison between two types of the parameters. *: p < 0.05; **: p < 0.005.
Diagnostics 11 02292 g007
Table
Table 1. The intra-examiner ICCs for each parameter. In each tracing scenario, the five parameters with the highest ICCs are labeled in green, and the five parameters with the lowest ICCs are marked in red.
Table 1. The intra-examiner ICCs for each parameter. In each tracing scenario, the five parameters with the highest ICCs are labeled in green, and the five parameters with the lowest ICCs are marked in red.
Cephalometric Tracing Measurement ParametersExaminer 1Examiner 2
2D with Magnification2D without Magnification3D2D with Magnification2D without magnification3D
ICC95% CI Lower Bound95% CI Upper BoundICC95% CI Lower Bound95% CI Upper BoundICC95% CI Lower Bound95% CI Upper BoundICC95% CI Lower Bound95% CI Upper BoundICC95% CI Lower Bound95% CI Upper BoundICC95% CI Lower Bound95% CI Upper Bound
LinearB to A point arch (mm)0.9880.9700.9950.9850.9540.9950.9900.9740.9960.9310.7840.9750.9200.8100.9670.7500.4720.893
Convexity (A-NPo) (mm)0.9780.9450.9910.9900.9730.9960.9880.9700.9950.9480.8590.9800.8470.6540.9360.8480.6560.937
Corpus length (Go-Gn) (mm)0.9890.9710.9950.9800.9460.9920.9930.9830.9970.9590.9010.9840.8760.7090.9490.9000.7680.959
Cranial length (mm)0.9440.8640.9780.9050.7800.9610.9170.7950.9670.8160.5900.9230.8370.6350.9320.6960.3780.867
L1-APo (mm)0.9830.9570.9930.9910.9790.9970.9870.9670.9950.9760.9400.9900.7920.5490.9120.8860.7330.953
L1-NB (mm)0.9800.9490.9920.9780.9070.9930.9930.9810.9970.8200.6030.9240.7960.5590.9130.8520.6690.938
LAFH (ANS-Me) (mm)0.9980.9940.9990.9970.9910.9990.9930.9840.9970.8680.6990.9460.8640.6930.9440.9450.8660.978
Lower Lip to E-Plane (mm)0.9860.9640.9940.9840.9600.9930.9910.9780.9970.9350.8450.9730.7300.4390.8830.7040.3910.871
Mand. Skeletal (Pg-Na Perp) (mm)0.9480.8730.9790.9910.9770.9960.9730.9340.9890.8940.7530.9570.9340.7940.9760.9420.8610.977
Mandibular Incisor Extrusion (mm)0.9530.8850.9810.9600.9040.9840.9610.9030.9840.6860.3560.8630.9250.8240.9690.379−0.0800.701
Mandibular length (Co-Gn) (mm)0.9920.9680.9970.9970.9940.9990.9980.9960.9990.8930.7490.9560.9080.7860.9620.9750.9360.990
Maxillary skeletal (A-Na Perp) (mm)0.9010.7680.9600.9770.9380.9910.9520.8830.9800.7010.3940.8690.7640.4620.9030.7970.5620.914
Midface Length (Co-A) (mm)0.9710.8780.9900.9870.9670.9950.9890.9720.9960.8130.5840.9220.9400.8540.9760.8640.6870.944
Molar Relation (mm)0.9660.9160.9860.9420.8600.9770.9570.8940.9830.6870.3610.8630.9220.8160.9690.8990.7640.959
Mx/Md diff (Co-Gn-Co-A) (mm)0.9950.9880.9980.9950.9870.9980.9950.9870.9980.9740.9290.9900.8900.7440.9550.9610.8920.985
Overbite (mm)0.9520.8830.9810.9630.9100.9850.9630.9090.9850.7850.5390.9090.9260.8250.9700.5820.2070.810
Overjet (mm)0.9730.9330.9890.9930.9840.9970.9940.9840.9980.7060.4010.8710.9420.8610.9760.8590.6780.942
Pg to ANS arc (mm)0.9680.9200.9870.9860.9640.9940.9690.9230.9880.8600.6840.9420.9030.7280.9630.6940.3820.866
Pog-NB (mm)0.9030.7720.9610.9330.6170.9800.9000.7650.9590.8370.6390.9320.8390.6370.9330.7690.5010.902
Porion location (mm)0.9150.7990.9660.9600.9010.9840.9470.8730.9790.8280.6200.9280.6990.3860.8690.8450.6380.936
Posterior facial height (Go-CF) (mm)0.9920.9810.9970.9940.9830.9980.9960.9880.9980.9690.9250.9880.8990.7620.9590.9820.9510.993
U1 most labial-A (perp to FH) (mm)0.9830.9570.9930.9890.9720.9960.9920.9800.9970.9620.9030.9850.7640.4960.8990.8570.6740.941
U1 to ANS arc (mm)0.9690.9240.9870.9790.9490.9920.9670.9180.9870.8870.7410.9530.8540.5390.9480.7560.4770.896
U1-APo (mm)0.9760.9410.9900.9970.9920.9990.9900.9760.9960.8510.6660.9380.8320.6220.9300.9080.7840.962
U1-NA (mm)0.9830.9580.9930.9930.9830.9970.9860.9650.9940.9270.8250.9710.7650.4940.9000.8210.6000.925
U6-PT vertical (mm)0.9770.9440.9910.9700.9270.9880.9710.9300.9880.8110.5890.9200.8120.4990.9280.8410.6310.935
Upper Lip to E-Plane (mm)0.9760.9410.9900.9730.9320.9890.9520.8830.9810.9540.8870.9820.7870.5340.9100.8670.6840.946
Wits Appraisal (mm)0.9780.9460.9910.9760.9360.9910.9650.9140.9860.9600.9030.9840.9280.8310.9710.7890.5370.911
AngularANB (°)0.9730.9340.9890.9860.9660.9940.9850.9630.9940.9530.8870.9810.8860.7330.9530.7850.5410.908
Cranial deflection (°)0.6160.2440.8290.9710.9250.9890.9140.7980.9650.6510.3110.8450.7360.3280.8970.7670.4990.901
Facial angle (FH/NPo) (°)0.9470.8710.9790.9900.9740.9960.9710.9300.9880.7010.2950.8690.8540.2950.9490.9200.8110.968
Facial axis angle (Ba-Na^Pt-Gn) (°)0.9630.9100.9850.9860.9650.9940.9930.9830.9970.9770.9430.9910.9240.8180.9690.9280.8290.971
Facial Axis-Ricketts (NaBa-PtGn) (°)0.9630.9100.9850.9860.9650.9940.9930.9830.9970.6770.3550.8570.9210.8130.9680.9240.8210.969
Facial taper (°)0.9820.9540.9930.9810.9460.9930.9910.9770.9960.9200.8080.9670.8450.6540.9350.8590.6840.941
FMA (MP-FH) (°)0.9380.8510.9750.9790.9280.9930.9820.9560.9930.9100.7890.9630.9020.6900.9650.9530.8860.981
FMIA (L1-FH) (°)0.9400.8560.9670.9630.8930.9860.9610.9050.9850.8460.6550.9360.8410.6270.9350.8500.6640.938
GoGn to FH (FMA) (°)0.9240.8210.9690.9760.9400.9900.9820.9560.9930.8860.7380.9530.7960.4060.9250.9170.8030.966
Hinge Axis Angle (°)0.9410.8580.9760.9590.8960.9840.9490.8760.9790.8830.7310.9520.7570.4780.8970.7440.4650.890
IMPA (L1-MP) (°)0.9540.8870.9810.9610.9060.9840.9320.8370.9730.8720.7040.9470.8590.6790.9420.7620.4870.899
Interincisal Angle (U1-L1) (°)0.9550.8900.9820.9750.9400.9900.9610.9070.9840.9140.7950.9650.7950.5580.9130.7230.4250.880
L1-APo (°)0.9750.9280.9900.9610.8910.9850.9400.8560.9760.9320.8220.9730.7990.5560.9150.8110.5870.921
L1-NB (°)0.9580.8980.9830.9570.8940.9830.9320.8370.9730.8480.6550.9370.8010.5620.9170.7430.4660.889
Lower face height (ANS-Xi-Pm) (°)0.9890.9710.9950.9910.9770.9960.9930.9830.9970.8870.7400.9530.9090.7690.9640.9480.8730.979
Lower Gonial angle (Na-Go-Me) (°)0.9820.9950.9930.9890.9730.9960.9940.9860.9980.8280.6190.9280.9080.7850.9620.9170.8020.966
Mandibular Arc (°)0.9460.8690.9780.8980.7660.9580.9630.9090.9850.7620.4810.9000.6480.3020.8440.6970.3820.867
Maxillary depth (FH-NA) (°)0.9700.9250.9880.9790.9450.9920.9520.8850.9810.8080.5790.9190.7650.4480.9050.9720.9330.989
Maxillary height (N-CF-A) (°)0.9560.8950.9820.9650.9140.9860.9670.9190.9870.8780.7230.9500.8440.6280.9370.8800.7200.951
MP-SN (°)0.9870.9670.9950.9870.9690.9950.9910.9770.9960.9610.9050.9840.8770.7190.9490.9160.8020.966
Occlusal plane to FH (°)0.9420.8620.9770.9490.7410.9840.9710.9290.9880.8110.5840.9200.8750.6970.9500.7600.4960.897
Occlusal Plane to SN (°)0.9640.9130.9850.9730.9250.9900.9660.9160.9860.9460.8660.9780.9360.8460.9740.8070.5720.919
Ramus position (°)0.8060.5700.9190.9340.8410.9730.9600.8990.9840.6070.2470.8220.4880.0340.7680.8470.6230.939
SN-palatal plane (°)0.9060.7800.9610.8390.6370.9330.9790.9480.9920.8300.6190.9290.7980.5540.9150.5460.1680.789
SNA (°)0.9800.9500.9920.9880.9710.9950.9910.9780.9970.8710.7080.9470.9060.7770.9620.8760.6710.952
SNB (°)0.9910.9770.9960.9880.9710.9950.9900.9760.9960.8420.6350.9350.9390.8530.9750.9450.8670.978
Soft tissue Convexity (°)0.9680.9210.9870.9320.8370.9730.8700.7070.9460.7960.5570.9140.9000.7700.9590.5890.1990.815
Total face height (NaBa-PmXi) (°)0.9650.9150.9860.9880.9700.9950.9950.9860.9980.8870.7370.9540.9180.8080.9670.9490.8780.979
U1- Palatal Plane (°)0.9400.8560.9760.9460.8650.9790.9580.8960.9830.8100.5810.9210.6880.3730.8630.7810.5220.907
U1-APo (°)0.9050.7750.9610.9200.7290.9720.9260.8220.9700.7480.4610.8920.7840.5250.9090.6230.2630.832
U1-FH (°)0.9470.8710.9790.9500.8320.9820.9680.9200.9870.8410.6410.9340.7790.3730.9180.8280.6220.928
U1-NA (°)0.9590.9000.9840.9640.8840.9870.9580.8980.9830.9130.7960.9640.7760.5240.9040.8570.6780.940
U1-SN (°)0.9590.8990.9830.9670.8990.9880.9730.9330.9890.8830.7280.9520.8510.6570.9390.8450.6540.935
Upper gonial angle (Ar-Go-Na) (°)0.9720.9300.9890.9900.9740.9960.9920.9800.9970.9610.9070.9840.8950.7270.9590.9440.8660.977
Upper lip angle (ULA) (°)0.9700.9250.9880.9700.9250.9880.9590.9000.9840.9230.7940.9700.8920.7490.9560.9230.8160.969
Table
Table 2. The inter-examiner ICCs for each parameter. In each tracing scenario, the five parameters with the highest ICCs are labeled in green, and the five parameters with the lowest ICCs are marked in red.
Table 2. The inter-examiner ICCs for each parameter. In each tracing scenario, the five parameters with the highest ICCs are labeled in green, and the five parameters with the lowest ICCs are marked in red.
Cephalometric Tracing Measurement ParametersInter-Examiner
2D with Magnification2D without Magnification3D
ICC95% CI Lower Bound95% CI Upper BoundICC95% CI Lower Bound95% CI Upper BoundICC95% CI Lower Bound95% CI Upper Bound
LinearB to A point arch (mm)0.9600.8870.9850.9570.8390.9850.6530.1360.866
convexity (A-NPo) (mm)0.9650.9110.9860.9280.8190.9710.5990.0430.844
Corpus length (Go-Gn) (mm)0.8620.6890.9430.9610.9060.9840.9400.8570.976
cranial length (mm)0.8720.7090.9470.8750.4920.9590.416−0.0510.730
L1-APo (mm)0.8390.6420.9330.9280.8280.9710.7180.4230.877
L1-NB (mm)0.7630.5000.8980.9390.8530.9750.7760.5190.905
LAFH (ANS-Me) (mm)0.8240.6110.9260.9370.8370.9750.7930.5550.912
Lower Lip to E-Plane (mm)0.7480.4530.8940.8910.7340.9560.6060.1130.840
Mand. Skeletal (Pg-Na Perp) (mm)0.9250.7860.9720.9420.8600.9770.9340.8410.973
Mandibular Incisor Extrusion (mm)0.7580.4810.8970.8680.6970.9460.6090.2160.828
Mandibular length (Co-Gn) (mm)0.9270.8260.9710.9790.9480.9920.9280.8310.971
Maxillary skeletal (A-Na Perp) (mm)0.7780.5200.9060.8710.7060.9470.6780.2300.871
Midface Length (Co-A) (mm)0.8900.7460.9550.9780.9460.9910.8430.4650.945
Molar Relation (mm)0.8840.7340.9520.9570.8960.9830.9180.8070.967
Mx/Md diff (Co-Gn-Co-A) (mm)0.9390.8530.9750.9820.9550.9930.9020.7700.960
Overbite (mm)0.7900.5390.9110.8650.6910.9450.7010.3200.877
Overjet (mm)0.9070.7800.9620.9610.9060.9840.8520.6690.938
Pg to ANS arc (mm)0.691−0.0520.9060.688−0.0160.9000.8290.6160.929
Pog-NB (mm)0.9190.7720.9690.9000.7420.9610.8020.5630.917
porion location (mm)0.7480.4620.8920.8940.7550.9560.562−0.0980.855
posterior facial height (Go-CF) (mm)0.9280.8300.9710.9550.7840.9860.9150.7990.965
U1 most labial-A (perp to FH) (mm)0.8590.6830.9420.9030.7720.9600.7050.3470.876
U1 to ANS arc (mm)0.464−0.1040.7920.489−0.1020.8090.7530.4810.894
U1-APo (mm)0.8070.5790.9190.9460.8700.9870.7860.5340.909
U1-NA (mm)0.8220.7300.9520.9170.8060.9660.7200.2880.892
U6-PT vertical (mm)0.8210.6080.9250.9090.6830.9680.7880.5370.911
Upper Lip to E-Plane (mm)0.7980.4650.9220.8340.5680.9350.6970.2050.885
Wits Appraisal (mm)0.9380.8500.9750.9360.8460.9740.7420.2990.903
AngularANB (°)0.9670.9190.9870.9180.8070.9660.574−0.0420.843
cranial deflection (°)0.5890.0720.8340.7710.5060.9030.7640.4900.900
facial angle (FH/NPo) (°)0.8300.5410.9350.9170.7990.9670.9390.8540.976
Facial axis angle (Ba-Na^Pt-Gn) (°)0.9050.7760.9610.9610.9050.9840.8930.5290.966
Facial Axis-Ricketts (NaBa-PtGn) (°)0.7030.3890.8710.9610.9070.9840.8900.5030.965
Facial taper (°)0.9070.7830.9620.8850.6650.9570.8530.6300.942
FMA (MP-FH) (°)0.7820.5240.9080.8880.7350.9550.8530.6660.939
FMIA (L1-FH) (°)0.8150.5970.9220.8050.5770.9170.6790.3430.860
GoGn to FH (FMA) (°)0.9310.8370.9720.8970.7610.9580.8610.6860.942
Hinge Axis Angle (°)0.8010.5220.9200.7830.5030.9100.6750.3450.857
IMPA (L1-MP) (°)0.8470.6420.9380.8290.6230.9280.6580.3230.848
Interincisal Angle (U1-L1) (°)0.7500.4510.8950.8570.6080.9450.6320.2810.835
L1-APo (°)0.8240.6010.9270.8350.5840.9350.4770.0720.751
L1-NB (°)0.7540.4780.8950.8170.5910.9230.5420.1320.791
Lower face height (ANS-Xi-Pm) (°)0.8070.4660.9270.8990.6730.9640.8280.6150.928
Lower Gonial angle (Na-Go-Me) (°)0.9220.8140.9680.9140.7890.9650.8370.6180.933
Mandibular Arc (°)0.680−0.0270.8980.6830.2320.8750.8640.6920.943
maxillary depth (FH-NA) (°)0.4690.0680.7450.8870.7400.9540.7010.2680.882
maxillary height (N-CF-A) (°)0.7690.4650.9050.8660.5660.9520.8220.5950.926
MP-SN (°)0.9050.7760.9610.9110.7670.9660.8230.5220.932
Occlusal plane to FH (°)0.7330.3660.8930.7860.5330.9100.6960.3840.867
Occlusal Plane to SN (°)0.7710.4340.9090.9310.8370.9720.8810.6440.956
ramus position (°)0.6110.2560.8230.7230.4280.8790.6540.2530.854
SN-palatal plane (°)0.8900.7470.9550.8470.6100.9400.7910.5470.911
SNA (°)0.9390.8220.9770.9370.8480.9750.7800.4580.913
SNB (°)0.9530.8430.9830.9740.9350.9890.9510.8660.981
Soft tissue Convexity (°)0.9050.7790.9610.9370.8480.9750.5150.1110.774
Total face height (NaBa-PmXi) (°)0.9270.8260.9710.9370.8500.7400.9570.8950.983
U1- Palatal Plane (°)0.7070.3490.8780.8610.5180.9520.7100.2500.889
U1-APo (°)0.5860.2210.8110.8510.6670.9380.6320.2760.836
U1-FH (°)0.7310.3820.8890.8500.6080.9420.8670.6670.947
U1-NA (°)0.7880.5390.9100.8710.6730.9490.7550.0790.923
U1-SN (°)0.8060.5290.9220.9200.8040.9680.8870.5000.964
upper gonial angle (Ar-Go-Na) (°)0.9170.7980.9670.9650.8040.9890.9210.2950.977
Upper lip angle (ULA) (°)0.8750.6100.9550.9560.8640.9840.7680.5090.901
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Li, C.; Teixeira, H.; Tanna, N.; Zheng, Z.; Chen, S.H.Y.; Zou, M.; Chung, C.-H. The Reliability of Two- and Three-Dimensional Cephalometric Measurements: A CBCT Study. Diagnostics 2021, 11, 2292. https://doi.org/10.3390/diagnostics11122292

AMA Style

Li C, Teixeira H, Tanna N, Zheng Z, Chen SHY, Zou M, Chung C-H. The Reliability of Two- and Three-Dimensional Cephalometric Measurements: A CBCT Study. Diagnostics. 2021; 11(12):2292. https://doi.org/10.3390/diagnostics11122292

Chicago/Turabian Style

Li, Chenshuang, Hellen Teixeira, Nipul Tanna, Zhong Zheng, Stephanie Hsiang Yi Chen, Min Zou, and Chun-Hsi Chung. 2021. "The Reliability of Two- and Three-Dimensional Cephalometric Measurements: A CBCT Study" Diagnostics 11, no. 12: 2292. https://doi.org/10.3390/diagnostics11122292

APA Style

Li, C., Teixeira, H., Tanna, N., Zheng, Z., Chen, S. H. Y., Zou, M., & Chung, C. -H. (2021). The Reliability of Two- and Three-Dimensional Cephalometric Measurements: A CBCT Study. Diagnostics, 11(12), 2292. https://doi.org/10.3390/diagnostics11122292

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop