Next Article in Journal
Silicon Nitride-Based Composites with the Addition of CNTs—A Review of Recent Progress, Challenges, and Future Prospects
Previous Article in Journal
In Vitro Simulation of Dental Implant Bridges Removal: Influence of Luting Agent and Abutments Geometry on Retrievability
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

One Step before 3D Printing—Evaluation of Imaging Software Accuracy for 3-Dimensional Analysis of the Mandible: A Comparative Study Using a Surface-to-Surface Matching Technique

by
Antonino Lo Giudice
1,
Vincenzo Ronsivalle
1,
Cristina Grippaudo
2,
Alessandra Lucchese
3,
Simone Muraglie
1,
Manuel O. Lagravère
4 and
Gaetano Isola
1,*
1
Department of General Surgery and Surgical-Medical Specialties, School of Dentistry, University of Catania, Policlinico Universitario “Vittorio Emanuele—G. Rodolico”, Via S. Sofia 78, 95123 Catania, Italy
2
Department of Orthodontics, University of Sacred Heart of Rome, 00168 Rome, Italy
3
Department of Orthodontics, Vita-Salute San Raffaele University, 10,090 Milan, Italy
4
Orthodontic Graduate Program, ECHA 5-524, Faculty of Medicine and Dentistry, University of Alberta, 11405-87 Ave, Edmonton, AB T6G1Z1, Canada
*
Author to whom correspondence should be addressed.
Materials 2020, 13(12), 2798; https://doi.org/10.3390/ma13122798
Submission received: 9 April 2020 / Revised: 10 May 2020 / Accepted: 19 June 2020 / Published: 21 June 2020

Abstract

:
The accuracy of 3D reconstructions of the craniomaxillofacial region using cone beam computed tomography (CBCT) is important for the morphological evaluation of specific anatomical structures. Moreover, an accurate segmentation process is fundamental for the physical reconstruction of the anatomy (3D printing) when a preliminary simulation of the therapy is required. In this regard, the objective of this study is to evaluate the accuracy of four different types of software for the semiautomatic segmentation of the mandibular jaw compared to manual segmentation, used as a gold standard. Twenty cone beam computed tomography (CBCT) with a manual approach (Mimics) and a semi-automatic approach (Invesalius, ITK-Snap, Dolphin 3D, Slicer 3D) were selected for the segmentation of the mandible in the present study. The accuracy of semi-automatic segmentation was evaluated: (1) by comparing the mandibular volumes obtained with semi-automatic 3D rendering and manual segmentation and (2) by deviation analysis between the two mandibular models. An analysis of variance (ANOVA) was used to evaluate differences in mandibular volumetric recordings and for a deviation analysis among the different software types used. Linear regression was also performed between manual and semi-automatic methods. No significant differences were found in the total volumes among the obtained 3D mandibular models (Mimics = 40.85 cm3, ITK-Snap = 40.81 cm3, Invesalius = 40.04 cm3, Dolphin 3D = 42.03 cm3, Slicer 3D = 40.58 cm3). High correlations were found between the semi-automatic segmentation and manual segmentation approach, with R coefficients ranging from 0,960 to 0,992. According to the deviation analysis, the mandibular models obtained with ITK-Snap showed the highest matching percentage (Tolerance A = 88.44%, Tolerance B = 97.30%), while those obtained with Dolphin 3D showed the lowest matching percentage (Tolerance A = 60.01%, Tolerance B = 87.76%) (p < 0.05). Colour-coded maps showed that the area of greatest mismatch between semi-automatic and manual segmentation was the condylar region and the region proximate to the dental roots. Despite the fact that the semi-automatic segmentation of the mandible showed, in general, high reliability and high correlation with the manual segmentation, caution should be taken when evaluating the morphological and dimensional characteristics of the condyles either on CBCT-derived digital models or physical models (3D printing).

1. Introduction

Cone beam computed tomography (CBCT) represents the three-dimensional (3D) imaging method of choice in oral and maxillofacial fields [1,2]. Although multi-slice computed tomography (MSCT) presents a higher resolution and a higher contrast-to-noise-ratio [3,4], CBCT scans offer adequate images for diagnostic purposes, at a lower risk of radiation exposure for patients [5,6,7]. In this respect, a 3D reconstruction of the craniomaxillofacial region using CBCT is employed in the diagnosis and planning of orthodontic treatment [8], maxillofacial surgery [9] and oral implantology [10], often involving the transformation of a physical object (3D printing). 3D rendering of the maxilla and mandibular jaws is extremely useful for pre-operative surgical planning and post-operative follow-up evaluation in orthognathic surgery and for the analysis of morphological, dimensional and positional changes before and after orthodontic therapies [11,12,13]. Moreover, it is fundamental to analyze and detect the magnitude and location of skeletal facial asymmetry, deformities, or asymmetry of temporomandibular joints (TMJ) and to plan surgical correction [14,15,16].
3D rendering is based on a process called segmentation, which is described as the virtual separation of the anatomical region with the removal of all other structures of noninterest for better visualization and analysis [17]. Segmentation can be performed both manually or automatically. The manual approach is user-dependent and is performed slice by slice with the software pooling all slices to reconstruct a 3D volume. Conversely, the semiautomatic segmentation is a computer-aided approach (hybrid). Here, the procedure usually starts with two user-guided interactive steps, i.e., the placement of initial seed regions in all three slices and the selection of a threshold interval (Hounsfield units), to provide information on the texture and background for the software [17,18]. Then, the software automatically selects the voxel of the interested region and excludes the surrounding structures.
Manual segmentation represents the gold standard for the 3D rendering of maxillofacial structures (CMF) since it allows for the detection of areas with low bone density or with no well-defined boundaries due to their low contrast and proximity to other structures [3]. However, semiautomatic segmentation is faster than a manual approach, which is relevant from a clinical perspective. Furthermore, semi-automatic segmentation is not influenced by intra-operator reliability [17], which is also important for clinical and research purposes.
The accuracy of CBCT-derived 3D segmented models can be affected by several variables such as voxel size, field of view, patient position, artifacts, and the beam inhomogeneity of CBCT scanners [3]. Additionally, the characteristics of the software used for segmentation can affect the rendering of specific craniofacial structures. In this respect, the reliability and accuracy of software for the semi-automatic segmentation of the respiratory region has been recently validated [19,20,21,22], while further studies are needed on this topic for the evaluation of the virtual anatomical segmentation of other specific CMF structures such as the mandible [22].
To date, the market has proposed a plethora of software for analyzing digital imaging communications in medicine (DICOM), most of them including semi-automatic segmentation tools. However, the creation of CBCT-based segmentation models is still not a common procedure in orthodontic/dental practice, since the software often presents low usability, requires higher electronic computer power and is licensed by its manufacturer, increasing the financial costs. Free-source DICOM viewers are also available online. Most of them include specific segmentation algorithms and were developed in a university setting or a small research group; as a consequence, clinicians might not be aware of such open-source options. However, no studies in the literature have assessed the accuracy of the semi-automatic segmentation method in detecting the volumetric and morphological characteristics of CMF structures—for example, the mandible—in comparison with manual segmentation, which represents the gold standard.
In this respect, the aim of the present study was to analyze the accuracy of three free-source and one licensed software in comparison with a manual segmentation approach for the semi-automatic segmentation of the mandible. For this purpose, we referred to a specific 3D digital diagnostic technology involving the surface-to-surface matching and deviation analysis [23,24] of 3D rendered mandibular models. The null hypothesis was the absence of significant differences in both the accuracy and usability of semi-automatic segmentation software compared to manual segmentation.

2. Materials and Methods

The present CBCT study followed the Helsinki Declaration on medical protocols and ethics and received a positive response by the Institutional Review Board of Indiana University–Purdue University (IRB protocol number: Pro00075765). The study sample was obtained from previously published materials [25], in order to avoid unnecessary or additional radiation exposure to the patients. Because this study was an archive study, ethics committee approval was not needed. The study group included 20 subjects (9 males and 11 females, mean age 23.58 ± 3.33 years) selected from a larger sample of patients who required surgically assisted rapid maxillary expansion treatment.
All images were acquired with the KODAK 9500 3D® (Carestream Health, Inc., Marne-la-Vallée, France, 90 kV, 10 mA, 0.2 mm voxel size) with the patient in maximum intercuspation and the Frankfort horizontal plane parallel to the floor [8]. The inclusion criteria were good quality CBCT scans, a field of view (FOV) including the whole mandibular bone, the absence of artifacts or image distortion, craniofacial deformities, signs or symptoms of temporomandibular disorder, third molar impaction and dental implants.
CBCT scans were preliminary imported into Dolphin 3D software (Dolphin Imaging, version 11.0, Chatsworth, CA, USA) to perform skull reorientation, according to a validated protocol [17,26]. Afterwards, the re-oriented CBCT scans were exported, and five CBCT viewer software programs were used to segment and generate a 3D rendering of the patients’ mandibular bone.
In particular, the Mimics software (version 21.0; Materialise, Leuven, Belgium) was used to perform a fully manual segmentation of the lower jaw, which served as the ground truth (gold standard) of the present investigation (Figure 1). The ground truth data for the lower jawbone boundaries were obtained by a manual slice-by-slice segmentation of the jaw data sets [27,28].
The semi-automatic segmentation of the mandible was carried out by using 4 software types, i.e., Dolphin3D (Dolphin Imaging, version 11.0, Chatsworth, CA, USA), Invesalius (version 3.0.0; Centro de Tecnologia da Informação Renato Archer, Campinas, SP, Brazil), ITK-Snap (version3.8.0; www.itksnap.org) and 3D Slicer (version 4.10.2; http://www.slicer.org). Segmentations were performed according to each software manufacturer’s recommendations and using an interactive threshold technique, which means that the operator selected the best threshold interval for visualizing the entirely of the anatomic boundaries of the mandible. Semi-automatic segmentation of the mandible was performed in this study by using the interactive threshold technique which means that operator selected the best threshold interval for visualizing the entirely of the anatomic boundaries of the mandible. Once the segmentation mask was obtained in each software, it was rendered into a 3D model and exported in STL ASCII electronic format. A detailed description of each software program is shown in Table 1.
In order to determinate the accuracy of the semi-automatic segmentation performed with each software, a surface deviation analysis was conducted by superimposing each obtained mandibular shell with the ground truth mandibular shell (obtained from manual segmentation). Briefly, the workflow of the 3D deviation analysis is described below.
Step 1—3D Model Superimposition and Final Registration
Each mandibular model obtained from tested software (semi-automatic segmentations) was superimposed to the ground truth mandibular model (manual segmentation). A preliminary registration was carried out by selecting the same 4 points on the surface of the 3D models (Figure 2): (1–2) the geometric center of the left and right metal foramina; (3–4) the left and right mandibular lingual at the inner surface of the ramus. Then, to enhance the quality of the superimposition, a surface-based registration was made by using the ‘Best fit alignment’ function. Using the ground truth mandibular model as the reference, the final superimposition was carried out by setting the precision to at least 0.01 mm.
Step 2—3D Models Definition (Exclusion of Teeth and Alveolar Process)
On the two superimposed models, an occlusal plane (OP) was constructed by selecting 3 points, respectively, the mesio-buccal cusp tip of the mandibular first molars and the interproximal point between the two mandibular central incisors. The OP was manually translated on the Y-axis (vertical axis) until it reached the apical position of the lowest dento-gingival junction. Finally, a distal plane passing through the tangent line to the distal wall of the second mandibular molars was created. These two cutting planes were constructed to exclude the teeth and the alveolar process from the tested mandibular shells (Figure 3).
Step 3—3D Deviation Analysis and Assessment of Volumetric Dimension
A surface-based deviation analysis was carried out using the specific function in the Geomagic Control X software (version 2017.0.0, 3D Systems, Santa Clara, CA, USA). The analysis was complemented by the visualization of the 3D color-coded maps set at two ranges of tolerance, respectively, 0.20 mm and 0.50 mm, to better evaluate and locate the discrepancy between the model surfaces (Figure 4). The maximum deviation calculation was set to 1.00 mm. After the deviation analysis, the percentages of all the distance values within the tolerance range were calculated. The software also allowed for the calculation of the total volume of the 3D models of the mandibular bone; these data were recorded on a spreadsheet and used for comparative analyses.
Step 4—Matching Percentage Calculation
Once the deviation analysis was carried out, the percentages (%) of all the distance values were calculated for the two tolerance groups. These values represented the degree of matching between the two models and, thus, show the accuracy of the mandibular models obtained with the tested software (semi-automatic segmentation).
The workflow, including segmentation and relative mask generation, was carried out by the same expert operator with 10 years of experience in digital orthodontics (A.L.G.). The images were re-measured 4 weeks after completing the first measurements, and separate spreadsheets were generated in order to blind the operator to the previous data. A flow chart of the entire process is reported in Figure 5.
Statistical Analysis
Differences in the volumetric dimension of the 3D rendered models obtained with each software were tested by using a one-way analysis of variance (ANOVA). The linear regression between the different software was also tested using the manual segmentation as the constant. One-way analysis of variance (ANOVA) was used to assess differences in the matching percentage between the 3D model obtained from manual segmentation (ground truth) and each model obtained from semi-automatic segmentation. Finally, intraclass correlation coefficient (ICC) values were used to check the reliability of the first and second measurements. Data were analyzed using SPSS® version 24 Statistics software (IBM Corporation, 1 New Orchard Road, Armonk, New York, NY, USA) with the significance level set at p < 0.05.

3. Results

The descriptive characteristics and intraclass correlation coefficients (ICC) for the 3D rendering of the mandible with different software are shown in Table 2. The ICC values ranged from 0.901 to 0.992, thus suggesting that the 3D rendering of the mandible was highly reliable for each software used in this study.
Small differences were found in the volumetric measurements of mandibular 3D models obtained with different software, ranging from 40.85 cm3 (Mimics) to 42.03 cm3 (Dolphin 3D); however, such differences were not statistically significant, as reported by the one-way analysis of variance (ANOVA) (Table 3).
Moreover, high correlations were found between volumetric measurements of the mandible obtained with semi-automatic segmentation (ITK-Snap, Invesalius, Dolphin 3D, Slicer 3D software) and those obtained with the manual segmentation approach (Mimics software), with R coefficients ranging from 0.960 to 0.992. (Table 4).
According to the one-way analysis of variance (ANOVA) and post-hoc comparison tests, statistically significant differences (p < 0.05) were found among the matching percentages (deviation analysis) recorded between the ground truth mandibular shell (manual segmentation) and each mandibular shell obtained from the semi-automatic approach (Table 5). In particular, the mandibular 3D models obtained with ITK-Snap showed the highest matching percentage (Tolerance A = 88.44%, Tolerance B = 97.30%) while those obtained with Dolphin 3D showed the lowest matching percentage (Tolerance A = 60.01%, Tolerance B = 87.76%) (p < 0.05). Similar matching percentages were obtained between Invesalius (Tolerance A = 81.79%, Tolerance B = 90.19%) and Slicer 3D (Tolerance A = 82.21%, Tolerance B = 90.57%) (p < 0.05).

4. Discussion

In the present study, we investigated the accuracy of the semi-automatic segmentation of the mandible from CBCT scans by comparing the 3D models obtained from different software with a ground truth mandibular model of the same patient obtained from manual segmentation. In this regard, in the absence of a real anatomic structure (dry mandible) or its realistic reproduction (laser scanning), manual segmentation still remains the gold standard for 3D rendering, since it allows for the detection of areas with low bone density or with no well-defined boundaries due to their low contrast and proximity to other structures [3].
In this study, semi-automatic segmentation was performed by using three types of free-source software, Invesalius, ITK-Snap and Slicer 3D, and one commercially licensed software, Dolphin 3D, while manual segmentation was performed by using Mimics software and set as the ground truth model.
The image scans included in the study were obtained from the same CBCT machine, with the same acquisition parameters. Thus, all factors affecting the accuracy of the 3D model rendering prior to the segmentation process were controlled and limited to the usage of different software [2,17,29].
Lastly, we decided to test the mandible for two reasons: (1) the semi-automatic segmentation of the maxilla is notably inaccurate due to variations in cortical bone thickness and the presence of an air-filled structure (sinus), producing bone dehiscence and fenestration artefacts in the 3D model [3,10,30,31]; (2) the 3D reconstruction of the lower jaw has a wider range of clinical applications, especially in orthodontics and maxillofacial fields [3,32,33,34,35,36,37,38].
According to the present findings, the volumetric renderings of the mandible obtained with ITK-Snap, Invesalius and Slicer 3D were notably closer to those obtained with manual segmentation (Mimics), with the 3D rendered model constructed with ITK-Snap and Mimics software being almost identical (mean difference = 0.04 cm3, data not shown). Conversely, Dolphin 3D software showed a slight overestimation of the mandibular rendered models with a volumetric difference of about 2 cm3 compared with manual segmentation as well as with the other semi-automatic software. However, these differences were not statistically significant. Moreover, all volumetric mandibular measurements obtained with semi-automatic programs showed a high correlation with the manual approach (Mimics), suggesting that all software behaved similarly in defining the mandibular bone contours.
However, volumetric data do not provide a qualitative evaluation of the accuracy of mandibular CBCT-derived models, i.e., precise information of the area of discordance between two surface models. Thus, the accuracy of semi-automatic segmentation was assessed by the superimposition of the 3D models obtained from each investigated software upon those acquired with manual segmentation (same patient). Afterwards, a deviation analysis was used to detect shape differences between the two CBCT-derived mandibular models as well as to obtain precise dimensional information, according to a consolidated methodology [19,20]. The semi-automatic segmentation performed with ITK-Snap, Invesalius, and Slicer 3D showed good accuracy, which is the matching percentage with manual segmentation over 90% (range of tolerance B). The color-coded map showed that the area of mismatch between the ground truth mandibular model (manual segmentation) and the other tested mandibular models (semi-automatic segmentation) was mainly located at the condyle level, with an underestimation of this anatomical region (shown in a turquoise to dark blue color). This is in agreement with previous findings suggesting that the condylar region is difficult to accurately segment due to the lower density of the bone, the overlapping bony structures and the difficulty in separating the condyle with the discus articularis [3,10,35,39,40,41].
The color-coded map showed an overestimation (in the yellow to red fields) of the Dolphin 3D software, which could be responsible for the higher volumetric measurements obtained with this software. Conversely, ITK-Snap, Invesalius, and Slicer 3D reported a slight underestimation (shown in a turquoise to dark blue color) in this area. Such different results could be explained by considering that the proximity of two different structures (roots and cortical bone) with a similar intense radio-opacity may have differently affected the iterative definition of the bony contour during segmentation. In this respect, the resolution of the CBCT scans [3,4] did not adequately allow for the full and accurate automatic distinction of the roots and cortical bone by the different tested software.
With all other variables being equal [2,3,17,21], the most significant factor potentially causing a difference in the measurements on the surface models is the accuracy of the algorithm of the threshold selection. In this respect, the semi-automatic segmentation of the mandible was performed in this study by using the interactive threshold technique, which means that the operator selected the best threshold interval for visualizing the entirety of the anatomic boundaries of the mandible. This process is dependent on the software algorithm, the spatial and contrast resolution of the scan, the thickness and degree of calcification or cortication of the bony structure, and, most importantly, the technical skill of the operator [13]. In this respect, semi-automatic segmentation still relies on the operator’s visual discrimination of the bony structure, with human vision being influenced by lighting conditions, visual acuity fatigue, and grayscale ability [29,35,38,39,40,41,42,43,44]. This is why the segmentation process is still a very subjective method, even with the semi-automatic approach.
However, the tested software featured different semi-automatic segmentation algorithms. In particular, Dolphin 3D features a binary threshold-based volume where the operator uses specific tools to remove the anatomical structures outside the volume of interest; instead, ITK-Snap, Invesalius, and Slicer 3D software were tested using the region-growing algorithm, where the user selects an expanding seed point for the 3D rendering, based on the threshold set. The differences in the interactive rules of the operator may explain some slight differences found in this study, i.e., the overestimation of the rendered volumes with Dolphin 3D software and the underestimation of the rendered volumes with ITK-Snap, Invesalius, and Slicer 3D software. Further studies are required in order to elucidate this aspect.
The accuracy of the segmentation process influences the quality of 3D volumetric representation of craniofacial structures, which is important for the purposes of diagnosis, treatment planning and treatment outcome evaluation [8,16]. Moreover, in modern medicine, 3D printing allows for new, innovative applications such as the construction of patient-specific surgical models and affordable prostheses, as well as more sophisticated procedures, namely bioprinting, tissue engineering and organs 3D printing. In dentistry and maxillofacial fields, the 3D printing of the lower jaw is useful for pre-operative planning or the simulation of surgery involving the three main components of the mandible, i.e., the body, the ramus and the condyle. In this regard, if the digital segmentation of the mandible is not accurate, the physical model obtained with 3D printing will not reliably reproduce the anatomy of the mandible, generating discordance between the treatment plan and the clinical outcomes [45].
Recently, the application of artificial intelligence (AI), through its deep learning paradigm, has shown very promising results in the automated segmentation of anatomical structures from CT and CBCT. In particular, convolutional neural networks (CNNs) have led to a series of breakthroughs in CBCT segmentation [27,30,46,47,48,49,50,51,52], especially when compared to previous methods employing general hand-crafted features, thanks to them being able to learn task-specific features directly from data [49,50,51,52,53,54,55,56,57,58]. Artificial intelligence for craniomaxillofacial structure bone segmentation can overcome two of the primary limits of semi-automatic segmentation, i.e., the operator-dependent and time-consuming process, and future studies are needed for this new scenario.

5. Conclusions

According to the present findings, the semi-automatic segmentation of the mandible showed high reliability, as well as high correlation, with the ground truth model (manual segmentation). However, semi-automatic segmentation could cause a slight underestimation of the condylar region of the CBCT-derived 3D mandibular models. In this respect, caution should be taken when evaluating the morphological and dimensional characteristics of the condyles, due to systematic errors in selecting the proper values of the threshold for this complex anatomical region. Consequently, if an accurate definition of condylar boundaries is required, highly skilled clinicians can perform manual refinement. Otherwise, clinicians should refer to companies specialized in 3D imaging technology for this purpose.

Author Contributions

A.L.G. drafted the work and performed segmentations; V.R. performed statistical analysis; C.G. critically revised the manuscript for relevant contents; A.L. revised the manuscript; M.O.L. and S.M. contributed to the study design; G.I. conceptualization, methodology, supervision, writing—review and editing. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Scarfe, W.C.; Farman, A.G.; Sukovic, P. Clinical applications of cone-beam computed tomography in dental practise. J. Can. Dent. Assoc. 2006, 72, 75–80. [Google Scholar] [PubMed]
  2. Isola, G.; Matarese, M.; Ramaglia, L.; Cicciù, M.; Matarese, G. Evaluation of the efficacy of celecoxib and ibuprofen on postoperative pain, swelling, and mouth opening after surgical removal of impacted third molars: A randomized, controlled clinical trial. Int. J. Oral Maxillofac. Surg. 2019, 48, 1348–1354. [Google Scholar] [CrossRef] [PubMed]
  3. Engelbrecht, W.P.; Fourie, Z.; Damstra, J.; Gerrits, P.O.; Ren, Y. The influence of the segmentation process on 3D measurements from cone beam computed tomography-derived surface models. Clin. Oral Investig. 2013, 17, 1919–1927. [Google Scholar] [CrossRef] [PubMed]
  4. Nicolielo, L.F.P.; Van Dessel, J.; Shaheen, E.; Letelier, C.; Codari, M.; Politi, C.; Lambrichts, I.; Jacobs, R. Validation of a novel imaging approach using multi-slice CT and cone-beam CT to follow-up on condylar remodeling after bimaxillary surgery. Int. J. Oral Sci. 2017, 9, 139–144. [Google Scholar] [CrossRef] [Green Version]
  5. Xi, T.; Van Loon, B.; Fudalej, P.; Bergè, S.; Swennen, G.; Maal, T. Validation of a novel semi-automated method for three-dimensional surface rendering of condyles using cone beam computed tomography data. Int. J. Oral Maxillofac. Surg. 2013, 42, 1023–1029. [Google Scholar] [CrossRef]
  6. Cevidanes, L.H.; Hajati, A.K.; Paniagua, B.; Lim, P.F.; Walker, D.G.; Palconet, G.; Nackley, A.G.; Styner, M.; Ludlow, J.B.; Zhu, H.; et al. Quantification of condylar resorption in temporomandibular joint osteoarthritis. Oral Surg. Oral Med. Oral Pathol. Oral Radiol. Endod. 2010, 110, 110–117. [Google Scholar] [CrossRef] [Green Version]
  7. Goncalves, J.R.; Wolford, L.M.; Cassano, D.S.; da Porciuncola, G.; Paniagua, B.; Cevidanes, L.H. Temporomandibular joint condylar changes following maxillomandibular advancement and articular disc repositioning. J. Oral Maxillofac. Surg. 2013, 71, 1759.E1–1759.E15. [Google Scholar] [CrossRef] [Green Version]
  8. Almaqrami, B.S.; Alhammadi, M.S.; Cao, B. Three dimensional reliability analyses of currently used methods for assessment of sagittal jaw discrepancy. J. Clin. Exp. Dent. 2018, 10, e352–e360. [Google Scholar] [CrossRef]
  9. Pelo, S.; Correra, P.; Gasparini, G.; Marianetti, T.M.; Cervelli, D.; Grippaudo, C.; Boniello, R.; Azzuni, C.; Deli, R.; Moro, A. Three-dimensional analysis and treatment planning of hemimandibular hyperplasia. J. Craniofac. Surg. 2011, 22, 2227–2234. [Google Scholar] [CrossRef]
  10. Fourie, Z.; Damstra, J.; Schepers, R.H.; Gerrits, P.O.; Ren, Y. Segmentation process significantly influences the accuracy of 3D surface models derived from cone beam computed tomography. Eur. J. Radiol. 2012, 81, e524–e530. [Google Scholar] [CrossRef]
  11. Lagravere, M.O.; Hansen, L.; Harzer, W.; Major, P.W. Plane orientation for standardization in 3-dimensional cephalometric analysis with computerized tomography imaging. Am. J. Orthod. Dentofac. Orthop. 2006, 129, 601–604. [Google Scholar] [CrossRef] [PubMed]
  12. Leonardi, R.; Muraglie, S.; Lo Giudice, A.; Aboulazm, K.S.; Nucera, R. Evaluation of mandibular symmetry and morphology in adult patients with unilateral posterior crossbite: A CBCT study using a surface-to-surface matching technique. Eur. J. Orthod. 2020. [Google Scholar] [CrossRef]
  13. Fischer, B.; Masucci, C.; Ruellas, A.; Cevidanes, L.; Giuntini, V.; Nieri, M.; Nardi, C.; Franchi, L.; McNamara, J.A., Jr.; Defraia, E. Three-dimensional evaluation of the maxillary effects of two orthopaedic protocols for the treatment of Class III malocclusion: A prospective study. Orthod. Craniofac. Res. 2018, 21, 248–257. [Google Scholar] [CrossRef] [PubMed]
  14. Spampinato, C.; Pino, C.; Giordano, D.; Leonardi, R. Automatic 3D segmentation of mandible for assessment of facial asymmetry. In Proceedings of the IEEE International Symposium on Medical Measurements and Applications Proceedings (MeMeA), Budapest, Hungary, 18–19 May 2012; pp. 1–4. [Google Scholar]
  15. Xia, J.J.; Gateno, J.; Teichgraeber, J.F. A new clinical protocol to evaluate cranio-maxillofacial deformity and to plan surgical correction. J. Oral Maxillofac. Surg. 2009, 67, 2093–2106. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Muraglie, S.; Leonardi, R.; Aboulazm, K.; Stumpo, C.; Loreto, C.; Grippaudo, C. Evaluation of structural skeletal asymmetry of the glenoid fossa in adult patients with unilateral posterior crossbite using surface-to-surface matching on CBCT images. Angle Orthod. 2020. [Google Scholar] [CrossRef] [Green Version]
  17. Fastuca, R.; Lorusso, P.; Lagravère, M.O.; Michelotti, A.; Portelli, M.; Zecca, P.; D’Antò, V.; Militi, A.; Nucera, R.; Caprioglio, A. Digital evaluation of nasal changes induced by rapid maxillary expansion with different anchorage and appliance design. BMC Oral Health 2017, 17, 113. [Google Scholar] [CrossRef] [Green Version]
  18. Chen, X.; Xu, L.; Yang, Y.; Egger, J. A semi-automatic computer-aided method for surgical template design. Sci. Rep. 2016, 6, 20280. [Google Scholar] [CrossRef] [Green Version]
  19. Guijarro-Martinez, R.; Swennen, G.R.J. Cone-beam computerized to-mography imaging and analysis of the upper airway: A systematicreview of the literature. Int. J. Oral Maxillofac. Surg. 2011, 40, 1227–1237. [Google Scholar] [CrossRef]
  20. Vikram Singh, A.; Hasan Dad Ansari, M.; Wang, S.; Laux, P.; Luch, A.; Kumar, A.; Patil, R.; Nussberger, S. The Adoption of Three-Dimensional Additive Manufacturing from Biomedical Material Design to 3D Organ Printing. Appl. Sci. 2019, 9, 811. [Google Scholar] [CrossRef] [Green Version]
  21. Schendel, S.A.; Hatcher, D. Automated 3-dimensional airway analysis from cone-beam computed tomography data. J. Oral Maxillofac. Surg. 2010, 68, 696–701. [Google Scholar] [CrossRef]
  22. El, H.; Palomo, J.M. Measuring the airway in 3 dimensions: A reliabil-ity and accuracy study. Am. J. Orthod. Dentofac. Orthop. 2010, 137, S50.E1–S50.E9. [Google Scholar] [CrossRef]
  23. Leonardi, R.; Lo Giudice, A.; Rugeri, M.; Muraglie, S.; Cordasco, G.; Barbato, E. Three-dimensional evaluation on digital casts of maxillary palatal size and morphology in patients with functional posterior crossbite. Eur. J. Orthod. 2018, 40, 556–562. [Google Scholar] [CrossRef] [PubMed]
  24. Leonardi, R.; Muraglie, S.; Bennici, O.; Cavallini, C.; Spampinato, C. Three-dimensional analysis of mandibular functional units in adult patients with unilateral posterior crossbite: A cone beam study with the use of mirroring and surface-to-surface matching techniques. Angle Orthod. 2019, 89, 590–596. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Kavand, G.; Lagravere, M.; Kula, K.; Stewart, K.; Ghoneima, A. Retrospective CBCT analysis of airway volume changes after bone-borne vs tooth-borne rapid maxillary expansion. Angle Orthod. 2019, 89, 566–574. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Leonardi, R. Cone-beam computed tomography and three-dimensional orthodontics. Where we are and future perspectives. J. Orthod. 2019, 46, 45–48. [Google Scholar] [CrossRef]
  27. Lo Giudice, A.; Nucera, R.; Ronsivalle, V.; Di Grazia, C.; Rugeri, M.; Quinzi, V. Enhance the diagnosis of maxillary transverse discrepancy through 3-D technology and surface to surface superimposition. A description of the digital work flow with documented case report. Eur. J. Paediatr. Dent. 2020, in press. [Google Scholar]
  28. Lo Giudice, A.; Fastuca, R.; Portelli, M.; Militi, A.; Bellocchio, M.; Spinuzza, P.; Briguglio, F.; Caprioglio, A.; Nucera, R. Effects of rapid vs slow maxillary expansion on nasal cavity dimensions in growing subjects: A methodological and reproducibility study. Eur. J. Paediatr. Dent. 2017, 18, 299–304. [Google Scholar]
  29. Liang, X.; Lambrichts, I.; Sun, Y.; Denis, K.; Hassan, B.; Li, L.; Pauwels, R.; Jacobs, R. A comparative evaluation of cone beam computed tomography (CBCT) and Multi-Slice CT (MSCT). Part II: On 3D model accuracy. Eur. J. Radiol. 2010, 75, 270–274. [Google Scholar] [CrossRef]
  30. Halazonetis, D.J. From 2-dimensional cephalograms to 3- dimensional computed tomography scans. Am. J. Orthod. Dentofac. Orthop. 2005, 127, 627–637. [Google Scholar] [CrossRef]
  31. Isola, G.; Anastasi, G.P.; Matarese, G.; Williams, R.C.; Cutroneo, G.; Bracco, P.; Piancino, M.G. Functional and molecular outcomes of the human masticatory muscles. Oral Dis. 2018, 24, 1428–1441. [Google Scholar] [CrossRef]
  32. Nucera, R.; Lo Giudice, A.; Bellocchio, A.M.; Spinuzza, P.; Caprioglio, A.; Perillo, L.; Matarese, G.; Cordasco, G. Bone and cortical bone thickness of mandibular buccal shelf for mini-screw insertion in adults. Angle Orthod. 2017, 87, 745–751. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Primožic, J.; Baccetti, T.; Franchi, L.; Richmond, S.; Farčnik, F.; Ovsenik, M. Three-dimensional assessment of palatal change in a controlled study of unilateral posterior crossbite correction in the primary dentition. Eur. J. Orthod. 2013, 35, 199–204. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Isola, G.; Perillo, L.; Migliorati, M.; Matarese, M.; Dalessandri, D.; Grassia, V.; Alibrandi, A.; Matarese, G. The impact of temporomandibular joint arthritis on functional disability and global health in patients with juvenile idiopathic arthritis. Eur. J. Orthod. 2019, 41, 117–124. [Google Scholar] [CrossRef] [PubMed]
  35. Isola, G.; Alibrandi, A.; Rapisarda, E.; Matarese, G.; Williams, R.C.; Leonardi, R. Association of vitamin d in patients with periodontal and cardiovascular disease: A cross-sectional study. J. Periodontal Res. 2020, 16. [Google Scholar] [CrossRef]
  36. Guerrero, M.E.; Jacobs, R.; Loubele, M.; Schutyser, F.; Suetens, P.; van Steenberghe, D. State-of-the-art on cone beam CT imaging for preoperative planning of implant placement. Clin. Oral Investig. 2006, 10, 1–7. [Google Scholar] [CrossRef]
  37. Piancino, M.G.; Isola, G.; Cannavale, R.; Cutroneo, G.; Vermiglio, G.; Bracco, P.; Anastasi, G.P. From periodontal mechanoreceptors to chewing motor control: A systematic review. Arch. Oral Biol. 2017, 78, 109–121. [Google Scholar] [CrossRef]
  38. Lo Giudice, A.; Ortensi, L.; Farronato, M.; Lucchese, A.; Lo Castro, E.; Isola, G. The step further smile virtual planning: Milled versus prototyped mock-ups for the evaluation of the designed smile characteristics. BMC Oral Health 2020, 20, 165. [Google Scholar] [CrossRef]
  39. Lo Giudice, A.; Rustico, L.; Caprioglio, A.; Migliorati, M.; Nucera, R. Evaluation of condylar cortical bone thickness in patient groups with different vertical facial dimensions using cone-beam computed tomography. Odontology 2020. [Google Scholar] [CrossRef]
  40. Isola, G.; Polizzi, A.; Alibrandi, A.; Indelicato, F.; Ferlito, S. Analysis of Endothelin-1 concentrations in individuals with periodontitis. Sci. Rep. 2020, 10, 1652. [Google Scholar] [CrossRef]
  41. Lo Giudice, A.; Brewer, I.; Leonardi, R.; Roberts, N.; Bagnato, G. Pain threshold and temporomandibular function in systemic sclerosis: Comparison with psoriatic arthritis. Clin. Rheumatol. 2018, 37, 1861–1867. [Google Scholar] [CrossRef]
  42. Isola, G.; Polizzi, A.; Santonocito, S.; Alibrandi, A.; Ferlito, S. Expression of Salivary And Serum Malondialdehyde And Lipid Profile Of Patients With Periodontitis And Coronary Heart Disease. Int. J. Mol. Sci. 2019, 20, 6061. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Lo Giudice, A.; Caccianiga, G.; Crimi, S.; Cavallini, C.; Leonardi, R. Frequency and type of ponticulus posticus in a longitudinal sample of nonorthodontically treated patients: Relationship with gender, age, skeletal maturity, and skeletal malocclusion. Oral Surg. Oral Med. Oral Pathol. Oral Radiol. 2018, 126, 291–297. [Google Scholar] [CrossRef]
  44. Loreto, C.; Filetti, V.; Almeida, L.E.; La Rosa, G.R.M.; Leonardi, R.; Grippaudo, C.; Lo Giudice, A. MMP-7 and MMP-9 are overexpressed in the synovial tissue from severe temporomandibular joint dysfunction. Eur. J. Histochem. 2020, 16, 64. [Google Scholar]
  45. Nucera, R.; Lo Giudice, A.; Bellocchio, M.; Spinuzza, P.; Caprioglio, A.; Cordasco, G. Diagnostic concordance between skeletal cephalometrics, radiograph-based soft-tissue cephalometrics, and photograph-based soft-tissue cephalometrics. Eur. J. Orthod. 2017, 39, 352–357. [Google Scholar] [CrossRef]
  46. Isola, G.; Alibrandi, A.; Currò, M.; Matarese, M.; Ricca, S.; Matarese, G.; Ientile, R.; Kocher, T. Evaluation of salivary and serum ADMA levels in patients with periodontal and cardiovascular disease as subclinical marker of cardiovascular risk. J. Periodontol. 2020, 7. [Google Scholar] [CrossRef] [PubMed]
  47. Pelo, S.; Saponaro, G.; Patini, R.; Staderini, E.; Giordano, A.; Gasparini, G.; Garagiola, U.; Azzuni, C.; Cordaro, M.; Foresta, E.; et al. Risks in surgery-first orthognathic approach: Complications of segmental osteotomies of the jaws. A systematic review. Eur. Rev. Med. Pharm. Sci. 2017, 21, 4–12. [Google Scholar]
  48. Patini, R.; Staderini, E.; Gallenzi, P. Multidisciplinary surgical management of Cowden syndrome: Report of a case. J. Clin. Exp. Dent. 2016, 18, 472–474. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  49. Isola, G.; Matarese, G.; Ramaglia, L.; Pedullà, E.; Rapisarda, E.; Iorio-Siciliano, V. Association between periodontitis and glycosylated haemoglobin before diabetes onset: A cross-sectional study. Clin. Oral Investig. 2019. [Google Scholar] [CrossRef]
  50. Pippi, R.; Santoro, M.; Patini, R. The central odontogenic fibroma: How difficult can be making a preliminary diagnosis. J. Clin. Exp. Dent. 2016, 8, e223–e225. [Google Scholar] [CrossRef] [PubMed]
  51. Isola, G.; Polizzi, A.; Iorio-Siciliano, V.; Alibrandi, A.; Ramaglia, L.; Leonardi, R. Effectiveness of a Nutraceutical Agent in the Non-Surgical Periodontal Therapy: A Randomized, Controlled Clinical Trial. Clin. Oral Investig. 2020. [Google Scholar] [CrossRef]
  52. Raucci, G.; Elyasi, M.; Pachêco-Pereira, C.; Grassia, V.; d’Apuzzo, F.; Flores-Mir, C.; Perillo, L. Predictors of long-term stability of maxillary dental arch dimensions in patients treated with a transpalatal arch followed by fixed appliances. Prog. Orthod. 2015, 16, 2. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  53. Isola, G.; Lo Giudice, A.; Polizzi, A.; Alibrandi, A.; Patini, R.; Ferlito, S. Periodontitis and Tooth Loss Have Negative Systemic Impact on Circulating Progenitor Cell Levels: A Clinical Study. Genes 2019, 10, 1022. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  54. Grassia, V.; Lombardi, A.; Kawasaki, H.; Ferri, C.; Perillo, L.; Mosca, L.; Delle Cave, D.; Nucci, L.; Porcelli, M.; Caraglia, M. Salivary microRNAs as new molecular markers in cleft lip and palate: A new frontier in molecular medicine. Oncotarget 2018, 9, 18929–18938. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Isola, G.; Alibrandi, A.; Pedullà, E.; Grassia, V.; Ferlito, S.; Perillo, L.; Rapisarda, E. Analysis of the effectiveness of Lornoxicam and Flurbiprofen on management of pain and sequelae following third molar surgery: A randomized, controlled, clinical trial. J. Clin. Med. 2019, 8, 325. [Google Scholar] [CrossRef] [Green Version]
  56. Minnema, J.; van Eijnatten, M.; Kouw, W.; Diblen, F.; Mendrik, A.; Wolff, J. CT image segmentation of bone for medical additive manufacturing using a convolutional neural network. Comput. Biol. Med. 2018, 103, 130–139. [Google Scholar] [CrossRef] [Green Version]
  57. Isola, G.; Polizzi, A.; Muraglie, S.; Leonardi, R.M.; Lo Giudice, A. Assessment Of vitamin C And Antioxidants Profiles In Saliva And Serum In Patients With Periodontitis And Ischemic Heart Disease. Nutrients 2019, 11, 2956. [Google Scholar] [CrossRef] [Green Version]
  58. Zhu, Y.; Wei, R.; Gao, G.; Ding, L.; Zhang, X.; Wang, X.; Zhang, J. Fully automatic segmentation on prostate MR images based on cascaded fully convolution network. J. Magn. Reson. Imaging 2019, 49, 1149–1156. [Google Scholar] [CrossRef]
Figure 1. Manual segmentation of mandibular jaw (ground truth); (a), coronal view; (b), axial view; (c), sagittal view; (d), 3D rendered mandible model.
Figure 1. Manual segmentation of mandibular jaw (ground truth); (a), coronal view; (b), axial view; (c), sagittal view; (d), 3D rendered mandible model.
Materials 13 02798 g001
Figure 2. Landmarking four points on 3D mandibular model superimposition: 1–2, the geometric center of the left and right metal foramina; 3–4, left and right mandibular lingual at the inner surface of ramus.
Figure 2. Landmarking four points on 3D mandibular model superimposition: 1–2, the geometric center of the left and right metal foramina; 3–4, left and right mandibular lingual at the inner surface of ramus.
Materials 13 02798 g002
Figure 3. Each 3D mandibular model obtained from semi-automatic segmentation was superimposed to its ground truth model (manual segmentation) in order to reliably remove alveolar processes and teeth. (A), occlusal plane (OP) constructed by selecting three points, respectively, the mesio-buccal cusp tip of the mandibular first molars and the interproximal point between the two mandibular central incisors; (B,C), the OP was manually translated on the Y-axis (vertical axis) until it reached the apical position of the lowest dento-gingival junction; (D), sagittal view of the defined horizontal cutting plane; (E), construction of a distal cutting plane passing through the tangent line to distal wall of the second mandibular molars; (F), removal of the alveolar process according to the two defined cutting planes.
Figure 3. Each 3D mandibular model obtained from semi-automatic segmentation was superimposed to its ground truth model (manual segmentation) in order to reliably remove alveolar processes and teeth. (A), occlusal plane (OP) constructed by selecting three points, respectively, the mesio-buccal cusp tip of the mandibular first molars and the interproximal point between the two mandibular central incisors; (B,C), the OP was manually translated on the Y-axis (vertical axis) until it reached the apical position of the lowest dento-gingival junction; (D), sagittal view of the defined horizontal cutting plane; (E), construction of a distal cutting plane passing through the tangent line to distal wall of the second mandibular molars; (F), removal of the alveolar process according to the two defined cutting planes.
Materials 13 02798 g003
Figure 4. Surface-based deviation analysis between 3D mandibular models obtained with semi-automatic segmentation and its ground truth model (manual segmentation). (A) ITK-Snap; (B) Invesalius; (C) Dolphin 3D; (D) Slicer 3D. The green of the color scale bar, on the right, represents the range of tolerance. Left side—color map set to a range of tolerance of ±0.2 mm. Right side—color map set to a range of tolerance of ±0.5 mm.
Figure 4. Surface-based deviation analysis between 3D mandibular models obtained with semi-automatic segmentation and its ground truth model (manual segmentation). (A) ITK-Snap; (B) Invesalius; (C) Dolphin 3D; (D) Slicer 3D. The green of the color scale bar, on the right, represents the range of tolerance. Left side—color map set to a range of tolerance of ±0.2 mm. Right side—color map set to a range of tolerance of ±0.5 mm.
Materials 13 02798 g004
Figure 5. Flow chart of the entire process involved in this study.
Figure 5. Flow chart of the entire process involved in this study.
Materials 13 02798 g005
Table 1. Descriptive analysis and general information of the software tested in the present study.
Table 1. Descriptive analysis and general information of the software tested in the present study.
NameVersionDeveloperCountryOperating SystemTypeSegmentation Options
Mimics21.0MaterialiseBelgiumWindowsPay per useManual and semi-automatic
ITK-Snap3.8.0University of Pennsylvania and UtahUSAWindows, Mac OS X, LinuxOpen-sourceManual and semi-automatic
Invesalius3.0.0Information Tecnology Center Renato ArcherBrasilWindows, Mac OS X, LinuxOpen-sourceSemi-automatic
Dolphi3D11.0Patterson Dental SupplyUSAWindowsPay per useSemi-automatic
Slicer 3D4.10.2Harvard UniversityUnited KingdomWindows, Mac OS X, LinuxOpen-sourceManual and semi-automatic
Table 2. Descriptive statistics of intraoperator means and standard deviations (SD) of volumetric measurements of the mandible for each program. Intraclass correlation coefficient (ICC).
Table 2. Descriptive statistics of intraoperator means and standard deviations (SD) of volumetric measurements of the mandible for each program. Intraclass correlation coefficient (ICC).
EXAMINATIONSMimicsITK-SnapInvesaliusDolphin 3DSlicer 3D
MeanSDMeanSDMeanSDMeanSDMeanSD
Measurement 140.854.1640.814.1440.043.9142.034.0740.584.10
Measurement 240.634.3540.434.3440.044.0942.024.9341.084.79
ICC0.9920.9920.9830.9380.901
Table 3. Comparison among the volumetric measurements of the mandibular models obtained with all the tested software. p-value based on one-way ANOVA. Standard deviation (SD); Fisher value (F).
Table 3. Comparison among the volumetric measurements of the mandibular models obtained with all the tested software. p-value based on one-way ANOVA. Standard deviation (SD); Fisher value (F).
SOFTWARESampleMean (cm3)SDConfidential IntervalFSignificance
Lower LimitUpper Limit
Mimics2040.854.1638.9042.800.634NS
ITK-Snap2040.814.1438.8642.74
Invesalius2040.043.9138.2141.87
Dolphin 3D2042.034.0740.1243.93
Slicer 3D2040.584.1038.6642.50
Total10040.714.0239.9141.50--
Table 4. Comparison of segmentation programs with linear regression analysis, using manual segmentation (Mimics) as indipendent variable and semi-automatic segmentation (other software) as dependent variables.
Table 4. Comparison of segmentation programs with linear regression analysis, using manual segmentation (Mimics) as indipendent variable and semi-automatic segmentation (other software) as dependent variables.
Dependent
Variables
Predictor
Variables
RR SquaredSignificance95% Interval Coefficient (B)
Lower Limit Upper Limit
ITK-SnapManual
Segmentation
0.9920.983p < 0.0010.9241.052
Invesalius0.9600.922p < 0.0010.7721.033
Dolphin 3D0.9890.978p < 0.0010.8941.039
Slicer 3D0.9680.937p < 0.0010.8311.077
Table 5. Comparison among the matching percentage between the mandibular models obtained with different semi-automatic segmentation software and the ground truth mandibular model (manual segmentation), according to the deviation analysis. p-value based on one-way ANOVA.
Table 5. Comparison among the matching percentage between the mandibular models obtained with different semi-automatic segmentation software and the ground truth mandibular model (manual segmentation), according to the deviation analysis. p-value based on one-way ANOVA.
ToleranceSoftware SampleMeanSDConfidential IntervalFSignificance
Lower LimitUpper Limit
Tolerance AITK-Snap a2088.44 b,c,d1.7087.6589.23405.80p < 0.005
Invesalius b2081.79 a,c3.1080.3583.25
Dolphin 3D c2060.01 a,b,d3.1058.5761.47
Slicer 3D d2082.21 a,c2.9080.8683.57
Total8078.1211.1875.6380.60--
Tolerance BITK-Snap a2097.30 b,c,d1.4296.6397.9760.64p < 0.005
Invesalius b2090.19 a,c3.2788.6691.73
Dolphin 3D c2087.76 a,b,d2.5086.6088.93
Slicer 3D d2090.57 a,c1.7689.7591.40
Total8091.464.2490.5192.40--
a-b-c-d = symbols according to the Scheffè test for post-hoc multiple comparison. SD = Standard deviation. A = range of tolerance set at 0.2 mm; B = range of tolerance set at 0.5 mm.

Share and Cite

MDPI and ACS Style

Lo Giudice, A.; Ronsivalle, V.; Grippaudo, C.; Lucchese, A.; Muraglie, S.; Lagravère, M.O.; Isola, G. One Step before 3D Printing—Evaluation of Imaging Software Accuracy for 3-Dimensional Analysis of the Mandible: A Comparative Study Using a Surface-to-Surface Matching Technique. Materials 2020, 13, 2798. https://doi.org/10.3390/ma13122798

AMA Style

Lo Giudice A, Ronsivalle V, Grippaudo C, Lucchese A, Muraglie S, Lagravère MO, Isola G. One Step before 3D Printing—Evaluation of Imaging Software Accuracy for 3-Dimensional Analysis of the Mandible: A Comparative Study Using a Surface-to-Surface Matching Technique. Materials. 2020; 13(12):2798. https://doi.org/10.3390/ma13122798

Chicago/Turabian Style

Lo Giudice, Antonino, Vincenzo Ronsivalle, Cristina Grippaudo, Alessandra Lucchese, Simone Muraglie, Manuel O. Lagravère, and Gaetano Isola. 2020. "One Step before 3D Printing—Evaluation of Imaging Software Accuracy for 3-Dimensional Analysis of the Mandible: A Comparative Study Using a Surface-to-Surface Matching Technique" Materials 13, no. 12: 2798. https://doi.org/10.3390/ma13122798

APA Style

Lo Giudice, A., Ronsivalle, V., Grippaudo, C., Lucchese, A., Muraglie, S., Lagravère, M. O., & Isola, G. (2020). One Step before 3D Printing—Evaluation of Imaging Software Accuracy for 3-Dimensional Analysis of the Mandible: A Comparative Study Using a Surface-to-Surface Matching Technique. Materials, 13(12), 2798. https://doi.org/10.3390/ma13122798

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop