Next Article in Journal
Exploring the Structural, Electronic, Magnetic, and Transport Properties of 2D Cr, Fe, and Zr Monoborides
Next Article in Special Issue
Optimized Erbium-Doped Yttrium Aluminum Garnet (Er:YAG) Laser Parameters for the Removal of Dental Ceramic Restorations
Previous Article in Journal
Enhanced Thermal Pad Composites Using Densely Aligned MgO Nanowires
Previous Article in Special Issue
The Application of a Fluoride-and-Vitamin D Solution to Deciduous Teeth Promotes Formation of Persistent Mineral Crystals: A Morphological Ex-Vivo Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Influence of Various Adhesive Systems and Polishing Methods on Enamel Surface Roughness after Debonding of Orthodontic Brackets: A Three-Dimensional In Vitro Evaluation

1
Institute of Dental Medicine, First Faculty of Medicine of the Charles University and General University Hospital in Prague, Kateřinská 32, 121 11 Prague, Czech Republic
2
Department of Orthodontics, Faculty of Medicine and Dentistry, Palacký University Olomouc, Palackého 700/12, 779 00 Olomouc, Czech Republic
*
Author to whom correspondence should be addressed.
Materials 2023, 16(14), 5107; https://doi.org/10.3390/ma16145107
Submission received: 28 May 2023 / Revised: 14 July 2023 / Accepted: 18 July 2023 / Published: 20 July 2023
(This article belongs to the Special Issue Materials and Techniques in Dentistry, Oral Surgery and Orthodontics)

Abstract

:
A slight alteration of the enamel surface is inevitable upon debonding of orthodontic brackets, adhesive removal, and finishing/polishing. The aim of this in vitro study was to compare two adhesives and three polishing methods by measuring enamel surface roughness using confocal laser scanning microscopy (CLSM). Brackets were bonded on 42 extracted human premolars using Transbond XT (Transbond group) or Fuji Ortho (Fuji group). After debracketing, adhesives were removed with a tungsten carbide bur, and surfaces were polished using Sof-Lex discs, a rotary brush with a prophylactic paste (Depural), or a prophylactic cup with two polishing pastes (n = 7 in each subgroup). Surface roughness (Sa, Sku, Sq, and Sz) was measured using CLSM and compared before treatment (T1), after debracketing and adhesive removal (T2), and after polishing (T3). The data were statistically analyzed using the Mann–Whitney U and Kruskal–Wallis tests with Bonferroni correction. The time required for adhesive removal was measured and compared using a two-sample t-test. Surface roughness at T2 increased compared to T1, but the difference was significant only for the Fuji group (p < 0.01). The time required to remove Transbond XT (94.1 ± 6.8 s) was significantly higher compared to Fuji (72.1 ± 5.9 s, p < 0.0001). Polishing with Sof-Lex discs resulted in lower surface roughness compared to T1 (p = 0.018). Using Depural and polishing pastes showed no significant difference in surface roughness compared to T1, except for a significant decrease in Sa and Sq for Transbond (p = 0.043) and in Sku for Fuji (p = 0.018) after polishing with Depural. In conclusion, the removal of Transbond took significantly longer, but there were fewer residues of composite resin on the enamel surface. Sof-Lex discs decreased enamel roughness, whereas enamel morphology and roughness were similar to the pre-treatment state after polishing with polishing pastes.

1. Introduction

To date, there is no proven method of restoring the enamel surface to its pre-treatment state after debracketing, adhesive removal, and enamel finishing/polishing. Regardless of which combination of methods is selected, enamel loss [1,2,3], change in surface roughness [4,5,6], and/or formation of cracks is inevitable [7]. Although the alteration is usually not severe [8], the damaged enamel may be more susceptible to decalcification because the superficial layer of aprismatic enamel is harder and richer in fluoride than deeper layers [9]. In addition, increased surface roughness promotes the adhesion of bacteria, which can lead to caries [10]. Therefore, it is necessary to minimize enamel damage, but at the same time, the residual adhesive should not be left on the enamel surface because that would also increase surface roughness and plaque accumulation [2,11].
The extent of enamel damage depends on the type of bur used for adhesive removal [12,13], its speed [14,15], the number of blades [16,17], or the material [5,18]. Clinically, tungsten carbide burs are commonly used [19], and they are also considered the gold standard in studies investigating enamel roughness after debonding of orthodontic brackets [4]. In contrast, the finishing and polishing of enamel is not standardized, and a wide range of tools are available. Combinations of fine rotary instruments (finishing burs, brushes, discs, polishing cups, etc.) with prophylactic or polishing pastes are often used [20,21]. For more effective polishing, a sequence of such instruments with decreasing roughness may be selected [4,5,22].
The alteration of the enamel surface may also be influenced by the adhesive used, as different adhesive types vary in adhesion mechanisms and mechanical properties. However, only a few studies examined how orthodontic adhesives affect the enamel surface [2,3,23] and the time required for their removal [24,25]. Resin composites have no chemical bond to the enamel, and their adhesion relies on micromechanical bonding ensured by acid etching and enamel adhesives [23]. Provided that no contamination of the etched surface with water or saliva occurs [26], the bond strength of enamel adhesives exceeds that of other orthodontic adhesives. Resin-modified glass ionomer cement is also commonly used because of its tolerance to humidity [27] and anti-cariogenic properties due to the release of fluoride ions. However, the chemical adhesion of glass ionomers to enamel is weak, so they are often applied in conjunction with conditioners that are able to clean and gently etch the enamel surface [28]. Without conditioning, the bond strength may be insufficient to ensure reliable adhesion of the bracket [28]. Other groups of materials, such as compomers, are used less frequently [29].
The aim of this in vitro study was to compare well-established resin composite and glass ionomer adhesives in terms of the time required for removal and the effect on enamel surface roughness after debracketing, adhesive removal, and polishing. Three widely used polishing methods were compared. The null hypotheses tested were (1) that the adhesive would affect neither the time required for removal nor enamel roughness and (2) that enamel roughness would not be affected by the polishing methods.

2. Materials and Methods

This in vitro study was performed with the approval of the local ethics committee (protocol number 153/21 S-IV) on 42 sound premolars extracted for orthodontic reasons in patients aged 10–16 years who underwent extraction therapy. The extracted teeth were collected with the written informed consent of the patients and their parents. After extraction, the premolars were debrided, stored in a 0.5% chloramine solution at 4–7 °C for 7 days, and then in water at 4–7 °C for a maximum of 3 months, following recommendations for the testing of adhesion of dental materials to dental tissues [30]. Only sound premolars were included in the experiment. The absence of caries, fillings, and cracks was visually assessed under a dental lamp without the use of magnification aids [18], with emphasis on the buccal (evaluated) surface. Prior to the evaluation, the surfaces were cleaned with a rotary brush, rinsed with water, and air-dried. For reliable identification of the premolars at different stages of the experiment, a number was engraved onto the root surface using a diamond bur and highlighted with a permanent marker.
Using the same technique, outlines of an area of approximately 4 × 4 mm were engraved and highlighted on the buccal surface of the premolars. This area (referred to as the orthodontic bonding area, OBA) was placed in the center of the buccal surface along the long axis of the tooth, i.e., in the area corresponding to the location of the orthodontic bracket positioning according to Mattick and Hobson [31]. Then, before bracket bonding (time T1), the roughness of the dried intact enamel surface was measured using a confocal laser scanning microscope (CLSM; S neox sensor, 3D Optical Profiler, Sensofar, Barcelona, Spain) placed on an anti-vibration pad, which enabled non-destructive three-dimensional evaluation [11,32,33]. A soft plastic material was used to position the evaluated surface as horizontally as possible. First, 2D images of OBA were taken at 100× and 1500× magnification using the CLSM for the qualitative evaluation of the surface. Then, a 3D map of the surface (113.34 × 94.58 µm) was recorded at five locations along the long axis of the tooth in the geometric center of each OBA at 1500× magnification. The 3D maps were used for the quantitative analysis of surface roughness using the specialized software SensoVIEW (version 1.7.0, Sensofar, Barcelona, Spain).
The specimens were then randomly divided into two equal groups using the sealed envelope method (n = 21), and a premolar bracket (Victory Series Brackets, 3M, St. Paul, MN, USA) was bonded in each OBA. Bonding was done according to the manufacturer’s instructions using two widely used adhesives [3,34]; either a light-cured resin composite (Transbond group) or a light-cured resin-modified glass ionomer cement (Fuji group), Table 1. In the Transbond group, the air-dried OBA was etched with a gel containing 35% phosphoric acid (Unitek Etching Gel, 3M, St. Paul, MN, USA) for 15 s, followed by rinsing with a water spray rinse for 15 s. After air-drying, an adhesive primer (Transbond XT Light Cure Orthodontic Adhesive Primer, 3M, St. Paul, MN, USA) was applied to OBA and light-cured with a polymerization lamp (Ortholux Luminous Curing Light, 3M, St. Paul, MN, USA) for 3 s at 1600 mW/cm2. A resin composite (Transbond XT Light Cure Adhesive Paste, 3M, St. Paul, MN, USA) was applied to the base of the bracket, which was then seated in OBA with moderate pressure. After removing the excess with a probe, the composite was light-cured for a total of 12 s (3 s from each side of the bracket). In the Fuji group, the air-dried OBA was conditioned with 10% polyacrylic acid (GC Ortho Conditioner, GC, Tokyo, Japan) for 20 s, followed by 20 s rinsing with water spray. OBA was gently air-dried, and a resin-modified glass ionomer cement (Fuji ORTHO LC Capsule, GC, Tokyo, Japan) was applied to the base of the bracket, which was then seated in OBA with moderate pressure. After removing the excess with a probe, the adhesive was light-cured for a total of 12 s (3 s from each side of the bracket). All specimens were incubated in water at 37 °C for 7 days [13,22,35] to ensure the proper setting of the adhesives and to simulate intraoral conditions.
Debracketing was performed with debonding pliers (Dentaurum Premium Line 004-349, Dentaurum, Ispringen, Germany) that were inserted under the occlusal and gingival wings of the bracket and pressed. This wing method was selected as it reduces the risk of enamel damage [20]. A tungsten carbide bur (123-604-30, Dentaurum, Ispringen, Germany) was used for adhesive removal at 20,000 rpm without water cooling [36], and the bur was replaced after removing the adhesive from 5 specimens. For each specimen, the time required to remove the adhesive (tT for Transbond, tF for Fuji) was measured with a digital stopwatch and rounded to seconds. Adhesive was considered removed when no residual material was visible on the tooth surface with the naked eye under a dental lamp [36]. Any debris was rinsed off using water spray for 10 s, and the air-dried surfaces were evaluated using CLSM (time T2) as described above. The tooth was positioned so that the assessed area corresponded in position and inclination to the previous measurement at time T1. This was verified using the 2D images at 100x magnification.
The Transbond and Fuji groups were then randomly divided into three equal subgroups (n = 7) according to the polishing method used. Sample size was estimated based on a previous study [34] and verified in our pilot study. In the Sof-Lex discs subgroup, teeth were polished using a sequence of fine and superfine polishing discs (Sof-Lex Extra Thin Fine and Superfine, 3M, St. Paul, MN, USA), each for 15 s at 20,000 rpm. Specimens from the Depural subgroup were polished for 20 s with a rotary brush (Hawe Miniature Tooth Cleaning and Polishing Brushes, Kerr, Orange, CA, USA) with a nepheline-containing prophylactic paste (Depural Neo, SpofaDental, Jičín, Czech Republic) at 3000 rpm. In the third subgroup (referred to as Polishing pastes), a prophylactic cup (Hawe Pro-Cup Hard—Dark Blue, Kerr, Orange, CA, USA) was used at 3000 rpm with two polishing pastes of descending abrasiveness; each applied for 10 s. The SuperPolish paste (Kerr, Orange, CA, USA) with Al2O3 particles was used first, followed by the CleanPolish paste (Kerr, Orange, CA, USA) with pumice powder. After rinsing and air-drying, all polished specimens were evaluated using CLSM (time T3) as described above.
The 3D maps (Figure 1) of the enamel surfaces recorded at T1, T2, and T3 were analyzed using the SensoVIEW software (version 1.7.0, Sensofar, Barcelona, Spain) in accordance with ISO 25178-2:2021 [37]. With S-filter and L-filter set to 0.8 µm and 0.05 mm, respectively, the parameters Sa, Sku, Sq, and Sz were calculated. All experiments and measurements were performed by the main investigator (TK). Figure 2 presents a flow chart summarizing the experimental procedures.

2.1. Measurement Error

To verify the repeatability of the measurements, 7 specimens were randomly selected at T1, and the measurements were repeated after 4 weeks. The measurement error was expressed using Dahlberg’s formula (D) and relative Dahlberg error (RDE). In addition, the agreement between the first and second measurements was verified by the intraclass correlation coefficient (ICC), and the presence of systematic error was tested using a paired t-test. The measurement is considered sufficiently accurate if ICC exceeds 0.75 and RDE is lower than 8% [38]. The results (Table 2) showed that these criteria were met for all parameters except Sku (ICC = 0.715 and RDE = 8.1%); however, the values were close to the desired criteria. The t-tests confirmed that the measurement errors were random.

2.2. Statistical Analysis

Medians of the five values of each parameter on each surface at each time point were calculated, as well as medians of differences in each parameter between time points (T2–T1 and T3–T1). Given the relatively small sample size in subgroups (n = 7) and the outcome of Shapiro–Wilk tests that revealed non-normal distribution in most parameters, the data were statistically analyzed using non-parametric methods. The Mann–Whitney U test was used to compare the adhesives (Transbond, Fuji), and the Kruskal–Wallis test with Bonferroni correction was used to compare the three polishing methods (Sof-Lex discs, Depural, and Polishing pastes). A comparison of surface roughness at different time points (T1, T2, T3) was performed using the Wilcoxon test. The data of time required to remove the adhesive (tT, tF) were normally distributed and therefore compared using a two-sample t-test. All analyses were performed using IBM SPSS Statistics for Windows (version 23.0. Armonk, IBM, NY, USA) and MedCalc (version 18.2, MedCalc Software, Ostend, Belgium) at a significance level of 0.05.

3. Results

Table 3 presents the comparison of surface roughness before treatment and its change after debracketing and adhesive removal. Measurements before the treatment (T1) showed no significant difference in any of the parameters between teeth allocated to each group (p > 0.3). After debracketing and adhesive removal with the tungsten carbide bur (T2), the values of Sa, Sq, and Sz increased, whereas Sku decreased slightly. In the Transbond group, the values at T2 were not statistically different from those measured at T1 (p > 0.05), as opposed to the Fuji group, where values were significantly different in all parameters (p < 0.01). As the trend of roughness change between T2 and T1 was similar for both adhesives, their values of ΔSa, ΔSku, ΔSq, and ΔSz did not differ significantly (p > 0.1). However, the time required to remove Transbond (tT = 94.1 ± 6.8 s) was significantly higher compared to Fuji (tF = 72.1 ± 5.9 s), p < 0.0001.
Surface roughness after polishing (T3) with Sof-Lex discs was significantly lower than at T1 (p = 0.018), and there was also a significant decrease from T1 after polishing with Depural in Sa and Sq for Transbond (p = 0.043) and in Sku for Fuji (p = 0.018). There was no significant difference from T1 in any of the parameters after using the polishing pastes with the prophylactic cup (p > 0.05). Table 4 summarizes changes in roughness (ΔSa, ΔSku, ΔSq, or ΔSz) between T3 and T1. Sof-Lex discs reduced roughness significantly more than the other polishing methods (p < 0.05), except for ΔSz values in the Transbond group polished with the polishing pastes (p = 0.143) and the Fuji group polished with Depural (p = 0.054). The change in surface roughness between T3 and T1 was similar for both adhesives when polished with Sof-Lex discs and Depural (p ≥ 0.18), but there was a significant difference between Transbond and Fuji in ΔSa, ΔSq, and ΔSz with the polishing pastes (p ≤ 0.025).
Figure 3 and Figure 4 present 2D images of representative enamel surfaces at each time point, i.e., before treatment (T1), after debracketing and adhesive removal with the tungsten carbide bur (T2), and after polishing using each of the tested methods (T3), for Transbond and Fuji, respectively. At T1, perikymata were clearly visible at 100× magnification, while the enamel microstructure with partial prism exposure was observed at 1500× magnification. At T2, the surface appeared scratched at 100× magnification, and residues of adhesives were found to overlie the enamel microstructure at 1500× magnification. After polishing with Sof-Lex discs, perikymata were absent, leading to a smooth and glossy appearance of the enamel surface at 100× magnification. At 1500× magnification, subtle concentric grooves corresponding to the rotation of the discs were revealed. Using Depural and the polishing pastes, perikymata were partially preserved, as shown at 100× magnification. At 1500× magnification, the enamel surface was relatively smooth, and prisms were not exposed.

4. Discussion

The aim of this study was to compare two types of orthodontic adhesives and three polishing methods in terms of their effect on enamel surface roughness. Prior to bonding (at T1), the assessment of sound enamel surfaces revealed both macroscopic and microscopic differences between individual teeth—some had more pronounced perikymata or more exposed prisms, some were smooth, and some contained subtle cracks. The quantitative analysis of the roughness parameters (Sa, Sku, Sq, and Sz) showed no significant difference between the teeth assigned to each group, but to prevent any influence of individual differences between teeth, the results at T2 and T3 were expressed as change in roughness parameters from baseline (T1).
The importance of this approach was evident in the results after debracketing and adhesive removal (T2). All roughness parameters in the Fuji group at T2 were significantly higher than at T1; however, the change in parameters between T2 and T1 (ΔSa, ΔSku, ΔSq, ΔSz) was statistically similar to the Transbond group where values at T2 were not significantly different from T1. The non-significant increase in Sa, Sq, and Sz and decrease in kurtosis (Sku) were explained by the 2D images—the enamel appeared lusterless. Perikymata could not be observed at 100× magnification, and parallel grooves formed by the tungsten carbide bur were visible at 1500× magnification. Comparison of results at T2 with other studies is not possible, as they do not evaluate surface roughness but rather the loss of enamel mass, which tends to be significantly higher when removing composites than glass ionomers [2,3].
In terms of time required for adhesive removal, it was found that removing Transbond resin composite takes significantly longer than the Fuji glass ionomer cement, which is in accordance with other studies [2,24]. On the other hand, David et al. [25] concluded that there was no significant difference in removal time between Transbond and Fuji with conditioning. Our results suggest that the time required for adhesive removal could be related to the difference in bond strength to enamel, which is higher for composites compared to glass ionomers [28,39]. This speculation is further supported by the fact that the use of a conditioner with glass ionomers was reported to increase not only the bond strength to enamel [28] but also the time required to remove the cement from the tooth surface [25].
The effect of adhesive type was also evaluated after polishing. There was no significant difference between both the groups after polishing with Sof-Lex discs and Depural, as opposed to the use of polishing pastes, which resulted in a significant difference between the adhesives in ΔSa, ΔSq, and ΔSz. While the polishing pastes reduced surface roughness in the Transbond group, an increase was observed for the Fuji group. This may be caused by the higher porosity of glass ionomers compared to resin composites [40]. While the surface of the tested resin composite could be polished to a high gloss, incomplete removal of the tested glass ionomer by the polishing pastes resulted in increased surface roughness, as best observed at 1500× magnification. Since the instructions for the use of the polishing pastes state that they are designed for polishing enamel, amalgam, gold, and composite restoration, it is possible that the contained abrasives are unable to effectively remove glass particles attached to the conditioned surface. A similar result was reported by Ferreira et al. [34]. In their study, the ability of a rubber cup with a pumice stone paste to polish enamel surfaces bonded with glass ionomers was lower compared to composites. To the best of our knowledge, other similar studies are not available.
The comparison of polishing procedures was based on the extent to which the final state (T3) corresponded to the pre-treatment values (T1). With Sof-Lex discs, there was a significant decrease in Sa, Sq, and Sz, while Sku increased significantly regardless of the adhesive used. The results were supported by the 2D images of the enamel—the surface was glossy, and a complete absence of perikymata was evident at 100× magnification. On the other hand, 1500× magnification revealed subtle parallel grooves corresponding to the rotation of the discs, and their presence explained the observed increase in kurtosis (Sku). Similar results were obtained in studies by Faria-Júnior et al. [41] and Cardoso et al. [21]—the enamel surfaces polished with Sof-Lex discs were smooth, and there was a significant decrease in Ra (2D roughness parameter analogous to Sa). On the contrary, Özer et al. [42] reported a significant increase in all measured parameters after polishing with Sof-Lex discs. The conclusion of the study by Eliades et al. [22] was that Sof-Lex discs did not have a consistent effect in terms of reducing surface roughness.
Polishing using the rotary brush with Depural decreased the values of all parameters, but the decrease was significant only in Sa and Sq in the Transbond group and in Sku in the Fuji group. In the 2D images, the enamel appeared naturally glossy with a hint of perikymata at 100× magnification. At 1500× magnification, the surface was relatively similar to the pre-treatment state, and enamel prisms were noticeable. This suggests that Depural applied with the rotary brush is a relatively gentle procedure that can partially restore the enamel surface. A relatively true restoration of the pre-treatment state was also achieved using the prophylactic cup with polishing pastes, as shown in the 2D images at 100× magnification. However, 1500× magnification revealed residues of the glass ionomer cement on the enamel surfaces, whereas prisms were observed in the Transbond group. Consequently, a non-significant decrease in all roughness parameters was measured in the Transbond group, while a non-significant increase was noted in the Fuji group compared to the baseline. Given the opposite trend for both adhesives, there was a significant difference between them in Sa, Sq, and Sz.
Since numerous polishing procedures are available, comparison with other studies is complicated. Ahrari et al. [43] did not reveal any significant difference in enamel roughness prior to treatment, after adhesive removal, and after polishing with a rotary cup with a pumice paste. Cardoso et al. [21] reported that polishing with a rotary cup and a pumice paste decreased Ra, but deeper grooves produced by a tungsten carbide bur used for adhesive removal remained on the surface. This is consistent with qualitative studies [12,44], which concluded that enamel appearance could be improved by prophylactic pastes, but major morphological surface changes created by adhesive removal tools, such as grooves and facets, cannot be entirely removed. In some studies [20,44], prophylactic pastes were used in conjunction with polishing discs, and the polished enamel surface was judged as satisfactory.
The tested polishing methods were also compared with each other, and it was found that polishing with Sof-Lex discs decreased roughness significantly more than Depural and polishing pastes, except for the ΔSz values of Transbond polished with polishing pastes and Fuji polished with Depural. On the other hand, there were no significantly different changes between T1 and T3 in any roughness parameter between Depural and polishing pastes. These results are in accordance with Vidor et al. [45], who evaluated enamel roughness after Transbond removal and found no significant difference between pastes containing alumina and pumice, whereas enamel polished with Sof-Lex discs was judged as the most damaged. As for Fuji, despite no significant difference in roughness change between Depural and the polishing pastes, all roughness parameters decreased when using Depural, in contrast with the polishing pastes that increased them slightly. This supported the above speculation that the polishing pastes are unable to entirely remove the glass ionomer cement. To our knowledge, there are no other studies in which a glass ionomer adhesive was polished using polishing pastes.
The inaccuracy in targeting the same areas for roughness measurements at different time points can be seen as a limitation of this study, as well as the relatively low sample size in experimental groups, which is related to the time-consuming nature of the experiment. Furthermore, comparisons between studies are limited by the human factor because interindividual differences in bonding, adhesive removal, and polishing are inevitable. Finally, other variables have been demonstrated to have an influence on the bond strength and mechanical properties of orthodontic adhesives, such as curing light output [46] or substrate contamination [26,27]. Debracketing and adhesive removal could also be influenced by adhesive thickness [47], so the effect of these variables on roughness values should be evaluated in future studies.

5. Conclusions

  • The removal of Transbond took significantly longer than Fuji, but there were fewer residues of Transbond on the enamel surface.
  • The adhesive did not have a significant effect on the change in roughness before and after treatment except for the use of a prophylactic cup with polishing pastes that resulted in a significant lower roughness change (ΔSa, ΔSq, and ΔSz) for Transbond.
  • The sequential use of fine and superfine Sof-Lex discs removed perikymata, resulting in significantly lower enamel surface roughness (Sa, Sq, and Sz) compared to the situation before treatment.
  • Perikymata and prisms were observed after polishing with a rotary brush with Depural. This method reduced all roughness parameters, but the differences were significant only in Sa and Sq for Transbond and Sku for Fuji.
  • The enamel morphology was also well restored with a prophylactic cup with the polishing pastes. However, the polishing pastes were not able to completely remove the residues of Fuji from the enamel surface.

Author Contributions

Conceptualization, T.K., H.T. and J.K.; methodology, T.K., A.T. and J.K.; validation, T.K.; investigation, T.K.; resources, A.T. and H.T.; data curation, T.K. and A.T.; writing—original draft preparation, T.K. and A.T.; writing—review and editing, H.T. and J.K.; visualization, T.K.; supervision, J.K.; funding acquisition, A.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research and the APC were funded by Charles University, grants Progres Q29/1LF and Cooperatio 207030 Dental Medicine/LF1. This article was supported by a grant from the Czech Orthodontic Society.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of the General University Hospital in Prague (protocol code 153/21 S-IV, approved on 19 August 2021).

Informed Consent Statement

The extracted teeth were collected with the written informed consent of the patients and their parents.

Data Availability Statement

The data presented in this study are openly available in the Mendeley Data repository at http://dx.doi.org/10.17632/k3wybh3pz2.1, accessed on 5 January 2023.

Acknowledgments

The authors extend special thanks to Pavel Hanus from the Technical University of Liberec for enabling the surface roughness measurements. Kateřina Langová from the Palacký University Olomouc is gratefully acknowledged for the statistical analysis. The GC corporation is acknowledged for providing the adhesive Fuji ORTHO LC Capsule.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Pont, H.B.; Ozcan, M.; Bagis, B.; Ren, Y. Loss of surface enamel after bracket debonding: An in-vivo and ex-vivo evaluation. Am. J. Orthod. Dentofac. Orthop. 2010, 138, 387.e1–387.e9. [Google Scholar] [CrossRef] [PubMed]
  2. Al Shamsi, A.H.; Cunningham, J.L.; Lamey, P.J.; Lynch, E. Three-dimensional measurement of residual adhesive and enamel loss on teeth after debonding of orthodontic brackets: An in-vitro study. Am. J. Orthod. Dentofac. Orthop. 2007, 131, e9–e301. [Google Scholar] [CrossRef]
  3. Ireland, A.J.; Hosein, I.; Sherriff, M. Enamel loss at bond-up, debond and clean-up following the use of a conventional light-cured composite and a resin-modified glass polyalkenoate cement. Eur. J. Orthod. 2005, 27, 413–419. [Google Scholar] [CrossRef] [Green Version]
  4. Sugsompian, K.; Tansalarak, R.; Piyapattamin, T. Comparison of the enamel surface roughness from different polishing methods: Scanning electron microscopy and atomic force microscopy investigation. Eur. J. Dent. 2020, 14, 299–305. [Google Scholar] [CrossRef] [PubMed]
  5. Shah, P.; Sharma, P.; Goje, S.K.; Kanzariya, N.; Parikh, M. Comparative evaluation of enamel surface roughness after debonding using four finishing and polishing systems for residual resin removal-an in vitro study. Prog. Orthod. 2019, 20, 18. [Google Scholar] [CrossRef]
  6. Mohebi, S.; Shafiee, H.A.; Ameli, N. Evaluation of enamel surface roughness after orthodontic bracket debonding with atomic force microscopy. Am. J. Orthod. Dentofac. Orthop. 2017, 151, 521–527. [Google Scholar] [CrossRef] [PubMed]
  7. Dumbryte, I.; Malinauskas, M. In vivo examination of enamel microcracks after orthodontic debonding: Is there a need for detailed analysis? Am. J. Orthod. Dentofac. Orthop. 2021, 159, e103–e111. [Google Scholar] [CrossRef]
  8. Cochrane, N.J.; Lo, T.W.G.; Adams, G.G.; Schneider, P.M. Quantitative analysis of enamel on debonded orthodontic brackets. Am. J. Orthod. Dentofac. Orthop. 2017, 152, 312–319. [Google Scholar] [CrossRef]
  9. Øgaard, B.; Rolla, G. Oral microbiological changes, long-term enamel alterations due to decalcification, and caries prophylactic aspects. In Orthodontic Materials: Scientific and Clinical Aspects; Brantley, W.A., Eliades, T., Eds.; Thieme: Stuttgart, Germany, 2001; pp. 123–142. [Google Scholar]
  10. Bollen, C.M.; Lambrechts, P.; Quirynen, M. Comparison of surface roughness of oral hard materials to the threshold surface roughness for bacterial plaque retention: A review of the literature. Dent. Mater. 1997, 13, 258–269. [Google Scholar] [CrossRef]
  11. Janiszewska-Olszowska, J.; Tandecka, K.; Szatkiewicz, T.; Sporniak-Tutak, K.; Grocholewicz, K. Three-dimensional quantitative analysis of adhesive remnants and enamel loss resulting from debonding orthodontic molar tubes. Head Face Med. 2014, 10, 37. [Google Scholar] [CrossRef] [Green Version]
  12. Zachrisson, B.U.; Årthun, J. Enamel surface appearance after various debonding techniques. Am. J. Orthod. 1979, 75, 121–127. [Google Scholar] [CrossRef]
  13. Alessandri Bonetti, G.; Zanarini, M.; Incerti Parenti, S.; Lattuca, M.; Marchionni, S.; Gatto, M.R. Evaluation of enamel surfaces after bracket debonding: An in-vivo study with scanning electron microscopy. Am. J. Orthod. Dentofac. Orthop. 2011, 140, 696–702. [Google Scholar] [CrossRef] [PubMed]
  14. Eminkahyagil, N.; Arman, A.; Cetinsahin, A.; Karabulut, E. Effect of resin-removal methods on enamel and shear bond strength of rebonded brackets. Angle Orthod. 2006, 76, 314–321. [Google Scholar] [PubMed]
  15. Sigiliao, L.C.; Marquezan, M.; Elias, C.N.; Ruellas, A.C.; Sant’Anna, E.F. Efficiency of different protocols for enamel clean-up after bracket debonding: An in vitro study. Dent. Press J. Orthod. 2015, 20, 78–85. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Degrazia, F.W.; Genari, B.; Ferrazzo, V.A.; Santos-Pinto, A.D.; Grehs, R.A. Enamel roughness changes after removal of orthodontic adhesive. Dent. J. 2018, 6, 39. [Google Scholar] [CrossRef] [Green Version]
  17. Ferreira, J.T.L.; Borsatto, M.C.; Saraiva, M.C.P.; Matsumoto, M.A.N.; Torres, C.P.; Romano, F.L. Evaluation of enamel roughness in vitro after orthodontic bracket debonding using different methods of residual adhesive removal. Turk. J. Orthod. 2020, 33, 43–51. [Google Scholar] [CrossRef]
  18. Karan, S.; Kircelli, B.H.; Tasdelen, B. Enamel surface roughness after debonding. Angle Orthod. 2010, 80, 1081–1088. [Google Scholar] [CrossRef]
  19. Sfondrini, M.F.; Scribante, A.; Fraticelli, D.; Roncallo, S.; Gandini, P. Epidemiological survey of different clinical techniques of orthodontic bracket debonding and enamel polishing. J. Orthod. Sci. 2015, 4, 123–127. [Google Scholar] [CrossRef]
  20. Zarrinnia, K.; Eid, N.M.; Kehoe, M.J. The effect of different debonding techniques on the enamel surface: An in vitro qualitative study. Am. J. Orthod. Dentofac. Orthop. 1995, 108, 284–293. [Google Scholar] [CrossRef]
  21. Cardoso, L.A.; Valdrighi, H.C.; Vedovello Filho, M.; Correr, A.B. Effect of adhesive remnant removal on enamel topography after bracket debonding. Dent. Press J. Orthod. 2014, 19, 105–112. [Google Scholar] [CrossRef]
  22. Eliades, T.; Gioka, C.; Eliades, G.; Makou, M. Enamel surface roughness following debonding using two resin grinding methods. Eur. J. Orthod. 2004, 26, 333–338. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Fjeld, M.; Ogaard, B. Scanning electron microscopic evaluation of enamel surfaces exposed to 3 orthodontic bonding systems. Am. J. Orthod. Dentofac. Orthop. 2006, 130, 575–581. [Google Scholar] [CrossRef] [PubMed]
  24. Norevall, L.I.; Marcusson, A.; Persson, M. A clinical evaluation of a glass ionomer cement as an orthodontic bonding adhesive compared with an acrylic resin. Eur. J. Orthod. 1996, 18, 373–384. [Google Scholar] [CrossRef] [PubMed]
  25. David, V.A.; Staley, R.N.; Bigelow, H.F.; Jakobsen, J.R. Remnant amount and cleanup for 3 adhesives after debracketing. Am. J. Orthod. Dentofac. Orthop. 2002, 121, 291–296. [Google Scholar] [CrossRef]
  26. Cacciafesta, V.; Sfondrini, M.F.; De Angelis, M.; Scribante, A.; Klersy, C. Effect of water and saliva contamination on shear bond strength of brackets bonded with conventional, hydrophilic, and self-etching primers. Am. J. Orthod. Dentofac. Orthop. 2003, 123, 633–640. [Google Scholar] [CrossRef]
  27. Cacciafesta, V.; Sfondrini, M.F.; Scribante, A.; De Angelis, M.; Klersy, C. Effect of blood contamination on shear bond strength of brackets bonded with a self-etching primer combined with a resin-modified glass ionomer. Am. J. Orthod. Dentofac. Orthop. 2004, 126, 703–708. [Google Scholar] [CrossRef]
  28. Valente, R.M.; De Rijk, W.G.; Drummond, J.L.; Evans, C.A. Etching conditions for resin-modified glass ionomer cement for orthodontic brackets. Am. J. Orthod. Dentofac. Orthop. 2002, 121, 516–520. [Google Scholar] [CrossRef]
  29. Mickenautsch, S.; Yengopal, V.; Banerjee, A. Retention of orthodontic brackets bonded with resin-modified GIC versus composite resin adhesives—A quantitative systematic review of clinical trials. Clin. Oral Investig. 2012, 16, 1–14. [Google Scholar] [CrossRef]
  30. Armstrong, S.; Breschi, L.; Ozcan, M.; Pfefferkorn, F.; Ferrari, M.; Van Meerbeek, B. Academy of Dental Materials guidance on in vitro testing of dental composite bonding effectiveness to dentin/enamel using micro-tensile bond strength (µTBS) approach. Dent. Mater. 2017, 33, 133–143. [Google Scholar] [CrossRef] [Green Version]
  31. Mattick, C.R.; Hobson, R.S. A comparative micro-topographic study of the buccal enamel of different tooth types. J. Orthod. 2000, 27, 143–148. [Google Scholar] [CrossRef]
  32. Brauchli, L.M.; Baumgartner, E.M.; Ball, J.; Wichelhaus, A. Roughness of enamel surfaces after different bonding and debonding procedures: An in vitro study. J. Orofac Orthop. 2011, 72, 61–67. [Google Scholar] [CrossRef] [PubMed]
  33. Ferreira, F.G.; da Silva, E.M.; Vilella, O.V. A novel method using confocal laser scanning microscopy for three-dimensional analysis of human dental enamel subjected to ceramic bracket debonding. Microsc Microanal 2020, 26, 1053–1060. [Google Scholar] [CrossRef] [PubMed]
  34. Ferreira, F.G.; Nouer, D.F.; Silva, N.P.; Garbui, I.U.; Correr-Sobrinho, L.; Nouer, P.R. Qualitative and quantitative evaluation of human dental enamel after bracket debonding: A noncontact three-dimensional optical profilometry analysis. Clin. Oral Investig. 2014, 18, 1853–1864. [Google Scholar] [CrossRef]
  35. Vilchis, R.J.; Hotta, Y.; Yamamoto, K. Examination of enamel-adhesive interface with focused ion beam and scanning electron microscopy. Am. J. Orthod. Dentofac. Orthop. 2007, 131, 646–650. [Google Scholar] [CrossRef]
  36. van Waes, H.; Matter, T.; Krejci, I. Three-dimensional measurement of enamel loss caused by bonding and debonding of orthodontic brackets. Am. J. Orthod. Dentofac. Orthop. 1997, 112, 666–669. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. ISO 25178-2:2021; Geometrical Product Specifications (GPS)—Surface Texture: Areal—Part 2: Terms, Definitions and Surface Texture Parameters. International Organization for Standardization: Geneva, Switzerland, 2021.
  38. Kim, J.H.; Kim, K.B.; Kim, W.C.; Kim, J.H.; Kim, H.Y. Accuracy and precision of polyurethane dental arch models fabricated using a three-dimensional subtractive rapid prototyping method with an intraoral scanning technique. Korean J. Orthod. 2014, 44, 69–76. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  39. Rix, D.; Foley, T.F.; Mamandras, A. Comparison of bond strength of three adhesives: Composite resin, hybrid GIC, and glass-filled GIC. Am. J. Orthod. Dentofac. Orthop. 2001, 119, 36–42. [Google Scholar] [CrossRef]
  40. Rodrigues, D.S.; Buciumeanu, M.; Martinelli, A.E.; Nascimento, R.M.; Henriques, B.; Silva, F.S.; Souza, J.C.M. Mechanical strength and wear of dental glass-ionomer and resin composites affected by porosity and chemical composition. J. Bio.-Tribo-Corros. 2015, 1, 24. [Google Scholar] [CrossRef] [Green Version]
  41. Faria-Junior, E.M.; Guiraldo, R.D.; Berger, S.B.; Correr, A.B.; Correr-Sobrinho, L.; Contreras, E.F.; Lopes, M.B. In-vivo evaluation of the surface roughness and morphology of enamel after bracket removal and polishing by different techniques. Am. J. Orthod. Dentofac. Orthop. 2015, 147, 324–329. [Google Scholar] [CrossRef]
  42. Ozer, T.; Basaran, G.; Kama, J.D. Surface roughness of the restored enamel after orthodontic treatment. Am. J. Orthod. Dentofac. Orthop. 2010, 137, 368–374. [Google Scholar] [CrossRef]
  43. Ahrari, F.; Akbari, M.; Akbari, J.; Dabiri, G. Enamel surface roughness after debonding of orthodontic brackets and various clean-up techniques. J. Dent. 2013, 10, 82–93. [Google Scholar]
  44. Retief, D.H.; Denys, F.R. Finishing of enamel surfaces after debonding of orthodontic attachments. Angle Orthod. 1979, 49, 1–10. [Google Scholar] [PubMed]
  45. Vidor, M.M.; Felix, R.P.; Marchioro, E.M.; Hahn, L. Enamel surface evaluation after bracket debonding and different resin removal methods. Dent. Press J. Orthod. 2015, 20, 61–67. [Google Scholar] [CrossRef] [Green Version]
  46. Sfondrini, M.F.; Cacciafesta, V.; Scribante, A.; Klersy, C. Plasma arc versus halogen light curing of orthodontic brackets: A 12-month clinical study of bond failures. Am. J. Orthod. Dentofac. Orthop. 2004, 125, 342–347. [Google Scholar] [CrossRef] [PubMed]
  47. Hama, T.; Namura, Y.; Nishio, Y.; Yoneyama, T.; Shimizu, N. Effect of orthodontic adhesive thickness on force required by debonding pliers. J. Oral. Sci. 2014, 56, 185–190. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Representative 3D maps of a sound enamel surface (left) and enamel surface polished with Sof-Lex discs (right).
Figure 1. Representative 3D maps of a sound enamel surface (left) and enamel surface polished with Sof-Lex discs (right).
Materials 16 05107 g001
Figure 2. Flow chart of the experimental procedures.
Figure 2. Flow chart of the experimental procedures.
Materials 16 05107 g002
Figure 3. Representative images of specimens bonded with Transbond for each polishing method at each time point. In each column, images magnified 100× are presented on the left and 1500× on the right. The first row (T1) shows enamel surfaces before treatment—perikymata were visible at 100× magnification, while 1500× magnification revealed partial prism exposure. The second row depicts the same surfaces after debracketing and adhesive removal (T2)—the surfaces appeared scratched at 100× magnification, and residues of the adhesive were identified at 1500× magnification. The third row presents the surfaces after polishing (T3). Sof-Lex discs removed perikymata, leaving the enamel surface smooth and glossy with subtle grooves identified at 1500× magnification. Depural and polishing pastes partially preserved perikymata, and the surfaces were relatively smooth without prism exposure.
Figure 3. Representative images of specimens bonded with Transbond for each polishing method at each time point. In each column, images magnified 100× are presented on the left and 1500× on the right. The first row (T1) shows enamel surfaces before treatment—perikymata were visible at 100× magnification, while 1500× magnification revealed partial prism exposure. The second row depicts the same surfaces after debracketing and adhesive removal (T2)—the surfaces appeared scratched at 100× magnification, and residues of the adhesive were identified at 1500× magnification. The third row presents the surfaces after polishing (T3). Sof-Lex discs removed perikymata, leaving the enamel surface smooth and glossy with subtle grooves identified at 1500× magnification. Depural and polishing pastes partially preserved perikymata, and the surfaces were relatively smooth without prism exposure.
Materials 16 05107 g003
Figure 4. Representative images of specimens bonded with Fuji for each polishing method at each time point. For an explanation, please refer to Figure 3.
Figure 4. Representative images of specimens bonded with Fuji for each polishing method at each time point. For an explanation, please refer to Figure 3.
Materials 16 05107 g004
Table 1. Overview of materials used in this study.
Table 1. Overview of materials used in this study.
Material (Batch Number)ManufacturerMaterial TypeCompositionApplication Procedure
Unitek Etching Gel (NE06102)3M, St. Paul, MN, USAEtchantPhosphoric acid (35 wt.%), water, amorphous silicaApply to the enamel, wait for 15 s, and rinse with water for 15 s.
Transbond XT Light Cure Orthodontic Adhesive Primer (NE10102)3M, St. Paul, MN, USAAdhesive primerBis-GMA, TEGDMA, 4-(dimethylamino)-benzeneethanolApply to the etched enamel, light-cure for 3 s.
Transbond XT Light Cure Adhesive Paste (NE18405)3M, St. Paul, MN, USAResin compositeSilane-treated quartz and silica, Bis-GMA, Bis-DMA, diphenyliodonium hexafluorophosphate, triphenylantimonyApply to the base of the bracket, seat with moderate pressure, remove excess, and light-cure for 4 × 3 s.
GC Ortho Conditioner (2102121)GC, Tokyo, JapanConditioner10% polyacrylic acid solutionApply to the enamel, wait for 20 s, and rinse with water for 20 s.
Fuji ORTHO LC Capsule (2105151)GC, Tokyo, JapanResin-modified glass ionomerGlass particles, HEMA, polyacrylic acid, 2-hydroxy-1,3 dimethacryloxypropane, UDMA, initiating systemApply to the base of the bracket, seat with moderate pressure, remove excess, and light-cure for 4 × 3 s.
Abbreviations: Bis-GMA—bisphenol A-glycidyl methacrylate, TEGDMA—triethylene glycol dimethacrylate, Bis-DMA—bisphenol A dimethacrylate, HEMA—2-hydroxyethyl methacrylate, UDMA—urethane dimethacrylate.
Table 2. Measurement error.
Table 2. Measurement error.
ParameterDahlberg ErrorRelative
Dahlberg Error
Intraclass
Correlation
Coefficient
p-Value 1
Sa0.00775.9%0.8480.239
Sku0.30288.1%0.7150.242
Sq0.00633.8%0.9330.189
Sz0.05805.0%0.9170.412
1 p-value < 0.05 would indicate systematic error.
Table 3. Surface roughness before treatment (T1) and its change after debracketing and adhesive removal (T2–T1).
Table 3. Surface roughness before treatment (T1) and its change after debracketing and adhesive removal (T2–T1).
Transbond
Median (min; max)
Fuji
Median (min; max)
p-Value 1
T1Sa (µm)0.15 (0.08; 0.25) 0.17 (0.08; 0.24)0.624
Sku3.88 (2.85; 5.28)3.97 (3.02; 7.17) 0.333
Sq (µm)0.20 (0.10; 0.32)0.21 (0.10; 0.32) 0.414
Sz (µm)1.51 (0.69; 2.62) 1.57 (0.75; 2.18)0.870
T2-T1ΔSa (µm)0.02 (−0.07; 0.27)0.04 (−0.06; 0.17)0.131
ΔSku−0.55 (−1.95; 3.66)−0.76 (−3.59; 1.01)0.222
ΔSq (µm)0.02 (−0.11; 0.48)0.05 (−0.09; 0.21)0.178
ΔSz (µm)0.11 (−1.26; 6.00)0.24 (−0.40; 1.16)0.505
1 The p-value < 0.05 would indicate a significant difference between the adhesives (Transbond and Fuji).
Table 4. Change in surface roughness after polishing compared with pre-treatment state (T3–T1).
Table 4. Change in surface roughness after polishing compared with pre-treatment state (T3–T1).
Sof-Lex DiscsDepuralPolishing Pastes
Transbond
Median
(min; max)
Fuji
Median
(min; max)
p-ValueTransbond
Median
(min; max)
Fuji
Median
(min; max)
p-ValueTransbond
Median
(min; max)
Fuji
Median
(min; max)
p-Value
ΔSa (µm)−0.12 A
(−0.17; −0.07)
−0.15 a
(−0.18; −0.08)
0.406−0.03 B
(−0.13; 0.03)
−0.04 b
(−0.09; 0.16)
0.949−0.05 B
(−0.07; 0.09)
0.06 b
(−0.04; 0.18)
0.025
ΔSku2.60 A
(1.42; 5.27)
2.16 a
(0.30; 5.16)
0.180−0.43 B
(−2.15; 1.44)
−0.59 b
(−4.33; −0.34)
0.406−0.33 B
(−1.82; 0.62)
0.17 b
(−2.85; 1.24)
0.749
ΔSq (µm)−0.15 A
(−0.21; −0.09)
−0.19 a
(−0.26; −0.09)
0.180−0.06 B
(−0.17; 0.03)
−0.06 b
(−0.12; 0.20)
0.749−0.06 B
(−0.10; 0.11)
0.10 b
(−0.06; 0.19)
0.025
ΔSz (µm)−1.01 A
(−1.74; −0.52)
−1.20 a
(−1.58; −0.19)
0.482−0.20 B
(−0.66; 0.30)
−0.57 ab
(−0.83; 0.95)
0.406−0.59 AB
(−1.09; 0.37)
0.55 b
(−0.57; 1.07)
0.009
Within each row, different superscript letters indicate significant differences between the polishing methods (p < 0.05)—upper-case letters for Transbond and lower-case letters for Fuji. For example, there is a significant difference in the ΔSq of Transbond between Sof-Lex discs (A) and Depural (B), but neither of them is significantly different from the polishing pastes (AB). The presented p-values indicate differences between adhesives for each parameter and polishing method. Significant differences (p < 0.05) are highlighted in bold.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Křivková, T.; Tichý, A.; Tycová, H.; Kučera, J. The Influence of Various Adhesive Systems and Polishing Methods on Enamel Surface Roughness after Debonding of Orthodontic Brackets: A Three-Dimensional In Vitro Evaluation. Materials 2023, 16, 5107. https://doi.org/10.3390/ma16145107

AMA Style

Křivková T, Tichý A, Tycová H, Kučera J. The Influence of Various Adhesive Systems and Polishing Methods on Enamel Surface Roughness after Debonding of Orthodontic Brackets: A Three-Dimensional In Vitro Evaluation. Materials. 2023; 16(14):5107. https://doi.org/10.3390/ma16145107

Chicago/Turabian Style

Křivková, Tereza, Antonín Tichý, Hana Tycová, and Josef Kučera. 2023. "The Influence of Various Adhesive Systems and Polishing Methods on Enamel Surface Roughness after Debonding of Orthodontic Brackets: A Three-Dimensional In Vitro Evaluation" Materials 16, no. 14: 5107. https://doi.org/10.3390/ma16145107

APA Style

Křivková, T., Tichý, A., Tycová, H., & Kučera, J. (2023). The Influence of Various Adhesive Systems and Polishing Methods on Enamel Surface Roughness after Debonding of Orthodontic Brackets: A Three-Dimensional In Vitro Evaluation. Materials, 16(14), 5107. https://doi.org/10.3390/ma16145107

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop