Next Article in Journal
The Enigmatic Emerging Role of the C-Maf Inducing Protein in Cancer
Previous Article in Journal
Effect of Point-Spread Function Reconstruction for Indeterminate PSMA-RADS-3A Lesions on PSMA-Targeted PET Imaging of Men with Prostate Cancer
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Diagnostic Role of Four-Dimensional Computed Tomography for Preoperative Parathyroid Localization in Patients with Primary Hyperparathyroidism: A Systematic Review and Meta-Analysis

1
Department of Nuclear Medicine, Beijing Luhe Hospital, Capital Medical University, No 82 Xinhua South Road, Tongzhou District, Beijing 101149, China
2
Department of Radiology, Beijing Luhe Hospital, Capital Medical University, No 82 Xinhua South Road, Tongzhou District, Beijing 101149, China
*
Author to whom correspondence should be addressed.
Diagnostics 2021, 11(4), 664; https://doi.org/10.3390/diagnostics11040664
Submission received: 22 February 2021 / Revised: 31 March 2021 / Accepted: 3 April 2021 / Published: 7 April 2021
(This article belongs to the Section Medical Imaging and Theranostics)

Abstract

:
We sought to systematically evaluate diagnostic performance of four-dimensional computed tomography (4D-CT) in the localization of hyperfunctioning parathyroid glands (HPGs) in patients with primary hyperparathyroidism (pHPT). We calculated the pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), and diagnostic odds ratios (DOR) of 4D-CT on a per-lesion level, as well as pooled sensitivity and positive predictive value (PPV) on a per-patient level with 95% confidence intervals (CIs). Additionally, we plotted summary receiver operating characteristic (SROC) curves and evaluated the areas under the curves (AUC). A total of 16 studies were included in the analysis. Their pooled sensitivity, specificity, PLR, NLR, and DOR of 4D-CT on per-lesion level were 75% (95%CI: 66–82%), 85% (95%CI: 50–97%), 4.9 (95%CI: 1.1–21.3), 0.30 (95%CI: 0.19–0.45), and 17 (95%CI: 3–100), respectively, with an AUC of 81% (95%CI: 77–84%). We also observed heterogeneity in sensitivity (I2 = 79%) and specificity (I2 = 94.7%), and obtained a pooled sensitivity of 81% (95%CI: 70–90%) with heterogeneity of 81.9% (p < 0.001) and PPV of 91% (95%CI: 82–98%) with heterogeneity of 80.8% (p < 0.001), based on a per-patient level. Overall, 4D-CT showed moderate sensitivity and specificity for preoperative localization of HPG(s) in patients with pHPT. The diagnostic performance may improve with 4D-CT’s promotion to first-line use on a lesion-based level, further research is needed to confirm the results.

1. Introduction

Primary hyperparathyroidism (pHPT) is a common endocrine disorder, defined as hypercalcemia secondary to excessive secretion of parathyroid hormone by 1 or more hyperfunctioning parathyroid glands (HPGs) [1,2]. It more commonly affects elderly individuals, and women four times as often as men [3,4]. A single parathyroid adenoma (85–90%) is the most common cause of pHPT [5]. Parathyroidectomy (PTx) represents the best line of action for management of parathyroid adenoma(s). It is advised for patients with systematic pHPT and those who meet the surgery guideline criteria. On the other hand, it is always an option for some patients with asystematic pHPT, even if they do not meet any criteria for surgery [6,7]. In addition, focused parathyroidectomy and bilateral neck exploration (BNE) have been shown to result in analogous biochemical complications and cure rates. Nevertheless, focused parathyroidectomy has some advantages, including decreased operating time, length of hospital stay as well as reduced medical cost and increased patient comfort [8]. However, clinicians need to be preoperatively precise in the localization of HPG(s) before surgery [5].
Although neck ultrasound (US) and 99mTc-sestamibi single-photon emission computed tomography/computed tomography (SPECT/CT) are the most commonly used modalities for localizing HPG(s), parathyroid localization has recently undergone considerable technological advancements [7]. Four-dimensional computed tomography (4D-CT), first reported in 2006, has emerged as a promising imaging modality for preoperative localization in patients with pHPT [9]. Summarily, 4D-CT is a contrast enhanced multiple-phase CT that comprises three or four common phases, namely non-contrast-enhanced, arterial and delayed phase. The first three dimensions entail axial acquisition with coronal and sagittal reformations, whereas the fourth “dimension” involves change in enhancement over time from the multiple-phase image. Parathyroid adenoma(s) always show low attenuation on the non–contrast enhanced imaging, rapid and peak enhancement on the arterial phase, then washout of contrast from arterial to delayed phase [10]. In the past decade, several studies have demonstrated 4D-CT’s diagnostic accuracy in localizing HPG(s) in patients with hyperparathyroidism (HPT), thereby to a correct side and/or quadrant on per-patient and/or per-lesion level, albeit with a wide range of sensitivities (ranging from 50–100%) and specificities (ranging from 0–100%) with number of patients ranging from 33–400 [11,12,13]. Additionally, previous meta-analyses found that 4D-CT exhibited a pooled sensitivity of 89.4%, 0.85 (95%CI, 0.69–0.94) and specificity of 0.93 (95%CI, 0.88–0.96), respectively [14,15]. However, the authors only enrolled two and nine studies, necessitating further investigation.
The present study aimed to evaluate diagnostic performance of 4D-CT for the localization of HPG(s) using a meta-analysis. The findings are expected to guide its application quadrant in patients with pHPT on both lesion-based and patient-based basis.

2. Materials and Methods

This systematic review and meta-analysis was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, nevertheless, it was not registered on the international prospective register of systematic reviews (PROSPERO) [16].

2.1. Search Strategy

We searched electronic literature databases, namely PubMed, Embase, and Web of science, from their inception up to 10th November 2020. The search algorithm (Supplementary File S1) was based on the following combined terms: (a) “Four-dimensional computed tomography or 4DCT or 4D-CT or Four dimensional computed tomography”, (b) “hyperparathyroidism or (parathyroid adenoma)”, and (c) “(diagnostic accuracy) or sensitivity or specificity”. No start date restrictions were included in our search.

2.2. Inclusion Criteria and Exclusion Criteria

Studies that met the following criteria were included in the analysis: (1) patients with primary hyperparathyroidism undergoing 4D-CT for localization of HPG(s); (2) surgery and histology as the gold standard; (3) the outcome was diagnostic accuracy expressed as sensitivity and specificity on lesion-based basis and sensitivity on patient-bases basis; and (4) reported sensitivity and/or specificity for a correct quadrant or typical parathyroid sites or in ectopic areas.
Articles were excluded if they were duplicate publications, case reports, abstracts, review articles, conference/meeting papers, lacked full text or were not written in English. Moreover, articles that reported insufficient data to reassess sensitivity and specificity as well as those that only described diagnosis of HPG(s) to a correct side were also excluded.

2.3. Data Extraction and Quality Assessment

Basic information, namely first author name, publication date, country, study design, and patients’ characteristics, as well as technical aspects, such as machine model, detector, product, injection rate, dose, scan phase, and imaging procedure, were grouped together. Each included study was analyzed to obtain the numbers of true positives (TP), false positives (FP), true negatives (TN), and false negatives (FN) of per-lesion or per-patient for localization of HPG(s). We applied the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool to assess studies quality. Each article was reviewed by two reviewers (L.S. and P.H.) and any discrepancies were resolved by discussion. The result was judged as true positive if 4D-CT localized the correct position of the HPG(s) (upper/lower pole of the thyroid left/right lobe, upper/lower part of the mediastinum, or elsewhere) at surgery on a per-lesion level, and if patients with one or several HPG(s) detected on imaging and confirmed by surgery findings on a per-patient level.

2.4. Statistical Analysis

The primary purpose of this analysis was to calculate summary sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR) and diagnostic odds ratios (DOR) with 95% confidence interval (CI) on a per-lesion level for the localization of HPG(s). A DOR can be calculated as the ratio of the odds of positivity in a disease state, relative to the odds of positivity in the non-disease state, with higher values indicating better discriminatory test performance [17]. We applied a bivariate random effects model to calculate the pooled sensitivity and specificity on a per-lesion level, then used the same model to plot summary receiver operating characteristic (SROC) curves and evaluate the areas under the curves (AUC). We only calculated pooled sensitivity and positive predictive value (PPV) on per-patient level, since some articles did not report FP and TN findings.
We assessed between-study heterogeneity of the data using the I-square index (I2) statistic and the Cochrane Q test, based on random-effects analysis [18]. To assess study-between heterogeneity, we performed the following subgroup analyses: (1) imaging procedure (4D-CT as first line vs. second line examination) on both analyses; and (2) parathyroid glands analysis (all glands vs. resected glands) on lesion-based level. Publication bias was evaluated by Deek’s test as previously described [19]. Data analyses were performed using the “Midas” and “Metaprop” modules in Stata software version 15.0 (StataCorp, College Station, TX, USA). Values were considered statistically significant if the two-sided p value was <0.05.

3. Results

3.1. Literature Search

Our search strategy resulted in a total of 238 studies, 76, 97, and 65 from PubMed, Embase, and Web of science, respectively. Among these, 100 duplicate articles as well 92 studies, including 33 not in the field of interest, 8 case reports, 31 abstracts, 15 reviews, one editorial, three congress and meetings, and one without full text were excluded. Among the remaining 46 articles, 16 [11,12,13,20,21,22,23,24,25,26,27,28,29,30,31,32] finally met the inclusion criteria and were subsequently included in our analysis. A flow diagram of eligible literature is shown in Figure 1.

3.2. Characteristics of the Included Studies

Basic characteristics of the 4D-CT studies are summarized in Table 1. Detailed technical aspects, including CT, as well as contrast and injection information, scan phase and imaging procedure are listed in Table 2. Among the 16 included studies, five described lesion-based analysis, seven reported patient-based analysis, whereas four were on both of the aforementioned analyses. Overall, these studies comprised a total of 1032 patients. Moreover, nine studies, including 710 patients and 2644 lesions on lesion-based analysis, and 11 studies comprising 503 patients on patient-based analysis allowed evaluation of 4D-CT’s role in localizing HPG(s), the diagnostic accuracy of 4D-CT are shown in Table 3. Of the 16 included studies, 13 and two had a retrospective and prospective design, respectively, whereas one study did not report the study design. Two studies focused on the group of patients operated on the second time or experiencing recurrence of the tumor, while the remaining 14 enrolled participants either without a history of prior neck surgery or with mixed type of the first and re-operation. Six and nine studies reported 4D-CT as a first- and second-line of examination, respectively, whereas one reported both examinations.

3.3. Quality Assessment

Results from methodological quality analysis, including patient selection, index test, reference standard, and flow and timing, are summarized in Figure 2. With regards to patient selection, nine studies showed an unclear risk of bias due to insufficient information of consecutive patient enrollment and time limitation, while one study revealed high risk of bias due to exclusion of multiple parathyroid glands. Based on index test, seven studies exhibited an unclear risk of bias owing to the fact that they did not mention whether or not the operators interpreted the images without reference standard, which might result in interpretation bias. We considered one study as high risk of bias, since not all interpretation of images were blinded. All studies revealed an unclear risk of bias in reference standard, owing to the fact that they did not mention whether or not the pathologist were blinded to prior clinical and imaging data, when they interpreted the histological results, which might result in verification bias. However, most of the studies were considered to have low applicability in the patient selection, index test and reference standard domains, therefore, we took all the studies into final analysis.

3.4. Summary of 4D-CT’s Diagnostic Performance

We regarded histological findings, as well as a combination of these and follow-up of biochemical resolution after surgery, as the reference standard. On a per-lesion analysis, sensitivity and specificity were used to assess the diagnostic performance. Conversely, on a per-patient analysis, the terms specificity and negative predictive value were not meaningful, since diagnosis was biologically confirmed for patients who were all assumed to have at least 1 HPG. Consequently, we only calculated pooled sensitivity and PPV as the metrics of diagnostic accuracy on a per-patient basis.

3.4.1. Per-Lesion Level Analysis

The pooled sensitivity, specificity, PLR, NLR, and DOR of 4D-CT were 75% (95%CI: 66–82%), 85% (95%CI: 50–97%), 4.9 (95%CI: 1.1–21.3), 0.30 (95%CI: 0.19–0.45), and 17 (95%CI: 3–100), respectively. We summarized sensitivities and specificities of 4D-CT for localization of HPG(s) using forest plots as shown in Figure 3a. I2 values for sensitivity and specificity were 79% (Q = 38.13) and 94.7% (Q = 150.47), respectively, whereas AUC of 4D-CT was 81% (95%CI: 77–84%). The resulting SROC curve is shown in Figure 3b.
Subgroup analyses, performed by imaging procedure, revealed that four studies used 4D-CT as a second-line examination, and this resulted in a pooled sensitivity and specificity of 65% (95%CI: 54–75%) without significant heterogeneity (I2 = 22%, Q = 3.84) and 78% (95%CI: 3–100%) with significant heterogeneity (I2 = 94.9%, Q = 58.9). On the other hand, 5 studies reported use of 4D-CT as a first-line examination, and resulted in a higher pooled sensitivity (77%, 95%CI: 67–85%) and specificity (95%, 95%CI: 91–97%). Studies that reported 4D-CT as first-line examination revealed statistically significant heterogeneity in their sensitivity (I2 = 86%, Q = 28.54) and specificity (I2 = 93%, Q = 56.78) estimates. The AUC of the two subgroups were 66% (95%CI: 62–70%) and 94% (95%CI: 92–96%), respectively.
Subgroup analysis, in studies focusing on all parathyroid glands analysis for localization of culprit parathyroid gland(s), revealed pooled sensitivity, specificity and AUC values of 75% (95%CI: 66–83%), 94% (95%CI: 91–96%) and 94% (95%CI: 91–95%), respectively. Studies that used all parathyroid glands analysis for localization were statistically heterogeneous with regards to their sensitivity (I2 = 85.3%, Q = 33.92) and specificity (I2 = 87.8%, Q = 41.01) estimates.
Subgroup analysis, targeting study design, showed that eight retrospective studies had pooled sensitivity and specificity of 77% (95%CI: 70–83%) and 83% (95%CI: 38–98%), respectively, with an AUC of 81% (95%CI: 77–84%). Moreover, we observed heterogeneity in their sensitivity (I2 = 65.2%, Q = 20.12) and specificity (I2 = 95.1%, Q = 142.37). The diagnostic performance was similar to the overall results.

3.4.2. Per-Patient Level Analysis

Patient-based analysis resulted in a pooled sensitivity of 81% (95%CI: 70–90%) and PPV of 91% (95%CI: 82–98%), with heterogeneity (I2 = 81.9% and I2 = 80.8%). A forest plot describing the sensitivity and PPV are shown in Figure 4. Subgroup analysis, performed by imaging procedure, showed that the pooled sensitivity were 77% (95%CI: 67–86%) and 86% (95%CI: 62–100%), and pooled PPV were 94% (95%CI: 86–100%) and 86% (95% CI: 68–98%) of 4D-CT as second- and first-line imaging modalities, respectively, with evidence of heterogeneity in their estimates of sensitivity (I2 = 59% and I2 = 91.2%) and PPV (I2 = 62.8% and I2 = 85.6%) in both subgroups. Furthermore, we did not perform subgroup analysis targeting study design (patient level), scan phase (three phases vs. four phases) as well as history of prior neck surgery (yes vs. no) and technical aspects, due to limited information from reported studies.
Further, Deek’s test showed no evidence of publication bias (p = 0.19 and p = 0.83) on a lesion- and patient-based level, the figures of funnel plot were supplemented in (Supplementary Figures S1 and S2).

4. Discussion

The current meta-analysis revealed that 4D-CT has moderate diagnostic accuracy in patients with pHPT to a correct quadrant, based on both per-lesion and per-patient level, as evidenced by moderate pooled sensitivity, specificity and AUC. Moreover, subgroup analyses revealed that 4D-CT may improve diagnostic performance, as a first-line modality for in localizing patients with pHPT on a lesion-based level.
Previous meta-analyses have reported 76.1% (95%CI: 70.4–81.4%), 86% (95%CI: 80–90%), and 85% (95%CI: 69–94%) pooled sensitivity of US, 99mTc-sestamibi SPECT/CT and 4D-CT, respectively, during localization of HPG(s) in patients with HPT [14,15,33]. Parathyroid US and SPECT/CT are still references for preoperative localization in pHPT. Nevertheless, their sensitivities are particularly low in reoperative patients [34]. Additionally, the imaging modalities were reportedly negative or discordant in some clinical scenarios. However, 4D-CT has recently been shown to act as an alternative and emerging imaging modality. For example, Hamidi et al. [35] and Amadou et al. [20] found that 4D-CT exhibited 77.4 (lateralization) and 75% (quadrant or site) sensitivities during preoperative localization of HPGs in persistent pHPT (due to the unrecognized ectopic localizations during the first surgery, unknown multiglands and a negative preoperative imaging finding) [36,37,38]. Previous studies have also suggested that 4D-CT may play a role in preoperative localization in patients in whom conventional imaging scans failed to localize by conventional imaging scans, as evidenced by sensitivities ranging from 66 to 86% [20,23,29,30].
Wan et al. have reported the comparison of diagnostic value between 4D-CT and SPECT/CT head-to-head, their sensitivity and specificity of 4D-CT were slightly higher than the results of this study in a lesion-based analysis [15]. However, there are several methodological differences between the two meta-analyses. First, they only selected studies investigating 4D-CT with SPECT/CT head-to-head. Second, they performed meta-analysis on a lesion-based level without calculations based on a per-patient level. In an attempt to obtain more information evaluating the diagnostic value of 4D-CT, we included more studies. Moreover, we performed subgroup analysis to observe the effectiveness of 4D-CT for localization of HPG(s) in pHPT patients in different clinical settings.
With regards to lesion-based analysis, we found four studies that showed lower sensitivities (from 50 to 75%). Among them, one adopted a prospective and consecutive design, with a resulting sensitivity of 58%, which was in contrast to many other findings [20,32,39]. This might be, in part, due to the study design. The other three articles also demonstrated a relatively lower diagnostic accuracy, in which 4D-CT played a role as a second-line imaging modality for localizing HPG(s). Based on these findings, we performed subgroup analyses on study design and imaging procedure.
Subgroup analysis, by imaging procedure performed targeting lesions and patients, showed that second-line modality had lower diagnostic performance than first-line, with regards to both analyses for localization of HPG(s). This might be attributed to imaging results and the inexperience technicians operating inconvenient shooting techniques. Other factors may also change the effectiveness of 4D-CT, including positioning, large body habitus and position of HPG(s) [28,40,41]. Patients subjected to 4D-CT as a second-line examination always had negative or inconclusive first-line imaging results. Therefore, it was easy to increase the number of false-negatives. Of note, lesions in subgroup of 4DCT used as first-line imaging are significantly larger than those of second-line, the results of this group might be more convincing.
Since some of the studies included herein always assumed that each patient had 4 or more parathyroid glands [11,13,27,28,32], we performed subgroup analysis based on all parathyroid glands attributes and found high specificity (94%, 95CI: 91–96%) and AUC (94%, 95CI: 91–96%). However, other studies focusing on resected parathyroid lesions exhibited significantly lower specificities, possibly due to absence of analysis in negative findings on 4D-CT [30,31].
We did not perform subgroup analysis on prior neck surgery (yes vs. no) and scan phase (three phases vs. four phases), due to the limited number of history reports. In addition, among 16 included studies, there were only two studies reporting the diagnostic performance of 4D-CT for localization of pHPT patient with low/mild line hypercalcemia or parathyroid hormone (PTH), two studies focusing on persistent or recurrent pHPT, the published data was insufficient to evaluate the special group of patients. Notably, it is better to choose a protocol that allows minimal radiation dose without sacrificing diagnostic accuracy. For example, Raghavan et al. [42] demonstrated that arterial phase images (with a sensitivity of 91% and specificity of 82.9%) alone was adequate to obtain the diagnostic accuracy for parathyroid adenomas localization. In addition, Campbell et al. [43] suggested the two-phase computed tomography is as effective as 4D-CT for identifying enlarged parathyroid glands. Further research is needed to ascertain an ideal CT protocol.
Apart from conventional B-mode US, SPECT/CT, ultrasound elastography, a new tool for diagnosing parathyroid adenomas, has revealed a high sensitivity (93–100%) and specificity (90–95%) [44,45,46]. Additionally, 18F-choline and 11C-methionine positron emission tomography/computed tomography (PET/CT) are also useful diagnostic modalities for preoperative localization in pHPT patients [47,48]. Previous meta-analyses exhibited a pooled sensitivity 92% (95CI: 88–96%) of 18F-choline PET and 81% (95CI: 74–86%) of 11C-Methionine PET/CT on a per-patient level [49,50]. Furthermore, 3T magnetic resonance imaging (MRI) showed an excellent sensitivity 97.8% (95CI: 92.3–99%) and specificity 97.5% (95CI: 97–100%) for preoperative localization of parathyroid adenomas [51]. However, up to now as no studies to compare the diagnostic accuracy of 11C-Methionine, 18F-choline PET, MRI with 4D-CT, further investigations are needed.
This meta-analysis had some limitations. Firstly, as shown by the QUADAS 2 tool, an unclear and a high risk of bias, arising from patient selection, index text and reference standard, should be took into consideration. It was difficult to avoid patient selection bias owing to the fact that only two studies had a prospective design, while a majority of the rest were retrospective. Furthermore, whether reviewers/pathologists were blinded to histological/imaging results or not can change the diagnostic accuracy to some extent. The results of the current meta-analysis should therefore be interpreted with caution. Secondly, some studies only exhibited diagnostic accuracy based on a single lesion, and excluded patients with multiple parathyroid glands. This could have lowered sensitivity. Thirdly, not all reference standards combined histological findings with follow up. Fourthly, a previous study reported that radio-labelled choline PET showed excellent diagnostic performance in the detection of HPG(s) in HPT patients. However, in our case, only two studies reported diagnostic accuracy of 4D-CT and F18 choline-PET/CT on lesion-based analysis, which was not enough to evaluate the diagnostic performance of the two imaging modalities.

5. Conclusions

Overall, 4D-CT exhibited moderate sensitivity and specificity in both patient- and lesion-based analysis of preoperative localization of HPG(s). Its diagnostic performance may improve when it was used as a first-line modality, nevertheless, necessitating further investigation to compare the diagnostic accuracy of 4D-CT with other imaging modalities to confirm our observation.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/diagnostics11040664/s1, File S1: details of search algorithm for each electronic literature databases; Figure S1: Deeks funnel plot asymmetry test for publication bias of 4D-CT for detecting HPG(s) on a per-lesion level. Figure S2: Deeks funnel plot asymmetry test for publication bias of 4D-CT for detecting HPG(s) on a per-patient level.

Author Contributions

Conceptualization: L.S.; methodology: L.S. and J.Y.; software: L.S. and P.H.; validation: Y.Y. and R.P.; formal analysis: Z.L. and Y.Y.; writing—original draft preparation: L.S. and J.Y.; writing—review and editing: L.S., P.H. and R.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

All analyses were based on previously published studies. Data sharing is not applicable to this article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bunch, P.M.; Kelly, H.R. Preoperative Imaging Techniques in Primary Hyperparathyroidism: A Review. JAMA Otolaryngol. Head Neck Surg. 2018, 144, 929–937. [Google Scholar] [CrossRef]
  2. Fraser, W.D. Hyperparathyroidism. Lancet 2009, 374, 145–158. [Google Scholar] [CrossRef]
  3. Yeh, M.W.; Ituarte, P.H.; Zhou, H.C.; Nishimoto, S.; Liu, I.L.; Harari, A.; Haigh, P.I.; Adams, A.L. Incidence and prevalence of primary hyperparathyroidism in a racially mixed population. J. Clin. Endocrinol. Metab. 2013, 98, 1122–1129. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Bunch, P.M.; Randolph, G.W.; Brooks, J.A.; George, V.; Cannon, J.; Kelly, H.R. Parathyroid 4D CT: What the Surgeon Wants to Know. Radiographics 2020, 40, 1383–1394. [Google Scholar] [CrossRef]
  5. Wilhelm, S.M.; Wang, T.S.; Ruan, D.T.; Lee, J.A.; Asa, S.L.; Duh, Q.Y.; Doherty, G.M.; Herrera, M.F.; Pasieka, J.L.; Perrier, N.D.; et al. The American Association of Endocrine Surgeons Guidelines for Definitive Management of Primary Hyperparathyroidism. JAMA Surg. 2016, 151, 959–968. [Google Scholar] [CrossRef] [PubMed]
  6. Bilezikian, J.P.; Brandi, M.L.; Eastell, R.; Silverberg, S.J.; Udelsman, R.; Marcocci, C.; Potts, J.T., Jr. Guidelines for the management of asymptomatic primary hyperparathyroidism: Summary statement from the Fourth International Workshop. J. Clin. Endocrinol. Metab. 2014, 99, 3561–3569. [Google Scholar] [CrossRef]
  7. Khan, A.A.; Hanley, D.A.; Rizzoli, R.; Bollerslev, J.; Young, J.E.; Rejnmark, L.; Thakker, R.; D’Amour, P.; Paul, T.; Van Uum, S.; et al. Primary hyperparathyroidism: Review and recommendations on evaluation, diagnosis, and management. A Canadian and international consensus. Osteoporos. Int. 2017, 28, 1–19. [Google Scholar] [CrossRef] [Green Version]
  8. Udelsman, R.; Donovan, P.I. Open minimally invasive parathyroid surgery. World J. Surg. 2004, 28, 1224–1226. [Google Scholar] [CrossRef] [PubMed]
  9. Rodgers, S.E.; Hunter, G.J.; Hamberg, L.M.; Schellingerhout, D.; Doherty, D.B.; Ayers, G.D.; Shapiro, S.E.; Edeiken, B.S.; Truong, M.T.; Evans, D.B.; et al. Improved preoperative planning for directed parathyroidectomy with 4-dimensional computed tomography. Surgery 2006, 140, 932–941. [Google Scholar] [CrossRef]
  10. Hoang, J.K.; Sung, W.K.; Bahl, M.; Phillips, C.D. How to perform parathyroid 4D CT: Tips and traps for technique and interpretation. Radiology 2014, 270, 15–24. [Google Scholar] [CrossRef] [Green Version]
  11. Acar, N.; Haciyanli, M.; Coskun, M.; Erdogan, N.K.; Celik, S.C.; Haciyanli, S.G.; Gur, E.O. Diagnostic value of four-dimensional computed tomography and four-dimensional magnetic resonance imaging in primary hyperparathyroidism when first-line imaging was inadequate. Ann. R Coll. Surg. Engl. 2020, 102, 294–299. [Google Scholar] [CrossRef]
  12. Eichhorn-Wharry, L.I.; Carlin, A.M.; Talpos, G.B. Mild hypercalcemia: An indication to select 4-dimensional computed tomography scan for preoperative localization of parathyroid adenomas. Am. J. Surg. 2011, 201, 334–338. [Google Scholar] [CrossRef]
  13. Yeh, R.; Tay, Y.K.D.; Tabacco, G.; Dercle, L.; Kuo, J.H.; Bandeira, L.; McManus, C.; Leung, D.K.; Lee, J.A.; Bilezikian, J.P. Diagnostic performance of 4D CT and sestamibi SPECT/CT in localizing parathyroid adenomas in primary hyperparathyroidism. Radiology 2019, 291, 469–476. [Google Scholar] [CrossRef] [PubMed]
  14. Cheung, K.; Wang, T.S.; Farrokhyar, F.; Roman, S.A.; Sosa, J.A. A meta-analysis of preoperative localization techniques for patients with primary hyperparathyroidism. Ann. Surg. Oncol. 2012, 19, 577–583. [Google Scholar] [CrossRef] [PubMed]
  15. Wan, Q.C.; Li, J.F.; Tang, L.L.; Lv, J.; Xie, L.J.; Li, J.P.; Qin, L.P.; Cheng, M.H. Comparing the diagnostic accuracy of 4D CT and 99mTc-MIBI SPECT/CT for localizing hyperfunctioning parathyroid glands: A systematic review and meta-analysis. Nucl. Med. Commun. 2021, 42, 225–233. [Google Scholar] [PubMed]
  16. Liberati, A.; Altman, D.G.; Tetzlaff, J.; Mulrow, C.; Gotzsche, P.C.; Ioannidis, J.P.; Clarke, M.; Devereaux, P.J.; Kleijnen, J.; Moher, D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. PLoS Med. 2009, 6, e1000100. [Google Scholar] [CrossRef] [PubMed]
  17. Glas, A.S.; Lijmer, J.G.; Prins, M.H.; Bonsel, G.J.; Bossuyt, P.M. The diagnostic odds ratio: A single indicator of test performance. J. Clin. Epidemiol. 2003, 56, 1129–1135. [Google Scholar] [CrossRef]
  18. Thompson, S.G. Why sources of heterogeneity in meta-analysis should be investigated. BMJ 1994, 309, 1351–1355. [Google Scholar] [CrossRef]
  19. Deeks, J.J.; Macaskill, P.; Irwig, L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J. Clin. Epidemiol. 2005, 58, 882–893. [Google Scholar] [CrossRef]
  20. Amadou, C.; Bera, G.; Ezziane, M.; Chami, L.; Delbot, T.; Rouxel, A.; Leban, M.; Herve, G.; Menegaux, F.; Leenhardt, L.; et al. 18F-Fluorocholine PET/CT and Parathyroid 4D Computed Tomography for Primary Hyperparathyroidism: The Challenge of Reoperative Patients. World J. Surg. 2019, 43, 1232–1242. [Google Scholar] [CrossRef] [PubMed]
  21. Binks, M.; Burrows, D.; Littlejohn, D. A rural perspective on minimally invasive parathyroidectomy: Optimal preoperative imaging and patient outcomes. ANZ J. Surg. 2018, 89, 43–47. [Google Scholar] [CrossRef] [Green Version]
  22. Chazen, J.L.; Gupta, A.; Dunning, A.; Phillips, C.D. Diagnostic accuracy of 4D-CT for parathyroid adenomas and hyperplasia. AJNR Am. J. Neuroradiol. 2012, 33, 429–433. [Google Scholar] [CrossRef] [Green Version]
  23. Day, K.M.; Elsayed, M.; Beland, M.D.; Monchik, J.M. The utility of 4-dimensional computed tomography for preoperative localization of primary hyperparathyroidism in patients not localized by sestamibi or ultrasonography. Surgery 2015, 157, 534–539. [Google Scholar] [CrossRef]
  24. Eller, M.; Dave, A.; Johnson, C.; Fingeret, A.L. Accuracy of 4-Dimensional Computed Tomography for Localization in Primary Hyperparathyroidism. J. Surg. Res. 2020, 257, 15–21. [Google Scholar] [CrossRef] [PubMed]
  25. Ginsburg, M.; Christoforidis, G.A.; Zivin, S.P.; Obara, P.; Wroblewski, K.; Angelos, P.; Grogan, R.H.; Kaplan, E.L. Adenoma localization for recurrent or persistent primary hyperparathyroidism using dynamic four-dimensional CT and venous sampling. J. Vasc. Interv. Radiol. 2015, 26, 79–86. [Google Scholar] [CrossRef]
  26. Hinson, A.M.; Lee, D.R.; Hobbs, B.A.; Fitzgerald, R.T.; Bodenner, D.L.; Stack, B.C. Preoperative 4D CT Localization of Nonlocalizing Parathyroid Adenomas by Ultrasound and SPECT-CT. Otolaryngol. Head Neck Surg. 2015, 153, 775–778. [Google Scholar] [CrossRef]
  27. Krakauer, M.; Wieslander, B.; Myschetzky, P.S.; Lundstrøm, A.; Bacher, T.; Sørensen, C.H.; Trolle, W.; Nygaard, B.; Bennedbæk, F.N. A Prospective Comparative Study of Parathyroid Dual-Phase Scintigraphy, Dual-Isotope Subtraction Scintigraphy, 4D-CT, and Ultrasonography in Primary Hyperparathyroidism. J. Med. Imaging Radiat. Oncol. 2016, 41, 93–100. [Google Scholar] [CrossRef] [PubMed]
  28. Naqvi, S.H.S.; Brooks, K.A.; Knackstedt, M.I.; Eguia, A.A.; Low, G.M.; Jacks, A.E.; Asi, K.W.; Patino, M.O.; Friedman, E.R.; Karni, R.J. 4D-CT facilitates focused parathyroidectomy in patients with primary hyperparathyroidism by maintaining a high negative-predictive value for uninvolved quadrants. Am. J. Otolaryngol. 2020, 41, 102683. [Google Scholar] [CrossRef]
  29. Piccardo, A.; Trimboli, P.; Rutigliani, M.; Puntoni, M.; Foppiani, L.; Bacigalupo, L.; Crescenzi, A.; Bottoni, G.; Treglia, G.; Paparo, F.; et al. Additional value of integrated F-18-choline PET/4D contrast-enhanced CT in the localization of hyperfunctioning parathyroid glands and correlation with molecular profile. Eur. J. Nucl. Med. Mol. Imaging 2019, 46, 766–775. [Google Scholar] [CrossRef] [PubMed]
  30. Pretet, V.; Rotania, M.; Helali, M.; Ignat, M.; Vix, M.; Imperiale, A. F-18-Fluorocholine PET and Multiphase CT Integrated in Dual Modality PET/4D-CT for Preoperative Evaluation of Primary Hyperparathyroidism. J. Clin. Med. 2020, 9, 2005. [Google Scholar] [CrossRef] [PubMed]
  31. Rameau, A.; Eng, S.; Vu, J.; Saket, R.; Jun, P.; Friduss, M. Four-dimensional computed tomography scan utility in parathyroidectomy for primary hyperparathyroidism with low baseline intact parathyroid hormone. Laryngoscope 2017, 127, 1476–1482. [Google Scholar] [CrossRef]
  32. Suh, Y.J.; Choi, J.Y.; Kim, S.J.; Chun, I.K.; Yun, T.J.; Lee, K.E.; Kim, J.H.; Cheon, G.J.; Youn, Y.K. Comparison of 4D CT, Ultrasonography, and Tc-99m Sestamibi SPECT/CT in Localizing Single-Gland Primary Hyperparathyroidism. Otolaryngol. Head Neck Surg. 2015, 152, 438–443. [Google Scholar] [CrossRef]
  33. Wong, K.K.; Fig, L.M.; Gross, M.D.; Dwamena, B.A. Parathyroid adenoma localization with 99mTc-sestamibi SPECT/CT: A meta-analysis. Nucl. Med. Commun. 2015, 36, 363–375. [Google Scholar] [CrossRef]
  34. Mortenson, M.M.; Evans, D.B.; Lee, J.E.; Hunter, G.J.; Shellingerhout, D.; Vu, T.; Edeiken, B.S.; Feng, L.; Perrier, N.D. Parathyroid exploration in the reoperative neck: Improved preoperative localization with 4D-computed tomography. J. Am. Coll. Surg. 2008, 206, 888–895; discussion 895–886. [Google Scholar] [CrossRef]
  35. Hamidi, M.; Sullivan, M.; Hunter, G.; Hamberg, L.; Cho, N.L.; Gawande, A.A.; Doherty, G.M.; Moore, F.D.; Nehs, M.A. 4D-CT is Superior to Ultrasound and Sestamibi for Localizing Recurrent Parathyroid Disease. Ann. Surg. Oncol. 2018, 25, 1403–1409. [Google Scholar] [CrossRef]
  36. Gough, I. Reoperative parathyroid surgery: The importance of ectopic location and multigland disease. ANZ J. Surg. 2006, 76, 1048–1050. [Google Scholar] [CrossRef] [PubMed]
  37. Jaskowiak, N.; Norton, J.A.; Alexander, H.R.; Doppman, J.L.; Shawker, T.; Skarulis, M.; Marx, S.; Spiegel, A.; Fraker, D.L. A prospective trial evaluating a standard approach to reoperation for missed parathyroid adenoma. Ann. Surg. 1996, 224, 308–320. [Google Scholar] [CrossRef] [PubMed]
  38. Bergenfelz, A.O.; Wallin, G.; Jansson, S.; Eriksson, H.; Martensson, H.; Christiansen, P.; Reihner, E. Results of surgery for sporadic primary hyperparathyroidism in patients with preoperatively negative sestamibi scintigraphy and ultrasound. Langenbecks Arch. Surg. 2011, 396, 83–90. [Google Scholar] [CrossRef] [PubMed]
  39. Tian, Y.; Tanny, S.T.; Einsiedel, P.; Lichtenstein, M.; Stella, D.L.; Phal, P.M.; Miller, J.A. Four-Dimensional Computed Tomography: Clinical Impact for Patients with Primary Hyperparathyroidism. Ann. Surg. Oncol. 2018, 25, 117–121. [Google Scholar] [CrossRef] [PubMed]
  40. Forghani, R.; Roskies, M.; Liu, X.; Tan, X.; Mlynarek, A.; Payne, R.J.; Nair, J.R.; Hier, M.P.; Levental, M. Dual-Energy CT Characteristics of Parathyroid Adenomas on 25-and 55-Second 4D-CT Acquisitions: Preliminary Experience. J. Comput. Assist. Tomogr. 2016, 40, 806–814. [Google Scholar] [CrossRef] [PubMed]
  41. Lubitz, C.C.; Hunter, G.J.; Hamberg, L.M.; Parangi, S.; Ruan, D.; Gawande, A.; Gaz, R.D.; Randolph, G.W.; Moore, F.D., Jr.; Hodin, R.A.; et al. Accuracy of 4-dimensional computed tomography in poorly localized patients with primary hyperparathyroidism. Surgery 2010, 148, 1129–1137. [Google Scholar] [CrossRef]
  42. Raghavan, P.; Durst, C.R.; Ornan, D.A.; Mukherjee, S.; Wintermark, M.; Patrie, J.T.; Xin, W.; Shada, A.L.; Hanks, J.B.; Smith, P.W.; et al. Dynamic CT for parathyroid disease: Are multiple phases necessary? AJNR Am. J. Neuroradiol. 2016, 35, 1959–1964. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Campbell, M.J.; Sicuro, P.; Alseidi, A.; Blackmore, C.C.; Ryan, J.A. Two-phase (low-dose) computed tomography is as effective as 4D-CT for identifying enlarged parathyroid glands. Int. J. Surg. 2015, 14, 80–84. [Google Scholar] [CrossRef] [PubMed]
  44. Cotoi, L.; Amzar, D.; Sporea, I.; Borlea, A.; Navolan, D.; Varcus, F.; Stoian, D. Shear Wave Elastography versus Strain Elastography in Diagnosing Parathyroid Adenomas. Int. J. Endocrinol. 2020, 2020, 3801902. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Azizi, G.; Piper, K.; Keller, J.M.; Mayo, M.L.; Puett, D.; Earp, K.M.; Malchoff, C.D. Shear wave elastography and parathyroid adenoma: A new tool for diagnosing parathyroid adenomas. Eur. J. Radiol. 2016, 85, 1586–1593. [Google Scholar] [CrossRef] [Green Version]
  46. Chandramohan, A.; Therese, M.; Abhraham, D.; Paul, T.V.; Mazhuvanchary, P.J. Can ARFI elastography be used to differentiate parathyroid from thyroid lesions? J. Endocrinol. Investig. 2018, 41, 111–119. [Google Scholar] [CrossRef] [Green Version]
  47. Cuderman, A.; Senica, K.; Rep, S.; Hocevar, M.; Kocjan, T.; Sever, M.J.; Zaletel, K.; Lezaic, L. (18)F-Fluorocholine PET/CT in Primary Hyperparathyroidism: Superior Diagnostic Performance to Conventional Scintigraphic Imaging for Localization of Hyperfunctioning Parathyroid Glands. J. Nucl. Med. 2020, 61, 577–583. [Google Scholar] [CrossRef]
  48. Traub-Weidinger, T.; Mayerhoefer, M.E.; Koperek, O.; Mitterhauser, M.; Duan, H.; Karanikas, G.; Niederle, B.; Hoffmann, M. 11C-methionine PET/CT imaging of 99mTc-MIBI-SPECT/CT-negative patients with primary hyperparathyroidism and previous neck surgery. J. Clin. Endocrinol. Metab. 2014, 99, 4199–4205. [Google Scholar] [CrossRef] [Green Version]
  49. Treglia, G.; Piccardo, A.; Imperiale, A.; Strobel, K.; Kaufmann, P.A.; Prior, J.O.; Giovanella, L. Diagnostic performance of choline PET for detection of hyperfunctioning parathyroid glands in hyperparathyroidism: A systematic review and meta-analysis. Eur. J. Nucl. Med. Mol. Imaging 2019, 46, 751–765. [Google Scholar] [CrossRef] [PubMed]
  50. Caldarella, C.; Treglia, G.; Isgro, M.A.; Giordano, A. Diagnostic performance of positron emission tomography using (1)(1)C-methionine in patients with suspected parathyroid adenoma: A meta-analysis. Endocrine 2013, 43, 78–83. [Google Scholar] [CrossRef]
  51. Argiro, R.; Diacinti, D.; Sacconi, B.; Iannarelli, A.; Diacinti, D.; Cipriani, C.; Pisani, D.; Romagnoli, E.; Biffoni, M.; Di Gioia, C.; et al. Diagnostic accuracy of 3T magnetic resonance imaging in the preoperative localisation of parathyroid adenomas: Comparison with ultrasound and 99mTc-sestamibi scans. Eur. Radiol. 2018, 28, 4900–4908. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Flow algorithm of selection for eligible studies.
Figure 1. Flow algorithm of selection for eligible studies.
Diagnostics 11 00664 g001
Figure 2. Methodology of included studies by Quality Assessment of Diagnostic Accuracy Studies 2 tool (QUADAS-2).
Figure 2. Methodology of included studies by Quality Assessment of Diagnostic Accuracy Studies 2 tool (QUADAS-2).
Diagnostics 11 00664 g002
Figure 3. (a) Forest plot of pooled sensitivity and specificity and (b) summary receiver-operating characteristic (ROC) curves of four-dimensional computed tomography (4D-CT) for assessing localization of hyperfunctioning parathyroid glands (HPGs) in primary hyperparathyroidism (pHPT) patients on a per-lesion level. The area under the ROC curves of 4D-CT was 0.81.
Figure 3. (a) Forest plot of pooled sensitivity and specificity and (b) summary receiver-operating characteristic (ROC) curves of four-dimensional computed tomography (4D-CT) for assessing localization of hyperfunctioning parathyroid glands (HPGs) in primary hyperparathyroidism (pHPT) patients on a per-lesion level. The area under the ROC curves of 4D-CT was 0.81.
Diagnostics 11 00664 g003
Figure 4. Forest plot of pooled sensitivity (a) and positive predictive value (PPV) (b) of 4D-CT for localization of HPGs in pHPT patients on a per-patient level, including 0.95 confidence interval (CI).
Figure 4. Forest plot of pooled sensitivity (a) and positive predictive value (PPV) (b) of 4D-CT for localization of HPGs in pHPT patients on a per-patient level, including 0.95 confidence interval (CI).
Diagnostics 11 00664 g004aDiagnostics 11 00664 g004b
Table 1. Basic information of included study characteristics.
Table 1. Basic information of included study characteristics.
SourceCountryStudy
Design
Patient
No.
AgeF/MPrior Neck SurgeryReference Standard
Acar N (2020) TurkeyR17 (33)59.516/1Nohistology + follow up
Amadou C (2019)FranceR19 (29)NANAYeshistology, US-guided FNA
Binks M (2018)AustraliaR13, 21 (165) *NANANAhistology + follow up
Chazen JL (2012)USAR25 (35)NANAYeshistology
Day KM (2015)USAR37 (37)63NAYeshistology + IOPTH
Eichhorn-Wharry LI (2011)USANA135 (135)59.2 ± 13109/26Yeshistology
Eller M (2020)USAR51 (100)NANANooperation + histology
Ginsburg M (2015)USAR22 (28)NANAYeshistology
Hinson AM (2015)USAR19 (19)6616/3Nohistology + follow up
Krakauer M (2016)DenmarkP91 (91)66 67/24Nosurgical findings + histology
Naqvi SHS (2020)USAR68 (68)65.5NANAsurgical findings + histology
Piccardo A (2019)ItalyP31 (44)NANANAhistology + follow up
Pretet V (2020)FranceR44 (50)NANAYeshistology + IOPTH + follow up
Rameau A (2016)USAR14 (14)57.612/2Nosurgical reports + histology
Suh YJ (2015)KoreaR38 (38)55.8 ±13.227/11Nosurgical reports + histology
Yeh R (2019)USAR400 (400)61 ± 14 319/81Nosurgical reports + histology
NOTE: NA—not available, No.—Number R—Retrospective P—Prospective, Patient No.—included patients (total patients), IOPTH—Intraoperative parathyroid hormone. *—This study reported 4D-CT was used as both first and second line examination for two different group of patients.
Table 2. Technical aspects.
Table 2. Technical aspects.
SourceMachine ModelDetectorProductInjection
Rate (mL/s)
DoseSlice
Thickness
Scan
Phase
Imaging Procedure
Acar N (2020)Siemens Somatom 128IodineNA1 mL/kgNA42
Amadou C (2019)NANANANANANA32
Binks M (2018)NANANANANANA3both
Chazen JL (2012)GE LightSpeed 16, 64Omnipaque42 mL/kg
120 mL max
1.25 mm31
Day KM (2015)GE LightSpeed 64Omnipaque3100 mL0.625 mmboth2
Eichhorn-Wharry LI (2011)GE 16, VCT Lightspeed16OptirayNA100 mL1.25 mm31
Eller M (2020)NANANANANANANA2
Ginsburg M (2015)Philips Brilliance64, 256 Omnipaque4120 mL0.9 mm42
Hinson AM (2015)Philips 64nonionic contrast375 mLNA42
Krakauer M (2016)Philips Skylight16Omnipaque3.5100 mL2 mm31
Naqvi SHS (2020)NANANANANANANA1
Piccardo A (2019)NA16Iohexol, Iodine3.3–480–100 mL
350 mg
1.25 mm32
Pretet V (2020)Philips Biograph 128Iomeron2.5–375 mL1 mm42
Rameau A (2016)GE LightSpeed, VCT16, 64Omnipaque4100–120 mL1.25 mm31
Suh YJ (2015)Philips Brilliance 64XeneticsNA90 mL2 mm41
Yeh R (2019)Siemens Symbia T16Omnipaque475 mL1 mm31
NOTE: Imaging procedure: 1—first line, 2—s line, Scan phase: 3—three phases, 4—four phases.
Table 3. Diagnostic accuracy of four-dimensional computed tomography (4D-CT) for localization of hyperfunctioning parathyroid glands (HPGs).
Table 3. Diagnostic accuracy of four-dimensional computed tomography (4D-CT) for localization of hyperfunctioning parathyroid glands (HPGs).
SourcePatient No.True PositivesFalse PositivesFalse NegativesTrue NegativesLBPB
Acar N (2020)17 (33)90951
Amadou C (2019)19 (29)12342
12070
Binks M (2018a)21 (165)18130
Binks M (2018b)13 (165)10030
Chazen JL (2012)25 (35)120211
Day KM (2015)37 (37)25930
Eichhorn-Wharry LI (2011)135 (135)531133NA
Eller M (2020)51 (100)36555
Ginsburg M (2015)22 (28)100102
Hinson AM (2015)19 (19)135454
Krakauer M (2016)91 (91)563741230
493600
Naqvi SHS (2020)68 (68)60914194
Piccardo A (2019)31 (44)23080
Pretet V (2020)44 (50)336170
33470
Rameau A (2016)14 (14)16130
11120
Suh YJ (2015)38 (38)3553109
Yeh R (2019)400 (400)414471081031
NOTE: LB—lesion-based, PB—patient-based.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Sun, L.; Yao, J.; Hao, P.; Yang, Y.; Liu, Z.; Peng, R. Diagnostic Role of Four-Dimensional Computed Tomography for Preoperative Parathyroid Localization in Patients with Primary Hyperparathyroidism: A Systematic Review and Meta-Analysis. Diagnostics 2021, 11, 664. https://doi.org/10.3390/diagnostics11040664

AMA Style

Sun L, Yao J, Hao P, Yang Y, Liu Z, Peng R. Diagnostic Role of Four-Dimensional Computed Tomography for Preoperative Parathyroid Localization in Patients with Primary Hyperparathyroidism: A Systematic Review and Meta-Analysis. Diagnostics. 2021; 11(4):664. https://doi.org/10.3390/diagnostics11040664

Chicago/Turabian Style

Sun, Lixin, Jian Yao, Pan Hao, Yuanyuan Yang, Zhimou Liu, and Ruchen Peng. 2021. "Diagnostic Role of Four-Dimensional Computed Tomography for Preoperative Parathyroid Localization in Patients with Primary Hyperparathyroidism: A Systematic Review and Meta-Analysis" Diagnostics 11, no. 4: 664. https://doi.org/10.3390/diagnostics11040664

APA Style

Sun, L., Yao, J., Hao, P., Yang, Y., Liu, Z., & Peng, R. (2021). Diagnostic Role of Four-Dimensional Computed Tomography for Preoperative Parathyroid Localization in Patients with Primary Hyperparathyroidism: A Systematic Review and Meta-Analysis. Diagnostics, 11(4), 664. https://doi.org/10.3390/diagnostics11040664

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop