Next Article in Journal
Simulation of Ultrasound RF Signals Backscattered from a 3D Model of Pulsating Artery Surrounded by Tissue
Next Article in Special Issue
Urethral Sphincter Length but Not Prostatic Apex Shape in Preoperative MRI Is Associated with Mid-Term Continence Rates after Radical Prostatectomy
Previous Article in Journal
Lesion Volume Quantification Using Two Convolutional Neural Networks in MRIs of Multiple Sclerosis Patients
Previous Article in Special Issue
Comparison of Accuracies between Real-Time Nonrigid and Rigid Registration in the MRI–US Fusion Biopsy of the Prostate
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Diagnostics
Volume 12
Issue 2
10.3390/diagnostics12020231
diagnostics-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Diagnostic Accuracy of Abbreviated Bi-Parametric MRI (a-bpMRI) for Prostate Cancer Detection and Screening: A Multi-Reader Study

by
Giorgio Brembilla
1,2,*,
Francesco Giganti
3,4,
Harbir Sidhu
1,
Massimo Imbriaco
5,
Sue Mallett
1,
Armando Stabile
6,
Alex Freeman
7,
Hashim U. Ahmed
8,9,
Caroline Moore
4,10,
Mark Emberton
4,10 and
Shonit Punwani
1
1
Centre for Medical Imaging, University College London, London W1W 7TS, UK
2
Department of Radiology, IRCCS San Raffaele Scientific Institute, Vita-Salute San Raffaele University, 20132 Milan, Italy
3
Department of Radiology, University College London Hospital NHS Foundation Trust, London NW1 2PG, UK
4
Division of Surgery & Interventional Science, University College London, London NW3 2PS, UK
5
Department of Advanced Biomedical Sciences, University Federico II, 80131 Naples, Italy
6
Department of Urology and Division of Experimental Oncology, Urological Research Institute, Vita-Salute San Raffaele University, IRCCS San Raffaele Scientific Institute, 20132 Milan, Italy
7
Department of Pathology, University College London Hospital NHS Foundation Trust, London NW1 2BU, UK
8
Imperial Urology, Charing Cross Hospital, Imperial College Healthcare NHS Trust, London W6 8RF, UK
9
Imperial Prostate, Division of Surgery, Department of Surgery & Cancer, Faculty of Medicine, Imperial College London, London SW7 2BX, UK
10
Department of Urology, University College London Hospitals NHS Foundation Trust, London NW1 2PG, UK
*
Author to whom correspondence should be addressed.
Diagnostics 2022, 12(2), 231; https://doi.org/10.3390/diagnostics12020231
Submission received: 30 November 2021 / Revised: 7 January 2022 / Accepted: 12 January 2022 / Published: 18 January 2022
(This article belongs to the Special Issue MRI in Prostate Cancer: New Evidences and Future Perspectives)
Versions Notes

Abstract

:
(1) Background: There is currently limited evidence on the diagnostic accuracy of abbreviated biparametric MRI (a-bpMRI) protocols for prostate cancer (PCa) detection and screening. In the present study, we aim to investigate the performance of a-bpMRI among multiple readers and its potential application to an imaging-based screening setting. (2) Methods: A total of 151 men who underwent 3T multiparametric MRI (mpMRI) of the prostate and transperineal template prostate mapping biopsies were retrospectively selected. Corresponding bpMRI (multiplanar T2WI, DWI, ADC maps) and a-bpMRI (axial T2WI and b 2000 s/mm2 DWI only) dataset were derived from mpMRI. Three experienced radiologists scored a-bpMRI, standard biparametric MRI (bpMRI) and mpMRI in separate sessions. Diagnostic accuracy and interreader agreement of a-bpMRI was tested for different positivity thresholds and compared to bpMRI and mpMRI. Predictive values of a-bpMRI were computed for lower levels of PCa prevalence to simulate a screening setting. The primary definition of clinically significant PCa (csPCa) was Gleason ≥ 4 + 3, or cancer core length ≥ 6 mm. (3) Results: The median age was 62 years, the median PSA was 6.8 ng/mL, and the csPCa prevalence was 40%. Using a cut off of MRI score ≥ 3, the sensitivity and specificity of a-bpMRI were 92% and 48%, respectively. There was no significant difference in sensitivity compared to bpMRI and mpMRI. Interreader agreement of a-bpMRI was moderate (AC1 0.58). For a low prevalence of csPCa (e.g., <10%), higher cut offs (MRI score ≥ 4) yield a more favourable balance between the predictive values and positivity rate of MRI. (4) Conclusion: Abbreviated bpMRI protocols could match the diagnostic accuracy of bpMRI and mpMRI for the detection of csPCa. If a-bpMRI is used in low-prevalence settings, higher cut-offs for MRI positivity should be prioritised.

1. Introduction

Multiparametric magnetic resonance imaging (mpMRI) plays a well-established role in the diagnostic workup of prostate cancer (PCa) [1]. The standard mpMRI protocol consists of multi-planar T2-weighted imaging (T2WI), diffusion-weighted imaging (DWI) and dynamic contrast-enhanced (DCE) sequences [2]. Given the constantly increasing demand for prostate MRI, the long scan times and high costs of mpMRI are limiting its widespread adoption in clinical practice; furthermore, concerns have been raised regarding the use of gadolinium-based contrast media [3]. As a consequence, shorter non-contrast protocols (i.e., bi-parametric MRI, bpMRI) may represent a potential solution to address these issues of mpMRI. Of note, evidence is accumulating that bpMRI may perform as well as mpMRI for PCa detection [4,5].
Moreover, interest has recently grown over prostate MRI as a tool for PCa screening [6,7,8,9,10]. In this scenario, where shorter scan lengths would have important health economic implications, abbreviated bpMRI (a-bpMRI) protocols could further improve MRI accessibility and reduce costs [11]. However, evidence on their diagnostic performance is limited, and potential limitations of abbreviated protocols (such as an increased number of indeterminate findings) should be considered. In addition, the optimal scoring approach for a-bpMRI protocols should be defined and tailored to the screening setting in terms of optimal cut-off scores and interpretation strategies (e.g., single versus double reading) [12].
To address these open questions, the aim of the present study is to investigate the diagnostic accuracy of a-bpMRI (<10 min scan) using template prostate mapping biopsies (TTPM) as the reference standard and to determine the best scoring approach to be used in a screening setting.

2. Materials & Methods

This study was conducted retrospectively on datasets acquired between 2012 and 2014 in the Prostate Imaging Compared to Transperineal Ultrasound-guided biopsy for significant prostate cancer Risk Evaluation (PICTURE) study [13], a paired-cohort confirmatory study designed to assess the diagnostic accuracy of mpMRI in men undergoing TTPM and targeted biopsy. Ethical approval for the original study was granted by London City Road and Hampstead National research ethics committee REC reference 11/LO/1657.
Inclusion and exclusion criteria, along with the complete study protocol, have been previously described [14]; briefly, treatment-naïve men were eligible for the study if they had undergone prior TRUS biopsy and were advised to undergo further biopsies as part of standard care.
Among the total participants to PICTURE (n = 249), 151 patients were involved in the present study. Patient selection was carried out blinded to clinical data and MRI findings, and with knowledge of the biopsy results, to obtain a predetermined prevalence of clinically significant cancer (i.e., 50% prevalence of Gleason 3 + 4 on TTPM biopsy), similar to that observed in another prospective, a TTPM-based cohort of men with clinical suspicion of PCa [15].

2.1. Imaging Protocols

All men underwent 3T mpMRI with a pelvic-phased array coil. The clinical mpMRI protocol consisted of the following sequences: axial and coronal T2WI, DWI including high b-value (b 2000 s/mm2) and apparent diffusion coefficient (ADC) map using multiple b-values (b 0, 150, 500, 1000 s/mm2), T1WI, and dynamic contrast enhancement with gadolinium (Magnevist). The total duration of the clinical mpMRI protocol was 28 min and 14 s (Table 1). Sequence details are reported in Supplementary Table S1.
The a-bpMRI dataset was generated separately from the original mpMRI dataset; a-bpMRI included axial T2WI and b 2000 s/mm2 DWI sequences only (estimated duration: 9 min and 13 s) (Table 1).

2.2. Image Analysis

All scans were reviewed by three dedicated radiologists (FG, MI, HS), all with more than 7 years of experience in prostate MRI reporting. Readers were blinded to clinical information, original mpMRI reports, and biopsy results. The review process was two-fold: first, a session for a-bpMRI reporting; then a second session for bpMRI and mpMRI reporting, with an interval of 5 months between the two sessions. No feedback was provided to the readers until the end of the study.
First session: abbreviated biparametric MRI
A-bpMRI scans were reported using a 5-point Likert scale for the likelihood of the presence of clinically significant cancer (1: highly unlikely; 2: unlikely; 3: equivocal; 4: likely; 5: highly likely) [16]. Likert scales are recommended for use in the UK by a consensus panel [17] and recent UK National Institute for Health and Care Excellence (NICE) guidance [18]; they were used for a-bpMRI scoring in the ReIMAGINE screening study [9]. The following information was also collected: image quality of T2WI and DWI sequences (i.e., clear delineation of anatomical structures, no major artefact preventing sequence interpretation), and Likert scores for individual T2WI/DWI sequences.
Second session: biparametric and multiparametric MRI
During the second session, readers first scored the bpMRI images, and then the full protocol (including DCE) was revealed for mpMRI scoring. BpMRI and mpMRI scans were reported using both Likert and PI-RADS v 2.1 score.

2.3. Histopathologic Assessment

All men underwent TTPM biopsies regardless of the MRI results within the PICTURE study [13]. Biopsies were performed using a brachytherapy grid fixed on a stepper, with cores taken every 5 mm. All biopsies were reported by one of two uropathologists with more than 20 years of experience, blinded to the mpMRI reports.
Clinically significant cancer was defined by criteria developed and validated for TTPM biopsies [19]. The primary definition (definition 1) of csPCa was considered the presence of dominant Gleason pattern 4 or greater (i.e., Gleason ≥ 4 + 3) or a cancer core length (CCL) involvement of ≥6 mm of any Gleason score. Alternative definitions were: (i) Gleason ≥ 3 + 4 and/or CCL ≥ 4 mm (definition 2), and (ii) presence of any Gleason ≥ 7.

2.4. Study Objectives

The primary objective of the study was to assess the diagnostic performance of a-bpMRI, alone and in comparison to bpMRI and mpMRI. The secondary objectives were: to assess interreader agreement of different MRI protocols, to investigate which lesions are missed by MRI using different protocols, to assess the performance of a-bpMRI for different cutoffs of MRI positivity, to simulate the performance of a-bpMRI in a low prevalence setting (e.g., screening), and to assess the performance of a double-reading approach.

2.5. Statistical Analyses

Contingency tables were used to calculate the diagnostic accuracy of the tests on a patient level for a cut off of MRI score ≥ 3: sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and MRI positivity rate (i.e., proportion of men with positive MRI finding according to cut-off score) were reported with 95% confidence intervals. True-positive, false-positive, true-negative, and false-negative results from each reader were combined by simple pooling to calculate diagnostic accuracy measures. Differences in sensitivity and specificity between a-bpMRI, bpMRI, and mpMRI were assessed using McNemar’s test, while differences in predictive values were assessed using a general estimating equation logistic regression model [20,21].
The diagnostic accuracy of a-bpMRI was then tested using alternative cut-off scores: (1) overall MRI score ≥ 4, and (2) the presence of any lesion with both T2WI and DWI scores ≥ 4. A-bpMRI scores from each reader were evaluated both individually and in combination (referred to as “combined scores”) to simulate a double-reading approach in which two radiologists report independently with a third reviewer involved when there is disagreement.
Finally, sensitivity and specificity values of a-bpMRI were used to predict the variation of PPV, NPV, and MRI positivity rates (i.e., the proportion of men with a positive MRI over the total of men undergoing MRI) for a lower prevalence of csPCa (2, 5, and 10%) [22].
Interobserver agreement was assessed using Gwet’s agreement coefficient 1 (AC1) and percentage of agreement (PA) [23,24]. Levels of agreement were interpreted using the classification of Landis and Koch [25].
Statistical tests were performed using RStudio graphical interface for R software v.4.0.2 (R Foundation, Vienna, Austria) and AgreeStat v.2015.6 (AgreeStat Analytics, Gaithersburg, MD, USA).

3. Results

3.1. Baseline Characteristics

A summary of the baseline demographic data of the men included in this study is presented in Table 2; the median age was 62 years (range: 41–83), and the median PSA was 6.8 ng/mL (range: 0.9–28.5). The prevalence of clinically significant cancer at TTPM biopsy was 60/151 (40%) according to definition 1, 95/151 (63%) according to definition 2, and 76/151 (50%) for any Gleason ≥ 7.

3.2. Diagnostic Accuracy of MRI

On a-bpMRI, axial T2WI sequences were judged to be of good diagnostic quality by all readers for all patients; DWI sequences were judged to be of low diagnostic quality in 10, 5, and 11 patients by the three readers, respectively, due to the presence of image artefacts.
The sensitivity, specificity, PPV, and NPV of a-bpMRI with a cut-off of MRI score ≥ 3 for the detection of definition 1 csPCa were 92% (95%—CI: 87–96), 48% (95%—CI 42–54), 54% (95%—CI: 48–60), and 90% (95%—CI: 84–95), respectively; there was no significant difference in sensitivity and NPV between a-bpMRI, bpMRI, and mpMRI (Table 3). The diagnostic accuracy of MRI for alternative definitions of csPCa is reported in Supplementary Table S2.
The proportions of MRI scores (1–2, 3, and 4–5) were similar for a-bpMRI, bpMRI, and mpMRI PI-RADS scores (32, 14, and 54% vs. 37, 13, and 50% vs. 36, 14, and 50%, respectively). A higher proportion of MRI score 3 was observed for bpMRI-mpMRI when using Likert scores (up to a 7% increase) (Supplementary Figure S1).

3.3. A-bpMRI: Alternative Cut-Offs and Combined Scores

Higher MRI cut-offs (MRI score ≥ 4 or higher) were associated with lower sensitivity (range: 70–83%) and higher specificity (range: 64–76%) for csPCa detection (Table 4; Supplementary Table S3); combined scores yielded slightly better performance, even if the difference was not significant.

3.4. Missed csPCa

Most of the lesions missed by mpMRI and a-bpMRI were of low-to-intermediate grade (Gleason 3 + 3 or 3 + 4; range n = 2–6), while one Gleason 4 + 3 tumour was missed by all MRI protocols regardless of the MRI cut-off (Supplementary Table S4). The number of missed high-grade tumours did not increase with a-bpMRI compared to mpMRI (n = 1). Conversely, it increased when a cut-off of MRI score ≥ 4, on both T2W and DWI, was used for a-bpMRI (n = 3, i.e., 2 additional Gleason 4 + 3 tumours).

3.5. Interreader Agreement

Interreader agreement of a-bpMRI was moderate and lower than mpMRI PI-RADS scores (PA: 76 vs. 81%; AC1 0.58 vs. 0.65, respectively); however, it was comparable to that of bpMRI (Supplementary Table S5). Agreement on a-bpMRI scores increased with higher positivity thresholds and was as high as 82% (CI—95%: 77–87; AC1 0.64, CI—95% 0.53–0.72) for a cut-off of MRI score ≥ 4 on both T2WI and DWI (Supplementary Table S6).

3.6. a-bpMRI and csPCa Prevalence

Assuming the sensitivity and specificity of MRI remained constant, predictive values were simulated for variable levels of csPCa prevalence (10, 5, and 2%). At lower levels of prevalence, PPV decreased while NPV increased; for a hypothetic csPCa prevalence of 5% as described in screening populations [26], NPV was very high (range: 98–100%) regardless the MRI cut-off used (Table 5; Supplementary Table S7). Higher MRI cut-offs were associated to lower positivity rates of MRI (Table 5).

4. Discussion

The present study provided evidence that an abbreviated biparametric MRI protocol consisting in axial T2WI and high b-value DWI sequences only (<10 min scan time) could match the performance of full biparametric and multiparametric MRI protocols for the detection of csPCa when interpreted by experienced radiologists. Our findings support emerging evidence on the limited utility of DCE for PCa detection [27,28], and are in line with similar studies that investigated abbreviated bpMRI protocols [11,29,30,31,32,33].
Fast MRI protocols that can be performed in less than 10 minutes could have a favorable impact on costs and accessibility of MRI [11]. As a consequence, bpMRI has recently drawn attention as a potential tool for imaging-based PCa screening, comparable to mammography for breast cancer or low-dose CT scan for lung cancer [6,7,8,9,10]. However, the screening setting is different from that of secondary care, where prostate MRI was developed, and little is known about the impact on MRI performance; notably, the prevalence of csPCa in the general population is significantly lower than in men with a clinical suspicion of PCa [26]. In this setting, attention should be focused on ruling out significant PCa while minimizing the number of positive MRI to avoid unnecessary interventions [3]. One of the most straightforward ways to achieve this goal is to use higher thresholds for MRI positivity. Accordingly, we simulated the performance of a-bpMRI at lower prevalence levels, and we observed that higher cut-offs (e.g., MRI score ≥ 4 or higher) yield a more acceptable balance between sensitivity and specificity, significantly reducing the proportion of positive scans and false-positive findings (Table 5). Concurrently, the NPV is expected to remain high (>97%) due to the low prevalence of the disease.
These numbers compare favorably with other established screening modalities; for lung cancer screening using low-dose CT, positivity rates of 27% and overall PPV of approximately 4% have been reported [34]. However, our findings should not be considered an exact prediction of the accuracy of MRI in a screening setting; instead, they are intended to provide an insight into the effect that different MRI cut-offs, scoring approaches, and disease prevalence have on the ability to predict the presence/absence of csPCa, in order to guide future applications of MRI for PCa screening. Real numbers are likely to be affected by true prevalence (which will vary with age and patient selection), prior tests, patient setting, scoring systems, biopsy techniques, and definitions of csPCa. In the recently published IP1-PROSTAGRAM study, where MRI was used as a primary screening test [8], a total of 17 clinically significant cancers were found in the 406 men screened (observed prevalence: 4.2%). Out of 406 men, 43 had a positive MRI using a cut-off of PI-RADS score 4–5 (scan positive rate: 10.6%); among these, csPCa was found in 11/43 men (PPV: 25.6%). Interestingly, these data overlap with those predicted in our study for a 5% prevalence of definition 2 csPCa (Supplementary Table S7).
One of the major drawbacks associated with the use of abbreviated MRI protocols is the potential increase in equivocal findings (i.e., PI-RADS/Likert score = 3) [11,35]. In our study, a-bpMRI did not lead to an increased number of equivocal findings compared to standard bpMRI and mpMRI, possibly due to the high experience of readers in prostate MRI interpretation. Moreover, the impact of equivocal scores would be negligible if a cut off of MRI score ≥ 4 is used [8]. Conversely, we observed lower interobserver agreement of a-bpMRI compared to previous reports [11,36]. One possible explanation is that T2WI, DWI, and DCE have an incremental value on lesion visibility, and the absence of multiplanar T2WI and ADC maps from our a-bpMRI protocol may have decreased the confidence of readers in determining MRI scores [37]. Furthermore, the use of Likert instead of PI-RADS for a-bpMRI could have played a role (Supplementary Table S5) [38].
In our study, we also simulated the performance of a double-reading approach (i.e., two radiologists report the MRI independently, with a third reviewer involved in case of disagreement), that replicates the methodology used for screening mammography [39]. We did not observe any significant benefit, or disadvantage, in terms of diagnostic performance of combined vs. individual reads (Table 4); however, this approach could still be considered as a potential solution to reduce the variability in MRI interpretation of abbreviated protocols; moreover, second reads could represent a future application of artificial intelligence tools [40].
A main strength of our study is that all patients underwent mapping biopsies regardless of the MRI results, increasing the reliability of sensitivity and specificity estimates compared to conventional targeted biopsy cohorts. Second, the multireader design averages the variable reader performance that can be encountered in the clinical routine, increasing the generalisability of the results. Third, a-bpMRI and bp/mpMRI were reported in two different sessions separated by a wash-out period. This may enhance the detection of small differences in the diagnostic accuracy between different study protocols when compared to standard sequential reading, wherein the results of one test will be invariably influenced by the other.
This study also has several limitations. First, patients were selected from a broader cohort of men included in a prospective trial [13], potentially introducing a selection bias. However, the demographics and csPCa prevalence were similar to those of other studies based on unselected populations [15], supporting the generalisability of our cohort.
Second, although we did not find significant differences in the performance of a-bpMRI, bpMRI, and mpMRI, the study was not specifically powered to detect such small differences, and our findings must be confirmed by larger studies. Third, Likert scores were used for a-bpMRI reporting, limiting the reproducibility of our results and the comparison with PI-RADS scores. However, although PI-RADS can be applied to bpMRI, this scoring system has not been conceived for short protocols (i.e.,: monoplanar, no ADC maps) [2]. Fourth, all the readers involved in the study are experienced readers from high volume centers, a factor that limits the applicability of our results to low-volume settings and less-experienced readers.

5. Conclusions

Abbreviated biparametric MRI (<10 min scan) can be as accurate as mpMRI for the detection of csPCa in the diagnostic setting when interpreted by expert readers. As far as the scan time, availability, cost, and acceptability are concerned, one might argue that an a-bpMRI could be the ideal tool for imaging-based screening programs for PCa. If used for this purpose, higher cut-offs (MRI score ≥ 4) could yield a more favorable balance between PCa detection and false-positive rates and could be preferred over lower cut-offs (MRI score ≥ 3). A double-reading approach might be considered to address the variability of MRI interpretation.

Supplementary Materials

Supplementary Materials: The following are available online at https://www.mdpi.com/article/10.3390/diagnostics12020231/s1, Figure S1: Proportions of MRI scores, Table S1: MRI protocol details, Table S2: Diagnostic accuracy of MRI, Table S3: Diagnostic accuracy of a-bpMRI (combined scores), Table S4: Clinically significant lesions (definition 1) missed by MRI, Table S5: Interreader agreement (cut off: MRI score 3), Table S6: Interreader agreement of a-bpMRI using alternative MRI cut-offs, Table S7: NPV and positivity rates of abbreviated bp-MRI (a-bpMRI) according to clinically significant PCa prevalence.

Author Contributions

Conceptualization, G.B., S.P. and C.M.; methodology, G.B. and S.P.; validation, all the authors; formal analysis, G.B., S.P. and S.M.; investigation, G.B., F.G., M.I. and H.S.; resources, S.P., C.M., M.E. and H.U.A.; data curation, G.B.; writing—original draft preparation, G.B., S.P. and F.G.; writing—review and editing, all the authors; visualization, G.B., S.P. and F.G.; supervision, S.P.; project administration, G.B. and S.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the London City Road and Hampstead National Research Ethics Committee (reference 11/LO/1657).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data are not publicly available due to regulatory restrictions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kasivisvanathan, V.; Rannikko, A.S.; Borghi, M.; Panebianco, V.; Mynderse, L.A.; Vaarala, M.H.; Briganti, A.; Budäus, L.; Hellawell, G.; Hindley, R.G.; et al. MRI-targeted or standard biopsy for prostate-cancer diagnosis. N. Engl. J. Med. 2018, 378, 1767–1777. [Google Scholar] [CrossRef] [PubMed]
  2. Turkbey, B.; Rosenkrantz, A.B.; Haider, M.A.; Padhani, A.R.; Villeirs, G.; Macura, K.J.; Tempany, C.M.; Choyke, P.L.; Cornud, F.; Margolis, D.J.; et al. Prostate imaging reporting and data system version 2.1: 2019 update of prostate imaging reporting and data system version 2. Eur. Urol. 2019, 76, 340–351. [Google Scholar] [CrossRef] [PubMed]
  3. Schoots, I.G.; Barentsz, J.O.; Bittencourt, L.K.; Haider, M.A.; Macura, K.J.; Margolis, D.J.A.; Moore, C.M.; Oto, A.; Panebianco, V.; Siddiqui, M.M.; et al. PI-RADS Committee position on MRI without contrast medium in biopsy-naive men with suspected prostate cancer: Narrative review. AJR. Am. J. Roentgenol. 2021, 216, 3–19. [Google Scholar] [CrossRef] [PubMed]
  4. Kang, Z.; Min, X.; Weinreb, J.; Li, Q.; Feng, Z.; Wang, L. Abbreviated biparametric versus standard multiparametric MRI for diagnosis of prostate cancer: A systematic review and meta-analysis. Am. J. Roentgenol. 2019, 212, 357–365. [Google Scholar] [CrossRef] [PubMed]
  5. Jambor, I.; Verho, J.; Ettala, O.; Knaapila, J.; Taimen, P.; Syvänen, K.T.; Kiviniemi, A.; Kähkönen, E.; Perez, I.M.; Seppänen, M.; et al. Validation of improd biparametric mri in men with clinically suspected prostate cancer: A prospective multi-institutional trial. PLoS Med. 2019, 16, e1002813. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Nam, R.K.; Wallis, C.J.D.; Stojcic-Bendavid, J.; Milot, L.; Sherman, C.; Sugar, L.; Haider, M.A. A pilot study to evaluate the role of magnetic resonance imaging for prostate cancer screening in the general population. J. Urol. 2016, 196, 361–366. [Google Scholar] [CrossRef] [PubMed]
  7. Eklund, M.; Jäderling, F.; Discacciati, A.; Bergman, M.; Annerstedt, M.; Aly, M.; Glaessgen, A.; Carlsson, S.; Grönberg, H.; Nordström, T. MRI-targeted or standard biopsy in prostate cancer screening. N. Engl. J. Med. 2021, 385, 908–920. [Google Scholar] [CrossRef]
  8. Eldred-Evans, D.; Burak, P.; Connor, M.; Day, E.; Evans, M.; Fiorentino, F.; Gammon, M.; Hosking-Jervis, F.; Klimowska- Nassar, N.; McGuire, W.; et al. Population-based prostate cancer screening with magnetic resonance or ultrasound imaging: The IP1-PROSTAGRAM study. JAMA Oncol. 2021, 7, 395–402. [Google Scholar] [CrossRef]
  9. Marsden, T.; Lomas, D.J.; McCartan, N.; Hadley, J.; Tuck, S.; Brown, L.; Haire, A.; Moss, C.L.; Green, S.; Van Hemelrijck, M.; et al. ReIMAGINE prostate cancer screening study: Protocol for a single-centre feasibility study inviting men for prostate cancer screening using MRI. BMJ Open 2021, 11, e048144. [Google Scholar] [CrossRef]
  10. Marsden, T.; McCartan, N.; Hadley, J.; Tuck, S.; Brown, L.; Haire, A.J.; Moss, C.L.; Green, S.; Van Hemelrijck, M.; Coolen, T.; et al. Update from the ReIMAGINE prostate cancer screening study NCT04063566: Inviting men for prostate cancer screening using magnetic resonance imaging. Eur. Urol. Focus 2021, 7, 503–505. [Google Scholar] [CrossRef]
  11. Van der Leest, M.; Israël, B.; Cornel, E.B.; Zámecnik, P.; Schoots, I.G.; van der Lelij, H.; Padhani, A.R.; Rovers, M.; van Oort, I.; Sedelaar, M.; et al. High diagnostic performance of short magnetic resonance imaging protocols for prostate cancer detection in biopsy-naïve men: The next step in magnetic resonance imaging accessibility. Eur. Urol. 2019, 76, 574–581. [Google Scholar] [CrossRef]
  12. Eldred-Evans, D.; Tam, H.; Sokhi, H.; Padhani, A.R.; Winkler, M.; Ahmed, H.U. Rethinking prostate cancer screening: Could MRI be an alternative screening test? Nat. Rev. Urol. 2020, 17, 526–539. [Google Scholar] [CrossRef]
  13. Simmons, L.A.M.; Kanthabalan, A.; Arya, M.; Briggs, T.; Barratt, D.; Charman, S.C.; Freeman, A.; Gelister, J.; Hawkes, D.; Hu, Y.; et al. The PICTURE study: Diagnostic accuracy of multiparametric MRI in men requiring a repeat prostate biopsy. Br. J. Cancer 2017, 116, 1159–1165. [Google Scholar] [CrossRef]
  14. Simmons, L.A.M.; Ahmed, H.U.; Moore, C.M.; Punwani, S.; Freeman, A.; Hu, Y.; Barratt, D.; Charman, S.C.; der Meulen, J.; Emberton, M. The PICTURE study—Prostate imaging (multi-parametric MRI and Prostate HistoScanningTM) compared to transperineal ultrasound guided biopsy for significant prostate cancer risk evaluation. Contemp. Clin. Trials 2014, 37, 69–83. [Google Scholar] [CrossRef]
  15. Ahmed, H.U.; El-Shater Bosaily, A.; Brown, L.C.; Gabe, R.; Kaplan, R.; Parmar, M.K.; Collaco-Moraes, Y.; Ward, K.; Hindley, R.G.; Freeman, A.; et al. Diagnostic accuracy of multi-parametric MRI and TRUS biopsy in prostate cancer (PROMIS): A paired validating confirmatory study. Lancet 2017, 389, 815–822. [Google Scholar] [CrossRef] [Green Version]
  16. Latifoltojar, A.; Appayya, M.B.; Barrett, T.; Punwani, S. Similarities and differences between Likert and PIRADS v2.1 scores of prostate multiparametric MRI: A pictorial review of histology-validated cases. Clin. Radiol. 2019, 74, e895-e1. [Google Scholar] [CrossRef]
  17. Brizmohun Appayya, M.; Adshead, J.; Ahmed, H.U.; Allen, C.; Bainbridge, A.; Barrett, T.; Giganti, F.; Graham, J.; Haslam, P.; Johnston, E.W.; et al. National implementation of multi-parametric magnetic resonance imaging for prostate cancer detection—Recommendations from a UK consensus meeting. BJU Int. 2018, 122, 13–25. [Google Scholar] [CrossRef] [Green Version]
  18. NICE Guidance. Prostate cancer: Diagnosis and management. BJU Int. 2019, 124, 9–26. [Google Scholar] [CrossRef]
  19. Ahmed, H.U.; Hu, Y.; Carter, T.; Arumainayagam, N.; Lecornet, E.; Freeman, A.; Hawkes, D.; Barratt, D.C.; Emberton, M. Characterizing clinically significant prostate cancer using template prostate mapping biopsy. J. Urol. 2011, 186, 458–464. [Google Scholar] [CrossRef]
  20. Leisenring, W.; Alonzo, T.; Pepe, M.S. Comparisons of predictive values of binary medical diagnostic tests for paired designs. Biometrics 2000, 56, 345–351. [Google Scholar] [CrossRef] [PubMed]
  21. Wang, W.; Davis, C.S.; Soong, S.J. Comparison of predictive values of two diagnostic tests from the same sample of subjects using weighted least squares. Stat. Med. 2006, 25, 2215–2229. [Google Scholar] [CrossRef] [PubMed]
  22. Altman, D.G.; Bland, J.M. Statistics notes: Diagnostic tests 2: Predictive values. BMJ 1994, 309, 102. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Gwet, K.L. Computing inter-rater reliability and its variance in the presence of high agreement. Br. J. Math. Stat. Psychol. 2008, 61, 29–48. [Google Scholar] [CrossRef] [Green Version]
  24. Cicchetti, D.V.; Feinstein, A.R. High agreement but low kappa: II. Resolving the paradoxes. J. Clin. Epidemiol. 1990, 43, 551–558. [Google Scholar] [CrossRef]
  25. Landis, J.R.; Koch, G.G. The measurement of observer agreement for categorical data. Biometrics 1977, 33, 159–174. [Google Scholar] [CrossRef] [Green Version]
  26. Thompson, I.M.; Pauler, D.K.; Goodman, P.J.; Tangen, C.M.; Lucia, M.S.; Parnes, H.L.; Minasian, L.M.; Ford, L.G.; Lippman, S.M.; Crawford, E.D.; et al. Prevalence of prostate cancer among men with a prostate-specific antigen level ≤ 4.0 ng per milliliter. N. Engl. J. Med. 2004, 350, 2239–2246. [Google Scholar] [CrossRef] [Green Version]
  27. Bosaily, A.E.S.; Frangou, E.; Ahmed, H.U.; Emberton, M.; Punwani, S.; Kaplan, R.; Brown, L.C.; Freeman, A.; Jameson, C.; Hindley, R.; et al. Additional value of dynamic contrast-enhanced sequences in multiparametric prostate magnetic resonance imaging: Data from the PROMIS study. Eur. Urol. 2020, 78, 503–511. [Google Scholar] [CrossRef]
  28. Bass, E.J.; Pantovic, A.; Connor, M.; Gabe, R.; Padhani, A.R.; Rockall, A.; Sokhi, H.; Tam, H.; Winkler, M.; Ahmed, H.U. A systematic review and meta-analysis of the diagnostic accuracy of biparametric prostate MRI for prostate cancer in men at risk. Prostate Cancer Prostatic Dis. 2020, 24, 596–611. [Google Scholar] [CrossRef]
  29. Kuhl, C.K.; Bruhn, R.; Krämer, N.; Nebelung, S.; Heidenreich, A.; Schrading, S. Abbreviated biparametric prostate MR imaging in men with elevated prostate-specific antigen. Radiology 2017, 285, 493–505. [Google Scholar] [CrossRef] [Green Version]
  30. Obmann, V.C.; Pahwa, S.; Tabayayong, W.; Jiang, Y.; O’Connor, G.; Dastmalchian, S.; Lu, J.; Shah, S.; Herrmann, K.A.; Paspulati, R.; et al. Diagnostic accuracy of a rapid biparametric MRI protocol for detection of histologically proven prostate cancer. Urology 2018, 122, 133–138. [Google Scholar] [CrossRef] [PubMed]
  31. Barth, B.K.; De Visschere, P.J.L.; Cornelius, A.; Nicolau, C.; Vargas, H.A.; Eberli, D.; Donati, O.F. Detection of clinically significant prostate cancer: Short dual-pulse sequence versus standard multiparametric MR Imaging—A multireader study. Radiology 2017, 284, 725–736. [Google Scholar] [CrossRef] [PubMed]
  32. Weiss, J.; Martirosian, P.; Notohamiprodjo, M.; Kaufmann, S.; Othman, A.E.; Grosse, U.; Nikolaou, K.; Gatidis, S. Implementation of a 5-minute magnetic resonance imaging screening protocol for prostate cancer in men with elevated prostate-specific antigen before biopsy. Invest. Radiol. 2018, 53, 186–190. [Google Scholar] [CrossRef] [PubMed]
  33. Cereser, L.; Giannarini, G.; Bonato, F.; Pizzolitto, S.; Como, G.; Valotto, C.; Ficarra, V.; Dal Moro, F.; Zuiani, C.; Girometti, R. Comparison of multiple abbreviated multiparametric MRI-derived protocols for the detection of clinically significant prostate cancer. Ital. J. Urol. Nephrol. 2020. [Google Scholar] [CrossRef]
  34. The National Lung Screening Trial Research Team. Results of initial low-dose computed tomographic screening for lung cancer. N. Engl. J. Med. 2013, 368, 1980–1991. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Zawaideh, J.P.; Sala, E.; Shaida, N.; Koo, B.; Warren, A.Y.; Carmisciano, L.; Saeb-Parsy, K.; Gnanapragasam, V.J.; Kastner, C.; Barrett, T. Diagnostic accuracy of biparametric versus multiparametric prostate MRI: Assessment of contrast benefit in clinical practice. Eur. Radiol. 2020, 30, 4039–4049. [Google Scholar] [CrossRef]
  36. Brembilla, G.; Dell’Oglio, P.; Stabile, A.; Damascelli, A.; Brunetti, L.; Ravelli, S.; Cristel, G.; Schiani, E.; Venturini, E.; Grippaldi, D.; et al. Interreader variability in prostate MRI reporting using prostate imaging reporting and data system version 2.1. Eur. Radiol. 2020, 30, 3383–3392. [Google Scholar] [CrossRef]
  37. Huebner, N.A.; Korn, S.; Resch, I.; Grubmüller, B.; Gross, T.; Gale, R.; Kramer, G.; Poetsch, N.; Clauser, P.; Haitel, A.; et al. Visibility of significant prostate cancer on multiparametric magnetic resonance imaging (MRI)—Do we still need contrast media? Eur. Radiol. 2020, 31, 3754–3764. [Google Scholar] [CrossRef]
  38. Brembilla, G.; Takwoingi, Y.; Kasivisvanathan, V. Tackling interobserver variability in multiparametric Magnetic Resonance Imaging (MRI): Is MRI even better than we think for prostate cancer diagnosis? Eur. Urol. 2020, 79, 43–45. [Google Scholar] [CrossRef] [PubMed]
  39. Thurfjell, E.L.; Lernevall, K.A.; Taube, A.A.S. Benefit of independent double reading in a population-based mammography screening program. Radiology 1994, 191, 241–244. [Google Scholar] [CrossRef]
  40. Penzkofer, T.; Padhani, A.R.; Turkbey, B.; Haider, M.A.; Huisman, H.; Walz, J.; Salomon, G.; Schoots, I.G.; Richenberg, J.; Villeirs, G.; et al. ESUR/ESUI position paper: Developing artificial intelligence for precision diagnosis of prostate cancer using magnetic resonance imaging. Eur. Radiol. 2021, 31, 9567–9578. [Google Scholar] [CrossRef]
Table
Table 1. Protocol scan times (min:s).
Table 1. Protocol scan times (min:s).
SequenceMpMRIbpMRIa-bpMRI
Localizer
(T2WI—sagittal)		0:190:190:19
T2WI—axial5:145:145:14
T2WI—coronal5:555:55-
DWI
(b0, 150, 500, 1000 s/mm2)		5:175:17-
DWI b 2000 s/mm23:403:403:40
T1WI3:06--
DCE4:43--
Total:28:1420:259:13
Scan time of mpMRI and estimated scan times of bpMRI and a-bpMRI protocols. T2WI: T2-weighted imaging; DWI: diffusion weighted imaging; T1WI: T1-weighted imaging; DCE: dynamic contrast enhanced imaging; mpMRI: multiparametric MRI; a-bpMRI: abbreviated biparametric MRI.
Table
Table 2. Summary of demographic data.
Table 2. Summary of demographic data.
No. of Patients151
Median age, y (range)62 (41–83)
Median PSA, ng/mL (range)6.8 (0.9–28.5)
Highest Gleason grade at histopathology (%)
Benign22 (15)
3 + 353 (35)
3 + 463 (42)
≥4 + 313 (8)
Definition 1 * csPCa60 (40)
Definition 2 ** csPCa95 (63)
Any Gleason ≥ 3 + 476 (50)
Median no. of positive cores (IQR)6 (2–11)
Median MCCL (IQR)4 (1.5–7)
* Gleason ≥ 4 + 3 and/or cancer core length (CCL) involvement ≥ 6 mm. ** Gleason ≥ 3 + 4 and/or CCL ≥ 4 mm. csPCa: clinically significant prostate cancer; IQR: interquartile range; MCCL: maximum cancer core length.
Table
Table 3. Diagnostic accuracy of MRI for definition 1 csPCa.
Table 3. Diagnostic accuracy of MRI for definition 1 csPCa.
a-bpMRIbpMRImpMRI
LikertLikertPI-RADSLikertPI-RADS
Sensitivity92 (87–96)92 (87–96)89 (83–93)92 (87–96)89 (83–93)
Specificity48 (42–54) *35 (29–41)52 (46–58)39 (33–45)53 (47–59)
PPV54 (48–60) *48 (43–54)56 (49–61)50 (44–56)56 (50–61)
NPV90 (84–95)87 (79–93)88 (82–92)88 (81–94)88 (82–92)
Pooled values are reported as % (95%—CI). * p < 0.05 a-bpMRI vs bpMRI/mpMRI Likert. bpMRI: biparametric MRI; mpMRI: multiparametric MRI; a-bpMRI: abbreviated biparametric MRI; PPV: positive predictive value; NPV: negative predictive value.
Table
Table 4. Pooled and combined diagnostic accuracy of a-bpMRI according to different MRI cut-offs (for definition 1 csPCa).
Table 4. Pooled and combined diagnostic accuracy of a-bpMRI according to different MRI cut-offs (for definition 1 csPCa).
MRI Score ≥ 4T2WI and DWI Score ≥ 4
Pooled
Sensitivity83 (76–88)70 (63–77)
Specificity64 (58–69)76 (71–81)
PPV60 (54–66)66 (59–73)
NPV85 (79–89)79 (74–84)
Combined *
Sensitivity85 (76–94)72 (60–83)
Specificity65 (55–75)79 (71–87)
PPV61 (51–72)69 (58–81)
NPV87 (79–95)81 (73–89)
Pooled values (aggregate from the three readers) are reported as % (95%—CI). * Simulated double-reading approach: two radiologists report the a-bpMRI independently with a third reviewer involved when there is disagreement between the reporters. PPV: positive predictive value; NPV: negative predictive value.
Table
Table 5. PPV, NPV, and positivity rates of abbreviated bpMRI (a-bpMRI) according to clinically significant PCa prevalence.
Table 5. PPV, NPV, and positivity rates of abbreviated bpMRI (a-bpMRI) according to clinically significant PCa prevalence.
Prevalence of csPCa (Definition 1)
10%5%2%
MRI score ≥ 3
Pos.rate59 (51–67)57 (49–65)56 (47–64)
PPV16 (9–25)8 (3–16)4 (1–10)
NPV98 (91–100)100 (94–100)100 (95–100)
MRI score ≥ 4
Pos. rate40 (32–49)37 (30–46)36 (29–45)
PPV21 (12–34)11 (4–22)5 (1–15)
NPV98 (92–100)99 (94–100)100 (96–100)
T2WI and DWI score ≥ 4
Pos. rate26 (19–34)23 (17–31)22 (16–29)
PPV28 (15–45)14 (5–30)6 (1–20)
NPV96 (91–99)98 (94–100)99 (95–100)
Values are reported as % (95%—CI). Pos. rate: rate of positive test according to MRI cut-off. csPCa: clinically significant prostate cancer; pos. rate: positivity rate of MRI; PPV: positive predictive value; NPV: negative predictive value.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Brembilla, G.; Giganti, F.; Sidhu, H.; Imbriaco, M.; Mallett, S.; Stabile, A.; Freeman, A.; Ahmed, H.U.; Moore, C.; Emberton, M.; et al. Diagnostic Accuracy of Abbreviated Bi-Parametric MRI (a-bpMRI) for Prostate Cancer Detection and Screening: A Multi-Reader Study. Diagnostics 2022, 12, 231. https://doi.org/10.3390/diagnostics12020231

AMA Style

Brembilla G, Giganti F, Sidhu H, Imbriaco M, Mallett S, Stabile A, Freeman A, Ahmed HU, Moore C, Emberton M, et al. Diagnostic Accuracy of Abbreviated Bi-Parametric MRI (a-bpMRI) for Prostate Cancer Detection and Screening: A Multi-Reader Study. Diagnostics. 2022; 12(2):231. https://doi.org/10.3390/diagnostics12020231

Chicago/Turabian Style

Brembilla, Giorgio, Francesco Giganti, Harbir Sidhu, Massimo Imbriaco, Sue Mallett, Armando Stabile, Alex Freeman, Hashim U. Ahmed, Caroline Moore, Mark Emberton, and et al. 2022. "Diagnostic Accuracy of Abbreviated Bi-Parametric MRI (a-bpMRI) for Prostate Cancer Detection and Screening: A Multi-Reader Study" Diagnostics 12, no. 2: 231. https://doi.org/10.3390/diagnostics12020231

APA Style

Brembilla, G., Giganti, F., Sidhu, H., Imbriaco, M., Mallett, S., Stabile, A., Freeman, A., Ahmed, H. U., Moore, C., Emberton, M., & Punwani, S. (2022). Diagnostic Accuracy of Abbreviated Bi-Parametric MRI (a-bpMRI) for Prostate Cancer Detection and Screening: A Multi-Reader Study. Diagnostics, 12(2), 231. https://doi.org/10.3390/diagnostics12020231

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop