Next Article in Journal
Mechanisms of Resistance to KRASG12C Inhibitors
Next Article in Special Issue
Prognostic Impacts of D816V KIT Mutation and Peri-Transplant RUNX1–RUNX1T1 MRD Monitoring on Acute Myeloid Leukemia with RUNX1–RUNX1T1
Previous Article in Journal
Molecular Changes in Retinoblastoma beyond RB1: Findings from Next-Generation Sequencing
Previous Article in Special Issue
Prognostic Factors in Childhood Anaplastic Large Cell Lymphoma: Long Term Results of the International ALCL99 Trial
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Cancers
Volume 13
Issue 1
10.3390/cancers13010150
cancers-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Specific and Sensitive Detection of Neuroblastoma mRNA Markers by Multiplex RT-qPCR

by
Lieke M. J. van Zogchel
1,2,
Lily Zappeij-Kannegieter
2,
Ahmad Javadi
2,
Marjolein Lugtigheid
2,
Nina U. Gelineau
1,2,
Nathalie S. M. Lak
1,2,
Danny A. Zwijnenburg
3,
Jan Koster
3,
Janine Stutterheim
1,
C. Ellen van der Schoot
2 and
Godelieve A. M. Tytgat
1,*
1
Princess Maxima Center for Pediatric Oncology, Department of Pediatric Oncology, 3584 CS Utrecht, The Netherlands
2
Sanquin Research and Landsteiner Laboratory, Department of Experimental Immunohematology, Amsterdam UMC, University of Amsterdam, 1066 CX Amsterdam, The Netherlands
3
Academic Medical Center, Department of Oncogenomics, 1105 AZ Amsterdam, The Netherlands
*
Author to whom correspondence should be addressed.
Cancers 2021, 13(1), 150; https://doi.org/10.3390/cancers13010150
Submission received: 7 December 2020 / Revised: 27 December 2020 / Accepted: 31 December 2020 / Published: 5 January 2021
(This article belongs to the Special Issue Minimal Residual Disease of Cancers)
Browse Figures
Versions Notes

Abstract

:

Simple Summary

Sensitive detection of minimal residual disease by RT-qPCR in patients with neuroblastoma is shown to be predictive of outcome, but has not yet been introduced into clinical practice. A panel of multiple mRNA markers increases the sensitivity of minimal residual disease detection, since neuroblastoma tumors are heterogeneous tumors. Recent studies have identified two distinct phenotypes, an adrenergic and mesenchymal phenotype, that can be identified by using different mRNA markers. As generally only small volumes of bone marrow or blood are available in young neuroblastoma patients, we have developed a multiplex RT-qPCR to be able to test seven different mRNA markers, while we reduce the sample volume needed. Comparison between the multiplex RT-qPCR and RT-qPCR for the single markers showed a comparable sensitivity. This reduction in required sample volume, while saving time and resources, can assist in the introduction of minimal residual disease detection by RT-qPCR into clinical practice.

Abstract

mRNA RT-qPCR is shown to be a very sensitive technique to detect minimal residual disease (MRD) in patients with neuroblastoma. Multiple mRNA markers are known to detect heterogeneous neuroblastoma cells in bone marrow (BM) or blood from patients. However, the limited volumes of BM and blood available can hamper the detection of multiple markers. To make optimal use of these samples, we developed a multiplex RT-qPCR for the detection of MRD in neuroblastoma. GUSB and PHOX2B were tested as single markers. The adrenergic markers TH, GAP43, CHRNA3 and DBH and mesenchymal markers POSTN, PRRX1 and FMO3 were tested in multiplex. Using control blood and BM, we established new thresholds for positivity. Comparison of multiplex and singleplex RT-qPCR results from 21 blood and 24 BM samples from neuroblastoma patients demonstrated a comparable sensitivity. With this multiplex RT-qPCR, we are able to test seven different neuroblastoma mRNA markers, which overcomes tumor heterogeneity and improves sensitivity of MRD detection, even in those samples of low RNA quantity. With resources and time being saved, reduction in sample volume and consumables can assist in the introduction of MRD by RT-qPCR into clinical practice.

Graphical Abstract

1. Introduction

Disseminated disease to the bone marrow (BM) is present at diagnosis in more than half of the children with neuroblastoma (NBL) [1,2]. BM infiltration at diagnosis and persistence during treatment is predictive of poor outcome [3,4,5,6,7]. In the current protocols, BM infiltration at diagnosis and during treatment is assessed by histology or (immuno)cytology, and more sensitive detection of tumor cells by reverse-transcriptase quantitative polymerase chain reaction (RT-qPCR) is under investigation [8,9,10]. Multiple studies showed that detection of MRD with various mRNA markers throughout and post-induction therapy could be prognostic of outcome [3,4,11,12,13].
We have previously described paired-like homeobox 2b (PHOX2B) as a sensitive and NBL specific mRNA marker for minimal residual disease (MRD) detection by RT-qPCR, with high expression in NBL tumors and no expression in normal BM and peripheral blood (PB) [8]. However, the marker shows variable expression levels between tumors and not all tumors can be identified with only PHOX2B. Therefore, we then demonstrated that the addition of other markers contributes to more sensitive MRD detection [9]. Based on high expression in NBL tumors and low/no expression in normal BM or PB, we optimized two mRNA marker panels, one specific for BM, the other specific for PB. PHOX2B, tyrosine hydroxylase (TH), cholinergic receptor nicotinic alpha 3 (CHRNA3), and growth associated protein 43 (GAP43) are part of the BM panel. PHOX2B, TH, CHRNA3 and dopamine beta hydroxylase (DBH) form the PB panel [8,9].
Several patients scoring negative for MRD detection with the above-mentioned adrenergic (ADRN) marker panels still experience relapse [4,13]. Epithelial to mesenchymal transition (EMT) is a process that plays a role in tumorigenic progression, resulting in an increased motility of cancer cells. EMT induces the conversion of cells from an epithelial to mesenchymal (MES) phenotype, and assists invasion, dissemination and thereby disease progression [14]. Metastasis and therapy resistance are results of EMT in diverse cancers. NBL tumors can contain both ADRN and MES cells, an enrichment of MES cells occurs in post-treatment and recurring tumors. The MES cells lack expression of regularly used NBL MRD markers, PHOX2B and DBH [15]. Since MES NBL cells might not be detected with the present MRD panel, a MES marker panel for MRD detection was developed. Periostin (POSTN) and paired related homeobox 1 (PRRX1) are MES specific. Together with flavin containing monooxygenase 3 (FMO3), which is not expressed in NBL cells but is expressed in mesenchymal stromal cells and used to differentiate these from MES, these markers form the MES marker panel. High expression of POSTN and PRRX1 and low/no expression of FMO3 can identify MES NBL cells in BM and PB [13].
Altogether these studies show that multiple targets are required for reliable MRD detection. However, patient-derived samples are precious since NBL patients are young of age, and thus only small volumes of BM or PB can be sampled. Multiplex (MPX) RT-qPCR reduces the sample volume required for detection of markers, and saves costs and time, which is important for clinical implementation. In this study, we aim to generate a workflow for a marker panel of NBL specific mRNA targets by MPX RT-qPCR for MRD detection implementation in clinical care of neuroblastoma.

2. Results

2.1. Optimization of RT-qPCR Setting

In order to ascertain compatibility in a MPX setting, the primers and probes for the mRNA markers were redesigned (sequences are listed in Table S1). The fluorophores FAM, Yakima Yellow™(YY) and Dragonfly Orange™ (DFO) were chosen to match the different channels available in the Viia7, with the appropriate Black Hole Quenchers®(BHQ). qPCR Master Mix containing ROX as a reference control was replaced by a master mix with Mustang Purple as the reference control, to eliminate the efflux of the Dragonfly orange fluorophore into the ROX filter channel. We observed a disturbance of RT-qPCR amplification plots through fluorescence quenching, which was caused by interaction between Mustang Purple and dithiothreitol (DTT) [16] from the reverse transcription mix (containing first strand buffer, DTT, dNTPs, random primers, RNAseout and MMLV). We therefore replaced this reverse transcriptase mix with the High-Capacity RNA-to-cDNA™ Kit (Applied Biosystems, Foster City, CA, USA).

2.2. Expression of Singleplex vs. MPX on Neuroblastoma Cell Lines

The expression of the ADRN and MES marker panel was measured in two isogenic neuroblastoma cell line pairs (691-MES/691-ADRN and SH-EP2/SH-SY5Y) with both singleplex and MPX RT-qPCR methods (Figure 1A). The expression levels of the ADRN panel on the ADRN cell lines and of the MES panel on MES cell lines were comparable in singleplex and MPX setting. The dilution curves of IMR32 (ADRN cell line) and 691-MES (MES cell line) display comparable sensitivity of the MPX RT-PCR and singleplex method (Figure 1B,C).

2.3. TH in MPX RT-qPCR Occasionally Showed Amplification of gDNA

When we proceeded to testing of the MPX panels in control and patient samples, we observed an aspecific amplification curve for TH in a fair number of samples, often resulting in a low Ct value. Sanger sequencing of the product revealed the genomic TH sequence. Furthermore, with this assay we detected amplifications on unconverted RNA as well (Figure S1), suggesting the detection of gDNA instead of cDNA. This was independent of RNA isolation method and DNAse treatment (included in PAXgene RNA isolation) (Figure S2). Of note, these aspecific curves for TH were also observed in singleplex RT-qPCR (Figure S3). Since these primer and probe sequences for TH are widely used within Europe [17,18], we were hesitant to redesign this assay. With a visual inspection of the amplification and multicomponent plot, as well as with the use of the AMPSCORE (indicating if the amplification is in the linear region), the CQCONF score (indicating the calculated confidence for the Ct value of the well) and dRN results, all provided within the QuantStudio software [19], we were able to distinguish ‘true’ from ‘false’ amplifications. Examples of the different amplification plots and multicomponent plots in MPX and singleplex RT-qPCR, as well as qPCR on the samples without reverse transcriptase (RT) can be found in Figure S3. The Ct values, AMPSCORE, CQCONF score and ΔRn values of these examples are listed in Table S2. The proposed required conditions for the confirmation of true TH amplifications can be found in Figure S4.

2.4. Setting a Threshold for Positivity for ADRN and MES mRNA MPX in BM and PB

To establish new thresholds for positivity for the MPX panel, we determined expression MPX panels in control BM (n = 54) and PB (n = 50) (Figure 2). It should be noted that the Ct of GUSB was on average 2.8 and 2.0 Ct lower compared to data obtained with control samples in our previous study for BM and PB, respectively (Table S3). In the current experiments, we were able to include samples with concentrations as low as 80 ng of total RNA for cDNA synthesis, which still resulted in a GUSB Ct value of 24 (4.5 ng of RNA was used for GUSB RT-qPCR, in duplicate). This seemed to be a result of the more efficient cDNA synthesis method using the High-Capacity RNA-to-cDNA™ Kit we used in the present study, as the RNA isolation method was similar to before. Applying the rules adapted from the European Study Group on MRD detection in ALL [20], we defined a threshold for positivity for the ADRN (BM and PB) and MES (PB only) markers as ΔCtsample < 3.0 Ct than median ΔCtcontrol tissue. Patient samples were scored positive when Ctsample < 40 and mean ΔCtsample < 3.0 Ct than median ΔCtcontrol tissue. As described previously [8,9], PHOX2B was not expressed in any of the control samples. Based on the levels of expression in control BM and PB, a threshold was set for positivity for the other ADRN markers, and for the MES markers in PB (Table 1). For the MES markers in BM, FMO3 positivity was taken into account resulting in the thresholds in Table 1. The number of control samples with expression of our markers was slightly increased, possibly due to the more efficient cDNA synthesis. However, ΔCt results were comparable to earlier established thresholds (Table S3), with the exception of FMO3 in BM, which showed an expression of 2.2 Ct lower than previously published data [9,13]. Of note, FMO3 amplifications were not detected in unconverted RNA, excluding the possibility that detection of gDNA resulted in lower Ct values. Based on the expression in control samples, we defined the threshold for PRRX1 in BM as CtPRRX1 − CtGUSB < 9.0 and CtPRRX1 − CtFMO3 < −1, and for POSTN in BM as CtPOSTN – CtGUSB < 9.0 and CtPOSTN − CtFMO3 < 1. With these thresholds, none of the controls were positive for the MES markers.

2.5. Comparison of Singleplex vs. MPX RT-qPCR in Patient Samples

To compare the expression between singleplex and MPX RT-qPCR assays, we performed MPX RT-qPCR on 21 PB and 24 BM samples from patients with NBL (Table S4), which were previously measured in single RT-qPCR settings for ADRN and MES mRNA markers. Overall, ΔCts for all markers were comparable in BM and PB, with the exception of FMO3 in BM samples (Figure 3). Individual correlation plots for each sample per marker can be found in Figure S5. The ΔCt of ADRN markers showed a good correlation between singleplex and MPX in both BM and PB. The MES markers were infrequently detected in PB. POSTN and PRRX1 show a good correlation in BM, but the ΔCt for FMO3 was consistently lower in BM. We therefore tested for FMO3 in 100 additional BM samples from patients with NBL in parallel for both singleplex and MPX. While the median Ct was 3.2 lower in the MPX assay, the Ct values in singleplex and MPX do seem to correlate (Figure S6). Subsequently, in this cohort of 21 PB and 24 BM samples of NBL patients, we evaluated the performance of the MPX compared to singleplex RT-qPCR in considering samples positive. The results obtained in this analysis are summarized in Table 2, more detailed 2x2 tables per marker can be found in Table S5. All BM samples were positive for PHOX2B, and TH identified the same samples in MPX and singleplex. GAP43 was positive in 6 samples in MPX, and negative in singleplex, and one sample was positive for CHRNA3 in singleplex and negative in MPX, and vice versa, but since all samples were positive for PHOX2B, this did not have any effect on positivity for the panel as a whole. The MES marker POSTN scored positive slightly more often in the MPX setting (7 samples, compared to 6 in singleplex). Next, we focused on PB samples. Out of the two samples that were PHOX2B negative in singleplex, only one was PHOX2B positive in MPX. Since this sample scored positive for DBH in singleplex (ΔCt of 12.1; threshold 15.0), this was already considered positive for the ADRN panel. As the primer and probe sequences of PHOX2B are not altered, and PHOX2B is still tested as a single marker, this can be a result of the more efficient cDNA synthesis method. The only sample that now tested negative for PHOX2B was only ADRN positive in singleplex because of a very low DBH expression, on the borderline of positivity (ΔCt of 14.7; threshold 15.0). Despite the comparable ΔCt values in singleplex and MPX, TH was less frequently positive in MPX, due to the lowered threshold. None of these TH-discrepant samples had a negative MPX result when the whole ADRN panel was taken into account, as PHOX2B was positive in all these samples. None of the PB samples were considered positive for the MES panel. Overall, these results indicate that the MPX RT-qPCR reliably detects presence of NBL mRNA in this cohort of BM and PB patient samples.

3. Discussion

mRNA detection by RT-qPCR is a very sensitive and promising technique for detection of disseminated neuroblastoma cells at diagnosis, and MRD during therapy. We previously showed that our panel of mRNA markers is superior to one single marker in the detection of neuroblastoma cells and therefore can transcend heterogeneity of the neuroblastoma tumor cells [9,21]. With the addition of our mesenchymal mRNA markers, we are able to detect neuroblastoma cells undergoing EMT during therapy [13,15,22] and can thus prevent false negativity. These EMT markers can be further used to study EMT in other tumor entities. However, often the sample quantity required to test multiple mRNA markers is limited. As the field of PCR-based mRNA detection is evolving rapidly, with different PCR approaches, RNA isolation methods, and new mRNA markers, we looked to optimize our workflow to increase the yield of the samples and we aimed to combine various mRNA markers in less RT-qPCR reactions. In this study, we redesigned the primer and probe sequences and optimized cDNA synthesis and RT-qPCR conditions. We tested control PB samples from healthy donors and BM samples from children with ALL in complete molecular remission to test for illegitimate expression of the markers. With the exception of FMO3, all redesigned markers in MPX showed a similar expression level compared to the old designs in singleplex in control samples [9]. The lower Ct value of the MPX RT-qPCR for FMO3 can be explained by the fact that the MPX FMO3 assay is designed in exon 5 and 6, while the singleplex FMO3 was designed in exon 2 and 3 [13]. Exon 3 is not part of the transcript NM_001319174.2 Homo sapiens flavin containing dimethylaniline monoxygenase 3 (FMO3), transcript variant 4, mRNA [23,24], and the RT-qPCR assay designed in exon 3 can thus result in a lower expression detected. Furthermore, the current amplicon for FMO3 in MPX RT-qPCR is shorter (86 bp) compared to the previous amplicon (113 bp), and the previous singleplex primers scored high for self-complementarity, which may explain why the MPX RT-qPCR is more efficient and results in lower Ct values [25]. For all markers tested in MPX, we defined new thresholds for positivity based on the expression of the markers in the control samples. There are multiple approaches to score patient-derived samples by RT-qPCR. Specifically, expression in control samples can be used to establish a threshold [8,9], or alternatively a cut-off for low and high expression can be established based on outcome of a patient cohort [3]. The advantage of the use of thresholds for positivity, based on control samples, is that these are not susceptible to treatment related changes and moreover results in a higher specificity of the RT-qPCR. With these new defined thresholds, we analyzed 21 PB and 24 BM samples from patients with neuroblastoma. MPX RT-qPCR resulted in a positive result for the ADRN marker panel in all 24 BM that were positive for the singleplex RT-qPCR, and identified one additional MES positive BM sample. Apart from one sample that was considered borderline positive in singleplex, based on a ΔCt of 14.7 for DBH (threshold 15.0), our findings confirm the comparability of the MPX and singleplex RT-qPCR. We are presently confirming the sensitivity and prognostic relevance of these markers with multiplex RT-qPCR in an ongoing prospective validation study.
One unexpected technical finding during the optimization of the MPX RT-qPCR was the overestimation of target expression levels, due to fluorescence quenching of the passive reference dye Mustang Purple by DTT [16]. We therefore replaced the reverse transcriptase method to one without DTT. The improved cDNA synthesis with the High-Capacity RNA-to-cDNA™ kit overall resulted in a decrease of 2.3 Ct of GUSB. Since we exclude samples that have a GUSB Ct value > 25 (corresponding to less than 5000 copies) [8,26,27], this facilitates the possibility to also test samples with a low RNA concentration. As the RNA yield in BM and PB samples collected during therapy is often low, this results in many excluded samples in larger studies [3], even when optimized standard operating procedures are in place. With the two newly developed MPX only half of the cDNA amount compared to the singleplex approach is required. Furthermore, combined with the improved cDNA synthesis, we are able to test 8 different mRNA markers, in all samples, even in those samples of low RNA quantity.
As we developed and optimized the MPX panels, we observed an aspecific amplification curve for TH in a fair number of samples, often resulting in a low Ct value. When we analyzed the same samples in singleplex, we still observed this aspecific amplification. We confirmed that TH gDNA was present in these samples after RNA isolation, even with DNAse treatment, and is causing this aspecific amplification. While we are able to distinguish between true and false positive TH amplifications with the use of QuantStudio software, these findings stress the need to carefully analyze amplifications when developing and optimizing RT-qPCR assays, to avoid false-positive samples.

4. Materials and Methods

4.1. Patients and Samples

We analyzed stored remains from BM and PB samples at diagnosis and during treatment from NBL patients with high-risk neuroblastoma, treated in accordance with the German NB2004 or Dutch NBL2009 trial [28,29]. The study was approved by the medical ethics committees (Academic Medical Center, Amsterdam, the Netherlands; MEC07/219#08.17.0836) and the University of Cologne. Samples were processed within 24 h after collection and stored in PAX tubes at −20 °C (Qiagen, Venlo, the Netherlands), or in Trizol (Invitrogen, Carlsbad, CA, USA) or RNAbee (Campro Scientific, Berlin, Germany) at −80 ℃. To establish thresholds for the newly designed markers, stored remains from 54 BM samples from patients with childhood acute lymphoid leukemia in molecular remission and 50 PB samples from healthy volunteers were used. Neuroblastoma cell lines SH-EP2, SH-Sy5Y, IMR32, 691-MES and 691-ADRN cells were cultured as previously described [30,31].

4.2. RNA Isolation and cDNA Synthesis

Isolation of mRNA from samples was done through the PAXgene Blood Kit (QIAGEN, Venlo, The Netherlands), through the RNAbee method (Campro Scientific, Berlin, Germany) or with Trizol (Invitrogen, Carlsbad, CA, USA), according to the manufacturer’s instructions. Concentration and quality of RNA were measured by an ND-1000 spectrophotometer (ThermoFisher Scientific, Waltham, MA, USA). For the samples tested in singleplex, cDNA synthesis was performed as described previously [32]. For the samples tested in MPX, synthesis of cDNA was done by the High-Capacity RNA-to-cDNA™ Kit (Applied Biosystems, Foster City, CA, USA), using 2–3 µg of RNA, 15 µL of RT Buffer Mix and 1.5 µL Enzyme Mix, in a total reaction volume of 30 μL and incubated at 37 °C for 60 min. Finally, the reverse transcriptase was inactivated by heating to 95 °C for 5 min, and the volume was diluted with H2O to 75 µL. For samples with an RNA concentration < 20 ng/μL, we used up to 40 μL of RNA together with 44.5 µL of RT Buffer Mix and 4.5 µL Enzyme Mix and did not dilute with H2O. cDNA samples were used immediately or stored at −20 ℃.

4.3. Multiplex Real-Time qPCR and Sequencing

Primers and probe for reference gene glucuronidase beta (GUSB) and PHOX2B have been published previously and continued to be used as single RT-qPCR markers [8,26]. TH, GAP43 and CHRNA3 were combined as the MPX BM panel, TH, CHRNA3 and DBH were combined as the MPX PB panel. POSTN, PRRX1 and FMO3 were combined as the MPX MES panel. TH primers and probe sequences have been described before [33]. For all other markers, new primers and probes were designed for compatibility in a MPX setting. Primers and probes were designed with Primer Express software (version 1.5; ThermoFisher Scientific, Waltham, MA, USA) and Oligo7 (Molecular Biology Insights, Colorado Springs, CO, USA) and synthesized by Eurogentec (Liege, Belgium) and are listed in Supplemental Table S1. RT-qPCR was performed on the Viia7 (Applied Biosystems, Foster, CA, USA), and analysis was performed using QuantStudio software version 1.4 (Applied Biosystems, Foster, CA, USA). The probe quencher and fluorescent reporter were chosen for the channels available in Viia7. Reactions were carried out in 20 µL (10 µL TaqManTM Multiplex Master Mix (Applied Biosystems, Foster, CA, USA), 300 nM forward and reverse primer and 200 nM probe and 5 µL cDNA). In all RT-qPCR reactions, initial heating was done for 20 s at 95 °C, followed by 50 cycles of 1 s at 95 °C and 20 s at 60 °C. All RT-qPCR reactions were performed in triplicate (except GUSB, which was performed in duplicate), and mean values were used for analysis. A given sample scored negative if the Ct value was 40 or greater, with the exception of PHOX2B (Ct ≤ 50). Sequencing of PCR products was performed as previously described [32].

4.4. Data Analysis

For both singleplex and MPX, expression was normalized to GUSB expression using the following equation: [normalized threshold cycle (ΔCt) = Ctmarker – CtGUSB]. For the singleplex RT-qPCR, positivity of samples was scored according to earlier published thresholds [9,13]. For the MPX RT-qPCR, thresholds for positivity in control BM and PB were determined on the basis of the expression in the control sample (see Results). While we continue to test PHOX2B as a single marker, we changed the cDNA synthesis method and the RT-qPCR Master Mix, and therefore determined the expression of PHOX2B in control- and patient samples. A threshold for positivity for the ADRN markers was defined as ΔCtsample < 3.0 Ct than median ΔCtcontrol tissue. For the MES markers, the expression of FMO3 was taken into account [13].

5. Conclusions

In conclusion, we developed a reliable and sensitive MPX RT-qPCR for a panel of ADRN and MES neuroblastoma MRD markers. NBL patients are young, and the volume of BM and PB that can be sampled is limited. As neuroblastoma tumors can be phenotypically heterogeneous, a panel of mRNA markers improves the sensitivity of MRD monitoring using RT-qPCR. By testing these markers in MPX, we save time, resources and make optimal use of these precious samples.

Supplementary Materials

The following are available online at https://www.mdpi.com/2072-6694/13/1/150/s1, Figure S1: Example of an amplification curve with low ΔRN, low Ct value, cDNA and RNA without RT, Figure S2: Detection of gDNA in RNA of IMR-32 without RT, Trizol isolation method compared to PAXgene isolation method (including DNAse treatment), Figure S3: Examples of different amplification curves for TH in MPX RT-qPCR, qPCR (without RT) and singleplex RT-Qpcr, Figure S4. Required conditions for the evaluation of TH- amplification curves in MPX RT-qPCR, Figure S5. Correlation plots for individual samples per marker, Figure S6. Correlation plot for FMO3 in MPX and singleplex in 100 BM samples, Table S1: Primers and probe sequences for multiplex method, Table S2. Examples Ct, ΔCt, AMPSCORE, CQCONF score and ΔRn results of MPX RT-qPCR, RNA qPCR and singleplex RT-qPCR, Table S3. Comparison of ΔCt and Ct results between multiplex and singleplex in control tissue, Table S4. Sample and patient characteristics of the cohort used to compare singleplex and multiplex RT-qPCR, Table S5. Detailed results of the comparison between MPX and singleplex RT-qPCR in a cohort of 24 bone marrow and 21 blood samples.

Author Contributions

Conceptualization, L.M.J.v.Z., C.E.v.d.S. and G.A.M.T.; Data curation, L.M.J.v.Z., C.E.v.d.S. and G.A.M.T.; Formal analysis, L.M.J.v.Z., L.Z.-K., A.J., M.L., D.A.Z., J.K. and J.S.; Funding acquisition, G.A.M.T.; Investigation, L.M.J.v.Z., L.Z.-K., A.J., M.L., N.U.G., N.S.M.L., D.A.Z. and J.K.; Methodology, L.M.J.v.Z., C.E.v.d.S. and G.A.M.T.; Project administration, L.M.J.v.Z., C.E.v.d.S. and G.A.M.T.; Resources, L.M.J.v.Z., C.E.v.d.S. and G.A.M.T.; Software, D.A.Z. and J.K.; Supervision, C.E.v.d.S. and G.A.M.T.; Validation, L.M.J.v.Z., L.Z.-K., A.J. and M.L.; Visualization, L.M.J.v.Z.; Writing—original draft, L.M.J.v.Z., C.E.v.d.S. and G.A.M.T.; Writing—review & editing, L.M.J.v.Z., L.Z.-K., A.J., M.L., N.U.G., N.S.M.L., D.A.Z., J.K., J.S., C.E.v.d.S. and G.A.M.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Liquidhope, a TranScan-2 project by Koningin Wilhelmina Fund, KWF Kankerbestrijding TRANSCAN 8352/TRS-2018-00000715 (L.M.J.v.Z, N.U.G, J.K.) and Foundation AMeesing Mees.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of Academic Medical Center, Amsterdam, the Netherlands, MEC07/219#08.17.0836, approved on 28-05-2008.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The authors confirm that the data analyzed during this study are available from the corresponding author, G.A.M.T., upon reasonable request.

Acknowledgments

The authors thank the Department of Pediatric Hematology and Oncology, Cologne, Germany for providing stored remains of peripheral blood from patients with neuroblastoma. The graphical abstract has been created with BioRender.com.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Abbreviations

ADRNadrenergic (neuroblastoma)
BHQBlack Hole Quencher
Ctcycle threshold
DFODragonfly Orange™
dNTPdeoxyribonucleotide triphosphate
DTTdithiothreitol
EMTepithelial to mesenchymal transition
MESmesenchymal (neuroblastoma)
MMLVMoloney Murine Leukemia Virus
MPXmultiplex RT-qPCR
NBLneuroblastoma
PBperipheral blood
YYYakima Yellow™

Genes

CHRNA3cholinergic receptor nicotinic alpha 3
DBHdopamine beta hydroxylase
FMO3flavin containing monooxygenase 3
GAP43growth associated protein 43
GUSBglucuronidase beta
PHOX2Bpaired-like homeobox 2b
POSTNperiostin
PRRX1paired related homeobox 1
THtyrosine hydroxylase

References

  1. Cohn, S.L.; Pearson, A.D.; London, W.B.; Monclair, T.; Ambros, P.F.; Brodeur, G.M.; Faldum, A.; Hero, B.; Iehara, T.; Machin, D. The international neuroblastoma risk group (inrg) classification system: An inrg task force report. J. Clin. Oncol. 2009, 27, e289. [Google Scholar] [CrossRef] [PubMed]
  2. Matthay, K.K.; Villablanca, J.G.; Seeger, R.C.; Stram, D.O.; Harris, R.E.; Ramsay, N.K.; Swift, P.; Shimada, H.; Black, C.T.; Brodeur, G.M. Treatment of high-risk neuroblastoma with intensive chemotherapy, radiotherapy, autologous bone marrow transplantation, and 13-cis-retinoic acid. N. Engl. J. Med. 1999, 341, 1165–1173. [Google Scholar] [CrossRef] [PubMed]
  3. Viprey, V.F.; Gregory, W.M.; Corrias, M.V.; Tchirkov, A.; Swerts, K.; Vicha, A.; Dallorso, S.; Brock, P.; Luksch, R.; Valteau-Couanet, D.; et al. Neuroblastoma mrnas predict outcome in children with stage 4 neuroblastoma: A european hr-nbl1/siopen study. J. Clin. Oncol. Off. J. Am. Soc. Clin. Oncol. 2014, 32, 1074–1083. [Google Scholar] [CrossRef] [PubMed]
  4. Stutterheim, J.; Zappeij-Kannegieter, L.; Versteeg, R.; Caron, H.N.; van der Schoot, C.E.; Tytgat, G.A. The prognostic value of fast molecular response of marrow disease in patients aged over 1 year with stage 4 neuroblastoma. Eur. J. Cancer 2011, 47, 1193–1202. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Cai, J.-Y.; Pan, C.; Tang, Y.-J.; Chen, J.; Ye, Q.-D.; Zhou, M.; Xue, H.; Tang, J.-Y. Minimal residual disease is a prognostic marker for neuroblastoma with bone marrow infiltration. Am. J. Clin. Oncol. 2012, 35, 275–278. [Google Scholar] [CrossRef] [PubMed]
  6. Choi, Y.B.; Bae, G.E.; Lee, N.H.; Kim, J.-S.; Lee, S.H.; Yoo, K.H.; Sung, K.W.; Koo, H.H. Clinical significance of persistent tumor in bone marrow during treatment of high-risk neuroblastoma. J. Korean Med Sci. 2015, 30, 1062–1067. [Google Scholar] [CrossRef]
  7. Seeger, R.C.; Reynolds, C.P.; Gallego, R.; Stram, D.O.; Gerbing, R.B.; Matthay, K.K. Quantitative tumor cell content of bone marrow and blood as a predictor of outcome in stage iv neuroblastoma: A children’s cancer group study. J. Clin. Oncol. Off. J. Am. Soc. Clin. Oncol. 2000, 18, 4067–4076. [Google Scholar] [CrossRef]
  8. Stutterheim, J.; Gerritsen, A.; Zappeij-Kannegieter, L.; Kleijn, I.; Dee, R.; Hooft, L.; van Noesel, M.M.; Bierings, M.; Berthold, F.; Versteeg, R.; et al. Phox2b is a novel and specific marker for minimal residual disease testing in neuroblastoma. J. Clin. Oncol. Off. J. Am. Soc. Clin. Oncol. 2008, 26, 5443–5449. [Google Scholar] [CrossRef]
  9. Stutterheim, J.; Gerritsen, A.; Zappeij-Kannegieter, L.; Yalcin, B.; Dee, R.; van Noesel, M.M.; Berthold, F.; Versteeg, R.; Caron, H.N.; van der Schoot, C.E.; et al. Detecting minimal residual disease in neuroblastoma: The superiority of a panel of real-time quantitative PCR markers. Clin. Chem. 2009, 55, 1316–1326. [Google Scholar] [CrossRef] [Green Version]
  10. Beiske, K.; Burchill, S.A.; Cheung, I.Y.; Hiyama, E.; Seeger, R.C.; Cohn, S.L.; Pearson, A.D.; Matthay, K.K.; International neuroblastoma Risk Group Task, F. Consensus criteria for sensitive detection of minimal neuroblastoma cells in bone marrow, blood and stem cell preparations by immunocytology and qrt-pcr: Recommendations by the international neuroblastoma risk group task force. Br. J. Cancer 2009, 100, 1627–1637. [Google Scholar] [CrossRef]
  11. Burchill, S.A.; Lewis, I.J.; Abrams, K.R.; Riley, R.; Imeson, J.; Pearson, A.D.; Pinkerton, R.; Selby, P. Circulating neuroblastoma cells detected by reverse transcriptase polymerase chain reaction for tyrosine hydroxylase mrna are an independent poor prognostic indicator in stage 4 neuroblastoma in children over 1 year. J. Clin. Oncol. 2001, 19, 1795–1801. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Tchirkov, A.; Paillard, C.; Halle, P.; Bernard, F.; Bordigoni, P.; Vago, P.; Deméocq, F.; Kanold, J. Significance of molecular quantification of minimal residual disease in metastatic neuroblastoma. J. Hematotherapy Stem Cell Res. 2003, 12, 435–442. [Google Scholar] [CrossRef] [PubMed]
  13. Wezel, E.M.V.; Zogchel, L.M.J.V.; Wijk, J.V.; Timmerman, I.; Vo, N.-K.; Zappeij-Kannegieter, L.; de Carolis, B.; Simon, T.; Noesel, M.M.V.; Molenaar, J.J.; et al. Mesenchymal neuroblastoma cells are undetected by current mrna marker panels: The development of a specific neuroblastoma mesenchymal minimal residual disease panel. JCO Precis. Oncol. 2019, 3, 1–11. [Google Scholar]
  14. Brabletz, T.; Kalluri, R.; Nieto, M.A.; Weinberg, R.A. Emt in cancer. Nat. Rev. Cancer 2018, 18, 128–134. [Google Scholar] [CrossRef]
  15. van Groningen, T.; Koster, J.; Valentijn, L.J.; Zwijnenburg, D.A.; Akogul, N.; Hasselt, N.E.; Broekmans, M.; Haneveld, F.; Nowakowska, N.E.; Bras, J.; et al. Neuroblastoma is composed of two super-enhancer-associated differentiation states. Nat. Genet. 2017, 49, 1261–1266. [Google Scholar] [CrossRef]
  16. Boiso, L.; Sanga, M.; Hedman, J. Dtt quenches the passive reference signal in real-time PCR. Forensic Sci. Int. Genet. Suppl. Ser. 2015, 5, e5–e6. [Google Scholar] [CrossRef]
  17. Burchill, S.A.; Beiske, K.; Shimada, H.; Ambros, P.F.; Seeger, R.; Tytgat, G.A.; Brock, P.R.; Haber, M.; Park, J.R.; Berthold, F. Recommendations for the standardization of bone marrow disease assessment and reporting in children with neuroblastoma on behalf of the international neuroblastoma response criteria bone marrow working group. Cancer 2017, 123, 1095–1105. [Google Scholar] [CrossRef]
  18. Viprey, V.F.; Lastowska, M.A.; Corrias, M.V.; Swerts, K.; Jackson, M.S.; Burchill, S.A. Minimal disease monitoring by qrt-pcr: Guidelines for identification and systematic validation of molecular markers prior to evaluation in prospective clinical trials. J. Pathol. 2008, 216, 245–252. [Google Scholar] [CrossRef]
  19. Applied biosystems™ Relative Quantitation Analysis Module User Guide. C.0 ed. ThermoFisher Scientific, 2016. Available online: https://assets.thermofisher.com/TFS-Assets/LSG/manuals/MAN0014820_RelativeQuant_UG.pdf (accessed on 9 June 2020).
  20. van der Velden, V.H.; Cazzaniga, G.; Schrauder, A.; Hancock, J.; Bader, P.; Panzer-Grumayer, E.R.; Flohr, T.; Sutton, R.; Cave, H.; Madsen, H.O.; et al. Analysis of minimal residual disease by ig/tcr gene rearrangements: Guidelines for interpretation of real-time quantitative PCR data. Leukemia 2007, 21, 604–611. [Google Scholar] [CrossRef] [Green Version]
  21. Stutterheim, J.; Zappeij-Kannegieter, L.; Ora, I.; van Sluis, P.G.; Bras, J.; den Ouden, E.; Versteeg, R.; Caron, H.N.; van der Schoot, C.E.; Tytgat, G.A. Stability of PCR targets for monitoring minimal residual disease in neuroblastoma. J. Mol. Diagn. Jmd 2012, 14, 168–175. [Google Scholar] [CrossRef]
  22. Boeva, V.; Louis-Brennetot, C.; Peltier, A.; Durand, S.; Pierre-Eugene, C.; Raynal, V.; Etchevers, H.C.; Thomas, S.; Lermine, A.; Daudigeos-Dubus, E. Heterogeneity of neuroblastoma cell identity defined by transcriptional circuitries. Nat. Genet. 2017, 49, e1408. [Google Scholar] [CrossRef] [PubMed]
  23. Bethesda (MD): National Library of Medicine (US), N.C.f.B.I. Available online: https://www.ncbi.nlm.nih.gov/entrez/viewer.fcgi?db=nucleotide&id=1675122364 (accessed on 30 September 2020).
  24. Ucsc Genome Browser on Human Dec. 2013 (grch38/hg38) Assembly. Available online: https://genome-euro.ucsc.edu/cgi-bin/hgTracks?db=hg38&lastVirtModeType=default&lastVirtModeExtraState=&virtModeType=default&virtMode=0&nonVirtPosition=&position=chr1%3A171090905%2D171117819&hgsid=245864441_abIEEt4GrIAlPZztyxlE9hklBgQa (accessed on 30 October 2020).
  25. Debode, F.; Marien, A.; Janssen, É.; Bragard, C.; Berben, G. The influence of amplicon length on real-time PCR results. Base 2017. [Google Scholar] [CrossRef]
  26. Beillard, E.; Pallisgaard, N.; van der Velden, V.H.; Bi, W.; Dee, R.; van der Schoot, E.; Delabesse, E.; Macintyre, E.; Gottardi, E.; Saglio, G.; et al. Evaluation of candidate control genes for diagnosis and residual disease detection in leukemic patients using ‘real-time’ quantitative reverse-transcriptase polymerase chain reaction (rq-pcr)-a europe against cancer program. Leukemia 2003, 17, 2474–2486. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Gabert, J.; Beillard, E.; van der Velden, V.H.; Bi, W.; Grimwade, D.; Pallisgaard, N.; Barbany, G.; Cazzaniga, G.; Cayuela, J.M.; Cave, H.; et al. Standardization and quality control studies of ‘real-time’ quantitative reverse transcriptase polymerase chain reaction of fusion gene transcripts for residual disease detection in leukemia-a europe against cancer program. Leukemia 2003, 17, 2318–2357. [Google Scholar] [CrossRef]
  28. Simon, T.; Berthold, F.; Borkhardt, A.; Kremens, B.; De Carolis, B.; Hero, B. Treatment and outcomes of patients with relapsed, high-risk neuroblastoma: Results of german trials. Pediatric Blood Cancer 2011, 56, 578–583. [Google Scholar] [CrossRef]
  29. Kraal, K.C.; Bleeker, G.M.; van Eck-Smit, B.L.; van Eijkelenburg, N.K.; Berthold, F.; van Noesel, M.M.; Caron, H.N.; Tytgat, G.A. Feasibility, toxicity and response of upfront metaiodobenzylguanidine therapy therapy followed by german pediatric oncology group neuroblastoma 2004 protocol in newly diagnosed stage 4 neuroblastoma patients. Eur. J. Cancer 2017, 76, 188–196. [Google Scholar] [CrossRef]
  30. Bate-Eya, L.T.; Ebus, M.E.; Koster, J.; den Hartog, I.J.; Zwijnenburg, D.A.; Schild, L.; van der Ploeg, I.; Dolman, M.E.; Caron, H.N.; Versteeg, R.; et al. Newly-derived neuroblastoma cell lines propagated in serum-free media recapitulate the genotype and phenotype of primary neuroblastoma tumours. Eur. J. Cancer 2014, 50, 628–637. [Google Scholar] [CrossRef]
  31. van Nes, J.; Chan, A.; van Groningen, T.; van Sluis, P.; Koster, J.; Versteeg, R. A notch3 transcriptional module induces cell motility in neuroblastoma. Clin. Cancer Res. Off. J. Am. Assoc. Cancer Res. 2013, 19, 3485–3494. [Google Scholar] [CrossRef] [Green Version]
  32. van Wezel, E.M.; Zwijnenburg, D.; Zappeij-Kannegieter, L.; Bus, E.; van Noesel, M.M.; Molenaar, J.J.; Versteeg, R.; Fiocco, M.; Caron, H.N.; van der Schoot, C.E.; et al. Whole-genome sequencing identifies patient-specific DNA minimal residual disease markers in neuroblastoma. J. Mol. Diagn. Jmd 2015, 17, 43–52. [Google Scholar] [CrossRef]
  33. Swerts, K.; De Moerloose, B.; Dhooge, C.; Vandesompele, J.; Hoyoux, C.; Beiske, K.; Benoit, Y.; Laureys, G.; Philippé, J. Potential application of elavl4 real-time quantitative reverse transcription-PCR for detection of disseminated neuroblastoma cells. Clin. Chem. 2006, 52, 438–445. [Google Scholar] [CrossRef] [Green Version]
Cancers 13 00150 g001 550
Figure 1. Expression of ADRN and MES panel markers in ADRN and MES cell lines with singleplex and multiplex methods (A) ADRN cell lines 691-ADRN and SH-SY5Y in red and green, respectively. MES cell lines 691-MES and SH-EP2 in blue and purple, respectively. Expression with multiplex method in open symbols, expression with singleplex method in filled symbols. UND = undetermined; (B) Dilution curve of IMR32, ADRN markers tested in MPX and singleplex; (C) Dilution curve of 691-MES, MES markers tested in MPX and singleplex.
Figure 1. Expression of ADRN and MES panel markers in ADRN and MES cell lines with singleplex and multiplex methods (A) ADRN cell lines 691-ADRN and SH-SY5Y in red and green, respectively. MES cell lines 691-MES and SH-EP2 in blue and purple, respectively. Expression with multiplex method in open symbols, expression with singleplex method in filled symbols. UND = undetermined; (B) Dilution curve of IMR32, ADRN markers tested in MPX and singleplex; (C) Dilution curve of 691-MES, MES markers tested in MPX and singleplex.
Cancers 13 00150 g001
Cancers 13 00150 g002 550
Figure 2. Marker expression with the multiplex method in control peripheral blood (PB) and bone marrow (BM).
Figure 2. Marker expression with the multiplex method in control peripheral blood (PB) and bone marrow (BM).
Cancers 13 00150 g002
Cancers 13 00150 g003 550
Figure 3. Mean normalized Ct values in BM (A) and PB (B) of patients with neuroblastoma, for singleplex and multiplex methods. Bar graph showing the mean normalized Ct value (ΔCt = Ctmarker – CtGUSB) for ADRN and MES markers in singleplex and multiplex methods, in A: bone marrow (BM) and B: peripheral blood (PB) samples of patients with neuroblastoma. Whiskers indicate the standard deviation.
Figure 3. Mean normalized Ct values in BM (A) and PB (B) of patients with neuroblastoma, for singleplex and multiplex methods. Bar graph showing the mean normalized Ct value (ΔCt = Ctmarker – CtGUSB) for ADRN and MES markers in singleplex and multiplex methods, in A: bone marrow (BM) and B: peripheral blood (PB) samples of patients with neuroblastoma. Whiskers indicate the standard deviation.
Cancers 13 00150 g003
Table
Table 1. Median normalized expression levels of ADRN and MES panel by multiplex RT-qPCR in control BM (n = 54) and control PB (n = 50).
Table 1. Median normalized expression levels of ADRN and MES panel by multiplex RT-qPCR in control BM (n = 54) and control PB (n = 50).
MarkerBMPB
Positive BM SamplesExpression (Median + IQR)ThresholdPositive PB SamplesExpression (Median + IQR)Threshold
PHOX2B0/54 0/50
TH17/5416.0 (0.9)13.021/5014.3 (0.9)11.3
CHRNA342/5416.0 (1.7)13.021/5016.4 (1.7)13.4
GAP4342/5417.0 (2.3)14.0
DBH 6/5016.7 (0.7)13.7
FMO354/548.6 (2.7) 16/5015.2 (1.4)
PRRX154/5410.3 (2.8)9.0 *30/5015.3 (1.7)12.3 **
POSTN54/5412.1 (3.0)9.0 *27/5015.4 (2.0)12.5 **
All samples represent the median (±interquartile range (IQR)) of normalized Ct values (ΔCt = Ctmarker – CtGUSB). * Threshold for PRRX1 in BM is defined as ΔCt < 9.0 and CtPRRX1 − CtFMO3 < −1. Threshold for POSTN in BM is defined as ΔCt < 9.0 and CtPOSTN − CtFMO3 < 1. ** Threshold for PRRX1 and POSTN in PB is defined as ΔCt < 12.3 and 12.5 respectively, and no expression of FMO3. BM = bone marrow, PB = peripheral blood.
Table
Table 2. Comparison of singleplex and multiplex testing of patient bone marrow (BM) and peripheral blood (PB) samples.
Table 2. Comparison of singleplex and multiplex testing of patient bone marrow (BM) and peripheral blood (PB) samples.
MarkerBM (n = 24)PB (n = 21)
MPX Positive BM SamplesSingpleplex Positive BM SamplesMPX Positive PB SamplesSingleplex Positive PB Samples
PHOX2B24242019
TH22221318
CHRNA320201616
GAP432418
DBH 1821
Total ADRN24 *2420 **21
PRRX19900
POSTN7600
Total MES11 ***1000
* Sensitivity of 100% compared to the singleplex RT-qPCR in the BM cohort. ** Sensitivity of 95% compared to singleplex RT-qPCR in the PB cohort. *** Sensitivity of 80% compared to singleplex RT-qPCR in the BM cohort.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

van Zogchel, L.M.J.; Zappeij-Kannegieter, L.; Javadi, A.; Lugtigheid, M.; Gelineau, N.U.; Lak, N.S.M.; Zwijnenburg, D.A.; Koster, J.; Stutterheim, J.; van der Schoot, C.E.; et al. Specific and Sensitive Detection of Neuroblastoma mRNA Markers by Multiplex RT-qPCR. Cancers 2021, 13, 150. https://doi.org/10.3390/cancers13010150

AMA Style

van Zogchel LMJ, Zappeij-Kannegieter L, Javadi A, Lugtigheid M, Gelineau NU, Lak NSM, Zwijnenburg DA, Koster J, Stutterheim J, van der Schoot CE, et al. Specific and Sensitive Detection of Neuroblastoma mRNA Markers by Multiplex RT-qPCR. Cancers. 2021; 13(1):150. https://doi.org/10.3390/cancers13010150

Chicago/Turabian Style

van Zogchel, Lieke M. J., Lily Zappeij-Kannegieter, Ahmad Javadi, Marjolein Lugtigheid, Nina U. Gelineau, Nathalie S. M. Lak, Danny A. Zwijnenburg, Jan Koster, Janine Stutterheim, C. Ellen van der Schoot, and et al. 2021. "Specific and Sensitive Detection of Neuroblastoma mRNA Markers by Multiplex RT-qPCR" Cancers 13, no. 1: 150. https://doi.org/10.3390/cancers13010150

APA Style

van Zogchel, L. M. J., Zappeij-Kannegieter, L., Javadi, A., Lugtigheid, M., Gelineau, N. U., Lak, N. S. M., Zwijnenburg, D. A., Koster, J., Stutterheim, J., van der Schoot, C. E., & Tytgat, G. A. M. (2021). Specific and Sensitive Detection of Neuroblastoma mRNA Markers by Multiplex RT-qPCR. Cancers, 13(1), 150. https://doi.org/10.3390/cancers13010150

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop