Next Article in Journal
NMR-Based Metabolic Profiling of Field-Grown Leaves from Sugar Beet Plants Harbouring Different Levels of Resistance to Cercospora Leaf Spot Disease
Previous Article in Journal
Acknowledgement to Reviewers of Metabolites in 2016
Previous Article in Special Issue
Metabolic Effect of Estrogen Receptor Agonists on Breast Cancer Cells in the Presence or Absence of Carbonic Anhydrase Inhibitors
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Distinguishing Benign from Malignant Pancreatic and Periampullary Lesions Using Combined Use of 1H-NMR Spectroscopy and Gas Chromatography–Mass Spectrometry

1
Department of Oncology, University of Calgary, Calgary, AB T2N 4N2, Canada
2
Department of Surgery, University of Calgary, Calgary, AB T2N 4N2, Canada
3
Department of Biological Sciences, University of Calgary, Calgary, AB T2N 4N2, Canada
4
Department of Pharmacology, University of Pennsylvania, Philadelphia, PA 19104, USA
5
Department of Mathematics and Statistics, University of Calgary, Calgary, AB T2N 4N2, Canada
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Metabolites 2017, 7(1), 3; https://doi.org/10.3390/metabo7010003
Submission received: 13 April 2016 / Revised: 9 December 2016 / Accepted: 8 January 2017 / Published: 13 January 2017
(This article belongs to the Special Issue Cancer Metabolomics 2016)

Abstract

:
Previous work demonstrated that serum metabolomics can distinguish pancreatic cancer from benign disease. However, in the clinic, non-pancreatic periampullary cancers are difficult to distinguish from pancreatic cancer. Therefore, to test the clinical utility of this technology, we determined whether any pancreatic and periampullary adenocarcinoma could be distinguished from benign masses and biliary strictures. Sera from 157 patients with malignant and benign pancreatic and periampullary lesions were analyzed using proton nuclear magnetic resonance (1H-NMR) spectroscopy and gas chromatography–mass spectrometry (GC-MS). Multivariate projection modeling using SIMCA-P+ software in training datasets (n = 80) was used to generate the best models to differentiate disease states. Models were validated in test datasets (n = 77). The final 1H-NMR spectroscopy and GC-MS metabolomic profiles consisted of 14 and 18 compounds, with AUROC values of 0.74 (SE 0.06) and 0.62 (SE 0.08), respectively. The combination of 1H-NMR spectroscopy and GC-MS metabolites did not substantially improve this performance (AUROC 0.66, SE 0.08). In patients with adenocarcinoma, glutamate levels were consistently higher, while glutamine and alanine levels were consistently lower. Pancreatic and periampullary adenocarcinomas can be distinguished from benign lesions. To further enhance the discriminatory power of metabolomics in this setting, it will be important to identify the metabolomic changes that characterize each of the subclasses of this heterogeneous group of cancers.

Graphical Abstract

1. Introduction

Patients with masses and strictures of the pancreas or periampullary structures may present with jaundice or pain, or lesions can be found incidentally on diagnostic imaging. Once a lesion of the pancreas and periampullary region is identified, further diagnostic tests are required to determine whether the lesion is benign or malignant (most commonly adenocarcinoma). Malignant lesions warrant early surgical consideration. Benign lesions, such as pancreatitis, benign strictures, and serous cysts, are ideally treated non-operatively.
Despite an extensive diagnostic workup consisting of cross-sectional imaging, endoscopic retrograde cholangiopancreatography (ERCP) with brush biopsy, endoscopic ultrasound (EUS) with fine needle aspiration (FNA), and serum CA19-9, malignant lesions can be diagnosed definitively only 60%–90% of the time [1,2,3,4]. Importantly, there is no sure way to determine whether a lesion is benign. There are a number of related implications. The extensive diagnostic work (including invasive tests) may delay treatment for patients who are ultimately proven to have a pancreatic or periampullary cancer. In addition, a large proportion of patients undergo major surgery without a definitive diagnosis. This results in a finding of benign pathology in 7%–31% of pancreatic surgical resection specimens [5,6,7,8]. Given that pancreatic surgery is associated with substantial morbidity and a significant risk of perioperative mortality [9,10], a reduction in the need for such “diagnostic” resections would be beneficial.
Better non-invasive diagnostic tests that accurately discriminate malignant from benign pancreatic lesions are clearly needed. Metabolomics, like other ‘omics’ fields, explores the ability of multimarker panels to differentiate between disease states. Our previous work demonstrated the ability of proton nuclear magnetic resonance (1H-NMR) spectroscopy to differentiate serum samples from patients with pancreatic cancer versus benign pancreaticobiliary disease using 22 metabolites and achieving an internal AUROC of 0.83 [11]. The current study is an extension of that work.
Firstly, we sought a more comprehensive evaluation of the metabolome by testing a larger group of samples using both 1H-NMR spectroscopy and gas chromatography–mass spectrometry (GC-MS). GC-MS has the potential to enhance the final metabolomic profile due to its greater sensitivity and ability to detect different metabolites than 1H-NMR spectroscopy [12]. 1H-NMR spectroscopy and GC-MS results were analyzed separately as well as in a combined fashion, to evaluate their relative strength and potential synergism. Secondly, we explored the application of metabolomics in a clinically relevant cohort of periampullary lesions, providing a more realistic analysis of the performance and limitations of a single metabolomic profile to distinguish benign from malignant disease. Previous studies have shown that the metabolomic profile of blood and urine can effectively distinguish benign disease from pancreatic cancer [11,13,14,15,16]. However, when located near the head of the pancreas, pancreatic cancer is mostly clinically indistinguishable from other periampullary adenocarcinomas. Therefore, it is unlikely that a test distinguishing benign disease from pancreatic cancer alone would be clinically useful unless it could also identify non-pancreatic periampullary cancers. To this end, using the two analytical modalities (1H-NMR spectroscopy and GC-MS), the minimal list of metabolites that consistently distinguished patients with malignant and benign pancreatic/periampullary lesions was identified in randomly allocated training sets, then validated in separate test sets.

2. Materials and Methods

2.1. Serum Samples

Venous blood samples were obtained from 157 patients who had a pancreatic or periampullary lesion on diagnostic imaging. All patients provided written consent consisting of permission to collect and bank blood and to collect linked demographic and clinical data for the purpose of supporting ethics-approved research projects. The procedures of the University of Calgary Hepatopancreaticobiliary/Gastrointestinal Tumor Bank, including consent, were approved by the Conjoint Health Research Ethics Board at the University of Calgary (Ethics ID E17213). The use of blood to identify metabolomic and proteomic biomarkers of pancreatic and periampullary tumors was also approved by the Conjoint Health Research Ethics Board at the University of Calgary (Ethics ID E20846). All patients had fasted for at least 8 hours at the time of sample collection.
For patients not undergoing surgical resection, samples were collected at a licensed laboratory collection facility. For patients undergoing surgical resection, samples were collected on the day of surgery, prior to any surgical manipulation. Serum samples were collected and stored as previously described [11].

2.2. Patient Data

Clinical data were collected prospectively as part of the serum banking process. Each patient was classified as having either a malignant or a benign pancreatic/periampullary lesion based on review of pathology, diagnostic imaging, and operative and clinic notes. Malignancies included adenocarcinomas of the pancreas, distal bile duct, ampulla of Vater and duodenum (all residing in the pancreatic and periampullary regions). In cases where finding the exact origin of an adenocarcinoma was not possible because the tumour was unresectable (n = 65), the lesion was classified according to the diagnosis favoured by the consulting surgeon based on the clinical course of the patient. For malignant lesions, stage classification was assigned according to the American Joint Committee on Cancer (AJCC) Cancer Staging Manual (7th Edition) [17].

2.3. Metabolomic Analysis

Serum samples for this study were analysed using 1H-NMR spectroscopy and GC-MS according to previously published protocols [11,18]. For 1H-NMR, a Bruker Avance 600 NMR spectrometer, operating at 600.22 MHz and equipped with a 5 mm TXI probe at 298 K was used. Spectra were acquired by using standard Bruker pulse sequence program (pr1d_noesy) in series of 1024 scans. Then 65,536 data points over the spectral width of 7211 Hz were then Fourier transformed using the Chenomx NMR Suite 6.1 processor software (Chenomx Inc., Edmonton, AB, Canada).
For GC-MS, each sample was randomly assigned to one of four sequential days for extraction, and then, with a separate randomization, assigned to one of four sequential days for derivatization and GC-MS analysis. Briefly, the modified Bligh and Dyer extraction and purification method for metabolite extraction [19]. For GC-MS analysis an Agilent 7890A chromatograph (Agilent Technologies Canada Inc., Mississauga, ON, Canada) equipped with an autosampler, was used. This was coupled with a Waters GCT Premier orthogonal acceleration/time-of-flight (oa-TOF) mass spectrometer (Waters Corp., Milford, MA, USA). An MS range of 50 to 800 m/z was used for scanning each sample in 31 min.
Metabolites from the 1H-NMR spectroscopy dataset were identified and quantified using the Human Metabolome Database (HMDB, version 2.5) [20] and Chenomx NMR Suite using the “Targeted Profiling” approach [21]. Metabolites and features from the GC-MS dataset were identified using Metabolite Detector software [22] (Version 2.06, Technische Universität Carolo-Wilhelmina zu Braunschweig, Braunschweig, Germany) and an in-house library based on the GOLM metabolite database [23]. All metabolite features, whether matched to an identification by Metabolite Detector or not, were included in the dataset for further analysis. Species matched to an entity in the GOLM database that does not yet have an associated chemical name were labelled with the word “Match”, their retention index (RI) value, and the list of m/z values for quantified ions (e.g., “Match: RI 1416.54, Ions 110 134 184 217 228”); and species not matched to any entity in the GOLM database were labelled with the word “Unmatched”, their RI value, and the list of m/z values for quantified ions (e.g., “Unmatched: RI 2475.33, Ions 73 375 376”).

2.4. Data Pre-Processing

All zero values were considered as missing values and all metabolites or features with >50% missing values were excluded from further analysis. The resulting 1H-NMR dataset contained 60 metabolites and the GC-MS dataset contained 123 metabolites/features for further analysis. Data pre-processing was conducted separately for the 1H-NMR spectroscopy and GC-MS datasets using STATA (version 12.0, StataCorp, College Station, TX, USA) and consisted of: median fold change normalization [24]; logarithmic transformation; centering; and unit variance scaling [25]. Median fold change normalization corrects for unwanted inter-sample differences in concentration and quality of preparation. Logarithmic transformation enhances the performance of the projection models that are based on the normality assumption for each metabolite, by making each metabolite’s distribution approach a normal distribution.
The resulting datasets had 22 metabolites in common (alanine, aspartate, citrate, glucose, glutamate, glutamine, glycerol, glycine, histidine, hypoxanthine, isoleucine, methionine, ornithine, phenylalanine, proline, pyroglutamate, serine, threonine, tryptophan, tyrosine, urea, and valine). For each of these metabolites, the 1H-NMR spectroscopy and GC-MS values was block normalized and included in a new combined dataset as previously reported [26]. To this was added the remaining 38 non-shared 1H-NMR metabolites and 101 non-shared GC-MS metabolites/features, giving a total of 161 metabolites/features in the combined dataset.

2.5. Multivariate Projection Modeling

Three random allocations of the 157 patient samples to training and test sets were conducted, in a 50:50 split, with separate stratifications within diagnosis class (malignant vs. benign) for serum sampling year (≤2008 vs. >2008), GC-MS extraction day (1 or 2 vs. 3 or 4), and GC-MS derivatization day (1 or 2 vs. 3 or 4).
SIMCA-P+ (Version 12.0, Umetrics, Umea, Sweden) software was used for all multivariate projection modeling. All modeling procedures were conducted separately for each of the three training sets, using the 1H-NMR spectroscopy, GC-MS, and combined datasets. Thus, a total of nine training models were generated (3 datasets x 3 trials). For each model, metabolites were pre-filtered using a t-test of distributions between malignant and benign lesions (p-value <0.3). Unsupervised principal component analysis (PCA) was then conducted to look for marked outliers and any latent structures within each model [27].
For each of the nine training sets, bidirectional orthogonal partial least squares (O2PLS) analysis was conducted using the following covariates: patient age, gender, lesion location, lesion type, surgical resection, cancer staging (where applicable), jaundice, diabetes mellitus, bowel cleansing, sampling year, and sampling location. For analysis of the GC-MS and combined datasets, extraction and derivatization days were added as covariates. Metabolites contributing more to the modeling of non-diagnostic covariates than to the modeling of the diagnostic class, were excluded iteratively until the diagnostic class was the covariate contributing most to the overall model. The resulting reduced list of metabolites was then submitted to orthogonal partial least squares-discriminant analysis (OPLS-DA) modeling. Using Variable Importance to Projection (VIP) values and coefficients, the list of metabolites was iteratively reduced to the absolute minimum required to maintain the strength of model parameters. For each training set, the resulting focused metabolite list was compiled and model parameters reported. The internal validity of the generated models was then tested by prediction of the diagnostic classification in the respective independent test sets, and area under the receiver operating curve (AUROC) values were calculated.

2.6. Metabolic Pathway Analysis

The focused list of metabolites from each trial was extracted, along with their respective regression coefficients and VIP values. These lists were combined for the three trials for each dataset. For metabolites found in the focused list for at least 2/3 of test data sets, average coefficient and VIP values were calculated. This yielded a focused list of metabolites for 1H-NMR spectroscopy, GC-MS, and combined datasets, respectively. A list of consistently contributing metabolites across all trials and datasets was compiled and submitted for topological metabolic pathway analysis using MetaboAnalyst software (version 2.0, Metabolomics Innovation Centre, Edmonton, AB, Canada) [28,29]. Where a metabolite was contributing to all three datasets, the average concentration/intensity data from the combined dataset was used. Otherwise, the concentration/intensity data from the 1H-NMR spectroscopy or GC-MS dataset was used, as appropriate.

3. Results

3.1. Demographic and Technical Factors

Lesions in the pancreas and periampullary region consisted of solid masses (n = 111), cystic lesions (n = 20), and biliary strictures (n = 19); seven were combinations of strictures and masses. Jaundice was present in 31 patients (19.7%), diabetes was present in 33 patients (21%). There were 35 benign lesions (22.2%). Of the malignant lesions, 84 (68.9%) were stage II and III cancers. All benign lesions were resected, 92 of the malignant lesions (75.4%) were resected. There were some differences in the benign and malignant groups. Average age was 57 ± 13 in the benign group, 66 ± 11 years in the malignant group (p < 0.0001). Jaundice was present in one patient with benign disease (2.8%), 30 patients with cancer (24.5%; p = 0.004). Finally, diabetes was present in six patients with benign lesions (17.1%) and 27 of patients with malignancy (22.1%; NS). For each of the three separate randomized allocations to the 50:50 split, the training group contained 80 patient samples, and the test group contained 77 patient samples. Clinical and technical factors appeared evenly distributed for each allocation, and training sets had similar characteristics as validation sets (Table 1).

3.2. Principal Component Analysis

On PCA modeling, no marked latent structures were identified and no sample was a consistent outlier across allocation trials (Figure 1). The cumulative R2X for the NMR model was 0.31 (based on four components); for GC-MS it was 0.46 (based on nine components).

3.3. Orthogonal Multivariate Projection Modeling

Table 2 summarizes the results of modeling for the 1H-NMR spectroscopy, GC-MS and combined datasets, and Figure 2 displays the respective scores plots. These results indicate the ability of metabolites from these three partitioned datasets to distinguish malignant versus benign lesions in training sets of 80 patient samples, with independent validation in test sets of 77 patient samples.
For the 1H-NMR spectroscopy dataset, the focused metabolite lists contained an average of 14 metabolites and the resulting models had the following average parameters: R2Y 0.308, Q2 0.184, and CV-ANOVA p value 1.8 × 10−3. On independent validation in the test sets, the average AUROC was 0.74 (SE = 0.06). When the same training sets were tested in the GC-MS dataset, the average focused metabolite list contained 18 compounds. Average model parameters were R2Y 0.312, Q2 0.188, and CV-ANOVA p value 8.4 × 10−4. On independent validation in the respective test sets, the mean AUROC was 0.62 (SE = 0.08). For both H-NMR and GC-MS, there is less variability in the benign samples than in the malignant samples. The malignant group is comprised entirely of adenocarcinomas, but the tissue of origin is heterogeneous, which may partly contribute to the larger degree of variability. In addition, the benign group is smaller, so there is limited variability expected in these circumstances. We do not believe that we have introduced any systematic bias, as we randomized the sample analysis.
For the combined dataset, focused metabolite lists contained, on average, 20 metabolites and the resulting models had, on average, R2Y 0.478, Q2 0.324, and CV-ANOVA p value 6.14 × 10−6. On validation in the respective test sets, the average AUROC was 0.66 (SE = 0.08). When the model containing only the eight metabolites in common was tested, the AUROC was 0.72 ± 0.05.
Eight metabolites were found to consistently contribute to the malignant/benign profile across all three datasets (Table 3): higher levels of glutamate, myo-inositol, phenylalanine, and urea were consistently correlated with malignancy; while higher levels of glutamine, ornithine, proline, and threonine were consistently correlated with benign disease. An additional 22 metabolites were found less consistently across the datasets. These metabolites were identified in the modeling for at least two trials in at least one dataset, or in different trials in different datasets. Of these, nine metabolites were associated with malignancy and 13 metabolites were associated with benign disease (Table 3).
Whisker plots of the raw data for all 30 consistently contributing metabolites are included as Supplementary Information. As in our previous clinical studies, the differences in individual metabolites between disease states are small. However, it is the pattern of multiple co-related metabolites that differ, as indicated in the above descriptions of OPLS-DA models. Thus, no single metabolomics feature is particularly informative, but the meta-biomarker comprised of co-relationships is reflective of disease state.

3.4. Metabolic Pathway Analysis

The predominant differences between malignant and benign patient samples appeared to occur within amino acid and carbohydrate metabolic pathways (Table 4). The arginine/proline pathway had the largest impact factor (0.456, p = 0.000085) with consistently higher levels of arginine, creatine, glutamine, ornithine, and proline seen in the benign samples and consistently higher levels of glutamate and urea in malignant samples. The alanine/aspartate/glutamate pathway had the next largest impact factor (0.441, p = 0.00026), reflecting the consistently higher levels of alanine and glutamine in benign samples versus glutamate and succinate in malignant samples. Galactose levels were higher in malignant samples and the galactose metabolism pathway had the third largest impact factor (0.224, p = 0.000086). The list of all statistically impacted pathways is included in Table 4.

4. Discussion

Clinically, to make timely treatment decisions, it would be beneficial to have a noninvasive test that distinguishes a benign from a malignant pancreatic and periampullary mass or stricture. A number of investigators have demonstrated that the serum metabolomic profile can discriminate pancreatic cancer from benign pancreatic lesions [11,13,14,15]. However, in the clinic, it is not always possible to distinguish pancreatic cancer from other periampullary adenocarcinomas. Therefore, our goal was to identify the metabolomic features that separated all pancreatic and periampullary adenocarcinomas from benign masses and strictures using a two-class model. This was considered feasible because cancers have some common features to their disordered metabolism, such as the Warburg effect.
We determined that focused metabolomic profiles containing as few as 14–18 metabolites do discriminate between serum samples from patients with malignant versus benign pancreatic/periampullary lesions. In the training set, these focused metabolomic profiles produced OPLS-DA models with R2 values of 0.30–0.48, indicating that 30%–48% of the observed variance in metabolite levels was attributable to the diagnostic classification. These values are in the range expected for clinical specimens [30], are in keeping with the clustering of samples by diagnostic category seen in the first and second components of unsupervised PCA, and were sufficient to statistically discriminate between diagnostic classes as indicated by the CV-ANOVA p-values. In separate validation sets, the AUROC values of metabolomics models had a level of performance similar to that of the serum tumor marker CA 19-9, suggesting that the metabolomic profile may have some value [1]. However, the test performance is insufficient to have a direct impact on clinical decision-making in its present form.
Our metabolomic models did not perform as well as in other studies, including our own. This is because our comparator groups consisted of disease processes that were more heterogenous than in other series, which typically consisted of pancreatic adenocarcinoma versus pancreatitis and/or or normal controls [11,13,14,15,31,32,33]. This was by design. Clinically, pancreatic and non-pancreatic adenocarcinomas are frequently indistinguishable. (It is only after resection that they can be definitively classified.) Therefore, if one were to apply a metabolomic profile for pancreatic cancer (as described by previous investigators) to a clinical population, it would underperform because of the inherent heterogeneity of the metabolomic features of similar lesions. We wanted to see if there was a simple “adenocarcinoma profile” that might be more applicable. The inferior performance of our model was not completely surprising, given that pancreatic cancer is associated with diabetes and non-pancreatic periampullary adenocarcinomas are not. Our experimental design provides a more realistic estimate of the performance of a test based on a single two-class metabolomic model. To enhance the performance of a metabolomics-based blood test for identification of individuals with malignancy, it will be important to define the metabolomic alterations associated with pancreatic and non-pancreatic adenocarcinomas separately.
The results of previous studies may also be overly optimistic because external validation sets were not always reported. In most studies, excellent AUROCS have been reported when metabolomic models were internally validated [11,15], exaggerating the performance of the metabolomic models. When external cohorts are used for validation, AUROCs on the validation sets are typically lower than in internal validation cohorts. For example, Kobayashi et al. compared metabolomic profiles of sera from pancreatic cancer and chronic pancreatitis analyzed by GC-MS [14]. They described an AUROC of 0.93 in a training set, and the AUROC in the validation set was only 0.76, which was no better than CA19-9 (AUROC 0.82) and CEA (AUROC 0.80). This illustrates the critical need for validation sets wherever possible in this field.
Unexpectedly, combining two complimentary analytical modalities in an attempt to gain a more comprehensive interrogation of the metabolome did not markedly improve test performance. We had hypothesized that creating a combined 1H-NMR spectroscopy/GC-MS dataset could harness the relative strengths of each platform, providing stronger predictions. However, the combined dataset models performed only slightly better than the GC-MS models and not as well as the 1H-NMR models. The combined metabolomic model derived from 1H-NMR spectroscopy and GC-MS was limited by the stability of the latter. 1H-NMR spectroscopy models generally performed better than the GC-MS models, with a smaller standard error for the AUROC values. In addition, the average standard error for the metabolite coefficients was 62% higher for GC-MS compared to 1H-NMR spectroscopy, indicating more variability in the regression modeling of metabolites in the GC-MS model. Finally, the consistency of metabolites identified across allocation sets was higher for 1H-NMR spectroscopy than for GC-MS. For 1H-NMR spectroscopy, 58% of metabolites important to the final focused list were identified in two or more of the allocation sets; only 36% of metabolites in the final list were identified in two or more of the allocation sets in GC-MS (p = 0.04).
It is possible that alternative approaches will be required to merge data from two analytical platforms. In the present study, a simple averaging technique was used to combine metabolites detected by both platforms. Other approaches to combining data are being developed and used, but no standard approach has yet been established [34,35]. Further work in this field may result in a method that effectively capitalizes on the relative strengths of multiplatform detection, to produce an even stronger diagnostic model.
Compared to our previous study using 1H-NMR spectroscopy to distinguish pancreatic cancer from benign tumors, some of the same changes in metabolites were observed in the present study. Specifically, in both studies, malignancy was associated with elevated glutamate, phenylalanine, and mannose; creatine, glutamine, threonine, and lysine were higher in the benign condition. These metabolites did not vary significantly by sex or any other factor other than disease state. The fact that these changes were seen in independent studies, despite the heterogeneity of the cancers included in the present study is encouraging.
The metabolomic profiles identified offer insights into the metabolomic pathways altered in patients with a pancreatic and periampullary malignancy. The results clearly indicate a tipping of the balance of amino acid metabolism towards higher glutamate levels in malignant samples and higher glutamine and alanine levels in benign disease. These observations are consistent with earlier findings published by our group, which found elevated levels of glutamate in the serum of pancreatic cancer patients when compared to that of patients with benign pancreatic or biliary disease [11]. It is also consistent with findings in many cancer model systems that show a switch to glutamine consumption, and increased glutamate and succinate production, in patients with rapidly proliferating cancer cells, as part of the “Warburg effect” [36,37].
Arginine and ornithine are part of the urea cycle and feed the production of putrescine, the rate-limiting step in protein synthesis. The conversion of arginine to ornithine, by the enzyme arginase, has been suggested as a major regulator of cell growth [36]. It is therefore interesting that arginine and ornithine levels were lower in the serum of patients with pancreatic cancer compared to benign pancreatic lesions. The level of urea, a side product of arginine-to-ornithine conversion, was slightly higher in patients with pancreatic cancer. Together, these findings are consistent with altered arginase activity in patients with pancreatic and periampullary adenocarcinomas. In pancreatic cancer samples tested by the International Cancer Genome Consortium [38], only 1% contained ARG1 mutations, and no ARG2 mutations were seen. Therefore, the mechanism for this observation must be further elucidated.
The correlation of serum galactose with pancreatic cancer is seen in the GC-MS dataset only, as NMR did not detect galactose in these conditions. A similar relationship was recently observed with colorectal cancer patients [18], but further investigation is needed before any putative mechanism can be proposed.

5. Conclusions

In conclusion, it is possible to distinguish benign and malignant pancreatic/periampullary masses and biliary strictures using 1H-NMR and GC-MS based on a two-class metabolomic model. We speculate that even better test performance could be expected if the metabolomic features of various pancreatic and periampullary cancers were defined, discriminating disease state on a multi-class model. Current methods of combining the employed analytical modalities do not enhance diagnostic power. However, if a more comprehensive analysis of the metabolome were done using quantitative methods (as opposed to semi-quantitative methods) or more sensitive techniques, perhaps targeting metabolites identified in discovery efforts such as this, one may derive a more robust diagnostic test. Using an analytic modality with broader coverage and improved separation, such as liquid chromatography-mass spectrometry, may also augment test performance.

Supplementary Materials

The following are available online at www.mdpi.com/2218-1989/7/1/3/s1, Figure S1: Principal Component Analysis (PCA) Scores Scatter plots for three training and validation set allocations of 1H-NMR, GC-MS and combined datasets; Figure S2: Receiver Operating Characteristic (ROC) curve for detection of benign and malignant periampullary lesions; Figure S3: Whisker plots for consistently contributing metabolites from NMR and GC-MS; Figure S4: Metaboanalyst 2.0 pathway analysis bubble plot; Table S1: Performance measurements in triplicate analysis of 1H-NMR dataset, 50/50 training/test dataset (n = 80/77); Table S2: Performance measurements in triplicate analysis of GC-MS dataset, 50/50 training/test dataset (n = 80/77); Table S3: Performance measurements in triplicate analysis of Combined dataset, 50/50 training/test dataset (n = 80/77).

Acknowledgments

This work was funded by the Alberta Cancer Foundation, and Alberta Innovates Health Solutions, as well as by individual donations. Hans J. Vogel holds the Armstrong Chair in Molecular Cancer Epidemiology. The authors wish to thank Nicole Dunse and Kathy Gratton for collecting and processing serum samples, and coordinating clinical data collection.

Author Contributions

Yarrow J. McConnell, Aalim M. Weljie, Hans J. Vogel and Oliver F. Bathe conceived and designed the experiments; Yarrow J. McConnell performed the experiments; Yarrow J. McConnell, Farshad Farshidfar, Karen A. Kopciuk and Oliver F. Bathe analyzed the data; Aalim M. Weljie, Elijah Dixon, Chad G. Ball, Francis R. Sutherland and Hans J. Vogel contributed reagents/materials/analysis tools; Yarrow J. McConnell, Farshad Farshidfar and Oliver F. Bathe wrote the paper. All authors have read and approved the final manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Goonetilleke, K.S.; Siriwardena, A.K. Systematic review of carbohydrate antigen (CA 19-9) as a biochemical marker in the diagnosis of pancreatic cancer. Eur. J. Surg. Oncol. 2007, 33, 266–270. [Google Scholar] [CrossRef] [PubMed]
  2. Kinney, T. Evidence-based imaging of pancreatic malignancies. Surg. Clin. N. Am. 2010, 90, 235–249. [Google Scholar] [CrossRef] [PubMed]
  3. Savides, T.J.; Donohue, M.; Hunt, G.; Al-Haddad, M.; Aslanian, H.; Ben-Menachem, T.; Chen, V.K.; Coyle, W.; Deutsch, J.; DeWitt, J.; et al. EUS-guided FNA diagnostic yield of malignancy in solid pancreatic masses: A benchmark for quality performance measurement. Gastrointest. Endosc. 2007, 66, 277–282. [Google Scholar] [CrossRef] [PubMed]
  4. Fogel, E.L.; deBellis, M.; McHenry, L.; Watkins, J.L.; Chappo, J.; Cramer, H.; Schmidt, S.; Lazzell-Pannell, L.; Sherman, S.; Lehman, G.A. Effectiveness of a new long cytology brush in the evaluation of malignant biliary obstruction: A prospective study. Gastrointest. Endosc. 2006, 63, 71–77. [Google Scholar] [CrossRef] [PubMed]
  5. Abraham, S.C.; Wilentz, R.E.; Yeo, C.J.; Sohn, T.A.; Cameron, J.L.; Boitnott, J.K.; Hruban, R.H. Pancreaticoduodenectomy (Whipple resections) in patients without malignancy: are they all ‘chronic pancreatitis’? Am. J. Surg. Pathol. 2003, 27, 110–120. [Google Scholar] [CrossRef] [PubMed]
  6. Yeo, C.J.; Cameron, J.L.; Sohn, T.A.; Lillemoe, K.D.; Pitt, H.A.; Talamini, M.A.; Hruban, R.H.; Ord, S.E.; Sauter, P.K.; Coleman, J.; et al. Six hundred fifty consecutive pancreaticoduodenectomies in the 1990s: Pathology, complications, and outcomes. Ann. Surg. 1997, 226, 248–260. [Google Scholar] [CrossRef] [PubMed]
  7. Camp, E.R.; Vogel, S.B. Blind Whipple resections for periampullary and pancreatic lesions. Am. Surg. 2004, 70, 6–12. [Google Scholar] [PubMed]
  8. McLean, S.R.; Karsanji, D.; Wilson, J.; Dixon, E.; Sutherland, F.R.; Pasieka, J.; Ball, C.; Bathe, O.F. The effect of wait times on oncological outcomes from periampullary adenocarcinomas. J. Surg. Oncol. 2013, 107, 853–858. [Google Scholar] [CrossRef] [PubMed]
  9. Simunovic, M.; Urbach, D.; Major, D.; Sutradhar, R.; Baxter, N.; To, T.; Brown, A.; Davis, D.; Levine, M.N. Assessing the volume-outcome hypothesis and region-level quality improvement interventions: Pancreas cancer surgery in two Canadian Provinces. Ann. Surg. Oncol. 2010, 17, 2537–2544. [Google Scholar] [CrossRef] [PubMed]
  10. Simons, J.P.; Shah, S.A.; Ng, S.C.; Whalen, G.F.; Tseng, J.F. National complication rates after pancreatectomy: Beyond mere mortality. J. Gastrointest. Surg. 2009, 13, 1798–1805. [Google Scholar] [CrossRef] [PubMed]
  11. Bathe, O.F.; Shaykhutdinov, R.; Kopciuk, K.; Weljie, A.M.; McKay, A.; Sutherland, F.R.; Dixon, E.; Dunse, N.; Sotiropoulos, D.; Vogel, H.J. Feasibility of identifying pancreatic cancer based on serum metabolomics. Cancer Epidemiol. Biomark. Prev. 2011, 20, 140–147. [Google Scholar] [CrossRef] [PubMed]
  12. Dunn, W.B.; Broadhurst, D.I.; Atherton, H.J.; Goodacre, R.; Griffin, J.L. Systems level studies of mammalian metabolomes: The roles of mass spectrometry and nuclear magnetic resonance spectroscopy. Chem. Soc. Rev. 2011, 40, 387–426. [Google Scholar] [CrossRef] [PubMed]
  13. Fang, F.; He, X.; Deng, H.; Chen, Q.; Lu, J.; Spraul, M.; Yu, Y. Discrimination of metabolic profiles of pancreatic cancer from chronic pancreatitis by high-resolution magic angle spinning 1H nuclear magnetic resonance and principal components analysis. Cancer Sci. 2007, 98, 1678–1682. [Google Scholar] [CrossRef] [PubMed]
  14. Kobayashi, T.; Nishiumi, S.; Ikeda, A.; Yoshie, T.; Sakai, A.; Matsubara, A.; Izumi, Y.; Tsumura, H.; Tsuda, M.; Nishisaki, H.; et al. A novel serum metabolomics-based diagnostic approach to pancreatic cancer. Cancer Epidemiol. Biomark. Prev. 2013, 22, 571–579. [Google Scholar] [CrossRef] [PubMed]
  15. Leichtle, A.B.; Ceglarek, U.; Weinert, P.; Nakas, C.T.; Nuoffer, J.M.; Kase, J.; Conrad, T.; Witzigmann, H.; Thiery, J.; Fiedler, G.M. Pancreatic carcinoma, pancreatitis, and healthy controls: Metabolite models in a three-class diagnostic dilemma. Metabolomics 2013, 9, 677–687. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Davis, V.W.; Schiller, D.E.; Eurich, D.; Bathe, O.F.; Sawyer, M.B. Pancreatic Ductal Adenocarcinoma is Associated with a Distinct Urinary Metabolomic Signature. Ann. Surg. Oncol. 2013, 20, 415–423. [Google Scholar] [CrossRef] [PubMed]
  17. American Joint Committee on Cancer. Exocrine and endocrine pancreas. In AJCC Cancer Staging Manual; Edge, S.B., Byrd, D.R., Compton, C.C., Eds.; Springer: Berlin/Heidelberg, Germany, 2010; pp. 241–249. [Google Scholar]
  18. Farshidfar, F.; Weljie, A.M.; Kopciuk, K.; Buie, W.D.; Maclean, A.; Dixon, E.; Sutherland, F.R.; Molckovsky, A.; Vogel, H.J.; Bathe, O.F. Serum metabolomic profile as a means to distinguish stage of colorectal cancer. Genome Med. 2012, 4, 42. [Google Scholar] [CrossRef] [PubMed]
  19. Bligh, E.G.; Dyer, W.J. A rapid method of total lipid extraction and purification. Can. J. Biochem. Physiol. 1959, 37, 911–917. [Google Scholar] [CrossRef] [PubMed]
  20. Wishart, D.S.; Knox, C.; Guo, A.C.; Eisner, R.; Young, N.; Gautam, B.; Hau, D.D.; Psychogios, N.; Dong, E.; Bouatra, S.; et al. HMDB: A knowledgebase for the human metabolome. Nucleic Acids Res. 2009, 37, D603–D610. [Google Scholar] [CrossRef] [PubMed]
  21. Weljie, A.M.; Newton, J.; Mercier, P.; Carlson, E.; Slupsky, C.M. Targeted profiling: Quantitative analysis of 1H-NMR metabolomics data. Anal. Chem. 2006, 78, 4430–4442. [Google Scholar] [CrossRef] [PubMed]
  22. Hiller, K.; Hangebrauk, J.; Jager, C.; Spura, J.; Schreiber, K.; Schomburg, D. MetaboliteDetector: Comprehensive analysis tool for targeted and nontargeted GC/MS based metabolome analysis. Anal. Chem. 2009, 81, 3429–3439. [Google Scholar] [CrossRef] [PubMed]
  23. Kopka, J.; Schauer, N.; Krueger, S.; Birkemeyer, C.; Usadel, B.; Bergmuller, E.; Dörmann, P.; Weckwerth, W.; Gibon, Y.; Stitt, M.; et al. [email protected]: The Golm Metabolome Database. Bioinformatics 2005, 21, 1635–1638. [Google Scholar] [CrossRef] [PubMed]
  24. Veselkov, K.A.; Vingara, L.K.; Masson, P.; Robinette, S.L.; Want, E.; Li, J.V.; Barton, R.H.; Boursier-Neyret, C.; Walther, B.; Ebbels, T.M.; et al. Optimized preprocessing of ultra-performance liquid chromatography/mass spectrometry urinary metabolic profiles for improved information recovery. Anal. Chem. 2011, 83, 5864–5872. [Google Scholar] [CrossRef] [PubMed]
  25. Van den Berg, R.A.; Hoefsloot, H.C.; Westerhuis, J.A.; Smilde, A.K.; van der Werf, M.J. Centering, scaling, and transformations: Improving the biological information content of metabolomics data. BMC Genom. 2006, 7, 142. [Google Scholar] [CrossRef] [PubMed]
  26. Booth, S.C.; Workentine, M.L.; Wen, J.; Shaykhutdinov, R.; Vogel, H.J.; Ceri, H.; Turner, R.J.; Weljie, A.M. Differences in metabolism between the biofilm and planktonic response to metal stress. J. Proteome Res. 2011, 10, 3190–3199. [Google Scholar] [CrossRef] [PubMed]
  27. Trygg, J.; Holmes, E.; Lundstedt, T. Chemometrics in metabonomics. J. Proteome Res. 2007, 6, 469–479. [Google Scholar] [CrossRef] [PubMed]
  28. Xia, J.; Wishart, D.S. Web-based inference of biological patterns, functions and pathways from metabolomic data using MetaboAnalyst. Nat. Protoc. 2011, 6, 743–760. [Google Scholar] [CrossRef] [PubMed]
  29. Xia, J.; Wishart, D.S. MSEA: A web-based tool to identify biologically meaningful patterns in quantitative metabolomic data. Nucleic Acids Res. 2010, 38, W71–W77. [Google Scholar] [CrossRef] [PubMed]
  30. Fiehn, O.; Garvey, W.T.; Newman, J.W.; Lok, K.H.; Hoppel, C.L.; Adams, S.H. Plasma metabolomic profiles reflective of glucose homeostasis in non-diabetic and type 2 diabetic obese African-American women. PLoS ONE 2010, 5, e15234. [Google Scholar] [CrossRef] [PubMed]
  31. Urayama, S.; Zou, W.; Brooks, K.; Tolstikov, V. Comprehensive mass spectrometry based metabolic profiling of blood plasma reveals potent discriminatory classifiers of pancreatic cancer. Rapid Commun. Mass Spectrom. 2010, 24, 613–620. [Google Scholar] [CrossRef] [PubMed]
  32. Zhang, H.; Wang, Y.; Gu, X.; Zhou, J.; Yan, C. Metabolomic profiling of human plasma in pancreatic cancer using pressurized capillary electrochromatography. Electrophoresis 2011, 32, 340–347. [Google Scholar] [CrossRef] [PubMed]
  33. Nishiumi, S.; Shinohara, M.; Ikeda, A.; Yoshie, T.; Hatano, N.; Kakuyama, S.; Mizuno, S.; Sanuki, T.; Kutsumi, H.; Fukusaki, E.; et al. Serum metabolomics as a novel diagnostic approach for pancreatic cancer. Metabolomics 2010, 6, 518–528. [Google Scholar] [CrossRef]
  34. Maher, A.D.; Cysique, L.A.; Brew, B.J.; Rae, C.D. Statistical integration of 1H-NMR and MRS data from different biofluids and tissues enhances recovery of biological information from individuals with HIV-1 infection. J. Proteome Res. 2011, 10, 1737–1745. [Google Scholar] [CrossRef] [PubMed]
  35. Gu, H.; Pan, Z.; Xi, B.; Asiago, V.; Musselman, B.; Raftery, D. Principal component directed partial least squares analysis for combining nuclear magnetic resonance and mass spectrometry data in metabolomics: application to the detection of breast cancer. Anal. Chim. Acta. 2011, 686, 57–63. [Google Scholar] [CrossRef] [PubMed]
  36. Weljie, A.M.; Jirik, F.R. Hypoxia-induced metabolic shifts in cancer cells: Moving beyond the Warburg effect. Int. J. Biochem. Cell Biol. 2011, 43, 981–989. [Google Scholar] [CrossRef] [PubMed]
  37. Morvan, D.; Demidem, A. Metabolomics by proton nuclear magnetic resonance spectroscopy of the response to chloroethylnitrosourea reveals drug efficacy and tumor adaptive metabolic pathways. Cancer Res. 2007, 67, 2150–2159. [Google Scholar] [CrossRef] [PubMed]
  38. Biankin, A.V.; Waddell, N.; Kassahn, K.S.; Gingras, M.C.; Muthuswamy, L.B.; Johns, A.L.; Miller, D.K.; Wilson, P.J.; Patch, A.M.; Wu, J.; et al. Pancreatic cancer genomes reveal aberrations in axon guidance pathway genes. Nature 2012, 491, 399–405. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. Principal components analysis (PCA) results. Scatter plots showing scores (t) in first two components of PCA models for one training dataset ((A) 1H-NMR; (B) GC-MS; (C) Combined). Results from other training sets were similar. Plots coded for patient diagnosis: malignant: ▲ vs. benign: ♢.
Figure 1. Principal components analysis (PCA) results. Scatter plots showing scores (t) in first two components of PCA models for one training dataset ((A) 1H-NMR; (B) GC-MS; (C) Combined). Results from other training sets were similar. Plots coded for patient diagnosis: malignant: ▲ vs. benign: ♢.
Metabolites 07 00003 g001
Figure 2. Orthogonal partial least squares discriminant analysis (OPLS-DA) results. Scatter plots showing scores (t) in first (t[1]) and orthogonal (to[1]) components of final OPLS-DA models for one training dataset (A) 1H-NMR; (B) GC-MS; (C) Combined). Results from other training sets were similar. Plots coded for patient diagnosis: malignant: ▲ vs. benign: ♢.
Figure 2. Orthogonal partial least squares discriminant analysis (OPLS-DA) results. Scatter plots showing scores (t) in first (t[1]) and orthogonal (to[1]) components of final OPLS-DA models for one training dataset (A) 1H-NMR; (B) GC-MS; (C) Combined). Results from other training sets were similar. Plots coded for patient diagnosis: malignant: ▲ vs. benign: ♢.
Metabolites 07 00003 g002
Table 1. Clinical and technical variables for each allocation of training and test sets.
Table 1. Clinical and technical variables for each allocation of training and test sets.
Allocation AAllocation BAllocation C
Training n = 80Test n = 77p *Training n = 80Test n = 77pTraining n = 80Test n = 77p *
Age<60 yrs24240.8727210.3822260.40
≥60 yrs5653 5356 5851
GenderMale45370.3146360.1840420.57
Female3540 3441 4035
Lesion LocationHead/Uncinate52580.3154560.5955550.46
Body/Tail2015 1916 2015
Lesion TypeMass58530.3759520.5754570.12
Stricture811 712 136
Cyst911 119 128
DiagnosisMalignant61610.6161610.6161610.61
Benign1916 1916 1916
Stage (for Malignant Lesions Only)I1180.395140.241270.25
II2728 3025 2728
III1613 1811 1415
IV712 811 811
Surgically ResectedYes48440.7243490.2149430.49
No3233 3728 3134
JaundiceYes13180.2614170.4715160.75
No6759 6660 6561
Diabetes MellitusYes20130.2117160.9418150.64
No6064 6361 6262
Bowel CleansingYes43431.042440.3047390.46
No2525 2921 2426
Sampling Year2006-845440.9145440.9145440.91
2009-103533 3533 3533
Sampling LocationLaboratory12170.2517120.3611180.12
OR6860 6365 6959
GC-MS ExtractionDay 1/242380.6942380.6942380.69
Day 3/43839 3839 3839
GC-MS DerivatizationDay 1/240410.6840410.6840410.68
Day 3/44036 4036 4036
* p values are for Mann-U-Witney testing between subgroups. Italicized variables were used as stratification factors in the randomized allocation process.
Table 2. Results of orthogonal partial least squares discriminant analysis (OPLS-DA).
Table 2. Results of orthogonal partial least squares discriminant analysis (OPLS-DA).
DatasetMean of Training Sets (n = 80 each)Mean of Test Sets (n = 77 each)
XR2Q2pAUROCSE
1H-NMR140.3080.1841.80 × 10−30.740.06
GC-MS180.3120.1888.40 × 10−40.620.08
Combined *200.4780.3246.14 × 10−60.660.08
* The combined dataset includes metabolite features from both 1H-NMR and GC-MS data, with averaged values for metabolites detected by both platforms. X: Mean number of unique metabolites/features in the focused metabolite lists across three randomized allocations of training/test set assignment; R2: goodness of fit; Q2: predictive ability of model (7-fold internal cross validation); p: p-value for CVANOVA testing; AUROC: area under the receiver operating curve; SE: standard error.
Table 3. Summary list of metabolite features included in final focused models.
Table 3. Summary list of metabolite features included in final focused models.
MetaboliteDatasetsMean CoeffMean SE (Coeff)Mean VIPMean SE (VIP)p-Value in NMRp-Value in GC-MS
Higher in MalignantGalactoseG, C0.1210.0691.1230.683-0.001
Unmatched RI:1007.82 QI: 67, 82, 83G, C0.1200.0741.3370.708-0.11
IsopropanolN, C0.1140.0421.0010.3820.01-
PhenylalanineN, G, C0.1090.0571.0520.6210.0040.15
GlutamateN, G, C0.1050.0641.1270.6160.010.01
MannoseN, C0.1020.0691.2200.4100.01-
Trimethylamine-N-oxideN0.0920.0610.8670.5030.08-
ArabitolG, C0.0900.0470.9670.409-0.16
ThreitolG, C0.0880.0800.8890.816-0.14
SuccinateN, C0.0860.1150.7430.777--
UreaN, G, C0.0740.0580.9650.6040.080.19
Myo-InositolN, G, C0.0700.0610.9910.5820.040.16
Trehalose-alphaG, C0.0590.0530.6240.572-0.21
Higher in BenignMatch RI:2018.25 QI: 191, 217, 305, 318, 507G, C−0.0290.0550.5680.680-0.79
TridecanolG−0.0600.0510.7380.613-0.28
Azelaic acidG−0.0610.0380.8140.526-0.04
Unmatched RI:2475.33 QI: 73, 375, 376G, C−0.0660.0480.7910.475-0.01
PyroglutamateN−0.0680.0360.6960.3060.18-
IsoleucineG−0.0690.0910.7781.069-0.05
TyrosineN, G−0.0740.0580.8620.6690.210.08
ArginineN, C−0.0800.0550.7210.5000.38-
Unmatched RI:1913.88 QI: 156, 174, 317G, C−0.0900.0671.0920.863-0.01
ProlineN, G, C−0.0960.0631.0090.5470.030.10
AlanineN, C−0.0980.0410.8530.3110.01-
OrnithineN, G, C−0.1040.0680.9970.6870.060.07
CreatineN, C−0.1070.0410.9520.2670.06-
GlutamineN, G, C−0.1150.0721.1070.6860.00020.0001
LysineN, C−0.1170.0371.2890.3450.01-
ThreonineN, G, C−0.1370.0651.3600.5380.040.001
Unmatched RI:1971.99 QI: 185, 247, 275G, C–0.1380.0691.3460.640-0.03
N: 1H-nuclear magnetic resonance spectroscopy, G: gas chromatography mass spectrometry, C: combined dataset, Coeff: regression coefficient for given X variable (metabolite) in the modeled Y variable (malignant versus benign), positive values associated with malignancy and negative values associated with benign disease; SE: standard error; RI: retention index, QI: quantification ions; VIP: variable importance to projection expresses overall contribution to the model. Metabolite features in italics were found in the focused lists for all three datasets.
Table 4. Topological metabolic pathway analysis.
Table 4. Topological metabolic pathway analysis.
Metabolic PathwayTotal Compounds in PathwayHits in Current DatasetpImpact Factor
Arginine and proline metabolism7778.49 × 10−50.456
Alanine, aspartate, and glutamate metabolism2442.60 × 10−40.441
Galactose metabolism4138.63 × 10−50.224
Lysine degradation4714.09 × 10−30.147
D-Glutamine and D-glutamate metabolism1121.37 × 10−30.139
Inositol phosphate metabolism3913.00 × 10−20.137
Phenylalanine metabolism4536.60 × 10−30.119
Aminoacyl-tRNA biosynthesis75108.90 × 10−70.113
Lysine biosynthesis3214.09 × 10−30.100
Glycine, serine and threonine metabolism4827.07 × 10−40.097
Tyrosine metabolism7622.77 × 10−20.047
Taurine and hypotaurine metabolism2018.27 × 10−30.032
Fructose and mannose metabolism4811.56 × 10−30.029
Butanoate metabolism4026.28 × 10−30.018
Valine, leucine, and isoleucine biosynthesis2729.74 × 10−40.013
Glutathione metabolism3833.35 × 10−30.013
Phenylalanine, tyrosine, and tryptophan biosynthesis2721.05 × 10−20.008
Purine metabolism9225.70 × 10−40.008
Produced using MetaboAnalyst software. For each pathway, the total number of known metabolites, along with the number of those found in the current dataset (“hits”) are reported. The p value is reported for the statistical comparison of metabolite feature levels between malignant and benign samples. The impact factor expresses the degree of centrality of the identified changes to the pathway functioning overall.

Share and Cite

MDPI and ACS Style

McConnell, Y.J.; Farshidfar, F.; Weljie, A.M.; Kopciuk, K.A.; Dixon, E.; Ball, C.G.; Sutherland, F.R.; Vogel, H.J.; Bathe, O.F. Distinguishing Benign from Malignant Pancreatic and Periampullary Lesions Using Combined Use of 1H-NMR Spectroscopy and Gas Chromatography–Mass Spectrometry. Metabolites 2017, 7, 3. https://doi.org/10.3390/metabo7010003

AMA Style

McConnell YJ, Farshidfar F, Weljie AM, Kopciuk KA, Dixon E, Ball CG, Sutherland FR, Vogel HJ, Bathe OF. Distinguishing Benign from Malignant Pancreatic and Periampullary Lesions Using Combined Use of 1H-NMR Spectroscopy and Gas Chromatography–Mass Spectrometry. Metabolites. 2017; 7(1):3. https://doi.org/10.3390/metabo7010003

Chicago/Turabian Style

McConnell, Yarrow J., Farshad Farshidfar, Aalim M. Weljie, Karen A. Kopciuk, Elijah Dixon, Chad G. Ball, Francis R. Sutherland, Hans J. Vogel, and Oliver F. Bathe. 2017. "Distinguishing Benign from Malignant Pancreatic and Periampullary Lesions Using Combined Use of 1H-NMR Spectroscopy and Gas Chromatography–Mass Spectrometry" Metabolites 7, no. 1: 3. https://doi.org/10.3390/metabo7010003

APA Style

McConnell, Y. J., Farshidfar, F., Weljie, A. M., Kopciuk, K. A., Dixon, E., Ball, C. G., Sutherland, F. R., Vogel, H. J., & Bathe, O. F. (2017). Distinguishing Benign from Malignant Pancreatic and Periampullary Lesions Using Combined Use of 1H-NMR Spectroscopy and Gas Chromatography–Mass Spectrometry. Metabolites, 7(1), 3. https://doi.org/10.3390/metabo7010003

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop