Next Article in Journal
The Association between Dysbiosis and Neurological Conditions Often Manifesting with Chronic Pain
Next Article in Special Issue
Combination of Platelet-Rich Plasma and Hyaluronic Acid vs. Platelet-Rich Plasma Alone for Treatment of Knee Osteoarthritis
Previous Article in Journal
Exploring the Pipeline of Novel Therapies for Inflammatory Bowel Disease; State of the Art Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Positive Correlation between Relative Concentration of Spermine to Spermidine in Whole Blood and Skeletal Muscle Mass Index: A Possible Indicator of Sarcopenia and Prognosis of Hemodialysis Patients

1
Division of Neurology, First Department of Integrated Medicine, Saitama Medical Center, Jichi Medical University, Saitama 330-8503, Japan
2
Division of Nephrology, First Department of Integrated Medicine, Saitama Medical Center, Jichi Medical University, Saitama 330-8503, Japan
3
Department of Pharmaceutical Sciences, Faculty of Pharmaceutical Sciences, Josai University, Saitama 330-0295, Japan
4
Department of Dialysis, Minami-Uonuma City Hospital, Niigata 949-6680, Japan
5
Division of General Medicine, Department of Comprehensive Medicine 1, Saitama Medical Center, Jichi Medical University, Saitama 330-8503, Japan
6
Amine Pharma Research Institute, Innovation Plaza at Chiba University, Chiba 260-0856, Japan
7
Saitama Medical Center, Jichi Medical University, Saitama 330-8503, Japan
8
Saitama Ken-o Hospital, Okegawa, Saitama 363-0008, Japan
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Biomedicines 2023, 11(3), 746; https://doi.org/10.3390/biomedicines11030746
Submission received: 3 January 2023 / Revised: 17 February 2023 / Accepted: 24 February 2023 / Published: 1 March 2023
(This article belongs to the Special Issue Musculoskeletal Regenerative Medicine)

Abstract

:
Several mechanisms strictly regulate polyamine concentration, and blood polyamines are excreted in urine. This indicates polyamine accumulation in renal dysfunction, and studies have shown increased blood polyamine concentrations in patients with renal failure. Hemodialysis (HD) may compensate for polyamine excretion; however, little is known about polyamine excretion. We measured whole-blood polyamine levels in patients on HD and examined the relationship between polyamine concentrations and indicators associated with health status. Study participants were 59 hemodialysis patients (median age: 70.0 years) at Minami-Uonuma City Hospital and 26 healthy volunteers (median age: 44.5 years). Whole-blood spermidine levels were higher and spermine/spermidine ratio (SPM/SPD) was lower in hemodialysis patients. Hemodialysis showed SPD efflux into the dialysate; however, blood polyamine levels were not altered by hemodialysis and appeared to be minimally excreted. The skeletal muscle mass index (SMI), which was positively correlated with hand grip strength and serum albumin level, was positively correlated with SPM/SPD. Given that sarcopenia and low serum albumin levels are reported risk factors for poor prognosis in HD patients, whole blood SPM/SPD in hemodialysis patients may be a new indicator of the prognosis and health status of HD patients.

1. Introduction

The polyamines spermine (SPM), spermidine (SPD), and their precursor putrescine (PUT) are aliphatic amines essential for all living cells (Supplemental Figure S1). A graph with the chemical formulae of polyamines is presented in Supplemental Figure S1. Polyamines are synthesized intracellularly from arginine and undergo catabolism by several enzymes. In addition, cells can take up polyamines from their surroundings, and intracellular polyamines are excreted from cells [1]. The involvement of several enzymes in polyamine synthesis and catabolism and the presence of transport systems across the cell membrane suggest that intracellular polyamine concentrations are tightly regulated, which in turn indicates that polyamines are important for cellular homeostasis.
Polyamines have diverse functional profiles and are involved in a variety of biological processes, including chromatin structure remodeling, gene transcription and translation, cell proliferation, and circadian clock regulation. Polyamines act on nucleic acids by interacting with the negatively charged phosphodiester backbone, resulting in conformational changes in DNA and stabilization of tRNA. Polyamines also act as chemical chaperones and may be associated with protein conformational changes and function [2].
Intracellular de novo synthesis is considered the major source of polyamines during the fetal and developmental stages. With growth, the enzymatic activity of polyamine synthase gradually decreases, and the capacity for intracellular polyamine synthesis is reduced. Based on these findings, it can be inferred that polyamine levels decrease with age. Indeed, the titles and abstracts of certain studies describe age-dependent decreases in polyamine concentrations. For example, when the relationship between age and polyamine concentrations is examined at all ages, including in children, blood polyamine levels decline with age [3]. However, this age-dependent decline occurs only in the very early stages of growth; that is, particularly during fetal life. Many studies have clearly shown that polyamine concentrations in adult tissues, blood, and urine do not decline with age [1]. In addition to intracellular de novo polyamine synthesis, cells can take up polyamines from the surrounding environment. The most important source of polyamines in adults is the gastrointestinal tract; that is, polyamines in ingested food are synthesized in the gastrointestinal tract through the action of intestinal bacteria. In recent years, changes in blood SPM concentrations have been observed with the continued consumption of a high-polyamine diet in healthy volunteers [4].
However, polyamines in the body are excreted in urine via the kidneys. Polyamine synthesis is enhanced by the autonomous activation of polyamine synthase enzymes in cancer cells, and polyamines synthesized by cancer cells are transferred to blood cells [1]. It is well known that increased polyamine excretion is observed in cancer patients [5]. This also means that polyamines in the body are not eliminated via the kidneys in patients with renal failure, and high blood polyamine levels have been observed in patients with renal failure [6]. Hemodialysis (HD) is used to treat uremia in patients with renal failure. However, little is known about polyamine efflux into the dialysate or the changes in blood concentrations caused by HD. One purpose of this study was to compare blood polyamine levels between patients with chronic renal failure (CKD) undergoing HD and healthy volunteers. The effects of HD on blood polyamine levels were examined before and after HD.
Several researchers have been reported to correlate with degree of aging and may be predictive of prognosis in HD patients as well as in otherwise healthy individuals [7,8]. Recent studies have shown that blood polyamine levels and the SPM-to-SPD ratio are associated with health status and various age-related chronic diseases [4,9]. We examined the relationship between polyamine concentration and indicators reported to be associated with healthy life expectancy. Additionally, this study examined whether blood polyamine levels are an indicator of both health status and degree of senescence in dialysis patients.

2. Materials and Methods

2.1. Study Design and Participants

The study was conducted in accordance with the Declaration of Helsinki (revised in Tokyo in 2004) and was approved by the Institutional Review Board of Minami-Uonuma City Hospital (ID: R1-13). Both adult patients undergoing hemodialysis for renal failure and healthy adult volunteer participants were fully informed about the study and provided informed consent before participating. All patients received intermittent hemodialysis (HD) or hemodiafiltration (HDF) three times per week for 3–5 h. Participants on HD or HDF with pacemaker implants were excluded from the study because their skeletal muscle mass could not be measured using bioelectrical impedance analysis (BIA). Healthy volunteers were adults over 20 years of age with no specific illnesses who were recruited through notices such as posters. Healthy volunteers underwent annual medical checks (laboratory tests: blood count, blood glucose, HbA1c, creatinine, and blood urea nitrogen levels) and had no history of regular hospital visits or oral medications. Because the presence of neoplasms has a significant impact on polyamine levels, patients with cancer and those with a history of cancer treatment within 3 months were excluded from the study.

2.2. Data and Sample Collection

Medical backgrounds and other relevant data of the HD and HDF patients were collected from their medical records, such as information on the causative diseases of renal failure and dialysis, including dry weight (DW). The health status of the healthy adult volunteers was determined through interviews and physical examinations.
Body mass index (BMI) was calculated as body weight in kilograms divided by height in meters squared. Multifrequency bioelectrical impedance analysis (MF-BIA) was performed using InBody S10 (InBody Japan, Tokyo, Japan) to measure body composition and muscle mass. Skeletal muscle mass index (SMI) was calculated by dividing the limb skeletal muscle mass in kilograms by height in meters squared. Hand grip strength (HGS) was measured using a hand grip strength meter (Smedley’s Hand Dynamo Meter, Matsumiya Ika Seiki, Tokyo, Japan) in a sitting position; the highest numerical value measured in the left and right hand grip strength tests was used.
Blood samples were obtained at ambient temperature from the patients before and after HD or HDF. For the measurement of polyamine concentrations in the dialysate from dialysis patients, the dialysate was collected from six dialysis patients before dialysis began, 30 min after dialysis began, and just before the end of dialysis. For both HD patients and volunteers, whole blood samples for the measurement of polyamine concentrations (as well as dialysate collected from dialysis patients for the polyamine assay) were stored at −20 °C until the assay.

2.3. Blood and Biochemical Tests

All blood sample measurements, except those for polyamines, were performed in the clinical laboratory of Minami-Uonuma City Hospital. Hemoglobin (Hb) concentration was measured using the sodium lauryl sulfate hemoglobin detection method with an automated blood cell counter (XN-2000; Sysmex Corporation, Kobe, Japan). Biochemical blood tests were performed using an automated biochemical analyzer (BM6070, JEOL Ltd., Akishima, Japan). Serum albumin (Alb) concentration was measured using the modified bromocresol purple (BCP) method. Blood urea nitrogen (BUN) and creatinine (Cre) levels were measured using enzymatic methods. C-reactive protein (CRP) levels were measured using the latex immunoturbidimetric method. Serum calcium (Ca) and phosphorus (P) levels were measured using Arsenazo III colorimetric and enzymatic calorimetric methods, respectively.

2.4. Determination of Polyamine Concentrations in Whole Blood

Since most polyamines in the body are associated with cells, and the majority of blood polyamines are also attached to blood cells [10], we measured polyamine concentrations in whole blood. Whole blood samples were obtained from the arteriovenous fistula before and after HD., and then heparinized, collected, and stored at −20 °C. For polyamine measurement, whole blood was thawed and degraded by sonication and freeze-thaw cycles. Polyamine concentrations were determined using high-performance liquid chromatography (HPLC) at the Cardiovascular Institute for Medical Research at Saitama Medical Center of Jichi Medical University [11]. To extract polyamines, whole blood was diluted five times with 5% trichloroacetic acid (TCA). Subsequently, adjusted samples were incubated at 95 °C for 45 min. After centrifugation at 13,000× g for 20 min at 4 °C, the supernatant was collected and deproteinated by increasing the TCA concentration to 10%. Next, incubation was carried out at 95 °C for 45 min, followed by centrifugation at 13,000× g for 20 min at 4 °C. The polyamines in 20 µL of TCA supernatant were separated with an HPLC system (Shimadzu Corporation, Kyoto, Japan) with a TSKgel Polyaminepak column (column size 4.6 mm ID × 50 mm length, particle size 7 µm, TOSOH Bioscience, Tokyo, Japan) at 50 °C. The flow rate of the separation buffer (0.09 M citric acid (Nacalai Tesque, Inc., Kyoto, Japan), 2 M NaCl (Nacalai Tesque, Inc.), 0.64 mM n-capric acid (Nacalai Tesque, Inc.), 0.1% Brij-35 (Sigma-Aldrich Japan, Tokyo, Japan), 20% methanol (FUJIFILM Corporation, Osaka, Japan), adjusted to pH 5.10) was 0.42 mL/min. Polyamines were detected by fluorescence intensity after the reaction of the column effluent at 50 °C with a solution containing 0.4 M boric buffer (pH 10.4) (Nacalai Tesque, Inc.), 0.1% Brij-35, 2.0 mL/L 2-mercaptoethanol (Nacalai Tesque, Inc.), and 0.06% o-phthalaldehyde (Nacalai Tesque, Inc.). The flow rate of the o-phthalaldehyde solution was 0.42 mL/min, and fluorescence was measured at an excitation wavelength of 340 nm and an emission wavelength of 455 nm. The retention times for SPD and SPM were 12 min and 23 min, respectively. The concentrations in the original whole blood samples were expressed as micromolar concentrations (µM).

2.5. Determination of Polyamine Concentrations in Dialysate

Dialysates were collected from the waste stream before dialysis started, 30 min after dialysis started, and immediately before the end of dialysis. Immediately after collection, the dialysate was frozen at −20 °C and thawed before measurement. For the extraction of polyamines, dialysate containing 5% TCA was incubated at 95 °C for 45 min. The HPLC assay was performed under the same conditions as those used for the blood samples. In a preliminary study, the detection limits of SPD and SPM concentrations in the dialysate were 0.5 nM and 5 nM, respectively. The flow rate of the dialysate was 500 mL/min. The total volume of the dialysate was determined by the time required for dialysis, and the amount of polyamine excreted in the dialysate was calculated using the polyamine concentration measured by HPLC.

2.6. Statistical Analysis

The Shapiro–Wilk normality test was used to determine the normal distribution of the dataset. Continuous variables with normal distributions were expressed as mean ± standard deviation, and non-normal variables were expressed as median and interquartile ranges. A paired Student’s t-test was used to compare normally distributed values. For non-normally distributed values, the Wilcoxon signed-rank test was used to compare the matched polyamine concentration data before and after dialysis. Additionally, the Mann–Whitney U test was used to compare non-matched data between dialysis patients and healthy controls.
Correlations between the two groups were evaluated using Pearson’s correlation for normally distributed data and Spearman’s rank correlation for non-normally distributed data. All analyses were performed using IBM SPSS Statistics for Windows, version 28.0 (IBM Corp., Armonk, NY, USA). A p value < 0.05 was considered statistically significant.

3. Results

3.1. Characteristics of the Participants

A flowchart of the patient registration process is shown in Supplementary Figure S2. Overall, 11 patients refused to participate in the study, two patients died before the end of the study, one patient did not meet the requirements for participation because he was wearing a pacemaker, and six patients who had a past or current history of cancer were excluded. A total of 59 patients (35 men and 24 women) were enrolled in the study (Supplemental Figure S2).
The backgrounds and characteristics of the participants are presented in Table 1. Many previous research results have shown that polyamine concentrations do not change with age in healthy adults [1]. Therefore, we did not focus on matching the age range of the control group with that of the target group, but respected the volunteers’ willingness to participate; as a result, the control and dialysis groups were not matched for age. Their median age was 70.0 years (range, 62–75 years), and their median duration from the introduction of hemodialysis was 62 months (range, 29–142 months). The causative diseases requiring dialysis were glomerulonephritis (n = 20), diabetes mellitus (n = 18), nephrosclerosis (n = 6), and other diseases (n = 15). Forty-four patients received HD, and 15 patients received HDF. Twenty-six healthy volunteers (11 men and 15 women) participated in the study as controls, and none were excluded from the study. Their median age was 44.5 years (range: 37–52 years). There was no difference in sex (p = 0.149) between the dialysis and control groups, whereas dialysis patients were significantly older in (p < 0.001). HD patients had significantly lower SMI (6.3 ± 1.1 vs. 8.0 ± 1.2, p < 0.001) and HGS (23.5 ± 9.0 vs. 35.3 ± 9.6, p < 0.001) values than healthy individuals (Table 1).

3.2. Comparison of Blood Polyamine Levels

The blood SPD concentrations in HD patients were higher than those in healthy participants (10.1 (6.9–12.7) µM vs. 6.0 (4.8–7.1) µM, p < 0.001). The numerical values of blood SPM concentrations in HD patients were higher than those in healthy volunteers; however, there was no significant difference between them (4.4 (2.6–5.8) µM vs. 3.6 (2.7–4.9) µM, p = 0.401). The blood SPM/SPD ratio in HD patients was significantly lower than that in healthy participants (0.43 (0.34–0.59) vs. 0.64 (0.48–0.79) µM; p < 0.001) (Figure 1).
SPD and SPM concentrations and SPM/SPD ratios were evaluated before and after HD (Figure 2). HD did not significantly affect the SPD or SPM levels in whole blood; however, the SPM/SPD ratios decreased after HD (0.43 (0.34–0.59) vs. 0.42 (0.32–0.54), p < 0.001).

3.3. Polyamine Concentrations in Dialysate

HPLC did not detect (0.5 and 5 nM below the detection limit for SPD and SPM, respectively) either SPD or SPM in the dialysate before dialysis. SPD concentrations were detected in the dialysate 30 min after the start of dialysis for all six patients; the mean SPD concentration in the dialysate was 0.21 ± 0.13 μM. However, only four of the six patients had detectable SPD concentrations in the dialysate immediately before the end of dialysis. The mean concentration of the four samples was 0.14 ± 0.13 μM. SPM was not detected in any of the samples.

3.4. Analyses of Various Measurements in HD Patients

Various correlations between clinical parameters (excluding polyamines) were examined (Table 2). Patient age was negatively associated with SMI (ρ = −0.493, p < 0.001), HGS (ρ = −0.422, p = 0.001), Alb (ρ = −0.276, p = 0.034), and Cre (ρ = −0.427, p = 0.001). HD duration was negatively correlated with BMI (ρ = −0.420, p = 0.001) and HGS (ρ = −0.293, p = 0.024), but positively correlated with Cre (ρ = 0.325, p = 0.012). BMI and SMI were positively correlated (r = 0.377, p = 0.003). SMI was positively correlated with HGS (r = 0.629, p < 0.001), Alb (ρ = 0.281, p = 0.031), and Cre (ρ = 0.350, p = 0.007). HGS was positively correlated with Alb (ρ = 0.372, p = 0.004) and Cre (ρ = 0.405, p = 0.001). The Hb and CRP levels were negatively correlated (ρ = −0.284, p = 0.029). Alb was negatively correlated with CRP (ρ = −0.480, p < 0.001) and positively correlated with Ca (ρ = 0.463, p < 0.001). BUN was positively correlated with Cre (ρ = 0.354, p = 0.006) and p levels (ρ = 0.390, p = 0.002).

3.5. The Relationship between Polyamines and Various Measurements

The SPD and SPM concentrations and SPM/SPD ratios in relation to other clinical parameters are shown in Table 3. Notably, age and BMI did not correlate with either SPD and SPM concentrations or the SPM/SPD ratio. No significant correlation was found between HD duration and SPD, SPM, or the SPM/SPD ratio. The SPM/SPD ratio was significantly and positively correlated with SMI (ρ = 0.309, p = 0.017) and HGS (ρ = 0.260, p = 0.046) in a simple linear regression analysis (Figure 3). SMI did not correlate with SPM or SPD, and HGS showed no significant association with SPM or SPD.

4. Discussion

In this study, we determined that whole-blood SPD levels were higher in HD patients than in healthy participants; however, SPM levels did not differ between groups. The results of the present study are similar to those reported previously. Several reports have shown that erythrocyte SPD concentrations are significantly higher in patients with chronic renal failure than in healthy participants; however, their SPM levels are comparable to those in healthy participants [6]. Moulinoux et al. reported a significant increase in erythrocyte SPD levels in patients undergoing hemodialysis, whereas SPM levels were abnormally high in only a small proportion of patients [12]. Decreased urinary polyamine excretion in both patients with chronic renal failure and those on HD is considered one of the major causes of polyamine accumulation in blood cells.
Polyamine excretion from the dialysate was confirmed. Previous reports have shown that serum polyamine levels decrease after dialysis [13], indicating that HD can lead to the excretion of polyamines. However, in the present study an increase in polyamine excretion in the dialysate was mainly observed immediately after the start of dialysis, without affecting polyamine concentrations in whole blood. This suggests that polyamine excretion into the dialysate was insufficient to reduce whole-blood polyamine levels, as previously reported [6]. Given that most blood polyamines are present in association with blood cells, this may be due to the loss of intracellular polyamine delivery from blood cells to renal cells through intercellular contact.
Because of the noticeably higher SPD, the SPM/SPD ratio in HD patients was significantly lower than that in healthy volunteers. A lower SPM/SPD ratio in HD patients has also been previously reported [6,14]. In this study, HD patients were significantly older on average than healthy volunteers. Several reports have shown that the SPM/SPD ratio tends to decrease in healthy individuals because of the absence of an age-related decrease in SPD concentration and the presence of an age-related decreasing trend in SPM concentration [4,9,15]. However, these changes were minor and not statistically significant. Therefore, although the age difference between the two groups in this study may have had some effect on both polyamine SPM concentrations and SPM/SPD ratios, this is not expected to have a significant effect on the SPM/SPD ratio, especially the SPD concentration.
The findings of this study are consistent with those of previous studies. The difference in age between dialysis patients and controls resulted in a significant difference in muscle mass, as indicated by SMI, and muscle power, as indicated by HGS. This age-related change was also observed in a study involving patients on dialysis alone. In other words, SMI and HGS were negatively correlated with age. Furthermore, Alb and Hb levels decreased with age. The finding that CRP levels are negatively correlated with Alb and Hb levels is consistent with the finding that inflammation inhibits Alb and Hb synthesis. SMI and HGS, which were strongly correlated, were also positively correlated with Alb, a representative indicator of nutritional status, and Cre, the values of which are affected by muscle mass. Previous reports have indicated that several factors correlate with the prognosis of dialysis patients [16,17,18]. Among these, sarcopenia (for which the major diagnostic criteria are gait speed, HGS, and muscle mass [19,20]) is a major factor associated with a poor prognosis [21,22].
The intracellular concentrations of polyamines are tightly regulated by their import, export, synthesis, and catabolism. As part of this process, SPD and SPM are mutually converted [1], and because of this the SPM/SPD ratio has the potential to change. Chronic inflammation is known to be closely related to the development of various age- and lifestyle-related diseases [23,24]. It has also been recognized as the main component of the uremic phenotype linked to cardiovascular diseases and protein-energy wasting, which leads to sarcopenia [25,26] and is a strong predictor of poor outcomes in dialysis patients [27]. Inflammation activates spermidine/spermine-N1-acetyltransferase (SSAT), which acetylates the primary N1 amines of SPD and SPM. Both acetylated SPM and acetylated SPD are subsequently oxidized by N1-acetylpolyamine oxidase to produce SPD or putrescine, depending on the starting substrate, with H2O2 and aldehyde 3-acetoaminopropanal as byproducts [28,29,30]. Inflammation also activates the alternative enzyme spermine oxidase (SMO), which directly converts SPM to SPD while producing H2O2 and aldehyde 3-aminopropanal [31]. The generated 3-aminopropanal is spontaneously deaminated to produce acrolein, a highly toxic aldehyde [32]. Increased plasma polyamine oxidase activity and elevated acrolein levels have been reported in patients with chronic renal failure [12,33]. Briefly, two molecules of SPM become two molecules of SPD through two enzymes: SSAT and SMO. Simultaneously, one molecule of SPD becomes one molecule of putrescine via SSAT because it does not act on SPD. The inflammation-induced catabolism of SPM was accelerated more than that of SPD, resulting in a decrease in the SPM/SPD ratio (Supplemental Figure S3). The mechanism of both the increase in SPD and decrease in SPM/SPD in hemodialysis patients needs further investigation; however, similar findings have been reported in neurodegenerative diseases in which chronic inflammation is present as a pathological background. Decreased SPM/SPD ratios have been reported in patients with neurodegenerative diseases and cerebral ischemia associated with elevated SPD [9,34,35].
Recently, the relationship between muscles and polyamines has been examined in various ways. SPD and SPM were significantly decreased in the skeletal muscle of aged mice compared with that of young mice [36]. In contrast, a study of changes in skeletal muscle polyamine concentrations during exercise in male rats showed exercise-induced endogenous testosterone, followed by polyamine synthesis [37]. Polyamines are thought to be involved in skeletal muscle atrophy and hypertrophy and are of great interest in the prevention and treatment of muscle diseases [38,39]. Interventions for polyamine metabolism have the potential to be therapeutic interventions for muscle atrophy; however, further studies are needed.
Novel findings of this study include the positive correlations between both the SPM/SPD ratio and SMI and between the SPM/SPD ratio and HGS in HD patients. As SMI and HGS (which are also indicators of sarcopenia) are used to predict the prognosis of patients with HD, the SPM/SPD ratio may be a new predictor of prognosis and health status in patients with HD.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/biomedicines11030746/s1, Supplemental Figure S1. Graph with the chemical formulae of polyamines: Supplemental Figure S2. Patient flowchart: Supplemental Figure S3. Polyamine Oxidation Pathways Inflammation activates spermidine/spermine-N1-acetyltransferase (SSAT), which acetylates spermine and spermidine. Both acetylated spermine and spermidine are subsequently oxidized by N1-acetylpolyamine oxidase to produce spermidine or putrescine, depending on the starting substrate, with H2O2 and aldehyde 3-acetoaminopropanal as byproducts. Inflammation also activates spermine oxidase, which directly converts SPM to SPD while producing H2O2 and the aldehyde 3-aminopropanal. Spermine is oxidized by two enzymes; however, spermine oxidase does not oxidize SPD. Acetyl-CoA, acetylcoenzyme A; SSAT, spermidine/spermine-N1-acetyltransferase; SPD, spermidine.

Author Contributions

Conceptualization, H.S. (Hidenori Sanayama), K.I. (Kiyonori Ito), Y.S., Y.M., K.T. and K.S.; Data curation, H.S. (Hidenori Sanayama); Formal analysis, H.S. (Hidenori Sanayama) and S.O.; Funding acquisition, K.I. (Kiyonori Ito), Y.S. and K.S.; Investigation, H.S. (Hidenori Sanayama), K.I. (Kiyonori Ito), S.I., S.K., M.I., and K.T.; Methodology, H.S. (Hidenori Sanayama), K.I. (Kiyonori Ito), S.O., T.U., K.I. (Kazuei Igarashi), and K.S.; Project administration, H.S. (Hitoshi Sugawara) and K.S.; Resources, K.I. (Kiyonori Ito), S.O. and K.T.; Supervision, K.S.; Visualization, H.S. (Hidenori Sanayama); Writing—original draft, H.S. (Hidenori Sanayama); Writing—review & editing, T.U., H.S. (Hitoshi Sugawara) and K.S. All authors will be informed about each step of manuscript processing, including submission, revision, and revision reminder, via e-mail from our system or an assigned Assistant Editor. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by a grant from the Honjo International Scholarship Foundation.

Institutional Review Board Statement

This study was approved by the Institutional Review Board of Minami-Uonuma City Hospital (ID: R1-13).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data that support the findings of this study are available from the corresponding author (Kuniyasu Soda), upon reasonable request.

Acknowledgments

We thank the study participants and the hemodialysis paramedical staff at the Minami-Uonuma City Hospital.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Soda, K. Overview of polyamines as nutrients for human healthy long life and effect of increased polyamine intake on DNA methylation. Cells 2022, 11, 164. [Google Scholar] [CrossRef]
  2. Despotović, D.; Longo, L.M.; Aharon, E.; Kahana, A.; Scherf, T.; Gruic-Sovulj, I.; Tawfik, D.S. Polyamines mediate folding of primordial hyperacidic helical proteins. Biochemistry 2020, 59, 4456–4462. [Google Scholar] [CrossRef]
  3. Pekar, T.; Wendzel, A.; Flak, W.; Kremer, A.; Pauschenwein-Frantsich, S.; Gschaider, A.; Wantke, F.; Jarisch, R. Spermidine in dementia: Relation to age and memory performance. Wien Klin Wochenschr. 2020, 132, 42–46. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Soda, K.; Uemura, T.; Sanayama, H.; Igarashi, K.; Fukui, T. Polyamine-rich diet elevates blood spermine levels and inhibits pro-inflammatory status: An interventional study. Med. Sci. 2021, 9, 22. [Google Scholar] [CrossRef]
  5. Soda, K. The mechanisms by which polyamines accelerate tumor spread. J. Exp. Clin. Cancer Res. 2011, 30, 95. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Swendseid, M.E.; Panaqua, M.; Kopple, J.D. Polyamine concentrations in red cells and urine of patients with chronic renal failure. Life Sci. 1980, 26, 533–539. [Google Scholar] [CrossRef]
  7. Kim, J.K.; Kim, S.G.; Oh, J.E.; Lee, Y.K.; Noh, J.W.; Kim, H.J.; Song, Y.R. Impact of sarcopenia on long-term mortality and cardiovascular events in patients undergoing hemodialysis. Korean J. Intern. Med. 2019, 34, 599–607. [Google Scholar] [CrossRef] [Green Version]
  8. Kittiskulnam, P.; Chertow, G.M.; Carrero, J.J.; Delgado, C.; Kaysen, G.A.; Johansen, K.L. Sarcopenia and its individual criteria are associated, in part, with mortality among patients on hemodialysis. Kidney Int. 2017, 92, 238–247. [Google Scholar] [CrossRef] [PubMed]
  9. Saiki, S.; Sasazawa, Y.; Fujimaki, M.; Kamagata, K.; Kaga, N.; Taka, H.; Li, Y.; Souma, S.; Hatano, T.; Imamichi, Y.; et al. A metabolic profile of polyamines in parkinson disease: A promising biomarker. Ann. Neurol. 2019, 86, 251–263. [Google Scholar] [CrossRef] [Green Version]
  10. Cooper, K.D.; Shukla, J.B.; Rennert, O.M. Polyamine distribution in cellular compartments of blood and in aging erythrocytes. Clin. Chim. Acta 1976, 73, 71–88. [Google Scholar] [CrossRef]
  11. Igarashi, K.; Kashiwagi, K.; Hamasaki, H.; Miura, A.; Kakegawa, T.; Hirose, S.; Matsuzaki, S. Formation of a compensatory polyamine by Escherichia coli polyamine-requiring mutants during growth in the absence of polyamines. J. Bacteriol. 1986, 166, 128–134. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Moulinoux, J.P.; Le Pogamp, P.; Quémener, V.; Le Calvé, M.; Joyeux, V.; Chevet, D. Red cell free polyamine concentrations in patients on maintenance hemodialysis. Life Sci. 1981, 29, 955–962. [Google Scholar] [CrossRef] [PubMed]
  13. Igarashi, K.; Ueda, S.; Yoshida, K.; Kashiwagi, K. Polyamines in renal failure. Amino Acids 2006, 31, 477–483. [Google Scholar] [CrossRef]
  14. Yoshida, K.; Yoneda, T.; Kimura, S.; Fujimoto, K.; Okajima, E.; Hirao, Y. Polyamines as an inhibitor on erythropoiesis of hemodialysis patients by in vitro bioassay using the fetal mouse liver assay. Ther. Apher. Dial. 2006, 10, 267–272. [Google Scholar] [CrossRef] [PubMed]
  15. Elworthy, P.; Hitchcock, E. Polyamine levels in red blood cells from patient groups of different sex and age. Biochim. Biophys. Acta 1989, 993, 212–216. [Google Scholar] [CrossRef]
  16. Norgren, L.; Hiatt, W.R.; Dormandy, J.A.; Nehler, M.R.; Harris, K.A.; Fowkes, F.G. Inter-society consensus for the management of peripheral arterial disease (TASC II). J. Vasc. Surg. 2007, 45 (Suppl. S), S5–S67. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Sarnak, M.J.; Levey, A.S.; Schoolwerth, A.C.; Coresh, J.; Culleton, B.; Hamm, L.L.; McCullough, P.A.; Kasiske, B.L.; Kelepouris, E.; Klag, M.J.; et al. Kidney disease as a risk factor for development of cardiovascular disease: A statement from the american heart association councils on kidney in cardiovascular disease, high blood pressure research, clinical cardiology, and epidemiology and prevention. Hypertension 2003, 42, 1050–1065. [Google Scholar] [CrossRef] [Green Version]
  18. Foley, R.N.; Parfrey, P.S.; Sarnak, M.J. Epidemiology of cardiovascular disease in chronic renal disease. J. Am. Soc. Nephrol. 1998, 9 (Suppl. 12), S16–S23. [Google Scholar] [CrossRef]
  19. Chen, L.K.; Woo, J.; Assantachai, P.; Auyeung, T.W.; Chou, M.Y.; Iijima, K.; Jang, H.C.; Kang, L.; Kim, M.; Kim, S.; et al. Asian working group for sarcopenia: 2019 consensus update on sarcopenia diagnosis and treatment. J. Am. Med. Dir. Assoc. 2020, 21, 300–307.e2. [Google Scholar] [CrossRef]
  20. Cruz-Jentoft, A.J.; Baeyens, J.P.; Bauer, J.M.; Boirie, Y.; Cederholm, T.; Landi, F.; Martin, F.C.; Michel, J.P.; Rolland, Y.; Schneider, S.M.; et al. Sarcopenia: European consensus on definition and diagnosis: Report of the European working group on sarcopenia in older people. Age Ageing 2010, 39, 412–423. [Google Scholar] [CrossRef] [Green Version]
  21. Mori, K.; Nishide, K.; Okuno, S.; Shoji, T.; Emoto, M.; Tsuda, A.; Nakatani, S.; Imanishi, Y.; Ishimura, E.; Yamakawa, T.; et al. Impact of diabetes on sarcopenia and mortality in patients undergoing hemodialysis. BMC Nephrol. 2019, 20, 105. [Google Scholar] [CrossRef] [PubMed]
  22. Pereira, R.A.; Cordeiro, A.C.; Avesani, C.M.; Carrero, J.J.; Lindholm, B.; Amparo, F.C.; Amodeo, C.; Cuppari, L.; Kamimura, M.A. Sarcopenia in chronic kidney disease on conservative therapy: Prevalence and association with mortality. Nephrol. Dial. Transplant. 2015, 30, 1718–1725. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Neves, J.; Sousa-Victor, P. Regulation of inflammation as an anti-aging intervention. FEBS J. 2020, 287, 43–52. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Soda, K. Biological Effects of Polyamines on the Prevention of Aging-associated Diseases and on Lifespan Extension. Food Sci. Technol. Res. 2015, 21, 145–157. [Google Scholar] [CrossRef] [Green Version]
  25. Ferrucci, L.; Fabbri, E. Inflammageing: Chronic inflammation in ageing, cardiovascular disease, and frailty. Nat. Rev. Cardiol. 2018, 15, 505–522. [Google Scholar] [CrossRef] [PubMed]
  26. Stenvinkel, P.; Heimbürger, O.; Paultre, F.; Diczfalusy, U.; Wang, T.; Berglund, L.; Jogestrand, T. Strong association between malnutrition, inflammation, and atherosclerosis in chronic renal failure. Kidney Int. 1999, 55, 1899–1911. [Google Scholar] [CrossRef] [Green Version]
  27. Zimmermann, J.; Herrlinger, S.; Pruy, A.; Metzger, T.; Wanner, C. Inflammation enhances cardiovascular risk and mortality in hemodialysis patients. Kidney Int. 1999, 55, 648–658. [Google Scholar] [CrossRef] [Green Version]
  28. Holbert, C.E.; Dunworth, M.; Foley, J.R.; Dunston, T.T.; Stewart, T.M.; Casero, R.A., Jr. Autophagy induction by exogenous polyamines is an artifact of bovine serum amine oxidase activity in culture serum. J. Biol. Chem. 2020, 295, 9061–9068. [Google Scholar] [CrossRef]
  29. Holst, C.M.; Nevsten, P.; Johansson, F.; Carlemalm, E.; Oredsson, S.M. Subcellular distribution of spermidine/spermine N1-acetyltransferase. Cell Biol. Int. 2008, 32, 39–47. [Google Scholar] [CrossRef]
  30. Vujcic, S.; Liang, P.; Diegelman, P.; Kramer, D.L.; Porter, C.W. Genomic identification and biochemical characterization of the mammalian polyamine oxidase involved in polyamine back-conversion. Biochem. J. 2003, 370 Pt 1, 19–28. [Google Scholar] [CrossRef]
  31. Wang, Y.; Devereux, W.; Woster, P.M.; Stewart, T.M.; Hacker, A.; Casero, R.A., Jr. Cloning and characterization of a human polyamine oxidase that is inducible by polyamine analogue exposure. Cancer Res. 2001, 61, 5370–5373. [Google Scholar]
  32. Pegg, A.E. Toxicity of polyamines and their metabolic products. Chem. Res. Toxicol. 2013, 26, 1782–1800. [Google Scholar] [CrossRef]
  33. Sakata, K.; Kashiwagi, K.; Sharmin, S.; Ueda, S.; Irie, Y.; Murotani, N.; Igarashi, K. Increase in putrescine, amine oxidase, and acrolein in plasma of renal failure patients. Biochem. Biophys. Res. Commun. 2003, 305, 143–149. [Google Scholar] [CrossRef]
  34. Gomes-Trolin, C.; Nygren, I.; Aquilonius, S.M.; Askmark, H. Increased red blood cell polyamines in ALS and Parkinson’s disease. Exp. Neurol. 2002, 177, 515–520. [Google Scholar] [CrossRef] [PubMed]
  35. Els, T.; Bruckmann, J.; Röhn, G.; Daffertshofer, M.; Mönting, J.S.; Ernestus, R.I.; Hennerici, M. Spermidine: A predictor for neurological outcome and infarct size in focal cerebral ischemia? Stroke 2001, 32, 43–46. [Google Scholar] [CrossRef] [Green Version]
  36. Uchitomi, R.; Hatazawa, Y.; Senoo, N.; Yoshioka, K.; Fujita, M.; Shimizu, T.; Miura, S.; Ono, Y.; Kamei, Y. Metabolomic analysis of skeletal muscle in aged mice. Sci. Rep. 2019, 9, 10425. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Turchanowa, L.; Rogozkin, V.A.; Milovic, V.; Feldkoren, B.I.; Caspary, W.F.; Stein, J. Influence of physical exercise on polyamine synthesis in the rat skeletal muscle. Eur. J. Clin. Investig. 2000, 30, 72–78. [Google Scholar] [CrossRef] [PubMed]
  38. Abukhalaf, I.K.; von Deutsch, D.A.; Wineski, L.E.; Silvestrov, N.A.; Abera, S.A.; Sahlu, S.W.; Potter, D.E. Effect of hindlimb suspension and clenbuterol treatment on polyamine levels in skeletal muscle. Pharmacology 2002, 65, 145–154. [Google Scholar] [CrossRef]
  39. Cervelli, M.; Leonetti, A.; Duranti, G.; Sabatini, S.; Ceci, R.; Mariottini, P. Skeletal muscle pathophysiology: The emerging role of spermine oxidase and spermidine. Med. Sci. 2018, 6, 14. [Google Scholar] [CrossRef] [Green Version]
Figure 1. A box and whisker plot and scatterplot of whole blood SPD, SPM, and SPM/SPD in dialysis patients and healthy participants. For each box, the interior line shows the median, and the edges of the box are the estimates of the first and third quartiles. The whiskers extend to the most extreme data points not considered outliers (1.5 times the interquartile range from the edges of the box). Black dots indicate the values for each patient. Left: Comparison of whole-blood SPD and SPM levels in dialysis patients and healthy participants. Right: Comparison of whole blood SPM/SPD between dialysis patients and healthy participants. SPD: Spermidine, SPM: Spermine, HD: hemodialysis, NS: not significant.
Figure 1. A box and whisker plot and scatterplot of whole blood SPD, SPM, and SPM/SPD in dialysis patients and healthy participants. For each box, the interior line shows the median, and the edges of the box are the estimates of the first and third quartiles. The whiskers extend to the most extreme data points not considered outliers (1.5 times the interquartile range from the edges of the box). Black dots indicate the values for each patient. Left: Comparison of whole-blood SPD and SPM levels in dialysis patients and healthy participants. Right: Comparison of whole blood SPM/SPD between dialysis patients and healthy participants. SPD: Spermidine, SPM: Spermine, HD: hemodialysis, NS: not significant.
Biomedicines 11 00746 g001
Figure 2. Box and whisker plot and scatter plot of whole-blood SPD, SPM, and SPM/SPD before and after hemodialysis. For each box, the interior line shows the median, and the edges of the box are the estimates of the first and third quartiles. The whiskers extend to the most extreme data points not considered outliers (1.5 times the interquartile range from the edges of the box). Black dots indicate the values for each patient. Left: SPD and SPM in whole blood before and after HD. Right: SPM/SPD in whole blood before and after HD. SPD: Spermidine, SPM: Spermine, HD: hemodialysis, NS: not significant.
Figure 2. Box and whisker plot and scatter plot of whole-blood SPD, SPM, and SPM/SPD before and after hemodialysis. For each box, the interior line shows the median, and the edges of the box are the estimates of the first and third quartiles. The whiskers extend to the most extreme data points not considered outliers (1.5 times the interquartile range from the edges of the box). Black dots indicate the values for each patient. Left: SPD and SPM in whole blood before and after HD. Right: SPM/SPD in whole blood before and after HD. SPD: Spermidine, SPM: Spermine, HD: hemodialysis, NS: not significant.
Biomedicines 11 00746 g002
Figure 3. SPM/SPD ratio positively correlated with the SMI and HGS. There was a significant positive correlation between the pre-dialysis whole-blood SPM/SPD ratio and SMI (left) and between the SPM/SPD ratio and HGS (right) in dialysis patients. The correlation coefficients (ρ) were calculated using Spearman’s rank correlation coefficient. SPD: Spermidine, SPM: Spermine, SMI: Skeletal muscle mass index.
Figure 3. SPM/SPD ratio positively correlated with the SMI and HGS. There was a significant positive correlation between the pre-dialysis whole-blood SPM/SPD ratio and SMI (left) and between the SPM/SPD ratio and HGS (right) in dialysis patients. The correlation coefficients (ρ) were calculated using Spearman’s rank correlation coefficient. SPD: Spermidine, SPM: Spermine, SMI: Skeletal muscle mass index.
Biomedicines 11 00746 g003
Table 1. Characteristics of study participants.
Table 1. Characteristics of study participants.
CharacteristicsHD PatientsControls
Number of patients n, (men/women)59 (35/24)26 (11/15)
Age (years)70.0 (62.0–75.0)44.5 (37.0–52.0)
HD duration (months)62.0 (29.0–142.0)
Dialysis time (min)246 (246–247)
Dry Weight (kg), mean ± SD57.2 ± 11.4
Interdialytic weight gain (kg), mean ± SD2.6 ± 1.0
Interdialytic weight gain/dry weight (%), mean ± SD4.6 ± 1.7
BMI (kg/m2), mean ± SD22.4 ± 3.722.8 ± 3.1
SMI (kg/m2), mean ± SD6.3 ± 1.18.0 ± 1.2
HGS (kg), mean ± SD23.5 ± 9.035.3 ± 9.6
Primary Disease, n (%)
Chronic glomerulonephritis20 (34)
Diabetes mellitus18 (31)
Nephrosclerosis6 (10)
Others15 (25)
Past Medical History, n (%)
Diabetes mellitus22 (37)0 (0)
Dyslipidemia27 (44)0 (0)
Hypertension55 (93)0 (0)
Cardiovascular disease8 (14)0 (0)
Cerebrovascular disease12 (20)0 (0)
Values are shown as the median (interquartile range) unless otherwise indicated. HD, hemodialysis; SD, standard deviation; BMI, body mass index (kg/m2); SMI, skeletal muscle mass index (kg/m2); HGS, handgrip strength (kg).
Table 2. Correlations between clinical parameters (excluding polyamine concentrations).
Table 2. Correlations between clinical parameters (excluding polyamine concentrations).
AgeHD
Duration
BMISMIHGSHbAlbBUNCreCRPCaP
Age1.000
HD duration−0.0991.000
BMI−0.247−0.420 *1.000
SMI−0.493 **−0.249 *0.377 *1.000
HGS−0.422 *−0.293 *0.203 0.629 **1.000
Hb−0.0830.158−0.252 0.022 0.086 1.000
Alb−0.276 *−0.0490.2130.281 *0.372 *0.1431.000
BUN−0.210−0.0680.0920.1530.2370.1920.1361.000
Cre−0.427 *0.325 *0.0510.350 *0.405 *0.1640.2100.354 *1.000
CRP0.1700.132−0.083−0.156−0.184−0.284 *−0.480 **−0.038−0.1631.000
Ca−0.0670.184−0.052 −0.036 −0.024 0.229 0.463 **0.1350.051−0.0771.000
P−0.132−0.0180.1830.1190.107−0.032−0.0260.390 *0.1860.0660.0391.000
Pearson’s correlation coefficient. ** Correlation is significant at the 0.01 level (2-tailed). * Correlation is significant at the 0.05 level (2-tailed). HD, hemodialysis; BMI, body mass index (kg/m2); SMI, skeletal muscle mass index (kg/m2); HGS, hand grip strength (kg); Hb, hemoglobin (g/dL); Alb, albumin (g/dL); BUN, blood urea nitrogen (mg/dL); Cre, creatinine (mg/dL); CRP, C-reactive protein (mg/dL); Ca, calcium (mg/dL); P, phosphorus (mg/dL).
Table 3. Correlations between clinical parameters and polyamine.
Table 3. Correlations between clinical parameters and polyamine.
vs. SPD Values in Simple Linear Regressionvs. SPM Values in Simple Linear Regressionvs. SPM/SPD Values in Simple Linear Regression
ρp valueρp valueρp value
Age −0.0550.680−0.1370.301−0.1450.275
HD duration −0.0320.807−0.1060.424−0.1700.198
BMI 0.1130.3950.2440.0630.1720.194
SMI −0.0680.6100.0840.5280.3090.017 *
HGS −0.1590.230−0.0630.6360.2600.046 *
Laboratory findings
Hb −0.1680.203−0.0750.5700.1870.157
Alb −0.2380.070−0.2150.1020.0680.610
BUN 0.0190.8850.0440.7430.0460.727
Cre 0.0240.8570.1260.3400.1150.385
CRP0.2190.0950.1240.351−0.0580.663
Ca −0.0720.588−0.0680.6070.0340.799
P 0.0460.7300.1360.3030.0950.473
* Correlation is significant at the 0.05 level (two-tailed). As the values were not normally distributed, Spearman’s rank correlation was used to test correlations with polyamine concentration. HD, hemodialysis; BMI, body mass index (kg/m2); SMI, skeletal muscle mass index (kg/m2); HGS, hand grip strength (kg); Hb, hemoglobin (g/dL); Alb, albumin (g/dL); BUN, blood urea nitrogen (mg/dL); Cre, creatinine (mg/dL); CRP, C-reactive protein (mg/dL); Ca, calcium (mg/dL); P, phosphorus (mg/dL); SPD, spermidine (μM); SPM, spermine (μM).
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Sanayama, H.; Ito, K.; Ookawara, S.; Uemura, T.; Imai, S.; Kiryu, S.; Iguchi, M.; Sakiyama, Y.; Sugawara, H.; Morishita, Y.; et al. Positive Correlation between Relative Concentration of Spermine to Spermidine in Whole Blood and Skeletal Muscle Mass Index: A Possible Indicator of Sarcopenia and Prognosis of Hemodialysis Patients. Biomedicines 2023, 11, 746. https://doi.org/10.3390/biomedicines11030746

AMA Style

Sanayama H, Ito K, Ookawara S, Uemura T, Imai S, Kiryu S, Iguchi M, Sakiyama Y, Sugawara H, Morishita Y, et al. Positive Correlation between Relative Concentration of Spermine to Spermidine in Whole Blood and Skeletal Muscle Mass Index: A Possible Indicator of Sarcopenia and Prognosis of Hemodialysis Patients. Biomedicines. 2023; 11(3):746. https://doi.org/10.3390/biomedicines11030746

Chicago/Turabian Style

Sanayama, Hidenori, Kiyonori Ito, Susumu Ookawara, Takeshi Uemura, Sojiro Imai, Satoshi Kiryu, Miho Iguchi, Yoshio Sakiyama, Hitoshi Sugawara, Yoshiyuki Morishita, and et al. 2023. "Positive Correlation between Relative Concentration of Spermine to Spermidine in Whole Blood and Skeletal Muscle Mass Index: A Possible Indicator of Sarcopenia and Prognosis of Hemodialysis Patients" Biomedicines 11, no. 3: 746. https://doi.org/10.3390/biomedicines11030746

APA Style

Sanayama, H., Ito, K., Ookawara, S., Uemura, T., Imai, S., Kiryu, S., Iguchi, M., Sakiyama, Y., Sugawara, H., Morishita, Y., Tabei, K., Igarashi, K., & Soda, K. (2023). Positive Correlation between Relative Concentration of Spermine to Spermidine in Whole Blood and Skeletal Muscle Mass Index: A Possible Indicator of Sarcopenia and Prognosis of Hemodialysis Patients. Biomedicines, 11(3), 746. https://doi.org/10.3390/biomedicines11030746

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop