Next Article in Journal
The Conditions Under Which Piracetam Is Used and the Factors That Can Improve National Institute of Health Stroke Scale Score in Ischemic Stroke Patients and the Importance of Previously Unnoticed Factors From a Hospital-Based Observational Study in Taiwan
Previous Article in Journal
The Diversity of Encephalitogenic CD4+ T Cells in Multiple Sclerosis and Its Animal Models
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Homocysteine: A Potential Biomarker for Diabetic Retinopathy

by
Amany Tawfik
1,2,3,4,*,
Riyaz Mohamed
5,
Nehal M. Elsherbiny
6,
Margaret M. DeAngelis
7,
Manuela Bartoli
3,4 and
Mohamed Al-Shabrawey
1,2,3,4
1
Department of Oral Biology and Diagnostic Sciences, Dental College of Medicine, Augusta University, Augusta, GA 30912, USA
2
Department of Cellular Biology and Anatomy, Medical College of Georgia (MCG), Augusta University, Augusta, GA 30912, USA
3
Department of Ophthalmology, MCG, Augusta University, Augusta, GA 30912, USA
4
James and Jean Culver Vision Discovery Institute, MCG, Augusta University, Augusta, GA 30912, USA
5
Department of Physiology and Endocrinology, MCG, Augusta University, Augusta, GA 30912, USA
6
Department of Biochemistry, Faculty of Pharmacy, Mansoura University, Mansoura 35516, Egypt
7
Department of Ophthalmology, Department of Population Health Sciences, University of Utah School of Medicine, Department of Pharmacotherapy, School of Pharmacy, Salt Lake City, UT 84132, USA
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2019, 8(1), 121; https://doi.org/10.3390/jcm8010121
Submission received: 17 December 2018 / Revised: 11 January 2019 / Accepted: 15 January 2019 / Published: 19 January 2019
(This article belongs to the Section Ophthalmology)

Abstract

:
Diabetic retinopathy (DR) is the most common cause of blindness in people under the age of 65. Unfortunately, the current screening process for DR restricts the population that can be evaluated and the disease goes undetected until irreversible damage occurs. Herein, we aimed to evaluate homocysteine (Hcy) as a biomarker for DR screening. Hcy levels were measured by enzyme-linked immuno sorbent assay (ELISA) and immunolocalization methods in the serum, vitreous and retina of diabetic patients as well as in serum and retina of different animal models of DM representing type 1 diabetes (streptozotocin (STZ) mice, Akita mice and STZ rats) and db/db mice which exhibit features of human type 2 diabetes. Our results revealed increased Hcy levels in the serum, vitreous and retina of diabetic patients and experimental animal models of diabetes. Moreover, optical coherence tomography (OCT) and fluorescein angiography (FA) were used to evaluate the retinal changes in mice eyes after Hcy-intravitreal injection into normal wild-type (WT) and diabetic (STZ) mice. Hcy induced changes in mice retina which were aggravated under diabetic conditions. In conclusion, our data reported Hcy as a strong candidate for use as a biomarker in DR screening. Targeting the clearance of Hcy could also be a future therapeutic target for DR.

1. Introduction

Diabetic retinopathy (DR) is one of the most substantial microvascular complications of diabetes mellitus (DM), and is the most common cause of blindness in people under the age of 65 [1]. Unfortunately, DR can go undetected and not even noticed until irreversible damage and blindness has occurred [2]. DR is caused by damage to the blood vessels, resulting in retinal ischemia and increased permeability. New blood vessel formation (neovascularization) and diabetic macular edema (DME) are common characteristics for the disease [3]. Currently, retinopathy can only be diagnosed by a qualified specialist, either via direct proper examination of the eye or the examination of images captured by appropriate health care staff, which is costly and therefore restricts the population that can be effectively screened. An easily available, reliable screening biomarker of diabetic retinopathy would be of great benefit in identifying the population in need of further assessment and treatment [4]. Our research highlights homocysteine (Hcy) as a biomarker for DR that shows possibilities as a screening marker to detect early diabetic retinopathy or even to detect patients at an increased risk of DR at the time of diagnosis of diabetes. In addition, targeting Hcy clearance could be a future therapeutic target for DR.
Hcy is a sulfur-containing amino acid that is formed entirely upon the demethylation of the essential amino acid methionine, which is found principally in red meat and dairy products. Hcy is nutritionally controlled and metabolized through two pathways: The remethylation and trans-sulfuration pathways. Vitamins B6, B12 and folic acid (folate) serve as cofactors in Hcy metabolism. To accomplish normal metabolism of Hcy, the body requires adequate amounts of folic acid, vitamin B12 and vitamin B6, and due to the absence of these cofactors, Hcy can easily accumulate to harmful levels [5]. Normally, the human body is able to get rid of excess Hcy via the transsulfuration pathway, by which Hcy is converted to cystathionine by cystathionine β-synthase (CBS) enzyme by converting it into an antioxidant glutathione. The normal total plasma content of Hcy varies from 3–15 µM, and elevated plasma levels are termed hyperhomocysteinemia (HHcy). The ranges of Hcy elevated levels have been referred to as mild (16–30 µM), moderate (31–100 µM), or severe (>100 µM). High levels of Hcy in the blood have been reported to be an independent risk factor for heart disease as well as associated with kidney and brain disease [6,7,8].
Recently, elevated Hcy level has gained special consideration in relation to DR in several clinical studies, suggesting an association between elevated serum Hcy levels and the risk of DR [9,10,11,12,13,14,15,16,17]. There is an association between HHcy and diabetes-induced microangiopathies (diabetic nephropathy, retinopathy and macular edema) [18,19,20,21]. Studies suggested a strong relationship between elevated Hcy levels and DR. However, the exact role of HHcy in the development of DR is not clearly elucidated. There is clear evidence that Hcy induces the death of retinal ganglion cells in vitro [22] and in vivo [23]. Furthermore, vasculopathies linked to HHcy include endothelial dysfunction, vessel wall malformations, loss of extracellular matrix collagen, and disruption of the blood–brain barrier (BBB) in rodents and humans [24]. Impaired endothelial cell function has been also reported in vitro and in vivo in HHcy [25]. Moreover, our previous work reported a direct impact of excess Hcy on the blood–retinal barrier (BRB), induced retinal ischemia and neovascularization, increased vascular endothelial growth factor (VEGF) level in retina [26,27,28], activation of endoplasmic reticulum (ER) stress [29], activation of oxidative stress [30] and induced epigenetic modifications [31].

2. Experimental Section

2.1. Animals

All animal procedures followed the Association for Research in Vision and Ophthalmology (ARVO) Statement for Use of Animals in Ophthalmic and Vision Research policies and were accomplished in accordance with the Institute for Animal Care and Use Committee and Augusta University policies (IACUC Approval for Protocol 2014-0683) C57Black6 mice, Akita mice and Sprague–Dawley (SD) rats were obtained from Jackson Laboratories). Type 2 diabetic mice (db/db) were also obtained from Jackson Laboratories and bred according to the Jackson Laboratory recommendations (BKS.Cg-Dock7m+/+Leprdb/J). All animals were group-housed, subjected to the standard 12-hour light/12-hour dark cycle, provided with food and water ad libitum and kept at a temperature range of 22–24 °C. Genotypes were confirmed according to the Jackson Animal Laboratory genotyping protocols specific to each genotype.

2.2. STZ Injections

Six to eight-week old C57BL/6 mice and Sprague–Dawley (SD) rats were injected intraperitoneally (IP) with streptozotocin (STZ) at 50 mg/kg to induce diabetes. Mice were injected with STZ for three consecutive days, while SD rats received a single IP dose (animals were fasted for 4 h prior to injection). The mice and rats were evaluated 3 days after the STZ injection series to determine if they were sufficiently diabetic. A blood glucose concentration that exceeded 300 mg/dL was considered diabetic.

2.3. Measurement of Homocysteine Level

The concentration of Hcy in the blood and retinas of humans and different animal models of diabetes, representing type 1 and type 2 diabetes (STZ-treated mice, db/db mice and STZ-treated rats)—was determined using an Hcy Enzyme Linked Immunosorbent Assay (ELISA) kit from Cell Bio Labs Inc (STA-670) (San Diego, CA, USA). Human vitreous samples were a generous gift from Dr. Gregory I. Liou, Department of Ophthalmology, and Augusta University. Samples were derived from donors (Georgia Eye Bank, Atlanta, GA, USA). The selection criteria included an age >50 years old, with donors being either insulin-requiring diabetes (with DR) or normal control and no life-support measures. The eyes were enucleated an average of 6.71 ± 0.84 h after death. Postmortem eye specimens were utilized for vitreous collection by aspiration [32]. The patient’s blood samples were provided by Dr. Margaret M. DeAngelis and IRB was approved by the University of Utah. The collected retinas were rinsed with 1×phosphate-buffered saline (PBS), homogenized in 1× PBS and kept at −20 °C overnight. To break the cell membranes, two freeze–thaw cycles were performed, and then the homogenates were centrifuged for 5 min at 5000× g at 4°C. The supernatant was separated and assayed immediately according to the protocol provided with the kit. The blood samples collected were allowed to clot in serum separator tubes (SST) for a minimum of 2 h at room temperature prior to centrifugation at 1000× g for 15 min. The serum was collected and immediately assayed according to the protocol provided with the kit. The readings were taken at 450 nm using an ELISA plate reader.

2.4. Measurement of Cystathionine Beta-Synthase(CBS)Enzyme Level

The concentration of CBS in the serum from human patients with and without diabetes and from diabetic mice was determined using a CBS ELISA assay kit from My BioSource (MBS700623) (San Diego, CA, USA). Blood samples were allowed to clot in serum separator tubes (SST) for a minimum of 2 h at room temperature prior to centrifugation at 1000× g for 15 min. The serum was collected and immediately assayed according to the protocol provided with the kit.

2.5. Optical Coherence Tomography (OCT) and Fluorescein Angiography (FA)

OCT and FA imaging were used to evaluate the retinal vasculature in living mice according to our published methods [28,31]. Briefly, 2% isoflurane was used to anesthetize mice and 1% tropicamide eye drop was used to dilate their pupils. The anesthetized mice were then individually placed on the imaging platform of the Phoenix Micron III retinal imaging microscope accompanied with an OCT imaging device (Phoenix Research Laboratories, Pleasanton, CA, USA). Then, Genteal gel was applied liberally to keep the eye moist during imaging. For FA, 10% fluorescein sodium (Apollo Ophthalmics, Newport Beach, CA, USA) was injected to the mice (IP, 10 to 20 µL), and fluorescent images were rapidly captured for ~5 min. Indistinct vascular borders progressing to diffusely hazy fluorescence was considered as fluorescein leakage.

2.6. Immunofluorescent Assessment of Hcy Level

Retinal cryosections were prepared according to our previously published method [28,30]. First, the retinal sections were fixed with 4% paraformaldehyde. The fixation was followed by washing with PBS–Triton X-100, blocking with Power Block (BioGenex, Fremont, CA, USA), and then incubation with an anti-homocysteine antibody (Catalog number; ab5512 rabbit polyclonal, Chemicon International Inc., Temecula, CA, USA) at 37 °C for 3 h or at 4 °C overnight. The sections were subsequently washed with PBS–Triton X-100 three times. Then, the sections were incubated with the appropriate secondary antibody at 37 °C for 1 h. Sections were then washed with PBS–Triton X-100 and Fluoroshield with DAPI (4’6-diamidino-2-phenylindole) was applied, followed by the placement of a coverslip (Sigma Aldrich F6057, Saint Louis, MO, USA) to label the nuclei. Thereafter, sections were examined and images were captured using fluorescent microscopy (Carl Zeiss, Göttingen, Germany).

2.7. Statistical Analysis

The results are expressed as mean ± standard deviation SD. The assessment of differences among experimental groups was performed using the two-tailed t test or one-way analysis of variance (ANOVA). Detection of statistical differences by ANOVA was followed by a post hoc Tukey’s test to determine which groups differed. Statistical significance was considered at a confidence level of p < 0.05.

3. Results

3.1. Elevated Hcy Levels in Serum, Vitreous and Retina of Diabetic Patients and Experimental Diabetic Animals

To evaluate Hcy as a potential biomarker for the development of retinal complications in diabetes, we tested changes in Hcy level in the blood and retina of experimental models of type1and type 2 diabetes (STZ mice and rats and db/db mice, respectively). Our results showed increased Hcy levels in the blood and retina of diabetic animals compared to corresponding non-diabetic controls. In humans, the serum and vitreous levels of Hcy were significantly increased in diabetic patients compared to non-diabetic controls, suggesting that elevated Hcy levels might represent a risk factor for development of DR (Figure 1).

3.2. Hcy Immunolocalization in the Retina of Diabetic Patients and Experimental Diabetic Animals

In order to identify Hcy expression in the retina of diabetic patients, we performed Hcy immunostaining in frozen sections from human diabetic retina. Our results showed both marked immunoflourescent and immunohistochemical staining of Hcy in diabetic human retinal sections (Figure 2a). Further, we performed Hcy immunofluorescence in various experimental models of type1and type 2 diabetes. STZ-injected mice and rats as well as Akita mice were used as experimental models of type 1 diabetes. However, db/db mice were used as an experimental model of type 2 diabetes. Immunoflourescent staining showed an increased expression of Hcy in retinal sections from various diabetic animals compared to the corresponding WT non-diabetic controls (Figure 2b).

3.3. Down Regulation of CBS in the Serum of Diabetic Patients and Experimental Diabetic Animals

Cystathionine beta-synthase (CBS) catalyzes the first step in Hcy clearance through the transsulfuration pathway by converting Hcy and serine to cystathionine and water. To determine whether changes in CBS levels are associated with altered Hcy levels in diabetes, we tested the CBS level in the serum of diabetic patients and experimental diabetic animals. Our data demonstrated significantly lower levels of CBS in diabetic subjects compared to non-diabetic control (Figure 3).

3.4. Optical Coherence Tomography (OCT) and Fluorescein Angiography (FA)

To confirm the link between Hcy and microvascular dysfunction in diabetic retina, OCT and FA were performed in WT and diabetic mice injected intravitreally with Hcy. Consistent with our previous publications [26,27,28,31], in the current study, OCT examination showed alterations in retinal vasculature with neovascularization in both inner (white arrows) and outer retina (yellow arrows), and disrupted retinal morphology, such as sub-retinal fluid accumulation, separation of the retinal pigmented epithelial layer, and thickening of the basal laminar membrane and the choroid, suggesting neovascularization. Also, STZ-injected mice demonstrated decreased vessel integrity and an impaired blood–retinal barrier (BRB), indicated by increased fluorescein leakage as well as disrupted retinal morphology, when compared to the WT mice. Furthermore, to evaluate the changes of the combined effect of elevated Hcy and diabetes on the retina, STZ-treated mice given intravitreal injections of Hcy were subjected to FA and OCT. Hcy-injected diabetic mice showed more deleterious effects on the retinal architecture, decreased vessel integrity and more impairment of the BRB.FA showed increased fluorescein leakage with focal spots of hyperfluorescence, and OCT results showed more distortion in retinal morphology and BRB integrity and neovascularization compared to Hcy-injected and diabetic mice alone (Figure 4).

4. Discussion

This study was conducted to highlight Hcy as a marker and may be a future therapeutic target for DR. Recently, the association between Hcy and (DM) has gained increasing attention. Many studies reported increased levels of Hcy in the plasma of type 1 diabetes mellitus (T1DM) patients compared to non-diabetic controls [33,34]. It was also reported in a meta-analysis study that plasma Hcy concentrations in T1DM patients without any complications were normal compared with healthy people. However, plasma Hcy concentrations showed significant elevations only in T1DM patients with DR compared with T1DM patients without any complications [12], suggesting that increased Hcy levels during DM contributes to the development of retinopathy. In contrast, some studies reported no significant difference in Hcy levels between T1DM and non-diabetic patients [35], yet patients with proliferative retinopathy display significantly higher values of Hcy than those without [21]. Hcy level was also reported to be more elevated in type 2 diabetes mellitus (T2 DM) patients than controls [36,37,38,39,40]. On the other hand, some studies refuted the link between HHcy and incidence of retinopathy in diabetic patients [40,41]. Indeed, it was reported that T1DM patients had lower levels of Hcy and global DNA methylation [42]. A recent study reported that elevated Hcy levels were associated with an increased risk of DR, especially in T2DM patients [43].
Therefore, the current study aimed to solve this controversy by confirming what has been reported in human studies and also measured Hcy levels in different animal models of DM representing T1DM (STZ mice, Akita mice and STZ rats) and T2 DM (db/db mice). Our study showed a significant increase in Hcy levels in both human and different animal models of diabetes. There are many causes that have been suggested for increased Hcy levels, such as the deficiency of vitamin cofactors needed for Hcy metabolism, such as folic acid and vitamin B12 [44,45,46,47], or the deficiency of any of the enzymes involved the remethylation [48] or transsulfuration [49] pathways of the Hcy metabolism. Our study showed that the differences in the serum and retinal levels of Hcy were statistically significant between the control and diabetic groups in both humans and animals. In addition, our study showed a significant reduction of the CBS enzyme level, which is a key enzyme needed for Hcy clearance via the transsulfuration pathway, in both human and animal models of DR. Ratnam et al.reported that insulin plays a role in regulating Hcy metabolism, and impaired insulin levels in diseases such as diabetes may influence Hcy metabolism by regulating the hepatic transsulfuration pathway [50]. Diabetic nephropathy is a common microvascular complication of diabetes and could play a role in elevated Hcy levels due to chronic kidney insufficiency and impaired Hcy clearance. However, a recent clinical study was conducted on 163 normo-albuminuric patients with T1DM and normal renal function to examine whether there is an independent relationship between plasma total homocysteine (tHcy) and retinopathy in normo-albuminuric T1DM patients with normal estimated glomerular filtration rate (eGFR). The study suggested that tHcy is independently associated with retinopathy in normo-albuminuric T1DM with normal eGFR [17]. Furthermore, another large study of European type 1 diabetic patients stated that increased concentrations of tHcy were independently related to macro-albuminuria, renal function and hypertension [51].
Moreover, various studies reported the mechanism of action of Hcy leading to retinal neurodegeneration using different animal models. Hcy has been reported to induce apoptosis in retinal ganglion cells and induced ganglion cell loss via the dysregulation of mitochondrial dynamics in vivo and in vitro [52,53,54]. The activation of N-methyl D-aspartate (NMDA) receptors has been also suggested as a possible mechanism of HHcy-induced retinal ganglion cell death during DR in several studies [54,55,56,57,58,59]. Other studies suggested that HHcy exerts its toxic effect via the activation of inflammatory and oxidative stress mechanisms leading to the activation of mitogen-activated protein kinases (MAPK), macrophage infiltration and enhanced pro-inflammatory cytokines production [60]. Moreover, HHcy elicits oxidative stress and decreases nitric oxide’s bioactivity, leading ultimately to vascular dysfunction [61]. Our previous work demonstrated that HHcy caused dysfunction of the BRB, disrupts retinal pigment epithelial structure and function, activates oxidative and endoplasmic reticulum stresses and induces retinal neovascularization and epigenetic modifications [27,28,29,30,31]. The current study found that HHcy caused similar structural changes to what has been reported in our previous publications [27,28,31] when injected intravitreally in mice retina, and these changes were more deleterious when Hcy was injected in diabetic mice, suggesting the involvement of Hcy in the pathogenesis of diabetes-induced retinal damage. This was consistent with what has been reported by Srivastav et al.—That Hcy level was correlated with the decrease in the thickness of the retinal nerve fiber layer in diabetic patients—and suggested a correlation between increased serum levels of Hcy and an increased severity of retinopathy [11].

5. Conclusions

The current study is innovative in suggesting a correlation between elevated levels of Hcy in serum and in retina and DR in both diabetic human and animal models of diabetes. Furthermore, our results suggest an association between increased serum levels of Hcy and an increased severity of retinopathy. Therefore, Hcy could be a useful diagnostic marker for screening to predict the incidence and severity of retinal damage in diabetic patients. In addition, enhancing Hcy clearance via pharmacological or genetic manipulations could be a future preventive/therapeutic strategy in targeting diabetic retinopathy.

Author Contributions

Conceptualization, A.M.T. and A.M.T.; methodology, A.M.T.; software, A.M.T. and M. Al-SH.; validation, A.M.T., M. Al-SH. and N.M.E.; formal analysis, A.M.T., R.M.; investigation, A.M.T., R.M.; M.M.D. resources, A.M.T., M.M.D., M.B., M. Al-SH.; data curation, A.M.T. and R.M.; writing—original draft preparation, A.M.T.; writing—review and editing, N.M.E. and M. Al-SH.; supervision, A.M.T.; project administration, A.M.T.; funding acquisition, A.M.T.

Funding

This publication was made possible by startup funds from the Dental College of Georgia, a pilot project grant from the James & Jean Culver Vision Discovery Institute (VDI) and American Heart Association (AHA) Scientist Development Grant award #16SDG30700016. National Institutes of Health Core Grant (EY014800) (Moran Eye Center) and an Unrestricted Grant from Research to Prevent Blindness, Inc., New York, NY, to the Department of Ophthalmology & Visual Sciences, University of Utah.

Acknowledgments

The work in Mohamed Al-Shabrawey laboratory is supported in part by 5R01EY023315-02. We also would like to thank Katharine Bunchfor helping in the IHC experiment (previously, a Research Assistant in Department of Oral Biology, Augusta University).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bennett, G.H.; Tuthill, A. Investigating the Barriers to the Uptake of Diabetic RetinaScreen. Ir. Med. J. 2017, 110, 628. [Google Scholar] [PubMed]
  2. Kashim, R.M.; Newton, P.; Ojo, O. Diabetic retinopathy screening: A systematic review on patients’ non-attendance. Int. J. Environ. Res. Public Health 2018, 15, 157. [Google Scholar] [CrossRef]
  3. Wu, L.; Fernandez-Loaiza, P.; Sauma, J.; Hernandez-Bogantes, E.; Masis, M. Classification of diabetic retinopathy and diabetic macular edema. World J. Diabetes 2013, 4, 290–294. [Google Scholar] [CrossRef] [PubMed]
  4. Pusparajah, P.; Lee, L.H.; Abdul Kadir, K. Molecular markers of diabetic retinopathy: Potential screening tool of the future? Front. Physiol. 2016, 7, 200. [Google Scholar] [CrossRef] [PubMed]
  5. Jacques, P.F.; Bostom, A.G.; Wilson, P.W.; Rich, S.; Rosenberg, I.H.; Selhub, J. Determinants of plasma total homocysteine concentration in the Framingham Offspring cohort. Am. J. Clin. Nutr. 2001, 73, 613–621. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Homocysteine Studies Collaboration. Homocysteine and risk of ischemic heart disease and stroke: A meta-analysis. JAMA 2002, 288, 2015–2022. [Google Scholar] [CrossRef]
  7. Sen, U.; Basu, P.; Abe, O.A.; Givvimani, S.; Tyagi, N.; Metreveli, N.; Shah, K.S.; Passmore, J.C.; Tyagi, S.C. Hydrogen sulfide ameliorates hyperhomocysteinemia-associated chronic renal failure. Am. J. Physiol. Renal. Physiol. 2009, 297, 410–419. [Google Scholar] [CrossRef] [PubMed]
  8. Lominadze, D.; Roberts, A.M.; Tyagi, N.; Moshal, K.S.; Tyagi, S.C. Homocysteine causes cerebrovascular leakage in mice. Am. J. Physiol. Heart Circ. Physiol. 2006, 290, 1206–1213. [Google Scholar] [CrossRef]
  9. Dos Santos Nunes, M.K.; Silva, A.S.; de Queiroga Evangelista, I.W.; Filho, J.M.; Gomes, C.; do Nascimento, R.A.F.; Luna, R.C.P.; de Carvalho Costa, M.J.; de Oliveira, N.F.P.; Persuhn, D.C. Hypermethylation in the promoter of the MTHFR gene is associated with diabetic complications and biochemical indicators. Diabetol. Metab. Syndr. 2017, 9, 84. [Google Scholar] [CrossRef]
  10. Dong, N.; Shi, H.; Tang, X. Plasma homocysteine levels are associated with macular thickness in type 2 diabetes without diabetic macular edema. Int. Ophthalmol. 2017. [Google Scholar] [CrossRef]
  11. Srivastav, K.; Saxena, S.; Mahdi, A.A.; Shukla, R.K.; Meyer, C.H.; Akduman, L.; Khanna, V.K. Increased serum level of homocysteine correlates with retinal nerve fiber layer thinning in diabetic retinopathy. Mol. Vis. 2016, 22, 1352–1360. [Google Scholar] [PubMed]
  12. Feng, Y.; Shan, M.Q.; Bo, L.; Zhang, X.Y.; Hu, J. Association of homocysteine with type 1 diabetes mellitus: A meta-analysis. Int. J. Clin. Exp. Med. 2015, 8, 12529–12538. [Google Scholar]
  13. Ajith, T.A.; Ranimenon. Homocysteine in ocular diseases. Clin. Chim. Acta 2015, 450, 316–321. [Google Scholar] [CrossRef] [PubMed]
  14. Xu, C.; Wu, Y.; Liu, G.; Liu, X.; Wang, F.; Yu, J. Relationship between homocysteine level and diabetic retinopathy: A systematic review and meta-analysis. Diagn. Pathol. 2014, 9, 167. [Google Scholar] [CrossRef] [PubMed]
  15. Malaguarnera, G.; Gagliano, C.; Giordano, M.; Salomone, S.; Vacante, M.; Bucolo, C.; Caraci, F.; Reibaldi, M.; Drago, F.; Avitabile, T.; et al. Homocysteine serum levels in diabetic patients with non proliferative, proliferative and without retinopathy. Biomed. Res. Int. 2014, 2014, 191497. [Google Scholar] [CrossRef] [PubMed]
  16. Li, J.; Zhang, H.; Yan, L.; Xie, M.; Chen, J. Fracture is additionally attributed to hyperhomocysteinemia in men and premenopausal women with type 2 diabetes. J. Diabetes Investig. 2014, 5, 236–241. [Google Scholar] [CrossRef] [PubMed]
  17. Bulum, T.; Blaslov, K.; Duvnjak, L. Plasma homocysteine is associated with retinopathy in type 1 diabetic patients in the absence of nephropathy. Semin. Ophthalmol. 2016, 31, 198–202. [Google Scholar] [CrossRef]
  18. Aydin, E.; Demir, H.D.; Ozyurt, H.; Etikan, I. Association of plasma homocysteine and macular edema in type 2 diabetes mellitus. Eur. J. Ophthalmol. 2008, 18, 226–232. [Google Scholar] [CrossRef]
  19. Ukinc, K.; Ersoz, H.O.; Karahan, C.; Erem, C.; Eminagaoglu, S.; Hacihasanoglu, A.B.; Yilmaz, M.; Kocak, M. Methyltetrahydrofolate reductase C677T gene mutation and hyperhomocysteinemia as a novel risk factor for diabetic nephropathy. Endocrine 2009, 36, 255–261. [Google Scholar] [CrossRef]
  20. Yang, G.; Lu, J.; Pan, C. The impact of plasma homocysteine level on development of retinopathy in type 2 diabetes mellitus. Chin. J. Intern. Med. 2002, 41, 34–38. (In Chinese) [Google Scholar]
  21. Vaccaro, O.; Perna, A.F.; Mancini, F.P.; Iovine, C.; Cuomo, V.; Sacco, M.; Tufano, A.; Rivellese, A.A.; Ingrosso, D.; Riccardi, G. Plasma homocysteine and microvascular complications in type 1 diabetes. Nutr. Metab. Cardiovasc. Dis. 2000, 10, 297–304. [Google Scholar] [PubMed]
  22. Moore, P.; El-sherbeny, A.; Roon, P.; Schoenlein, P.V.; Ganapathy, V.; Smith, S.B. Apoptotic cell death in the mouse retinal ganglion cell layer is induced in vivo by the excitatory amino acid homocysteine. Exp. Eye Res. 2001, 73, 45–57. [Google Scholar] [CrossRef] [PubMed]
  23. Ganapathy, P.S.; Moister, B.; Roon, P.; Mysona, B.A.; Duplantier, J.; Dun, Y.; Moister, T.K.; Farley, M.J.; Prasad, P.D.; Liu, K.; et al. Endogenous elevation of homocysteine induces retinal neuron death in the cystathionine-beta-synthase mutant mouse. Investig. Ophthalmol. Vis. Sci. 2009, 50, 4460–4470. [Google Scholar] [CrossRef] [PubMed]
  24. Beard, R.S., Jr.; Reynolds, J.J.; Bearden, S.E. Hyperhomocysteinemia increases permeability of the blood-brain barrier by NMDA receptor-dependent regulation of adherens and tight junctions. Blood 2011, 118, 2007–2014. [Google Scholar] [CrossRef]
  25. Cheng, Z.; Yang, X.; Wang, H. Hyperhomocysteinemia and endothelial dysfunction. Curr. Hypertens. Rev. 2009, 5, 158–165. [Google Scholar] [CrossRef]
  26. Tawfik, A.; Al-Shabrawey, M.; Roon, P.; Sonne, S.; Covar, J.A.; Matragoon, S.; Ganapathy, P.S.; Atherton, S.S.; El-Remessy, A.; Ganapathy, V.; et al. Alterations of retinal vasculature in cystathionine-Beta-synthase mutant mice, a model of hyperhomocysteinemia. Investig. Ophthalmol. Vis. Sci. 2013, 54, 939–949. [Google Scholar] [CrossRef] [PubMed]
  27. Tawfik, A.; Markand, S.; Al-Shabrawey, M.; Mayo, J.N.; Reynolds, J.; Bearden, S.E.; Ganapathy, V.; Smith, S.B. Alterations of retinal vasculature in cystathionine-beta-synthase heterozygous mice: A model of mild to moderate hyperhomocysteinemia. Am. J. Pathol. 2014, 184, 2573–2585. [Google Scholar] [CrossRef]
  28. Ibrahim, A.S.; Mander, S.; Hussein, K.A.; Elsherbiny, N.M.; Smith, S.B.; Al-Shabrawey, M.; Tawfik, A. Hyperhomocysteinemia disrupts retinal pigment epithelial structure and function with features of age-related macular degeneration. Oncotarget 2016, 7, 8532–8545. [Google Scholar] [CrossRef] [Green Version]
  29. Tawfik, A.; Smith, S.B. Increased ER stress as a mechanism of retinal neurovasculopathy in mice with severe hyperhomocysteinemia. Austin J. Clin. Ophthalmol. 2014, 1, 1023–1029. [Google Scholar]
  30. Mohamed, R.; Sharma, I.; Ibrahim, A.S.; Saleh, H.; Elsherbiny, N.M.; Fulzele, S.; Elmasry, K.; Smith, S.B.; Al-Shabrawey, M.; Tawfik, A. Hyperhomocysteinemia alters retinal endothelial cells barrier function and angiogenic potential via activation of oxidative stress. Sci. Rep. 2017, 7, 11952. [Google Scholar] [CrossRef]
  31. Elmasry, K.; Mohamed, R.; Sharma, I.; Elsherbiny, N.; Liu, Y.; Al-Shabrawey, M.; Tawfik, A. Epigenetic modifications in hyperhomocysteinemia: Potential role in diabetic retinopathy and age-related macular degeneration. Oncotarget 2018, 9, 12562–12590. [Google Scholar] [CrossRef]
  32. Fulzele, S.; El-Sherbini, A.; Ahmad, S.; Sangani, R.; Matragoon, S.; El-Remessy, A.; Radhakrishnan, R.; Liou, G.I. MicroRNA-146b-3p regulates retinal inflammation by suppressing adenosine deaminase-2 in diabetes. Biomed. Res. Int. 2015, 2015, 846501. [Google Scholar] [CrossRef] [PubMed]
  33. Wotherspoon, F.; Laight, D.W.; Browne, D.L.; Turner, C.; Meeking, D.R.; Allard, S.E.; Munday, L.J.; Shaw, K.M.; Cummings, M.H. Plasma homocysteine, oxidative stress and endothelial function in patients with Type 1 diabetes mellitus and microalbuminuria. Diabet Med. 2006, 23, 1350–1356. [Google Scholar] [CrossRef] [PubMed]
  34. Van Leeuwen-Wintjens, H.R.; Muls, E.E. The implications of hyperhomocysteinemia in a patient with type 1 diabetes. Acta Clin. Belg. 1998, 53, 349–352. [Google Scholar] [CrossRef] [PubMed]
  35. Martinez Laborda, S.; Salazar Garcia-Blanco, M.I.; Rodriguez Rigual, M.; Baldellou Vazquez, A. Total homocysteine levels in children with diabetes type 1 conditional factors. An. Pediatr. (Barc) 2008, 68, 264–268. (In Spanish) [Google Scholar] [PubMed]
  36. Kundi, H.; Kiziltunc, E.; Ates, I.; Cetin, M.; Barca, A.N.; Ozkayar, N.; Ornek, E. Association between plasma homocysteine levels and end-organ damage in newly diagnosed type 2 diabetes mellitus patients. Endocr. Res. 2017, 42, 36–41. [Google Scholar] [CrossRef] [PubMed]
  37. Real, J.T.; Folgado, J.; Molina Mendez, M.; Martinez-Hervas, S.; Peiro, M.; Ascaso, J.F. Plasma homocysteine, Lp(a), and oxidative stress markers in peripheral macroangiopathy in patients with type 2 diabetes mellitus. Clin. Investig. Arterioscler. 2016, 28, 188–194. (In Spanish) [Google Scholar] [PubMed]
  38. Wang, C.; Wu, Q.; Zhang, L.; Hao, Y.; Fan, R.; Peng, X.; Liu, S.; Chen, Z.; Zhang, T.; Chen, S.; et al. Elevated total plasma homocysteine levels are associated with type 2 diabetes in women with hypertension. Asia Pac. J. Clin. Nutr. 2015, 24, 683–691. [Google Scholar]
  39. Dhananjayan, R.; Malati, T.; Rupasree, Y.; Kutala, V.K. Association of aberrations in one carbon metabolism with intimal medial thickening in patients with type 2 diabetes mellitus. Indian J. Clin. Biochem. 2015, 30, 263–270. [Google Scholar] [CrossRef]
  40. Kontoangelos, K.; Papageorgiou, C.C.; Raptis, A.E.; Tsiotra, P.; Lambadiari, V.; Papadimitriou, G.N.; Rabavilas, A.D.; Dimitriadis, G.; Raptis, S.A. Homocysteine, cortisol, diabetes mellitus, and psychopathology. J. Diabetes Res. 2015, 2015, 354923. [Google Scholar] [CrossRef]
  41. Hultberg, B.; Agardh, E.; Andersson, A.; Brattstrom, L.; Isaksson, A.; Israelsson, B.; Agardh, C.D. Increased levels of plasma homocysteine are associated with nephropathy, but not severe retinopathy in type 1 diabetes mellitus. Scand. J. Clin. Lab. Investig. 1991, 51, 277–282. [Google Scholar] [CrossRef] [PubMed]
  42. Arroyo-Jousse, V.; Garcia-Diaz, D.F.; Perez-Bravo, F. Global DNA methylation and homocysteine levels are lower in type 1 diabetes patients. Rev. Med. Chil. 2015, 143, 562–568. (In Spanish) [Google Scholar] [CrossRef] [PubMed]
  43. Lei, X.; Zeng, G.; Zhang, Y.; Li, Q.; Zhang, J.; Bai, Z.; Yang, K. Association between homocysteine level and the risk of diabetic retinopathy: A systematic review and meta-analysis. Diabetol. Metab. Syndr. 2018, 10, 61. [Google Scholar] [CrossRef] [PubMed]
  44. Andersson, A.; Brattstrom, L.; Israelsson, B.; Isaksson, A.; Hamfelt, A.; Hultberg, B. Plasma homocysteine before and after methionine loading with regard to age, gender, and menopausal status. Eur. J. Clin. Investig. 1992, 22, 79–87. [Google Scholar] [CrossRef] [PubMed]
  45. Selhub, J.; Jacques, P.F.; Wilson, P.W.; Rush, D.; Rosenberg, I.H. Vitamin status and intake as primary determinants of homocysteinemia in an elderly population. JAMA 1993, 270, 2693–2698. [Google Scholar] [CrossRef] [PubMed]
  46. Dardiotis, E.; Arseniou, S.; Sokratous, M.; Tsouris, Z.; Siokas, V.; Mentis, A.A.; Michalopoulou, A.; Andravizou, A.; Dastamani, M.; Paterakis, K.; et al. Vitamin B12, folate, and homocysteine levels and multiple sclerosis: A meta-analysis. Mult. Scler. Relat. Disord. 2017, 17, 190–197. [Google Scholar] [CrossRef] [PubMed]
  47. Ao, M.; Tsuji, H.; Shide, K.; Kosaka, Y.; Noda, A.; Inagaki, N.; Nakase, H.; Tanaka, K. High prevalence of vitamin B-12 insufficiency in patients with Crohn‘s disease. Asia Pac. J. Clin. Nutr. 2017, 26, 1076–1081. [Google Scholar] [PubMed]
  48. Ogier de Baulny, H.; Gerard, M.; Saudubray, J.M.; Zittoun, J. Remethylation defects: Guidelines for clinical diagnosis and treatment. Eur. J. Pediatr. 1998, 157 (Suppl 2.), 77–83. [Google Scholar] [CrossRef]
  49. Mudd, S.H.; Skovby, F.; Levy, H.L.; Pettigrew, K.D.; Wilcken, B.; Pyeritz, R.E.; Andria, G.; Boers, G.H.; Bromberg, I.L.; Cerone, R.; et al. The natural history of homocystinuria due to cystathionine beta-synthase deficiency. Am. J. Hum. Genet. 1985, 37, 1–31. [Google Scholar]
  50. Ratnam, S.; Maclean, K.N.; Jacobs, R.L.; Brosnan, M.E.; Kraus, J.P.; Brosnan, J.T. Hormonal regulation of cystathionine beta-synthase expression in liver. J. Biol. Chem. 2002, 277, 42912–42918. [Google Scholar] [CrossRef]
  51. Soedamah-Muthu, S.S.; Chaturvedi, N.; Teerlink, T.; Idzior-Walus, B.; Fuller, J.H.; Stehouwer, C.D.; Eurodiab ProspectivE Complications Study Group. Plasma homocysteine and microvascular and macrovascular complications in type 1 diabetes: A cross-sectional nested case-control study. J. Intern. Med. 2005, 258, 450–459. [Google Scholar] [CrossRef] [PubMed]
  52. Kern, T.S.; Du, Y.; Miller, C.M.; Hatala, D.A.; Levin, L.A. Overexpression of Bcl-2 in vascular endothelium inhibits the microvascular lesions of diabetic retinopathy. Am. J. Pathol. 2010, 176, 2550–2558. [Google Scholar] [CrossRef] [PubMed]
  53. Martin, P.M.; Roon, P.; Van Ells, T.K.; Ganapathy, V.; Smith, S.B. Death of retinal neurons in streptozotocin-induced diabetic mice. Investig. Ophthalmol. Vis. Sci. 2004, 45, 3330–3336. [Google Scholar] [CrossRef] [PubMed]
  54. Diederen, R.M.; La Heij, E.C.; Deutz, N.E.; Kijlstra, A.; Kessels, A.G.; van Eijk, H.M.; Liem, A.T.; Dieudonne, S.; Hendrikse, F. Increased glutamate levels in the vitreous of patients with retinal detachment. Exp. Eye Res. 2006, 83, 45–50. [Google Scholar] [CrossRef] [PubMed]
  55. Yu, X.H.; Zhang, H.; Wang, Y.H.; Liu, L.J.; Teng, Y.; Liu, P. Time-dependent reduction of glutamine synthetase in retina of diabetic rats. Exp. Eye Res. 2009, 89, 967–971. [Google Scholar] [PubMed]
  56. Ola, M.S.; Hosoya, K.; LaNoue, K.F. Regulation of glutamate metabolism by hydrocortisone and branched chain keto acids in cultured rat retinal Muller cells (TR-MUL). Neurochem. Int. 2011, 59, 656–663. [Google Scholar] [CrossRef] [PubMed]
  57. Zhang, Y.; Bhavnani, B.R. Glutamate-induced apoptosis in neuronal cells is mediated via caspase-dependent and independent mechanisms involving calpain and caspase-3 proteases as well as apoptosis inducing factor (AIF) and this process is inhibited by equine estrogens. BMC Neurosci. 2006, 7, 49. [Google Scholar] [CrossRef]
  58. Ganapathy, P.S.; White, R.E.; Ha, Y.; Bozard, B.R.; McNeil, P.L.; Caldwell, R.W.; Kumar, S.; Black, S.M.; Smith, S.B. The role of N-methyl-D-aspartate receptor activation in homocysteine-induced death of retinal ganglion cells. Investig. Ophthalmol. Vis. Sci. 2011, 52, 5515–5524. [Google Scholar] [CrossRef]
  59. Lipton, S.A.; Kim, W.K.; Choi, Y.B.; Kumar, S.; D‘Emilia, D.M.; Rayudu, P.V.; Arnelle, D.R.; Stamler, J.S. Neurotoxicity associated with dual actions of homocysteine at the N-methyl-D-aspartate receptor. Proc. Natl. Acad. Sci. USA 1997, 94, 5923–5928. [Google Scholar] [CrossRef] [Green Version]
  60. Li, Y.; Zhang, H.; Jiang, C.; Xu, M.; Pang, Y.; Feng, J.; Xiang, X.; Kong, W.; Xu, G.; Li, Y.; et al. Hyperhomocysteinemia promotes insulin resistance by inducing endoplasmic reticulum stress in adipose tissue. J. Biol. Chem. 2013, 288, 9583–9592. [Google Scholar] [CrossRef]
  61. Weiss, N. Mechanisms of increased vascular oxidant stress in hyperhomocys-teinemia and its impact on endothelial function. Curr. Drug Metab. 2005, 6, 27–36. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Assessment of Hcy level by enzyme-linked immuno sorbent assay (ELISA). (A) Blood and (B) retina of streptozotocin (STZ)-injected mice showed a significant increase in Hcy level compared to the wild-type (WT) group (* p < 0.05, ** p < 0.01). (C) Blood and (D) retina of genetically obese leptin receptor-deficient mice (db/db) showed a significant increase in Hcy level compared to the WT group (* p < 0.05). (E) Blood and (F) retina of STZ-injected rats showed a significant increase in Hcy level compared to the WT group (* p < 0.05, *** p < 0.001). (G) Blood and (H) vitreous of diabetic patients showed a significant increase in Hcy level compared to the control non-diabetic group (*** p < 0.001, * p < 0.05).
Figure 1. Assessment of Hcy level by enzyme-linked immuno sorbent assay (ELISA). (A) Blood and (B) retina of streptozotocin (STZ)-injected mice showed a significant increase in Hcy level compared to the wild-type (WT) group (* p < 0.05, ** p < 0.01). (C) Blood and (D) retina of genetically obese leptin receptor-deficient mice (db/db) showed a significant increase in Hcy level compared to the WT group (* p < 0.05). (E) Blood and (F) retina of STZ-injected rats showed a significant increase in Hcy level compared to the WT group (* p < 0.05, *** p < 0.001). (G) Blood and (H) vitreous of diabetic patients showed a significant increase in Hcy level compared to the control non-diabetic group (*** p < 0.001, * p < 0.05).
Jcm 08 00121 g001
Figure 2. Immunolocalization of Hcy in diabetic retina. (a) Immunoflourescent staining (top panel) of retinal cryosections from diabetic patients (green fluorescence detects Hcy and 4’6-diamidino-2-phenylindole (DAPI) (blue) detects nuclei). Immunohistochemical detection (bottom panel) of Hcy (brown) in retinal cryosections from diabetic patients (yellow arrows). (b) Immunoflourescent staining of retinal cryosections from wild-type (WT) mice (upper left panel), STZ-injected mice (upper middle panel), db/db mice (upper right panel), Akita mice (lower left panel), WT rats (lower middle panel) and STZ-injected rats (lower right panel). Green fluorescence detects Hcy and DAPI (blue) detects nuclei.
Figure 2. Immunolocalization of Hcy in diabetic retina. (a) Immunoflourescent staining (top panel) of retinal cryosections from diabetic patients (green fluorescence detects Hcy and 4’6-diamidino-2-phenylindole (DAPI) (blue) detects nuclei). Immunohistochemical detection (bottom panel) of Hcy (brown) in retinal cryosections from diabetic patients (yellow arrows). (b) Immunoflourescent staining of retinal cryosections from wild-type (WT) mice (upper left panel), STZ-injected mice (upper middle panel), db/db mice (upper right panel), Akita mice (lower left panel), WT rats (lower middle panel) and STZ-injected rats (lower right panel). Green fluorescence detects Hcy and DAPI (blue) detects nuclei.
Jcm 08 00121 g002
Figure 3. Assessment of cystathionine beta-synthase (CBS) level by ELISA. (A) Serum samples from diabetic patients demonstrated a significant decrease in CBS level compared to the control non-diabetic group (*** p < 0.001). (B) STZ-injected mice, (C) db/db mice and (D) Akita mice demonstrated a significant decrease in blood CBS level compared to corresponding control groups (* p < 0.05).
Figure 3. Assessment of cystathionine beta-synthase (CBS) level by ELISA. (A) Serum samples from diabetic patients demonstrated a significant decrease in CBS level compared to the control non-diabetic group (*** p < 0.001). (B) STZ-injected mice, (C) db/db mice and (D) Akita mice demonstrated a significant decrease in blood CBS level compared to corresponding control groups (* p < 0.05).
Jcm 08 00121 g003
Figure 4. Retinal Fluorescein Angiography (FA) and Optical Coherence Tomography (OCT) assessment of wild-type (WT) mice, Hcy-intravitreal injected mice, STZ-injected mice and Hcy+STZ injected mice (8–10 weeks diabetic). FA demonstrated well-formed vessels in WT mice. FA for Hcy-injected mice showed hyperfluorescence, indicating vascular leakage. Similarly, the FA of STZ-injected mice showed decreased vessel integrity and a disrupted blood–retinal barrier (BRB), indicated by increased fluorescein leakage (pale green haziness). However, the FA of Hcy injected STZ- mice showed focal spots of hyperfluorescence, indicating more significant vascular leakage (A). OCT examination showed a typical normal architecture of retinal layers in WT mice, but a disruption of retinal morphology in Hcy-injected mice (white and yellow arrows). These changes were also observed in the OCT of STZ-injected mice. However, the OCT of Hcy+STZ injected mice demonstrated marked structural alteration with sub-retinal fluid leakage and neovascularization in both the inner retina (white arrows) and outer retina (yellow arrows) (B).
Figure 4. Retinal Fluorescein Angiography (FA) and Optical Coherence Tomography (OCT) assessment of wild-type (WT) mice, Hcy-intravitreal injected mice, STZ-injected mice and Hcy+STZ injected mice (8–10 weeks diabetic). FA demonstrated well-formed vessels in WT mice. FA for Hcy-injected mice showed hyperfluorescence, indicating vascular leakage. Similarly, the FA of STZ-injected mice showed decreased vessel integrity and a disrupted blood–retinal barrier (BRB), indicated by increased fluorescein leakage (pale green haziness). However, the FA of Hcy injected STZ- mice showed focal spots of hyperfluorescence, indicating more significant vascular leakage (A). OCT examination showed a typical normal architecture of retinal layers in WT mice, but a disruption of retinal morphology in Hcy-injected mice (white and yellow arrows). These changes were also observed in the OCT of STZ-injected mice. However, the OCT of Hcy+STZ injected mice demonstrated marked structural alteration with sub-retinal fluid leakage and neovascularization in both the inner retina (white arrows) and outer retina (yellow arrows) (B).
Jcm 08 00121 g004aJcm 08 00121 g004b

Share and Cite

MDPI and ACS Style

Tawfik, A.; Mohamed, R.; Elsherbiny, N.M.; DeAngelis, M.M.; Bartoli, M.; Al-Shabrawey, M. Homocysteine: A Potential Biomarker for Diabetic Retinopathy. J. Clin. Med. 2019, 8, 121. https://doi.org/10.3390/jcm8010121

AMA Style

Tawfik A, Mohamed R, Elsherbiny NM, DeAngelis MM, Bartoli M, Al-Shabrawey M. Homocysteine: A Potential Biomarker for Diabetic Retinopathy. Journal of Clinical Medicine. 2019; 8(1):121. https://doi.org/10.3390/jcm8010121

Chicago/Turabian Style

Tawfik, Amany, Riyaz Mohamed, Nehal M. Elsherbiny, Margaret M. DeAngelis, Manuela Bartoli, and Mohamed Al-Shabrawey. 2019. "Homocysteine: A Potential Biomarker for Diabetic Retinopathy" Journal of Clinical Medicine 8, no. 1: 121. https://doi.org/10.3390/jcm8010121

APA Style

Tawfik, A., Mohamed, R., Elsherbiny, N. M., DeAngelis, M. M., Bartoli, M., & Al-Shabrawey, M. (2019). Homocysteine: A Potential Biomarker for Diabetic Retinopathy. Journal of Clinical Medicine, 8(1), 121. https://doi.org/10.3390/jcm8010121

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop