Next Article in Journal
Effect of Gestational Age at Fetoscopic Laser Photocoagulation on Perinatal Outcomes for Patients with Twin–Twin Transfusion Syndrome
Previous Article in Journal
Role of Phytotherapy in the Management of BPH: A Summary of the Literature
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
JCM
Volume 12
Issue 5
10.3390/jcm12051901
jcm-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Changes in Bone Metabolism in Patients with Rheumatoid Arthritis during Tumor Necrosis Factor Inhibitor Therapy

by
Tanja Janković
1,*,
Momir Mikov
2,
Jelena Zvekić Svorcan
1,
Ivana Minaković
3,
Jelena Mikov
4,
Ksenija Bošković
1 and
Darko Mikić
5
1
Medical Faculty, University of Novi Sad, Special Hospital for Rheumatic Diseases, 21000 Novi Sad, Serbia
2
Department of Pharmacology and Toxicology, Medical Faculty, University of Novi Sad, 21000 Novi Sad, Serbia
3
Medical Faculty, University of Novi Sad, Health Center “Novi Sad”, 21000 Novi Sad, Serbia
4
Medical Faculty, University of Novi Sad, 21000 Novi Sad, Serbia
5
Pathology and Forensic Medicine Institute, Medical Faculty of the Military Medical Academy, University of Defence, 11000 Belgrade, Serbia
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2023, 12(5), 1901; https://doi.org/10.3390/jcm12051901
Submission received: 21 January 2023 / Revised: 19 February 2023 / Accepted: 22 February 2023 / Published: 28 February 2023
(This article belongs to the Section Endocrinology & Metabolism)
Review Reports Versions Notes

Abstract

:
Tumor necrosis factor alpha (TNF-α), which enhances osteoclast activity and bone resorption, is one of the key inflammation mediators in rheumatoid arthritis (RA). The aim of this study was to assess the influence of yearlong TNF-α inhibitor application on bone metabolism. The study sample comprised 50 female patients with RA. Analyses involved the osteodensitometry measurements obtained using a “Lunar” type apparatus and the following biochemical markers from serum: procollagen type 1 N-terminal propeptide (P1NP), beta crosslaps C-terminal telopeptide of collagen type I (b-CTX) by ECLIA method, total and ionized calcium, phosphorus, alkaline phosphatase, parathyroid hormone and vitamin D. Analyses revealed changes in bone mineral density (BMD) at L1–L4 and the femoral neck, with the difference in mean BMD (g/cm2) not exceeding the threshold of statistical significance (p = 0.180; p = 0.502). Upon completion of 12-month therapy, a significant increase (p < 0.001) in P1NP was observed relative to b-CTX, with mean total calcium and phosphorus values following a decreasing trend, while vitamin D levels increased. These results suggest that yearlong application of TNF inhibitors has the capacity to positively impact bone metabolism, as indicated by an increase in bone-forming markers and relatively stable BMD (g/cm2).

1. Introduction

Rheumatoid arthritis (RA) is a systemic, autoimmune, chronic inflammatory disease that affects bone metabolism by increasing bone resorption, leading to osteoporosis and a high risk of fracture [1,2]. The presence of numerous proinflammatory cytokines in RA is associated with the activation of osteoclastogenesis, with tumor necrosis factor alpha (TNF-α) playing a leading role in this process. TNF-α stimulates the expression of the receptor activator of nuclear factor kB ligand (NF-kB), RANKL, which is instrumental in osteoclast differentiation and maturation. It can also exert its influence through the soluble receptor osteoprotegerin (OPG), or via stromal cells of the bone marrow lineage of osteoblasts, as well as by directly activating the cells in osteoclast lineage [3]. The interaction between RANKL and its receptor-activator of nuclear factor kB (RANK) occurs on the surface of osteoclasts by forming a RANKL/RANK bond that leads to accelerated differentiation, maturation, activation and life extension of osteoclasts, which initiates the bone resorption process. The OPG soluble part of the receptor for RANKL, which is structurally homologous to RANK, by binding to RANKL forms a RANKL/OPG bond that inhibits the final phase of osteoclast differentiation as well as activation of matrix osteoclast suppression, while accelerating osteoclast apoptosis. Therefore, balance between RANKL and OPG is the main regulatory factor of the biological balance involving bone formation and resorption [4,5,6]. TNF-α can stimulate osteoclast precursors directly through TNF receptor 1 (TNFR1) signaling, while soluble TNF is responsible for mobilization of osteoclasts from the bone marrow. Binding of TNF-α to receptors activates intracellular cascades that include NF-κB and mitogenic activation of protein kinase, thus transmitting information from the receptor to the nucleus [7]. Osteoblast differentiation and activity are influenced by TNF-α, while NF-kB signaling inhibits the regulation of bone morphogenetic protein (BMP) [8]. As Wnt uses a co-receptor (frizzled receptor and lipoprotein receptor 5 − LPR5) to activate, its transduction pathway is presently considered the most important for the control of osteoblast differentiation. In addition, in interaction with the Wnt signaling pathway, TNF-α plays an important role in the control and differentiation of osteoblasts, as TNF-α stimulates Dkk-1 (Dickkopf-related protein 1) expression of the endogenous Wnt signal inhibitor. During this process, Dkk-1 binds to the LDL-receptor LRP5 or LRP6 of osteoblasts, which inhibits their activity and enhances osteoclastogenesis [9]. By stimulating the production of sclerostin—a hormone produced by osteocytes—TNF reduces preosteoblast differentiation into osteoblasts and thus inhibits bone tissue formation [10,11].
Clinical tracking of the bone remodeling process consists of the determination of biochemical markers of bone resorption and bone formation in serum and urine, allowing bone metabolism, bone resorption rate and fracture risk to be assessed [12,13]. Together with the determination of inorganic matrix markers (i.e., total and ionized calcium, phosphorus and alkaline phosphatase), hormones closely related to bone metabolism—parathyroid hormone (PTH) and vitamin D—are also determined. The International Osteoporosis Foundation (IOF) and International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) recommend tracking of biochemical marker serum procollagen type I N propeptide (P1NP) as an indicator of bone synthesis and Beta-CrossLaps/serum C-terminal cross-linking telopeptide of type I collagen (b-CTX) as an indicator of bone resorption [14,15]. According to the European League Against Rheumatism (EULAR) guidelines, introduction of biological drugs is recommended in patients with highly active RA that have not responded well to the previously applied therapy [16].
The application of biological drugs—various proteins with immunomodulation capability (i.e., direct regulation of immune response)—has initiated a new concept in RA treatment. Some of the most frequently applied biological drugs are so-called TNF inhibitors, as their mechanism of action is based on blocking proinflammatory cytokine TNF-α. Besides their desirable influence on disease activity, these drugs impact local and general loss of bone mineral density (BMD). Presently, different TNF inhibitors are utilized in RA treatment, including etanercept, adalimumab, golimumab, infliksimab and certolizumab pegol [17,18]. However, TNF inhibitor choice should be individualized to each patient. Etanercept is applied as subcutaneous injections, which are administered once a week in 50 mg doses, while both adalimumab (in 40 mg doses) and certolizumab pegol (in 50 mg doses) are administered at biweekly intervals, and golimumab is applied once a month in 50 mg doses. Infliksimab is applied intravenously starting with 3 mg/kg doses [19,20]. These medications can be particularly beneficial for mitigating the high rate of general bone mass loss in RA patients, given the evidence of 2.1–2.7% BMD loss in lumbar spine and 1.7–3.6% in femoral neck in this population [21]. Moreover, in findings yielded by the multi-center study conducted by Chopin et al., as a part of which the impact of 12-month infliksimab therapy on bone metabolism was tracked, this TNF inhibitor had the capacity to increase bone-forming markers and decrease bone resorption markers [22]. Similar results were obtained by Orsolini and colleagues based on treating 68 RA patients with infliksimab [23]. Their findings revealed a significant increase in the bone-forming marker P1NP accompanied by a significant decrease in the bone resorption marker beta-crosslaps.
As extant research mostly focused on the capacity of infliximab and adalimumab to induce changes in bone mineral density and the biochemical markers of bone resorption and synthesis, the aim of the present study was to evaluate the effectiveness of 12-month TNF-α inhibitor (etanercept, adalimumab, golimumab and infliximab) therapy in terms of bone metabolism improvements in patients with rheumatoid arthritis.

2. Materials and Methods

2.1. Study Design and Participants

This research involved 50 female patients in whom the rheumatoid arthritis diagnosis was made on the basis of American College of Rheumatology (ACR)/European League Against Rheumatism (EULAR) criteria published in 2010 [24], and whose clinical status indicated that they would benefit from biological drugs from the TNF inhibitor group. The study was conducted at the Special Hospital for Rheumatic Diseases Novi Sad, Serbia.
It was designed as a 12-month-long retrospective/prospective study that would include all patients treated with a biological drug from the TNF-inhibitor group in the Special Hospital for Rheumatic Diseases in Novi Sad, Serbia. In order to obtain valid results, our sample was as homogeneous as possible in terms of disease type, gender, age, disease length and activity, and treatment method. Our cohort comprised 50 female patients, which was sufficient, as 48 individuals were the minimum required to attain 10% margin of error and 85% confidence level.
The study inclusion criteria (all of which had to be present in an individual to be considered for participation in the study) were: menopause duration <5 years, RA diagnosis within the last 10 years, methotrexate (MTX) therapy (at a stable dose of 10 mg/week at a minimum), no glucocorticoid therapy, anatomical stage II of joint destruction, and Disease Activity Score-28 DAS28 > 5.1.
The study exclusion criteria (presence of any of which would preclude participation in the study) were: menopause duration > 5 years; RA duration > 10 years, anatomical stage III (destruction of bone as well as cartilage, joint deformities) or stage IV (fibrous or bony ankylosis, advanced muscle atrophy, joint deformities) of joint destruction; presence of any disease with adverse repercussions for bone tissue, such as malignant tumors, kidney and liver insufficiency, endocrine diseases (Cushing syndrome, hyperthyroidism, hyperparathyroidism, hypoparathyroidism, hyperprolactinemia, acromegaly); therapy involving drugs that impact bone metabolism (low-molecular-weight heparin, aromatase inhibitors, anticonvulsants, antipsychotics, antidiabetics, L-thyroxin in supraphysiological doses); and prolonged immobility.
All patients that were eligible for participation and were willing to take part in the study signed the informed consent form. Moreover, all participants received vitamin D supplements (800 IU per day) during the study period.
All performed procedures were in conformity with the ethical standards of the institutional research committee and with the Helsinki Declaration and its subsequent amendments or comparative ethical standards. The study was approved by the Ethics Committee of the Special Hospital for Rheumatic Diseases, Novi Sad, Serbia, protocol code 14/35-5/1-016, and by the Ethics Committee of the Medical Faculty, University of Novi Sad, Serbia, protocol code 01-39/148/1.

2.2. Measurements

At entry, all medical documentation was reviewed, rheumatologic examination was conducted, pain threshold was determined, and global RA activity was assessed through visual analogue scale (VAS). The VAS is a subjective measure of symptom severity; it was used in the present study to allow respondents to rate perceived extent of pain on a scale from 0 (indicating absence of pain) to 100 mm (corresponding to almost unbearable pain) [25].
For disease activity assessment, clinical index Disease Activity Score-28 with serum CRP levels (DAS28 CRP) and erythrocyte sedimentation rate (ESR) (DAS28 ESR) were adopted. The Disease Activity Score-28 is a combined index that measures disease activity in patients with rheumatoid arthritis based on both 28 tender joint count (TJC) and swollen joint count (SJC), as well as a laboratory measure of acute inflammation (serum CRP levels or erythrocyte sedimentation rate) and patient global health assessment (PGA) of disease severity on a 0–10 cm scale. The activity score can be calculated according to the following formula: DAS28-CRP = 0.56 * √(TJC28) + 0.28 * √(SJC28) + 0.36 * ln (CRP + 1) + 0.014 * (PGA) + 0.96; DAS28-ESR = 0.56 * √(TJC28) + 0.28 * √(SJC28) + 0.70 * ln (ESR) + 0.014 * (PGA) [26]. The final score of DAS28-CRP or ESR ≤ 2 indicates that the patient is in remission, while scores in the 2.6–3.2 and 3.2–5.1 ranges are indicative of low and moderate disease activity, respectively, and those above >5.1 signify high activity [26].
In addition to the aforementioned evaluations, a health assessment questionnaire (HAQ) was administered to all study participants to assess their degree of incapability. It comprises 20 items classified under eight categories pertaining to activities of daily living: dressing, arising, eating, walking, hygiene, reach, grip, and common daily activities. Each item is rated on a 0–3 scale, where 0 indicates “without difficulty” and 3 indicates “unable to do”, and additional points can be added if aids or devices are needed for performing specific activities. The final score is calculated by summing the scores obtained for each of the categories and dividing this value by the number of categories, resulting in the 0–3 range, where a higher figure indicates poorer quality of life [27].
The body mass index (BMI) is a quantitative ratio of body mass expressed in kilograms (kg) and body height expressed in meters squared (m2), and was used to classify the study participants into six groups: severely underweight (BMI ≤ 16.49 kg/m2), underweight (BMI = 16.50–18.49 kg/m2), normal weight (BMI = 18.50–24.99 kg/m2), overweight (BMI = 25.00–29.99 kg/m2), obese (BMI = 30.00–34.99 kg/m2), and severely obese (BMI ≥ 35.00 kg/m2) [28].
Bone mineral density (BMD) was measured in two regions—front-end lumbar spine (LS) region L1–L4 and the left proximal femoral neck—at the beginning and end of the 12-month TNF inhibitor treatment. BMD measurements were performed by the same technician using the dual energy X-ray absorptiometry (DXA) method on the “Lunar” type apparatus. The coefficient of variation (CV) in the measurements performed at our hospital was 0.8%, as determined daily using the anatomical spine phantom, and no machine drift was detected during the study period. The short-term in vivo precision error for L2–L4 lumbar spine is 0.012 g/cm2 (LSC = 0.034 g/cm2 at the 95% confidence level) and is 0.013 g/cm2 for femur neck (LSC = 0.035 g/cm2 at 95% confidence level). The obtained T-scores were used to classify the participants into three groups: normal (T-score > −1), osteopenia (T-score in the −1 to −2.5 range) and osteoporosis (T-score < −2.5) [29].

2.3. Biochemical Analysis

Blood tests were also performed at the beginning and end of the study, focusing on sedimentation (SE), C-reactive protein (CRP), ionized and total calcium, phosphorus, 25(OH) vitamin D, alkaline phosphatase, parathyroid hormone (PTH), and biochemical bone markers procollagen type I N propeptide (P1NP) and Beta-CrossLaps/serum C-terminal cross-linking telopeptide of type I collagen (b-CTX). Erythrocyte sedimentation rate was determined by the Westergren method, while ionized calcium and phosphorus were measured via the usual spectrophotometric laboratory procedure based on ion exchange using ion exchange electrodes. Alkaline phosphatase was measured by spectrophotometry, and P1NP and b-CTX were determined using ECLIA methods. Blood samples were collected between 7:00 a.m. and 9:00 a.m. after an overnight fast.

2.4. Statistical Analysis

All statistical analyses were performed using Windows SPSS ver. 24 (Statistical Package for the Social Sciences) with p ≤ 0.05 signifying statistical significance. First, the distribution of numerical variables was examined using the Kolmogorov–Smirnov test. As only age was found to be normally distributed, it was presented as mean ± SD (standard deviation), while median (IQR) was calculated in all other cases, and frequencies and percentages were reported for categorical variables. The differences between the parameters measured at two time points were tested by the non-parametric Wilcoxon signed-rank test (Z).

3. Results

3.1. Baseline Clinical Characteristics

The study sample comprised 50 female RA patients aged 51.50 ± 3.94 years, 84% of whom were diagnosed within the preceding 5 years, and 95% and 92% were positive for rheumatoid factor (RF) and anti-cyclic citrulline peptide antibodies (ACPA), respectively. All patients received methotrexate in stabile doses (15–17.5 mg/week) and were treated by TNF inhibitors as the first biological drug, whereby 46%, 34%, 18%, and 2% of the sample received adalimumab, etanercept, golimumab, and infliximab, respectively. Based on their BMI, 62% of the patients were mildly (either slightly or moderately) obese, and the remaining 36% and 2% had optimal weight and were severely obese, respectively (Table 1). TNF inhibitor therapy resulted in a statistically significant improvement in all disease activity parameters compared to the baseline. Specifically, DAS28 SE (Z = −5.71, p ˂ 0.001), SE (mm/h) (Z = −5.97, p ˂ 0.001) and CRP (Z = −5.90, p ˂ 0.001) exhibited statistically significant decreases.

3.2. Effect of TNF Inhibitors on Bone Mineral Density

The obtained findings indicated changes in the measured BMD (g/cm2) values after 12-month TNF inhibitor therapy relative to the baseline, but the difference did not exceed the threshold of statistical significance (Z = 1.34, p = 0.180; Z = 0.67, p = 0.502), as shown in (Table 2).
Prior to initiating the TNF inhibitor therapy, all but one patient had P1NP values in the reference range (16.3–73.9 ng/mL). Upon therapy completion, all patients had P1NP values in the reference range, and the overall improvement in this biomarker (42.30 [IQR = 21.67] vs. 59.30 [IQR = 18.27]) was statistically significant (Z = −6.07, p ˂ 0.001). Although a majority of patients (78%) had the biochemical marker b-CTX in serum values within the reference range (556–1008 ng/mL) before starting the TNF inhibitor therapy, upon its completion, this percentage increased to 94%, (593.00 [IQR = 63.00] vs. 627.50 [IQR = 100.00]), and the overall increase in this parameter was statistically significant (Z = −4.78, p ˂ 0.001). Analyses further revealed that BMI impacted changes in both P1NP and b-CTX values, whereby the greatest increases in P1NP and b-CTX were observed in patients with optimal body mass (Table 3).
A further goal of our analysis was to determine if BMD, P1NP and b-CTX changes related to different TNF inhibitors were statistically significant. Since only 2% of patients received infliximab, its influence on the observed parameters was not assessed. Moreover, changes induced by the remaining three TNF inhibitors in T-score (SD) and BMD (g/cm2) were comparable. Even though the differences were not statically significant, the greatest increase in P1NP was noted in patients treated with golimumab, while those treated with etanercept had the greatest increase in b-CTX (Table 4).

3.3. Changes in Other Parameters of Bone Metabolism after One-Year Use of TNF Inhibitors

The values of other observed bone metabolism parameters also changed following the 12-month TNF inhibitor therapy. Specifically, a decrease in average values was noted for total calcium (from 2.30 [IQR = 0.24] to 2.30 [IQR = 0.20]; Z = −3.07, p = 0.002), ionized calcium (from 1.12 [IQR = 0.09] to 1.10 [IQR = 0.06]; Z = −4.35, p ˂ 0.001), and phosphorus (from 1.00 [IQR = 0.13] to 1.00 [IQR = 0.10]; Z = −2.55, p = 0.011). While 25(OH) vitamin levels increased from 44.00 [IQR = 20.00] mol/L to 51.50 [IQR = 16.25] (Z = −5.06, p ˂ 0.001), no statistically significant changes were noted in the average values of alkaline phosphatase (Z = −1.53, p = 0.124).
Two-way analysis of variance (ANOVA) was also conducted to examine the joint effect of TNF-α inhibitors and vitamin D on the examined bone metabolism parameters. The obtained results did not exceed the threshold of statistical significance (p = 0.037).

4. Discussion

In the extant literature, the presence of numerous proinflammatory cytokines in rheumatoid arthritis (RA) is associated with localized inflammatory bone resorption and generalized bone loss. Available findings further indicate that the receptor activator of nuclear factor kB (RANK)-RANK ligand (RANKL) system is the main driver of inflammatory bone resorption [30]. On the other hand, the use of TNF inhibitors has been shown to affect bone metabolism by increasing the P1NP and osteocalcin (OC) serum level (as bone synthesis markers), and decreasing the levels of serum b-CTX and RANKL (as bone resorption markers in RA), thus slowing down generalized osteoporosis and the development of periarticular erosions [31].
Guided by this evidence, the aim of the present study was to evaluate the impact of 12-month use of TNF inhibitors on changes in bone mineral density and biochemical markers of bone synthesis (P1NP) and resorption (b-CTX). These markers were chosen, as our sample comprised solely women aged 51.50 ± 3.94 years, and it is widely known that estrogen affects bone homeostasis directly (via the effect on bone cells through the RANKL-RANK-OPG pathway), as well as indirectly through an immune mechanism by mitigating the increase in cytokine (such as IL-1, IL-6 and TNF) production caused by estrogen deficiency. In this context, TNF-α (produced by T-lymphocytes in the bone marrow) is particularly significant, as it is the most influential cytokine in bone loss caused by estrogen deficiency. In our cohort, menopause duration did not exceed 5 years, which is relevant as estrogen levels decrease rapidly during menopause, which in turn activates the differentiation and proliferation of osteoclasts while inhibiting the action of osteoblasts and increasing osteocyte apoptosis. All of these effects accelerate bone resorption, as confirmed by extant evidence indicating that the onset of estrogen decline coincides with a phase of rapid bone loss, resulting in 10% and 5% bone mass loss in the spine and hip, respectively, during the 5 five years of menopause. Some estimates further suggest that after 10–15 years of menopause, about 50% of trabecular and 30% of cortical bone is lost [32]. Our findings indicate that 12-month use of TNF inhibitors attenuates the decline in BMD measured at the L1–L4 level as well as in the femoral neck area. Moreover, although the increase in BMD values for the lumbar spine and hip did not exceed the threshold of statistical significance, we observed statistically significant improvements in the corresponding T-score (SD) values. Our findings are in agreement with the results reported by Nutz et al. based on a meta-analysis of 15 studies that included 12-month TNF-inhibitor treatment in patients with RA [33].
Similarly, Zerbini and colleagues analyzed 28 studies in which participants received TNF inhibitors and observed their beneficial effect on preserving or increasing BMD in the lumbar spine and hip, as well as achieving a better biochemical bone marker profile [34]. Findings reported by other authors yielded similar conclusions [35,36,37,38]. It is also worth noting that, by analyzing the effect of TNF inhibitors on bone metabolism in RA patients over a 15-month period, Jura-Poltorak et al. confirmed that they are effective in arresting bone loss. However, in their cohort, the improvements in BMD in the lumbar spine and femoral neck, as well as the corresponding T scores, failed to reach statistical significance. On the other hand, as the authors observed a statistically significant change in the levels of bone synthesis/resorption biochemical markers, it appears that these markers respond more rapidly to TNF inhibitor therapy compared to bone mineral density [39].
In the present study, a higher degree of bone resorption was associated with greater disease activity and b-CTX levels, which correlated with lower BMD values at the onset of TNF inhibitor therapy. Therefore, by monitoring b-CTX levels, we could predict further BMD loss. Our analyses also revealed that TNF inhibitors increased serum P1NP levels and mitigated the b-CTX increase, thus elevating the P1NP/b-CTX ratio. Moreover, TNF inhibitor use was positively correlated with changes in bone biochemical marker levels, which indicated a statistically significant increase in P1NP levels as well as improvements in b-CTX (which did not exceed the threshold of statistical significance). Finally, the observed changes in P1NP and b-CTX upon completion of 12-month TNF inhibitor administration were associated with RA disease activity reduction. Similar findings were reported by Szulc and colleagues based on an investigation involving 54 patients treated with TNF inhibitors for 12 months [40]. However, other authors reported statistically significant improvements in both parameters, while some also noted BMD increases in their cohorts [39].
To position our results in this context, we segregated our sample into younger (below 50 years) and older (50+ years) groups and examined their outcomes. These comparisons revealed that greater improvements in P1NP and b-CTX were associated with younger age (30% and 10.5% for those under 50 vs. 26.8% and 6.6% for women over 50). Likewise, when the cohort was segregated by BMI, we determined that being underweight (BMI < 19), as well as overweight or obese (BMI > 25), was a risk factor for osteoporosis, as it resulted in more pronounced changes in bone metabolism. These observations concur with the available data, indicating that BMD declines more rapidly in obese individuals due to inadequate physical activity, hypertension, and suboptimal vitamin D levels [41]. In addition, adipose tissue secretes cytokines that affect bone tissue by increasing bone resorption, while adipokines affect the central nervous system by altering the influence of the sympathetic nervous system on bone tissue [42]. Therefore, it is not surprising that the greatest changes in P1NP values (38%) and b-CTX (8.4%) were recorded in patients of normal weight.
Hypovitaminosis D is highly prevalent in patients suffering from inflammatory rheumatic diseases, especially RA, and may exacerbate the negative impact of inflammation on BMD. Vitamin D in its active form—25(OH)D—exhibits an immunoregulatory effect that manifests through the regulation of monocytes and macrophages as well as the activity of B and T cells. It is thus believed that vitamin D intake can reduce the production of proinflammatory cytokines such as TNF-α and IL-6, which play a key role in bone resorption in RA patients. Consequently, the potential beneficial role of vitamin D as a modulator of inflammation in RA is increasingly being discussed [43].
In our cohort, 12-month TNF inhibitor therapy resulted in a statistically significant reduction in disease activity (as measured by composite indices DAS28 SE and DAS28 CRP), while increasing average vitamin D, total calcium, ionized calcium, and phosphorus values. These observations are supported by the findings reported by Oelzner et al., indicating that high RA activity is associated with changes in vitamin D metabolism and increased bone resorption [44], which is expected given that lower serum vitamin D levels may contribute to negative calcium balance and inhibition of bone formation. Similar conclusions were reached by Scott et al. and Lin et al. based on their meta-analyses of available studies [45,46]. However, given the paucity of comparative studies focusing on the efficacy of different TNF inhibitors (mostly tocilizumab and abatacept), our findings regarding the changes in BMD and bone synthesis/resorption biochemical markers can only be directly compared with those reported by Sainaghi and colleagues, with which they concur [47]. It is also worth noting that, even though 12-month administration of all tested biological drugs resulted in an increase in P1NP and b-CTX, the highest percentage increase in P1NP was achieved with adalimumab (34%), followed by golimumab (32.6%) and finally etanercept (18.7%). In contrast, b-CTX was most significantly modified by etanercept (9.21%), followed by adalimumab (7.48%) and finally by golimumab (4.94%).
The significance of our study derives from the inclusion of biologically naïve patients who were selected based on clearly defined criteria, excluding individuals taking glucocorticoids and other drugs as well as those suffering from diseases that are known to impact bone remodeling (which would affect any changes in BMD that occurred during the study period). This rigorous research design allowed us to obtain a clearer picture of the effect of TNF inhibitors on BMD. Furthermore, several variables—SE, CRP, PTH, vitamin D 25(OH) level, DAS28 SE and DAS28 CRP, and self-reported quality of life—that could potentially affect bone metabolism were monitored. Based on these analyses, we hypothesize that TNF inhibitors are not only effective in controlling inflammation, but may also directly inhibit osteoclast activity.
Nonetheless, when interpreting our findings, several limitations to our study should be considered, one of which was a small sample size, which was partly due to the strict study inclusion/exclusion criteria, but was also a result of stringent approval protocols implemented for the administration of biological drugs (including TNF inhibitors). Therefore, as a part of our investigation, we were unable to detect minor changes in the observed variables. Moreover, the 12-month follow-up period was potentially insufficient for emergence of meaningful BMD improvements in our patient cohort. A further limitation of the present study stems from the lack of a control group that would have allowed us to better understand the effect of TNF inhibitors on bone marker values, as any changes in the treatment group could be compared with both the baseline and the controls. This shortcoming should be rectified in future studies, allowing the potential beneficial effects of biological drugs, including TNF inhibitors, on inflammatory bone loss to be assessed more precisely.

5. Conclusions

In our cohort comprising 50 female RA patients, 12-month TNF inhibitor therapy had a positive effect on bone metabolism. Increased P1NP and b-CTX values were accompanied by rapid bone remodeling, which was not dependent on the changes in BMD values. Moreover, TNF inhibitor application prevented a decline in BMD (g/cm2), whereby changes in BMD values did not differ among examined biological drugs.

Author Contributions

Conceptualization, T.J. and M.M.; Methodology, T.J., M.M., J.Z.S. and I.M.; Formal analysis, T.J., J.Z.S., I.M. and J.M.; Investigation, T.J., I.M., J.M., K.B. and D.M.; Project administration, J.Z.S., I.M. and J.M.; Supervision, T.J., M.M. and K.B.; Validation, T.J., M.M., J.Z.S. and I.M.; Writing—original draft, T.J.; Writing—review and editing, T.J., M.M. and I.M.; Visualization, I.M., J.M. and D.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

All performed procedures were in conformity with the ethical standards of the institutional research committee and with the Helsinki Declaration and its subsequent amendments or comparative ethical standards. The study was approved by the Ethics Committee of the Special Hospital for Rheumatic Diseases, Novi Sad, Serbia, protocol code 14/35-5/1-016 and by the Ethics Committee of the Medical Faculty, University of Novi Sad, Serbia, protocol code 01-39/148/1.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Chen, T.L.; Chang, K.H.; Su, K.Y. Effects of Biological/Targeted Therapies on Bone Mineral Density in Inflammatory Arthritis. Int. J. Mol. Sci. 2022, 23, 4111. [Google Scholar] [CrossRef]
  2. Moon, S.J.; Ahn, I.E.; Kwok, S.K.; Park, K.S.; Min, J.K.; Park, S.H.; Kim, H.Y.; Ju, J.H. Periarticular Osteoporosis Is a Prominent Feature in Early Rheumatoid Arthritis: Estimation Using Shaft to Periarticular Bone Mineral Density Ratio. J. Korean Med. Sci. 2013, 28, 287–294. [Google Scholar] [CrossRef] [PubMed]
  3. Walsh, N.C.; Crotti, T.N.; Goldring, S.R.; Gravallese, E.M. Rheumatic diseases: The effects of inflammation on bone. Immunol. Rev. 2005, 208, 228–251. [Google Scholar] [CrossRef] [PubMed]
  4. Braun, T.; Schett, G. Pathways for Bone Loss in Inflammatory Disease. Curr. Osteoporos. Rep. 2012, 10, 101–108. [Google Scholar] [CrossRef] [PubMed]
  5. Morris, H.A.; Eastell, R.; Jorgensen, N.R.; Cavalier, E.; Vasikaran, S.; Chubb, S.A.P.; Kanis, J.A.; Cooper, C.; Makris, K. Clinical Usefulness of Bone Turnover Marker Concentrations in Osteoporosis. Clin. Chim. Acta 2017, 467, 34–41. [Google Scholar] [CrossRef]
  6. Tobeiha, M.; Moghadasian, M.H.; Amin, N.; Jafarnejad, S. RANKL/RANK/OPG Pathway: A Mechanism Involved in Exercise-Induced Bone Remodeling. Biomed Res. Int. 2020, 2020, 6910312. [Google Scholar] [CrossRef] [Green Version]
  7. Wysocki, T. Tumor Necrosis Factor in Rheumatoid Arthritis. Encyclopedia. Available online: https://encyclopedia.pub/entry/20537 (accessed on 16 February 2023).
  8. Yi, S.-J.; Lee, H.; Lee, J.; Lee, K.; Kim, J.; Kim, Y.; Park, J.-I.; Kim, K. Bone Remodeling: Histone Modifications as Fate Determinants of Bone Cell Differentiation. Int. J. Mol. Sci. 2019, 20, 3147. [Google Scholar] [CrossRef] [Green Version]
  9. Zhu, M.; Fan, Z. The Role of the Wnt Signalling Pathway in the Energy Metabolism of Bone Remodelling. Cell Prolif. 2022, 55, e13309. [Google Scholar] [CrossRef]
  10. Glass, D.A.; Karsenty, G. In Vivo Analysis of Wnt Signaling in Bone. Endocrinology 2007, 148, 2630–2634. [Google Scholar] [CrossRef] [Green Version]
  11. Zhao, B. TNF and Bone Remodeling. Curr. Osteoporos. Rep. 2017, 15, 126–134. [Google Scholar] [CrossRef]
  12. Choy, E. Understanding the Dynamics: Pathways Involved in the Pathogenesis of Rheumatoid Arthritis. Rheumatology 2012, 51, v3–v11. [Google Scholar] [CrossRef] [Green Version]
  13. Neumann, E.; Schett, G. Bone Metabolism: Molecular Mechanisms. Z. Rheumatol. 2007, 66, 286–289. [Google Scholar] [CrossRef] [PubMed]
  14. Kuo, T.R.; Chen, C.H. Bone Biomarker for the Clinical Assessment of Osteoporosis: Recent Developments and Future Perspectives. Biomark. Res. 2017, 5, 18. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Shetty, S.; Kapoor, N.; Bondu, J.D.; Thomas, N.; Paul, T.V. Bone Turnover Markers: Emerging Tool in the Management of Osteoporosis. Indian J. Endocrinol. Metab. 2016, 20, 846–852. [Google Scholar] [CrossRef] [PubMed]
  16. Smolen, J.; Landewé, R.; Bijlsma, J.; Burmester, G.; Dougados, M.; Kerschbaumer, A.; Mcinnes, I.; Sepriano, A.; Van Vollenhoven, R.; Aletaha, D.; et al. EULAR recommendations for the management of rheumatoid arthritis with synthetic and biological disease-modifying antirheumatic drugs: 2019 update. Ann. Rheum Dis. 2020, 79, 685–699. [Google Scholar] [CrossRef] [Green Version]
  17. Chen, J.F.; Hsu, C.Y.; Yu, S.F.; Ko, C.H.; Chiu, W.C.; Lai, H.M.; Chen, Y.C.; Su, Y.J.; Cheng, T.T. The Impact of Long-Term Biologics/Target Therapy on Bone Mineral Density in Rheumatoid Arthritis: A Propensity Score-Matched Analysis. Rheumatology 2020, 59, 2471–2480. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. LeBoff, M.S.; Greenspan, S.L.; Insogna, K.L.; Lewiecki, E.M.; Saag, K.G.; Singer, A.J.; Siris, E.S. The Clinician’s Guide to Prevention and Treatment of Osteoporosis. Osteoporos. Int. 2022, 3, 2049–2102. [Google Scholar] [CrossRef] [PubMed]
  19. Gerriets, V.; Bansal, P.; Khaddour, K. Tumor Necrosis Factor (TNF) Inhibitors. Available online: https://www.ncbi.nlm.nih.gov/books/NBK482425/ (accessed on 20 May 2022).
  20. Soós, B.; Szentpétery, Á.; Raterman, H.G.; Lems, W.F.; Bhattoa, H.P.; Szekanecz, Z. Effects of Targeted Therapies on Bone in Rheumatic and Musculoskeletal Diseases. Nat. Rev. Rheumatol. 2022, 18, 249–257. [Google Scholar] [CrossRef]
  21. Haugeberg, G.; Uhlig, T.; Falch, J.A.; Halse, J.I.; Kvien, T.K. Bone Mineral Density and Frequency of Osteoporosis in Female Patients with Rheumatoid Arthritis: Results from 394 Patients in the Oslo County Rheumatoid Arthritis Register. Arthritis Rheum. 2000, 43, 522. [Google Scholar] [CrossRef]
  22. Chopin, F.; Garnero, P.; le Henanff, A.; Debiais, F.; Daragon, A.; Roux, C.; Sany, J.; Wendling, D.; Zarnitsky, C.; Ravaud, P.; et al. Long-Term Effects of Infliximab on Bone and Cartilage Turnover Markers in Patients with Rheumatoid Arthritis. Ann. Rheum. Dis. 2008, 67, 353–357. [Google Scholar] [CrossRef]
  23. Orsolini, G.; Adami, G.; Adami, S.; Viapiana, O.; Idolazzi, L.; Gatti, D.; Rossini, M. Short-Term Effects of TNF Inhibitors on Bone Turnover Markers and Bone Mineral Density in Rheumatoid Arthritis. Calcif. Tissue Int. 2016, 98, 580–585. [Google Scholar] [CrossRef] [PubMed]
  24. Aletaha, D.; Neogi, T.; Silman, A.J.; Funovits, J.; Felson, D.T.; Bingham, C.O.; Birnbaum, N.S.; Burmester, G.R.; Bykerk, V.P.; Cohen, M.D.; et al. 2010 Rheumatoid Arthritis Classification Criteria: An American College of Rheumatology/European League against Rheumatism Collaborative Initiative. Arthritis Rheum. 2010, 62, 2569–2581. [Google Scholar] [CrossRef] [PubMed]
  25. Fries, J.F.; Spitz, P.; Kraines, R.G.; Holman, H.R. Measurement of Patient Outcome in Arthritis. Arthritis Rheum. 1980, 23, 137–145. [Google Scholar] [CrossRef] [PubMed]
  26. Greenmyer, J.R.; Stacy, J.M.; Sahmoun, A.E.; Beal, J.R.; Diri, E. DAS28-CRP Cutoffs for High Disease Activity and Remission Are Lower than DAS28-ESR in Rheumatoid Arthritis. ACR Open Rheumatol. 2020, 2, 507–511. [Google Scholar] [CrossRef] [PubMed]
  27. Cosman, F.; de Beur, S.J.; LeBoff, M.S.; Lewiecki, E.M.; Tanner, B.; Randall, S.; Lindsay, R. Clinician’s Guide to Prevention and Treatment of Osteoporosis. Osteoporos. Int. 2014, 25, 2359–2381. [Google Scholar] [CrossRef] [Green Version]
  28. Weir, C.B.; Jan, A. BMI Classification Percentile and Cut Off Points. Available online: https://www.ncbi.nlm.nih.gov/books/NBK541070/ (accessed on 24 September 2022).
  29. Fardellone, P.; Séjourné, A.; Paccou, J.; Goëb, V. Bone Remodelling Markers in Rheumatoid Arthritis. Mediators Inflamm. 2014, 2014, 484280. [Google Scholar] [CrossRef]
  30. Manara, M.; Sinigaglia, L. Bone and TNF in Rheumatoid Arthritis: Clinical Implications. RMD Open 2015, 1, e000065. [Google Scholar] [CrossRef] [Green Version]
  31. Hamar, A.; Szekanecz, Z.; Pusztai, A.; Czókolyová, M.; Végh, E.; Pethő, Z.; Bodnár, N.; Gulyás, K.; Horváth, Á.; Soós, B.; et al. Effects of one-year tofacitinib therapy on bone metabolism in rheumatoid arthritis. Osteoporos. Int. 2021, 32, 1621–1629. [Google Scholar] [CrossRef]
  32. Aeberli, D.; Schett, G. Cortical Remodeling during Menopause, Rheumatoid Arthritis, Glucocorticoid and Bisphosphonate Therapy. Arthritis Res. Ther. 2013, 15, 208. [Google Scholar] [CrossRef] [Green Version]
  33. Nut, A.; Duny, Y.; Barnetche, T.; Morel, J.; Combe, B.; Daien, C. Can tumor necrosis factor inhibitors protect rheumatoid arthritis patients from osteoporosis? Impact of tumor necrosis factor inhibitors on bone mineral density and bone remodeling markers. In Proceedings of the ACR/ARHP Annual Meeting, Boston, MA, USA, 14–19 November 2014; p. 1490. [Google Scholar]
  34. Zerbini, C.A.F.; Clark, P.; Mendez-Sanchez, L.; Pereira, R.M.R.; Messina, O.D.; Uña, C.R.; Adachi, J.D.; Lems, W.F.; Cooper, C.; Lane, N.E. Biologic Therapies and Bone Loss in Rheumatoid Arthritis. Osteoporos. Int. 2016, 28, 429–446. [Google Scholar] [CrossRef]
  35. Sakthiswary, R.; Das, S. The Effects of TNF α Antagonist Therapy on Bone Metabolism in Rheumatoid Arthritis: A Systematic Review. Curr. Drug Targets 2013, 14, 1552–1557. [Google Scholar] [CrossRef] [PubMed]
  36. Klareskog, L.; van der Heijde, D.; de Jager, J.P.; Gough, A.; Kalden, J.; Malaise, M.; Martín Mola, E.; Pavelka, K.; Sany, J.; Settas, L.; et al. TEMPO (Trial of Etanercept and Methotrexate with Radiographic Patient Outcomes) study investigators. Therapeutic Effect of the Combination of Etanercept and Methotrexate Compared with Each Treatment Alone in Patients with Rheumatoid Arthritis: Double-Blind Randomised Controlled Trial. Lancet 2004, 363, 675–681. [Google Scholar] [CrossRef] [PubMed]
  37. Llorente, I.; García-Castañeda, N.; Valero, C.; González-Álvaro, I.; Castañeda, S. Osteoporosis in Rheumatoid Arthritis: Dangerous Liaisons. Front. Med. 2020, 7, 601618. [Google Scholar] [CrossRef] [PubMed]
  38. Vis, M.; Wolbink, G.J.; Lodder, M.C.; Kostense, P.J.; van de Stadt, R.J.; de Koning, M.H.M.T.; Dijkmans, B.A.C.; Lems, W.F. Early Changes in Bone Metabolism in Rheumatoid Arthritis Patients Treated with Infliximab. Arthritis Rheum. 2003, 48, 2996–2997. [Google Scholar] [CrossRef] [PubMed]
  39. Jura-Półtorak, A.; Szeremeta, A.; Olczyk, K.; Zoń-Giebel, A.; Komosińska-Vassev, K. Bone Metabolism and RANKL/OPG Ratio in Rheumatoid Arthritis Women Treated with TNF-α Inhibitors. J. Clin. Med. 2021, 10, 2905. [Google Scholar] [CrossRef] [PubMed]
  40. Szulc, P.; Bauer, D.C.; Eastell, R. Biochemical Markers of Bone Turnover in Osteoporosis. In Primer on the Metabolic Bone Diseases and Disorders of Mineral Metabolism; Academic Press: Cambridge, MA, USA, 2013; pp. 297–306. [Google Scholar] [CrossRef]
  41. Cao, J.J. Effects of Obesity on Bone Metabolism. J. Orthop. Surg. Res. 2011, 6, 30. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Turcotte, A.F.; O’Connor, S.; Morin, S.N.; Gibbs, J.C.; Willie, B.M.; Jean, S.; Gagnon, C. Association between Obesity and Risk of Fracture, Bone Mineral Density and Bone Quality in Adults: A Systematic Review and Meta-Analysis. PLOS ONE 2021, 16, e0252487. [Google Scholar] [CrossRef]
  43. Takahashi, K.; Setoguchi, T.; Tawaratsumida, H.; Arishima, Y.; Tominaga, H.; Ishidou, Y.; Nagano, S.; Shigemizu, S.; Aoki, N.; Akimoto, M.; et al. Risk of Low Bone Mineral Density in Patients with Rheumatoid Arthritis Treated with Biologics. BMC Musculoskelet. Disord. 2015, 16, 269. [Google Scholar] [CrossRef] [Green Version]
  44. Oelzner, P.; Müller, A.; Deschner, F.; Hüller, M.; Abendroth, K.; Hein, G.; Stein, G. Relationship between Disease Activity and Serum Levels of Vitamin D Metabolites and PTH in Rheumatoid Arthritis. Calcif. Tissue Int. 1998, 62, 193–198. [Google Scholar] [CrossRef]
  45. Scott, D.L.; Farr, M.; Hawkins, C.F.; Wilkinson, R.; Bold, A.M. Serum Calcium Levels in Rheumatoid Arthritis. Ann. Rheum. Dis. 1981, 40, 580–583. [Google Scholar] [CrossRef]
  46. Lin, J.; Liu, J.; Davies, M.L.; Chen, W. Serum Vitamin D Level and Rheumatoid Arthritis Disease Activity: Review and Meta-Analysis. PLoS ONE 2016, 11, e0146351. [Google Scholar] [CrossRef] [PubMed]
  47. Sainaghi, P.P.; Gibbin, A. Vitamin D, Inflammation and Osteoporosis in Rheumatoid Arthritis. Open Rheumatol. J. 2018, 12, 300–312. [Google Scholar] [CrossRef]
Table
Table 1. Baseline clinical characteristics of rheumatoid arthritis patients.
Table 1. Baseline clinical characteristics of rheumatoid arthritis patients.
Clinical CharacteristicsRA (n = 50)
Female patients, n (%)50 (100.0%)
Age (years), mean ± SD51.50 ± 3.94
RA duration, n (%)
1–5 years42 (84.0%)
5–10 years8 (16.0%)
Rheumatoid factor, n (%)
Negative13 (26.0%)
Positive37 (74.0%)
ACPA, n (%)
Negative1 (2.0%)
Positive49 (98.0%)
Biological drug, n (%)
Etanercept17 (34.0%)
Adalimumab23 (46.0%)
Golimumab9 (18.0%)
Infliximab1 (2.0%)
BMI (kg/m2) category, n (%)
Normal weight (18.50–24.99)18 (36.0%)
Slightly overweight (25.00–29.99)24 (48.0%)
Obese (30.00–34.99)7 (14.0%)
Severely obese (≥35)1 (2.0%)
n—number of patients; SD—standard deviation; RA—rheumatoid arthritis; ACPA anti-cyclic citrulline peptide antibodies; BMI—body mass index; kg—kilogram, m2—meter squared.
Table
Table 2. Differences between the average values of T-score and BMD after 12-month TNF inhibitor therapy.
Table 2. Differences between the average values of T-score and BMD after 12-month TNF inhibitor therapy.
NMinMaxMeIQRZp
BMD (g/cm2) L1–L4,
first measurement		500.781.190.960.101.340.180
BMD (g/cm2) L1–L4,
second measurement		500.751.200.970.12
BMD (g/cm2) femoral neck, first measurement500.641.090.840.110.670.502
BMD (g/cm2) femoral neck, second measurement500.711.070.840.14
N—number of patients; Min—minimum; Max—maximum; Me—median; IQR—interquartile range; Z—Wilcoxon signed-rank test; p—statistical significance (p ≤ 0.05).
Table
Table 3. BMI and improvements in the P1NP and b-CTX values.
Table 3. BMI and improvements in the P1NP and b-CTX values.
BMI (18.5–24.9)BMI (25+)
MeIQR% ChangeMeIQR% Change
P1NP, first measurement40.2016.83 42.8522.25
P1NP, second measurement59.3012.7847.51%57.7021.8534.65%
b-CTX, first measurement593.5072.50 593.0068.75
b-CTX, second measurement632.5099.856.57%626.00104.505.56%
BMI—body mass index; Me—median; IQR—interquartile range; P1NP—procollagen type 1N-terminal propeptide; b-CTX—beta crosslaps C-terminal telopeptide of collagen type I.
Table
Table 4. Percentage change in P1NP and b-CTX with respect to the prescribed TNF inhibitor.
Table 4. Percentage change in P1NP and b-CTX with respect to the prescribed TNF inhibitor.
Biological Drug Treatment
EtanerceptAdalimumabGolimumab
MeIQR% ChangeMeIQR% ChangeMeIQR% Change
P1NP, 1st measurement44.5025.8034.38%42.3014.3041.37%38.4025.7853.12%
P1NP, 2nd measurement59.8027.05 59.8015.43 58.8020.15
b-CTX 1st measurement620.0070.008.87%589.0071.006.09%583.0043.454.97%
b-CTX 2nd measurement675.0095.65624.90100.00612.0048.75
Me—median; IQR—interquartile range; P1NP—procollagen type 1N-terminal propeptide; b-CTX—beta crosslaps C-terminal telopeptide of collagen type I.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Janković, T.; Mikov, M.; Zvekić Svorcan, J.; Minaković, I.; Mikov, J.; Bošković, K.; Mikić, D. Changes in Bone Metabolism in Patients with Rheumatoid Arthritis during Tumor Necrosis Factor Inhibitor Therapy. J. Clin. Med. 2023, 12, 1901. https://doi.org/10.3390/jcm12051901

AMA Style

Janković T, Mikov M, Zvekić Svorcan J, Minaković I, Mikov J, Bošković K, Mikić D. Changes in Bone Metabolism in Patients with Rheumatoid Arthritis during Tumor Necrosis Factor Inhibitor Therapy. Journal of Clinical Medicine. 2023; 12(5):1901. https://doi.org/10.3390/jcm12051901

Chicago/Turabian Style

Janković, Tanja, Momir Mikov, Jelena Zvekić Svorcan, Ivana Minaković, Jelena Mikov, Ksenija Bošković, and Darko Mikić. 2023. "Changes in Bone Metabolism in Patients with Rheumatoid Arthritis during Tumor Necrosis Factor Inhibitor Therapy" Journal of Clinical Medicine 12, no. 5: 1901. https://doi.org/10.3390/jcm12051901

APA Style

Janković, T., Mikov, M., Zvekić Svorcan, J., Minaković, I., Mikov, J., Bošković, K., & Mikić, D. (2023). Changes in Bone Metabolism in Patients with Rheumatoid Arthritis during Tumor Necrosis Factor Inhibitor Therapy. Journal of Clinical Medicine, 12(5), 1901. https://doi.org/10.3390/jcm12051901

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop