Next Article in Journal
Evaluation of the Performance of an Artificial Intelligence (AI) Algorithm in Detecting Thoracic Pathologies on Chest Radiographs
Previous Article in Journal
Advances in Inflammatory Bowel Disease Diagnostics: Machine Learning and Genomic Profiling Reveal Key Biomarkers for Early Detection
Previous Article in Special Issue
Screening for Asymptomatic Osteonecrosis of the Hip in Systemic Lupus Erythematous: A Systematic Review and Meta-Analysis of MRI-Based Prevalence
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Predicting Rheumatoid Arthritis Development Using Hand Ultrasound and Machine Learning—A Two-Year Follow-Up Cohort Study

1
Department of Radiology, University of California San Diego, San Diego, CA 92093, USA
2
Division of Cardiovascular Diseases, Department of Medicine, Hospital of the University of Pennsylvania, Philadelphia, PA 19104, USA
3
Department of Biomedical Engineering, Tarbiat Modares University, Tehran 14115-111, Iran
4
Department of Radiology, Shiraz University of Medical Sciences, Shiraz 71348, Iran
5
Proteomics Research Center, Shahid Beheshti University of Medical Sciences, Tehran 19839-63113, Iran
6
Division of Rheumatic Disease, Department of Internal Medicine, UT Southwestern Medical Center, Dallas, TX 75390, USA
7
Department of Internal Medicine, Rheumatology Research Center, Shariati Hospital, Tehran University of Medical Sciences, Tehran 14117-13135, Iran
8
Immunology Research Center, Mashhad University of Medical Sciences, Mashhad 91779-48564, Iran
9
Orthopedic Research Center, Mashhad University of Medical Sciences, Mashhad 91779-48564, Iran
10
Division of Musculoskeletal Imaging, Department of Radiology, UT Southwestern Medical Center, Dallas, TX 75390, USA
*
Authors to whom correspondence should be addressed.
Diagnostics 2024, 14(11), 1181; https://doi.org/10.3390/diagnostics14111181
Submission received: 8 May 2024 / Revised: 25 May 2024 / Accepted: 1 June 2024 / Published: 4 June 2024
(This article belongs to the Special Issue Musculoskeletal Imaging 2023)

Abstract

:
Background: The early diagnosis and treatment of rheumatoid arthritis (RA) are essential to prevent joint damage and enhance patient outcomes. Diagnosing RA in its early stages is challenging due to the nonspecific and variable clinical signs and symptoms. Our study aimed to identify the most predictive features of hand ultrasound (US) for RA development and assess the performance of machine learning models in diagnosing preclinical RA. Methods: We conducted a prospective cohort study with 326 adults who had experienced hand joint pain for less than 12 months and no clinical arthritis. We assessed the participants clinically and via hand US at baseline and followed them for 24 months. Clinical progression to RA was defined according to the ACR/EULAR criteria. Regression modeling and machine learning approaches were used to analyze the predictive US features. Results: Of the 326 participants (45.10 ± 11.37 years/83% female), 123 (37.7%) developed clinical RA during follow-up. At baseline, 84.6% of the progressors had US synovitis, whereas 16.3% of the non-progressors did (p < 0.0001). Only 5.7% of the progressors had positive PD. Multivariate analysis revealed that the radiocarpal synovial thickness (OR = 39.8), PIP/MCP synovitis (OR = 68 and 39), and wrist effusion (OR = 12.56) on US significantly increased the odds of developing RA. ML confirmed these US features, along with the RF and anti-CCP levels, as the most important predictors of RA. Conclusions: Hand US can identify preclinical synovitis and determine the RA risk. The radiocarpal synovial thickness, PIP/MCP synovitis, wrist effusion, and RF and anti-CCP levels are associated with RA development.

1. Introduction

Rheumatoid arthritis (RA) is a chronic inflammatory condition characterized by joint inflammation and progressive joint damage, primarily affecting the hands and feet [1,2]. The timely diagnosis and effective management of RA are critical to prevent irreversible joint destruction and functional impairment [3,4,5,6]. However, early detection poses a challenge due to the often subtle and nonspecific initial symptoms [7,8]. There is a pressing need for accurate diagnostic methods capable of identifying RA in its early stages, particularly among individuals with undifferentiated arthritis [9,10,11,12].
Imaging modalities such as ultrasound (US) [13,14] and magnetic resonance imaging (MRI) have emerged as valuable tools for the detection of early inflammatory changes in the body, even before the onset of clinical synovitis [15,16]. Imaging modalities such as US and MRI [17] have emerged as valuable tools for detecting early inflammatory changes before the onset of clinical synovitis [18,19,20]. High-frequency ultrasound has shown promise as a cost-effective, non-invasive, and widely available method for the detection of mild synovitis and in predicting the progression to clinical arthritis [9,19,21]. However, previous research on the effectiveness of US in early disease detection has been limited by small sample sizes and variability [17,22,23,24].
This study aimed to evaluate the prognostic utility of hand ultrasound (US) in the early diagnosis of RA among 326 individuals presenting with nontraumatic hand joint pain who initially did not meet the established criteria for RA. Leveraging supervised machine learning techniques, we analyzed the US findings alongside other clinical and serological data to identify predictive features for RA development over an extended observation period. The insights garnered from this research have the potential to inform the development of diagnostic and prognostic models integrating ultrasound assessment for risk stratification in individuals with undifferentiated arthritis. The early identification of high-risk individuals enables the targeted implementation of disease-modifying treatments, thereby optimizing patient outcomes.

2. Materials and Methods

2.1. Study Design

We carried out a single-center, prospective cohort study at the rheumatology clinic of Dr. Shariati Hospital in Tehran, Iran, from 2018 to 2021, to assess the diagnostic effectiveness of hand ultrasonography in the early detection of RA among patients with nontraumatic hand joint pain. The primary goal was to evaluate how well ultrasound imaging could identify patients who would develop clinically evident RA within a two-year follow-up period. A power analysis, assuming a 20% difference in RA incidence between the exposed and unexposed groups, with a significance level of 0.05 and 80% power, guided our target enrollment of 300 patients.

2.2. Participants and Clinical Assessment

Eligible participants were individuals aged 18 years or older, presenting to the clinic with nontraumatic hand joint pain with a duration of less than 12 months and no prior diagnosis of rheumatic disease [25]. Exclusion criteria included symptoms attributable solely to degenerative joint disease, a definite RA diagnosis at initial presentation, previous arthritis, treatment with disease-modifying antirheumatic drugs (DMARDs) or glucocorticoids, systemic infections or autoimmune diseases, lymphoproliferative disorders, a history of cancer or recent radiotherapy, and refusal to participate or attend follow-up visits.
Participants provided written informed consent; completed a baseline questionnaire detailing their symptoms and family and medical history; and underwent clinical examinations and laboratory tests. Tests included the erythrocyte sedimentation rate (ESR), C-reactive protein (CRP), IgM-RF, and anti-cyclic citrullinated peptide (anti-CCP) antibodies, using standardized equipment (HITACHI 912 autoanalyzer; Stat Fax 4200 ELISA Microplate Reader, Tokyo, Japan), as per the manufacturer guidelines.
The primary outcome measure, the development of rheumatoid arthritis (RA) within a 24-month period, was determined using the 2010 American College of Rheumatology/European League Against Rheumatism (ACR/EULAR) classification criteria. The evaluation of RA development was performed by a rheumatologist who was blinded to the patients’ ultrasonography results [25]. Detailed information about diagnostic criteria and abbreviations can be found in the Supplementary File S1.

2.3. Ultrasonography Examination

All patients underwent hand ultrasonography within one week of clinical assessment, performed by a radiologist with over four years of experience in musculoskeletal ultrasonography, who was unaware of the patients’ clinical and laboratory data. Using a MyLabX8 Platform (Esaote, Genoa, Italy) with a multifrequency (LA523, 2–9 MHz) linear array probe, the radiologist scanned various hand joints, including the bilateral proximal interphalangeal (PIP), metacarpophalangeal (MCP), and distal interphalangeal (DIP) joints; the interphalangeal joint (IP) of the thumb; the first carpometacarpal (CMC) joint; and the wrist joints. Each scan lasted about 20 min, following a standardized OMERACT protocol, involving a midline 12 o’clock longitudinal scan perpendicular to the joint surface [5,26].
The radiologist utilized both grayscale (GS) and power Doppler (PD) imaging to evaluate synovitis, effusion, erosion, and cartilage damage, applying a semiquantitative scoring system (0–3) [25,26]. Synovitis was identified by a GS grade above 1 or any PD activity. The radiologist recorded the GS and PD scores, along with each patient’s exposure status, in a digital database. The PD settings were optimized for sensitivity and artifact reduction, with adjustments made to the pulse repetition frequency and the positioning of the color box to accurately capture blood flow signals.
The ultrasonography equipment was regularly calibrated to ensure accuracy, and patient images were stored on a local PACS server. After data collection, all images were reviewed collectively to discuss the findings (Figure 1, Figure 2, Figure 3 and Figure 4).

2.4. Follow-Up

We monitored the patients for two years after the initial assessment. We conducted phone interviews with patients who did not wish to visit the clinic for their 6-, 12-, and 18-month evaluations. We inquired about their symptoms, treatments, and outcomes and advised them to visit the outpatient clinic for further examination by a rheumatologist if they showed signs of clinical synovitis. At the 24-month visit, we determined if the patients had rheumatoid arthritis or non-inflammatory pain based on the rheumatologist’s decision using the 2010 ACR/EULAR criteria (score of more than 6/10) [25].

2.5. Data Preprocessing and Model Development

The GS and PD scores for each assessed joint were used directly as input features for the machine learning models, without additional preprocessing. We employed several supervised learning algorithms, including decision trees, support vector machines (linear, quadratic, and Gaussian kernel), k-nearest neighbors, AdaBoost, neural networks, and random forests, to identify ultrasound characteristics predictive of preclinical RA.
The selection of the final model was guided by the documented performance in medical image classification tasks. After careful consideration, the random forest (RF) algorithm, an ensemble method that amalgamates multiple decision trees to enhance the prediction accuracy and mitigate overfitting, was deemed most suitable [27,28,29,30].
The hyperparameters, including the number of trees (set to 80), were fine-tuned using a grid search approach to optimize the model performance. The performance of the RF model was assessed using k-fold cross-validation (k = 5) and a comprehensive set of metrics, including sensitivity, specificity, precision, the F1-score, and the Matthews correlation coefficient (MCC). This approach ensured robust evaluation, particularly considering the class imbalance present in the dataset [31].

2.6. Statistical Analysis

Statistical analysis was performed using SPSS version 22. Quantitative data were presented as means and standard deviations, while qualitative data were expressed as frequencies and percentages. We assessed group differences using independent-samples t-tests for continuous data and chi-square or Fisher’s exact tests for categorical data. Our dataset contained minimal missing values, less than 5% across all variables, which were handled through pairwise deletion. The hypothesis tests conducted were exploratory, aimed at generating rather than confirming hypotheses; therefore, no adjustments for multiple comparisons were made. Logistic regression analyses were used to investigate potential predictors of RA development, with results presented as odds ratios and 95% confidence intervals. The agreement between the initial physician assessments and final diagnoses was measured using Cohen’s kappa coefficient. The diagnostic accuracy of ultrasonography was evaluated through the sensitivity, specificity, and positive and negative predictive value, each reported with 95% confidence intervals. We assumed no unmeasured confounding for the validity of our results, addressing potential confounders via regression-based covariate adjustment. Statistical significance was determined at a p-value of less than 0.05.

3. Results

3.1. Study Cohort and RA Development

Of the 503 patients screened for eligibility, 326 (65% of those screened) were included in the final analysis, with a follow-up period of 24 months. The cohort predominantly comprised females (83%), with an average age of 45.10 ± 11.37 years. During the follow-up, 123 patients (37.7% of the cohort) were diagnosed with clinical RA according to the 2010 ACR-EULAR criteria.

3.2. Baseline Characteristics

The demographic and laboratory characteristics at baseline are detailed in Table 1. The patients who developed RA (RA group) were significantly older on average (47.10 years, 95% CI: 45.32–48.88) compared to those who did not develop RA (non-RA group) (43.90 years, 95% CI: 42.49–45.31; p = 0.019). Significant differences were also observed in the baseline laboratory markers between the groups, with the RA group showing higher mean values of the white blood cell count (WBC; p = 0.012), erythrocyte sedimentation rate (ESR; p = 0.003), rheumatoid factor (RF; p < 0.0001), and anti-citrullinated protein antibodies (anti-CCP; p < 0.0001).

3.3. Baseline US Findings

Ultrasonography at baseline revealed the significantly higher prevalence of synovitis in any hand joint in the RA group compared to the non-RA group (84.6% vs. 16.3%; p < 0.0001). The RA group also exhibited the higher prevalence of positive PD signals (5.7% vs. 0.5%; p = 0.003). There were no significant differences between the groups in terms of carpal bone erosion, wrist ganglion cysts, bone hypertrophy, and IP joint erosion.

3.4. Predictors of RA Development

Both univariate and multivariate logistic regression analyses were conducted to identify predictors of RA development within 24 months. The univariate analysis identified several significant predictors, including age, WBC, ESR, RF, anti-CCP, and various ultrasonography findings. The multivariate analysis, incorporating variables with a p-value < 0.05, identified the strongest independent predictors of RA development: WBC (OR = 1.23, 95% CI = 1.02–1.50, p = 0.035), RF (OR = 1.08, 95% CI = 1.04–1.12, p ≤ 0.0001), anti-CCP (OR = 1.04, 95% CI = 1.02–1.07, p = 0.002), and certain ultrasonography findings, including radiocarpal synovial thickening, PIP and MCP synovitis, and wrist effusion (Table 2).

3.5. Machine Learning Model Performance

Applying various machine learning models to predict RA based on the baseline variables highlighted the random forest model, which comprised 80 trees, as the most effective, demonstrating an F1-score of 82.1. This model also showed high precision (82.11%) and sensitivity (82.09%). The performance overview of the different models is detailed in Table 3, with the ROC and precision–recall curves for the random forest model depicted in Figure 5.

3.6. Feature Importance in Prediction Models

The results of this analysis indicated that radiocarpal synovial thickening, MCP synovitis, PIP synovitis, RF, and anti-CCP were the most influential features, with relative importance scores of 0.23, 0.18, 0.16, 0.13, and 0.11, respectively. For a visual representation of these feature importance scores, please refer to Figure 6.

3.7. Impact of Ultrasonographic Features on Model Performance

Incorporating US features significantly enhanced the performance metrics across all models, particularly for the random forest model, which saw its F1-score increase from 77.8 to 82.1, precision from 77.7 to 82.11, and sensitivity from 77.9 to 82.09. Detailed improvements are documented in Table 3, Table 4 and Table 5.

4. Discussion

This study aimed to evaluate the prognostic value of hand US in the early detection of RA in patients with nontraumatic hand joint pain. We identified specific US features, including radiocarpal synovial thickening, PIP and MCP synovitis, and wrist effusion, as strong predictors of RA development when combined with elevated RF and anti-CCP titers.
At the conclusion of the follow-up, 37.7% of the patients had developed clinical arthritis, with 84.6% showing ultrasound synovitis at baseline, indicated by a grade of synovial hypertrophy in GS greater than 1 or the presence of PD abnormalities. Of these, 48.8% had synovitis in only one joint, while 35.9% had it in two or more joints. Clinically, patients who progressed to RA were more likely to exhibit elevated WBC counts, ESR levels, and RF and-CCP titers. US synovitis strongly correlated with the development of clinical RA at the patient level. However, positive PD abnormalities were rare (2.5%) and did not predict future clinical RA. These results align with previous research indicating that US synovitis is a significant marker in pre-RA patients and can predict the onset of clinical arthritis in those at risk [4,5,11,32,33]. However, the prevalence and predictors of RA development may vary depending on the US method, scanning protocol, population characteristics, assessment of effusion and erosion, or examination of other modes, such as PD or GS.
In a cohort study by Nam et al., patients experiencing arthralgia, irrespective of their antibody status, were followed for one year. Baseline ultrasound synovitis was defined as GS ≥ 2 and/or PD ≥ 1. By the end of the study, 16% of participants developed arthritis, 59% of whom had positive US findings at the start. The wrists (26%) and MTP joints (11%) were most frequently affected. Independent predictors of inflammatory arthritis development included age, US synovitis, a positive PD signal, and morning stiffness. Interestingly, US effectively ruled out IA in patients without US synovitis [5]. Van Beers-Tas et al. observed that among 163 seropositive individuals, 31% developed clinical arthritis after a median of 12 months, with 86% meeting the 2010 ACR/EULAR criteria for RA. Their analysis suggested that, excluding the MTP joints, the US synovial thickness correlated with both the occurrence and timing of clinical arthritis at the patient level. Positive PD indicators, as in our findings, were infrequent among those at risk and were not predictive [11]. Naredo et al. conducted a prospective study on anti-CCP+ patients without clinical arthritis, assessing GS, PD, and erosions across 32 joints, including the wrists, MCPs, PIPs, and MTPs. Eighty-six percent of those who developed clinical arthritis had at least one US abnormality at baseline, compared to 67% of non-progressors. All US findings predicted IA progression, with the highest risk associated with PD abnormalities [34]. Van Steenbergen et al. studied 192 arthralgia patients with positive autoantibody titers, finding that 23% progressed to RA after an average of 11 months. Their study indicated a trend towards US abnormalities in ≥1 joints at baseline being predictive of arthritis development. However, contrary to our findings, they demonstrated that US predicted clinical synovitis at the joint level rather than the patient level [33].
The collective evidence presented in this study suggests that the utilization of US in the assessment and stratification of the RA risk appears to be of substantial value during the preclinical stages of the disease, surpassing the sole reliance on clinical examination and autoantibody status. However, it is crucial to acknowledge that the observed inconsistencies among the findings may be attributed to the variability in the scanning protocol employed, which includes the application of US examinations solely to symptomatic joints or to all joints, encompassing the MTP joints and larger joints. Additionally, another potential explanation for the discrepancies observed in the results could be the existence of technical disparities between US machines, as these variations have a notable impact on the detection of PD signals [11].
Previous research indicates that clinicians’ requirements for US scanning vary by indication, with a higher number of joints assessed for diagnostic purposes to detect inflammation and initiate treatment promptly in cases of widespread pain. For ongoing synovial activity, the choice of joints to scan often depends on the presence of pain or the tendency of certain joints to be more frequently affected. Studies also reveal that rheumatologists in university settings typically perform US on fewer than 10 joints, constrained by the available time [35]. Although simplified US joint count scoring systems have been evaluated for early RA and found feasible in assessing joint inflammation, selecting the optimal subset of asymptomatic joints for clinical use remains challenging. Employing a multiple-joint scoring system is more time-consuming, but focusing on the joints commonly affected by RA could save time and possibly enhance the sensitivity [33]. To refine joint selection in US protocols, we analyzed all hand joints using US and employed regression models and machine learning techniques to identify the most significant US predictors of RA progression [11].
The results from a multivariate regression model and machine learning analysis indicate that specific US findings significantly influence the likelihood of RA progression in the U.S. population. Notably, radiocarpal synovial thickening, PIP and MCP synovitis, and wrist effusion at baseline, as identified by grayscale US, are strong independent predictors of RA in at-risk patients. These US variables, coupled with high RF and anti-CCP titers in patients presenting with arthralgia but not fulfilling the RA clinical criteria, are highly valuable for risk stratification in clinical settings. Additionally, the study underscores the potential of AI, particularly the random forest algorithm, in enhancing CAD systems, showing superior performance over other models.
Based on the findings, a simplified US protocol targeting the key joints and scores may enhance the efficiency and feasibility of screening and diagnosing pre-rheumatoid arthritis (pre-RA) patients. Additionally, incorporating machine learning models could improve the accuracy and objectivity in predicting RA development by using ultrasound data along with other clinical and laboratory variables. However, further research is needed to validate and optimize these US protocols and machine learning models across different settings and populations.
Another noteworthy observation is that wrist joint synovial thickening and synovitis in the PIP and DIP joints can manifest in the early stages of OA, as evidenced by prior studies [36]. Recent imaging techniques have revealed that synovial inflammation is common in both the early and late phases of OA [36], particularly affecting the DIP, PIP, and the base of the thumb [37]. In our study, the presence of US-positive findings in these joints at baseline, without the subsequent development of RA during follow-up, may have represented early manifestations of OA. However, additional research with longer follow-up is necessary to confirm this.
This suggests that US may not always be specific enough to distinguish between RA and OA, particularly when clinical and laboratory indicators are unclear. Thus, the careful interpretation of US results is essential to avoid diagnostic errors.

Study Strengths and Limitations

This study exhibits several notable strengths. Firstly, its prospective design, coupled with a substantial sample size and an extended 24-month follow-up period, lends credibility to the findings. Additionally, the implementation of a standardized US scanning protocol enhanced the reliability and reproducibility of the data collection process. Furthermore, the innovative application of machine learning techniques facilitated the identification of the most predictive US features, underscoring the study’s methodological rigor.
However, it is essential to acknowledge certain limitations. As a single-center study, the generalizability of the findings may be restricted, necessitating further validation across diverse healthcare settings and populations. Despite concerted efforts to adjust for key variables, the potential for residual confounding cannot be entirely ruled out. Moreover, while the US protocol employed in this study was comprehensive, there may be alternative joint areas or scoring systems that could yield additional predictive value, warranting further exploration.
Consequently, future research endeavors spanning multiple centers, diverse populations, and the exploration of alternative US protocols or scoring systems are recommended. Such initiatives would not only validate the present findings but also refine and enhance the predictive capabilities of the proposed approach. By addressing these limitations, the study’s impact could be amplified, contributing to the development of more robust and generalizable predictive models for the early detection of rheumatoid arthritis.

5. Conclusions

This prospective cohort study exhibits the significance of targeted hand ultrasonography in the identification of individuals with a strong likelihood of advancing to rheumatoid arthritis. Key ultrasonographic characteristics, such as thickening of the radiocarpal synovium and synovitis in the PIP and MCP joints, as well as the presence of fluid in the wrist, were found to be strong and independent predictors of the onset of clinical rheumatoid arthritis within a 2-year period of follow-up among patients displaying undifferentiated arthritis. Moreover, the machine learning analysis highlighted these ultrasound predictors, in addition to increased levels of RF and anti-CCP antibodies, as the most influential differentiating factors when compared to other variables.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/diagnostics14111181/s1, Supplementary File S1.

Author Contributions

Conceptualization, M.A., M.D.; Methodology, M.D., E.B.-G., S.G.; Software, E.B.-G.; Validation, A.V., S.E., F.E.; Formal Analysis, E.B.-G.; Investigation, M.D., M.A., N.A.; Resources, M.G., P.P.; Data Curation, E.R., M.A.; Writing—Original Draft Preparation, M.D., A.V.; Writing—Review and Editing, M.A., F.E., S.E.; Visualization, E.B.-G.; Supervision, M.A.; Project Administration, M.A.; Funding Acquisition, N.A. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study protocol was approved by the ethics committee of Tehran University of Medical Sciences (Ethical Code: IR.TUMS.SHARIATI.REC.1401.034).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The datasets generated and analyzed during the current study are available from the corresponding author on reasonable request.

Acknowledgments

We thank the staff at the Rheumatology Clinic of Shariati Hospital for their assistance in patient recruitment and data collection.

Conflicts of Interest

The authors declare no conflicts of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

Declaration of Generative AI in Scientific Writing

The authors used “Grammarly” to check the grammar and “Winston AI” to check the originality and clarity of this work. They also revised and edited the content as needed and take full responsibility for the publication.

References

  1. Murali, S.; Ding, H.; Adedeji, F.; Qin, C.; Obungoloch, J.; Asllani, I.; Anazodo, U.; Ntusi, N.A.B.; Mammen, R.; Niendorf, T.; et al. Bringing MRI to low- and middle-income countries: Directions, challenges and potential solutions. NMR Biomed. 2023, e4992. [Google Scholar] [CrossRef] [PubMed]
  2. Che, Q.-C.; Jia, Q.; Zhang, X.-Y.; Sun, S.-N.; Zhang, X.-J.; Shu, Q. A prospective study of the association between serum klotho and mortality among adults with rheumatoid arthritis in the USA. Arthritis Res. Ther. 2023, 25, 149. [Google Scholar] [CrossRef] [PubMed]
  3. Eberhard, A.; Rydell, E.; Forslind, K.; Bergman, S.; Mandl, T.; Olofsson, T.; Jacobsson, L.T.; Turesson, C. Radiographic damage in early rheumatoid arthritis is associated with increased disability but not with pain—A 5-year follow-up study. Arthritis Res. Ther. 2023, 25, 29. [Google Scholar] [CrossRef] [PubMed]
  4. Lage-Hansen, P.R.; Lindegaard, H.; Chrysidis, S.; Terslev, L. The role of ultrasound in diagnosing rheumatoid arthritis, what do we know? An updated review. Rheumatol. Int. 2017, 37, 179–187. [Google Scholar] [CrossRef] [PubMed]
  5. Van der Ven, M.; van der Veer-Meerkerk, M.; Ten Cate, D.F.; Rasappu, N.; Kok, M.R.; Csakvari, D.; Hazes, J.M.W.; Gerards, A.H.; Luime, J.J. Absence of ultrasound inflammation in patients presenting with arthralgia rules out the development of arthritis. Arthritis Res. Ther. 2017, 19, 202. [Google Scholar] [CrossRef] [PubMed]
  6. Mankia, K.; Siddle, H.; Di Matteo, A.; Alpízar-Rodríguez, D.; Kerry, J.; Kerschbaumer, A.; Aletaha, D.; Emery, P. A core set of risk factors in individuals at risk of rheumatoid arthritis: A systematic literature review informing the EULAR points to consider for conducting clinical trials and observational studies in individuals at risk of rheumatoid arthritis. RMD Open 2021, 7, e001768. [Google Scholar] [CrossRef]
  7. Mehta, B.; Goodman, S.; DiCarlo, E.; Jannat-Khah, D.; Gibbons, J.A.B.; Otero, M.; Donlin, L.; Pannellini, T.; Robinson, W.H.; Sculco, P.; et al. Machine learning identification of thresholds to discriminate osteoarthritis and rheumatoid arthritis synovial inflammation. Arthritis Res. Ther. 2023, 25, 31. [Google Scholar] [CrossRef] [PubMed]
  8. Siddle, H.J.; Bradley, S.H.; Anderson, A.M.; Mankia, K.; Emery, P.; Richards, S.H. Opportunities and challenges in early diagnosis of rheumatoid arthritis in general practice. Br. J. Gen. Pract. 2023, 73, 152–154. [Google Scholar] [CrossRef] [PubMed]
  9. Bessette, L.; Haraoui, B.; Rampakakis, E.; Dembowy, J.; Trepanier, M.O.; Pope, J. Effectiveness of a treat-to-target strategy in patients with moderate to severely active rheumatoid arthritis treated with abatacept. Arthritis Res. Ther. 2023, 25, 183. [Google Scholar] [CrossRef] [PubMed]
  10. Zabotti, A.; Finzel, S.; Baraliakos, X.; Aouad, K.; Ziade, N.; Iagnocco, A. Imaging in the preclinical phases of rheumatoid arthritis. Clin. Exp. Rheumatol. 2020, 38, 536–542. [Google Scholar] [PubMed]
  11. Van Beers-Tas, M.H.; Blanken, A.B.; Nielen, M.M.J.; Turkstra, F.; van der Laken, C.J.; Meursinge Reynders, M.; van Schaardenburg, D. The value of joint ultrasonography in predicting arthritis in seropositive patients with arthralgia: A prospective cohort study. Arthritis Res. Ther. 2018, 20, 279. [Google Scholar] [CrossRef] [PubMed]
  12. Salaffi, F.; Ciapetti, A.; Gasparini, S.; Carotti, M.; Filippucci, E.; Grassi, W. A clinical prediction rule combining routine assessment and power Doppler ultrasonography for predicting progressionto rheumatoid arthritis from early-onset undifferentiated arthritis. Clin. Exp. Rheumatol. 2010, 28, 686–694. [Google Scholar] [PubMed]
  13. Hanova, P.; Prajzlerová, K.; Petrovská, N.; Gregová, M.; Mann, H.; Pavelka, K.; Vencovský, J.; Šenolt, L.; Filková, M. POS0911 ultrasound-detected synovitis among individuals at risk of rheumatoid arthritis increases the risk of developing clinical arthritis in the future. Ann. Rheum. Dis. 2023, 82, 764. [Google Scholar]
  14. Bejerano, A.R.; Bote, A.C.; Palomo, J.A.; Cáceres, B.B. POS0932 ultrasound-defined grade i synovitis in patients with inflammatory-suspected arthralgia and its role in diagnosis a year later. Ann. Rheum. Dis. 2023, 82, 777–778. [Google Scholar]
  15. Van der Helm-van Mil, A.; Landewé, R.B. The earlier, the better or the worse? Towards accurate management of patients with arthralgia at risk for RA. Ann. Rheum. Dis. 2020, 79, 312–315. [Google Scholar] [CrossRef] [PubMed]
  16. Petrovska, N.; Prajzlerova, K.; Vencovsky, J.; Senolt, L.; Filkova, M. The pre-clinical phase of rheumatoid arthritis: From risk factors to prevention of arthritis. Autoimmun. Rev. 2021, 20, 102797. [Google Scholar] [CrossRef] [PubMed]
  17. Ahlawat, S.; Debs, P.; Amini, B.; Lecouvet, F.E.; Omoumi, P.; Wessell, D.E. Clinical applications and controversies of whole-body MRI: AJR expert panel narrative review. Am. J. Roentgenol. 2023, 220, 463–475. [Google Scholar] [CrossRef] [PubMed]
  18. Liu, F.; Xin, Y.; Zhu, J. AB1346 ultrasound assessment of sub-clinical hand joint inflammation: A comparative study between early rheumatoid and psoriatic arthritis. Ann. Rheum. Dis. 2022, 81, 1779. [Google Scholar] [CrossRef]
  19. Huang, Y.H.; Chen, Y.H.; Yong, S.B.; Ma, K.S. Ultrasound for ankle and foot pathologies in early rheumatoid arthritis. Int. J. Rheum. Dis. 2023, 26, 1388–1390. [Google Scholar] [CrossRef] [PubMed]
  20. Babulal Vadher, A.; Sinha, A.; Roy Choudhury, S.; Prakash, M.; Maralakunte, M.; Rehman, T.; Sharma, S.; Kumar, Y. Ultrasound and magnetic resonance imaging of hands in systemic sclerosis: A cross-sectional analytical study of prevalence of inflammatory changes in patients with subclinical arthropathy. J. Scleroderma Relat. Disord. 2023, 8, 72–78. [Google Scholar] [CrossRef] [PubMed]
  21. Bureau, N.J. Point-of-Care Musculoskeletal Ultrasound: Point—The Evolution of Ultrasound Improving Patient Care. Am. J. Roentgenol. 2023. [Google Scholar] [CrossRef]
  22. Moller, B.; Aletaha, D.; Andor, M.; Atkinson, A.; Aubry-Rozier, B.; Brulhart, L.; Dan, D.; Finckh, A.; Grobety, V.; Mandl, P.; et al. Synovitis in rheumatoid arthritis detected by grey scale ultrasound predicts the development of erosions over the next three years. Rheumatology 2020, 59, 1556–1565. [Google Scholar] [CrossRef] [PubMed]
  23. Witt, M.; Mueller, F.; Nigg, A.; Reindl, C.; Leipe, J.; Proft, F.; Stein, N.; Hammitzsch, A.; Mayer, S.; Dechant, C.; et al. Relevance of grade 1 gray-scale ultrasound findings in wrists and small joints to the assessment of subclinical synovitis in rheumatoid arthritis. Arthritis Rheum. 2013, 65, 1694–1701. [Google Scholar] [CrossRef] [PubMed]
  24. Tan, Y.K.; Li, H.; Allen, J.C., Jr.; Thumboo, J. Joint damage in rheumatoid arthritis: Lessons learned from an extended 36-joint ultrasonography and 28-joint Disease Activity Score assessments. Int. J. Rheum. Dis. 2021, 24, 106–111. [Google Scholar] [CrossRef] [PubMed]
  25. Kay, J.; Upchurch, K.S. ACR/EULAR 2010 rheumatoid arthritis classification criteria. Rheumatology 2012, 51 (Suppl. S6), vi5–vi9. [Google Scholar] [CrossRef] [PubMed]
  26. Naredo, E.; Möller, I.; Moragues, C.; De Agustín, J.J.; Scheel, A.K.; Grassi, W.; de Miguel, E.; Backhaus, M.; Balint, P.; Bruyn, G.A. Interobserver reliability in musculoskeletal ultrasonography: Results from a “Teach the Teachers” rheumatologist course. Ann. Rheum. Dis. 2006, 65, 14–19. [Google Scholar] [CrossRef] [PubMed]
  27. Breiman, L. Random forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef]
  28. Pereira, S.; Pinto, A.; Oliveira, J.; Mendrik, A.M.; Correia, J.H.; Silva, C.A. Automatic brain tissue segmentation in MR images using Random Forests and Conditional Random Fields. J. Neurosci. Methods 2016, 270, 111–123. [Google Scholar] [CrossRef] [PubMed]
  29. Mahapatra, D. Automatic cardiac segmentation using semantic information from random forests. J. Digit. Imaging 2014, 27, 794–804. [Google Scholar] [CrossRef]
  30. Ko, B.C.; Kim, S.H.; Nam, J.Y. X-ray image classification using random forests with local wavelet-based CS-local binary patterns. J. Digit. Imaging 2011, 24, 1141–1151. [Google Scholar] [CrossRef] [PubMed]
  31. Lagomarsino, D.; Tofani, V.; Segoni, S.; Catani, F.; Casagli, N. A tool for classification and regression using random forest methodology: Applications to landslide susceptibility mapping and soil thickness modeling. Environ. Model. Assess. 2017, 22, 201–214. [Google Scholar] [CrossRef]
  32. Rakieh, C.; Nam, J.L.; Hunt, L.; Hensor, E.M.; Das, S.; Bissell, L.A.; Villeneuve, E.; McGonagle, D.; Hodgson, R.; Grainger, A.; et al. Predicting the development of clinical arthritis in anti-CCP positive individuals with non-specific musculoskeletal symptoms: A prospective observational cohort study. Ann. Rheum. Dis. 2015, 74, 1659–1666. [Google Scholar] [CrossRef]
  33. Van de Stadt, L.A.; Bos, W.H.; Meursinge Reynders, M.; Wieringa, H.; Turkstra, F.; van der Laken, C.J.; van Schaardenburg, D. The value of ultrasonography in predicting arthritis in auto-antibody positive arthralgia patients: A prospective cohort study. Arthritis Res. Ther. 2010, 12, R98. [Google Scholar] [CrossRef]
  34. Nam, J.L.; Hensor, E.M.; Hunt, L.; Conaghan, P.G.; Wakefield, R.J.; Emery, P. Ultrasound findings predict progression to inflammatory arthritis in anti-CCP antibody-positive patients without clinical synovitis. Ann. Rheum. Dis. 2016, 75, 2060–2067. [Google Scholar] [CrossRef]
  35. Aydin, S.Z.; Pay, S.; Inanc, N.; Kamali, S.; Karadag, O.; Emery, P.; D’Agostino, M.-A. Which joints and why do rheumatologists scan in rheumatoid arthritis by ultrasonography? A real life experience. Clin. Exp. Rheumatol. 2017, 35, 508–511. [Google Scholar] [PubMed]
  36. Hayashi, D.; Roemer, F.W.; Katur, A.; Felson, D.T.; Yang, S.-O.; Alomran, F.; Guermazi, A. Imaging of synovitis in osteoarthritis: Current status and outlook. Semin. Arthritis Rheum. 2011, 41, 116–130. [Google Scholar] [CrossRef] [PubMed]
  37. Keen, H.I.; Wakefield, R.J.; Grainger, A.J.; Hensor, E.M.; Emery, P.; Conaghan, P.G. Can ultrasonography improve on radiographic assessment in osteoarthritis of the hands? A comparison between radiographic and ultrasonographic detected pathology. Ann. Rheum. Dis. 2008, 67, 1116–1120. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Study flow chart.
Figure 1. Study flow chart.
Diagnostics 14 01181 g001
Figure 2. Examples of joint gray scale ultrasound findings. (A) Wrist joint showing synovial hypertrophy (indicated by double-headed blue arrows) and joint capsule distention (double-headed green arrows). (B) Proximal interphalangeal (PIP) joint showing synovial hypertrophy (indicated by double-headed blue arrows) and joint capsule distention (double-headed green arrows). Osteophytes are marked by red arrows.
Figure 2. Examples of joint gray scale ultrasound findings. (A) Wrist joint showing synovial hypertrophy (indicated by double-headed blue arrows) and joint capsule distention (double-headed green arrows). (B) Proximal interphalangeal (PIP) joint showing synovial hypertrophy (indicated by double-headed blue arrows) and joint capsule distention (double-headed green arrows). Osteophytes are marked by red arrows.
Diagnostics 14 01181 g002
Figure 3. Examples of joint Doppler ultrasound findings. (A) Radiocarpal joint showing synovial thickening, marked as “1” within the green rectangle, and increased vascularity on Doppler ultrasound, indicated by blue and red areas within the green rectangle. (B) Proximal interphalangeal (PIP) joint with synovitis and hypervascularity on Doppler ultrasound, indicated by blue and red areas within the green rectangle.
Figure 3. Examples of joint Doppler ultrasound findings. (A) Radiocarpal joint showing synovial thickening, marked as “1” within the green rectangle, and increased vascularity on Doppler ultrasound, indicated by blue and red areas within the green rectangle. (B) Proximal interphalangeal (PIP) joint with synovitis and hypervascularity on Doppler ultrasound, indicated by blue and red areas within the green rectangle.
Diagnostics 14 01181 g003aDiagnostics 14 01181 g003b
Figure 4. Ultrasound findings of the MCP joint. (A) Grade II joint capsule distension is observed without significant hypervascularity. The double-headed blue arrows indicate synovial thickness. (B) Moderate joint effusion and joint capsule thickening. The double-headed white arrows indicate joint capsule thickness, yellow arrows show joint effusion, and the green rectangle encompasses Color Doppler imaging to show vascularity. (C) A normal MCP joint with standard synovial thickness, as shown by the double-headed blue arrows. The red double-headed arrow represents the normal MCP joint anatomy.
Figure 4. Ultrasound findings of the MCP joint. (A) Grade II joint capsule distension is observed without significant hypervascularity. The double-headed blue arrows indicate synovial thickness. (B) Moderate joint effusion and joint capsule thickening. The double-headed white arrows indicate joint capsule thickness, yellow arrows show joint effusion, and the green rectangle encompasses Color Doppler imaging to show vascularity. (C) A normal MCP joint with standard synovial thickness, as shown by the double-headed blue arrows. The red double-headed arrow represents the normal MCP joint anatomy.
Diagnostics 14 01181 g004
Figure 5. The ROC (left panel) and precession–recall (right panel) curves.
Figure 5. The ROC (left panel) and precession–recall (right panel) curves.
Diagnostics 14 01181 g005
Figure 6. The predictive value of the US and laboratory variables according to the random forest algorithm.
Figure 6. The predictive value of the US and laboratory variables according to the random forest algorithm.
Diagnostics 14 01181 g006
Table 1. Baseline demographic and laboratory characteristics.
Table 1. Baseline demographic and laboratory characteristics.
VariableNon-RA Patients
(n = 203)
RA Patients
(n = 123)
p-Value
Age (year) (mean ± SD)43.90 ± 10.3847.10 ± 12.650.019
Gender, female, n (%)174 (85.7)97 (78.9)0.109
WBC6.81 ± 2.177.45 ± 2.180.012
ESR17.13 ± 15.2623.11 ± 20.120.003
RF7.13 ± 5.6821.63 ± 29.57<0.0001
CRP5.15 ± 10.767.32 ± 9.700.069
Anti-CCP3.93 ± 9.1430.95 ± 75.14<0.0001
Vitamin D33.64 ± 15.7234.93 ± 18.650.504
Table 2. Independent predictive variables associated with RA progression for 24-month follow-up.
Table 2. Independent predictive variables associated with RA progression for 24-month follow-up.
VariableUnivariate ModelMultivariate Model
Odds Ratio (95%CI)p-ValueOdds Ratio (95%CI)p-Value
Age (years)1.03 (1.01–1.05)0.0151.03 (0.99–1.07)0.147
WBC1.14 (1.03–1.27)0.0131.23 (1.02–1.50)0.035
ESR1.02 (1.006–1.03)0.0041 (0.98–1.03)0.804
RF1.09 (1.05–1.12)<0.00011.08 (1.04–1.12)<0.0001
Anti-CCP1.05 (1.02–1.08)0.0031.04 (1.02–1.07)0.002
Radiocarpal–synovial thickening18.19 (10.18–32.50)<0.000139.87 (15.86–100.20)<0.0001
Hypervascularity12.19 (1.48–100.31)0.027.99 (0.32–202.95)0.208
Wrist effusion4.68 (1.63–13.47)0.00412.56 (2.22–70.95)0.004
MCP synovitis51.53 (6.88–385.86)<0.000139 (3.34–454.1)0.003
PIP synovitis28.68 (8.61–95.55)<0.000168 (12.62–365.91)<0.0001
Extensor tenosynovitis3.89 (1.54–9.83)0.0044.03 (0.60–27.01)0.151
Flexor tenosynovitis2.77 (1.16–6.61)0.0220.74 (0.14–3.96)0.724
DIP synovitis4.40 (1.35–14.36)0.0140.76 (0.10–6.16)0.8
Table 3. The results of the evaluation metrics for machine learning methods including tree, linear SVM, quadratic SVM, SVM with Gaussian kernel, KNN, AdaBoost, random forest, and NN for US and laboratory features.
Table 3. The results of the evaluation metrics for machine learning methods including tree, linear SVM, quadratic SVM, SVM with Gaussian kernel, KNN, AdaBoost, random forest, and NN for US and laboratory features.
US and Laboratory FeaturesTreeLinear SVMQuadradic
SVM
Gaussian SVMKNN
K = 10
AdaBoostRandom ForestNeural Network
Accuracy83. 784.9784.6684.9776.0786.286.585.28
Sensitivity78.0578.8673.9878.0542.2879.6782.1179.67
Specificity87.1988.6791.1389.1696.5590.1589.1688.67
Precision78.6980.8383.4981.3688.1483.0582.0980.99
FPR12.8111.3308.8710.8403.4509.8510.8411.33
F1-Score78.3779.8478.4579.6757.1481.3382.1080.33
MCC Matthews65.3567.8766.9067.7948.8870.4271.2868.57
Kappa Cohen’s65.3567.8666.6167.7543.2670.3971.2868.56
Table 4. The results of the evaluation metrics for machine learning methods including tree, linear SVM, quadratic SVM, SVM with Gaussian kernel, KNN, AdaBoost, random forest, and NN for US features.
Table 4. The results of the evaluation metrics for machine learning methods including tree, linear SVM, quadratic SVM, SVM with Gaussian kernel, KNN, AdaBoost, random forest, and NN for US features.
US FeaturesTreeLinear SVMQuadradic
SVM
Gaussian SVMKNN
K = 10
AdaBoostRandom ForestNeural Network
Accuracy82.5282.5281.9080.9878.8383.4483.7481.60
Sensitivity69.9278.0569.9273.9847.1568.2975.6165.04
Specificity90.1585.2289.1685.2298.0392.6188.6791.63
Precision81.1376.1979.6375.2193.5584.8580.1782.47
FPR09.8514.7810.8414.781.977.3911.338.37
F1-Score75.1177.1174.4674.5962.775.6877.8272.73
MCC Matthews62.1562.9860.8459.455.8164.2065.0860.08
Kappa Cohen’s61.7562.9760.5459.450.0863.3465.0159.19
Table 5. The results of the evaluation metrics for machine learning methods including tree, linear SVM, quadratic SVM, SVM with Gaussian kernel, KNN, AdaBoost, random forest, and NN, for laboratory features.
Table 5. The results of the evaluation metrics for machine learning methods including tree, linear SVM, quadratic SVM, SVM with Gaussian kernel, KNN, AdaBoost, random forest, and NN, for laboratory features.
Laboratory FeaturesTreeLinear SVMQuadradic
SVM
Gaussian SVMKNN
K = 10
AdaBoostRandom ForestNeural Network
Accuracy63.872.0971.4770.5570.5570.5573.0165.34
Sensitivity54.4730.8934.1530.8930.8942.2848.7849.59
Specificity69.6497.0494.0994.5894.5887.6887.6874.88
Precision51.9486.3677.7877.5577.5567.5370.5954.46
FPR30.5402.9605.9105.4205.4212.3212.3225.12
F1-Score53.1745.5147.4644.1944.195257.6951.91
MCC Matthews23.7239.6336.8134.5534.5534.1940.2624.98
Kappa Cohen’s23.7031.9931.7428.9028.9032.3438.8324.91
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Daskareh, M.; Vakilpour, A.; Barzegar-Golmoghani, E.; Esmaeilian, S.; Gilanchi, S.; Ezzati, F.; Alikhani, M.; Rahmanipour, E.; Amini, N.; Ghorbani, M.; et al. Predicting Rheumatoid Arthritis Development Using Hand Ultrasound and Machine Learning—A Two-Year Follow-Up Cohort Study. Diagnostics 2024, 14, 1181. https://doi.org/10.3390/diagnostics14111181

AMA Style

Daskareh M, Vakilpour A, Barzegar-Golmoghani E, Esmaeilian S, Gilanchi S, Ezzati F, Alikhani M, Rahmanipour E, Amini N, Ghorbani M, et al. Predicting Rheumatoid Arthritis Development Using Hand Ultrasound and Machine Learning—A Two-Year Follow-Up Cohort Study. Diagnostics. 2024; 14(11):1181. https://doi.org/10.3390/diagnostics14111181

Chicago/Turabian Style

Daskareh, Mahyar, Azin Vakilpour, Erfan Barzegar-Golmoghani, Saeid Esmaeilian, Samira Gilanchi, Fatemeh Ezzati, Majid Alikhani, Elham Rahmanipour, Niloofar Amini, Mohammad Ghorbani, and et al. 2024. "Predicting Rheumatoid Arthritis Development Using Hand Ultrasound and Machine Learning—A Two-Year Follow-Up Cohort Study" Diagnostics 14, no. 11: 1181. https://doi.org/10.3390/diagnostics14111181

APA Style

Daskareh, M., Vakilpour, A., Barzegar-Golmoghani, E., Esmaeilian, S., Gilanchi, S., Ezzati, F., Alikhani, M., Rahmanipour, E., Amini, N., Ghorbani, M., & Pezeshk, P. (2024). Predicting Rheumatoid Arthritis Development Using Hand Ultrasound and Machine Learning—A Two-Year Follow-Up Cohort Study. Diagnostics, 14(11), 1181. https://doi.org/10.3390/diagnostics14111181

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop