Next Article in Journal
Infection of Trichinella spiralis Affects the Reproductive Capacity of ICR/CD-1 Male Mice by Reducing the Urine Pheromone Contents and Sperm Quality
Previous Article in Journal
hiPSC-Derived Cells as Models for Drug Discovery 2.0
Previous Article in Special Issue
Rheumatic Immune-Related Adverse Events due to Immune Checkpoint Inhibitors—A 2023 Update
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Inappropriate Expression of PD-1 and CTLA-4 Checkpoints in Myeloma Patients Is More Pronounced at Diagnosis: Implications for Time to Progression and Response to Therapeutic Checkpoint Inhibitors

by
Anna Kulikowska de Nałęcz
1,
Lidia Ciszak
2,
Lidia Usnarska-Zubkiewicz
3,
Edyta Pawlak
2,
Irena Frydecka
2,
Magdalena Szmyrka
4 and
Agata Kosmaczewska
2,*
1
Hematology and Hematological Oncology Department, Provincial Hospital, 45-061 Opole, Poland
2
Hirszfeld Institute of Immunology and Experimental Therapy, Polish Academy of Sciences, 53-114 Wroclaw, Poland
3
Department of Hematology, Blood Neoplasms, and Bone Marrow Transplantation, Wroclaw Medical University, 50-367 Wroclaw, Poland
4
Department of Rheumatology and Internal Diseases, Wroclaw Medical University, 50-556 Wroclaw, Poland
*
Author to whom correspondence should be addressed.
Int. J. Mol. Sci. 2023, 24(6), 5730; https://doi.org/10.3390/ijms24065730
Submission received: 30 November 2022 / Revised: 24 February 2023 / Accepted: 15 March 2023 / Published: 17 March 2023
(This article belongs to the Special Issue Immune Checkpoint Inhibitors and Immune Checkpoint Resistance)

Abstract

:
Multiple myeloma (MM) is a hematologic malignancy characterized by severely profound immune dysfunction. Therefore, the efficacy of drugs targeting the immune environments, such as immune checkpoint inhibitors (ICIs), is of high clinical importance. However, several clinical trials evaluating ICIs in MM in different therapeutic combinations revealed underwhelming results showing a lack of clinical efficacy and excessive side effects. The underlying mechanisms of resistance to ICIs observed in the majority of MM patients are still under investigation. Recently, we demonstrated that inappropriate expression of PD-1 and CTLA-4 on CD4 T cells in active MM is associated with adverse clinical outcomes and treatment status. The aim of the current study was to determine the usefulness of immune checkpoint expression assessment as a predictive biomarker of the response to therapeutic inhibitors. For this purpose, along with checkpoint expression estimated by flow cytometry, we evaluated the time to progression (TTP) of MM patients at different clinical stages (disease diagnosis and relapse) depending on the checkpoint expression level; the cut-off point (dividing patients into low and high expressors) was selected based on the median value. Herein, we confirmed the defective levels of regulatory PD-1, CTLA-4 receptors, and the CD69 marker activation in newly diagnosed (ND) patients, whereas relapsed/refractory patients (RR) exhibited their recovered values and reactivity. Additionally, substantially higher populations of senescent CD4+CD28 T cells were found in MM, primarily in NDMM subjects. These observations suggest the existence of two dysfunctional states in MM CD4 T cells with the predominance of immunosenescence at disease diagnosis and exhaustion at relapse, thus implying different responsiveness to the external receptor blockade depending on the disease stage. Furthermore, we found that lower CTLA-4 levels in NDMM patients or higher PD-1 expression in RRMM patients may predict early relapse. In conclusion, our study clearly showed that the checkpoint level in CD4 T cells may significantly affect the time to MM progression concerning the treatment status. Therefore, when considering novel therapies and potent combinations, it should be taken into account that blocking PD-1 rather than CTLA-4 might be a beneficial form of immunotherapy for only a proportion of RRMM patients.

1. Introduction

Despite the current advances in treatment seen with the inclusion of proteosome inhibitors (PIs), immunomodulatory drugs (IMIDs), and chimeric T cell therapy (CAR-T) multiple myeloma (MM) remains an almost universally incurable malignancy. Along with reducing the bulk of myeloma cells by conventional therapy, host factors including the cytotoxic capacity of activated T cells is essential for tumor eradication and clinical outcomes of MM therapy. Accumulating evidence has shown that tumor-induced immune dysfunction in MM patients seems to be greater than in other B cell malignancies [1,2,3], and includes dysfunction of dendritic and T cells [4], accumulation of suppressive cell types [2,4], cytotoxic T cell/Treg and Th17/Treg imbalance [5,6], and T cell hyporesponsiveness [7,8].
The dysfunction of T cells in cancer patients is characterized by anergy, senescence, and/or exhaustion [9,10,11], namely the states sharing expression of the multiple inhibitory molecules implicated in the impaired effector functions and hyporesponsiveness. Overcoming the hyporesponsiveness of T cells could reinvigorate the host’s immune response and restore antitumor immunity. Available data, including ours, demonstrates that T cells in patients with MM display features of exhaustion and senescence [6,12]. It is interesting to note that both dysfunctional states may exist at the same disease stage. Determination of the extent of senescence and/or exhaustion within the T cell compartment remain confusing due to several similarities. While both states share overlapping functional and phenotypic features including the expression of regulatory receptors (e.g., PD-1 and CTLA-4), increased cell cycle arrest, and affected effector functions, they also have distinct regulatory and molecular mechanisms controlling their development and disturbed antitumor functions [13,14,15]. Another difference is the potential for reversion as a consequence of modulation of regulatory pathways after external receptor blockade, a feature attributed only to exhaustion [13,16]. An increasing body of evidence suggests that the extent of the clinical response to checkpoint inhibitors might be closely related to the level of checkpoint expression on T cells [6,16]. Therefore, the identification of dysfunctional states predominating in MM patients regarding the clinical stage could help determine if T cell hyporesponsiveness is reversible by manipulating the immune checkpoint blockade, thus predicting the clinical response to this therapeutic approach.
Accordingly, our recent study was conducted to assess the usefulness of immune checkpoints as predictive biomarkers of the response to therapeutic checkpoint inhibitors at different clinical stages, namely NDMM and RRMM patients [6]. In the current study, we confirmed the suboptimal level of CTLA-4 and PD-1 in circulating MM CD4 T cells, primarily in NDMM patients. Furthermore, we observed that the level of checkpoint expression may predict the clinical outcome, when considering TTP, in relation to the treatment status; lower CTLA-4 expression at disease diagnosis or higher PD-1 levels in RRMM patients might predict early relapse. Our results clearly indicate that blocking immune checkpoints might be a beneficial form of immunotherapy for only a proportion of RRMM patients.

2. Results

2.1. Circulating Myeloma CD4 T Cells Contain Lower Levels of Immune Checkpoints at Diagnosis

As recent clinical trials of the administration of immune checkpoint inhibitors (ICIs) in MM showed real disappointment [16,17,18,19,20], we wanted to verify whether the onset and/or exacerbation of MM is accompanied by alterations in the expression of immune checkpoints, thereby affecting their usefulness as targets for therapeutic inhibitors. Therefore, we assessed PD-1 and CTLA-4 expression in the peripheral blood (PB) CD4+ T cell subsets involved in the antitumor response in MM patients at disease diagnosis and relapse.
In our study, as is shown in Figure 1a, a median proportion of CD4+ T cells expressing the PD-1 checkpoint was found to increase in all MM patients regardless of disease stage when compared to controls (p < 0.05). While an expansion of PD-1+ Teff cells was similar in all patients, Treg cells from RRMM patients expressed the PD-1 molecule on a significantly higher proportion of cells than in the NDMM group (p = 0.037) (Figure 1a).
Remarkably, a quantitative analysis of PD-1 expression on PB CD4+ T cells showed lower levels in NDMM patients compared to healthy controls (p = 0.06) (Figure 1b). While a decline of PD-1 was observed in the whole population of NDMM CD4+ T cells, including both Teff and Treg subsets, the loss of PD-1 was more pronounced in Treg cells (p = 0.016) (Figure 1b); in Teff cells, a decrease of PD-1 was of borderline significance (p = 0.08) (Figure 1b). In RRMM patients, PD-1 expression was also down-regulated primarily in the Treg subset; however, its median values were statistically comparable to those observed in corresponding healthy cells (Figure 1b). Although some differences in PD-1 expression between patient groups were observed, they did not reach statistical significance.
As is demonstrated in Figure 2a, we also found no significant differences in the proportion of CTLA-4 expressing cells within the examined subsets between the participants studied, except for the higher abundance of CTLA-4+ Treg cells in RRMM patients when compared to healthy controls (p = 0.031). Remarkably, similarly to PD-1 expression, a quantitative estimation of CTLA-4 showed that the only group exhibiting a markedly down-regulated level of CTLA-4 on CD4 T cells, including Teff and Treg cells, was NDMM patients (p ≤ 0.008 and p ≤ 0.005, respectively) compared to normal levels in corresponding cells from the RRMM and healthy groups (Figure 2b). Additionally, there were no differences in CTLA-4 expression between RRMM patients and controls regarding the studied CD4+ T cell subsets (Figure 2b).
From our results it seems that the lower levels of both immune checkpoints in MM CD4 T cells suggest they are not appropriate targets for therapeutic inhibitors in MM, at least at disease onset, and, consequently, should not to be considered in first-line treatment settings. Furthermore, chemo- and/or immunotherapy of MM, despite the risk of the development of refractoriness, is capable of reinforcing both PD-1 and CTLA-4 checkpoint expression, making them more attainable to the therapeutic inhibitors in RRMM.

2.2. Lower CTLA-4 Levels at Myeloma Diagnosis Predispose to a Shortened TTP

Next, we analyzed whether the observed alterations in PD-1 and CTLA-4 expression may influence the clinical outcome of MM. Therefore, we assessed the TTP of MM patients at the different clinical stages (disease onset and relapse/refractoriness) depending on the expression of both immune checkpoints on CD4 T cells. The cut-off point was selected based on the median value of the checkpoint expression (measured at qualitative and quantitative levels). The statistically significant associations are shown in Figure 3.
For the whole MM patient cohort, regardless of CD4+ T cell subtypes, a weak positive association of CTLA-4 level on CD4+ T cells with TTP was indicated (p = 0.053) (Figure 3a); however, this relationship was found to be strengthened only with regards to the Teff subset (p = 0.02) (Figure 3b), and CTLA-4 expression on Treg was not associated with TTP. Furthermore, clinical subanalysis revealed that the above association might be assigned to NDMM patients (Figure 3a); patients with a CTLA-4 level below the median value had significantly shorter TTP than those with a higher CTLA-4 expression (p = 0.04). In contrast, RRMM patients exhibited no statistically significant association of CTLA-4 fluorescence intensity with TTP (p = 0.098) (Figure 3a). Likewise, no impact was found of changes in CTLA-4 distribution within CD4+ T cells on MM progression in either group of patients.
Our study demonstrating the association of CTLA-4 loss in CD4 T cells with shortened TTP seen in NDMM patients points to the possibility that blockade of CTLA-4 in MM may be an unfavorable strategy at diagnosis.

2.3. Higher PD-1 Expression May Predict Early Relapse in RRMM Patients

Given it is noted that MM patients at diagnosis exhibited an impaired PD-1 level, we next examined its association with clinical outcomes in terms of TTP as well.
For the whole patient cohort, as is demonstrated in Figure 4, several inverse associations of TTP with the frequency of PD-1-expressing CD4+ T cells (p = 0.057) (Figure 4a) have been found: PD-1+ Treg cells (p = 0.07) (Figure 4b), PD-1+ Teff (p = 0.043) (Figure 4c), and the level of PD-1 in Treg and Teff cells (p = 0.046 and p = 0.035, respectively) (Figure 4b and 4c, respectively). Together these indicate that high-PD-1 expressors experienced an MM relapse significantly earlier than those with PD-1 expression below the median values. However, patient analysis based on the clinical division according to MM stage revealed that the above observation was primarily assigned to the RRMM group, where patients with percentages of CD4+PD-1+ T cells over the median value had markedly shorter TTP compared to those with a lower frequency of these cells (p = 0.033) (Figure 4a); of note, such an association was not shown for NDMM patients (p = 0.41) (Figure 4a).
From the above data it appears that the administration of PD-1 inhibitors might be a beneficial form of therapy for a proportion of RRMM patients, particularly those exhibiting higher PD-1 expression within CD4+ T cells.

2.4. CD4 T Cells from NDMM Patients Retain In Vivo Lower Reactivity to Stimuli

Having demonstrated that the dysregulated expression of immune checkpoints on T cells may be a consequence of altered in vivo stimulation, we also analyzed the systemic activation of CD4 T cells in all individuals studied. The assessment of T cell reactivity is important in predicting the biological effectiveness of the checkpoint blockade [13,21].
While we noted an increased proportion of CD4+CD69+ T cells in the PB of all patients (p < 0.06), statistically significant differences were found only between the RRMM group and healthy controls (p = 0.027) (Figure 5a). Remarkably, the median fluorescence intensity of the activation marker CD69 was the lowest in the CD4+ T cells from NDMM patients and it significantly differed from that obtained in corresponding healthy cells (p = 0.017). Although the difference in CD69 expression was also observed in comparison to the RRMM group, it remained at a statistically similar level (Figure 5a).
The above results indicate that the level of immune checkpoint expression in MM corresponds with the suboptimal activation of T cells. Therefore, inappropriate expression of checkpoints may not be responsible for MM T cell hyporesponsiveness observed primarily at disease onset.

2.5. CD28 Loss Related to Cell Senescence Is More Pronounced at Myeloma Diagnosis

Despite the altered pattern of immune checkpoint expression, the lack of CD28 could also help to identify a predominant dysfunctional state in MM CD4 T cells related to immune suppression. Given that it has been demonstrated that the lack of CD28 is one of the constant features of senescent T cells, CD28 negativity has been proposed as a surrogate senescence marker of T cells [13,22]. Therefore, we analyzed the frequency of pathogenic PB CD4+CD28 T cells at different MM stages in order to predict a clinical response to ICIs.
We found a substantial increase in the proportion of CD4+CD28 T cells in circulation among all MM patients compared to the controls (p < 0.0001). However, detailed analysis revealed a significant difference in the abundance of these pathogenic cells among patients regarding disease stage, with the predominance of senescent CD4+CD28 T cells evident in the NDMM group when compared to RRMM patients (p < 0.001) (Figure 5b).
Our data clearly showed that MM immunopathology is characterized by a higher frequency of CD4+CD28 T cells, which is more pronounced in NDMM patients. This may clearly indicate prevalence of the senescent state in MM and points toward the suggestion that reversion of hyporesponsiveness by administrating therapeutic checkpoint inhibitors in MM could be associated with an increasing risk of ineffectiveness.

2.6. The Significance of Clinico-Pathological Features in Prediction of Myeloma Early Relapse

In order to determine the representativeness of our cohort of MM patients, we assessed the impact of the clinico-pathological features of patients on the MM clinical outcome regarding the time to disease relapse. Among the clinical characteristics studied, including patient age, the International Staging System (ISS), anemia, and the levels of β2-microglobulin, albumin, creatinine, plasmacytes, lactate dehydrogenase (LDH), and serum calcium, we found that hyper-β2-microglobulinemia, anemia, and the higher abundance of circulating plasmacytes shortened the time to MM progression (p = 0.009, p = 0.02, and p = 0.08, respectively), thus indicating their predictive significance and enrollment of suitable patients (Figure 6).

3. Discussion

The reversal of T cell hyporesponsiveness plays an essential role in myeloma immunotherapy aimed at the restoration of the host’s immune response. Growing evidence has shown that defective tumor immunity contributes to compromised effectiveness of anti-myeloma therapy applied so far mainly in advanced high-risk RRMM [23]. The available research demonstrated that MM T cells, depending on the clinical stage, may display features of immune senescence and/or functional exhaustion [6,12,24]. In order to resolve the mechanism responsible for the hyporesponsiveness of MM T cells, it is crucial to distinguish between both dysfunctional states to achieve their adequate and effective control with the appropriate therapeutic approaches.
Herein, we report that in patients with active MM the alterations of the immune checkpoint level depend on the clinical stage of the disease associated with treatment status, and correspond to the extent of the systemic activation of circulating CD4 T cells. In particular, defected levels of PD-1 and CTLA-4 checkpoints, as well as CD69 were observed in MM primarily at diagnosis. Furthermore, we noted that patients, although relapsed, also exhibited inappropriate checkpoint expression, thus confirming the recent suggestion that immune checkpoints are not responsible for T cell hyporesponsiveness in MM [6,24]. The above observation points to the possibility that immune checkpoints might not be appropriate targets for therapeutic inhibitors in MM, and indicates that T cell-related immune suppression in MM cannot be effectively reversed by manipulating extrinsic regulatory pathways. Remarkably, our observation on an association of the lower CTLA-4 expression on CD4 T cells with shortened TTP in NDMM patients confirms the suggestion that blocking CTLA-4 in MM may be an unfavorable therapeutic strategy for a proportion of MM patients, primarily at diagnosis. This finding is consistent with former observations, including ours, on the impact of genetic variations of the CTLA-4 gene involved in lower CTLA-4 protein expression with increasing susceptibility to MM development [25,26,27]. Similar dependence of the response to a CTLA-4 blockade on the level of CTLA-4 expression was previously observed in chronic lymphocytic leukemia by our group [28].
Moreover, inappropriate levels of PD-1 and CTLA-4 in MM CD4 T cells together with the increased subset of CD4+CD28 T cells found in our patient cohort have been demonstrated as features of senescent T cells, thus indicating senescence as a predominant dysfunctional state in MM [24]. Our observation is in accordance with a study by Zeller-Riese et al. [12], who recently found that T cells from MM patients express several molecules associated with either T cell exhaustion (e.g., PD-1 and CTLA-4) or T cell senescence (a lack of CD28). They also reported, however, that the enhancement of the senescent CD28-negative T cell population was more pronounced in NDMM patients in comparison to RRMM subjects. These results clearly correspond with our recent study performed in the same patient cohort [6], demonstrating the expansion of CD4 T cells exhibiting a senescence-associated secretory effector phenotype (SASP) [29], primarily in NDMM patients. This is suggestive of the significance of immune senescence in myeloma development, rather than anergy as a dominant functional state of hyporesponsiveness, and emphasizes a role for determining the extent of T cell senescence [6]. Remarkably, the data available have shown that T cell senescence is caused by intrinsic signals induced by DNA damage and can be reversed pharmacologically, but not with an external receptor blockade [13,22,30,31], thereby minimizing the role for checkpoint inhibitors in MM immunotherapy. It should be emphasized, however, that T cell clones in MM have recently been demonstrated not to be related to shortened telomeres, which may imply that their senescence is potentially reversible in MM, if the underlying mechanism is elucidated [24]. Nonetheless, estimation of the senescent T cell population in MM may be of clinical relevance in terms of predicting the clinical response to therapeutic checkpoint inhibitors.
The defective levels of immune checkpoints observed in the present study, more pronounced in the Treg subset, may also imply the inappropriate prevention of autoimmunity [32]. Likewise, in the same patient cohort, we recently found a higher population of CD4 T cells with capacity for inflammatory IL-17 and IFN-γ cytokine secretion with an increased Th17/Treg ratio when compared to the values obtained in the RRMM group [6]. Although the Treg cell population was found to be expanded in all studied patients, the current analysis revealed that this subset is mostly affected by impaired expression levels of PD-1 and CTLA-4 at disease diagnosis, which might compromise the Treg regulatory function. Given that checkpoint expression in Treg cells is associated with suppressive activity [33,34,35], the decreased level of checkpoints in the Treg population is suggestive of the shift in the immune balance toward autoimmune inflammatory conditions, especially in NDMM patients. In fact, the augmented population of CD4+CD28 T cells that we found in all MM patients was previously shown to secrete inflammatory cytokines, which corresponds with the phenotypic and functional characteristics of autoreactive cytotoxic CD4+ T cells [6,36,37,38]. The notion that among MM patients, the CD4+CD28 T cell population is significantly enriched, primarily at disease onset, is in line with the current phenotypic analysis of Tregs and strongly indicates the possibility of a higher incidence of autoimmune responses in MM. In fact, a personal history of autoimmune disease was found to be associated with a significantly higher risk of the monoclonal gammopathy of undetermined significance (MGUS) and MM, indicating a common genetic susceptibility between autoimmunity and plasma cell disorders [39,40]. It has also been demonstrated that co-morbidity of the autoimmune disease might be prognostic of a worse survival rate in MM patients [39], and suboptimal immune checkpoint expression cannot be excluded when considering the underlying mechanism. Our finding that the lower CTLA-4 expression on CD4 T cells may predict early relapse in NDMM patients also seems to confirm these associations. Therefore, an increasing risk of exaggeration of autoimmune events should be taken into account when considering blocking immune checkpoints in MM [41]. A case of an NDMM patient who developed a lethal immune-related myocarditis after a single dose of pembrolizumab (a PD1-L inhibitor) in combined therapy with lenalidomide and dexamethasone seems to strengthen the above concern, and indicates that therapeutic checkpoint inhibitors should be administered in MM with extreme caution, if at all, especially in first-line treatments [42].
Interestingly, our present study also showed that chemo- and/or immunotherapy of MM, despite the well-known risk of the development of refractoriness [43], is capable of reinforcing both PD-1 and CTLA-4 checkpoint expression, and this notion is consistent with other studies [6,12,44]. The post-treatment ligation of regulatory receptors resulting in the increase and recovery of T cells found in this study has previously been demonstrated as a key phenotypic feature of cell exhaustion, which is also a dysfunctional state related to MM T cell hyporesponsiveness [12]. It should be emphasized, however, that unlike the cell senescence predominant in NDMM patients, the exhaustion of T cells observed mainly in relapse has been shown to be reversible upon inhibitory receptor blockade [13,23]. Here we report that an increase in immune checkpoint expression seen in RRMM patients and accompanied by CD69 reversion is suggestive of the treatment-related tendency to the restoration of reactivity in CD4 T cells, thus making them more attainable for therapeutic inhibitors in RRMM. Of note, exhaustion has been proposed as a mechanism of the prevention of T cell loss and the retention of T cell clones required for immune surveillance and tumor immunity [13]. In fact, expanded clones of cytotoxic T cells exist in patients with MM and other hematologic malignancies [35,45,46,47,48,49,50,51]. Although exhausted T cells are hyporesponsive in vitro, their presence in the blood of MM patients is related to better prognosis, probably due to their potential to reverse cell dysfunction [45,46,52,53]. However, our current study, showing that high-PD-1 expressors (primarily within the Teff population) in RRMM patients exhibit a shortened TTP, is indicative of the possibility that a PD-1 blockade might be a beneficial form of immunotherapy for a subset of RRMM patients depending on their PD-1 expression level. This notion is in line with a recent study by Alrasheed et al. [54], who demonstrated that a high level of PD-1+ Teff cells predicts early progression in MM. In our recent study [6], we consistently found an association of high PD-1 expression in Teff and Treg cells in MM with an adverse clinical outcome. Genetic susceptibility to MM development regarding PD-1 gene polymorphisms also indicated a significant association with a high PD-1 expression haplotype [25], which is in opposition to the CTLA-4 gene, as its lower expression level has been reported to be involved in MM development [26,27]. These results together with our findings might suggest that, among immune checkpoints, PD-1 rather than CTLA-4 could have potential as a target for therapeutic blockade in a subset of RRMM patients, if the relevant expression of T cells is observed.
Although a weakness of our study is that the relatively small size of the patient cohort inhibits our ability to make strong conclusions, noteworthy is its accordance with the results of two recent phase III clinical trials (namely KEYSTONE-183 and KEYSTONE-185 conducted in RR and ND MM patients, respectively) [17,18]. Both trials showed an unfavorable benefit-to-risk profile after administration of pembrolizumab (a PD-1 inhibitor) in combination with dexamethasone and immunomodulatory drugs (IMIDs). While these trials failed to show higher overall response rate (ORR) or TTP/progression-free-survival (PFS) in the experimental arms, they also demonstrated a much higher frequency and severity of immune-related adverse events (iRAEs) compared to those observed in a checkpoint blockade in other malignancies [17,18]. Moreover, regarding the clinical stages of MM, iRAEs were more pronounced in NDMM patients than in RRMM subjects, probably due to a less exhausted immune system at disease onset [19] and inappropriate prevention of autoimmunity, which clearly confirms the findings presented in our current work. In addition, we displayed a predictive value of the clinico-pathological characteristics of MM patients enrolled in the study, demonstrating the impact of β2-microglobulin, plasmacyte, and hemoglobin levels on the time to relapse, thus indicating the representativeness of our cohort of patients.
In the immunotherapy of MM patients, except pembrolizumab, several other ICIs have been administered, including nivolumab (anti-PD-1 mAb) and atezolizumab (anti-PD-L1 mAb) alone, or in combination with conventional chemotherapeutics and/or IMIDs, which are showing a disappointing clinical response in the majority of cases [23,55]. Available data showed that the low efficacy of conventional checkpoint inhibitors may be caused by the existence of compensatory inhibitory mechanisms related to the up-regulation of the other checkpoints, such as VISTA or TIM-3 [56,57]. Remarkably, our study clearly showed that an inappropriate level of PD-1 and CTLA-4 checkpoint expression in CD4 T cells in MM patients may also be responsible for the failure of ICIs, and in a proportion of NDMM patients, therapy with ICIs might even be deleterious by shortening the TTP. Our finding implies the significance of checkpoint level assessment in MM patients for predicting the clinical response rate to ICIs and for determining effective therapeutic strategies. Therefore, recently discovered and developed small-molecule inhibitors (SMIs) of checkpoint receptors provide an alternative and promising approach to the immunotherapy of cancers, and are of growing interest due to several desirable benefits they offer [58]. One of these benefits is the capability of SMIs to target more than one checkpoint protein, and the selectivity against other immune checkpoints and enzymes involved in the transcription of genes engaged in tumor suppression [58,59]. In consequence, SMIs reveal the potency for inducing a greater clinical response rate compared to conventional ICIs [58,59,60]. This pleiotropic activity of SMIs seems to be an attractive property for the area of MM immunotherapy aimed at breaking immune suppression, and appears to be of special interest, especially in view of our notion that PD-1 and CTLA-4 could be less accessible for ICIs in MM. Having ascertained that reversion of both the checkpoint levels and T cell reactivity observed in our cohort of RRMM patients might improve the clinical response to therapeutic inhibitors in terms of delayed relapse, the development of methods targeting the restoration of PD-1 expression in MM T cells, for example, SMIs modulating PD-1 gene transcription, seems to be desirable. In fact, epigenetic small-molecule modulators of PD-L1 and PD-L2 genes’ transcription have been shown to up-regulate the expression of these ligands, thus making them more amenable for effective inhibition of the PD-1/PD-L interaction when combined with a PD-1 blocking antibody in mice [61]. This is in accordance with reports showing that PD-L1 expression in cancers might predict a better response to ICIs and improve survival [62]. In cancer treatment, SMIs may act alone or in combination with approved therapies, namely chemo-, radio-, or immunotherapy, including monoclonal antibodies directed toward PD-1/PD-L1 or CTLA-4, such as nivolumab, pembrolizumab, atezolizumab, or ipilimumab (anti-CTLA-4 mAb) [63,64,65,66,67]. Several epigenetic SMIs have also recently been suggested as potent adjuvant agents for combined treatment in numerous types of advanced cancers [58]. Of these, entinostat, panobinostat, and azacitidine are currently in clinical trials in combined therapy with pembrolizumab or ipilimumab in immunogenic cancer patients [63,66,67]. Encouraging results in pre-clinical studies on PD-1-derived CA170 (a small molecule dually targeting PD-L1 and VISTA pathways) reporting high efficacy in the suppression of tumor growth at well-tolerated doses has prompted the advancement of CA170 to clinical trials [59].
In conclusion, the results of our study together with the impressive clinical response to the checkpoint blockade seen in patients with solid tumors, expressing regulatory receptors at a relevant level [16], strengthens the suggestion of a predictive role of checkpoint expression in this therapeutic approach in MM. Therefore, considering novel therapies and potent combinations, estimation of the immune checkpoint levels in T cells before the administration of inhibitors in the different clinical stages of MM is warranted for excluding patients with checkpoint suboptimal levels in order to avoid very limited effectiveness of the anti-myeloma response, early relapse, and/or severe aggravation of autoimmune adverse events.

4. Materials and Methods

4.1. Samples

The study group of patients studied consisted of a total of 40 active myeloma patients (26 newly diagnosed (NDMM) and 14 relapsed/refractory (RRMM)). Patients were recruited in two centers: the Department of Hematology and Bone Marrow Transplantation at Wroclaw Medical University and the Department of Hematological Oncology at the Provincial Hospital in Opole. The diagnosis of MM was based on the criteria set out by the International Myeloma Working Group (IMWG) [68]. The disease stage was determined according to the International Staging System (ISS) upon entry into the study [69]. RRMM patients were treated with chemotherapy, IMIDs, and a proteasome inhibitor; no patient enrolled in the study received prior treatment with stem cell transplantation (SCT) or ICIs.
The control population comprised 20 healthy individuals matched for age and sex; they had been without any treatment affecting the immune system for six months before entering the study. Patients with a simultaneous active or chronic infection, diabetes, autoimmune disease, or with a history of other malignancies or connective tissue diseases were excluded from the study. Blood samples from all participants were collected after informed consent in accordance with the Declaration of Helsinki and approval from the Institutional Local Research Bioethics Committee at Wroclaw Medical University.

4.2. Clinical and Laboratory Characteristics of Patients

The main characteristics of MM patients are summarized in Table S1. Of the 26 NDMM patients, the majority were women (n = 17, 65.4% vs. n = 9, 34.6%). The median age at diagnosis was 66.0 years old (range 50–76). According to the ISS, 5 patients (19.0%) were classified as stage I, 10 (38.5%) were classified as stage II, and 11 (42.5%) were classified as stage III. The immunoglobulin subtype was IgG for 18 patients (69.0%), and IgA for 3 patients (11.5%). Five patients (19.5%) had light chain only. Of the NDMM patients, the majority (n = 16, 61.5%) had light chain kappa, 9 patients (34.5%) had light chain lambda. A majority of the NDMM patients presented with osteolytic bone lesions (n = 15, 60.0%), had a serum β2-microglobulin level ≥ 3.5 mg/L (n = 18, 69.0%), and a hemoglobin value ≤ 12 g/dL (n = 23, 88.5%). A creatinine level ≥ 2.0 mg/dL and a serum calcium value ≥ 10 mg/dL were present in 9 (34.5%) NDMM patients. An LDH level higher than 190 U/L and a platelet value less than 100,000/mm3 was present in 6 (23.0%) and 2 (7.5%) patients, respectively.
Of the 14 RRMM patients, 10 were men (71.4%) and 4 were women (28.6%). The median age at diagnosis was 72.0 years old (range 65–75). According to the ISS, 1 patient (7.0%) was classified as stage I, 6 (43.0%) were classified as stage II, and 7 (50.0%) were classified as stage III. The immunoglobulin subtype was IgG for 9 patients (64.0%), and IgA for 3 patients (21.5%). Two patients had light chain only (14.5%). Seven RRMM patients had light chain kappa (50.0%) and 7 had light chain lambda. The majority of the RRMM patients (n = 13, 92.8%) presented with osteolytic bone lesions. Of the RRMM patients, a majority had a serum β2-microglobulin level ≥ 3.5 mg/L (n = 9, 64.0%), a serum calcium level ≥ 10 mg/dL (n = 11, 78.5%), and a hemoglobin value ≤ 12 g/dL (n = 8, 57.0%). Four RRMM patients (28.5%) had a creatinine level ≥ 2.0 mg/dL. An LDH level higher than 190 U/L and a platelet value less than 100,000/mm3 was present in 2 (14.0%) patients and 1 (7.0%) patient, respectively. Of the RRMM patients, 12 subjects (85.5%) received bortezomib (BTZ)-based therapy, and 11 patients (78.5%) were treated with IMiDs. The majority of RRMM patients (n = 8, 57.0%) received 1–3 therapy lines, while the remainder (n = 6, 43.0%) received ≥ 4 therapy lines.

4.3. Isolation of Peripheral Blood Mononuclear Cells (PBMCs)

Peripheral venous blood from MM patients and healthy individuals was collected in tubes containing lithium heparin as anticoagulant. Peripheral blood mononuclear cells (PBMCs) were isolated by buoyant density-gradient centrifugation on Lymphoflot (Bio-Rad Medical Diagnostics GmbH, Dreieich, Germany). After centrifugation, the PBMCs were washed three times in sterile phosphate-buffered saline (PBS) (without Ca2+ and Mg2+), and then suspended in 95% fetal calf serum (CytoGen GmbH, Sinn, Germany) containing 5% DMSO (Sigma-Aldrich, St. Gallen, Switzerland) and cryopreserved prior to use.

4.4. Determination of Immune Checkpoints (PD-1 and CTLA-4), CD28 and CD69 Expression

Multicolor flow cytometry was used to analyze the PBMCs of MM patients and healthy controls for the expression of PD-1 and CTLA-4 proteins in pooled CD4+ T cells as well as their subsets: Treg cells (CD4+CD127 cells) and Teff cells (CD4+CD127+ cells). The expression of CD28 and CD69 molecules was detected on gated CD4+ T cells. According to standard protocols, isolated PBMCs were stained with several combinations of fluorochrome-conjugated monoclonal primary antibodies (mAbs) purchased from Pharmingen (Pharmingen, BD Biosciences, San Diego, CA, USA): FITC anti-human CD3 (Catalog #555332), FITC anti-human CD127 (Catalog # 560549), PerCP anti-human CD4 (Catalog #566924), PE anti-human PD-1 (Catalog #560795), PE anti-human CTLA-4 (Catalog #555853), PE anti-human CD69 (Catalog #555531), and PE anti-human CD28 (Catalog #555729). Appropriate fluorochrome-labeled isotype control antibodies included from Pharmingen (Pharmingen, BD Biosciences, San Diego, CA, USA) were used to confirm expression specificity and for gate settings in each case (FITC mouse IgG1: Catalog #555748, PE mouse IgG1: Catalog #554680, PE mouse IgG2a: Catalog #555574, PE mouse IgG1: Catalog #555749). Briefly, refrozen PBMCs were washed twice in PBS, divided into tubes at a concentration of 5 × 105 cells per tube, and incubated with appropriate antibodies for 30 min at 4 °C in the dark. Excess unbound antibodies were removed by two washes with PBS. Following washing, the cells were fixed in PBS containing 1.5% paraformaldehyde (Catalog #P6148, Sigma-Aldrich, St. Gallen, Switzerland) and analyzed by flow cytometry. Finally, a total of 100,000 events per sample were acquired using a FACSCalibur flow cytometer (Becton-Dickinson, BD Biosciences, San Diego, CA, USA) equipped with Cell Quest software 3.3 (Becton-Dickinson, BD Biosciences, San Diego, CA, USA). Data were analyzed by Cell Quest software and the results were expressed as the proportions of CD3+CD4+ (CD4+ T cells) as well as CD4+CD127 (Treg) and CD4+CD127+ (Teff) cells co-expressing PD-1 or CTLA-4. The percentages of CD4+ T cells co-expressing CD69 and the frequencies of CD4+CD28 T cells were also examined. The gating strategy is presented in Figure S1 in supplementary materials. In order to demonstrate quantitative expression of immune checkpoints as well as CD69 protein at the single-cell levels, the results are shown as mean fluorescence intensity (MFI) values and expressed in arbitrary units (AU).

4.5. Statistical Analysis

Statistical analyses of the clinical data and laboratory findings were performed using the Statistica 7.1 package (TIBCO Software Inc., Palo Alto, CA, USA) and GraphPad Prism 8.01 (GraphPad Software, San Diego, CA, USA). Clinical parameters were presented as absolute numbers and percentages for frequencies. For all other analyzed variables, the median values and 25th and 75th interquartile ranges (IQ ranges) were calculated. As collected data were not normally distributed and/or had heterogeneous variances, differences between examined groups were evaluated using a one-way analysis of variance (ANOVA), with the Kruskal–Wallis or the Mann–Whitney U test as nonparametric alternatives. The Kaplan–Meier method was used to plot survival curves and the difference between curves was calculated by the log-rank test. A p value ≤ 0.05 was considered significant.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijms24065730/s1.

Author Contributions

Conceptualization and design of the study, A.K.d.N. and A.K.; methodology, A.K.d.N. and A.K.; data curation, A.K.d.N., L.U.-Z. and I.F.; cell culture, fluorescence staining, and cytometric analysis (investigation), L.C., E.P. and A.K.; analysis or interpretation of data, A.K.d.N., L.C., E.P., M.S. and A.K.; statistical analysis and validation, L.C. and E.P.; visualization, L.C. and M.S.; manuscript writing—original draft preparation, A.K.d.N. and A.K.; writing—review and editing, A.K.d.N., L.C., L.U.-Z., I.F., E.P., M.S. and A.K.; supervision, A.K.; funding acquisition, A.K. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by a grant from the Wroclaw Centre of Biotechnology, the Leading National Research Centre (KNOW) program for the years 2014–2018 (grant no. 132/2017/KNOW/IITD to A.K.).

Institutional Review Board Statement

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee (permission no. KB-528/2017 from Wroclaw Medical University) and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

All data generated or analyzed during this study are available on request from the corresponding author.

Acknowledgments

We are grateful to our patients and healthy subjects for their blood donations and agreement to participate in this study. We also acknowledge Aleksandra Szteblich for excellent technical assistance.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Favaloro, J.; Brown, R.; Aklilu, E.; Yang, S.; Suen, H.; Hart, D.; Fromm, P.; Gibson, J.; Khoo, L.; Ho, P.J.; et al. Myeloma skews regulatory and pro-inflammatory T helper 17 cell balance in favor of a suppressive state. Leuk. Lymphoma 2015, 55, 1090–1098. [Google Scholar] [CrossRef] [PubMed]
  2. Favaloro, J.; Liyadipitiya, T.; Brown, R.; Yang, S.; Suen, H.; Woodland, N.; Nassif, N.; Hart, D.; Fromm, P.; Weatherburn, C.; et al. Myeloid derived suppressor cells are numerically, functionally, and phenotypically different in patients with multiple myeloma. Leuk. Lymphoma 2014, 55, 2893–2900. [Google Scholar] [CrossRef]
  3. Brown, R.; Suen, H.; Favaloro, J.; Yang, S.; Ho, P.J.; Gibson, J.; Joshua, D. Trogocytosis generates acquired regulatory T cells adding further complexity to the dysfunctional immune response in multiple myeloma. Oncoimmunology 2012, 1, 1658–1660. [Google Scholar] [CrossRef] [Green Version]
  4. Brown, R.D.; Pope, B.; Murray, A.; Esdale, W.; Sze, D.M.; Gibson, J.; Ho, P.J.; Hart, D.; Joshua, D. Dendritic cells from patients with myeloma are numerically normal but functionally defective as they fail to up-regulate CD80 (B7-1) expression after huCD40LT stimulation because of inhibition by transforming growth factor-β1 and interleukin-10. Blood 2001, 98, 2992–2998. [Google Scholar] [CrossRef] [Green Version]
  5. Bryant, C.; Suen, H.; Brown, R.; Yang, S.; Favaloro, J.; Aklilu, E.; Gibson, J.; Ho, P.J.; Iland, H.; Fromm, P.; et al. Long-term survival in multiple myeloma is associated with a distinct immunological profile, which includes proliferative cytotoxic T cell clones and a favourable Treg/Th17 balance. Blood Cancer J. 2013, 3, e148. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Kulikowska de Nalecz, A.; Ciszak, L.; Usnarska-Zubkiewicz, L.; Frydecka, I.; Pawlak, E.; Szmyrka, M.; Kosmaczewska, A. Deregulated Expression of Immune Checkpoints on Circulating CD4 T Cells May Complicate Clinical Outcome and Response to Treatment with Checkpoint Inhibitors in Multiple Myeloma Patients. Int. J. Mol. Sci. 2021, 22, 9298. [Google Scholar] [CrossRef]
  7. Dosani, T.; Carlsten, M.; Maric, I.; Landgren, O. The cellular immune system in myelogenesis: NK and T cells in the development of myeloma and their uses in immunotherapies. Blood Cancer J. 2015, 5, e306. [Google Scholar] [CrossRef] [Green Version]
  8. Kawano, Y.; Zavidij, O.; Park, J.; Moschetta, M.; Kokubun, K.; Mouhieddine, T.H.; Manier, S.; Mishima, Y.; Murakami, N.; Bustoros, M.; et al. Blocking IFNAR1 inhibits multiple myeloma-driven Treg expansion and immunosuppression. J. Clin. Investig. 2018, 128, 2487–2499. [Google Scholar] [CrossRef] [PubMed]
  9. Doering, T.A.; Crawford, A.; Angelosanto, J.M.; Paley, M.A.; Ziegler, C.G.; Wherry, E.J. Network analysis reveals centrally connected genes and pathways involved in CD8+ T cell exhaustion versus memory. Immunity 2012, 37, 1130–1144. [Google Scholar] [CrossRef] [Green Version]
  10. Wherry, E.J.; Kurachi, M. Molecular and cellular insights into T cell exhaustion. Nat. Rev. Immunol. 2015, 15, 486–499. [Google Scholar] [CrossRef]
  11. Suen, H.; Brown, R.; Yang, S.; Ho, P.J.; Gibson, J.; Joshua, D. The failure of immune checkpoint blockade in multiple myeloma with PD-1 inhibitors in a phase I study. Leukemia 2015, 29, 1621–1622. [Google Scholar] [CrossRef] [PubMed]
  12. Zeller-Rieser, C.; Thangavadivel, S.; Biedermann, R.; Brunner, A.; Stoitzner, P.; Willenbacher, E.; Greil, R.; Jöhrer, K. T cells in multiple myeloma display features of exhaustion and senescence at the tumor site. J. Hematol. Oncol. 2016, 9, 116. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Pawelec, G. Is there a positive side to T cell exhaustion? Front. Immunol. 2019, 10, 111. [Google Scholar] [CrossRef] [Green Version]
  14. Reiser, J.; Banerjee, A. Effector, memory, and dysfunctional CD8+ T cell fates in the antitumor immune response. J. Immunol. Res. 2016, 2016, 8941260. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Akbar, A.; Henson, S. Are senescence and exhaustion intertwined or unrelated processes that compromise immunity? Nat. Rev. Immunol. 2011, 11, 289–295. [Google Scholar] [CrossRef]
  16. Webb, E.S.; Liu, P.; Baleerino, R.; Lemoine, N.R.; Yuan, M.; Wang, Y. Immune checkpoint inhibitors in cancer therapy. J. Biomed. Res. 2018, 32, 317–326. [Google Scholar]
  17. Mateos, M.V.; Blacklock, H.; Schjesvold, F.; Rocafiguera, A.O.; Simpson, D.; George, A.; Goldschmidt, H.; LaRocca, A.; Sherbenou, D.W.; Avivi, I.; et al. A phase 3 randomized study of pembrolizumab (Pembro) plus pomalidomide (Pom) and dexamethasone (Dex) for relapsed/refractory multiple myeloma (RRMM): Keynote-183. J. Clin. Oncol. 2018, 36, 8021. [Google Scholar] [CrossRef]
  18. Usmani, S.Z.; Schjesvold, F.; Rocafiguera, A.O.; Karlin, L.; Rifkin, R.M.; Yimer, H.A.; Leblanc, R.; Takezako, N.; McCroskey, R.D.; Suzuki, K.; et al. A phase 3 randomized study of pembrolizumab (pembro) plus lenalidomide (len) and low-dose dexamethasone (Rd) versus Rd for newly diagnosed and treatment-naïve multiple myeloma (MM): Keynote-185. J. Clin. Oncol. 2018, 36, 8010. [Google Scholar] [CrossRef]
  19. Bertamini, L.; Gay, F. Checkpoint inhibitors and myeloma: Promises, deadlocks and new directions. Ann. Transl. Med. 2020, 8, 777. [Google Scholar] [CrossRef]
  20. Alkharabsheh, O.; Trisel, Z.; Badami, S.; Aljama, M.A.; Sidiqi, M.H. Checkpoint inhibitors in multiple myeloma: Intriguing potential and unfulfilled promises. Cancers 2022, 14, 113. [Google Scholar] [CrossRef]
  21. Zhao, Y.; Shao, Q.; Peng, G. Exhaustion and senescence: Two crucial dysfunctional states of T cells in the tumor microenvironment. Cell. Mol. Immunol. 2020, 17, 27–35. [Google Scholar] [CrossRef] [PubMed]
  22. Lanna, A.; Henson, S.M.; Escors, D.; Akbar, A.N. The kinase p38 activated by the metabolic regulator AMPK and scaffold TAB1 drives the senescence of human T cells. Nat. Immunol. 2014, 15, 965–972. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Tamura, H. Immunopathogenesis and immunotherapy of multiple myeloma. Int. J. Hematol. 2018, 107, 278–285. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Suen, H.; Brown, R.; Yang, S.; Weatherburn, C.; Ho, P.J.; Woodland, N.; Nassif, N.; Barbaro, P.; Bryant, C.; Hart, D.; et al. Multiple myeloma causes clonal T cell immunosenescence: Identification of potential novel targets for promoting tumour immunity and implications for checkpoint blockade. Leukemia 2016, 30, 1716–1724. [Google Scholar] [CrossRef]
  25. Kasamatsu, T.; Awata, M.; Ishihara, R.; Murakami, Y.; Gotoh, N.; Matsumoto, M.; Sawamura, M.; Yokohama, A.; Handa, H.; Tsukamoto, N.; et al. PDCD1 and PDCD1LG1 polymorphisms affect the susceptibility to multiple myeloma. Clin. Exp. Med. 2020, 20, 51–62. [Google Scholar] [CrossRef]
  26. Karabon, L.; Pawlak-Adamska, E.A.; Tomkiewicz, A.; Jedynak, A.; Kielbinski, M.; Woszczyk, D.; Potoczek, S.; Jonkisz, A.; Kuliczkowski, K.; Frydecka, I. Variations in suppressor molecule CTLA-4 gene are related to susceptibility to multiple myeloma in a Polish population. Pathol. Oncol. Res. 2011, 18, 219–226. [Google Scholar] [CrossRef] [Green Version]
  27. Zheng, C.; Huang, D.; Liu, L.; Bjorkholm, M.; Holm, G.; Yi, Q.; Sundblad, A. Cytotoxic T-lymphocyte antigen-4 microsatellite polymorphism is associated with multiple myeloma. Br. J. Haematol. 2001, 112, 216–218. [Google Scholar] [CrossRef]
  28. Ciszak, L.; Frydecka, I.; Wolowiec, D.; Szteblich, A.; Kosmaczewska, A. Patients with chronic lymphocytic leukemia (CLL) differ in the pattern of CTLA-4 expression on CLL cells: The possible implications for immunotherapy with CTLA-4 blocking antibody. Tumor Biol. 2016, 37, 4143–4157. [Google Scholar] [CrossRef] [Green Version]
  29. Coppe, J.P.; Desprez, P.Y.; Krtolica, A.; Campisi, J. The senescence-associated secretory phenotype: The dark side of tumor suppression. Annu. Rev. Pathol. 2010, 5, 99–118. [Google Scholar] [CrossRef] [Green Version]
  30. Lanna, A.; Gomes, D.C.; Muller-Durovic, B.; McDonnell, T.; Escors, D.; Gilroy, D.W.; Lee, J.H.; Karin, M.; Akbar, A.N. A sestrin-dependent Erk-Jnk-p38 MAPK activation complex inhibits immunity during aging. Nat. Immunol. 2017, 18, 354–363. [Google Scholar] [CrossRef] [Green Version]
  31. Liu, X.; Mo, W.; Ye, J.; Li, L.; Zhang, Y.; Hsueh, E.C.; Hoft, D.F.; Peng, G. Regulatory T cells trigger effector T cell DNA damage and senescence caused by metabolic competition. Nat. Commun. 2018, 9, 249. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Paluch, C.; Santos, A.M.; Anzilotti, C.; Cornall, R.J.; Davis, S.J. Immune checkpoints as therapeutic targets in autoimmunity. Front. Immunol. 2018, 9, 2306. [Google Scholar] [CrossRef] [PubMed]
  33. Asano, T.; Meguri, Y.; Yoshioka, T.; Kishi, Y.; Iwamoto, M.; Nakamura, M.; Sando, Y.; Yagita, H.; Koreth, J.; Kim, H.T.; et al. PD-1 modulates regulatory T-cell homeostasis during low-dose interleukin-2 therapy. Blood 2017, 129, 2186–2197. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Francisco, L.M.; Salinas, V.H.; Brown, K.E.; Vanguri, V.K.; Freeman, G.J.; Kuchroo, V.K.; Sharpe, A.H. PD-L1 regulates the development, maintenance, and function of induced regulatory T cells. J. Exp. Med. 2009, 206, 3015–3029. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Stathopoulou, C.; Gangaplara, A.; Mallett, G.; Flomerfelt, F.A.; Liniany, L.P.; Knight, D.; Samsel, L.A.; Berlinguer-Palmini, R.; Yim, J.J.; Felizardo, T.C.; et al. PD-1 inhibitory receptor downregulates asparaginyl endopeptidase and maintains Foxp3 transcription factor stability in induced regulatory T cells. Immunity 2018, 49, 247–263.e7. [Google Scholar] [CrossRef] [Green Version]
  36. Thewissen, M.; Somers, V.; Hellings, N.; Fraussen, J.; Damoiseaux, J.; Stinissen, P. CD4+CD28null T cells in autoimmune disease: Pathogenic features and decreased susceptibility to immunoregulation. J. Immunol. 2007, 179, 6514–6523. [Google Scholar] [CrossRef] [Green Version]
  37. Kosmaczewska, A.; Ciszak, L.; Stosio, M.; Szteblich, A.; Madej, M.; Frydecka, I.; Wiland, P.; Szmyrka, M. CD4+CD28null T cells are expanded in moderately active systemic lupus erythematosus and secrete pro-inflammatory interferon gamma, depending on the Disease Activity Index. Lupus 2020, 29, 705–714. [Google Scholar] [CrossRef]
  38. Perez-Andres, M.; Almeida, J.; Martin-Ayuso, M.; Moro, M.J.; Martin-Nunez, G.; Galende, J.; Hernandez, J.; Mateo, G.; San Miguel, J.F.; Orfao, A. Characterization of bone marrow T cells in monoclonal gammopathy of undetermined significance, multiple myeloma, and plasma cell leukemia demonstrates increased infiltration by cytotoxic/Th1 T cells demonstrating a squed TCR-Vβ repertoire. Cancer 2006, 106, 1296–1305. [Google Scholar] [CrossRef]
  39. Lindqvist, E.K.; Landgren, O.; Lund, S.H.; Turesson, I.; Hultcrantz, M.; Goldin, L.; Björkholm, M.; Kristinsson, S.Y. History of autoimmune disease is associated with impaired survival in multiple myeloma and monoclonal gammopathy of undetermined significance: A population-based study. Ann. Hematol. 2017, 96, 261–269. [Google Scholar] [CrossRef] [Green Version]
  40. Shimanovsky, A.; Alvarez, A.J.; Murali, S.; Dasanu, C.A. Autoimmune manifestations in patients with multiple myeloma and monoclonal gammopathy of undetermined significance. BBA Clin. 2016, 6, 12–18. [Google Scholar] [CrossRef] [Green Version]
  41. Salik, B.; Smyth, M.J.; Nakamura, K. Targeting immune checkpoints in hematological malignancies. J. Hematol. Oncol. 2020, 13, 111. [Google Scholar] [CrossRef] [PubMed]
  42. Martinez-Calle, N.; Rodriguez-Otero, P.; Villar, S.; Mejias, L.; Melero, I.; Prosper, F.; Marinello, P.; Paiva, B.; Idoate-Gastearena, M.; Miguel, J.S. Anti-PD-1 associated fulminate myocarditis after a single pembrolizumab dose: The role of occult pre-existing autoimmunity. Haematologica 2018, 103, e318. [Google Scholar] [CrossRef] [PubMed]
  43. Kumar, S.K.; Rajmkumar, S.V.; Dispenzieri, A.; Lacy, M.Q.; Hayman, S.R.; Buadi, F.K.; Zeldenrust, S.R.; Dingli, D.; Russell, S.J.; Lust, J.A.; et al. Improved survival in multiple myeloma and the impact of novel therapies. Blood 2008, 111, 2516–2520. [Google Scholar] [CrossRef] [Green Version]
  44. Batorov, E.V.; Aristova, T.A.; Sergeevicheva, V.V.; Sizikova, S.A.; Ushakova, G.A.; Pronkin, N.V.; Shishkova, I.V.; Shevela, E.Y.; Ostanin, A.A.; Chernykh, E.R. Quantitative and functional characteristics of circulating and bone marrow PD-1- and TIM-3-positive T cells in treated multiple myeloma patients. Sci. Rep. 2020, 10, 20846. [Google Scholar] [CrossRef] [PubMed]
  45. Brown, R.; Yuen, E.; Nelson, M.; Gibson, J.; Joshua, D. The prognostic significance of T cell receptor beta gene rearrangements and idiotype-reactive T cells in multiple myeloma. Leukemia 1997, 11, 1312–1317. [Google Scholar] [CrossRef] [Green Version]
  46. Joshua, D.; Brown, R.; Sze, D.M.; Raitakari, M.; Gibson, J.; Ho, P.J.; Yang, S.; Yuen, E.; Murray, A. The role of T cells in myeloma. Hematol. J. 2003, 4, S26–S28. [Google Scholar]
  47. Li, Y.; Yang, L.J.; Chen, S.H.; Zhang, Y.P.; Zhang, X.L.; Luo, G.X. T cell receptor Vbeta repertoire usage and clonal expansion of T cells in chronic myelogenous leukemia. Chin. Med. J. 2004, 117, 840–843. [Google Scholar]
  48. Mustjoki, S.; Ekblom, M.; Arstila, T.P.; Dybedal, I.; Epling-Burnette, P.K.; Guilhot, F.; Hjorth-Hansen, H.; Hoglund, M.; Kovanen, P.; Laurinolli, T.; et al. Clonal expansion of T/NK-cells during tyrosine kinase inhibitor dasatinib therapy. Leukemia 2009, 23, 1398–1405. [Google Scholar] [CrossRef] [Green Version]
  49. Li, J.; Sze, D.M.-Y.; Brown, R.D.; Cowley, M.J.; Kaplan, W.; Mo, S.-L.; Yang, S.; Aklilu, E.; Kabani, K.; Loh, Y.S.; et al. Clonal expansions of cytotoxic T cells exist in the blood of patients with Waldenstrom macroglobulinemia but exhibit anergic properties and are eliminated by nucleoside analogue therapy. Blood 2010, 115, 3580–3588. [Google Scholar] [CrossRef] [Green Version]
  50. Epling-Burnette, P.; Painter, J.S.; Rollison, D.E.; Ku, E.; Vendron, D.; Widen, R.; Boulware, D.; Zou, J.X.; Bai, F.; List, A. Prevalence and clinical association of clonal T-cell expansion in Myelodysplastic Syndrome. Leukemia 2007, 21, 659–667. [Google Scholar] [CrossRef] [Green Version]
  51. Vries, A.D.; Langerak, A.W.; Verhaaf, B.; Niemeyer, C.M.; Stary, J.; Schmiegelow, K.; Van Wering, E.R.; Zwaan, C.M.; Beishuizen, A.; Pieters, R.; et al. T-cell receptor Vβ CDR3 oligoclonality frequently occurs in childhood refractory cytopenia (MDS-RC) and severe aplastic anemia. Leukemia 2008, 22, 1170–1174. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  52. Brown, R.; Spencer, A.; Ho, P.J.; Kennedy, N.; Kabani, K.; Yang, S.; Sze, D.M.; Aklilu, E.; Gibson, J.; Joshua, D.E. Prognostically significant cytotoxic T cell clones are stimulated after thalidomide therapy in patients with multiple myeloma. Leuk. Lymph. 2009, 50, 1860–1864. [Google Scholar] [CrossRef] [PubMed]
  53. Sze, D.M.-Y.; Giesajtis, G.; Brown, R.D.; Raitakari, M.; Gibson, J.; Ho, J.; Baxter, A.; Groth, B.F.D.S.; Basten, A.; Joshua, D.E. Clonal cytotoxic T cells are expanded in myeloma and reside in the CD8+CD57+CD28 compartment. Blood 2001, 98, 2817–2827. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  54. Alrasheed, N.; Lee, L.; Ghorani, E.; Henry, J.Y.; Conde, L.; Chin, M.; Galas-Filipowicz, D.; Furness, A.J.; Chavda, S.J.; Richards, H.; et al. Marrow infiltrating regulatory T cells correlate with the presence of dysfunctional CD4+PD-1+ cells and inferior survival in patients with newly diagnosed multiple myeloma. Clin. Cancer Res. 2020, 26, 3443–3454. [Google Scholar] [CrossRef] [Green Version]
  55. Tan, S.; Day, D.; Nicholls, S.J.; Segelov, E. Immune checkpoint inhibitor therapy in oncology: Current uses and future directions. J. Am. Coll. Cardiol. Cardio Onc. 2022, 4, 579–597. [Google Scholar]
  56. Koyama, S.; Akbay, E.A.; Li, Y.Y.; Herter-Sprie, G.S.; Buczkowski, K.A.; Richards, W.G.; Gandhi, L.; Redig, A.J.; Rodig, S.J.; Asahina, H.; et al. Adaptive resistance to therapeutic PD-1 blockade is associated with upregulation of alternative immune checkpoints. Nat. Commun. 2016, 7, 10501. [Google Scholar] [CrossRef] [Green Version]
  57. Gao, J.; Ward, J.F.; A Pettaway, C.; Shi, L.Z.; Subudhi, S.K.; Vence, L.M.; Zhao, H.; Chen, J.; Chen, H.; Efstathiou, E.; et al. VISTA is an inhibitory immune checkpoint that is increased after ipilimumab therapy in patients with prostate cancer. Nat. Med. 2017, 23, 551–555. [Google Scholar] [CrossRef] [Green Version]
  58. Smith, W.M.; Purvis, I.J.; Bomstad, C.N.; Labal, C.M.; Velpula, K.K.; Tsung, A.J.; Regan, J.N.; Venkataraman, S.; Vibhakar, R.; Asuthkar, S. Therapeutic targeting of immune checkpoints with small molecule inhibitors. Am. J. Transl. Res. 2019, 11, 529–541. [Google Scholar]
  59. Sasikumar, P.G.; Sudarshan, N.S.; Adurthi, S.; Ramachandra, R.K.; Samiulla, D.S.; Lakshminarasimhan, A.; Ramanathan, A.; Chandrasekhar, T.; Dhudashiya, A.A.; Talapati, S.R.; et al. PD-1 derived CA-170 is an oral immune checkpoint inhibitor that exhibits preclinical anti-tumor efficacy. Commun. Biol. 2021, 4, 699. [Google Scholar] [CrossRef]
  60. Guo, L.; Overholser, J.; Darby, H.; Ede, N.J.; Kaumaya, P.T.P. A newly discovered PD-L1 B-cell epitope peptide vaccine (PDL1-Vaxx) exhibits potent immune responses and effective anti-tumor immunity in multiple syngeneic mice models and (synergizes) in combination with a dual HER-2 B-cell vaccine (B-vaxx). Oncoimmunology 2022, 11, e2127691. [Google Scholar] [CrossRef]
  61. Woods, D.M.; Sodré, A.L.; Villagra, A.; Sarnaik, A.; Sotomayor, E.M.; Weber, J. HDAC inhibition upregulates PD-1 ligands in melanoma and augments immunotherapy with PD-1 blockade. Cancer Immunol. Res. 2015, 3, 1375–1385. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  62. Sabatier, R.; Finetti, P.; Mamessier, E.; Adelaide, j.; Chaffanet, m.; Ali, H.R.; Viens, P.; Caldas, C.; Birnbaum, D.; Bertucci, F. Prognostic and predictive value of PDL1 expression in breast cancer. Oncotarget 2015, 6, 5449–5464. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  63. Terranova-Barberio, M.; Thomas, S.; Munster, P.N. Epigenetic modifiers in immunotherapy: A focus on checkpoint inhibitors. Immunotherapy 2016, 8, 705–719. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  64. Frys, S.; Simons, Z.; Hu, Q.; Barth, M.J.; Gu, J.J.; Mavis, C.; Skitzki, J.; Song, L.; Czuczman, M.S.; Hernandez-Ilizaliturri, F.J. Entinostat, a novel histone deacetylase inhibitor is active in B-cell lymphoma and enhances the anti-tumour activity of rituximab and chemotherapy agents. Br. J. Haematol. 2015, 169, 506–519. [Google Scholar] [CrossRef] [Green Version]
  65. Orillion, A.; Hashimoto, A.; Damayanti, N.; Shen, L.; Adelayie-Ogala, R.; Arisa, S.; Chintala, S.; Ordentlich, P.; Kao, C.; Elzey, B.; et al. Entinostat neutralizes myeloid-derived suppressor cells and enhances the anti-tumor effect of PD-1 inhibition in murine models of lung and renal cell carcinoma. Clin. Cancer Res. 2017, 23, 5187–5201. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  66. Azad, N.S.; El-Khoueiry, A.; Yin, J.; Oberg, A.L.; Flynn, P.; Adkins, D.; Sharma, A.; Weisenberger, D.J.; Brown, T.; Medvari, P.; et al. Combination epigenetic therapy in metastatic colorectal cancer (mCRC) with subcutaneous 5-azacitidine and entinostat: A phase 2 consortium/stand up 2 cancer study. Oncotarget 2017, 8, 35326–35338. [Google Scholar] [CrossRef] [Green Version]
  67. Chiappinelli, K.B.; Zahnow, C.A.; Ahuja, N.; Baylin, S.B. Combining epigenetic and immunotherapy to combat cancer. Cancer Res. 2016, 76, 1683–1689. [Google Scholar] [CrossRef] [Green Version]
  68. Rajkumar, S.V.; Dimopoulos, M.A.; Palumbo, A.; Blade, J.; Merlini, G.; Mateos, M.V.; Kumar, S.; Hillengass, J.; Kastritis, E.; Richardson, P.; et al. International Myeloma Working Group updated criteria for the diagnosis of multiple myeloma. Lancet Oncol. 2014, 15, e538–e548. [Google Scholar] [CrossRef]
  69. Greipp, P.R.; San Miguel, J.; Durie, B.G.; Crowley, J.J.; Barlogie, B.; Bladé, J.; Boccadoro, M.; Child, J.A.; Avet-Loiseau, H.; Kyle, R.A.; et al. International staging system for multiple myeloma. J. Clin. Oncol. 2005, 23, 3412–3420. [Google Scholar] [CrossRef] [Green Version]
Figure 1. PD-1 expression on PB CD4 T cell subtypes of MM patients in the different clinical stages and healthy controls. (a) Frequency of PD-1-expressing CD4+ T cells (identified as CD3+CD4+), Treg (identified as CD4+CD127), and Teff (identified as CD4+CD127+) cells in healthy controls (HC) (n = 20) and patient subgroups (NDMM and RRMM) (n = 26 and n = 14, respectively). (b) PD-1 level (determined as mean fluorescence intensity) in CD4+ T cells, Treg, and Teff cells in HC (n = 20), NDMM (n = 26), and RRMM (n = 14) patients. Boxes and whiskers show 25th and 75th interquartile range and minimum–maximum, respectively; the median is the central line in each box. The differences between the studied groups were statistically evaluated using Kruskal–Wallis, ANOVA, and Mann–Whitney U tests. * p < 0.05, *** p < 0.001.
Figure 1. PD-1 expression on PB CD4 T cell subtypes of MM patients in the different clinical stages and healthy controls. (a) Frequency of PD-1-expressing CD4+ T cells (identified as CD3+CD4+), Treg (identified as CD4+CD127), and Teff (identified as CD4+CD127+) cells in healthy controls (HC) (n = 20) and patient subgroups (NDMM and RRMM) (n = 26 and n = 14, respectively). (b) PD-1 level (determined as mean fluorescence intensity) in CD4+ T cells, Treg, and Teff cells in HC (n = 20), NDMM (n = 26), and RRMM (n = 14) patients. Boxes and whiskers show 25th and 75th interquartile range and minimum–maximum, respectively; the median is the central line in each box. The differences between the studied groups were statistically evaluated using Kruskal–Wallis, ANOVA, and Mann–Whitney U tests. * p < 0.05, *** p < 0.001.
Ijms 24 05730 g001
Figure 2. CTLA-4 expression on PB CD4 T cell subtypes of MM patients in the different clinical stages and healthy controls. (a) Frequency of CTLA-4 expressing CD4+ T cells (identified as CD3+CD4+), Treg (identified as CD4+CD127), and Teff (identified as CD4+CD127+) cells in healthy controls (HC) (n = 20) and patient subgroups (NDMM and RRMM) (n = 26 and n = 14, respectively). (b) CTLA-4 level (determined as mean fluorescence intensity) in CD4+ T cells, Treg, and Teff cells in HC (n = 20), NDMM (n = 26), and RRMM (n = 14) patients. Boxes and whiskers show 25th and 75th interquartile range and minimum–maximum, respectively; the median is the central line in each box. The differences between the studied groups were statistically evaluated using Kruskal–Wallis, ANOVA, and Mann–Whitney U tests. * p < 0.05, ** p < 0.01, *** p < 0.001.
Figure 2. CTLA-4 expression on PB CD4 T cell subtypes of MM patients in the different clinical stages and healthy controls. (a) Frequency of CTLA-4 expressing CD4+ T cells (identified as CD3+CD4+), Treg (identified as CD4+CD127), and Teff (identified as CD4+CD127+) cells in healthy controls (HC) (n = 20) and patient subgroups (NDMM and RRMM) (n = 26 and n = 14, respectively). (b) CTLA-4 level (determined as mean fluorescence intensity) in CD4+ T cells, Treg, and Teff cells in HC (n = 20), NDMM (n = 26), and RRMM (n = 14) patients. Boxes and whiskers show 25th and 75th interquartile range and minimum–maximum, respectively; the median is the central line in each box. The differences between the studied groups were statistically evaluated using Kruskal–Wallis, ANOVA, and Mann–Whitney U tests. * p < 0.05, ** p < 0.01, *** p < 0.001.
Ijms 24 05730 g002
Figure 3. Influence of CTLA-4 expression on the time to progression (TTP). (a) TTP in patients with high and low CTLA-4 expression in CD4+ T cells (shown as CTLA-4 fluorescence intensity) identified as >median and ≤median values, respectively, in the whole patient cohort (MM) (n = 40) and patient subgroups (NDMM and RRMM) (n = 26 and n = 14, respectively). (b) TTP in patients with high and low CTLA-4 expression in Teff cells (shown as CTLA-4 fluorescence intensity) identified as >median and ≤median values, respectively, in the whole patient cohort (MM) (n = 40). The log-rank test was performed for the Kaplan–Meier curves.
Figure 3. Influence of CTLA-4 expression on the time to progression (TTP). (a) TTP in patients with high and low CTLA-4 expression in CD4+ T cells (shown as CTLA-4 fluorescence intensity) identified as >median and ≤median values, respectively, in the whole patient cohort (MM) (n = 40) and patient subgroups (NDMM and RRMM) (n = 26 and n = 14, respectively). (b) TTP in patients with high and low CTLA-4 expression in Teff cells (shown as CTLA-4 fluorescence intensity) identified as >median and ≤median values, respectively, in the whole patient cohort (MM) (n = 40). The log-rank test was performed for the Kaplan–Meier curves.
Ijms 24 05730 g003
Figure 4. Influence of PD-1 expression on the time to progression (TTP). (a) TTP in patients with high and low frequency of PD-1 positive CD4+ T cells identified as >median and ≤median values, respectively, in the whole patient cohort (MM) (n = 40) and patient subgroups (NDMM and RRMM) (n = 26 and n = 14, respectively). (b) TTP in patients with high and low PD-1 expression in Treg cells (shown as the frequency of PD-1+ Treg cells and as PD-1 fluorescence intensity in Treg), identified as >median and ≤median values, respectively, in the whole patient cohort (MM) (n = 40). (c) TTP in patients with high and low expression of PD-1 in Teff cells (shown as frequency of PD-1+ Teff and as PD-1 fluorescence intensity in Teff) identified as >median and ≤median values, respectively, in the whole patient cohort (MM) (n = 40). The log-rank test was performed for the Kaplan–Meier curves.
Figure 4. Influence of PD-1 expression on the time to progression (TTP). (a) TTP in patients with high and low frequency of PD-1 positive CD4+ T cells identified as >median and ≤median values, respectively, in the whole patient cohort (MM) (n = 40) and patient subgroups (NDMM and RRMM) (n = 26 and n = 14, respectively). (b) TTP in patients with high and low PD-1 expression in Treg cells (shown as the frequency of PD-1+ Treg cells and as PD-1 fluorescence intensity in Treg), identified as >median and ≤median values, respectively, in the whole patient cohort (MM) (n = 40). (c) TTP in patients with high and low expression of PD-1 in Teff cells (shown as frequency of PD-1+ Teff and as PD-1 fluorescence intensity in Teff) identified as >median and ≤median values, respectively, in the whole patient cohort (MM) (n = 40). The log-rank test was performed for the Kaplan–Meier curves.
Ijms 24 05730 g004
Figure 5. Markers of CD4 T cell reactivity. (a) Expression of the CD69 activation marker on CD4+ T cells in PB of healthy controls (HC) (n = 20) and patient subgroups (NDMM and RRMM) (n = 26 and n = 14, respectively). (b) Frequency of CD28 lacking CD4+ T cells at the different MM stages. Boxes and whiskers show 25th and 75th interquartile range and minimum–maximum, respectively; the median is the central line in each box. The differences between the studied groups were statistically evaluated using Kruskal–Wallis, ANOVA, and Mann–Whitney U tests. * p < 0.05, *** p < 0.001.
Figure 5. Markers of CD4 T cell reactivity. (a) Expression of the CD69 activation marker on CD4+ T cells in PB of healthy controls (HC) (n = 20) and patient subgroups (NDMM and RRMM) (n = 26 and n = 14, respectively). (b) Frequency of CD28 lacking CD4+ T cells at the different MM stages. Boxes and whiskers show 25th and 75th interquartile range and minimum–maximum, respectively; the median is the central line in each box. The differences between the studied groups were statistically evaluated using Kruskal–Wallis, ANOVA, and Mann–Whitney U tests. * p < 0.05, *** p < 0.001.
Ijms 24 05730 g005
Figure 6. Predictive significance of the clinico-pathological characteristics of MM patients. (a) Levels of β2-microblobulin, (b) anemia, and (c) percentages of circulating plasmacytes (PLCs) affect the time to progression (TTP) of MM patients (n = 40). The log-rank test was performed for the Kaplan–Meier curves.
Figure 6. Predictive significance of the clinico-pathological characteristics of MM patients. (a) Levels of β2-microblobulin, (b) anemia, and (c) percentages of circulating plasmacytes (PLCs) affect the time to progression (TTP) of MM patients (n = 40). The log-rank test was performed for the Kaplan–Meier curves.
Ijms 24 05730 g006
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Kulikowska de Nałęcz, A.; Ciszak, L.; Usnarska-Zubkiewicz, L.; Pawlak, E.; Frydecka, I.; Szmyrka, M.; Kosmaczewska, A. Inappropriate Expression of PD-1 and CTLA-4 Checkpoints in Myeloma Patients Is More Pronounced at Diagnosis: Implications for Time to Progression and Response to Therapeutic Checkpoint Inhibitors. Int. J. Mol. Sci. 2023, 24, 5730. https://doi.org/10.3390/ijms24065730

AMA Style

Kulikowska de Nałęcz A, Ciszak L, Usnarska-Zubkiewicz L, Pawlak E, Frydecka I, Szmyrka M, Kosmaczewska A. Inappropriate Expression of PD-1 and CTLA-4 Checkpoints in Myeloma Patients Is More Pronounced at Diagnosis: Implications for Time to Progression and Response to Therapeutic Checkpoint Inhibitors. International Journal of Molecular Sciences. 2023; 24(6):5730. https://doi.org/10.3390/ijms24065730

Chicago/Turabian Style

Kulikowska de Nałęcz, Anna, Lidia Ciszak, Lidia Usnarska-Zubkiewicz, Edyta Pawlak, Irena Frydecka, Magdalena Szmyrka, and Agata Kosmaczewska. 2023. "Inappropriate Expression of PD-1 and CTLA-4 Checkpoints in Myeloma Patients Is More Pronounced at Diagnosis: Implications for Time to Progression and Response to Therapeutic Checkpoint Inhibitors" International Journal of Molecular Sciences 24, no. 6: 5730. https://doi.org/10.3390/ijms24065730

APA Style

Kulikowska de Nałęcz, A., Ciszak, L., Usnarska-Zubkiewicz, L., Pawlak, E., Frydecka, I., Szmyrka, M., & Kosmaczewska, A. (2023). Inappropriate Expression of PD-1 and CTLA-4 Checkpoints in Myeloma Patients Is More Pronounced at Diagnosis: Implications for Time to Progression and Response to Therapeutic Checkpoint Inhibitors. International Journal of Molecular Sciences, 24(6), 5730. https://doi.org/10.3390/ijms24065730

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop