1. Introduction
The fact that approximately 40% of malignant pleural effusions do not yield positive cytology results during pleural puncture highlights the need for a panel of diagnostic methods to complement the available biochemical and cytological examinations [
1]. A novel concept in the treatment of pleural effusions is the possibility to analyze pleural fluid for the presence of tumor markers [
2].
Since pleural fluid is a filtrate of blood serum, its composition should reflect that of circulating blood [
3]. Therefore, elevated levels of tumor markers in the circulation would also be expected to increase in the pleural fluid. Another theory suggests that pleural carcinomatosis leads to elevated tumor markers in pleural fluid, where they enter directly from metastases on the pleural lining [
4]. Additionally, due to the impaired drainage of pleural fluid resulting from tumor invasion, the clearance of tumor markers is impaired, leading to elevated levels [
5]. Potential possibilities for further development include creating an optimal panel of tumor markers based on the most common types of metastatic diseases affecting the pleura, which should be considered in conjunction with an extensive biochemical and cytological analysis of the pleural fluid. This approach will provide the most relevant data to help unravel the complexities of metastatic pleural effusions [
6].
The assessment of tumor markers is a moderately expensive method that can become more cost-effective with a targeted search. The most studied tumor marker to date is carcinoembryonic antigen (CEA), which demonstrates a diagnostic sensitivity of 50–60%. An intriguing study conducted by Miedouge [
7] demonstrated that the following tumor markers exhibit the corresponding percentages of diagnostic sensitivity:
CEA: 60.0%;
CA15-3: 63.7%;
CYFRA: 42.8%;
CA-19-9: 20.9%;
CA72-4: 68.4%;
SCC: 5.6%;
NSE: 18.1%.
Some markers show a high sensitivity for certain diseases compared to others. Miedouge and his colleagues found that the panel of CEA, CA15-3, CYFRA, and NSE showed the most promising results, identifying 83.9% of cytologically negative non-lymphomatous malignant pleural effusions. The ability of tumor markers to predict the underlying histological type of neoplasia was examined using descriptive analysis. NSE, SCC, and CYFRA were shown to be the most reliable for differentiating adenocarcinomas, small cell lung carcinoma, squamous cell carcinoma, and mesothelioma. Their predictive accuracy reached 89.4% across all cases, with the highest accuracy observed for adenocarcinoma. However, identifying the different possible locations of adenocarcinoma proved challenging, as only 64.8% of adenocarcinomas were accurately grouped.
Despite their benefits, tumor markers demonstrate low diagnostic specificity when it comes to their quantitative assessment in pleural fluid [
8]. For malignant pleural effusions, the listed tumor markers exhibit similar diagnostic capabilities. The sensitivity of pleural CEA, according to Miedouge’s findings, aligns with results from known studies in the literature, confirming its significance in diagnosing carcinomas. CA72-4 has confirmed its relevance in detecting metastatic adenocarcinoma and squamous cell carcinoma. CA15-3 is expressed in pleural fluid in cases of carcinomatosis resulting from invasive ductal adenocarcinoma of the breast and adenocarcinomas of other origins. CYFRA shows good predictive results in diagnosing pleural mesothelioma. Importantly, pleural fluid serves as a suitable medium for analyzing tumor markers released by cancer cells. In several patients, their levels were found to be significantly elevated, even exceeding concentrations in serum.
Numerous studies have established the use of discriminant statistical analysis and logistic regression analysis to highlight the advantages of the quantitative assessment of tumor markers in pleural fluid. Serum concentrations of CYFRA 21-1 and NSE, as well as pleural NSE, have been shown to be adequate predictors of pleural malignancy. Their combined application has established statistical significance [
9]. According to a notable study conducted by Volaric and his colleagues involving a sample of 73 men and 27 women, the average age of the patients was 71 years, with 88 diagnosed with unilateral pleural effusion. Based on Light’s criteria, a pleural exudate was diagnosed in 71% of cases, while the remaining met the criteria for transudate.
The gender distribution revealed that 39 men and 16 women were in the malignant group, while 34 men and 11 women were in the non-malignant group of pleural effusions. The analysis showed that the concentrations of tumor markers CEA, NSE, CA-125, and CYFRA 21-1 were significantly elevated in malignant pleural effusions.
Many of the studies available in the literature, investigating the diagnostic significance of tumor markers in pleural fluid, employ the capabilities of retrospective analysis and have been conducted in standalone hospital centers without a validated cohort group. This is why Zhai and his collaborators [
10] conducted the first derivative and validation study in China, examining the diagnostic efficacy of CEA, CA125, CA15-3, and CA19-9. Their results further reinforce the notion that tumor markers are useful for differentiating benign from malignant pleural effusions, showing dramatically elevated levels in the latter group. Among the examined markers, CEA demonstrated the highest diagnostic accuracy, consistent with existing information. It showed an 84.7% sensitivity and a 90.9% specificity at a laboratory threshold of 2.42 ng/mL. Its elevated levels are associated with direct pleural infiltration. CA15-3 was reported to have a diagnostic specificity of 97.6% but a dramatically low sensitivity of 63.1%. Therefore, the standalone use of this tumor marker is not recommended. The results regarding CA125 and CA19-9 were contradictory. For example, CA125 had a laboratory threshold ranging from 558.7 to 383.9 U/mL, while CA19-9 ranged from 9.3 to 11.1 U/mL. These discrepancies were attributed to tumor heterogeneity and varying stages of metastatic disease. This leads to the conclusion that perhaps these two markers are not the most suitable for investigating malignant pleural effusions.
To confirm a diagnosis of malignant pleural effusion, we should use the tumor marker with the highest sensitivity, while, to rule out malignancy, the tumor marker should have a proven high specificity [
11,
12,
13,
14,
15,
16]. A given marker may excel at confirming a diagnosis but not at excluding it, or vice versa. To further enhance the diagnostic sensitivity and specificity, many authors recommend the combined examination of tumor markers in pleural fluid and serum, as well as calculating their pleural gradient [
17,
18,
19,
20,
21,
22].
The conflicting opinions regarding the use of tumor markers for diagnosing malignant pleural effusions unanimously agree on one point: the quantitative determination of tumor markers in pleural fluid could be indicated for patients with an undetermined cause of hydrothorax, in the presence of a high clinical suspicion of malignancy despite inconclusive cytological analysis, but with a known oncological history [
23,
24,
25].
2. Materials and Methods
In order to achieve the set objectives, a cross-sectional, observational case-control study was conducted on a Bulgarian population of patients with hydrothorax.
A total of 151 patients participated in the analysis. In the control group of 72 patients, a benign disease was diagnosed and confirmed through subsequent biopsy. Of these, 38 cases were identified as inflammatory, while 34 were verified as pleural effusions of non-inflammatory origin. Malignant pleural involvement was confirmed in 79 patients. These two groups are representative of the main types of pleural pathology.
Pleural fluid was obtained using a closed container for biological material. The biological material was collected during thoracentesis or intraoperatively during VATS. A portion of the collected pleural fluid was used to determine biochemical parameters, while the remaining fluid was set aside for the analysis of tumor markers and cytological examination. All of the analyses were performed using the clinico-chemical analyzer “Beckman Coulter”, model AU480, according to the original programs.
The choice of statistical methods was made according to the objectives of the study, the type of variables, and the established practices in the scientific research in the field of thoracic surgery. The systematization, processing, and analysis of the primary data in the form of quantitative and qualitative variables were carried out using the statistical software package IBM SPSS Statistics 27.0.1. The analysis and conclusions from the study were drawn after a summarized presentation of the empirical results in tabular form and were illustrated with the corresponding graphs. The graphical analysis was performed using MS Office 365. To objectify the results of the analyses conducted, the following statistical-mathematical methods were used:
Mann–Whitney Wilcoxon Test: A non-parametric statistical analysis used to compare two independent groups. Its purpose is to determine whether the distribution of the two populations differs significantly from each other.
Kolmogorov–Smirnov’s One-Sample Test: A non-parametric test used to check whether a given sample follows a specific distribution. It compares the empirical distribution of data with the theoretical distribution.
Independent Samples t-test: A parametric test used to compare the means of two independent groups.
Levene’s Test for Equality of Variances: A statistical test used to check for equality of variances among two or more groups.
Correlation Analysis: A statistical method used to assess the relationship between two or more variables. It helps to understand whether changes in one independent variable are associated with changes in another dependent variable. It does not establish a causal relationship but measures the degree of association between the variables.
Receiver Operating Characteristic (ROC) Curve: A graphical method used to evaluate the performance of binary classifiers. It demonstrates the behavior of the classifier at different threshold values for decision making.
Youden Index: A statistical measure used to evaluate diagnostic tests. It combines sensitivity and specificity, allowing for a comprehensive assessment of the test’s performance in distinguishing between positive and negative cases.
To reject the null hypothesis, we looked for values of p ≤ 0.05 in all of the analyses. When it was rejected and p ≤ 0.05, the alternative hypothesis (H1) could be accepted, which means that there was a statistically significant difference or relationship.
3. Results
To demonstrate the significance of the examined tumor markers in pleural effusions, we used the previously mentioned methods to assess the normal distribution of the data. Applying the Kolmogorov–Smirnov test, we observed that all of the variables did not follow a normal distribution. The greatest deviation in the distribution was observed for CA19-9 (
p = 0.453) and PIVKA (
p = 0.447). The results of the analysis are presented in
Table 1.
When we applied the Independent Samples
t-test, which checked for the differences in the mean values between the two groups, and Levene’s test, which examined whether the two groups demonstrated equality of variances, we obtained the results shown in
Table 2.
Of all the variables, only the values of PIVKA did not show a difference between the malignant and non-malignant groups. All of the other variables had a significant differences in mean values, with CAE and CA19-9 showing the most pronounced differences.
When we applied the Mann–Whitney U test and Wilcoxon W test, which again assessed the significance of the examined parameters, we saw that all of the tumor markers, except for PIVKA, demonstrated a statistically significant difference between the two groups, with
p < 0.005. Therefore, these markers can be associated with the malignant nature of the effusion. The results are presented in
Table 3.
Looking for the interrelationships among the examined tumor markers, we analyzed the correlation dependencies between them. The results of the correlation analysis are presented in
Table 4, with the corresponding correlations marked for ease of reference.
To analyze the relationship between the sensitivity and specificity of tumor markers, and to derive example cut-off values, we decided to use the Receiver Operating Characteristic (ROC) curve for each of them.
The curve consists of two axes. The X-axis illustrates the specificity (false-positive rate) and shows the proportion of false-positive cases. The Y-axis represents the sensitivity (true-positive rate) and indicates the proportion of correctly classified positive cases relative to the total number of patients. The green diagonal represents the line of random guessing, where the model has no predictive power (
p = 0.5). In the exhibited table, the blue curve significantly exceeds the green one, confirming the hypothesis that the model has good classification abilities. The presented
Table 5 is a visual analysis of the data obtained in
Figure 1. It shows the results of the analysis of the Area Under the Curve (AUC) for the CEA marker. It is notable that the model demonstrates good discriminative ability (0.746) in classifying the two groups. This value indicates that this tumor marker has a 74.6% probability of correctly classifying a pleural effusion as malignant. Additionally, the small value of the standard error and the significant
p-value confirm that the results are statistically significant.
We conducted an identical analysis for each of the examined tumor markers. The ROC curves are illustrated in
Figure 2. The obtained results are presented in
Table 6.
Based on the obtained AUC values, it is possible to predict the discriminative ability of each of the examined tumor markers. Thus, their ability to distinguish between malignant and non-malignant pleural effusions can be classified into the following four groups: very good (CA72-4), good (CA125; CA15-3), moderate (CA19-9), and weak (PIVKA). As can be seen, CA72-4 shows the best discriminative ability between the two groups, while PIVKA is classified as a statistically insignificant biomarker.
To differentiate positive from negative results in a diagnostic test, it is necessary to derive a cut-off value for the examined parameter. A cut-off or threshold value is a value that effectively separates the positive from the negative results.
Using the obtained ROC curves, we can identify the values at which the sensitivity and specificity are optimally balanced. For this purpose, we used the Youden index, which is calculated using the following formula:
Thus, for example, we obtained the following values presented in
Table 7, which offer the best compromise between specificity and sensitivity.
According to our study, the tumor markers demonstrate the following performance characteristics:
CEA with a cut-off of 1.8 shows a sensitivity of 70.9% and a specificity of 70.8%;
CA19-9 with a cut-off of 3.75 shows a sensitivity of 48.1% and a specificity of 81.9%;
CA72-4 with a cut-off of 4.52 shows a sensitivity of 70.9% and a specificity of 87.5%;
CA125 with a cut-off of 544.43 shows a sensitivity of 75.9% and a specificity of 62.5%;
CA15-3 with a cut-off of 9.65 shows a sensitivity of 68.4% and a specificity of 80.6%.
4. Discussion
The non-invasive nature of tumor marker analysis in pleural fluid offers a less burdensome alternative to more invasive procedures, particularly for frail patients or those with advanced disease. This aligns with modern approaches aimed at improving patient comfort while maintaining diagnostic rigor. The initial subtype classification of pleural effusion as transudative or exudative, using the traditional criteria proposed by Light, is relatively accurate, providing a correct diagnosis in nearly 100 percent of exudative pleural effusions [
26]. However, a portion of transudative pleural effusions is incorrectly classified as exudative according to these criteria. This leads to a series of unnecessary investigations that could be avoided.
The significance of tumor markers for malignant pleural diseases lies in their ability to rule out or confirm the presence of malignancy. There is certainly no shortage of studies examining the diagnostic capabilities of tumor markers, but none present definitive results [
27]. We can be certain that markers like CEA, CA15-3, and CYFRA 21-1 are elevated in malignant pleural effusions [
28]. To demonstrate this, we applied the Mann–Whitney U test, which showed that all of the tumor markers we examined, except for PIVKA, are statistically significant between the two groups of patients.
There are few studies investigating the role of tumor markers in identifying malignant pleural effusions. In a study conducted by Porcel [
29], 1575 patients with non-purulent pleural effusions were observed. Among them, 549 had confirmed pleural carcinomatosis, 284 had highly suspicious pleural carcinomatosis, but it was not proven, and 742 had benign pleural effusions. Elevated levels of the tumor markers CEA and CA15-3 were found in the pleural fluid in the malignant group. A proposed cut-off value for CEA was >45 ng/mL, which was exceeded in 30% of cases. The cut-off value for CA15-3 was >77 UI/L, which was exceeded in 19% of patients. Both tumor markers were elevated in 41% of the patients. When applying the ROC analysis, an Area Under the Curve (AUC) of 0.819 (95% CI: 0.793–0.845) was obtained for CEA, and 0.822 (95% CI: 0.796–0.847) for CA15-3. Additionally, it was shown that the combination of tumor markers and the cytopathological examination of pleural fluid diagnosed malignant pleural effusions in 14% more cases.
Similar results were demonstrated by Khalaf in his study [
30], where he examined the values of CEA, CA15-3, CYFRA21-1, CA19-9, and CA125 in 281 patients with malignant and benign pleural effusions. It was established that all of the tumor markers were significantly elevated in the malignant group. The Areas Under the Curve yielded the following results: CEA (0.81), CA15-3 (0.78), CYFRA21-1 (0.75), CA19-9 (0.65), and CA125 (0.65). The best results regarding the sensitivity were obtained with the combined use of CEA and CA-15-3 (94%). Similar observations were noted by Antonangelo [
26].
Other studies validating the role of tumor markers in the diagnostic panel for malignant pleural effusions include the A Study Investigating Markers in Pleural Effusion (SIMPLE) [
5], which is a prospective, double-blind study with a significant patient sample lasting 3 years, and the Diagnostic and Prognostic Biomarkers in the Rational Assessment of Mesothelioma (DIAPHRAGM) [
31].
In his work, Trape examined 402 patients, 122 of whom had malignant pleural effusions. Threshold values for each tumor marker were derived with a combined sensitivity of 63.9%. The proposed values were 60 μg/L for CEA, 80 KU/L for CA15-3, 209 KU/L for CA19-9, and 21 KU/L for CA72-4. Other studies proposed varying values of 40 to 50 μg/L for CEA, 53 to 75 KU/L for CA15-3, and 8.9 to 16 KU/L for CA72-4 [
32,
33].
According to our analyses, the tumor marker CEA shows very good performance, with an AUC = 0.746. Furthermore, it is statistically significant between the malignant and benign groups, as p < 0.001. Its confidence interval is also relatively narrow, making it reliable for differentiating between our two groups.
The tumor marker CA19-9 shows a moderate diagnostic accuracy, with an AUC = 0.644. Additionally, since p = 0.002, it can be said that the marker is reliable, and the results are statistically significant.
Based on the sample, CA72-4 shows a high diagnostic accuracy, with an AUC = 0.845, making it an excellent indicator of malignancy. This marker demonstrates the best result of all examined, and is statistically significant with
p < 0.001. Some authors even proposed this marker as a leading method for differentiating malignant from benign pleural effusions [
34].
Regarding the results for CA15-3, we can say that it has a good diagnostic accuracy, with an AUC = 0.773, and the results are statistically significant, with p < 0.001.
Only PIVKA demonstrates a low diagnostic value, with an AUC = 0.571, indicating that this tumor marker is a weak indicator for differentiating malignant from benign pleural effusions. Furthermore, the results are not statistically significant, as p = 0.132.
The study of tumor markers in pleural fluid may offer significant advantages in terms of cost and method efficiency. Although these markers show a high specificity, their relatively low sensitivity limits their application. Nevertheless, the combined use of tumor markers and traditional diagnostic methods, such as Light’s criteria and cytological analysis, could be incorporated into new diagnostic algorithms. These would leverage the strengths of individual tests to provide comprehensive, evidence-based pathways for managing pleural effusions. There is disagreement regarding which values should be accepted as thresholds when examining tumor markers in pleural fluid. In a study by Zhang, a sample of 619 individuals diagnosed with pleural effusions over two years was observed. Among them, 274 patients had lung cancer, and 74 were diagnosed with benign pleural effusions. A sensitivity of 89.8% and specificity of 98.6% for CEA (AUC of 0.978) was found at a threshold value of 5.23 ng/mL. According to data from the study, CYFRA 21-1 demonstrated a sensitivity of 67.9% with a specificity of 90.5% (AUC of 0.853) at a threshold value of 31.39 ng/mL.
According to another study, elevated levels of CA125, CEA, CA15-4, CA19-9, CYFRA21-1, and NSE were found, indicating that the greatest diagnostic value lies with CEA at a threshold value of 3.7 ng/mL (AUC [0.890 (0.871–0.907)]). This is further strengthened when CEA levels are examined in conjunction with CYFRA21-1 levels, as the sensitivity of the combined examination reaches 79.9%, and the specificity is 95.7%.
Other studies recommend the combined examination of CEA and CA15-3, as well as CEA and CA19-9, proving that the levels of these tumor markers are significantly elevated in malignant pleural effusions, but remain with a low sensitivity [
35].
Feng [
36] conducted a study comparing 81 pleural effusions associated with lung adenocarcinoma and 96 benign pleural effusions. The levels of CEA, CYFRA21-1, and CA19-9 were examined. According to the analyses, the optimal threshold values were determined as 0.93, 0.85, and 0.81, respectively. The combined examination of these three markers increased the sensitivity to 95.06%, with an AUC = 0.95.
The importance of the combined examination of tumor markers in pleural fluid is also evident in Yang’s analysis. A series of bibliographic databases were reviewed, and among 20 studies investigating the levels of tumor markers in pleural fluid, the following sensitivity/specificity values were derived: CEA + CA 125, 0.65/0.98; CEA + CA 15-3, 0.64/0.98; CEA + CA 19-9, 0.58/0.98; CEA + CYFRA 21-1, 0.82/0.92; CA 15-3 + CYFRA 21-1, 0.88/0.94. In conclusion, it is suggested that, for unexplained pleural effusions, the combined examination of CA15-3, CEA, and CA19-9 is recommended.
According to the analyses we conducted, we can calculate the sensitivity and specificity of the thresholds we derived as follows: CEA (75.9%/55.6%), CA19-9 (48.1%/18.1%), CA72-4 (70.9%/12.5%), CA125 (75.9%/37.5%), and CA15-3 (68.4%/80.6%).
Sensitivity measures the ability of the test to detect disease when it is present. It represents the percentage of people who have malignant pleural effusion and whose positivity for the tumor marker will correctly diagnose the condition. Specificity measures the test’s ability to identify patients who do not have malignant pleural effusions. It measures the percentage of people without carcinomatosis who are correctly classified as benign.
The results we obtained largely reflect global data. Of course, the thresholds derived are not definitive and can only guide us in extreme deviations beyond the reference parameters. Current guidelines for the management of pleural effusions emphasize cytological and biochemical analyses as first-line diagnostic tools [
37]. However, the demonstrated diagnostic value of markers such as CEA, CA15-3, and CA72-4 calls for their inclusion as supplementary tools, particularly in cases with a high clinical suspicion of malignancy but non-diagnostic initial results. The results of this study could contribute to the development of updated clinical recommendations, including thresholds and decision trees incorporating tumor marker analysis.
Despite these advantages, the relatively low sensitivity of individual markers highlights the importance of combining them for enhanced diagnostic accuracy. Further research is needed to validate these findings across diverse populations and healthcare settings. Additionally, the standardization of laboratory thresholds and techniques will be essential to facilitate broader clinical adoption.