Next Article in Journal
Real-World Immunogenicity and Reactogenicity of Two Doses of Pfizer-BioNTech COVID-19 Vaccination in Children Aged 5–11 Years
Next Article in Special Issue
Resistance towards ChadOx1 nCoV-19 in an 83 Years Old Woman Experiencing Vaccine Induced Thrombosis with Thrombocytopenia Syndrome
Previous Article in Journal
Protecting the Offspring, the Gift of Maternal Immunization: Current Status and Future Perspectives
Previous Article in Special Issue
Longitudinal Analyses after COVID-19 Recovery or Prolonged Infection Reveal Unique Immunological Signatures after Repeated Vaccinations
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Vaccines
Volume 10
Issue 11
10.3390/vaccines10111952
vaccines-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Communication

Determining the SARS-CoV-2 Anti-Spike Cutoff Level Denoting Neutralizing Activity Using Two Commercial Kits

by
Engy Mohamed El-Ghitany
1,*,
Mona H. Hashish
2,
Azza Galal Farghaly
1 and
Eman A. Omran
2
1
Department of Tropical Health, High Institute of Public Health, Alexandria University, Alexandria 21526, Egypt
2
Department of Microbiology, High Institute of Public Health, Alexandria University, Alexandria 21526, Egypt
*
Author to whom correspondence should be addressed.
Vaccines 2022, 10(11), 1952; https://doi.org/10.3390/vaccines10111952
Submission received: 24 August 2022 / Revised: 7 November 2022 / Accepted: 14 November 2022 / Published: 18 November 2022
(This article belongs to the Special Issue Unraveling SARS-CoV-2 Pathogenesis: Development of Vaccines and Therapeutics for COVID-19: Version II)
Browse Figures
Versions Notes

Abstract

:
Background: The viral neutralization assay is the gold standard to estimate the level of immunity against SARS-CoV-2. This study analyzes the correlation between the quantitative Anti-SARS-CoV-2 QuantiVac ELISA (IgG) and the NeutraLISA neutralization assay. Methods: 650 serum samples were tested for both SARS-CoV-2 anti-spike (anti-S) immunoglobulin G (IgG) and neutralizing antibodies (nAbs) using kits by EUROIMMUN, Germany. Results: There was a significant correlation between levels of anti-S and nAbs (Spearman’s rho = 0.913). Among the positive samples for anti-S, 77.0% (n = 345) were positive for nAbs. There was a substantial agreement between anti-S and nAbs (Cohen’s kappa coefficient = 0.658; agreement of 83.38%). Considering NeutraLISA as a gold standard, anti-S had a sensitivity of 98.57%, specificity of 65.66%, NPV of 97.5%, and PPV of 77.0%. When the anti-S titer was greater than 18.1 RU/mL (57.9 BAU/mL), nAbs were positive, with a sensitivity of 90.0% and specificity of 91%. Conclusions: A titer of SARS-CoV-2 anti-S IgG can be correlated with levels of nAbs.

1. Introduction

The SARS-CoV-2 genome encodes the spike (S), nucleocapsid, membrane, and envelope structural proteins. The S protein plays a key role in viral infection and pathogenesis. It comprises subunits S1 and S2: S1 harbors the N-terminal domain (NTD) and the receptor-binding domain (RBD) [1]. The RBD on the viral spike interacts with the angiotensin-converting enzyme 2 (ACE2) on host cells required for cell entry [2].
The neutralizing ability of antibodies targeting the S1/RBD has been reported by several studies. Neutralization is attributed to the ability of antibodies to block the S1/RBD binding to the ACE2 receptors in the respiratory tract [2]. Neutralizing antibodies (nAbs) primarily prevent viral infection by blocking the early step of infection, viral entry, and especially by interfering with virions binding to their receptor. Neutralizing antibodies can be estimated using in vitro neutralization tests, and their presence is often correlated with protective immunity [3].
In the era of COVID-19, it is important to characterize the nature of SARS-CoV2 antibodies in terms of their binding (mere mechanical blocking) and neutralizing ability (functional neutralization of virions). This characterization is necessary to assess protective antiviral immunity following infection or vaccination. The detection of the neutralizing ability of antibodies is also required to identify donors for convalescent plasma therapy [4]. The Food and Drug Administration (FDA) has recommended that convalescent plasma with a virus-neutralizing antibody titer of ≥1:160 be used for therapeutic transfusion [5].
Gomaa et al., reported that among 227 plasma samples from convalescent donors tested for nAbs against SARS-CoV-2 using a microneutralization assay, a third of the tested samples were negative for nAbs [6]. Furthermore, SARS-CoV-2 humoral immune responses have been studied extensively in a multitude of serosurveillance studies worldwide to describe pandemic dynamics, epidemiology, and associated risk factors. The epidemiological surveys primarily used anti-S tests, while a smaller percentage utilized viral neutralizing tests [7,8]. Despite the importance of nAbs in protection against SARS-CoV-2 infection, the level of nAbs has not been precisely correlated with the protection ability [9].
Several serological tests are available to determine the humoral immune response elicited by SARS-CoV-2 infection. These are based on techniques such as enzyme-linked immunosorbent assays (ELISAs), chemiluminescent immunoassays (CLIAs), and lateral flow immunoassays (LFIAs). Concerning tests for nAbs, two tests are considered gold standards. These are the plaque reduction neutralization test (PRNT) and the viral neutralization test (VNT). The PRNT can only be performed for smaller sample sizes by experienced personnel in biosafety level-3 (BSL-3) laboratories. The pseudovirus neutralization test uses a replication-deficient virus and does not require a BSL-3 laboratory, but it is more difficult to perform and is not suitable for high throughput samples. Owing to this complexity, PRNTs and VNTs are not used routinely, but they are utilized for research purposes only. Manufacturers have developed surrogate enzyme-linked immunosorbent assays (sELISAs) to overcome these drawbacks. Surrogate VNT (sVNT) tests are carried out via the competitive binding of anti-SARS-CoV-2 neutralizing antibodies with the angiotensin-converting enzyme 2 (ACE2) to block an enzyme-labeled S-RBD protein from binding its natural ligand on a microtiter plate. Surrogate ELISAs are high-throughput, cheaper, faster, and can be performed under standard laboratory safety conditions. However, there are limited data on how they compare to PRNTs and VNTs [10,11,12]. Consequently, the association between the results of tests measuring the levels of anti-S binding antibodies and those measuring the blocking neutralizing ones is gaining importance with time [13,14]. This correlation between both types of antibodies might allow the titer of anti-S antibodies to be used as an indicator, or predictor, substituting the more sophisticated neutralization tests. Several anti-S immunoassays are commercially available, but there is wide variability in their correlation with nAbs [15].
Using a commercial anti-S test which has a good correlation with nAbs and identifying a cutoff value indicating neutralization are important when it comes to predicting protective immunity. Therefore, we used two commercially available ELISA kits (anti-S and a neutralizing assay) to test their correlation and then identify an anti-S cutoff value which indicates neutralization.

2. Methods

2.1. Study Setting and Sample Size Determination

This cross-sectional study was carried out over a period of six months (January–June 2021) during the early waves of COVID-19 in Egypt. The serum samples were part of a larger survey intended to determine the seroprevalence of anti-S in the Egyptian community [16]. Based on the seroprevalence rate of SARS-CoV-2 antibodies in our previously mentioned survey (estimated to be 46.3%) [16], a minimum sample size of 388 subjects (including 155 subjects testing positive by NeutraLISA) was required to achieve a minimum power of 80% for detecting a change in the sensitivity percentage of a screening test from 0.70 to 0.80 [17], based on a target significance level of 0.05. The sample size was calculated using Power Analysis and Sample Size (PASS) 11 software.

2.2. Data Collection Methods and Tools

A total of 650 serum samples were tested for both SARS-CoV-2 anti-S and nAbs using kits by the same manufacturer (EUROIMMUN, Lübeck, Germany). The kits used in the study were the anti-SARS-CoV-2 Quantivac enzyme-linked immunosorbent assay (ELISA) (EUROIMMUN, Lübeck, Germany), and the SARS-CoV-2 NeutraLISA kit (EUROIMMUN, Lübeck, Germany). The first ELISA test was used to quantify immunoglobulin G (IgG) against the S1 domain of the viral spike protein of SARS-CoV-2 using a standard curve. The principle of the test depends on coating the microtiter plate with the S1 domain of the viral spike protein of SARS-CoV-2. After the addition of serum samples, bound antigen-antibody complexes were detected by the addition of another enzyme-labeled anti-human IgG (enzyme conjugate).
The second kit was used to measure the neutralizing antibodies in a competitive ELISA manner. The principle of this test depends on the coating of the microtiter plate with the S1/RBD domain of the spike antigen of SARS-CoV-2, followed by the addition of samples dissolved in ACE-2 biotinylated buffer. If nAbs are present, they compete with the binding sites of the ACE-2 for the S1/RBD receptors. The intensity of the color formed is inversely proportional to the level of antibodies in the sample [18]. Tests were performed and interpreted according to the manufacturer’s instructions.
The results of anti-S are expressed in relative unit/mL (RU/mL) and were categorized as follows: negative (<8 RU/mL), borderline (titer: 8–<11 RU/mL), and positive (titers ≥11 RU/mL). For our study, we considered borderline results to be positive. According to the manufacturer, the specificity of the QuantiVac ELISA (IgG) test was 99.8% [19].
The obtained results in RU/mL were multiplied by 3.2 and calculated in binding antibody unit/mL (BAU/mL), which is the first International Standard of the World Health Organization to detect SARS-CoV-2 neutralizing antibodies [20].
Concerning the detection of nAbs, a surrogate viral neutralization test (sVNT) with the competitive ELISA method was used (NeutraLISA, EUROIMMUN, Lübeck, Germany). This test measures the neutralizing activity of several immunoglobulins, which are Igs A, M, and G [18]. According to EUROIMMUN, this kit has a specificity of 99.7% and its sensitivity is 95.9% [21]. As instructed, the percentage inhibition (%IH) results were interpreted as follows: % IH < 20 were considered “negative”, % IH ≥ 20 to <35 were considered “borderline”, while % IH ≥ 35 indicated a “positive” result [18]. Similar to our approach with borderline results for anti-S, borderline results for nAbs were also considered positive.
Tests of association and quantitative correlation were performed between both antibodies. After ensuring a good correlation existed between both tests, a receiver operating characteristic (ROC) curve analysis was constructed to generate a cutoff point for anti-S above which the NeutraLISA test was predicted to be positive at an optimum sensitivity and specificity.

2.3. Statistical Analysis

Statistical analysis was performed using SPSS-V25 (IBM Corp., Armonk, NY, USA) and Medcalc. Concordance analyses (Cohen’s Kappa) were performed to compare the results of each antibody assay and the results were interpreted as follows: value ≤ 0 as no agreement, 0.01–0.20 as none to slight, 0.21–0.40 as fair, 0.41–0.60 as moderate, 0.61–0.80 as substantial, and 0.81–1.00 as almost perfect agreement [22]. Receiver operating characteristic (ROC) curve analysis was used to identify optimized thresholds (cutoff indices). Means were given with standard deviation (SD) and medians with interquartile range (IQR). For comparison of means, the Mann–Whitney U and Kruskal–Wallis tests were used. The Spearman’s correlation coefficient was determined for the linear correlation of two variables; p-values  <  0.05 were considered significant differences.

3. Results

A total of 650 serum samples were tested for both anti-spike and neutralizing antibodies against SARS-CoV-2 using kits by the same manufacturer (EUROIMMUN, Germany). Borderline results constituted 10.5% (68 samples) of all nAb results, and 2.9% (19 samples) of all anti-S results. Borderline results were considered positive for both antibodies to avoid confusion in statistical analyses.
Anti-S positivity was prevalent in 68.9% of samples (n = 448), with a median (IQR) titer of 44.0 (77.48) RU/mL in positive samples (equivalent to 140.8 BAU/mL) and a median (IQR) of 20.40 (60.53) (equivalent to 65.3 BAU/mL) in total samples. The presence of nAbs was prevalent in 53.8% of samples (n = 350), with a median (IQR) IH% of 62.18 (46.29) in positive samples and median (IQR) of 24.81(59.18) in total samples (Table 1).
There was a significant correlation between levels of anti-S and nAbs (Spearman’s rho = 0.913, p-value < 0.01) (Figure 1).
Among the positive samples for anti-S, 77.0% of them (n = 345) were also positive for nAbs, while 23.0% were negative. Among the negative samples for anti-S, the majority were also negative for nAbs, while five samples (2.5%) had a neutralizing activity despite being negative for anti-S. There was a substantial agreement between anti-S and nAbs (Cohen’s kappa coefficient (κ) = 0.658 (0.602–0.714), SE = 0.029, p-value < 0.01), with an overall percent agreement of 83.38%. Considering NeutraLISA as a gold standard, anti-S was found to have a sensitivity of 98.57%, specificity of 65.66%, NPV of 97.5%, and PPV of 77.0% (Table 2).
The ROC curve showed a good predictive value in terms of the anti-S titers for the prevalence of nAbs (area under the curve = 0.964 (0.951–0.977). When the anti-S titer exceeded a value of 18.1 RU/mL (57.9 BAU/mL), nAbs were also positive at a sensitivity of 90.0% [95% CI: 68.6–89.6%] and a specificity of 91% [95% CI: 73.5–97.9%] (Figure 2). Lower anti-S titers exhibited higher diagnostic sensitivities but lower specificities and vice versa. For instance, when the anti-S titer was 10 RU/mL, the prediction of nAbs prevalence had a sensitivity of 97.7% and a specificity of 73%. Meanwhile, when the anti-S titer was 40 RU/mL, the prediction of nAbs prevalence had a sensitivity of 67.1% and a specificity of 98%.

4. Discussion

To the best of the authors’ knowledge, there are no current data available regarding the titer of neutralizing antibodies that protect persons from SARS-CoV-2 infection. However, the role of nAbs as a marker of immunity against COVID-19 infection is proven. Lucas et al. reported that the early appearance of nAbs correlates with better COVID-19 clinical trajectory and prognosis among hospitalized patients. They also found that patients who had lower SARS-CoV-2 viral loads in their nasal swabs had higher serum nAbs [23]. Similar protective effects of nAbs were reported in studies on vaccine recipients and donors of convalescent plasma [3,6]. Cromer et al. reported that a decline in neutralizing antibodies against SARS-CoV-2 occurs in convalescent patients, resulting in reinfection [24]. This highlights the importance of laboratory tests for nAbs to evaluate the immune status of such individuals.
An International Standard (IS) containing a known amount of anti-SARS-CoV-2 immunoglobulins with well-characterized neutralizing activity was made available by the WHO in December 2020 to allow for the accurate calibration of assays to the international unit (IU) for neutralizing antibodies or binding antibody units (BAU) for binding antibodies, thereby reducing interlaboratory variation and creating a common language for reporting data [20]. This standardization of measuring units is encouraged among kit manufacturers and vaccine developers to allow for the comparison of results from studies on infection or post-vaccination and to precisely identify correlates of protection [25]. Regarding the tests used in our study, the Quantivac SARS-CoV-2 test has an established conversion factor (as described by the manufacturer), where results in RU/mL are multiplied by a factor of 3.2 to obtain results expressed in BAU/mL, as recommended. However, no such conversion factor is available for the NeutraLISA kit [26]. Nevertheless, since our work was not aiming to identify a correlate of protection against infection and we aimed to merely identify a positivity cutoff for neutralizing antibodies, the lack of a conversion factor did not affect the rationale of our study or the reliability of our results.
Our study used a surrogate VNT (sVNT) rather than the conventional pseudovirus-based SARS-CoV-2 neutralizing antibody assay. This sVNT test (SARS-CoV-2 NeutraLisa test) has the advantage of being easy to perform, not requiring a BSL-3 laboratory and the production of rapid results. The sVNT is also suitable for high-throughput testing and/or fully automated testing after minimal adaptation. According to Tan et al., there was a good correlation between the results of the RBD ELISA and the RBD sVNT [27].
We chose the EUROIMMUN NeutraLISA test and the anti-S test Quantivac by the same manufacturer to maximize the accuracy of our results and reduce variation owing to differences in manufacturing techniques between different commercial brands. Montesinos et al. compared the results of six binding assays and compared their clinical performances against a plaque reduction neutralization test (PRNT) at a 1/80 titer and concluded that EUROIMMUN QuantiVac IgG showed a better ability to detect nAbs than four other assays with an area under the ROC curve of 0.95 (95% CI: 0.92–0.98) [28]. Pieri et al. also reported an overall agreement of 95.45% and a correlation of r = 0.810 between the EUROIMMUN sVNT and the results of the gold standard VNT [26]. Overall, these results encouraged us to choose the EUROIMMUN sVNT in our study for cutoff determination.
In our study, among the positive samples for anti-S, 77.0% (n = 345) were positive for nAbs. This indicates that the humoral response against S-protein for the most part also involves the production of neutralizing antibodies. Several studies reported such findings [4,29,30]. Almost a quarter of the sera (23.0%) had no nAbs despite being positive for anti-S. Researchers have explained this by the fact that SARS-CoV-2 infection/vaccination may often fail to induce sufficient B-cell expansion and maturation to generate high-titer neutralizing antibodies [31].
Considering NeutraLISA as a gold standard, anti-S was found to have a sensitivity 98.57%, a specificity 65.66%, an NPV of 97.5%, and a PPV of 77.0%, with an AUC of 0.964 (0.951–0.977). There was a significant correlation between levels of anti-S and nAbs (Spearman’s rho= 0.913, p-value < 0.01) and a substantial agreement between both tests (Cohen’s kappa coefficient = 0.658 (0.602–0.714), p-value < 0.01), with an overall percentage agreement of 83.38%. The manufacturer (EUROIMMUN) tested 111 samples with anti-SARS-CoV-2 Quantivac (IgG) and NeutraLISA kits and stated a qualitative agreement of 99.1% (borderline results were excluded) [21]. In our case, the agreement between both tests was lower than that reported by the manufacturer, and this could be a result of our inclusion of borderline results with positive ones. The agreement between anti-S and nAbs denotes that the humoral response against S-protein also primarily involves the production of neutralizing antibodies [10]. Similar to our work, Dinç et al. reported a correlation between both kits by EUROIMMUN (rs = 0.496, p < 0.001) [32].
Valdivia et al., reported a strong correlation between SARS-CoV-2 anti-S and nAbs. However, their study used the EUROIMMUN SARS-CoV-2 IgG ELISA (rho  =  0.73) and a pseudotyped virus assay for 50% virus neutralization [33].
When the spike antibodies had a titer exceeding 18.1 RU/mL (57.9 BAU/mL), nAbs were also positive, with a sensitivity of 90.0% [95% CI: 68.6–89.6%] and specificity of 91% [95% CI: 73.5–97.9%]. A study reported a similar approach, where a cutoff anti-RBD IgG antibody level of 9.95 S/CO resulted in a sensitivity of 84.0% and a specificity of 86.3% for the prediction of seropositivity for neutralizing antibodies [34]. Another study evaluated the antibody response (both spike and neutralizing antibodies) among vaccinated participants using the same EUROIMMUN kits used in the present study. In that study, the anti-S test was reported to be a reliable predictor among cases with positive neutralizing antibodies (area under the curve = 0.929). In that same study, when the anti-S titer exceeded 40 RU/mL (128 BAU/mL), neutralization was also positive, with a sensitivity of 80.6% (95% CI: 68.6–89.6%) and specificity of 90% (95% CI:73.5–97.9%) [35]. In that study, borderline results were considered to be negative, while in the present study, borderline results (10.5%) were considered to be positive, and this might explain the relatively higher cutoff chosen by their study compared to ours. Moreover, our larger sample size (n = 650) compared to theirs (n = 92) might also contribute to the better accuracy and lower cutoff value.
Generally, to determine an optimized predictive cutoff out of a ROC analysis, this requires knowing the purpose of the test. In the context of the COVID-19 pandemic, if an immunoassay is required as a diagnostic aid, such as in serosurveillance studies, then a high sensitivity is preferred (exceeding 90%) over a high specificity. However, if antibody tests were required for the release of patients from quarantine, then specificity would be more important than sensitivity. This is because a low specificity could lead to infectious patients being released from the quarantine to the community, leading to the perpetuation of the infection in the community [36].
In our study, at lower anti-S titers, e.g., 10 RU/mL, the prediction of nAbs positivity had a sensitivity of 97.7% and a specificity of 73%. Meanwhile, when the anti-S titer was 40 RU/mL, the prediction of nAbs positivity had a sensitivity of 67.1% and a specificity of 98%. It is noteworthy to observe the variation in sensitivity and specificity at the titer 40 RU/mL between our study and the other study described earlier [35], as we recorded a lower sensitivity but a higher specificity at that titer. Again, our larger sample size and discrepancy in terms of the inclusion of borderline results might have contributed to these variations in diagnostic performance, even though both studies used the same commercial kits for both antibodies.
In the present study, five samples (2.5%) had a neutralizing activity despite being negative for anti-S. This might be explained by the fact that, although the RBD specifically is the main target for nAbs, other areas/epitopes of S protein may also elicit nAbs [29]. Possible reasons for this include the fact that the NeutraLISA test, as described by its manufacturer, does not only measure only neutralizing IgG but also neutralizing activity by IgA and IgM. On the other hand, the Quantivac kit, as stated by the same manufacturer, measures the anti-S binding ability of IgG only. EUROIMMUN recommends repeating the investigations 7 to 14 days later to overcome this discrepancy [19]. Marot et al. reported that in their convalescent plasma samples, the purified IgA had a greater neutralizing capacity than IgG at earlier time points (2 weeks post-infection until 3 months), whereas the opposite pattern was observed after 3 months [37].
It is noteworthy to mention that the samples of our study were collected near the end of the second wave of the pandemic and throughout the whole third wave (January–June 2021). During this time, the dominant viral variants belonged to the Pangolin lineage C.36 (especially C.36.3) [38]. According to official national reports in August 2021, at that time, the Delta variant had not yet been detected in Egypt, despite being discovered in several other countries [39]. Delta (B.1.617.2) and Omicron (B.1.1.529) variants are known for their immunity evasion and escape from neutralization owing to mutations in their N-terminal domain of the spike protein, which is the primary neutralizing epitope [40]. Ai et al. reported that their pseudovirus assay demonstrated that Omicron virus neutralization by plasma of convalescent or twice-vaccinated people (with BNT162b2, mRNA-1273, ChAdOx1, Ad26.COV2.S, Sputnik V, BBIBP-CorV) was significantly reduced or absent in comparison with the ancestral strain [41]. Studies on viral neutralization should always be interpreted in the context of circulating viral variants in a specific geographical location.

Strengths and Limitations

Our study included a relatively large number of samples, which provided more reliable results when the cutoff was calculated. Although several studies utilized the Quantivac (EUORIMMUN) kit, there is a scarcity in terms of the publications available on the sVNT NeutraLISA (EUORIMMUN) test. To the best of our knowledge, no other study has been published that predicted a cutoff value for this anti-S Quantivac test using the NeutraLISA kit.
The limitations of the study include the absence of a conversion factor for the NeutraLISA test in terms of the WHO international standards (IU/mL). This might have had helped in identifying the values of nAbs that exceed the cutoff of anti-S in units that are standardized between different neutralization tests.

5. Conclusions

Our results indicate that the anti-SARS-CoV-2 QuantiVac ELISA IgG test (EUROIMMUN, Lübeck, Germany) can be correlated with the neutralizing antibody response against SARS-CoV-2. This can be helpful following natural SARS-CoV-2 infection and vaccination or for the identification of convalescent plasma donors.

Author Contributions

Conceptualization, E.M.E.-G.; Data curation, M.H.H. and E.A.O.; Formal analysis, A.G.F.; Funding acquisition, E.M.E.-G.; Investigation, M.H.H. and E.A.O.; Methodology, E.M.E.-G. and E.A.O.; Project administration, E.M.E.-G.; Resources, E.M.E.-G., M.H.H. and E.A.O.; Supervision, E.M.E.-G. and A.G.F.; Validation, A.G.F.; Visualization, A.G.F.; Writing—original draft, E.A.O.; Writing—review & editing, E.M.E.-G., M.H.H. and E.A.O. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported financially by the Science and Technology Development Fund (STDF), Egypt; Project No. 43834.

Institutional Review Board Statement

The study was conducted in compliance with the Helsinki Declaration and was approved by the Institutional Review Board (IRB) Committee, Faculty of Medicine, Alexandria University; IRB number: 00012098-FWA number: 00018699, serial number: 0305136.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Hoffmann, M.; Kleine-Weber, H.; Schroeder, S.; Krüger, N.; Herrler, T.; Erichsen, S.; Schiergens, T.S.; Herrler, G.; Wu, N.-H.; Nitsche, A. SARS-CoV-2 cell entry depends on ACE2 and TMPRSS2 and is blocked by a clinically proven protease inhibitor. Cell 2020, 181, 271–280.e278. [Google Scholar] [CrossRef] [PubMed]
  2. Yan, R.; Zhang, Y.; Li, Y.; Xia, L.; Guo, Y.; Zhou, Q. Structural basis for the recognition of SARS-CoV-2 by full-length human ACE2. Science 2020, 367, 1444–1448. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Plotkin, S.A. Correlates of protection induced by vaccination. Clin. Vaccine Immunol. 2010, 17, 1055–1065. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Dolscheid-Pommerich, R.; Bartok, E.; Renn, M.; Kümmerer, B.M.; Schulte, B.; Schmithausen, R.M.; Stoffel-Wagner, B.; Streeck, H.; Saschenbrecker, S.; Steinhagen, K. Correlation between a quantitative anti-SARS-CoV-2 IgG ELISA and neutralization activity. J. Med. Virol. 2022, 94, 388–392. [Google Scholar] [CrossRef]
  5. US Food and Drug Adminsitration (FDA). Recommendations for Investigational COVID-19 Convalescent Plasma. 2020. Available online: https://www.fda.gov/vaccines-blood-biologics/investigational-new-drug-applications-inds-cber-regulated-products/recommendations-investigational-covid-19-convalescent-plasma (accessed on 9 August 2021).
  6. Gomaa, M.R.; Kandeil, A.; Mostafa, A.; Roshdy, W.H.; Kayed, A.E.; Shehata, M.; Kutkat, O.; Moatasim, Y.; El Taweel, A.; Mahmoud, S.H.; et al. Prevalence of Severe Acute Respiratory Syndrome Coronavirus 2 Neutralizing Antibodies in Egyptian Convalescent Plasma Donors. Front. Microbiol. 2020, 11, 596851. [Google Scholar] [CrossRef]
  7. Ward, H.; Cooke, G.S.; Atchison, C.; Whitaker, M.; Elliott, J.; Moshe, M.; Brown, J.C.; Flower, B.; Daunt, A.; Ainslie, K. Prevalence of antibody positivity to SARS-CoV-2 following the first peak of infection in England: Serial cross-sectional studies of 365,000 adults. Lancet Reg. Health-Eur. 2021, 4, 100098. [Google Scholar] [CrossRef]
  8. Xiaojie, S.; Yu, L.; Guang, Y.; Min, Q. Neutralizing antibodies targeting SARS-CoV-2 spike protein. Stem Cell Res. 2021, 50, 102125. [Google Scholar] [CrossRef]
  9. Khoury, D.S.; Cromer, D.; Reynaldi, A.; Schlub, T.E.; Wheatley, A.K.; Juno, J.A.; Subbarao, K.; Kent, S.J.; Triccas, J.A.; Davenport, M.P. Neutralizing antibody levels are highly predictive of immune protection from symptomatic SARS-CoV-2 infection. Nat. Med. 2021, 27, 1205–1211. [Google Scholar] [CrossRef]
  10. Wang, Y.; Zhang, L.; Sang, L.; Ye, F.; Ruan, S.; Zhong, B.; Song, T.; Alshukairi, A.N.; Chen, R.; Zhang, Z. Kinetics of viral load and antibody response in relation to COVID-19 severity. J. Clin. Investig. 2020, 130, 5235–5244. [Google Scholar] [CrossRef]
  11. Ni, L.; Ye, F.; Cheng, M.-L.; Feng, Y.; Deng, Y.-Q.; Zhao, H.; Wei, P.; Ge, J.; Gou, M.; Li, X. Detection of SARS-CoV-2-specific humoral and cellular immunity in COVID-19 convalescent individuals. Immunity 2020, 52, 971–977.e973. [Google Scholar] [CrossRef]
  12. Kohmer, N.; Rühl, C.; Ciesek, S.; Rabenau, H.F. Utility of different surrogate enzyme-linked immunosorbent assays (sELISAs) for detection of SARS-CoV-2 neutralizing antibodies. J. Clin. Med. 2021, 10, 2128. [Google Scholar] [CrossRef] [PubMed]
  13. Bal, A.; Pozzetto, B.; Trabaud, M.-A.; Escuret, V.; Rabilloud, M.; Langlois-Jacques, C.; Paul, A.; Guibert, N.; D’Aubarède-Frieh, C.; Massardier-Pilonchery, A. Evaluation of high-throughput SARS-CoV-2 serological assays in a longitudinal cohort of patients with mild COVID-19: Clinical sensitivity, specificity, and association with virus neutralization test. Clin. Chem. 2021, 67, 742–752. [Google Scholar] [CrossRef] [PubMed]
  14. Bonelli, F.; Sarasini, A.; Zierold, C.; Calleri, M.; Bonetti, A.; Vismara, C.; Blocki, F.A.; Pallavicini, L.; Chinali, A.; Campisi, D. Clinical and analytical performance of an automated serological test that identifies S1/S2-neutralizing IgG in COVID-19 patients semiquantitatively. J. Clin. Microbiol. 2020, 58, e01224-20. [Google Scholar] [CrossRef] [PubMed]
  15. Therrien, C.; Serhir, B.; Bélanger-Collard, M.; Skrzypczak, J.; Shank, D.; Renaud, C.; Girouard, J.; Loungnarath, V.; Carrier, M.; Brochu, G. Multicenter evaluation of the clinical performance and the neutralizing antibody activity prediction properties of 10 high-throughput serological assays used in clinical laboratories. J. Clin. Microbiol. 2021, 59, e02511–e02520. [Google Scholar] [CrossRef] [PubMed]
  16. El-Ghitany, E.M.; Farag, S.; Farghaly, A.G.; Hashish, M.H.; Hassaan, M.A.; Omran, E.A. A pre-vaccine exploratory survey of SARS-CoV-2 humoral immunity among Egyptian general population. Trop. Med. Health 2022, 50, 53. [Google Scholar] [CrossRef] [PubMed]
  17. Gaber, Y.; Alem, S.A.; Musa, S.; Amer, K.; Elnagdy, T.; Hassan, W.A.; Abdelrahman, R.Z.; Gad, A.; Ali, M.A.; Badary, H.A. Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) immunoglobulins using chemiluminescence immunoassay and its correlation with neutralizing antibodies. Virus Res. 2022, 319, 198852. [Google Scholar] [CrossRef]
  18. EUROIMMUN. SARS-CoV-2 Neutralisation Test in ELISA Format. Available online: https://www.coronavirus-diagnostics.com/documents/Indications/Infections/Coronavirus/EI_2606_I_UK_C.pdf (accessed on 10 August 2021).
  19. Gosink, J. Investigation of SARS-CoV-2- Specific Immune Reponses. Available online: https://www.euroimmun.de/fileadmin/user_upload/News/Professional-articles/CLI_June_2021_SARS-CoV-2_immune_responses.pdf. (accessed on 12 August 2021).
  20. Kristiansen, P.A.; Page, M.; Bernasconi, V.; Mattiuzzo, G.; Dull, P.; Makar, K.; Plotkin, S.; Knezevic, I. WHO International Standard for anti-SARS-CoV-2 immunoglobulin. Lancet 2021, 397, 1347–1348. [Google Scholar] [CrossRef]
  21. Cecconi, M.; Piovani, D.; Brunetta, E.; Aghemo, A.; Greco, M.; Ciccarelli, M.; Angelini, C.; Voza, A.; Omodei, P.; Vespa, E. Early predictors of clinical deterioration in a cohort of 239 patients hospitalized for Covid-19 infection in Lombardy, Italy. J. Clin. Med. 2020, 9, 1548. [Google Scholar] [CrossRef]
  22. McHugh, M.L. Interrater reliability: The kappa statistic. Biochem. Med. (Zagreb) 2012, 22, 276–282. [Google Scholar] [CrossRef]
  23. Lucas, C.; Klein, J.; Sundaram, M.E.; Liu, F.; Wong, P.; Silva, J.; Mao, T.; Oh, J.E.; Mohanty, S.; Huang, J.; et al. Delayed production of neutralizing antibodies correlates with fatal COVID-19. Nat. Med. 2021, 27, 1178–1186. [Google Scholar] [CrossRef]
  24. Cromer, D.; Juno, J.A.; Khoury, D.; Reynaldi, A.; Wheatley, A.K.; Kent, S.J.; Davenport, M.P. Prospects for durable immune control of SARS-CoV-2 and prevention of reinfection. Nat. Rev. Immunol. 2021, 21, 395–404. [Google Scholar] [CrossRef] [PubMed]
  25. Knezevic, I.; Mattiuzzo, G.; Page, M.; Minor, P.; Griffiths, E.; Nuebling, M.; Moorthy, V. WHO International Standard for evaluation of the antibody response to COVID-19 vaccines: Call for urgent action by the scientific community. Lancet Microbe 2021, 3, E235–E240. [Google Scholar] [CrossRef]
  26. Pieri, M.; Infantino, M.; Manfredi, M.; Nuccetelli, M.; Grossi, V.; Lari, B.; Tomassetti, F.; Sarubbi, S.; Russo, E.; Amedei, A.; et al. Performance evaluation of four surrogate Virus Neutralization Tests (sVNTs) in comparison to the in vivo gold standard test. FBL 2022, 27, 74. [Google Scholar] [CrossRef] [PubMed]
  27. Tan, C.W.; Chia, W.N.; Qin, X.; Liu, P.; Chen, M.I.C.; Tiu, C.; Hu, Z.; Chen, V.C.-W.; Young, B.E.; Sia, W.R.; et al. A SARS-CoV-2 surrogate virus neutralization test based on antibody-mediated blockage of ACE2–spike protein–protein interaction. Nat. Biotechnol. 2020, 38, 1073–1078. [Google Scholar] [CrossRef] [PubMed]
  28. Montesinos, I.; Dahma, H.; Wolff, F.; Dauby, N.; Delaunoy, S.; Wuyts, M.; Detemmerman, C.; Duterme, C.; Vandenberg, O.; Martin, C. Neutralizing antibody responses following natural SARS-CoV-2 infection: Dynamics and correlation with commercial serologic tests. J. Clin. Virol. 2021, 144, 104988. [Google Scholar] [CrossRef] [PubMed]
  29. Chi, X.; Yan, R.; Zhang, J.; Zhang, G.; Zhang, Y.; Hao, M.; Zhang, Z.; Fan, P.; Dong, Y.; Yang, Y. A neutralizing human antibody binds to the N-terminal domain of the Spike protein of SARS-CoV-2. Science 2020, 369, 650–655. [Google Scholar] [CrossRef]
  30. Salazar, E.; Kuchipudi, S.V.; Christensen, P.A.; Eagar, T.; Yi, X.; Zhao, P.; Jin, Z.; Long, S.W.; Olsen, R.J.; Chen, J. Convalescent plasma anti–SARS-CoV-2 spike protein ectodomain and receptor-binding domain IgG correlate with virus neutralization. J. Clin. Investig. 2020, 130, 6728–6738. [Google Scholar] [CrossRef]
  31. Weisblum, Y.; Schmidt, F.; Zhang, F.; DaSilva, J.; Poston, D.; Lorenzi, J.C.C.; Muecksch, F.; Rutkowska, M.; Hoffmann, H.-H.; Michailidis, E.; et al. Escape from neutralizing antibodies by SARS-CoV-2 spike protein variants. eLife 2020, 9, e61312. [Google Scholar] [CrossRef]
  32. Dinç, H.Ö.; Demirci, M.; Özdemir, Y.E.; Sirekbasan, S.; Aktaş, A.N.; Karaali, R.; Tok, Y.T.; Özbey, D.; Akçin, R.; Gareayaghi, N. Anti-SARS-CoV-2 IgG and neutralizing antibody levels in patients with past COVID-19 infection: A longitudinal study. Balk. Med. J. 2022, 39, 172. [Google Scholar] [CrossRef]
  33. Valdivia, A.; Torres, I.; Latorre, V.; Francés-Gómez, C.; Albert, E.; Gozalbo-Rovira, R.; Alcaraz, M.J.; Buesa, J.; Rodríguez-Díaz, J.; Geller, R. Inference of SARS-CoV-2 spike-binding neutralizing antibody titers in sera from hospitalized COVID-19 patients by using commercial enzyme and chemiluminescent immunoassays. Eur. J. Clin. Microbiol. Infect. Dis. 2021, 40, 485–494. [Google Scholar] [CrossRef]
  34. Xue, J.-H.; Wang, Y.-J.; Li, W.; Li, Q.-L.; Xu, Q.-Y.; Niu, J.-J.; Liu, L.-L. Anti–Receptor-Binding Domain Immunoglobulin G Antibody as a Predictor of Seropositivity for Anti–SARS-CoV-2 Neutralizing Antibody. Arch. Pathol. Lab. Med. 2022, 146, 814–821. [Google Scholar] [CrossRef] [PubMed]
  35. Omran, E.A.; Habashy, R.E.; Ezz Elarab, L.A.; Hashish, M.H.; El-Barrawy, M.A.; Abdelwahab, I.A.; Fekry, M.M. Anti-Spike and Neutralizing Antibodies after Two Doses of COVID-19 Sinopharm/BIBP Vaccine. Vaccines 2022, 10, 1340. Available online: https://www.mdpi.com/2076-393X/10/8/1340 (accessed on 10 July 2021). [CrossRef] [PubMed]
  36. Adams, E.R.; Ainsworth, M.; Anand, R.; Andersson, M.I.; Auckland, K.; Baillie, J.K.; Barnes, E.; Beer, S.; Bell, J.I.; Berry, T. Antibody testing for COVID-19: A report from the National COVID Scientific Advisory Panel. Wellcome Open Res. 2020, 5, 139. [Google Scholar] [CrossRef] [PubMed]
  37. Marot, S.; Malet, I.; Leducq, V.; Zafilaza, K.; Sterlin, D.; Planas, D.; Gothland, A.; Jary, A.; Dorgham, K.; Bruel, T. Rapid decline of neutralizing antibodies against SARS-CoV-2 among infected healthcare workers. Nat. Commun. 2021, 12, 844. [Google Scholar] [CrossRef]
  38. Roshdy, W.H.; Kandeil, A.; El-Shesheny, R.; Khalifa, M.K.; Al-Karmalawy, A.A.; Showky, S.; Naguib, A.; Elguindy, N.; Fahim, M.; Abu Elsood, H.; et al. Insight into Genetic Characteristics of Identified SARS-CoV-2 Variants in Egypt from March 2020 to May 2021. Pathogens 2022, 11, 834. Available online: https://www.mdpi.com/2076-0817/11/8/834 (accessed on 10 July 2021). [CrossRef]
  39. Service, S.I. Tageddin: Delta Variant Has not Appeared in Egypt so Far. 2021. Available online: https://www.sis.gov.eg/Story/158646?lang=en-us (accessed on 30 August 2021).
  40. Guérin, P.; Yahi, N.; Azzaz, F.; Chahinian, H.; Sabatier, J.-M.; Fantini, J. Structural dynamics of the SARS-CoV-2 spike protein: A 2-year retrospective analysis of SARS-CoV-2 variants (from alpha to omicron) reveals an early divergence between conserved and variable epitopes. Molecules 2022, 27, 3851. [Google Scholar] [CrossRef]
  41. Ai, J.; Zhang, H.; Zhang, Y.; Lin, K.; Zhang, Y.; Wu, J.; Wan, Y.; Huang, Y.; Song, J.; Fu, Z. Omicron variant showed lower neutralizing sensitivity than other SARS-CoV-2 variants to immune sera elicited by vaccines after boost. Emerg. Microbes Infect. 2022, 11, 337–343. [Google Scholar] [CrossRef]
Vaccines 10 01952 g001 550
Figure 1. Correlation of EUROIMMUN SARS-CoV-2 anti-S (RU/mL) with EUROIMMUN SARS-CoV-2 NeutraLISA (%IH)* (n = 650).
Figure 1. Correlation of EUROIMMUN SARS-CoV-2 anti-S (RU/mL) with EUROIMMUN SARS-CoV-2 NeutraLISA (%IH)* (n = 650).
Vaccines 10 01952 g001
Vaccines 10 01952 g002 550
Figure 2. A ROC analysis illustrating the optimized cutoff value for the anti-spike immunoglobulin, in relation to the prevalence of nabs (AUC= 0.964 (0.951–0.977). * p-value < 0.01.
Figure 2. A ROC analysis illustrating the optimized cutoff value for the anti-spike immunoglobulin, in relation to the prevalence of nabs (AUC= 0.964 (0.951–0.977). * p-value < 0.01.
Vaccines 10 01952 g002
Table
Table 1. Distribution of the 650 samples according to their median (IQR) results for SARS-CoV-2 anti-S IgG titer (RU/mL) and SARS-CoV-2 nAbs (%IH).
Table 1. Distribution of the 650 samples according to their median (IQR) results for SARS-CoV-2 anti-S IgG titer (RU/mL) and SARS-CoV-2 nAbs (%IH).
No.%Median: Titer (anti-S)/IH%(nAbs)IQR
SARS-CoV-2 anti-S IgGNegative20231.11.654.10
Positive44868.944.0077.48
Total650100.020.4060.53
SARS-CoV-2 nAbsNegative30046.24.8215.46
Positive35053.862.1846.29
Total650100.024.8159.18
Table
Table 2. Agreement and performance of EUROIMMUN SARS-CoV-2 anti-S with EUROIMMUN SARS-CoV-2 NeutraLISA as a gold standard (n = 650).
Table 2. Agreement and performance of EUROIMMUN SARS-CoV-2 anti-S with EUROIMMUN SARS-CoV-2 NeutraLISA as a gold standard (n = 650).
EUROIMMUN SARS-CoV-2 NeutraLISATotal
Negative (n = 300)Positive (n = 350)
EUROIMMUN SARS-CoV-2 anti-SNegative197 (97.5%)5 (2.5%)202
Positive103 (23.0%)345 (77.0%)448
Cohen’s kappa coefficient (κ) = 0.658 (0.602–0.714), SE = 0.029, p-value < 0.01
Overall percent agreement = 83.38%
Sensitivity = 98.57% (96.69–99.53%)
Specificity = 65.66% (59.99–71.02%)
* NPV = 97.52% (94.26–98.95%)
** PPV = 77.00% (74.11–79.67%)
*** Positive LR = 2.87 (2.45–3.35)
**** Negative LR = 0.02 (0.00–0.05)
* NPV: negative predictive value; ** PPV: positive predictive value; *** Positive LR: positive likelihood ratio; **** Negative LR: negative likelihood ratio.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

El-Ghitany, E.M.; Hashish, M.H.; Farghaly, A.G.; Omran, E.A. Determining the SARS-CoV-2 Anti-Spike Cutoff Level Denoting Neutralizing Activity Using Two Commercial Kits. Vaccines 2022, 10, 1952. https://doi.org/10.3390/vaccines10111952

AMA Style

El-Ghitany EM, Hashish MH, Farghaly AG, Omran EA. Determining the SARS-CoV-2 Anti-Spike Cutoff Level Denoting Neutralizing Activity Using Two Commercial Kits. Vaccines. 2022; 10(11):1952. https://doi.org/10.3390/vaccines10111952

Chicago/Turabian Style

El-Ghitany, Engy Mohamed, Mona H. Hashish, Azza Galal Farghaly, and Eman A. Omran. 2022. "Determining the SARS-CoV-2 Anti-Spike Cutoff Level Denoting Neutralizing Activity Using Two Commercial Kits" Vaccines 10, no. 11: 1952. https://doi.org/10.3390/vaccines10111952

APA Style

El-Ghitany, E. M., Hashish, M. H., Farghaly, A. G., & Omran, E. A. (2022). Determining the SARS-CoV-2 Anti-Spike Cutoff Level Denoting Neutralizing Activity Using Two Commercial Kits. Vaccines, 10(11), 1952. https://doi.org/10.3390/vaccines10111952

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop