INTRODUCTION
Infectious diseases continue to pose a significant challenge for humanity, as the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic has again demonstrated (
1). Nevertheless, in contrast to the past, diagnostic, therapeutic, and preventive strategies are now being developed at an unprecedented rate to address these pandemic challenges. Among all these strategies, however, the one that stands out is the vaccination against SARS-CoV-2. Using new technologies and extensive knowledge on active immunization against numerous pathogens, highly efficient vaccines have been developed and applied within a few months (
2).
The vaccination aims to induce a SARS-CoV-2 specific immune response analogous to a previous infection and thus should protect against disease or even better protect against infection. The simplest way to objectify an immune response is to measure the specific antibodies elicited by an infection or vaccine (
3). Thus, SARS-CoV-2 antibody tests can be used to confirm known prior infections or detect unreported infections in seroprevalence surveys (
4,
5). For this purpose, different antigens are used, which can be divided into two classes: SARS-CoV-2 nucleocapsid-specific antibodies and antibodies directed against the spike protein (
6). The latter antibodies, which are formed against components of the virus surface spike protein, are induced by all COVID vaccines currently in use, making them an ideal surrogate for the immune response after vaccination (
7).
The need to develop quantitative assays to detect vaccine-induced antibodies was highlighted early in the pandemic. Quantitative detection of antibodies was considered an essential requirement to perform immunogenicity and efficacy studies and eventually to establish thresholds for protective correlates (
8). However, standardization is necessary to allow comparability of quantitative antibody test results. Therefore, an international standard for SARS-CoV-2 antibodies (National Institute for Biological Standards and Control [NIBSC] 20/136) was issued by the WHO to compare SARS-CoV-2 specific antibody levels better (
9). Although there is currently no general recommendation to determine antibody levels in all individuals after SARS-CoV-2 vaccination, this is reasonable from a scientific perspective and has been done in numerous studies (
10–13). Moreover, it is now known that suboptimal or even lack of response to vaccination can occur in specific groups like immunocompromised patients (
14,
15). These potential nonresponders might be identified in a first step by determining the antibody levels after vaccination. Unfortunately, there is little scientific evidence on the real-life comparability of different commercially available quantitative test systems, especially after vaccination (
16,
17).
We could previously show that reporting standardized binding antibody units (BAU/mL) is insufficient for different test systems to provide numerically comparable results (
16). Moreover, antibody responses are dependent on the type of vaccine used (
18,
19). In this view, the temporal kinetics of antibody levels after vaccination were described for different vaccines and different antibody assays (
20–23). However, the factors that may influence the comparability of different quantitative SARS-CoV-2 antibody tests have not been sufficiently systematically studied.
In the present work, we aimed to expand this knowledge using samples from AZD1222 vaccinated volunteers and tested antibody levels at multiple time points: 3 weeks after the first vaccine dose, 11 weeks after the first dose (immediately before the second dose), and 3 weeks after the second dose. Moreover, prebooster and postbooster levels were compared to SARS-CoV-2 specific T cell interferon γ responses. We used two of the most widely applied commercially available assays, the Roche Elecsys SARS-CoV-2 S-ECLIA (
24) and the Abbott Anti-SARS-CoV-2 IgG II (
25), to examine the comparability of the assays concerning the timing of blood collection after vaccination.
DISCUSSION
SARS‐CoV‐2 specific anti‐spike protein assays have been and are still widely used for serological studies. While the distinction between positive and negative is usually sufficient in seroprevalence studies, quantitative results are needed to describe the immunogenicity of SARS-CoV-2 vaccines and, ideally, to find protection correlates (
13,
26). However, the quantitative results of different SARS-CoV-2 antibody tests must be comparable to summarize the results of different studies or to translate them to other situations (
8,
9). In the present work, we compared two commercially available and broadly used CE-IVD marked SARS-CoV-2 antibody assays (Roche and Abbott). Both assays quantitate antibodies directed against the RBD domain of the SARS-CoV-2 spike protein and were referenced against the first WHO standard for SARS-CoV-2 antibodies, thus providing results in BAU/mL. We demonstrated in a previous study after vaccination with BNT162b that despite the standardization of SARS-CoV-2 antibody assays, the numerical values of different test systems are not interchangeable (
16). Now we show for the first time that the problem of comparability is even more complex because the conversion between different assays can change dramatically with the time interval from vaccination.
From studies with convalescents, we know that the levels of antibodies depend on the test system used and that, in addition, other differences may become observable over time, e.g., levels appear to decline more rapidly with one test than with another (
27). However, these findings cannot be transferred to the situation after vaccination without restrictions. There are known differences between the serostatus after infection and vaccination (
28), and the various vaccines also differ in this respect (
29).
Using samples from 50 individuals vaccinated with AZD1222, we could show that both anti-spike antibody assays used (Abbott and Roche) detected specific antibodies in all but two participants 3 weeks after the first dose. Both nonresponders were taking immunosuppressive drugs, which can lead to a decreased to absent response to the vaccine (
30–32). However, after the second dose, the antibody levels markedly increased and reached detectable levels in all participants (
Table 1 and
Fig. 2A). In contrast to people with previous COVID (
33–35), the second dose was required in our SARS-CoV-2 naive population to induce high antibody levels. The median relative change of individual antibody levels 3 weeks after the first versus 3 weeks after the second dose was nearly 20-times higher for Roche than for Abbott (80.8 versus 4.5-fold change;
Fig. 2B). Despite targeting the same antigen (RBD) and reporting in BAU/mL, not even the relative increases in antibody levels turned out to be comparable. Of course, it should be mentioned that the exact antigens used in the two test systems are unlikely to be identical, and therefore such differences may be due to different epitope specificities. Furthermore, Abbott and Roche differ in the test format where the former uses classical IgG-specific detection, whereas the latter applies a sandwich format to bind all antibody isotypes potentially. The limited comparability of serological assays after vaccination is not specific for the AstraZeneca vaccine, as it was also observed after immunization with Pfizer/BioNTech BNT162b2 (16).
When looking at the difference between 3 and 11 weeks after the first vaccination dose, it was found that both the Abbott test and the cPass sVNT did not detect an increase in antibodies (
Fig. 2). In contrast, antibody levels measured by the Roche test increased >4-fold during this period. This discrepancy could be either explained by the inability of the Abbott and sVNT assays to distinguish such small changes in antibody concentration or the possibility that the Roche assay detects not only quantitative but also qualitative changes of the antibodies formed. Because previous studies failed to demonstrate a continuous increase in antibody levels for AZD1222 later than 3 weeks after vaccination, the Roche total antibody sandwich assay may also be sensitive to qualitative changes in nascent antibodies (e.g., antibody maturation), in contrast to the Abbott IgG-specific assay (
12,
36). This hypothesis is also supported by the observation that in direct comparison with the sVNT, the Roche assay underestimated inhibitory capacities at week 3 (
Fig. 4), which is discussed in detail below. Thus, the assays studied show significant differences in the kinetics of antibody levels, which has been reported previously but was only rarely demonstrated from the same sample with different assays (
17,
37). Although the correlation between Roche and Abbott improved over time, their relationship changed significantly depending on the time of blood sampling (
Fig. 3). At the first time point, Roche measured three times lower values in BAU/mL than the Abbott assay, 11 weeks after the first dose, Roche measured twice as high as Abbott, and finally, after the booster, Roche was median 5 to 6 times higher than Abbott. Currently, further evidence is lacking on whether the association between two antibody tests can become constant and at what time interval to the second dose this would be the case. But it should also be considered that each new stimulus of antibody formation would lead to different ratios. Considering the ongoing administration of a third dose and already starting vaccination of fourth doses, continuous ratios changes would be likely. It is important to note that, unlike other comparative (often retrospective) studies, we did not choose time intervals but clearly defined time points in this prospective observational study. Therefore, an accurate assessment of the observed time-dependent effects was possible, which could otherwise be overlooked.
As studies have shown before that detection of SARS-CoV-2 anti-spike binding antibodies correlates well with the presence of functional neutralizing antibodies, we wanted to examine differences between Roche and Abbott assays in this regard (
38–43). The agreement between the results of the binding antibody assays and the neutralization test surrogate was generally good (
Fig. 4). At 11 weeks after the first vaccination, the correlation was excellent; after the booster, the correlation was technically limited due to many participants reaching the plateau of the sVNT. However, the worst correlation was found for the first antibody response 3 weeks after the first dose, and here Roche performed significantly worse than Abbott. This finding may be important because the improvement in Roche/sVNT correlation from ρ = 0.666 to ρ = 0.894 between 3 and 11 weeks after the first dose may indicate reduced sensitivity of the Roche assay for early antibodies. In other words, the discrepancy mentioned above that only Roche showed increasing antibody levels between 3 and 11 weeks after the first dose, while the other two tests showed identical or even slightly decreasing levels (
Fig. 2), could mean that the Roche test requires more matured antibodies to allow binding.
In line with previous studies, the second dose of AZD1222 substantially enhanced the initial antibody response in our cohort (
19,
36,
44). Because the formation of antibodies is physiologically supported by specific T cells, we assumed a correlation between T cell response and antibody formation. Therefore, we aimed to additionally investigate the cellular responses elicited by the second dose. For this purpose, we used a SARS-COV-2 Quantiferon IFN-γ release assay similar to those known from tuberculosis diagnostics and compared the time points before and after the second vaccine dose. As previously shown (
45), the second dose induced an increase in cellular reactivity in most cases (
Fig. 5). Three participants presented negative responses to Ag1 and Ag2, but the decreases were only moderate (0.04 to 0.07 IU/mL). The antibody responses in these participants were comparable to those seen in the rest of the cohort. However, we found only weak, mostly statistically nonsignificant correlations between antibody levels and absolute IFN-γ levels before the second dose and no correlation at all after the second dose (
Table 2).
In contrast, the percent cellular response (fold change) to the second dose correlated significantly with the percent antibody response (ρ = 0.33 for both binding assays), see
Table 2. This finding suggests that the increase of antibodies after a second shot, which is detected by both binding assays, can be substantiated by an accompanying cellular reaction. In contrast, we found no correlation between the relative changes in cellular and sVNT response, which might be partly explained by the limited measurement range of the sVNT. However, because not all antibodies formed are functionally active neutralizing antibodies (NAbs), even not all of those specifically directed against the receptor-binding domain (RBD) of the spike protein, the binding antibodies may be superior to the measurement of NAbs here as a correlate for cellular activation.
This study has several strengths and limitations: although 50 participants might be considered a relatively small cohort, we have shown in previous work that this number is sufficient for such comparative approaches and that our data could be replicated in much larger cohorts (
16,
46). One strength of our study is that we followed exact time points for blood sampling in the context of a prospective observational study. A limitation is that we did not perform measurements beyond 3 weeks after the second dose. Thus, whether a constant ratio would be observed after a specific time is unclear. Furthermore, our cohort using AZD1222 (inducing significantly lower median antibody levels than, e.g., BNT162b2) has the advantage of a broader distribution of values across the measurable spectrum with a very low proportion of results above 1,000 BAU/mL. As this value represents the upper limit of referencing with the WHO SARS-CoV-2 antibody standard, a linear relationship is no longer guaranteed for values above this, leading to unwanted biases in comparing different antibody tests.
In summary, with the present work, we show for the first time that the comparability of quantitative anti-spike SARS-CoV-2 antibody tests is highly dependent on the timing of blood collection. Although the results of the two assays studied correlate well at all time points, a numerical agreement is only possible through a correction factor, which changes over time after both the first dose of vaccine and the stimulus of the second dose of vaccine. Concerning boosters with a 3rd and possibly fourth dose, we must assume that the relationship between two antibody assays may be in a constant state of change. Therefore, it does not seem feasible to compare different quantitative SARS-COV-2 antibody results without standardization of the time of sample collection.