| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Previous Article | Next Article ![]()
Clinical and Vaccine Immunology, April 2008, p. 644-649, Vol. 15, No. 4
1071-412X/08/$08.00+0 doi:10.1128/CVI.00473-07
Copyright © 2008, American Society for Microbiology. All Rights Reserved.

Naval Institute for Dental and Biomedical Research, Great Lakes, Illinois,1 General Dynamics Information Technology, Frederick, Maryland,2 Biological Monitoring Laboratory Section, Biomonitoring and Health Assessment Branch, National Institute for Occupational Safety and Health (NIOSH), Centers for Disease Control and Prevention, Cincinnati, Ohio3
Received 27 November 2007/ Returned for modification 21 January 2008/ Accepted 20 February 2008
| ABSTRACT |
|---|
|
|
|---|
4 or
50 µg/ml PA-specific IgG, the LFA results for each environmental condition were identical to those obtained in the laboratory. These data indicate that this rapid point-of-care test would be a feasible tool in monitoring the serological antibody responses of individuals that have been vaccinated against anthrax. | INTRODUCTION |
|---|
|
|
|---|
The 83-kDa protective antigen (PA) is a highly immunogenic protein that is the principal immunogen of the current vaccine (14). The vaccine elicits an anti-PA antibody response in humans (1, 4, 5, 15, 22-24, 28) as well as in several animal models (9, 11-13, 16, 17, 20, 21). The blood anti-anthrax PA immunoglobulin G (IgG) level is considered to be an effective indicator for assessing vaccine efficacy (27).
Antibody responses to AVA and its principal component of PA are not routinely monitored in vaccine recipients. In the past, scientists have used laboratory-based tests to assess the immune response evoked by the anthrax vaccine. A quantitative enzyme-linked immunosorbent assay (ELISA) (25) and a multiplexed fluorescent covalent microsphere immunoassay (3) have been developed for the serological detection of PA-specific IgG. Unfortunately, neither of these tests is practical in field settings, as they require laboratory equipment and highly trained personnel.
With advancing technology, the development and commercialization of screening tests are moving toward rapid point-of-care assays. Lateral flow assays (LFAs) are semiquantitative colorimetric tests that are well established in the public sector (e.g., to test for pregnancy, drugs of abuse, and human immunodeficiency virus). The lateral flow-style test is subdivided into cassette, card, and dipstick configurations. Although these test configurations are performed differently, they function through the same basic principle. The donor's specimen and chase buffer are applied to the sample pad. The sample flows via capillary action through a conjugate pad (i.e., impregnated with conjugated gold or latex particles) and across a nitrocellulose membrane that has a test stripe and a control stripe. For detecting disease or monitoring vaccination status, the device is usually designed to detect the presence of specific antibodies. If disease-specific antibodies are present in the specimen, they will react with the test stripe, containing the diagnostic target molecule. A control stripe, designed to test the performance of the assay, can be biotin, to which conjugated gold streptavidin migrates. The results are obtained after 15 to 20 min with the unaided eye.
To detect anti-PA antibodies in serum and whole blood, Biagini et al. developed a blood-based LFA (4). In that study, samples from 18 vaccinated individuals with relatively high concentrations (52 to 340 µg/ml) of PA-specific IgG were tested. With these samples, the diagnostic sensitivity and specificity of the LFA were 100%, with ELISA-measured anti-PA used as the standard. Additionally, a human anti-anthrax vaccine serum standard was used, which determined the detection limit of the LFA to be 2.8 µg/ml of PA-specific IgG.
The aim of this study was to determine whether the above-mentioned LFA maintains sensitivity and specificity in a cohort with a broad range of anthrax-specific antibody concentrations (from below the ELISA minimum detection concentration [MDC; 3 µg/ml PA-specific IgG] to 708 µg/ml). Also, simulation experiments were conducted to determine the stability of the LFA in environments that are commonly encountered under field conditions. The latter experiments included exposure of the devices to fluctuating temperature and humidity cycles (i.e., thermal shock, high temperature/high relative humidity [RH], high temperature/low RH, and low temperature/low RH).
| MATERIALS AND METHODS |
|---|
|
|
|---|
Specimens. As described previously, blood was collected from the participants, using a 21-gauge needle and a serum separation Vacutainer tube (Becton Dickinson, Franklin Lakes, NJ) (5, 15). After the whole blood was allowed to clot, it was centrifuged (1,470 x g) and the supernatant collected. Serum samples used for the immunoassays were frozen at –35°C or less until needed.
As a gold standard for comparison, a quantitative ELISA was used to characterize the specimens by their amounts of PA-specific IgG (25). The authors determined that the MDC of the serum antibody ELISA using standard reference serum pool AVR414 is 3.0 µg/ml.
For environmental stability testing, 25 specimens were divided into arbitrary groups, with 0, 4 to 10, 11 to 15, 20 to 50, 150 to 180, and >250 µg/ml of PA-specific IgG. For each of these groups, the specimens were tested consecutively in quadruplicate.
Antigen source. Recombinant PA (rPA) was used as the target molecule in the immunoassays. For the ELISA, rPA in 10 mM Tris buffer was obtained from BioPort Corp. To verify its authenticity, this preparation was tested by mass spectrometry, N-terminal sequencing, amino acid analysis, and immunoblot analysis (5, 15). The antigen used for the LFA was purchased from List Biological Laboratories, Inc. (Campbell, CA). As described below, parallel ELISA testing with the two antigen preparations was conducted to ensure that the results obtained from these assays were comparable. Specifically, with the same reagent concentrations and ELISA procedure, both rPA preparations were tested with 20 serum samples in replicate.
LFA. The LFA device for the detection of anti-PA IgG was manufactured under contract with Arista Biologicals, Inc. (Allentown, PA), as a single-antigen direct sandwich assay. Some of the details in the preparation of the device were proprietary. The device consists of a plastic support to which a nitrocellulose membrane (thickness, 205 ± 1 µm) is mounted. Purified anthrax rPA (List Biological Laboratories, Inc.) was striped in the "test line" position (2 mg/ml), while a biotinylated bovine serum albumin conjugate was striped in the "control line" position (2 mg/ml). Gold particles (40 nm) individually conjugated to PA and streptavidin were prepared and mixed. The mixture of PA and streptavidin colloidal gold conjugate was dispensed onto a conjugate pad. The conjugate pad was then affixed to the test strip by overlapping the nitrocellulose membrane at its proximal end; the addition of a sample pad completed the assembly by overlapping onto the conjugate pad. Individual lateral flow devices were sealed in a foil pouch with a desiccant to protect the test strips.
Prior to the opening of the foil pouch and the conducting of the test, the devices were allowed to reach room temperature. To assess the antibody response to anthrax immunizations, 30 µl of serum and 3 drops of chase buffer (50 mM phosphate buffer containing 0.1% Igepal CA-720, 0.03% sodium dodecyl sulfate, 1% bovine serum albumin, and 0.1% sodium azide) were applied to the sample pad. When anthrax-specific antibodies were present in the specimen, they reacted with the test stripe, which contained rPA. Nonspecific antibodies were bound at the control line. Qualitative positive and negative results were visually obtained with the unaided eye after 20 min. Any staining visible at the test line was considered to be a positive reaction.
ELISA. To compare the two rPA preparations, an ELISA was used according to the method of Quinn et al. (25), with modifications. Two hundred nanograms of rPA in 10 mM phosphate-buffered saline (PBS) (pH 7.4) was adsorbed onto the wells of an Immulon 2-HB polystyrene 96-well plate (Thermo Electron Corp., Milford, MA). The plates were incubated at 4°C overnight and subsequently washed with 10 mM PBS containing 0.1% Tween 20. The serum samples were diluted 1:100 in blocking buffer (PBS containing 5% skim milk and 0.1% Tween 20), added to antigen-coated wells, and incubated for 1 h at 37°C. Each serum sample (n = 20) was analyzed on each of two separate days. The plates were then washed and incubated with 100 µl of mouse anti-human PAN IgG-specific horseradish peroxidase conjugate (for all four subclasses of IgG; Hybridoma Reagent Laboratories, Baldwin, MD) (diluted 1:16,000) for 1 h at 37°C. Peroxidase activity was detected by the addition of a peroxidase substrate system (Kirkegaard & Perry Laboratories, Inc., Gaithersburg, MD) that contained 2,2'-azino-di-(3-ethylbenzthiazoline-6-sulfonate) in glycine-citric acid buffer. The reactions were terminated by adding 1% sodium dodecyl sulfate, and the absorbance values were measured at 405 nm (490-nm reference filter) using a Thermo Labsystems MRX Revelation microtiter plate reader (Chantilly, VA).
Environmental exposure. Simulated environmental exposure testing consisted of exposing the cassettes and buffer solution to conditions of thermal shock, high temperature/high RH, high temperature/low RH, and low temperature/low RH. Exposure temperatures and humidity levels were based on meteorological data for countries to which the supplies are most likely to be deployed. For each set of conditions, 112 cassettes and 12 ml of buffer solution were tested. With the exception of the thermal shock treatment, the materials were conditioned in an environmental chamber (model WP-216-THCM1-3-3; Thermotron Industries, Holland, MI) for 2 h at 23°C and 50% RH immediately prior to exposure testing. Following conditioning, the materials were subjected to one of the exposure conditions. After the completion of the exposure period, the materials were removed from the chamber and tested. A new group of devices was tested for each of the exposure conditions. Specific procedures for attaining the simulated environmental exposure conditions are provided below.
For thermal shock exposure, the materials were placed in the environmental chamber and conditioned for 2 h at 23°C and 35% RH. The temperature was then lowered to –40°C and the humidity allowed to reach in-chamber ambient levels (
50%) over a 1.5-h period. The materials were maintained at that temperature and humidity for 4 h. The chamber temperature and humidity were then changed to 65°C and 35% RH over a 2-h period. This temperature and humidity condition was maintained for 4 h, after which the chamber temperature was adjusted to 23°C over a 1-h period and a new cycle begun. Five cycles were run without interruption. The materials were then removed from the chamber.
For the high-temperature/high-RH exposure, the chamber temperature and humidity were raised to 65°C and 75% RH over a 1-h period. The materials were then exposed to these conditions for a period of 96 h. At the end of the exposure period, the chamber conditions were returned to 23°C and 50% RH over a 1-h period. After 2 h under these conditions, the materials were removed.
For the high-temperature/low-RH exposure, the chamber temperature was adjusted to 65°C and the humidity allowed to reach in-chamber ambient levels (
15%) over a 1-h period. The materials were exposed to these conditions for a period of 96 h. At the end of the exposure period, the chamber was returned to 23°C and 50% RH over a 1-h period. After 2 h under these conditions, the materials were removed.
For the low-temperature/low-RH exposure, the chamber temperature was adjusted to –40°C and the humidity allowed to reach in-chamber ambient levels (
50%) over a 1.5-h period. The materials were exposed to these conditions for a period of 96 h. At the end of the exposure period, the chamber was returned to 23°C and 50% RH over a 1-h period. After 2 h under these conditions, the materials were removed.
Statistical analyses. The diagnostic performance of the LFA was computed using the following definitions and anti-PA IgG ELISA results as the "gold standard": TP, true-positive diagnostic test result; TN, true-negative diagnostic test result; FN, false-negative diagnostic test result; and FP, false-positive diagnostic test result. Sensitivity [TP/(TP + FN) x 100] was computed as the percentage of positive LFA test responses for subjects with positive ELISA responses. Specificity [TN/(FP + TN) x 100] was computed as the percentage of negative LFA test responses for subjects with negative ELISA responses. Diagnostic efficiency [(TP + TN)/(TP + FP + TN + FN) x 100] describes the percentage of subjects correctly classified as having positive and negative anti-PA IgG results by LFA. Receiver operating characteristic (ROC) curves were calculated (SigmaPlot 10; Systat Software, Inc., San Jose, CA) as previously described (2). An averaging method was used to minimize bias in cases in which sera had anti-PA IgG results below the limit of detection of the ELISA (10). A Kolmogorov-Smirnov test (SigmaStat; Systat Software, Inc.) was used to investigate whether the data distribution was consistent with normality. Simple linear regression was used to evaluate the correlation between log10 anti-PA IgG values, percentages of positive LFA responses, numbers of AVA injections, and levels of PA-specific IgG detected by rPA (obtained from BioPort Corp. and List Biological Laboratories, Inc.). The anti-PA IgG threshold for maximal diagnostic efficiency was determined using logistic regression, with the equation y = 0.5 (SAS 9.1; SAS Institute, Inc., Cary, NC). Differences in rates of positive test results between the laboratory condition and the combined environmental test exposures for the groups with PA-specific IgG levels of 4 to 10, 11 to 15, and 20 to 50 µg/ml were analyzed using exact chi-square methods (which are necessary when cell frequencies are at or near 0) (StatXact; Cytel Software Corp.) for differences between two independent proportions.
| RESULTS |
|---|
|
|
|---|
|
|
|
|
|
Environmental testing. For all environmental conditions, the LFA results were identical for samples containing <4 or >50 µg/ml PA-specific IgG (Table 2). For sera with 4 to 10 µg/ml PA-specific IgG, there was not a significant effect of environmental exposure on the devices, as the false-positive rates were similar to those observed with devices that were maintained under laboratory conditions. Similarly, for PA-specific antibody concentrations of 11 to 15 and 20 to 50 µg/ml, there was no statistically significant evidence that environmental manipulations degraded the performance of the device.
|
| DISCUSSION |
|---|
|
|
|---|
The level of anti-PA IgG which is protective against anthrax exposure in humans has not been established (24). Protection against cutaneous or inhalational anthrax exposure in AVA-treated individuals is inferred upon receipt of the AVA vaccine. Anti-PA antibody levels are not routinely measured either after the AVA injection series or after booster injections. The major reason for this is that anti-PA IgG measurements are laboratory based, necessitating specific equipment and trained personnel (3, 25).
Biagini et al. (4) reported on an LFA which displayed 100% sensitivity and specificity and a positive cutoff of 2.8 µg/ml compared to ELISA anti-PA IgG values. These values ranged from nondetectable to 340 µg/ml for sera from vaccinees who received the FDA-cleared AVA regimen. In the present report, anti-PA IgG values ranged from nondetectable to 708 µg/ml with the vaccinated subjects receiving between one and six AVA injections. The anthrax LFA had a 92% diagnostic sensitivity and 98% diagnostic specificity at a maximal diagnostic efficiency cutoff (based on ELISA anti-PA IgG) of 11 µg/ml. The ROC area under the curve at this concentration was 0.988, suggesting that the LFA is an extremely accurate diagnostic test.
Choosing the optimal decision cutoff is a compromise between optimizing sensitivity and specificity. The optimal decision threshold reported in the present analysis assumed that the cost of a false-positive result and the cost of a false-negative result were equal. This is not the case in outcomes of exposure to anthrax when preexisting immunity is not adequate for protection. Further complicating the analysis is that the level of immunity necessary to protect from the consequences of anthrax exposure is not known, the level of protection in a vaccinated individual is related to the absorbed dose of anthrax spores (a high enough dose of anthrax could overcome preexisting immunity), and the level of putative protective immunity is based on the number of doses of AVA received. This was shown in the present work by the orthogonal relationships between anti-PA IgG concentrations, the percentages of subjects found positive for anti-PA IgG by LFA, and the numbers of doses of AVA received by the subjects.
Like those of other diagnostic tests, the components of the LFA are susceptible to environmental conditions and gradually deteriorate, even under ideal storage. Most manufacturers recommend that their products be stored at 4 to 30°C, and the expiration dates assume that these conditions are met. For field applications, temperatures above this level are often unavoidable. Exposure of rapid diagnostic tests to constant temperatures above 45°C has been reported to result in (i) warping of the test strip, (ii) a defect in the nitrocellulose membrane that hampers sample flow, (iii) a failing control line (8), and (iv) lost diagnostic sensitivity (8, 18). For the rapid diagnosis of disease, it appears that the effect of freezing needs to be considered on a case-by-case basis. For instance, storage for 21 days at –20°C and –80°C yielded results comparable to those observed at 4°C for samples with Yersinia pestis F1 antigen (7). Conversely, freeze-thaw with a rapid test for malaria caused a reduction in sensitivity at lower parasite densities (8). Humidity has also been reported to adversely affect the performance of rapid diagnostic tests as a result of a failed control line (7) or a decrease in diagnostic sensitivity (19).
While these studies with constant temperatures are indicators of environmental effects on rapid diagnostic tests, they may not reflect test performance in the field, as the ambient temperature in the field could fluctuate greatly within a 24-hour period. With this in mind, we exposed the LFA to fluctuating temperatures and RHs. The diagnostic performance of the LFAs in the present experiment was not affected by temperatures/humidities of 65°C and 15% to 75% RH and –40°C and
50% RH. Nonetheless, we anticipate that subsequent field/clinical trials will need to evaluate numerous temperature and humidity cycles, as there may be poorly controlled transport conditions and infrequent resupply to remote sites.
With this rapid point-of-care test, it would be easy to screen vaccinated individuals prior to deployment to ensure that antibody levels of deferred vaccinees have achieved an appropriate concentration (i.e., a level of PA-specific IgG that is comparable to those in recipients of an uninterrupted AVA regimen). When a discrepancy is observed, additional immunizations may be recommended.
With the advancement of technology, it is probable that the anthrax vaccine regimen will change. A recent human clinical trial indicated that administration of the currently licensed vaccine may be changed from subcutaneous to intramuscular. As well, the number of priming doses may be reduced (J. Wright, A. Seright, J. Wheeling, S. Parker, M. Mulligan, J. Babcock, W. Keitel, H. E. Sahly, G. Poland, R. Jacobson, H. Keyserling, B. Plikaytis, S. Martin, C. Rose, C. P. Quinn, and N. Marano, presented at the International Conference on Bacillus anthracis, B. cereus, and B. thuringiensis, Oslo, Norway, 17 to 21 June 2007). For new anthrax vaccine candidates, it is expected that PA will be a component, as anti-PA is a major correlate of protection. Recently, Selinsky et al. have identified a positive quality control and standard reference sera and developed an ELISA to measure anthrax lethal factor (LF)-binding IgG (26). With this, they have elucidated the antibody response and anticipate an assessment of the contribution of the LF-specific immune response to protection against anthrax. As the correlates of protection against B. anthracis continue to be defined, it may be useful to develop a multiplexed LFA, such that a single sample could be simultaneously screened for anti-PA and anti-LF antibodies. Moreover, it may be possible to modify this LFA to utilize noninvasively collected specimens, because the salivary PA-specific IgG response parallels that observed in serology (5).
| ACKNOWLEDGMENTS |
|---|
We appreciate the provision by BioPort Corp. of purified rPA and specific antibodies developed against it. We offer special thanks to M. E. Cohen and C. K. Chang for providing statistical consulting and skilled technical assistance, respectively.
The views expressed in this article are those of the authors and do not necessarily reflect the official policy or positions of the Department of the Navy, the Department of Defense, or the U.S. Government. The use of commercially available products does not imply the endorsement of these products or preferences to other, similar products on the market. We are military service members or employees of the U.S. Government. This work was prepared as part of our official duties. Mention of a product or company name does not constitute endorsement by NIOSH. The content and conclusions of this report are those of the authors and do not necessarily represent the views of the National Institute for Occupational Safety and Health.
| FOOTNOTES |
|---|
Published ahead of print on 5 March 2008. ![]()
| REFERENCES |
|---|
|
|
|---|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Antimicrob. Agents Chemother. | Clin. Microbiol. Rev. | Infect. Immun. |
|---|---|---|
| J. Clin. Microbiol. | J. Virol. | ALL ASM JOURNALS |