Free access
Research Article
November 2013

Simultaneous Detection of Major Drug Resistance Mutations in the Protease and Reverse Transcriptase Genes for HIV-1 Subtype C by Use of a Multiplex Allele-Specific Assay

ABSTRACT

High-throughput, sensitive, and cost-effective HIV drug resistance (HIVDR) detection assays are needed for large-scale monitoring of the emergence and transmission of HIVDR in resource-limited settings. Using suspension array technology, we have developed a multiplex allele-specific (MAS) assay that can simultaneously detect major HIVDR mutations at 20 loci. Forty-five allele-specific primers tagged with unique 24-base oligonucleotides at the 5′ end were designed to detect wild-type and mutant alleles at the 20 loci of HIV-1 subtype C. The MAS assay was first established and optimized with three plasmid templates (C-wt, C-mut1, and C-mut2) and then evaluated using 148 plasma specimens from HIV-1 subtype C-infected individuals. All the wild-type and mutant alleles were unequivocally distinguished with plasmid templates, and the limits of detection were 1.56% for K219Q and K219E, 3.13% for L76V, 6.25% for K65R, K70R, L74V, L100I, K103N, K103R, Q151M, Y181C, and I47V, and 12.5% for M41L, K101P, K101E, V106A, V106M, Y115F, M184V, Y188L, G190A, V32I, I47A, I84V, and L90M. Analyses of 148 plasma specimens revealed that the MAS assay gave 100% concordance with conventional sequencing at eight loci and >95% (range, 95.21% to 99.32%) concordance at the remaining 12 loci. The differences observed were caused mainly by 24 additional low-abundance alleles detected by the MAS assay. Ultradeep sequencing analysis confirmed 15 of the 16 low-abundance alleles. This multiplex, sensitive, and straightforward result-reporting assay represents a new efficient genotyping tool for HIVDR surveillance and monitoring.

INTRODUCTION

It is estimated that >8.2 million people were receiving antiretroviral therapy (ART) in low- and middle-income countries at the end of 2011, a dramatic 26-fold increase from 2003 (1). As access to ART continues to expand worldwide and without adequate virological monitoring of patients on ART, the emergence and transmission of HIV drug resistance (HIVDR) are valid concerns. In resource-limited settings, studies have revealed that transmitted drug resistance (DR) in recently HIV-infected populations is rising in some countries where access to ART had previously been expanded (26), while acquired DR had been detected in a majority of the patients failing to respond to ART (3, 7, 8).
To preserve the efficacy of the limited first-line antiretroviral (ARV) drugs and to prevent the emergence and transmission of HIVDR, it is imperative to conduct HIVDR surveillance and monitoring in resource-limited settings. Data from DR surveillance and monitoring will allow for making evidence-based decisions on the need for ART guideline changes and assisting in the promotion of best practices in the provision of ART services that lead to higher rates of viral suppression and prevention of both acquired and transmitted HIVDR (9, 10).
In the past few decades, two types of genotypic DR detection assays, sequencing-based and allele-specific assays, have been developed for detecting HIVDR mutations. Conventional sequencing-based assays, such as the FDA-approved and commercially available genotyping assays, ViroSeq (11) and TruGene (12), and many in-house assays (1315), have been widely used for HIVDR detection analyses in clinical settings and surveillance purposes. These assays can provide detailed sequence information and detect all possible mutations that are present in an amount above the detection limit, but they are generally labor-intensive and not sensitive enough to detect low-abundance mutations. Ultradeep sequencing and single-genome sequencing have also been utilized in HIVDR detection analyses in recent years and are highly sensitive in detecting low-abundance mutations; however, these assays require highly technical skills and are expensive, and they have not been used in routine surveillance in resource-limited settings (1618).
The other type of genotypic assay is allele-specific assays. Several allele-specific assays have been developed, including oligonucleotide ligation assay (OLA), parallel allele-specific sequencing (PASS) (19, 20), allele-specific PCR (AS-PCR) (2129) and LigAmp (21, 30). These assays offer substantial improvements in their detection sensitivity over conventional sequencing-based assays and are less expensive, and the results are easy to interpret. However, a major limitation of existing allele-specific assays is that they can only detect one or a few mutations at a time. This has limited their use in routine HIVDR surveillance and monitoring. Here, we report the development of a multiplex allele-specific (MAS) DR detection assay based on suspension array technology (31, 32) for high-throughput and sensitive detection of HIVDR mutations, which may be a feasible genotyping tool for large-scale HIVDR surveillance and monitoring in resource-limited settings.
(Data from this study were presented in part at the International Workshop on HIV and Hepatitis Virus Drug Resistance and Curative, 5 to 9 June 2012, Sitges, Spain.)

MATERIALS AND METHODS

Design of allele-specific primer extension primers.

Based on the current WHO recommendations for first- and second-line ARVs in resource-limited settings, we designed allele-specific primer extension (ASPE) primers targeting the drug resistance mutations (DRMs) at 20 loci of HIV-1 subtype C that are associated with resistance to commonly used ARVs in resource-limited settings. These include eight mutations associated with resistance to nucleoside reverse transcriptase inhibitors (NRTIs) (M41L, K65R, K70R, L74V, Y115F, Q151M, M184V, and K219Q/E), seven mutations associated with resistance to nonnucleoside reverse transcriptase inhibitors (NNRTIs) (L100I, K101P/E, K103N/R, V106A/M, Y181C, Y188L, and G190A), and five mutations associated with resistance to protease inhibitors (PIs) (V32I, I47A/V, L76V, I84V, and L90M). For each of the 20 mutation loci, one ASPE primer was designed for the wild-type (WT) and one or two primers were designed for the mutant (Mut) allele(s) based on the HIV-1 subtype C consensus sequence obtained from the HIV sequence database (see http://www.hiv.lanl.gov/content/sequence/NEWALIGN/align.html). Since five loci have two types of Mut alleles, 20 WT alleles and 25 Mut alleles were included in the assay (i.e., a total of 45 ASPE primers were designed). The specificity of each primer was confirmed by NCBI BLAST program analyses (http://www.ncbi.nlm.nih.gov/BLAST/). The ASPE primers contained an allele-specific nucleotide at the 3′ end for each of the WT and Mut alleles, and at the 5′ end, they contained a unique 24-base Tag (Luminex Corp., Austin, TX) that is complementary to the anti-Tag on each of the MagPlex-TAG microspheres (Luminex Corp.) for distinguishing each of the alleles by the suspension array system. We incorporated degenerate bases into the primers to accommodate polymorphisms adjacent to the targeted alleles. The lengths of primers were between 24 and 39 nucleotide bases with melting temperatures (Tm) of around 60°C. Table 1 shows the 45 ASPE primer sequences.
Table 1
Table 1 ASPE primers for HIV-1 group M subtype C
Primer no.TypeaSequence (5′ to 3′)Tag IDbPositionc
1M41Tag-AAG ARA AAA TAA AAG CAT TAA YAG MAA TTT GTG AWG ARA452632→2670
241LTag-AAG ARA AAA TAA AAG CAT TAA YAG MAA TTT GTG AWG ARC382632→2670
3K65Tag-AAA TCC ATA TAA CAC TCC ART ATT TGC YAT AAA RAA122708→2743
465RTag-AAA TCC ATA TAA CAC TCC ART ATT TGC YAT AAA RAG132708→2743
5K70Tag-CCA GTA TTT GCC ATA AAG ARG AAR GAY AGT ACT AA182724→2758
670RTag-CCA GTA TTT GCC ATA AAG ARG AAR GAY AGT ACT AG212724→2758
7L74Tag-CAT AAA AAA GAA RGA CAG TAC HAR RTG GAG AAA AT672735→2769
874VTag-CAT AAA AAA GAA RGA CAG TAC HAR RTG GAG AAA AG902735→2769
9Y115Tag-AGT RCT RGA YGT GGG RGA TGC ATA732870→2893
10115FTag-AGT RCT RGA YGT GGG RGA TGC ATT622870→2893
11Q151Tag-GGA TTA GRT ATC AAT ATA ATG TRY TNC CAC292971→3000
12151MTag-GGA TTA GRT ATC AAT ATA ATG TRY TNC CAA362971→3000
13M184Tag-AGR GCA AAA AAT CCA GAM RTR GTY ATC TRY CAA TAY A373063→3099
14184VTag-AGR GCA AAA AAT CCA GAM RTR GTY ATC TRY CAA TAY G223063→3099
15K219Tag-AAR TGG GGR TTT ACY ACA CCA GAC A533180→3204
16219QTag-AAR TGG GGR TTT ACY ACA CCA GAC C443180→3204
17219ETag-AAR TGG GGR TTT ACY ACA CCA GAK G963180→3204
18L100Tag-CAA TTA GGR ATA CCA CAC CCA KCA GGR T422820→2847
19100ITag-CAA TTA GGR ATA CCA CAC CCA KCA GGR A582820→2847
20K101Tag-AAT TAG GRA TAC CAC ACC CAK CAG GRW TRA552821→2850
21101PTag-AAT TAG GRA TAC CAC ACC CAK CAG GRW TRC C892821→2851
22101ETag-AAT TAG GRA TAC CAC ACC CAK CAG GRW TRG652821→2850
23K103Tag-GAA TAC CAC ACC CAK CAG GGT TRA ARA AGA AA192827→2858
24103NTag-GAA TAC CAC ACC CAK CAG GGT TRA ARA AGA AY662827→2858
25103RTag-GAA TAC CAC ACC CAK CAG GGT TRA ARA AGA GA632827→2858
26V106Tag-ACA CCC AKC AGG GTT AAA RAA GAA HAA RTC WGT202834→2866
27106ATag-ACA CCC AKC AGG GTT AAA RAA GAA HAA RTC WGC392834→2866
28106MTag-CAC ACC CAK CAG GGT TAA ARA AGA AHA ART CWA752833→2865
29Y181Tag-GCC CTT TAG RRC AMA AAA TCC AGA MVT RGT YAT CTA93056→3091
30181CTag-GCC CTT TAG RRC AMA AAA TCC AGA MVT RGT YAT CTG823056→3091
31Y188Tag-CAG AAA TRG TYA TCT RTC AAT AYR TRG ATG AYT TRT A833076→3112
32188LTag-CAG AAA TRG TYA TCT RTC AAT AYR TRG ATG AYT TRC T933076→3112
33G190Tag-ATA GTY ATC TRT CAA TAT RTG GAT GAC TTR TAT GTR GG973081→3118
34190ATag-ATA GTY ATC TRT CAA TAT RTG GAT GAC TTR TAT GTR GC763081→3118
35V32Tag-CTC TYT TAG AYA CAG GAG CAG ATG AYA CAG142317→2346
3632ITag-CTC TYT TAG AYA CAG GAG CAG ATG AYA CAA482317→2346
37I47Tag-TGC CAG GRA RAT GGA AAC CAA RAA TRA302365→2391
3847VTag-GCC AGG RAR ATG GAA ACC AAR AAT RGT432366→2392
3947ATag-GCC AGG RAR ATG GAA ACC AAR AAT RGC782366→2392
40L76Tag-AAA TTT GTG GRA AAA ARG CTR TAG GTA CAG TRT282446→2478
4176VTag-AAA TTT GTG GRA AAA ARG CTR TAG GTA CAG TRG702446→2478
42I84Tag-AGT ATT ART RGG RCC TAC ACC TGT CAA YA352474→2502
4384VTag-AGT ATT ART RGG RCC TAC ACC TGT CAA YG772474→2502
44L90Tag-CCT ACA CCT GTC AAC ATA ATT GGR AGR AAY HTR T952487→2520
4590 MTag-CCT ACA CCT GTC AAC ATA ATT GGR AGR AAY HTR A572487→2520
a
One primer was designed for each wild-type and mutant allele at 20 drug resistance mutation loci, and five loci have two types of mutant allele, so a total of 45 ASPE primers were designed.
b
Each Tag matches with one of the MagPlex-TAG microspheres (Luminex Corp., Austin, TX, USA). ID, identification.
c
Positions based on HXB2 sequence positions from 5′ to 3′.

Construction of HIV-1 subtype C wild-type and mutant plasmids.

In the initial assay development, three 990-bp DNA fragments representing WT and Mut types based on the subtype C reference sequence (GenBank accession no. AF457054) (33) were designed. The DNA fragments were synthesized and individually cloned into pUCminusMCS plasmids by Blue Heron Biotechnology (Bothell, WA). Plasmid C-wt contains the wild-type HIV-1 subtype C partial pol gene between nucleotides 2294 and 3283, according to the HIV strain HXB2 reference sequence (34). Plasmid C-mut1 carries the DRMs V32I, I47V, L76V, I84V, and L90M in the protease region, and M41L, K65R, K70R, L74V, L100I, K101P, K103N, V106A, Y115F, Q151M, Y181C, M184V, Y188L, G190A, and K219Q in the reverse transcriptase (RT) region. Plasmid C-mut2 carries the DRM I47A in the protease region and K101E, K103R, V106M, and K219E in the RT region. These three plasmids were used in the initial assay development, optimization, and sensitivity determination.

Development of the multiplex allele-specific HIVDR assay for HIV-1 subtype C.

To test the validity of each of the ASPE primers, we amplified the plasmid DNAs individually by PCR. One microliter of 10 ng/μl plasmid DNAs (equivalent to 1,618 viral DNA copies) was added to 100 μl of the PCR mixture, containing 0.2 μM primers M13F (5′-CCCAG TCACG ACGTT GTAAA ACG-3′) and M13R (5′-AGCGG ATAAC AATTT CACAC AGG-3′), 1× High Fidelity PCR buffer, 2.0 mM MgSO4, and 2.0 U of Platinum Taq High Fidelity (Life Technologies, Bethesda, MD). PCR was conducted as follows: 2 min at 94°C, 30 cycles of 20 s at 94°C, 20 s at 55°C, and 90 s at 68°C, and 5 min at 68°C. The PCR products were purified using the ExoSAP-IT PCR cleanup kit (USB Co., Cleveland, OH). The purified PCR products of plasmids C-wt and C-mut1, a mixture of the two at a 1:1 ratio (wt/wt), and a no-target PCR negative control (NC) were used to validate each of the WT and Mut ASPE primers. A multiplex ASPE assay was optimized for several factors affecting the specificity and signal output. These included Mg2+ concentration, polymerase concentration, cycling parameters, annealing temperature, ASPE primer length, ASPE primer concentrations, and the amount of PCR product used in the ASPE reaction mixture. Once the specificities of the individual primers were confirmed and the assay conditions were optimal, we combined all 45 ASPE primers and performed the multiplex ASPE (mASPE) assay in a single tube using Tsp DNA polymerase (Invitrogen, Carlsbad, CA) and reaction buffer that allows for a relatively wide range of annealing temperatures. Briefly, for each 20-μl mASPE reaction mixture, it contained 5 μl purified PCR product, 1.5 U Tsp DNA polymerase, 9.5 × 1011 copies of each ASPE primer (Table 1), 10.0 μM (each) dATP, dTTP, dGTP, and biotin-dCTP (Invitrogen, Carlsbad, CA), 20.0 mM Tris-HCl (pH 8.4), 50.0 mM KCl, and 1.88 mM MgCl2. The reaction mixtures were subjected to the following PCR conditions: initial denaturation at 96°C for 2 min followed by 30 cycles of 94°C for 30 s, 55°C for 1 min, and 74°C for 2 min. Next, 10 μl of mASPE products was added to a 40-μl microsphere hybridization mixture containing 2.2 × 103 of each microsphere set and 2× Tm hybridization buffer (0.2 M Tris-HCl [pH 8.0], 0.4 M NaCl, 0.16% Triton X-100). The ASPE-bead mixtures were subjected to denaturation at 96°C for 90 s and annealing at 37°C for 30 min, and the reaction mixtures were placed on a magnetic separator for 60 s. After discarding the supernatant, the microspheres were resuspended in 100 μl 1× Tm hybridization buffer containing 4 μg/ml streptavidin R-phycoerythrin (Molecular Probes, Eugene, OR) and incubated at 37°C for 15 min. Finally, the 100-μl reaction mixture was analyzed with the Bio-Plex 3D suspension array system to determine the median fluorescence intensity (MFI) value for at least 100 microspheres for each of the 45 sets of microspheres. The MFI value for each bead set was corrected by subtracting the value of the no-target PCR negative control, and the resulting net MFI values were used for the calculation of the allelic ratio (AR). The AR is equal to the net MFI for an allele divided by the sum of the net MFIs for all alleles tested for a given mutation site, which represents the fraction of the total net MFI signal for the mutation site attributed to the presence of a particular allele. Threshold values were determined according to procedures described in previous studies (35, 36); an AR of ≥0.10 indicated the presence of a particular allele, and if more than one allele had an AR of ≥0.10, a mixture was called. Figure 1 is a schematic illustration of the mASPE and suspension array analysis processes.
Fig 1
Fig 1 Schematic illustration of the MAS assay. The MAS assay starts with an allele-specific primer extension (ASPE) with all allele-specific primers mixed together in one reaction tube containing the reaction reagent mixture and a template. For the primer with a matching 3′-terminal nucleotide, primer extension occurs and biotinylated dCTPs are incorporated into the extended product. During the hybridization step, ASPE products are uniquely annealed to microspheres through the specificity of Tag/anti-Tag recognition. Finally, the hybridization products are read with the suspension array system, which identifies each microsphere set by its internal dye and records the associated reporter dye intensity as the mean fluorescence intensity (MFI).

Determination of the assay sensitivity.

To determine the sensitivity of the MAS assay for each of the Mut alleles, we diluted the two Mut plasmid DNAs with the WT plasmid DNA. Ten nanograms per microliter of C-mut1 or C-mut2 plasmid DNA was mixed with the WT plasmid DNA, resulting in 2-fold serial dilutions with Mut template at levels of 100%, 50%, 25%, 12.5%, 6.25%, 3.12%, 1.56%, and 0%. One microliter of each serial dilution was used for PCR amplification, and each of the 5-μl amplicons was used to perform a multiplex ASPE assay with all 45 ASPE primers in a single tube reaction, and 10 μl of the mASPE products was analyzed following the procedure described above. The sensitivity of the assay for each allele was determined based on the results from three independent experiments. The lowest concentration at which all three replicates were positive was defined as the sensitivity of the assay for a given allele.

Application of the MAS assay with clinical specimens.

Plasma specimens collected from 148 individuals infected with HIV-1 subtype C from Zambia and Malawi (37, 38) with known viral loads (VLs) ranging from 2.43 to 6.50 log10 copies/ml were analyzed. They were collected from 71 ART-experienced patients and 77 ART-naive patients who were eligible for ART at the time of specimen collection. All the specimens were collected under institutional review board-approved protocols. The tests conducted for the MAS assay using deidentified specimens were determined to be non-human subject research by the associate director for Science at the Center for Global Health at CDC. The nested PCR products obtained previously by a broadly sensitive genotyping assay (13, 14) were analyzed using the MAS assay.

Verification of low-abundance alleles detected by the MAS assay.

To verify the additional low-abundance alleles detected by the MAS assay, 16 of the 24 specimens with low-abundance alleles were amplified using primers tagged with multiplex identifiers (39) and then were pooled and pyrosequenced using the Roche 454 GS-FLX Titanium sequencing kit XLR70 (Roche Applied Science, Indianapolis, IN, USA) following the manufacturer's protocol. Six overlapping primer sets (three each forward and reverse) were used for bidirectional coverage of the protease (amino acids 6 to 99) and RT (amino acids 1 to 251) regions (Z. Zhou, K. Tang, G. Zhang, N. Wadonda-Kabondo, L. A. Rowe, J. R. DeVos, N. Wagar, J. Nkengasong, M. Frace, S. Sammons, and C. Yang, unpublished data).

Statistical analysis.

The means, standard deviations (SD), and coefficients of variation (CVs) were calculated for net MFI in the repeat runs of plasmid DNA templates. The agreement between the MAS and in-house sequencing-based assays was assessed by calculating concordance with the 95% confidence interval (CI). The chi-square test was applied for a comparison of the categorical data. Statistical calculations were performed with the SPSS 20.0 (SPSS, Inc., Chicago, IL) and Microsoft Excel 2010 (Microsoft Corp., Redmond, WA, USA) software packages.

Nucleotide sequence accession numbers.

The nucleotide sequences of the three plasmids C-wt, C-mut1, and C-mut2 were submitted to GenBank under accession no. KF019640 to KF019642.

RESULTS

Development of the MAS assay using specially constructed plasmid DNAs.

For the initial development of the MAS assay, two plasmids (C-wt and C-mut1) and a mixture of them at a 1:1 ratio (wt/wt) were analyzed. Figure 2 shows the results of the two plasmid templates (C-wt and C-mut1) for all 20 codons from five independent test runs after testing conditions had been optimized. The mean background MFI for each allele ranged from 12.56 to 127.94. The mean ± SD of the highest background value was 127.94 ± 19.41, and the 99% upper confidence limit, which corresponded to the mean plus 2.58 SD, was 178.02. Based on this calculation, the minimal valid allele-calling MFI value was set at 180. If these criteria were met, the allele was determined using the AR. With these criteria, each of the WT and Mut alleles in the plasmid templates was correctly detected. As shown in Fig. 2, the assay had good reproducibility, as evidenced by the low SD between testing runs. The CVs for the positive signals of each WT allele were 2.43% to 15.42%, and the CVs for the positive signals of each Mut allele were 3.41% to 11.68%.
Fig 2
Fig 2 Detection of drug resistance mutations using plasmid DNA templates. After PCR amplification of each template individually, a mixture of the wild-type template and the mutant template (Mut) at a ratio of 1:1 (wt/wt), amplicons of each individual template, and a no-target negative control (NC) were analyzed with the 45 ASPE primers. The data shown are means plus standard deviations (SD) (error bars) (n = 5).

Sensitivity of the MAS assay.

The results from three independent testing runs of serial dilutions of Mut templates (C-mut1 and C-mut2) are shown in Fig. 3. Although the MFI values varied between different Mut alleles, a significant concentration-dependent relationship was observed for each Mut allele. At a cutoff value of 180 and a AR of ≥0.1, the MAS assay detected 1.56% of the minority mutant populations of K219Q and K219E, 3.13% of L76V, 6.25% of K65R, K70R, L74V, L100I, K103N, K103R, Q151M, Y181C, and I47V, and 12.5% of M41L, K101P, K101E, V106A, V106M, Y115F, M184V, Y188L, G190A, V32I, I47A, I84V, and L90M.
Fig 3
Fig 3 Sensitivity for detection of drug resistance mutations at 20 mutation sites. Twofold serial dilutions of the Mut template against the WT template were tested with the MAS assay. The data shown are the means plus SD (error bars) (n = 3).

Analysis of plasma specimens from ART-experienced and ART-naive patients.

The purified nested PCR products from 148 patient specimens were analyzed using the MAS assay. In all, 2,960 codons (20 codons per specimen, 148 specimens) were analyzed, of which 2,887 (97.53% [95% CI, 96.91 to 98.06]) were genotyped; the remaining 73 codons had indeterminate results due to negative reactions for both the WT and Mut alleles. The mean MFI for the positive signals in patient specimens was 2,823 (95 percentile interval, 525.0 to 6,720.2), and the mean MFI for negative signals in patient specimens was 59.80 (95 percentile interval, 8.48 to 140.0), which are comparable to those obtained from plasmid templates. Analyses of the DRMs at 20 loci showed that eight mutation sites had identical genotyping results, while the remaining 12 sites were 95.21% to 99.32% concordant between the MAS assay and conventional sequencing (Table 2).
Table 2
Table 2 Concordance between population sequencing and the MAS assay in DR mutation genotyping of patient specimens (n = 148) at each resistance mutation site
pol regionPositionNo. (%) of alleles detectedNo. (%) of specimens with concordant resultsaNo. of discrepanciesNo. of additional mixturesb
rt41145 (97.97)144 (99.31)10
 65148 (100.0)145 (97.97)33
 70142 (95.95)141 (99.30)11
 74144 (97.30)144 (100.0)00
 115145 (97.97)145 (100.0)00
 151143 (96.62)143 (100.0)00
 184137 (92.57)134 (97.81)32
 219142 (95.95)141 (99.30)10
 100143 (96.62)143 (100.0)00
 101c147 (99.32)143 (97.28)42
 103146 (98.65)139 (95.21)75
 106148 (100.0)146 (98.65)22
 181c137 (92.57)135 (98.54)21
 188c143 (96.62)141 (98.60)22
 190c145 (97.97)140 (96.55)55
prt32148 (100.0)148 (100.0)00
 47148 (100.0)148 (100.0)00
 76140 (94.59)140 (100.0)00
 84148 (100.0)148 (100.0)00
 90148 (100.0)147 (99.32)11
Total 2,887 (97.53)2,855 (98.89)3224
a
The concordance rate equals the number of concordant specimens divided by the number of alleles detected.
b
Number of additional mixtures detected by the MAS assay.
c
Six untargeted alleles at four loci could not be detected because no ASPE primers were designed for them; these include one K101Q, Y181I, Y188H, G190S, and two Y188C.
Overall, among the 2,887 codons detected by both MAS and sequencing-base assays, 2,855 (98.89% [95% CI, 98.44 to 99.21]) were identical and 32 were discordant between the two assays. The concordance rates between the two methods in ART-experienced and ART-naive patients were 98.54% (1,353/1,373) (95% CI, 97.76% to 99.05%) and 99.21% (1,502/1,514) (95% CI, 98.62% to 99.55%), respectively, which were not significantly different between the two groups of patients (χ2 = 2.90, P = 0.09). In total, there were 32 discordant allele calls, and among them, 24 were identified as mixtures by the MAS assay, while they were identified as nonmixtures by sequencing-based assay (15 WTs and 9 Muts). To the contrary, seven codons identified as mixtures by the sequencing-based assay were interpreted as WTs (n = 5) and Muts (n = 2) by the MAS assay, and the one remaining specimen, MW4644 from Malawi, was a Mut at 181C using the sequencing assay and was a wild-type Y181 using the MAS assay. Sequencing results showed that the MAS assay missed these alleles due to mismatches between the ASPE primers and viral sequences.
Of the 73 indeterminate results from the MAS assay, sequencing results indicated that 58 were WTs, seven were Muts, two were a mixture of WTs and Muts, and the remaining six were untargeted alleles, including one K101Q, Y181I, Y188H, and G190S, and two Y188Cs. These indeterminate results were caused by the failure of the ASPE primers to either hybridize or extend during primer extension. Analysis of the sequences generated by conventional sequencing revealed three reasons for the indeterminate results: (i) an unexpected mutation within close proximity to the polymorphism site (at the 3′ end of ASPE primer), (ii) multiple mutations within the span of the ASPE primers, or (iii) an untargeted Mut allele that was not included in the assay.

Results of 454 ultradeep pyrosequencing.

Sixteen of the 24 low-abundance alleles detected using the MAS assay were further analyzed by Roche 454 ultradeep sequencing. All but one low-abundance allele (K65R in MW5549 collected from Malawi) were verified by ultradeep sequencing. The ultradeep sequencing tagged with multiplex identifiers yielded an average of 2,258 reads per base, with a range of 332 to 5,591 reads per base, and the results showed that the proportions of low-abundance Mut alleles missed by Sanger sequencing were 3.61% to 27.29%. Since several steps of amplification were involved prior to pyrosequencing, the accuracy of these proportions is unverifiable. Nevertheless, the ultradeep sequencing results confirmed the higher sensitivity of the MAS assay than that of conventional sequencing in detecting low-abundance alleles.

DISCUSSION

We describe the development and validation of a multiplex allele-specific HIV-1 subtype C DR detection assay using suspension array technology that can simultaneously detect a set of genetic mutations associated with the resistance of HIV-1 to the commonly used NNRTIs, NRTIs, and PIs. This novel assay can simultaneously detect 45 alleles in a single reaction tube and has good concordance with a well-validated in-house sequencing-based method (13). Specimens from both ART-experienced and ART-naive patients were analyzed successfully by the MAS assay, indicating the potential utility of this assay to detect both acquired and transmitted DRMs.
The results of 2-fold serial dilutions of the Mut templates in a WT background demonstrated that the MAS assay reliably detected Mut alleles at low levels of 1.56% to 12.5%, while direct sequence analysis has less sensitivity for polymorphism detection, approximately 15 to 20% (40). More low-abundance alleles in patient specimens were detected by the MAS assay as verified by 454 ultradeep sequencing, further confirming the increased sensitivity of the MAS assay. This increased sensitivity will reduce the chance of missing low-abundance DRMs, which may have clinical significance for treatment outcomes (17, 41). However, like any allele-specific DR detection assay, the higher sensitivity for detecting low-abundance variants is input copy number dependent; thus, low-abundance variants may still be missed when the patient specimens used for the analysis have low viral load levels.
Traditional sequencing-based DR assays require six to eight sequencing reaction tubes/wells per sample to cover the minimal regions for which sequence data need to be collected in the pol region. This increases the time spent to complete testing for each sample and the analysis time for generating a consensus sequence from the 6 to 8 contigs to a week or more. The use of the 45-plex suspension array assay reduces the number of tubes/wells used for each sample testing to one, and the time to results is substantially reduced. After initial reverse transcription-PCR (RT-PCR) and nested PCR amplification and purification, it takes <8 h to perform the entire procedure, including the mASPE reaction (4.0 h), hybridization to microspheres (1.0 h), incubation with reporter dye (0.5 h), instrument readout (1.0 h), and data analysis (0.5 h). As only one tube/reaction well is required per sample, this allows for the genotyping of 96 or 384 samples (including controls) to occur in one plate, which can be accomplished within one work day. Therefore, this method is especially suitable for large-scale ongoing surveillance of HIVDR.
The high-throughput nature of the MAS assay substantially reduces its cost. To estimate the reagent cost, we included the cost associated with RNA extraction, primer synthesis, RT-PCR and nested PCR amplification, PCR purification, mASPE, hybridization, and suspension array detection. We calculated a cost of $40.90 (U.S. market price) per sample for the MAS assay, which is comparable to the inexpensive in-house sequencing assay ($40.00 per sample) and considerably lower than that for commercially available genotyping assays, such as ViroSeq ($213.20 per sample) and TruGene ($172.86 per sample) (14). Moreover, the instrumentation for the MAS assay is more affordable. The latest compact suspension array system, Magpix (Luminex Corp., Austin, TX), costs only one-tenth that of an ABI 3730 sequencer (Applied Biosystems, Foster City, CA).
Another advantage of the MAS assay over sequencing is that this assay is simpler to perform and the resulting data are easier to interpret. Once an assay run is completed, the genotyping results are immediately available and the data can be reported.
Due to the flexibility of the suspension array technology, which currently permits multiplexed analysis of up to 500 individual analytes per tube or well, additional mutations of biological significance can be easily incorporated into the current assay. As such, the MAS assay can be readily adapted for different surveillance purposes, as well as for clinical use, by adding or removing ASPE primers and the corresponding microspheres to the assay.
As with any DR genotyping assays, the MAS assay has its limitations. First, it can only be used to analyze known DR mutations and it does not provide sequence data. This issue is common to any other point mutation assays, such as the AS-PCR, OLA, and PASS. Second, due to significant genetic variation between different HIV-1 subtypes, ASPE primers designed based on one subtype sequence may not work well for other subtypes. Currently, we are modifying the primers and validating the assay for HIV-1 non-C subtypes. Third, the assay is a qualitative assay and cannot be used for the quantification of DR mutations.
In conclusion, we have developed and validated a multiplex allele-specific subtype C DR detection assay. This assay not only saves time and resources for high-throughput detection of DR mutations but also has the flexibility to add or delete DR mutations based on specific needs. Therefore, the MAS assay may represent an efficient and flexible approach for the surveillance and monitoring of HIVDR in countries where subtype C viruses predominate.

ACKNOWLEDGMENTS

This project was supported by the President's Emergency Plan for AIDS Relief (PEPFAR) through the U.S. Centers for Disease Control and Prevention, grants from the U.S. National Institutes of Health (no. RO1 GM065057), and the appointment of Guoqing Zhang to the International Emerging Infectious Diseases (EID) fellowship program sponsored by the Association of Public Health Laboratories (APHL) and the Centers for Disease Control and Prevention.
We thank all the local staff in Zambia and Malawi who participated in the study, and we are grateful to Kathi L. Kellar and R. Suzanne Beard for critically reading the manuscript.
Chunfu Yang, Feng Gao, Guoqing Zhang, and Fangping Cai are the inventors in U.S. patent application no. 61/655,216. This does not alter the authors' adherence to journal policies on sharing data and materials.
The use of trade names is for identification only and does not constitute endorsement by the U.S. Department of Health and Human Services, the Public Health Service, or the Centers for Disease Control and Prevention. The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.

REFERENCES

1.
WHO. 2012. WHO HIV drug resistance report 2012. World Health Organization, Geneva, Switzerland. http://www.who.int/hiv/pub/drugresistance/report2012/en/.
2.
Wheeler WH, Ziebell RA, Zabina H, Pieniazek D, Prejean J, Bodnar UR, Mahle KC, Heneine W, Johnson JA, Hall HI, and Variant, Atypical, and Resistant HIV Surveillance Group. 2010. Prevalence of transmitted drug resistance associated mutations and HIV-1 subtypes in new HIV-1 diagnoses, U.S.-2006. AIDS 24:1203–1212.
3.
Stadeli KM and Richman DD. 2013. Rates of emergence of HIV drug resistance in resource-limited settings: a systematic review. Antivir. Ther. 18:115–123.
4.
Hamers RL, Wallis CL, Kityo C, Siwale M, Mandaliya K, Conradie F, Botes ME, Wellington M, Osibogun A, Sigaloff KC, Nankya I, Schuurman R, Wit FW, Stevens WS, van Vugt M, and de Wit TF, PharmAccess African Studies to Evaluate Resistance (PASER). 2011. HIV-1 drug resistance in antiretroviral-naive individuals in sub-Saharan Africa after rollout of antiretroviral therapy: a multicentre observational study. Lancet Infect. Dis. 11:750–759.
5.
Price MA, Wallis CL, Lakhi S, Karita E, Kamali A, Anzala O, Sanders EJ, Bekker LG, Twesigye R, Hunter E, Kaleebu P, Kayitenkore K, Allen S, Ruzagira E, Mwangome M, Mutua G, Amornkul PN, Stevens G, Pond SL, Schaefer M, Papathanasopoulos MA, Stevens W, and Gilmour J, IAVI Early Infection Cohort Study Group. 2011. Transmitted HIV type 1 drug resistance among individuals with recent HIV infection in east and southern Africa. AIDS Res. Hum. Retroviruses 27:5–12.
6.
Jain V, Liegler T, Vittinghoff E, Hartogensis W, Bacchetti P, Poole L, Loeb L, Pilcher CD, Grant RM, Deeks SG, and Hecht FM. 2010. Transmitted drug resistance in persons with acute/early HIV-1 in San Francisco, 2002–2009. PLoS One 5:e15510.
7.
Wood E and Montaner JS. 2011. Time to get serious about HIV antiretroviral resistance. Lancet Infect. Dis. 11:723–724.
8.
Sigaloff KC, Calis JC, Geelen SP, van Vugt M, and de Wit TF. 2011. HIV-1-resistance-associated mutations after failure of first-line antiretroviral treatment among children in resource-poor regions: a systematic review. Lancet Infect. Dis. 11:769–779.
9.
Jordan MR, Bennett DE, Wainberg MA, Havlir D, Hammer S, Yang C, Morris L, Peeters M, Wensing AM, Parkin N, Nachega JB, Phillips A, De Luca A, Geng E, Calmy A, Raizes E, Sandstrom P, Archibald CP, Perriëns J, McClure CM, Hong SY, McMahon JH, Dedes N, Sutherland D, and Bertagnolio S. 2012. Update on World Health Organization HIV drug resistance prevention and assessment strategy: 2004–2011. Clin. Infect. Dis. 54(Suppl 4):S245–S249.
10.
WHO. 2012. World Health Organization global strategy for the surveillance and monitoring of HIV drug resistance 2012. World Health Organization, Geneva, Switzerland. http://www.who.int/hiv/pub/drugresistance/drug_resistance_strategy/en/index.html.
11.
Eshleman SH, Crutcher G, Petrauskene O, Kunstman K, Cunningham SP, Trevino C, Davis C, Kennedy J, Fairman J, Foley B, and Kop J. 2005. Sensitivity and specificity of the ViroSeq human immunodeficiency virus type 1 (HIV-1) genotyping system for detection of HIV-1 drug resistance mutations by use of an ABI Prism 3100 genetic analyzer. J. Clin. Microbiol. 43:813–817.
12.
Grant RM, Kuritzkes DR, Johnson VA, Mellors JW, Sullivan JL, Swanstrom R, D'Aquila RT, Van Gorder M, Holodniy M, Lloyd RM Jr, Reid C, Morgan GF, and Winslow DL. 2003. Accuracy of the TRUGENE HIV-1 genotyping kit. J. Clin. Microbiol. 41:1586–1593.
13.
Yang C, McNulty A, Diallo K, Zhang J, Titanji B, Kassim S, Wadonda-Kabondo N, Aberle-Grasse J, Kibuka T, Ndumbe PM, Vedapuri S, Zhou Z, Chilima B, and Nkengasong JN. 2010. Development and application of a broadly sensitive dried-blood-spot-based genotyping assay for global surveillance of HIV-1 drug resistance. J. Clin. Microbiol. 48:3158–3164.
14.
Zhou Z, Wagar N, DeVos JR, Rottinghaus E, Diallo K, Nguyen DB, Bassey O, Ugbena R, Wadonda-Kabondo N, McConnell MS, Zulu I, Chilima B, Nkengasong J, and Yang C. 2011. Optimization of a low cost and broadly sensitive genotyping assay for HIV-1 drug resistance surveillance and monitoring in resource-limited settings. PLoS One 6:e28184.
15.
Buckton AJ, Bissett SL, Myers RE, Beddows S, Edwards S, Cane PA, and Pillay D. 2008. Development and optimization of an internally controlled dried blood spot assay for surveillance of human immunodeficiency virus type-1 drug resistance. J. Antimicrob. Chemother. 62:1191–1198.
16.
Dudley DM, Chin EN, Bimber BN, Sanabani SS, Tarosso LF, Costa PR, Sauer MM, Kallas EG, and O'Connor DH. 2012. Low-cost ultra-wide genotyping using Roche/454 pyrosequencing for surveillance of HIV drug resistance. PLoS One 7:e36494.
17.
Simen BB, Simons JF, Hullsiek KH, Novak RM, Macarthur RD, Baxter JD, Huang C, Lubeski C, Turenchalk GS, Braverman MS, Desany B, Rothberg JM, Egholm M, and Kozal MJ, Terry Beirn Community Programs for Clinical Research on AIDS. 2009. Low-abundance drug-resistant viral variants in chronically HIV-infected, antiretroviral treatment-naive patients significantly impact treatment outcomes. J. Infect. Dis. 199:693–701.
18.
Wang C, Mitsuya Y, Gharizadeh B, Ronaghi M, and Shafer RW. 2007. Characterization of mutation spectra with ultradeep pyrosequencing: application to HIV-1 drug resistance. Genome Res. 17:1195–1201.
19.
Cai F, Chen H, Hicks CB, Bartlett JA, Zhu J, and Gao F. 2007. Detection of minor drug-resistant populations by parallel allele-specific sequencing. Nat. Methods 4:123–125.
20.
Liu J, Miller MD, Danovich RM, Vandergrift N, Cai F, Hicks CB, Hazuda DJ, and Gao F. 2011. Analysis of low-frequency mutations associated with drug resistance to raltegravir before antiretroviral treatment. Antimicrob. Agents Chemother. 55:1114–1119.
21.
Church JD, Towler WI, Hoover DR, Hudelson SE, Kumwenda N, Taha TE, Eshleman JR, and Eshleman SH. 2008. Comparison of LigAmp and an ASPCR assay for detection and quantification of K103N-containing HIV variants. AIDS Res. Hum. Retroviruses 24:595–605.
22.
Johnson JA, Li JF, Wei X, Lipscomb J, Bennett D, Brant A, Cong ME, Spira T, Shafer RW, and Heneine W. 2007. Simple PCR assays improve the sensitivity of HIV-1 subtype B drug resistance testing and allow linking of resistance mutations. PLoS One 2:e638.
23.
Johnson JA, Li JF, Wei X, Lipscomb J, Irlbeck D, Craig C, Smith A, Bennett DE, Monsour M, Sandstrom P, Lanier ER, and Heneine W. 2008. Minority HIV-1 drug resistance mutations are present in antiretroviral treatment-naive populations and associate with reduced treatment efficacy. PLoS Med. 5:e158.
24.
Metzner KJ, Rauch P, Walter H, Boesecke C, Zöllner B, Jessen H, Schewe K, Fenske S, Gellermann H, and Stellbrink HJ. 2005. Detection of minor populations of drug-resistant HIV-1 in acute seroconverters. AIDS 19:1819–1825.
25.
Metzner KJ, Giulieri SG, Knoepfel SA, Rauch P, Burgisser P, Yerly S, Gunthard HF, and Cavassini M. 2009. Minority quasispecies of drug-resistant HIV-1 that lead to early therapy failure in treatment-naive and -adherent patients. Clin. Infect. Dis. 48:239–247.
26.
Bansal V, Metzner KJ, Niederöst B, Leemann C, Böni J, Günthard HF, and Fehr JS. 2011. Minority K65R variants and early failure of antiretroviral therapy in HIV-1-infected Eritrean immigrant. Emerg. Infect. Dis. 17:1966–1968.
27.
Flys T, Nissley DV, Claasen CW, Jones D, Shi C, Guay LA, Musoke P, Mmiro F, Strathern JN, Jackson JB, Eshleman JR, and Eshleman SH. 2005. Sensitive drug-resistance assays reveal long-term persistence of HIV-1 variants with the K103N nevirapine (NVP) resistance mutation in some women and infants after the administration of single-dose NVP: HIVNET 012. J. Infect. Dis. 192:24–29.
28.
Boltz VF, Maldarelli F, Martinson N, Morris L, McIntyre JA, Gray G, Hopley MJ, Kimura T, Mayers DL, Robinson P, Mellors JW, Coffin JM, and Palmer SE. 2010. Optimization of allele-specific PCR using patient-specific HIV consensus sequences for primer design. J. Virol. Methods 164:122–126.
29.
Boltz VF, Ambrose Z, Kearney MF, Shao W, KewalRamani VN, Maldarelli F, Mellors JW, and Coffin JM. 2012. Ultrasensitive allele-specific PCR reveals rare preexisting drug resistant variants and a large replicating virus population in macaques infected with a simian immunodeficiency virus containing human immunodeficiency virus reverse transcriptase. J. Virol. 86:12525–12530.
30.
Shi C, Eshleman SH, Jones D, Fukushima N, Hua L, Parker AR, Yeo CJ, Hruban RH, Goggins MG, and Eshleman JR. 2004. LigAmp for sensitive detection of single-nucleotide differences. Nat. Methods 1:141–147.
31.
Dunbar SA. 2006. Applications of Luminex xMAP technology for rapid, high-throughput multiplexed nucleic acid detection. Clin. Chim. Acta 363:71–82.
32.
Houser B. 2012. Bio-Rad's Bio-Plex suspension array system, xMAP technology overview. Arch. Physiol. Biochem. 118:192–196.
33.
Dowling WE, Kim B, Mason CJ, Wasunna KM, Alam U, Elson L, Birx DL, Robb ML, McCutchan FE, and Carr JK. 2002. Forty-one near full-length HIV-1 sequences from Kenya reveal an epidemic of subtype A and A-containing recombinants. AIDS 16:1809–1820.
34.
Ratner L, Haseltine W, Patarca R, Livak KJ, Starcich B, Josephs SF, Doran ER, Rafalski JA, Whitehorn EA, Baumeister K, Ivanoff L, Petteway SR, Pearson ML, Lautenberger JA, Papas TS, Ghrayeb J, Chang NT, Gallo RC, and Wong-Staal F. 1985. Complete nucleotide sequence of the AIDS virus, HTLV-III. Nature 313:277–284.
35.
Bortolin S, Black M, Modi H, Boszko I, Kobler D, Fieldhouse D, Lopes E, Lacroix JM, Grimwood R, Wells P, Janeczko R, and Zastawny R. 2004. Analytical validation of the tag-it high-throughput microsphere-based universal array genotyping platform: application to the multiplex detection of a panel of thrombophilia-associated single-nucleotide polymorphisms. Clin. Chem. 50:2028–2036.
36.
Li G, Luo X, He J, Zhu Z, Yu G, Qin H, Zeng T, Liu Z, Wu S, Xu J, and Ren-Heidenreich L. 2011. A novel liquidchip platform for simultaneous detection of 70 alleles of DNA somatic mutations on EGFR, KRAS, BRAF and PIK3CA from formalin-fixed and paraffin-embedded slides containing tumor tissue. Clin. Chem. Lab. Med. 49:191–195.
37.
Wadonda-Kabondo N, Bennett D, van Oosterhout JJ, Moyo K, Hosseinipour M, DeVos J, Zhou Z, Aberle-Grasse J, Warne TR, Mtika C, Chilima B, Banda R, Pasulani O, Porter C, Phiri S, Jahn A, Kamwendo D, Jordan MR, Kabuluzi S, Chimbwandira F, Kagoli M, Matatiyo B, Demby A, and Yang C. 2012. Prevalence of HIV drug resistance before and 1 year after treatment initiation in 4 sites in the Malawi antiretroviral treatment program. Clin. Infect. Dis. 54:S362–S368.
38.
Stringer JS, McConnell MS, Kiarie J, Bolu O, Anekthananon T, Jariyasethpong T, Potter D, Mutsotso W, Borkowf CB, Mbori-Ngacha D, Muiruri P, Ong'ech JO, Zulu I, Njobvu L, Jetsawang B, Pathak S, Bulterys M, Shaffer N, and Weidle PJ. 2010. Effectiveness of non-nucleoside reverse-transcriptase inhibitor-based antiretroviral therapy in women previously exposed to a single intrapartum dose of nevirapine: a multi-country, prospective cohort study. PLoS Med. 7:e1000233.
39.
Hoffmann C, Minkah N, Leipzig J, Wang G, Arens MQ, Tebas P, and Bushman FD. 2007. DNA bar coding and pyrosequencing to identify rare HIV drug resistance mutations. Nucleic Acids Res. 35:e91.
40.
Tsiatis AC, Norris-Kirby A, Rich RG, Hafez MJ, Gocke CD, Eshleman JR, and Murphy KM. 2010. Comparison of Sanger sequencing, pyrosequencing, and melting curve analysis for the detection of KRAS mutations: diagnostic and clinical implications. J. Mol. Diagn. 12:425–432.
41.
Nicot F, Saliou A, Raymond S, Sauné K, Dubois M, Massip P, Marchou B, Delobel P, and Izopet J. 2012. Minority variants associated with resistance to HIV-1 nonnucleoside reverse transcriptase inhibitors during primary infection. J. Clin. Virol. 55:107–113.

Information & Contributors

Information

Published In

cover image Journal of Clinical Microbiology
Journal of Clinical Microbiology
Volume 51Number 11November 2013
Pages: 3666 - 3674
PubMed: 23985909

History

Received: 26 June 2013
Returned for modification: 22 July 2013
Accepted: 20 August 2013
Published online: 21 December 2020

Permissions

Request permissions for this article.

Contributors

Authors

Guoqing Zhang
International Laboratory Branch, Division of Global HIV/AIDS, CGH
Fangping Cai
Department of Medicine, Duke University Medical Center, Durham, North Carolina, USA
Zhiyong Zhou
International Laboratory Branch, Division of Global HIV/AIDS, CGH
Joshua DeVos
International Laboratory Branch, Division of Global HIV/AIDS, CGH
Nick Wagar
International Laboratory Branch, Division of Global HIV/AIDS, CGH
Karidia Diallo
International Laboratory Branch, Division of Global HIV/AIDS, CGH
Isaac Zulu
CDC-Zambia, Lusaka, Zambia
Nellie Wadonda-Kabondo
CDC-Malawi, Lilongwe, Malawi
Jeffrey S. A. Stringer
University of North Carolina School of Medicine, Chapel Hill, North Carolina, USA
Centre for Infectious Disease Research in Zambia, Lusaka, Zambia
Paul J. Weidle
Division of HIV/AIDS Prevention, NCHHSTP, CDC, Atlanta, Georgia, USA
Clement B. Ndongmo
CDC-Zambia, Lusaka, Zambia
Izukanji Sikazwe
Ministry of Health, Lusaka, Zambia
Abdoulaye Sarr
CDC-Malawi, Lilongwe, Malawi
Matthew Kagoli
Ministry of Health of Malawi, Lilongwe, Malawi
John Nkengasong
International Laboratory Branch, Division of Global HIV/AIDS, CGH
Feng Gao
Department of Medicine, Duke University Medical Center, Durham, North Carolina, USA
Chunfu Yang
International Laboratory Branch, Division of Global HIV/AIDS, CGH

Notes

Address correspondence to Chunfu Yang, [email protected], or Feng Gao, [email protected].

Metrics & Citations

Metrics

Note: There is a 3- to 4-day delay in article usage, so article usage will not appear immediately after publication.

Citation counts come from the Crossref Cited by service.

Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Figures and Media

Figures

Media

Tables

Share

Share

Share the article link

Share with email

Email a colleague

Share on social media

American Society for Microbiology ("ASM") is committed to maintaining your confidence and trust with respect to the information we collect from you on websites owned and operated by ASM ("ASM Web Sites") and other sources. This Privacy Policy sets forth the information we collect about you, how we use this information and the choices you have about how we use such information.
FIND OUT MORE about the privacy policy