INTRODUCTION
Mycoplasma pneumoniae is an important etiologic agent in pediatric and adult tracheobronchitis and community-acquired pneumonia (CAP). Centers for Disease Control and Prevention (CDC) investigations found that
M. pneumoniae was the most common bacterial pathogen detected in children with CAP (8%) and in 2% of adult CAP cases during periods when
M. pneumoniae was endemic (
1,
2). Up to 20 to 40% of CAP in the general population and up to 70% in closed populations can be caused by
M. pneumoniae during cyclic epidemic periods, with an estimated two million annual cases of CAP resulting in 100,000 hospitalizations of adults in the United States (
3–6).
Macrolides have been the recommended treatment of choice for
M. pneumoniae infections, especially in children, due to relative contraindications for tetracyclines and fluoroquinolones. In Asia, macrolide resistance rates in
M. pneumoniae have surged in the past 2 decades to >90%, resulting in increased patient morbidity, greater cost of care, and prolonged hospital stays (
3). Data from a recent U.S. national surveillance study demonstrated an overall
M. pneumoniae macrolide resistance rate of 7.5%, but in some areas of the northeast and southeast, the rate exceeded 20% (
7).
M. pneumoniae infection can be diagnosed by culture, serology, or molecular methods (
3). Culture is relatively insensitive, requires specialized media, significant expertise, and takes several days to weeks to complete due to the fastidious nature and slow growth of the organism. Serology lacks both sensitivity and specificity due to various reasons, which include the high prevalence of background antibodies in healthy persons and the lack of an IgM response in many older individuals (
3). Optimum use of serology requires testing acute and convalescent specimens, which is not practical for diagnosis in an ambulatory setting.
Molecular methods for
M. pneumoniae detection were first developed in the 1980s and were refined further over the past decade with the advent of real-time PCR and the ability to detect macrolide resistance directly in clinical specimens without the need for culture (
8,
9). Despite U.S. Food and Drug Administration (FDA) approval of the first molecular test for
M. pneumoniae in 2011, there have been no specific recommendations from regulatory or professional organizations to perform such testing, and most infections due to
M. pneumoniae remain undiagnosed. Inclusion of
M. pneumoniae as a target on FDA-approved respiratory pathogen panels enables detection of this organism, but the clinical sensitivity of these assays has not been thoroughly evaluated.
Since 2011, there have been five FDA-cleared commercial molecular tests targeting
M. pneumoniae in clinical specimens. Four of these are multianalyte PCR platforms that simultaneously detect several respiratory viruses,
M. pneumoniae, and other bacterial pathogens such as
Chlamydia pneumoniae and
Bordetella spp. The other FDA-cleared commercial assay is a single-analyte loop-mediated isothermal amplification (LAMP) system that detects only
M. pneumoniae. Since molecular testing has become more widely available in recent years and there are now several FDA-cleared assays, this diagnostic approach can now be considered the method of choice (
3). Some molecularly based assays require separate DNA extraction, while others perform extraction, amplification, and detection on specimens inoculated directly into the instruments with results available in about 1 to 4 h. Although there are several previous publications describing the performance of various commercial molecularly based assays that include statistics on their ability to detect
M. pneumoniae, most studies involving multiplex platforms have focused primarily on detection of respiratory viruses and included a relatively small number of specimens testing positive for
M. pneumoniae (
10–26). No previous studies have evaluated large numbers of
M. pneumoniae-positive specimens to enable thorough head-to-head comparisons of commercial molecular diagnostic platforms available in the United States.
The University of Alabama at Birmingham (UAB) Diagnostic Mycoplasma Laboratory and the CDC independently developed, validated, and currently utilize PCR assays for rapid detection of macrolide resistance directly in respiratory specimens. However, there are no commercial assays sold in the United States that enable rapid detection of macrolide-resistant
M. pneumoniae. SpeeDx, Inc. (Austin, TX), has developed the
Resistance Plus MP, an investigational PCR assay for
M. pneumoniae detection and designation of macrolide resistance. This assay is similar in format to their
Resistance Plus MG assay that is now sold in some countries for detection and designation of macrolide resistance in
Mycoplasma genitalium (
27). Determination of macrolide resistance via molecular identification of rRNA mutations known to confer macrolide resistance is more rapid and practical than determination via culture and broth microdilution MICs (
3,
8,
28). There are no published studies evaluating the
Resistance Plus MP assay for detection of macrolide resistance directly in clinical specimens. To our knowledge, there are no other alternatives under commercial development in the United States for rapid detection of macrolide-resistant
M. pneumoniae at this time.
In the present study, we have sought to examine the comparative diagnostic performance of the following three FDA-cleared, multianalyte molecularly based platforms for detection of M. pneumoniae in clinical specimens: the FilmArray respiratory panel (RP) (bioMérieux/BioFire Diagnostics, Inc., Salt Lake City, UT), ePlex respiratory pathogen panel (RPP) (GenMark Diagnostics, Inc., Carlsbad, CA), and the NxTAG RPP (Luminex Corporation, Austin, TX). We also evaluated the single-analyte FDA-cleared Alethia Mycoplasma Direct (formerly illumigene Mycoplasma Direct; Meridian Bioscience, Inc., Cincinnati, OH) LAMP assay and the InGenius MGB Mycoplasma pneumoniae research use only (RUO) PCR (ELITechGroup, Inc., Bothell, WA). The SpeeDx Resistance Plus MP assay was evaluated for its ability to codetect M. pneumoniae and mutations associated with macrolide resistance. Data obtained from each commercial method were compared against results obtained by reference methods consisting of validated laboratory-developed PCR assays at the UAB Diagnostic Mycoplasma Laboratory and the CDC and by Sanger sequencing.
DISCUSSION
Although other studies have evaluated the test performance characteristics of molecular diagnostic assays targeting
M. pneumoniae, these assays are not commercially available in the United States (
40–42). Despite FDA approval of several diagnostic tests targeting
M. pneumoniae that are included in this evaluation, there have been minimal head-to-head comparisons with limited sample sizes to draw definitive conclusions on the relative utility of each assay. This study is the first to recruit and evaluate a large number of samples from 8 sites throughout the United States to compare the performance of six commercial assays, including FDA-approved diagnostics targeting
M. pneumoniae. Detailed descriptions of the multianalyte FilmArray RP, ePlex RPP, and NxTAG RPP, including basic information regarding function, throughput, turnaround times, and overall performance data, with particular emphasis on detection of respiratory viruses, have been discussed in depth by Ramanan et al. (
43). Therefore, our discussion of these assays, as well as of the Alethia Mycoplasma Direct, ELITe InGenius MP RUO, and
Resistance Plus MP assays, is limited primarily to their performance for the detection of
M. pneumoniae and macrolide resistance.
The FilmArray RP was the first multiplex PCR FDA approved for the detection of bacterial and viral respiratory pathogens (
17,
18,
44). We found the FilmArray RP compared extremely well with the reference PCRs, with 98.1% sensitivity and 100% specificity. This is consistent with other studies showing high concordance for many pathogens on the panel relative to laboratory-developed PCRs (
23,
25). We also found that the FilmArray RP performed significantly better than the ePlex RPP and NxTAG RPP multiplex panels. Published head-to-head comparisons of multiplex panels show significant variability in detection of
M. pneumoniae, with some publications indicating that the ePlex is more sensitive than the FilmArray RP (
15), that the NxTAG RPP exhibits similar sensitivity to the FilmArray RP (
16,
18), and that the NxTAG RPP is not as sensitive as the FilmArray RP (
17,
21) or a laboratory-developed PCR assay (
24). A significant limitation of all of these publications is the small number of
M. pneumoniae-positive specimens that were available (typically <10). Our study, using a much larger sample size of 212
M. pneumoniae-positive specimens distributed throughout the United States, shows a clear difference with respect to the performance of the three multiplex panels. Similar test performance evaluations of the most recent FDA-approved molecular diagnostic test, the QIAstat-Dx respiratory panel (Qiagen, Germantown, MD) are needed.
As Mycoplasma pneumoniae is only one of several targets in multiplex assays, additional consideration of reported sensitivities to other pathogens, organism coverage, workflow, costs, and additional tests available on the platform should be taken into consideration when exploring diagnostic test options. As M. pneumoniae disproportionately affects children and adolescents, laboratory directors of pediatric hospitals should focus particular attention on platform differences in test performance characteristics for organisms of interest to their patient population. In addition, test manufacturers should note opportunities for optimization of assay conditions and actively promote large multicenter evaluations of individual targets included on syndromic panels.
Syndromic panels targeting many respiratory pathogens simplify testing algorithms and improve the speed of diagnosis with minimal hands-on time for laboratory technologists (
43). However, by virtue of targeting multiple pathogens, the LoD and analytical sensitivity for individual targets are often reduced relative to those of singleplex assays. Additionally, multiplex panels exhibit high instrument costs and high costs per test, and they lack flexibility for customization. Although singleplex assays such as the Mycoplasma Direct LAMP only target one pathogen, instrument costs and costs per test are considerably lower, and assay optimization for the single target often yields enhanced analytical sensitivity for this target relative to that of multiplex tests.
Although, the InGenius MGB
M. pneumoniae RUO PCR assay is not yet FDA approved, we chose to incorporate this assay into this study due to its commercial availability and a recent publication noting impressive test performance characteristics (
34). Additionally, the ability of the InGenius platform to perform 12 independent and customizable tests per run offers clinical labs, particularly moderately sized complex clinical laboratories running many different molecular tests, an alternative solution for
M. pneumoniae testing. This singleplex assay exhibited the highest clinical sensitivity (99.5%), outperforming all other tests. Although the ELITech InGenius platform can perform nucleic extraction directly from patient samples, our in-house studies showed equivalent nucleic acid extraction efficiency with the Roche MagNA Pure platform (data not shown). Therefore, we chose to run the InGenius MP RUO assay with extracted nucleic acids (not direct samples) as the input enabling thorough evaluation of the RT-PCR component of this test system. Future studies with large sample sizes are recommended to evaluate the relative performance of this assay when starting with direct specimens.
Unexpectedly, the Mycoplasma Direct singleplex assay detected only 55.7% of confirmed
M. pneumoniae-positive specimens, yielding the poorest performance of all six commercial tests. In our previous evaluation of the
illumigene Mycoplasma DNA amplification assay, the forerunner of Mycoplasma Direct (
26), among 214 respiratory specimens from a variety of sources previously cultured for
M. pneumoniae (indicative of a higher organism load), the sensitivity of the
illumigene assay was 100% and the specificity was 99%. Chou and Zheng identified the sensitivity and specificity of the
illumigene assay to be 100% compared with those of the FilmArray RP and also reported a greater analytic sensitivity for the
illumigene (23.5 CFU/ml versus 235 CFU/ml for the FilmArray RP) (
22). The Mycoplasma Direct assay does not require a separate DNA extraction step, making it similar in this respect to the multiplex systems. However, the gene target and assay LAMP chemistry are identical for both assays, and prior evaluations showed comparable test performances (
10). To our knowledge, there have been no other studies performed with the new version of the Mycoplasma Direct comparing it to other methods since it was reformatted with an integrated DNA extraction procedure. The poor performance of the Mycoplasma Direct assay in this study may be attributable to modification of manufacturer-recommended specimen collection protocols. Although the Mycoplasma Direct protocol specifies collection of throat swabs in nonnutritive transport medium with a pledget (<1.2 ml), samples in this study were nasal swabs collected in universal transport medium (∼3 ml) as specified for BioFire testing. Given the lack of convincing evidence that throat swabs are superior to nasal swabs for detection of
M. pneumoniae (
45), we aliquoted 25 μl of specimen into SMP Prep tubes and processed the samples per the manufacturers’ instructions. Future studies strictly following manufacturer protocols are required to determine the true test performance characteristics of the Mycoplasma Direct assay.
The optimal approach to assess the clinical accuracy of various commercial molecularly based tests for detection of
M. pneumoniae would be to prospectively collect specimens and run them on all of the platforms before any storage, freezing, or other manipulation took place. The challenge for performing such a study is that the low frequency for circulating
M. pneumoniae during periods when it is not epidemic would mean that very large numbers of specimens would have to be collected for meaningful comparison, making such an endeavor very costly and time-consuming. Among 1,612 respiratory specimens analyzed by the FilmArray RP2, Leber et al. (
11) found
M. pneumoniae in only 23 specimens (1.4%). Moreover, no single hospital or laboratory has a need to have all of these instruments and assays in operation on-site for simultaneous testing. Future studies initiated during epidemic years may enable prospective evaluation of test performance characteristics lacking the caveats highlighted in the current study.
Given our study design, it is worthwhile to mention some potential factors that might have affected the results of this study. All specimens had been collected in universal transport medium for testing on the FilmArray RP and frozen prior to shipment to UAB. There was no attempt to determine whether the same type of transport system was used by all hospitals over the 4-year period of specimen accrual, and there was no way to know if there were variations in storage temperatures or length of storage prior to freezing. Additionally, there is a possibility that some organism loss may have occurred after freezing and thawing, which could have affected performance of the commercial assays other than the FilmArray RP performed on-site. However, the FilmArray RP concordantly detected M. pneumoniae in 208/212 (98.1%) confirmed-positive specimens, while all 216 remaining specimens were concordantly negative, resulting in an overall 99.1% agreement for the FilmArray RP and the reference PCRs. Since there were no instances in which the FilmArray RP was positive when the reference PCRs were negative, it is unlikely there was any significant loss of viable DNA as a result of sample handling, storage, freezing, and shipping.
Unlike in a clinical laboratory setting, limited sample volumes prevented repeat testing when a commercial diagnostic test gave an invalid result. In this study, high invalid result rates (34/428; 7.9%) were only problematic for the ePlex RPP. Although high relative to those of other test systems, ePlex RPP invalid rates for the study were within the range (2.2 to 8.4%; mean, 5.6%) typical for regular clinical diagnostic use at the Children’s of Alabama Pediatric Virology Laboratory. It is therefore highly unlikely that storage/handling affected the ePlex RPP invalid result rate. Although it is not possible to know how exclusion of 34 results affected our evaluation of test performance characteristics, an equal distribution of samples (17 positive and 17 negative) yielding invalid results suggests a minimal effect on test performance parameters had repeat testing been available.
The rate of macrolide-resistant isolates (21/212; 9.9%) and the predominance of A2063G point mutations in the current study is consistent with recently published prevalence rates in the United States (
7). Implementation of a commercial molecular test capable of detecting macrolide resistance in clinical laboratories would enable the identification of infected patients whose treatment would benefit from an alternative antibiotic choice and help mitigate rising macrolide resistance rates (
7). Although the
Resistance Plus MP assay is not yet available in the United States, it is the only commercial assay targeting macrolide-resistant
M. pneumoniae and was included in this study to evaluate its potential utility to meet this increasingly important diagnostic niche. The clinical sensitivity of the
Resistance Plus MP to detect
M. pneumoniae in clinical specimens was generally good, at 93.3%, compared to the reference PCRs. This sensitivity was not significantly different from that of the FilmArray (98.1%) but did differ from that of the ELITe InGenius (99.5%), since the 95% confidence intervals did not overlap, as shown in
Table 2. The
Resistance Plus MP accurately detected 27/33 (81.8%) of specimens confirmed as macrolide resistant by other methods. The
Resistance Plus MP assay had different sensitivities for detection of different mutations. One-third of A2064G mutations (2/6) were missed. This PCR is still under development by SpeeDx, and attention needs to be given to the PCR design and the nature of the reagents in the PCR mixture, as well as the PCR program, in order to improve diagnostic accuracy. Future studies are needed to evaluate and identify optimized assays capable of accurately distinguishing patients infected with macrolide-resistant
M. pneumoniae.
In summary, we have performed an evaluation of six commercial molecularly based methods for the detection of M. pneumoniae in clinical specimens using two laboratory developed PCRs as reference methods. Among the three multiplex PCRs, the FilmArray RP had the best overall performance and detected significantly more confirmed positive specimens than the ePlex RPP and NxTAG RPP. Although not yet FDA cleared, the single-analyte InGenius MP RUO assay had the highest sensitivity of all tests evaluated. The single-analyte Mycoplasma Direct is the closest to a point-of-care test for M. pneumoniae, but in this evaluation it detected only slightly more than half of the positive specimens. Despite an acceptable performance for the Resistance Plus MP in detection of M. pneumoniae, additional work is necessary to develop commercial assays capable of accurately identifying macrolide-resistant M. pneumoniae.
Our study is the first to address commercial systems and their differences in detection of
M. pneumoniae, as well as documenting macrolide resistance in comparison with reference testing by two different laboratory-developed PCRs. These data may aid in selection of diagnostic testing for syndromic management of
M. pneumoniae infections. Our laboratory at the University of Alabama at Birmingham currently performs PCR for detection of
M. pneumoniae as a single analyte. Because of concerns for macrolide resistance and its frequent occurrence in this area (
7), we perform our laboratory-developed PCR for detection of macrolide resistance on all specimens that test positive for the organism and report the results of both tests at the same time.