Accuracy of a rapid molecular test for tuberculosis in sputum samples, bronchoalveolar lavage fluid, and tracheal aspirate obtained from patients with suspected pulmonary tuberculosis at a tertiary referral hospital

ABSTRACT

Tuberculosis continues to be a major public health problem worldwide. The aim of the present study was to evaluate the accuracy of the Xpert MTB/RIF rapid molecular test for tuberculosis, using pulmonary samples obtained from patients treated at the Júlia Kubitschek Hospital, which is operated by the Hospital Foundation of the State of Minas Gerais, in the city of Belo Horizonte, Brazil. This was a retrospective study comparing the Xpert MTB/RIF test results with those of standard culture for Mycobacterium tuberculosis and phenotypic susceptibility tests. Although the Xpert MTB/RIF test showed high accuracy for the detection of M. tuberculosis and its resistance to rifampin, attention must be given to the clinical status of the patient, in relation to the test results, as well as to the limitations of molecular tests.

Keywords:
Tuberculosis/diagnosis; Molecular diagnostic techniques; Sputum; Bronchoalveolar lavage fluid

RESUMO

A tuberculose permanece como um grave problema de saúde pública. O objetivo deste estudo foi avaliar a acurácia do teste rápido molecular Xpert MTB/RIF em amostras pulmonares no Hospital Júlia Kubitschek, Fundação Hospitalar do Estado de Minas Gerais, localizado em Belo Horizonte (MG). Trata-se de um estudo descritivo retrospectivo, considerando-se como método padrão a cultura para o bacilo da tuberculose e o teste de sensibilidade fenotípico. O teste Xpert MTB/RIF apresentou ótima acurácia para a detecção da tuberculose e resistência à rifampicina, mas é necessária a atenção a dados clínicos do paciente em relação ao resultado do exame e às limitações dos testes moleculares.

Descritores:
Tuberculose/diagnóstico; Técnicas de diagnóstico molecular; Escarro; Líquido da lavagem broncoalveolar

Tuberculosis continues to be a major public health problem worldwide. It is estimated that there were 6.3 million new cases of tuberculosis worldwide in 2016, 1.7 million individuals having died from the disease, which is recognized by the World Health Organization (WHO) as the leading cause of death from infectious diseases worldwide.¹ In 2016, 66,796 new cases of tuberculosis were diagnosed and reported in Brazil.²

Early diagnosis and treatment of pulmonary tuberculosis are essential in reducing tuberculosis dissemination, morbidity, mortality, and costs.³ In Brazil, 71.6% of all new tuberculosis cases in 2016 were confirmed by laboratory criteria, and, according to the latest WHO report, 41% of all multidrug-resistant tuberculosis cases in 2016 were diagnosed in Brazil.^1,2 However, conventional diagnostic methods have disadvantages such as low sensitivity and specificity (in the case of smear microscopy), as well as the considerable time required for obtaining test results (in the cases of culture and drug susceptibility testing).⁴ Molecular diagnostic techniques have been reported as being more sensitive, specific, and rapid.⁵

In 2010, the WHO recommended the use of the Xpert MTB/RIF rapid molecular test for tuberculosis (Cepheid, Sunnyvale, CA, USA), a rapid and fully automated nucleic acid amplification test that detects Mycobacterium tuberculosis and its resistance to rifampin.⁶ Although most studies validating the Xpert MTB/RIF test have shown promising results, showing good accuracy in sputum samples,⁷ only a few have shown good accuracy in BAL fluid and tracheal aspirate (TA).^3,8-10

The Brazilian National Ministry of Health has recently incorporated the use of the Xpert MTB/RIF test in some laboratories in Brazil, including the laboratory of the Júlia Kubitschek Hospital, which is operated by the Hospital Foundation of the State of Minas Gerais, a tertiary referral hospital for tuberculosis and drug-resistant tuberculosis in the city of Belo Horizonte, Brazil.¹¹ The objective of the present study was to evaluate the accuracy of the Xpert MTB/RIF test in sputum samples, BAL fluid, and TA obtained from patients with suspected pulmonary tuberculosis at the aforementioned hospital.

This was a retrospective descriptive study. We compared the Xpert MTB/RIF test results with those of standard culture for M. tuberculosis in a total of 534 samples in the period between December of 2014 and November of 2015. Of those samples, 238 were sputum samples, 199 were BAL fluid samples, and 97 were TA samples. Culture was considered the standard method for detecting M. tuberculosis. Antimicrobial susceptibility testing (AST) was considered the standard method for detecting resistance to rifampin. Samples with insufficient growth for mycobacterial species identification were excluded, as were contaminated samples and samples with growth of nontuberculous mycobacteria.

Culture was performed on Löwenstein-Jensen medium after decontamination by the sodium lauryl sulfate method.¹² Species identification and AST by the proportion method^13,14 or by an automated culture system (BACTEC Mycobacteria Growth Indicator Tube [MGIT] 960; Becton Dickinson, Sparks, MD, USA) were performed in the Ezequiel Dias Foundation state referral laboratory. The Xpert MTB/RIF test was performed in accordance with the manufacturer instructions.¹⁵

Sensitivity, specificity, positive predictive value, negative predictive value, accuracy, and agreement were calculated with the Minitab software, version 17 (Minitab Inc., State College, PA, USA) and the GraphPad Prism software, version 7 (GraphPad Software Inc., San Diego, CA, USA).

The study project was approved by the Research Ethics Committee of the Hospital Foundation of the State of Minas Gerais (Ruling no. 1,764,672).

Culture was positive for M. tuberculosis in 15.2% of the samples (81/534), and the Xpert MTB/RIF test was positive for M. tuberculosis in 19.9% of the samples (106/534). Table 1 shows the overall accuracy of the Xpert MTB/RIF test in detecting M. tuberculosis, whereas Table 2 shows the accuracy of the Xpert MTB/RIF test in detecting M. tuberculosis for each sample type.

Table 1
Diagnostic accuracy of the Xpert MTB/RIF test for detecting Mycobacterium tuberculosis and its resistance to rifampin.^a

Variable	Detection of MTB	Detection of resistance to RIF
Sensitivity (%)	100 (100-100)	100 (100-100)
Specificity (%)	94.5 (92.4-96.6)	98.0 (94.2-101.8)
PPV (%)	76.4 (68.3-84. 5)	90.0 (76.0-103.1)
NPV (%)	100 (100-100)	100 (100-100)
Accuracy (%)	95.3 (93.5-97.1)	98.3 (95.1-101.6)
Kappa*	0.84 (0.78-0.90)	0.94 (0.82-1.06)

• MTB: Mycobacterium tuberculosis; RIF: rifampin; PPV: positive predictive value; and NPV: negative predictive value. ^aValues expressed as n (95% CI). *The criteria for kappa were as follows: < 0.20, poor; 0.21-0.40, weak; 0.41-0.60, moderate; 0.61-0.80, good; and > 0.80-1.00, very good.

Table 2
Diagnostic accuracy of the Xpert MTB/RIF test for different types of pulmonary samples.

Variable	Sputum	Bronchoalveolar lavage fluid	Tracheal aspirate
	(n = 238)	(n = 199)	(n = 97)
Sensitivity (%)	100 (100-100)	100 (100-100)	100 (100-100)
Specificity (%)	92.8 (89.1-96.4)	95 (91.8-98.2)	97.5 (94.0-100.9)
PPV (%)	75.9 (64.9-86.9)	67.9 (50.6-85.2)	90.0 (76.0-103.1)
NPV (%)	100 (100-100)	100 (100-100)	100 (100-100)
Accuracy (%)	94.1 (91.1-97.1)	95.5 (92.6-98.4)	97.9 (95.1-100.8)
Kappa*	0.83 (0.74-0.91)	0.78 (0.65-0.92)	0.93 (0.84-1.02)

• PPV: positive predictive value; and NPV: negative predictive value. ^aValues expressed as n (95% CI). *The criteria for kappa were as follows: < 0.20, poor; 0.21-0.40, weak; 0.41-0.60, moderate; 0.61-0.80, good; and > 0.80-1.00, very good.

AST was performed in 60 isolates from 81 cultures that were positive for M. tuberculosis. Of those 60 isolates, 9 were found to be resistant to rifampin by AST and the Xpert MTB/RIF test. With regard to susceptibility to rifampin, there was agreement between the two test methods for 49 of the 60 isolates and disagreement for 2 (resistance to rifampin by the Xpert MTB/RIF test and susceptibility to rifampin by AST in 1 and susceptibility to rifampin by the Xpert MTB/RIF test and resistance to rifampin by AST in 1). The accuracy of the Xpert MTB/RIF test in detecting resistance to rifampin is shown in Table 1.

In 25 patients, the Xpert MTB/RIF test results were positive but culture results were negative. Of those 25 patients, 9 had a history of tuberculosis, 4 had been receiving treatment at the time of testing, and 1 underwent testing for disease control (the test having therefore been incorrectly requested). In 4 patients, there was no history of tuberculosis and treatment was not initiated, the outcome being defined as mycobacteria other than tuberculosis. In the remaining 7 patients, it was impossible to evaluate clinical history.

Sensitivity was higher in the present study than in other studies (82-93%), whereas specificity was similar (96-100%).^3,7-9 The negative predictive value of the Xpert MTB/RIF test was found to be high, meaning that the test can rapidly rule out tuberculosis in patients suspected of having the disease.

With regard to the accuracy of the Xpert MTB/RIF test in detecting M. tuberculosis for each sample type, the results were similar except for the positive predictive values for sputum and BAL fluid samples, which were lower because of a higher number of discordant (false-positive) results between the two.

Of the 25 patients in whom there was disagreement between the Xpert MTB/RIF test results and culture results (i.e., positive Xpert MTB/RIF test results and negative culture results), 14 had a history of tuberculosis, with 4 being under treatment at the time of testing; this shows the importance of effective communication between the laboratory and clinical staff, given that the Xpert MTB/RIF test amplifies DNA originating from live or dead bacilli.³ In a report published one year after the implementation of the Xpert MTB/RIF test in Brazil, 50% of the monitors stated that the test request forms used in their states lacked important information-such as whether the individual under investigation for tuberculosis has any risk factors for the disease-thus making it difficult to select the most appropriate tools for diagnosis.¹⁶

In patients without active disease but with dead bacilli in their lungs from previously treated active tuberculosis, the Xpert MTB/RIF test results can remain positive for up to five years; therefore, conversion to negative is not a suitable marker of treatment success. In such cases, the diagnosis of tuberculosis should be made exclusively by sputum smear microscopy and sputum culture; the Xpert MTB/RIF test can be used only to identify early resistance to rifampin.^17,18 Further studies are needed in order to quantify this better and determine predisposing factors.¹⁷

In the 4 patients who had no history of tuberculosis and who were classified as having mycobacteria other than tuberculosis in the present study, the results should be interpreted in a clinical context. In some cases, the Xpert MTB/RIF test can be more sensitive than conventional culture. The high sensitivity of the Xpert MTB/RIF test can be explained by the analytical detection limit, which is 131 colony-forming units/mL, being as high as 10 colony-forming units/mL in some samples.⁹

It has been hypothesized that false-positive results are due to residual persistent DNA from dead M. tuberculosis in lung tissue, expectorated because of another lung disease and thus leading to false-positive results for active tuberculosis.¹⁷

Of 25 positive Xpert MTB/RIF test results and negative culture results, 12 showed very low cycle threshold values (> 28 cycles) and 11 showed low values (23-28 cycles). These values represent a low concentration of M. tuberculosis complex DNA in our sample.³ Further studies are needed in order to interpret these results in conjunction with patient clinical evaluation and the presence of other diseases.

Positive Xpert MTB/RIF test results and negative culture results might be related to technical manipulation issues, such as drastic decontamination procedures, temperature fluctuations in the incubator, and improper clinical sample storage.¹²

With regard to rifampin resistance, 2 samples showed disagreement between the Xpert MTB/RIF test and AST: resistance to rifampin by the Xpert MTB/RIF test and susceptibility to rifampin by AST in 1 and susceptibility to rifampin by the Xpert MTB/RIF test and resistance to rifampin by AST in 1. Resistance to rifampin is primarily due to mutations in the rpoB gene; however, rare mutations can occur outside the target region, and rifampin resistance cannot be detected unless 65-100% of the DNA population in the sample is mutant.^4,19 In addition, mixed infections can lead to false-negative or false-positive results. Heteroresistance is defined by the presence of susceptible and resistant populations of M. tuberculosis and has been reported as a possible cause of discordant AST results.²⁰

One of the limitations of the present study is that sputum smear microscopy was not performed in parallel with the Xpert MTB/RIF test, because the samples were evaluated under routine laboratory conditions. In addition, it was impossible to analyze sociodemographic, clinical, and imaging data. Furthermore, it was impossible to study the impact of the Xpert MTB/RIF test on the time from diagnosis to treatment.

The results of the present study can contribute to improving the laboratory diagnosis of tuberculosis in sputum samples, BAL fluid, and TA; however, attention must be given to the clinical status of the patient, in relation to the test results, as well as to the limitations of molecular tests.^3,17,18 In addition, it is important that test request forms be filled out correctly and include information on why the test is being requested (i.e., for diagnosis or follow-up), as well as patient history of tuberculosis treatment (i.e., previous tuberculosis treatment or no previous tuberculosis treatment) and risk factors for tuberculosis.¹⁶

Although the Xpert MTB/RIF test showed high accuracy for the detection of M. tuberculosis and its resistance to rifampin, attention must be given to the clinical status of the patient, in relation to the test results, as well as to the limitations of molecular tests.^3,17,18 Further studies are needed in order to evaluate the impact of the Xpert MTB/RIF test on patients and society in different settings (primary care, secondary care, and tertiary care) in the five regions of Brazil.

ACKNOWLEDGMENTS

We would like to thank the Hospital Foundation of the State of Minas Gerais for allowing us to gain access to the relevant data. We would also like to thank the coordinators and technical staff of the Júlia Kubitschek Hospital laboratory for their support during data collection.

REFERENCES

• ¹
  World Health Organization. Global Tuberculosis Report 2016. Geneva: World Health Organization; 2016.
• ²
  Brasil. Ministério da Saúde. Secretaria de Vigilância em Saúde. Indicadores prioritários para o monitoramento do Plano Nacional pelo fim da tuberculose como problema de saúde pública no Brasil. Boletim Epidemiológico. 2017;48(8):1-11.
• ³
  Ssengooba W, Respeito D, Mambuque E, Blanco S, Bulo H, Mandomando I, et al. Do Xpert MTB/RIF Cycle Threshold Values Provide Information about Patient Delays for Tuberculosis Diagnosis? PLoS One. 2016;11(9):e0162833. https://doi.org/10.1371/journal.pone.0162833
  » https://doi.org/10.1371/journal.pone.0162833
• ⁴
  Xpert(r) MTB/RIF no diagnóstico da tuberculose pulmonar. Bol Bras Avaliação de Tecnologias em Saúde. 2011;16:1-13.
• ⁵
  Aurin TH, Munshi SK, Kamal SM, Rahman MM, Hossain MS, Marma T, et al. Molecular approaches for detection of multi-drug resistant tuberculosis (MDR-TB) in Bangladesh. PloS One. 2014;9(6):e99810. https://doi.org/10.1371/journal.pone.0099810
  » https://doi.org/10.1371/journal.pone.0099810
• ⁶
  World Health Organization [homepage on the Internet]. Geneva: World Health Organization; c2016 [updated 2010 Dec 8; cited 2016 Oct 15]. WHO endorses new rapid tuberculosis test. Available from: http://www.who.int/mediacentre/news/releases/2010/tb_test_20101208/en/index.html
  » http://www.who.int/mediacentre/news/releases/2010/tb_test_20101208/en/index.html
• ⁷
  Steingart KR, Schiller I, Horne DJ, Pai M, Boehme CC, Dendukuri N. Xpert(r) MTB/RIF assay for pulmonary tuberculosis and rifampicin resistance in adults. Cochrane Database Syst Rev. 2014;(1):CD009593. https://doi.org/10.1002/14651858.CD009593.pub3
  » https://doi.org/10.1002/14651858.CD009593.pub3
• ⁸
  Theron G, Peter J, Meldau R, Khalfey H, Gina P, Matinyena B, et al. Accuracy and impact of Xpert MTB/RIF for the diagnosis of smear-negative or sputum-scarce tuberculosis using bronchoalveolar lavage fluid. Thorax. 2013;68(11):1043-51. https://doi.org/10.1136/thoraxjnl-2013-203485
  » https://doi.org/10.1136/thoraxjnl-2013-203485
• ⁹
  Lee HY, Seong MW, Park SS, Hwang SS, Lee J, Park YS, et al. Diagnostic accuracy of Xpert(r) MTB/RIF on bronchoscopy specimens in patients with suspected pulmonary tuberculosis. Int J Tuberc Lung Dis. 2013;17(7):917-21. https://doi.org/10.5588/ijtld.12.0885
  » https://doi.org/10.5588/ijtld.12.0885
• ¹⁰
  Le Palud P, Cattoir V, Malbruny B, Magnier R, Campbell K, Oulkhouir Y, et al. Retrospective observational study of diagnostic accuracy of the Xpert(r) MTB/RIF assay on fiberoptic bronchoscopy sampling for early diagnosis of smear-negative or sputum-scarce patients with suspected tuberculosis. BMC Pulm Med. 2014;14:137. https://doi.org/10.1186/1471-2466-14-137
  » https://doi.org/10.1186/1471-2466-14-137
• ¹¹
  Pinto M, Entringer AP, Steffen R, Trajman A. Cost analysis of nucleic acid amplification for diagnosing pulmonary tuberculosis, within the context of the Brazilian Unified Health Care System. J Bras Pneumol. 2015;41(6):536-8. https://doi.org/10.1590/s1806-37562015000004524
  » https://doi.org/10.1590/s1806-37562015000004524
• ¹²
  Ministério da Saúde. Secretaria de Vigilância em Saúde. Centro de Referência Professor Hélio Fraga. Manual de Bacteriologia da Tuberculose. Rio de Janeiro: Ministério da Saúde; 2005.
• ¹³
  Canetti G, Fox W, Khomenko A, Mahler HT, Menon MK, Mitchison DA, et al. Advances in techniques of testing mycobacterial drug sensitivity, and the use of sensitivity tests in tuberculosis control programmes. Bull World Health Organ. 1969;41(1):21-43.
• ¹⁴
  Martins Soares V, Da Silva Carvalho W, Spindola De Miranda S. Utilization of bacteriological culture for increased diagnostic performance at a tuberculosis reference center hospital. Rev Argent Microbiol. 2012;44(3):173-6.
• ¹⁵
  Cepheid.com [homepage on the Internet]. Sunnyvale (CA): Cepheid; [updated 2010 Dec 8; cited 2016 Jan 26]. Cepheid Xpert MTB/RIF Brochure. Available from: http://www.cepheid.com/us/search?searchword=MTB+rif
  » http://www.cepheid.com/us/search?searchword=MTB+rif
• ¹⁶
  Brasil. Ministério da Saúde. Secretaria de Vigilância em Saúde. Departamento de Vigilância das Doenças Transmissíveis. Rede de Teste Rápido para tuberculose no Brasil: primeiro ano da implantação. Brasília: Ministério da Saúde; 2015.
• ¹⁷
  Boyles TH, Hughes J, Cox V, Burton R, Meintjes G, Mendelson M. False-positive Xpert(r)MTB/RIF assays in previously treated patients: need for caution in interpreting results. Int J Tuberc Lung Dis. 2014:18(7);876-8. https://doi.org/10.5588/ijtld.13.0853
  » https://doi.org/10.5588/ijtld.13.0853
• ¹⁸
  Metcalfe JZ, Makumbirofa S, Makamure B, Mutetwa R, Peñaloza RA, Sandy C, et al. Suboptimal specificity of Xpert MTB/RIF among treatment-experienced patients. Eur Resp J. 2015:45(5):1504-6. https://doi.org/10.1183/09031936.00214114
  » https://doi.org/10.1183/09031936.00214114
• ¹⁹
  Blakemore R, Story E, Helb D, Kop J, Banada P, Owens MR, et al. Evaluation of the analytical performance of the Xpert MTB/RIF assay. J Clin Microbiol. 2010:48(7);2495-501. https://doi.org/10.1128/JCM.00128-10
  » https://doi.org/10.1128/JCM.00128-10
• ²⁰
  Singh UB, Pandey P, Mehta G, Bhatnagar AK, Mohan A, Goyal V, et al. Genotypic, Phenotypic and Clinical Validation of GeneXpert in Extra-Pulmonary and Pulmonary Tuberculosis in India. PLoS One. 2016;11(2):e0149258. https://doi.org/10.1371/journal.pone.0149258
  » https://doi.org/10.1371/journal.pone.0149258

• 1
  Study carried out in the Setor de Microbiologia, Laboratório do Hospital Júlia Kubitschek, Fundação Hospitalar do Estado de Minas Gerais - FHEMIG - Belo Horizonte (MG) Brasil.

• Financial support:

  None.

Publication Dates

• Publication in this collection
  2019

History

• Received
  11 Dec 2017
• Accepted
  12 Aug 2018