Evaluation of rapid tests for human immunodeficiency virus as a tool to detect recent seroconversion

ORIGINAL ARTICLE

Evaluation of rapid tests for human immunodeficiency virus as a tool to detect recent seroconversion

Samira Barboza Girardi^I; Angela Maria Egydio de Carvalho Barreto^II; Claudia Cortese Barreto^II,III; Anna Barbara Proietti^IV,V; Silvia Maia Farias de Carvalho^VI; Paula Loureiro^VII; Ester Cerdeira Sabino^VIII,*

^IUniversidade Federal de São Paulo, Escola Paulista de Medicina (UNIFESP), São Paulo, SP, Brazil

^IIFundação Pró-Sangue Hemocentro de São Paulo, São Paulo, SP, Brazil

^IIILIM56-FMUSP, Department of Molecular Biology, São Paulo, SP, Brazil

^IVFundação Centro de Hematologia e Hemoterapia de Minas Gerais (Hemominas), Belo Horizonte, MG, Brazil

^VFaculdade de Saúde e Ecologia Humana (FASEH), Vespasiano, MG, Brazil

^VIInstituto Estadual de Hematologia Arthur de Siqueira Cavalcanti (Hemorio), Rio de Janeiro, RJ, Brazil

^VIIFundação Hemope, Recife, PE, Brazil

^VIIIDepartment of Infectious Disease, Institute of Tropical Medicine, Universidade de São Paulo (USP), São Paulo, SP, Brazil

ABSTRACT

The identification of recent HIV infection is important for epidemiological studies and to monitor the epidemic. The objective of this study was to evaluate two rapid tests that are easily available to the Brazilian scientific community for using as markers of recent HIV infection. The Rapid Test - HIV-1/2 Bio-Manguinhos (Bio-Manguinhos/Fiocruz, Brazil) and the Rapid Check HIV 1&2 (NDI-UFES, Center for Infectious Diseases, Universidade Federal do Espírito Santo) were tested, using 489 samples with HIV positive serology, from blood donors, previously classified as recent or long-term infection by serological testing algorithm for recent HIV seroconversion (STARHS) or LS-HIV Vitros assay methods. The samples were diluted prior to testing (1:50 and 1:100 for the Rapid Test - HIV-1/2 Bio-Manguinhos, and 1:500 and 1:600 for the Rapid Check HIV 1&2). Negative samples were considered recent infection, whereas those showing any color intensity were associated with long-term infection. The best dilutions were 1:100 for HIV-1/2 Bio-Manguinhos test (Kappa = 0.840; overall agreement = 0.93), and 1:500 for the Rapid Check HIV 1&2 (Kappa = 0.867; overall agreement = 0.94). The results suggest that both rapid tests can be used to detect recent seroconversion.

Keywords: HIV-1 incidence; Detuned assay; Surveillance; Rapid test

Introduction

Despite the great progress achieved in preventing new human immunodeficiency virus (HIV) infections and the reduction of the annual number of acquired immunodeficiency syndrome (AIDS)-related deaths, the number of people living with HIV continues to grow worldwide. In 2010, 34 million people were estimated to be infected globally, a number 17% higher than in 2001, and the prevalence was nearly three times higher than that found in 1990. In the same period, there were 2.7 million new cases, which means over 7,000 new HIV infections per day, and 1.8 million annual deaths from AIDS.¹ There is evidence of success in HIV prevention in diverse settings, such as the reduction on the annual rate of new HIV infections around the globe, as well as a lower prevalence of HIV among young people in several countries.^2,3 Efforts to prevent HIV transmission should focus on recent infections, due to their greater impact on the spread of the epidemic.

The identification of populations at risk of HIV infection is a priority for public health and epidemiological surveillance. In recent years, epidemiologists have used different laboratory tests to estimate the incidence of HIV in certain populations, or to check the number of new infections in a given period of time.^4-7 These strategies are important tools to identify populations with high rates of ongoing transmission, to understand the patterns of transmission, to monitor and direct resources and prevention programs (especially in low-income countries, where the concentration of cases is higher), and to assess the future of the HIV epidemic.^8-11

Likewise, for studies that identify subtypes of HIV-1 or patterns of drug resistance in infected individuals, the identification of recent infected individuals can provide important information about the dynamics of the epidemic.^12-14

Detection of early infection can also be of clinical significance to the infected individual. The identification of people at an early stage of infection may accelerate the onset of treatment, improving long-term prognosis. Early treatment, along with appropriate counseling and partner notification, can help reduce secondary transmission by the newly infected partners.^15-17

The determination of incidence from conventional epidemiological methods is complex and expensive. The development of tools that could indicate whether a person was infected recently has always been a priority for HIV research. In 1998, Janssen et al.¹⁸d escribed the serological testing algorithm for recent seroconversion (STARHS) to estimate the incidence of HIV-1 in different populations. The technique was based on the principle that antibody titers against HIV increase gradually over the initial months after seroconversion. The method was based on enzyme immunoassays (ELISA - enzyme-linked immunoabsorbent assay) of the first generation (Abbott, and later manufactured by Organon Teknika). Subsequently, studies have shown that this technology could show unspecific recent infection results among with other HIV subtypes, since the test is based on HIV-1 subtypes B antigen. Another problem is that the companies discontinued the first generation tests. In 2002, Parekh et al.¹⁹ developed a new IgG capture enzyme immunoassay (BED-EIA), which is based on the detection of gradual increase in the proportion of HIVspecific IgG 1 and total IgG after seroconversion. This test showed a similar sensitivity to detect specific antibodies to the various HIV-1 subtypes. These methods can differentiate individuals with recent seroconversion from long-term infection within about six months after seroconversion, and can estimate HIV incidence using a single cross-sectional study.²⁰ However, false positive results also occurred among longterm infection. Factors such as heterogeneity of the immune response to HIV-1 genotype and use of antiretroviral therapy may cause misclassification. Thus, these assays are used at a population level, and should not be used as a diagnostic tool, since they may be misleading for the individual case definition of recent infection.

Another limiting factor for their use was the need for special equipment to perform the immunoassays, and the many hours required to obtain the results.^21,22 In places with limited resources, where the majority of diagnostic tests are performed using HIV rapid tests, these disadvantages may be of concern, and for those reasons, it is necessary to develop and validate simple tests that can be used continuously, regardless of any commercial source.²¹

The development of simple, rapid tests with high sensitivity and specificity was a major breakthrough in the diagnosis of HIV infection. These tests provide results in a very short time (minutes), do not require special laboratory equipment, and are, in addition, very economical, having been widely used as diagnostic methods, particularly in regions with limited resources and high prevalence of HIV infection.^23-25 The availability of a rapid test that also has the ability to accurately determine the incidence would be a useful epidemiological tool to assess the HIV epidemic in these regions.^25,26

Recently, some researchers^8,27,28 evaluated the use of rapid tests for the diagnosis of recent infection. The aim of the present study was to evaluate rapid tests manufactured in Brazil for this purpose.

Materials and methods

Two HIV rapid tests (RT) were analyzed: Rapid Test -HIV-1/2 Bio-Manguinhos (Bio-Manguinhos/Fiocruz, Brazil) and Rapid Check HIV 1&2 (NDI-UFES, Center for Infectious Diseases, Universidade Federal do Espírito Santo). Both tests are provided solely by the Ministry of Health, and are not commercialized. These assays consist of specific HIV-1/2 antigens adsorbed on special membranes. The results can be visualized in the form of bands on the membranes. For the purposes of the present research, the original assays were modified exclusively by dilution of samples, and the reagents and materials were not changed.

A total of 489 HIV-positive serum samples from the Epidemiology Recipient and Donor Evaluation Study (REDS)²⁹ were used for this evaluation. Of these, 147, 155, and 187 were from blood donations of the years 2007, 2008, and 2009, respectively. Samples from 2007 had previously been evaluated by the STARHS method (Vironostika HIV-1 microElisa System; bioMérieux - Raleigh, NC, USA), while in the 2008 and 2009 samples, the LS-HIV Vitros Assay method (Ortho Diagnostics, Raritan, NJ) was utilized.³⁰ The results obtained during the REDS were used to classify the samples as a recent or longterm infection.

First, four samples classified as recent infection and four samples classified as long-term infection were selected to onset of standardization. Serial dilutions were made from 1:10 to 1:10,000 in negative human serum. From this preliminary test, the best two dilutions were selected to evaluate a large number of samples. Since these are tests whose results are obtained by colorimetric bands, the reading was visual, on a properly lit and flat surface. Non-reactive samples after dilution, that is, with no band at the location indicated by the colorimetric test, were associated with cases of recent infection; those that had any staining intensity at the location indicated were associated with long-term infections.

For the Rapid Test -HIV-1/2 Bio-Manguinhos, the 1:50 and 1:100 dilutions were evaluated, as both had similar results to the samples tested. Samples were diluted in plasma and 5 fL of the final dilution was used for testing.

For the Rapid Check HIV 1&2 assay, the 1:500 and 1:600 dilutions were used. Samples were diluted in negative plasma and 10 µL were used for testing.

Apart from the dilutions, the tests were performed according to the manufacturer's instructions.

Statistical analysis was performed using the kappa coefficient, which assesses the agreement beyond chance of the results with the reference methods (STARHS and LS-HIV Vitros assay). The sensitivity and specificity of each assay were determined with a confidence interval of 95%.

Results

Table 1 shows the test results obtained by the HIV-1/2 Bio-Manguinhos using the best two dilutions (1:50 and 1:100), and the tests results by the Rapid Check HIV 1&2 at dilutions 1:500 and 1:600. Of the 146 samples defined as recent infection by reference ELISA, 111 (76%) and 132 (90.4%) were considered to be new infection by HIV-1/2 Bio-Manguinhos at dilutions of 1:50 and 1:100, respectively. Of the 343 long-term infection samples, 330 (96.2%) and 324 (94.5%) were considered to be long-term by the HIV-1/2 Bio-Manguinhos in 1:50 and 1:100 dilutions, respectively. Therefore, the 1:100 dilution was chosen for this test. For the test Rapid Check HIV 1&2, of 145 samples defined as recent infection by reference ELISAs, 132 (91%) were considered recent infection at a dilution of 1:500, and 138 (95.2%) at a dilution of 1:600. Of the 341 samples defined as long-term, Rapid Check detected 327 (95.9%) when at a dilution of 1:500, and 316 (92.7%) at a dilution of 1:600.

Table 2 summarizes the results obtained by comparing each test with each reference ELISA. The overall concordance was similar, ranging from 0.90 to 0.95.

Discussion

RTs are a practical and economical method for the diagnosis of recent HIV infection. Especially in places with limited resources, to estimate HIV incidence, using an RT could be an important tool for guiding prevention programs, identifying populations with high transmission rates, as well as understanding the patterns of transmission.

Incidence calculation by prospective cohort studies is expensive, and generally the samples are non-representative of the general population. Mathematical models created for these estimations are based on epidemiological data on HIV prevalence, diagnosis of AIDS, or death rates. However, they are difficult to standardize or require complex statistical methods.⁶ Because of this complexity and the limitations of methods to estimate HIV incidence, different laboratory techniques have been developed, seeking to distinguish recent infections from long-term infections.^{7,11,18,19,21,27,28,31-44} These tests, however, depend on the calibration panels, which are not always available in a given country. In the current study, techniques that are easily accessed by the Brazilian scientific community and public services were evaluated in order to facilitate the development of epidemiological studies needed to detect incident cases of HIV infection.

The results suggest that, by modifying the sample dilution, HIV-1/2 RTs had a similar performance as the reference ELISAs (STARHS and LS-HIV Vitros assay) to discriminate between recent and long-term infection.

The overall agreement between the RTs and the reference tests was 93% on average. As these tests are visually interpreted, it was not possible to calculate the coefficient of variation.

In 2005, Soroka et al.²⁸ modified three protocols for the detection of recent seroconversion by RT. Determine HIV-1/2 (Abbott Laboratories), OraQuick Advance HIV-1/2 (OraSure Technologies), and SeroStrip HIV-1/2 (Chem-Bio) were used, and obtained a general agreement of 95% for the tested samples. More recently, Kshatriya et al.²⁷ also compared Determine HIV-1/2 and OraQuick Advance HIV1/2 tests, and showed an agreement of 97% and 93%, respectively.

The samples used in the present study were previously tested by the reference methods STARHS and LS-HIV Vitros assay.²⁹ Similar results were observed with both assays. However, in 2011, Kassanjee⁴⁵ suggested caution in the use of LS-HIV Vitros Assay, since it has high false-recent rates.

Unfortunately, the results of both tests were not available for the same sample, thus it was not possible to determine the agreement between the two tests in the tested samples. In this sense, the limitation of this study is the same as reported by the majority of other investigators seeking to standardize tests for this purpose, that is, the lack of availability of specific samples in an adequate volume that would allow for the evaluation of a test series, comparing performance among them.

Another limitation of this study is that the interval between infection and seroconversion could not be determined. The STARHS and LS-HIV Vitros assay tests were standardized for a window period of 170 days using samples with the window period previously known. The fact that this study's methodology has shown good correlation with these methods does not necessarily imply that the window period is the same.

Conclusion

It is still premature to use this technology to define incidence. However, it could be used to screen recently infected individuals, who would need to be confirmed by a follow up-sample, or to be used in studies comparing the relative rate of newly infected individuals in different populations.

Conflict in interest

All authors declare to have no conflict of interest.

Acknowledgements

Samira Barbosa Girardi received a Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES) grant. The rapid test was freely offered by the Brazilian Ministry of Health's AIDS Program.

Received 5 April 2012

Accepted 15 May 2012

Available online 7 September 2012

• 1. Unaids. World AIDS Day Report 2011. 2011. Available from: http://www.unaids.org/en/media/unaids/contentassets/documents/unaidspublication/2011/JC2216 WorldAIDSday_report_2011_en.pdf
• ²
  Unaids. Relatório Global sobre a Epidemia de AIDS 2009 - Sumário Geral. 2009. Available from: http://www.onu-brasil.org.br/doc/2009-Relatorio-Global-Aids-Sum-rio-Geral-Port.pdf
• 3. Unaids. AIDS Epidemic Update 2009. 2009. Available from: http://data.unaids.org/pub/Report/2009/JC1700_Epi_Updat_e_2009_en.pdf
• 4. Balasubramanian R, Lakagos SW. Estimating HIV incidence based on combined prevalence testing. The Internat Biom Soc. 2009;66:1-10.
• 5. Barreto CC, Sabino EC, Gonzalez TT, et al. Prevalence, incidence and residual risk of HIV among community and replacement first-time blood donors in São Paulo Brazil. Transfusion. 2005;45:1709-14.
• 6. Busch MP, Pilcher CD, Mastro TD, et al. Beyond detuning: 10 years of progress and new challenges in the development and application of assays for HIV incidence estimation. AIDS. 2010;24:2763-71.
• 7. Vu SL, Pillonel J, Semaille C, et al. Principles and uses of HIV incidence estimation from recent infection testing-areview. Eurosurveillance. 2008;13:11-6.
• 8. Constantine NT, Sill AM, Jack N, et al. Improved classification of recent HIV-1 infection by employing a two-stage sensitive/less-sensitive test strategy. J Acquir Immune Defic Syndr. 2003;32:94-103.
• 9. Constantine NT, Zink H. HIV testing technologies after two decades of evolution. Indian J Med Res. 2005;121:519-38.
• 10. Hall HI, Song R, Rhodes P, et al. Estimation of HIV incidence in the United States. J Am Med Assoc. 2008;300:520-9.
• 11. Schüpbach J, Gebhardt MD, Tomasik Z, et al. Assessment of recent HIV-1 infection by a line immunoassay for HIV 1/2 confirmation. Plos Medicine. 2007;4:1921-30.
• 12. Machado DM, Delwarta EL, Diaz RS, et al. Use of the sensitive/less-sensitive (detuned) EIA strategy for targeting genetic analysis of HIV-1 to recently infected blood donors. AIDS. 2002;16:113-9.
• 13. Guy R, Gold J, Calleja JMC, et al. Accuracy of serological assays for detection of recent infection with HIV and estimation of population incidence: a systematic review. Lancet Infect Dis. 2009;9:747-59.
• 14. Novitsky V, Wang R, Kebaabetswe L, et al. Better control of early viral replication is associated with slower rate of elicited antiviral antibodies in the detuned enzyme immunoassay during primary HIV-1 infection. J Acquir Immune Defic Syndr. 2009;52:265-72.
• 15. Carr A, Cooper DA. Adverse effects of antiretroviral therapy. Lancet. 2000;356:1423-30.
• 16. Hammer SM, Eron JJ, Reiss P, et al. Antiretroviral treatment of adult HIV infection: 2008 recomendations of the international AIDS Society USA Panel. J Am Med Assoc. 2008;300:555-70.
• 17. Ministério da Saúde. Recomendações para terapia antirretroviral em adultos infectados pelo HIV. Brasília, 2008. Available from: http://www.aids.gov.br/publicacao/consenso-recomendacoes-para-terapia-antirretroviral-em-adultos-infectados-pelo-hiv-2008
• 18. Janssen RS, Satten GA, Stramer SL, et al. New testing strategy to detect early HIV-1 infection for use in incidence estimates and for clinical and prevention purposes. J Am Med Assoc. 1998;280:42-9.
• 19. Parekh BS, Kennedy MS, Dobbs T, et al. Quantitative detection of increasing HIV type 1 antibodies after seroconversion: a simple assay for detecting recent HIV infection and estimating incidence. Aids Res and Hum Retrov. 2002;18:295-307.
• 20. Hargrove JW, Humphrey JH, Mutasa K, et al. Improved HIV-1 incidence estimates using the BED capture enzyme immunoassay. AIDS. 2008;22:511-8.
• 21. Murphy G, Parry JV. Assays for the detection of recent infections with human immunodeficiency virus type 1. Eurosurveillance. 2008;13:4-10.
• 22. Sakarovitch C, Rouet F, Murphy G, et al. Do tests devised to detect recent HIV-1 infection provide reliable estimates of incidence in Africa? J Acqui Immune Defic Syndr. 2007;45:115-22.
• 23. Donovan BJ, Rublein JC, Leone PA, Pilcher CD. HIV Infection: Point-of-care testing. The Annals of Pharmac. 2004;38:670-6.
• 24. Duarte G, Gonçalves CV, Marcolin AC, et al. Teste rápido para detecção da infecção pelo HIV-1 em gestantes. Rev Bras Ginecol Obstet. 2001;23:107-11.
• 25. Piwowar-Manning EM, Tustin NB, Sikateyo P, et al. Validation of rapid HIV antibody tests in 5 African countries. J Int Assoc Phys AIDS Care. 2010;9:170-2.
• 26. Ferreira Junior OC, Ferreira C, Riedel M, et al. Evaluation of rapid tests for anti-HIV detection in Brazil. AIDS. 2005;19:S70-5.
• 27. Kshatriya R, Cachafeiro AA, Kerr RJS, et al. Comparison of two rapid human immunodeficiency virus (HIV) assays. Determine HIV-1/2 and OraQuick Advance Rapid HIV-1/2, for detection of recent HIV seroconversion. J Clin Microbiol. 2008;46:3482-3.
• 28. Soroka SD, Granade TC, Candal D, Parekh BS. Modification of rapid human immunodeficiency virus (HIV) antibody assay protocols for detecting recent HIV seroconversion. Clin Diagn Lab Immunol. 2005;12:918-21.
• 29. Sabino EC, Gonçalez TT, Carneiro-Proietti AB, et al. Human immunodeficiency virus prevalence, incidence, and residual risk of transmission by transfusions at Retrovirus Epidemiology Donor Study-II blood centers in Brazil. Transfusion. 2012;52:870-9.
• 30. Keating SM, Hanson D, Lebedeva L, et al. Optimization and calibration of less sensitive and avidity modified protocols for the vitros immunodiagnostic products anti-HIV-1+2 for detection of early HIV infections. In: CDC/APHL Diagnostic Conference. 2010.
• 31. Rawal BD, Degula A, Lebedeva L, et al. Development of a new less-sensitive enzyme immunoassay for detection of early HIV-1 infection. J Acquir Immune Defic Syndr. 2003;33:349-55.
• 32. Kothe D, Byers RH, Caudill SP, et al. performance characteristics of a new less sensitive HIV-1 enzyme immunoassay for use in estimating HIV seroincidence. J Acquir Immune Defic Syndr. 2003;33:625-34.
• 33. Mcdougal JS, Pilcherb CD, Parekh BP, et al. Surveillance for HIV-1 incidence using tests for recent infection in resource-constrained countries. AIDS. 2005;19:S25-30.
• 34. Hare CB, Pappalardo BL, Busch MP, et al. Seroreversion in subjects receiving antiretroviral therapy during acute/early HIV infection. Clin Infect Dis. 2006;42:700-8.
• 35. Suligoi B, Galli C, Massi M, et al. Precision and accuracy of a procedure for detecting recent human immunodeficiency virus infections by calculating the antibody avidity index by an automated immunoassay-based method. J Clin Microbiol. 2002;40:4015-20.
• 36. Suligoi B, Massi M, Galli C, et al. Identifying recent HIV infections using the avidity index and an automated enzyme immunoassay. J Acquir Immune Defic Syndr. 2003;32:424-8.
• 37. Chawla A, Murphy G, Donnelly C, et al. Human immunodeficiency virus (HIV) antibody avidity testing to identify recent infection in newly diagnosed HIV type 1 (HIV-1)-seropositive persons infected with diverse HIV-1 subtypes. J Clin Microbiol. 2007;45:415-20.
• 38. Barin F, Meyer L, Lancar R, et al. Development and validation of an immunoassay for identification of recent human immunodeficiency virus type 1 infections and its use on dried serum spots. J Clin Microbiol. 2005;43:4441-7.
• 39. Semaille C, Barin F, Cazein F, et al. Monitoring the dynamics of the HIV epidemic using assays for recent infection and serotyping among new HIV diagnoses: experience after 2 years in France. J Infect Dis. 2007;196:377-83.
• 40. Pillonel J, Laperche S, Bernillon P, et al. Human immunodeficiency virus type 1 incidence among blood donors in France, through 2006: use of an immunoassay to identify recent infections. Transfusion. 2008;48:1567-75.
• 41. Wilson KM, Johnson EIM, Croom HA, et al. Incidence immunoassay for distinguishing recent from established HIV-1 infection in therapy-naïve populations. AIDS. 2004;8:2253-9.
• 42. Barin F, Nardone A. Monitoring HIV epidemiology using assays for recent infection: where are we? Euro Surveill. 2008;13:1-2.
• 43. Wei X, Liu X, Dobbs T, et al. Development of two avidity-based assays to detect recent HIV type 1 seroconversion using a multisubtype gp41 recombinant protein. AIDS Res Hum Retroviruses. 2010;26:61-71.
• 44. Withum, DG, et al. Serological testing algorithm for recent HIV seroconversion (STARHS): CDC's investigational new drug program and uses of a testing strategy to detect early HIV-1 infection. Inf Conf AIDS (abstract ThPeC7603). XIV International AIDS Conference. Barcelona; July 2002.
• 45. Kassanjee R, Welte A, McWalter TA, et al. Seroconverting blood donors as a resource for characterizing and optimizing recent infection testing algorithms for incidence estimation. Plos One. 2011;6:1-8.

Publication Dates

• Publication in this collection
  17 Oct 2012
• Date of issue
  Oct 2012

History

• Received
  05 Apr 2012
• Accepted
  15 May 2012