Abstract
Rapid antigen detection tests (RADTs) are immunoassays that produce results in 15 min or less, have low sensitivity (50 %), but high specificity (95 %). We studied the clinical impact and laboratory savings of a diagnostic algorithm for influenza infection using RADTs as a first-step technique during the influenza season. From January 15th to March 31st 2014, we performed a diagnostic algorithm for influenza infection consisting of an RADT for all respiratory samples received in the laboratory. We studied all the patients with positive results for influenza infection, dividing them into two groups: Group A with a negative RADT but positive reference tests [reverse transcription polymerase chain reaction (RT-PCR) and/or culture] and Group B with an initial positive RADT. During the study period, we had a total of 1,156 patients with suspicion of influenza infection. Of them, 217 (19 %) had a positive result for influenza: 132 (11 %) had an initial negative RADT (Group A) and 85 (7 %) had a positive RADT (Group B). When comparing patients in Group A and Group B, we found significant differences, as follows: prescribed oseltamivir (67 % vs. 82 %; p = 0.02), initiation of oseltamivir before 24 h (89 % vs. 97 %; p = 0.03), antibiotics prescribed (89 % vs. 67 %; p = <0.01), intensive care unit (ICU) admissions after diagnosis (23 % vs. 14 %; p = 0.05), and need for supplementary oxygen (61 % vs. 47 %; p = 0.01). An influenza algorithm including RADTs as the first step improves the time of administration of proper antiviral therapy, reduces the use of antibiotics and ICU admissions, and decreases hospital costs.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
During the winter season, the influenza virus constitutes a work overload, especially for the emergency department, healthcare workers, and for the microbiological department [1]. The diagnosis of influenza virus has improved rapidly since the 2009 pandemic, becoming currently a fast and accurate diagnosis with an elevated sensitivity and specificity [2]. The reference standards for laboratory confirmation of influenza virus infection are reverse transcription polymerase chain reaction (RT-PCR) or viral culture. These tests require trained personnel, take time to perform, and are expensive techniques. Rapid antigen detection tests (RADTs) are immunoassays that can identify the presence of influenza A and B viral nucleoprotein antigens in respiratory specimens. These tests are simple to perform and produce results in 15 min or less, yet they have been proven to have a low sensitivity (≈50 %), but a high specificity (≈95 %), especially during the influenza season [3]. The value of these tests as a diagnostic tool for influenza infection and the importance of an algorithm using RADTs as a first step test is not clear [4, 5]. Our hypothesis is that a simplified strategy would improve the time to diagnosis, reduce the work load, improve patient management, and, ultimately, help to reduce costs. Our study consists of the evaluation of the clinical and laboratory impact of a diagnostic algorithm for influenza infection using RADTs as a first-step technique during the influenza season.
Methods
Setting, study design, and population
Our institution is a 1,550-bed general teaching hospital attending a catchment population of approximately 715,000 inhabitants in a large city.
We performed a cohort study from January 15th to March 31st 2014. During this period, our microbiological department received upper and lower respiratory samples from children and adults who arrived at our hospital with a clinical suspicion of influenza. Upper respiratory samples consisted of nose-throat swabs or nasopharyngeal aspirates and lower respiratory samples consisted of endotracheal aspirates or bronchoalveolar lavages. The samples were taken by the nursing staff in the emergency department and the hospitalization wards.
Microbiological procedure
All respiratory samples received in our laboratory were broken into a vial containing transport medium. During the study period, we systematically performed on all respiratory samples an RADT. The RADT was performed following the manufacturer’s instructions (Xpect™ Flu A & B, Remel Europe Ltd.). We also performed an RT-PCR assay and/or a shell vial assay on all the samples. RT-PCR was performed by extracting viral RNA from 200 μL of the sample in a NucliSENS easyMag device (bioMérieux, Boxtel, the Netherlands) following the manufacturer’s instructions, eluted in 60 μL of elution buffer, and maintained at 4 °C if it was analyzed immediately or at −70 °C until the assay was performed. A water sample was co-extracted as a negative control in all cases. Influenza A H1N1 and influenza B were detected using real-time RT-PCR following the manufacturer’s instructions (RT-PCR Flu A/B Typing Real-time Detection, Anyplex). For the shell vial assay, the samples were inoculated into two cell lines, MRC-5 and A549, the latter with immunofluorescence using specific fluorescein-conjugated monoclonal antibodies (SimulFluor® FluA/FluB, Light Diagnostics), as reported previously [2].
We studied all the patients who were positive for influenza infection, dividing them into two groups: Group A in which the initial RADT was negative but the reference tests were positive, informing the clinician of this last result, and Group B with an initial positive RADT, in which the clinician was immediately informed of the result and the diagnostic algorithm was considered finished. These results were confirmed by reference tests afterwards.
Clinical data
The clinical data were retrieved from the electronic medical records of the patients. The data included age, gender, location of the patients at the moment of presenting with respiratory symptoms, and complications of influenza infection: admission to the intensive care unit (ICU), new or worsening heart failure, requirement of supplementary oxygen (nasal cannula or oxygen mask), and endotracheal intubation with mechanical ventilation. Additional data included: prescribed and time of prescription of antiviral (oseltamivir) and prescribed antibiotic, final outcome, and length of hospital stay. We also collected microbiological results that included RADT, RT-PCR, and shell vial results.
Statistical analysis
Categoric variables appear with their frequency distribution. Non-normally distributed continuous variables are expressed as the median and interquartile range (IQR). The association between categoric variables was evaluated by using the χ2 test or Fisher’s exact test. A t-test was performed on the equality of means between Groups A and B; Bartlett’s test has been used to test the equality of variances before conducting the t-test. A p-value of 0.05 was considered statistically significant. Data were analyzed using Stata, version 12.
Ethics committee approval
This study had been evaluated and approved by the ethics committee of our institution and by the Spanish Drug Agency.
Results
During the study period, we had a total of 1,156 patients with suspicion of influenza infection. Of them, 939 (81 %) had a negative initial RADT and a negative reference test result; therefore, they were considered true-negatives. On the other hand, 217 (19 %) had a positive result for influenza. Of these patients, 132 (11 %) had an initial negative RADT, but had a positive reference test for influenza (RT-PCR/culture); therefore, they were categorized into Group A, and 85 (7 %) patients had a positive RADT and were categorized into Group B (Fig. 1).
When comparing patients in Group A and patients in Group B, we found no significant differences regarding mean age (58 vs. 53 years; p = 0.08), gender (59 % vs. 54 % male patients; p = 0.76), first consultation in the emergency department (58 % vs. 53 %; p = 0.43), and hospitalization units (p = 0.67): ICU hospitalization (3 % vs. 2 %), general medicine (24 % vs. 22 %), cardiology (5 % vs. 5 %), oncology and hematology (4 % vs. 5 %), pediatric (3 % vs. 7 %), geriatric (2 % vs. 5 %), general surgery (1 % vs. 1 %), and obstetric wards (2 % vs. 0 %) (Table 1).
Comparing the clinical impact of the diagnostic algorithm between Group A and Group B, we found significant differences in the following: prescribed oseltamivir (67 % vs. 82 %; p = 0.02); time of prescription of oseltamivir (p = 0.03): before 24 h (89 % vs. 97 %), 24 h (2 % vs. 3 %), 48 h (5 % vs. 0 %), 72 h (2 % vs. 0 %), and more than 72 h (2 % vs. 0 %). Significant differences were also found in the antibiotics prescribed between both groups (89 % vs. 67; p < 0.01), specifically cephalosporins (13 % vs. 5 %; p = 0.01) and quinolones (45 % vs. 33 %; p = 0.04), and the following complications after the diagnosis of influenza: required ICU admission (23 % vs. 14 %; p = 0.05) and required supplementary oxygen (61 % vs. 47 %; p = 0.01). We found no significant differences in heart failure (22 % vs. 25 %; p = 0.67), requirement of mechanical ventilation (11 % vs. 9 %; p = 0.38), days of hospital stay (13.52 vs. 16.44; p = 0.17), and mortality (7 % vs. 6 %; p = 0.12) (Table 2).
The average time to diagnose influenza infection in Group A was 2 days, while the average time for diagnosis in Group B was 15 min. Reference tests could not have been purportedly avoidable in any patient of Group A, while they could have been avoided in all 85 (7 %) patients constituting Group B. Taking into consideration that performing RT-PCR in our laboratory accounts for 35€/per sample versus 12€/per sample for RADT, 3,000€ of expenses for RT-PCR could have been saved just in acquiring reagents. In addition to the above, we were able to save in antibiotic costs, since patients in Group B received less cephalosporins (the expenses of one vial of ceftriaxone of 2 g equals 17€) and quinolones (the expenses of one vial of levofloxacin equals 15€), and, most importantly, fewer patients in this group required ICU admission (a day of ICU admission accounts for ~1,100€ in Spain [6]).
Discussion
Our results prove that RADTs contribute to shortening the time of diagnosis of influenza infection in a high proportion of patients. Patients with a positive RADT receive more suitable management when compared to those patients whose RADT was negative and rely on the results of the reference tests (RT-PCR or culture). This is associated with a reduction in the time of diagnosis and hospital costs [7, 8]. The Centers for Disease Control and Prevention (CDC) consider RADTs to be useful in identifying influenza virus infection, particularly during the influenza season [9]. However, the role of RADTs in the era of molecular techniques is not clear.
In our study, we used RADTs as a first, easy to perform and low cost, step on all the respiratory samples received in our laboratory during the influenza season, followed by a reference test. However, these tests have been proven to have a variable sensitivity, depending on the prevalence of influenza infection, type of influenza virus, timing of the test and use in adult patients, and other factors described previously [10–12]. On the other hand, viral cell culture and molecular techniques such as real-time RT-PCR are considered the reference methods for the detection of influenza A and B. The reference tests are becoming more accepted as gold-standard techniques for influenza viruses. However, molecular methods, at the present time, are technically demanding, laborious, and expensive, even though new and improved molecular detection tests, like those based on isothermal nucleic acid amplification, are being tested [13, 14]. Our results were consistent with the literature, in terms of the sensitivity and specificity of RADTs [3, 10, 15, 16]. Uyeki et al., in a study conducted in three different sites, compared the QuickVue Influenza A+B Test with RT-PCR as their “gold standard”. Their results regarding sensitivity are one of the lowest found in the literature: 26.7 % (range, 18.9 %–32.3 %), with a median specificity of 97.2 % (range, 96.2 %–99.6 %) [16]. In our study, of the total of 217 patients who were positive for influenza, 132 (61 %) had an initial false-negative RADT, which was later confirmed positive by the reference tests (62 % sensitivity). Indeed, the sensitivity of these tests will vary, depending mainly on the setting and prevalence of influenza in a certain location; if the prevalence is high, the positive predictive value (PPV) will be high as well and the negative predictive value (NPV) will be low [17]; and also the type and performance of the different RADTs available, as described by Baas et al. [18] and Chan et al. [19]. For definite, each location would have to study whether RADTs could be a useful tool depending on the different factors discussed previously.
Because one of the main concerns of using RADTs as a screening tool is their low sensitivity, some authors recommend substituting them for molecular techniques [20]. An argument against this could be the saving in economic costs. In our study, of the 217 patients diagnosed with influenza infection, 85 (39 %) patients with a positive RADT could have been spared of a reference test. This means a high percentage of savings not only in laboratory costs, but also in prescribed antibiotics (especially cephalosporins and quinolones), human resources, and ICU admissions. González-Canudas et al. [7, found similar results when applying RADTs as a first-step technique; they saved 13$ per suspected case of influenza infection. Apart from economic savings, our algorithm has the advantage that it could easily be incorporated into the everyday clinical practice during the influenza season: every respiratory sample with a suspicion of influenza would first be tested by an RADT (easy-to-perform point-of-care bedside test with results in 15 min or less), and only negative results would then have to be processed and tested with a reference test (RT-PCR/culture).
Previous studies emphasize the importance of initiating antiviral treatment during the first several hours of the onset of respiratory symptoms [21–23]. A European study named IMPACT (Immediate Possibility to Access Oseltamivir Treatment) investigated the relationship between time to intervention and duration of illness by treating with oral oseltamivir as early as possible after the onset of influenza symptoms. They concluded that an earlier intervention with oseltamivir was associated with shorter illness duration, reduced the duration of fever, severity of the symptoms, and the times to return to baseline activity and health scores [23]. Hayden and Pavia [21] also insist that oseltamivir has been shown to decrease antibiotic use, the number of hospitalizations, and, probably, the risk of death after influenza. Coincidentally, in our study, the patients with a positive RADT received earlier oseltamivir treatment (less than 24 h since the onset of symptoms) when compared to patients with a negative RADT, resulting in a better management of these patients and less ICU admissions.
Our study has the main limitation that it may not be possible to apply our algorithm in every setting, since RADTs are influenced by numerous factors, such as the prevalence of influenza infection in each population, as discussed previously.
Our algorithm for diagnosing influenza infection has a clinical impact in those patients diagnosed by a positive RADT, since these patients receive adequate and prompt antiviral treatment; receive less antibiotics, and present fewer complications than those diagnosed by standard reference tests.
References
Nap RE, Andriessen MP, Meessen NE, Miranda Ddos R, van der Werf TS (2008) Pandemic influenza and excess intensive-care workload. Emerg Infect Dis 14:1518–1525
López Roa P, Catalán P, Giannella M, García de Viedma D, Sandonis V, Bouza E (2011) Comparison of real-time RT-PCR, shell vial culture, and conventional cell culture for the detection of the pandemic influenza A (H1N1) in hospitalized patients. Diagn Microbiol Infect Dis 69:428–431
Vasoo S, Stevens J, Singh K (2009) Rapid antigen tests for diagnosis of pandemic (Swine) influenza A/H1N1. Clin Infect Dis 49:1090–1093
Subbarao EK, Griffis J, Waner JL (1989) Detection of multiple viral agents in nasopharyngeal specimens yielding respiratory syncytial virus (RSV). An assessment of diagnostic strategy and clinical significance. Diagn Microbiol Infect Dis 12:327–332
Waner JL (1994) Mixed viral infections: detection and management. Clin Microbiol Rev 7:143–151
Madrid: Health Value (2012) Base de datos de costes sanitarios en España. Versión 4.2
González-Canudas J, Iglesias-Chiesa JM, Romero-Antonio Y, Chávez-Cortes C, Gay-Molina JG, Rivas-Ruiz R (2011) Cost-effectiveness in the detection of influenza H1N1: clinical data versus rapid tests. Rev Panam Salud Publica 29:1–8
You JH, Chan ES, Leung MY, Ip M, Lee NL (2012) A cost-effectiveness analysis of “test” versus “treat” patients hospitalized with suspected influenza in Hong Kong. PLoS One 7:e33123
(CDC) CfDCaP 2013 2011, posting date. Seasonal Influenza (FLU). [Online]
Tanei M, Yokokawa H, Murai K, Sakamoto R, Amari Y, Boku S, Inui A, Fujibayashi K, Uehara Y, Isonuma H, Kikuchi K, Naito T (2014) Factors influencing the diagnostic accuracy of the rapid influenza antigen detection test (RIADT): a cross-sectional study. BMJ Open 4:e003885
Sakai-Tagawa Y, Ozawa M, Tamura D, Le Mt, Nidom CA, Sugaya N, Kawaoka Y (2010) Sensitivity of influenza rapid diagnostic tests to H5N1 and 2009 pandemic H1N1 viruses. J Clin Microbiol 48:2872–2877
Chartrand C, Leeflang MM, Minion J, Brewer T, Pai M (2012) Accuracy of rapid influenza diagnostic tests: a meta-analysis. Ann Intern Med 156:500–511
Sidoti F, Bergallo M, Costa C, Cavallo R (2013) Alternative molecular tests for virological diagnosis. Mol Biotechnol 53:352–362
Bell J, Bonner A, Cohen DM, Birkhahn R, Yogev R, Triner W, Cohen J, Palavecino E, Selvarangan R (2014) Multicenter clinical evaluation of the novel Alere™ i Influenza A&B isothermal nucleic acid amplification test. J Clin Virol 61:81–86
Blyth CC, Iredell JR, Dwyer DE (2009) Rapid-test sensitivity for novel swine-origin influenza A (H1N1) virus in humans. N Engl J Med 361:2493
Uyeki TM, Prasad R, Vukotich C, Stebbins S, Rinaldo CR, Ferng YH, Morse SS, Larson EL, Aiello AE, Davis B, Monto AS (2009) Low sensitivity of rapid diagnostic test for influenza. Clin Infect Dis 48:e89–e92
Chu H, Lofgren ET, Halloran ME, Kuan PF, Hudgens M, Cole SR (2012) Performance of rapid influenza H1N1 diagnostic tests: a meta-analysis. Influenza Other Respir Viruses 6:80–86
Baas C, Barr IG, Fouchier RA, Kelso A, Hurt AC (2013) A comparison of rapid point-of-care tests for the detection of avian influenza A(H7N9) virus, 2013. Euro Surveill 18(21). pii: 20487
Chan KH, To KK, Chan JF, Li CP, Chen H, Yuen KY (2013) Analytical sensitivity of seven point-of-care influenza virus detection tests and two molecular tests for detection of avian origin H7N9 and swine origin H3N2 variant influenza A viruses. J Clin Microbiol 51:3160–3161
Drexler JF, Helmer A, Kirberg H, Reber U, Panning M, Müller M, Höfling K, Matz B, Drosten C, Eis-Hübinger AM (2009) Poor clinical sensitivity of rapid antigen test for influenza A pandemic (H1N1) 2009 virus. Emerg Infect Dis 15:1662–1664
Hayden FG, Pavia AT (2006) Antiviral management of seasonal and pandemic influenza. J Infect Dis 194(Suppl 2):S119–S126
Król E, Rychłowska M, Szewczyk B (2014) Antivirals—current trends in fighting influenza. Acta Biochim Pol 61:495–504
Aoki FY, Macleod MD, Paggiaro P, Carewicz O, El Sawy A, Wat C, Griffiths M, Waalberg E, Ward P; IMPACT Study Group (2003) Early administration of oral oseltamivir increases the benefits of influenza treatment. J Antimicrob Chemother 51:123–129
Conflict of interest
The authors declare no conflicts of interest.
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
About this article
Cite this article
González-Del Vecchio, M., Catalán, P., de Egea, V. et al. An algorithm to diagnose influenza infection: evaluating the clinical importance and impact on hospital costs of screening with rapid antigen detection tests. Eur J Clin Microbiol Infect Dis 34, 1081–1085 (2015). https://doi.org/10.1007/s10096-015-2328-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10096-015-2328-7