Introduction

Bacteremia is a major cause of hospital morbidity and mortality. It is usually associated with a severe event and is characterized by extended hospitalizations and higher hospital costs [1]. The severity of bacteremia can be assessed using both objective and subjective data. Objective methods are obviously more reliable and are generally employed in the form of scores. Some scores, such as the Pitt score and the APACHE II that are available today, are based on conventional clinical and laboratory data. This allows for the prediction of mortality in hospitalized patients with or without bacteremia [2, 3]. Usually, these mortality scores are constructed from derivation cohorts and later validated with a new cohort (validation cohort). Bacteremia severity scores can also be targeted to a specific microorganism, as noted in a recent study evaluating a mortality score in patients with carbapenem-resistant Enterobacteriaceae bacteremia [4]. Unfortunately, several clinical and laboratory data were not included in these scores because the study was based on a specific population. The Pitt score uses clinical and laboratory data to predict mortality. However, there are no studies validating this score in Brazil. The Pitt bacteremia scoring system was recently demonstrated to predict mortality more effectively than the APACHE II among intensive care unit (ICU) patients with sepsis. However, this score was not the aim of our study [5].

Blood culture remains the most critical test for the diagnosis of bacteremia. New molecular methods are available, although these are not realistic for most hospitals [6]. A blood culture result may require over 24 h to identify microbial growth. Antibiotics in sepsis patients must not be delayed by such a length of time [7]. In view of this situation, clinical scores that correlate with blood culture positivity are crucial.

The objective of this study was to determine the factors that were related to blood culture positivity and the risk factors for mortality in patients with suspected bacteremia. We also sought to develop a clinical score of culture positivity and mortality based on data from a middle-income country.

Methods

Study design

This was a prospective cohort study conducted at a Brazilian university hospital between January 2014 and January 2015 (derivation cohort), followed by a validation period (validation cohort) between February 2015 and January 2016. The study was approved by the Research Ethics Committee (CAAE 42,286,814.6.0000.0103), and all patients signed a consent form to participate in the study. The hospital is in the city of Curitiba, State of Paraná, Southern Brazil. The hospital has 600 beds and 30 adult ICU beds. It is a referral hospital for trauma, burns, and renal transplantation.

Since 2012, the hospital has established that any adult blood sample collected for culture in hospitalized patients outside the ICU required a form to be completed by a physician. This method permitted the blood culture to be performed. The decision to collect a blood sample for culture was determined by the physician. The required form consisted of clinical and laboratory data based on the Pitt bacteremia score [8, 9] (Table 1). In addition, the form contained the justification for the blood culture, previous use of antibiotics, use of antibiotics on the day of the blood sample collection, age, and the length of hospitalization. After completion of the form, the laboratory performed the collection of blood for culture. The routine for blood culture included 10 mL of peripheral blood sample in anaerobe and aerobe bottles using the BACT/ALERT® system (bioMérieux, Durham, NC). Bacteria were identified by phenotypic or automated methods (VITEK 2®, bioMérieux, Durham, NC). Susceptibility tests were performed according to the bacterium species using an automated method (VITEK 2®), disk-diffusion, or E-test (bioMérieux, Durham, NC).

Table 1 Clinical data used in the paper form for patients with bacteremia and the Pitt bacteremia score assessing illness severity

Inclusion and exclusion criteria

The two endpoints analyzed in this study were blood culture positivity and global mortality (hospital mortality). A blood culture was considered positive and included in the study when the same agent was identified in two separate blood cultures, the patient was an adult (> 18 years), and the form was properly completed. False positives due to contamination (e.g., coagulase-negative Staphylococci) were minimized when only patients with suggestive clinical findings, plus two separate blood cultures were included, as previously described. Patients with two positive blood cultures with two different species of coagulase-negative Staphylococci were considered to be contaminated. Each patient was analyzed only once, and patients with two episodes of bacteremia were excluded from the analysis.

Statistical analysis and calculation

Statistical analysis was performed using SPSS 23.0. Continuous data are expressed as means with standard deviation or median, and categorical variables are expressed as percentages. The use of median and mean was defined according to the normality test (Kolmogorov–Smirnov test). A Chi-square test, Fisher’s exact test, and Student’s t test were applied according to the type and quantity of variables. For variables with p < 0.05, a multivariate forward binary regression model was used to evaluate independent factors related to blood culture positivity as well as to mortality. Continuous variables were split before inclusion in the model, using the best cut-off according to the lowest p value. Odds ratios (ORs) with 95% confidence intervals (CIs) were calculated to determine the strength of the association. The area under the ROC curve (AUC) was calculated to quantify the discriminative ability of the score. A value of 0.5 denoted random predictions, and a value of 1.0 denoted perfect predictions.

After a statistical analysis of the original data, the score was validated using a prospective group that included 380 patients. For this, a Kaplan–Meier survival curve for the derivation cohort and the validation cohort was constructed, and the difference was assessed using a log-rank test.

Results

Of the 1,048 blood cultures evaluated in the derivation cohort, 784 forms were complete and were from adult patients (> 18 years). Among these, 155 had positive blood cultures (20%), with a predominance of Staphylococcus spp. (44%). Among the cultures positive for Staphylococcus, 23.5% were S. aureus. The frequency of the bacteria identified in the blood cultures are described in Table 2.

Table 2 Microbial profile of analyzed blood cultures

The use of antibiotics at the time of blood collection for culture (n = 407, 52%) was a factor associated with negative blood cultures (OR, 0.58; 95% CI, 0.41–0.83; p = 0.003). Recent use of antibiotics (in the past 10 days), except the last 24 h (n = 337, 43%), was not related to blood culture positivity (OR, 0.87; 95% CI, 0.60–1.26; p = 0.47). A positive blood culture did not contribute to patient mortality (odds ratio [OR], 0.82; 95% confidence interval [CI], 0.57–1.16; p = 0.27). The continuous variables are listed in Table 3. Factors related to a positive blood culture were a prolonged hospitalization (with a mean of 15.5 Â days and a median of 8.5 Â days), body temperature (with a mean of 37.4 ºC), and heart rate (with a mean of 101.9 bpm). Considering that only two variables were associated with positive blood cultures (length of hospitalization and mean temperature), it was not possible to develop a blood culture positivity score.

Table 3 Continuous variables and relationship with blood culture positivity

Of the 784 patients included in the analysis, 335 died. The mortality-related factors are listed in Table 4. Significant risk factors were advanced age, an extended hospitalization, > 10% immature cells in the leukogram, lower mean blood pressure, elevated heart rate, elevated WBC count, and elevated respiratory rate. The use of antibiotics in the past 10 days (OR 0.58; 95% CI 0.43–0.79, p < 0.001), as well as the use of antibiotics on the day of collection (OR 0.36; 95% CI 0.27–0.48, p < 0.001) were associated with lower mortality, regardless of the bacterium susceptibility profile, the prescribed antibiotic, or the route of administration.

Table 4 Mortality-related factors in patients submitted to blood culture collection

For the independent variables with p < 0.05, the multivariate model was applied, where the constants used in Eq. (1) were obtained, allowing the creation of a mortality score.

Below is the equation for the \(E\) score:

$$E=1.393 I+0.693 {T}_{i}-0.797 {P}_{a}+0.557 {F}_{c }+0.753 L$$
(1)

where I is the age, Ti is the hospitalization time, Pa is the mean blood pressure, Fc is the heart rate, and L is the number of WBCs.

These continuous variables were dichotomized according to their significance level, creating a cut-off limit. The dichotomies resulted in the following mortality-related factors: age > 60 years, length of hospitalization > 5 days, leukocytosis > 12,000/mm3, heart rate > 100 bpm, and mean blood pressure < 81 mmHg with Eq. (1) Subsequently, the scores for each variable were obtained (Table 5). The mortality attributed to each score ranged from 15 to 90%, with 90% for scores > 25 points, as described in Table 6.

Table 5 Scoring for risk factor for mortality in patients with suspected bacteremia/candidemia included in the score
Table 6 Percentage of mortality according to score obtained from patients with suspected bacteremia/candidemia

To evaluate the efficacy of the score for predicting mortality related to the significant factors mentioned above, the area under the ROC curve (AUC) was calculated to be 0.789 (Fig. 1). The score was validated in a group of 380 patients who were prospectively evaluated. In this group all factors had a p value < 0.001 in the multivariate analysis, except for the length of hospitalization. The survival curves between the validation and derivation groups were similar (Fig. 2).

Fig. 1
figure 1

ROC curve (AUC) for mortality score of patients with suspected bacteremia/candidemia

Fig. 2
figure 2

Survival curve of the validation cohort and derivation cohort of patients with suspected bacteremia/candidemia. The curve shows the equivalence between groups and there was no significant difference between groups

Discussion

According to our findings, factors related to positive blood cultures were prolonged hospitalization time, body temperature, and heart rate. Patients with suspected bacteremia with age > 60 years, time of hospitalization > 5 days, leukocytosis > 12.000 cells/mm3, heart rate > 100 bpm, and mean blood pressure < 81 mmHg were at increased risk of death and had an elevated Pitt score. When considering the mortality score from our data, age > 60 years was the most important factor related to a poor prognosis.

One of the methods to assess the severity of patients with bacteremia is by using tools that provide scores. The Pitt score reflects the severity of patients with bacteremia. The parameters necessary to calculate the score are vital signs, mental status, requirement for mechanical ventilation, and recent cardiac arrest. According to the literature, Pitt scores higher than 4 are considered indicative of severe bacteremia and suggest an increase in the relative risk of death [10]. Nevertheless, even in non-bacteremic patients, the traditional Pitt score and/or quick Pitt score (qPitt) has been validated [11]. Thus, the Pitt score remains a useful tool for predicting mortality in septic patients independent of blood culture results.

Compared with the Pitt score, the Acute Physiology and Chronic Health Evaluation II (APACHE II) has an inferior ability to estimate the sensitivity and specificity that predicts mortality among ICU patients with sepsis. The APACHE II is a general ICU score and is not specific to septic/bacteremic patients [5]. The variables used in the Pitt score were similar to our score. However, when the factors are pooled, various weights are presented, which may refine the analysis. This newly adapted score could be validated, thus demonstrating a strong correlation between the groups in the survival curve.

The results of this study justify changes to the blood culture collection form. Laboratory and clinical data must be adapted to the circumstances of the institution. It is possible that this is also necessary for other hospitals. Various factors must be considered including the patient setting, the microbiological profile, and the issues related to the proper management of sepsis. These factors can vary significantly between institutions.

Despite the internal validation, this mortality score cannot be extrapolated to other institutions without external validation or multicenter studies. Another limitation has previously been described, which is to attribute mortality only to baseline conditions. This may be modifiable variables with appropriate management, such as hypotension. Although it was not the objective of this study, it is worth noting that the rate of positivity of blood cultures in this study is superior to that of the literature. This is most likely due to the presence of the specific method of our study, encouraging the physician to collect blood culture only in specific indications, avoiding samples in patients with mild infection and low pre-test probability. The advantage is a lower cost; however there may be cases of bacteremia that are not diagnosed. Silva et al. evaluated 4,214 blood cultures and found that 93.4% were negative [12]. Our study demonstrated the predominance of bacteremia caused by Staphylococcus spp., with 22% being S. aureus. This profile is similar to that of several hospitals in various countries [13]. Although a gram-negative bacilli such as E. coli may predominate in other regions [14], a study conducted in another developing country showed the same profile as our study, with a predominance of Staphylococcus spp. [15]. Unfortunately, in our institution we do not used the “incubation time to detection” in the automated system to distinguish coagulase-negative staphylococcal contamination from infection. This approach could increase the percentage of coagulase-negative Staphylococcus bacteremia in our sample. The time-to-positivity is an useful adjunctive test to determine the clinical significance of isolation of coagulase-negative from a blood culture [16].

It was observed that patients taking antibiotics and those who took antibiotics in the past 10 days exhibited a significant reduction in overall mortality when compared to patients who did not take antibiotics. Antibiotic therapy not only reduces mortality by treating the initial infection, but also reduces the occurrence of new infections in the respiratory tract. Consequently, this reduces global mortality [17]. However, the antimicrobial approach must be used with caution and must be culture-driven in order to combat the emergence of bacterial resistance, improve clinical outcomes, and control costs [18]. Although the previous use of antibiotics in the past 10 days prior to collection proved to be relevant for reducing mortality, it did not influence the results of the blood cultures. Patients receiving antibiotics on the day of collection had a lower blood culture positivity rate.

Blood cultures should preferably be collected prior to the initiation of antibiotic therapy to avoid interference with bacterial growth and consequent false negatives [19]. However, the dilution of antimicrobials in the culture medium may result in insufficient concentrations to inhibit bacterial growth. Thus, this allows cultures to be collected even when antibiotics have previously been employed [19]. A positive blood culture was associated with prolonged hospitalization, fever, and tachycardia. Previsdomini et al. demonstrated greater positivity in patients with longer hospitalizations and temperatures higher than 38.5 °C [20].

The mortality score presented in this study was beneficial, and we believe that its’ implementation is important for continuous surveillance and greater validation of the results. The application of this score can be associated with cost minimization, avoidance of unnecessary blood cultures, adverse events due to blood collection, and unwarranted treatment of positive cultures without clinical significance. Sogaard et al. evaluated patients with bacteremia, stratified by age group over 30 days, and found that patients over 65 years were at higher risk of death [21]. This is very similar to our study. It is worth mentioning that five of the factors related to mortality in our study correspond to the criteria of systemic inflammatory response syndrome. We emphasize that age > 60 years represents the highest scoring factor followed by tachycardia. It is also possible to establish a relationship between the new mortality score offered in the present study with the local hospital situation using the Pitt score.

In conclusion, this study failed to present a score to predict blood culture positivity. However, the mortality score was beneficial. A prospective study is under development at another institution to provide external validation of the presented score considering our results.