Abstract
Two international multicentre randomised controlled trials of drotrecogin alfa (activated) (DrotAA), the Recombinant Human Activated Protein C Worldwide Evaluation of Severe Sepsis (PROWESS) and Administration of Drotrecogin Alfa (Activated) in Early Stage Severe Sepsis (ADDRESS) trials, have produced inconsistent results. When 28-day mortality data from these trials for patients with severe sepsis and at high risk of death are pooled using a standard random-effects meta-analysis technique, there is no statistically significant survival benefit (for patients with Acute Physiology and Chronic Health Evaluation (APACHE II) scores of 25 or more), or a borderline significant benefit (for patients with multi-organ failure). We argue that two important methodological issues might explain the disparate results between the two trials. These issues centre on early trial stopping, which exaggerates treatment effects, and reliance on subgroup analyses, which for DrotAA yields inconsistent results across different definitions of high risk. These concerns call into question the effectiveness of DrotAA in any patients with severe sepsis. Consequently, further randomised trials of this agent in prospectively defined high-risk patients are required to clarify its role in the management of severe sepsis.
Introduction
Severe sepsis is a condition with important public health ramifications because it is common and has a high case-fatality rate [1]. Drotrecogin alfa (activated) (DrotAA), more commonly known as recombinant human activated protein C, is the first specific therapy for sepsis to show an important survival benefit. On the basis of the favourable results of the Recombinant Human Activated Protein C Worldwide Evaluation of Severe Sepsis (PROWESS) trial [2], DrotAA was approved for patients with severe sepsis and at high risk of death. However, regulatory approval for DrotAA was controversial [3, 4], and the recently published Administration of Drotrecogin Alfa (Activated) in Early Stage Severe Sepsis (ADDRESS) trial [5] has heightened this controversy. The results of this study demonstrated no evidence of benefit for DrotAA in patients with severe sepsis and at low risk of death, and unexpectedly raised concerns regarding its efficacy among patients at high risk of death [6]. In this commentary we argue that the cumulative evidence for a survival benefit in DrotAA-treated patients with severe sepsis and at high risk of death is weaker than originally believed. We also suggest methodological explanations for discrepant results of these two rigorous multicentre trials. These findings have important implications not only for clinicians treating patients with severe sepsis but also for the interpretation of other single, seemingly pivotal, randomised controlled trials.
Effect of DrotAA on 28-day survival
Figure 1 shows the effect of DrotAA therapy on 28-day survival, as observed in all three published trials (a phase II trial [7], PROWESS [2], and ADDRESS [5]) and in an additional unpublished trial in children with severe sepsis [8]. (A recent systematic review and health technology assessment of DrotAA [9] found no additional trials.) PROWESS suggested a survival benefit for all severely septic patients who received DrotAA. This survival benefit seemed to be concentrated in patients at high risk of death, defined either by an Acute Physiology and Chronic Health Evaluation (APACHE II) [10] threshold of 25 or by multiple organ failure. Consequently, regulatory authorities restricted DrotAA approval to severely septic patients with an APACHE II score of 25 or more (USA) or multiple organ failure (many European countries). The ADDRESS study provided new data and an excellent opportunity to retest the hypothesis that DrotAA is effective only in these high-risk subgroups. Although designed to study patients at low risk of death, ADDRESS enrolled patients with an APACHE II score of 25 or more, or multiple organ failure, when investigators perceived the risk of death to be low on other clinical grounds.
Figure 2 shows, for PROWESS [2, 11] and ADDRESS [5, 12], the effect of therapy on patients grouped by risk of death. These subgroup data are not published for the phase II adult trial or for the paediatric trial. We pooled results by using standard meta-analysis software (Review Manager, Version 4.2; The Cochrane Collaboration, Oxford, UK) and a conservative random-effects model. Pooled estimates confirm no evidence of benefit for DrotAA in low-risk patients. For high-APACHE II patients, the results vary substantially between studies (p = 0.01 for heterogeneity, I2 = 84%; I2 describes the percentage of total variation in results across studies that is due to heterogeneity rather than chance [13]), and pooled data show a trend towards survival benefit that is not statistically significant. For high-risk patients defined by multiple organ failure, the two trials are more consistent (p = 0.23 for heterogeneity, I2 = 32%), with the pooled results suggesting a clinically important survival benefit that just reaches the conventional threshold for statistical significance.
To summarize, these analyses show that the effect of DrotAA varies substantially between the two adult trials overall, and in the high-risk subgroups. This suggests that the PROWESS trial's estimate of survival benefit in severely septic patients might not be robust and that the true effect is probably more modest.
Explanations for disparate results in high-risk patients
DrotAA investigators have postulated several explanations for this between-trial difference in treatment effect among high-risk patients. These include a lower average APACHE II score and baseline risk of death in the high-APACHE II subgroup of ADDRESS than in PROWESS [5] and potential misclassification of patients with respect to the APACHE II threshold of 25 in ADDRESS [14]. The first observation suggests that the treatment effect of DrotAA may be quite variable even in patients with an APACHE II score of 25 or more, and the second highlights the practical difficulty of applying any APACHE II threshold to patient selection for DrotAA. Investigators also discovered a higher prevalence of poor prognostic factors in patients receiving DrotAA, compared with placebo, in the high-APACHE II subgroup of ADDRESS [12]. An adjusted analysis incorporating relevant baseline covariates would address this possibility. Similar adjusted analyses should be performed for the PROWESS trial, because at least some poor prognostic factors seem to be more prevalent in the high-risk placebo subgroups [15]. However, even if the adjusted and unadjusted analyses were to differ, more data would still be required to clarify the discrepant findings.
Two other more general methodological considerations may be more important in explaining the differences between the PROWESS and ADDRESS results.
First, in stopping early after a predefined interim analysis, the PROWESS trial probably overestimated the treatment effect [16, 17]. Current research suggests that such overestimation is less prominent in trials accumulating a large number of outcome events [16], such as PROWESS (469 outcome events and p = 0.005 for overall survival benefit). However, another recent sepsis trial illustrates the potential hazard of stopping early even after accumulating many outcome events. In the randomised placebo-controlled Optimized Phase 3 Tifacogin in Multicenter International Sepsis Trial (OPTIMIST) [18], investigators studied the effect of tifacogin (recombinant tissue factor pathway inhibitor) in patients with severe sepsis and an elevated international normalized ratio. A planned interim analysis of the first 722 patients (about 245 events) demonstrated a significant mortality improvement in patients receiving tifacogin (29.1% versus 38.9%, p = 0.006). However, after reaching the target enrolment of 1,754 patients (597 events), the apparent mortality difference disappeared (34.2% versus 33.9%, p = 0.88). Similar issues have arisen in oncology trials [19, 20]. These examples illustrate the potentially misleading estimates of treatment effect when trials are stopped early for efficacy, even if supported by many events and extreme p values.
Second, the PROWESS and ADDRESS trials differed in the results of an analysis of the effect of DrotAA in high-APACHE II versus low-APACHE II patients: PROWESS found a differential effect, whereas ADDRESS did not. This raises the possibility that this subgroup effect in PROWESS was due to chance. Current teaching [21–23] suggests that results of subgroup analyses are most likely to be true when they are pre-specified, and when large in magnitude and statistically significant – all of which were true of the PROWESS APACHE II subgroup analysis. However, it was one of about 25 pre-specified subgroup analyses (rather than one of few), it was not consistent across different definitions of high risk (such as presence versus absence of multiple organ failure, mechanical ventilation, or vasopressor support) [11], there is no other independent evidence to support this subgroup effect, and the biological rationale for it is unclear. If the high-APACHE II versus low-APACHE II subgroup effect in PROWESS is due to chance, then the best estimate of DrotAA's effect for any patient is the overall pooled result of the two trials, which demonstrates no statistically significant benefit (relative risk 0.93, 95% confidence interval 0.69 to 1.26). [The pooled estimate is very similar whether the phase II patients are also included (relative risk 0.95, 95% confidence interval 0.72 to 1.25) or all four trials shown in Figure 1 are included (relative risk 0.94, 95% confidence interval 0.76 to 1.17)]. Alternatively, if this subgroup effect is real, the pooled analyses in Figure 2 show that the degree of survival benefit depends on the operational definition of 'high risk of death' and at best just reaches the conventional threshold for statistical significance. In either case, more data are required to clarify the degree of benefit, if any, in this or any other subgroup of patients with severe sepsis.
Comparisons with other sepsis therapies
Single randomised controlled trials of two other therapies have recently suggested mortality benefits in critically ill patients. A trial of intensive insulin therapy was stopped early for benefit [24], and another trial showed that low-dose steroid treatment improved survival in a pre-specified subgroup of patients with vasopressor-dependent septic shock [25]. Both treatments have been incorporated into current consensus recommendations for the treatment of severe sepsis [26], similarly to the situation for DrotAA. To confirm the encouraging results of both studies, further trials are being conducted [27–31]. This situation contrasts with DrotAA, for which, to our knowledge, no additional trials in patients with sepsis and at high risk of death are either under way or planned to confirm initial findings and to resolve the subgroup discrepancies.
Conclusion
Patients with severe sepsis and at high risk of death are among the most vulnerable patients in the intensive care unit. In the light of new findings from the ADDRESS trial, the role for DrotAA in these patients is less clear than before. Others have raised important safety concerns by observing a higher risk of serious bleeding, including intracranial haemorrhage, in open-label use [32, 33]. We share the concerns of others [3, 15, 33–36] and believe that further trials of DrotAA in prospectively defined high-risk patients are required to clarify its role in the management of severe sepsis.
Abbreviations
- ADDRESS:
-
= Administration of Drotrecogin Alfa (Activated) in Early Stage Severe Sepsis
- APACHE:
-
= Acute Physiology and Chronic Health Evaluation
- DrotAA:
-
= drotrecogin alfa (activated)
- PROWESS:
-
= Recombinant Human Activated Protein C Worldwide Evaluation of Severe Sepsis.
References
Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR: Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med. 2001, 29: 1303-1310. 10.1097/00003246-200107000-00002.
Bernard GR, Vincent JL, Laterre PF, LaRosa SP, Dhainaut JF, Lopez-Rodriguez A, Steingrub JS, Garber GE, Helterbrand D, Ely EW, for the Recombinant human protein C Worldwide Evaluation in Severe Sepsis (PROWESS) study group, et al: Efficacy and safety of recombinant human activated protein C for severe sepsis. N Engl J Med. 2001, 344: 699-709. 10.1056/NEJM200103083441001.
Warren HS, Suffredini AF, Eichacker PQ, Munford RS: Risks and benefits of activated protein C treatment for severe sepsis. N Engl J Med. 2002, 347: 1027-1030. 10.1056/NEJMsb020574.
Siegel JP: Assessing the use of activated protein C in the treatment of severe sepsis. N Engl J Med. 2002, 347: 1030-1034. 10.1056/NEJMsb021512.
Abraham E, Laterre PF, Garg R, Levy H, Talwar D, Trzaskoma BL, Francois B, Guy JS, Bruckmann M, Rea-Neto A, for the Administration of Drotrecogin Alfa (Activated) in Early Stage Severe Sepsis (ADDRESS) Study Group, et al: Drotrecogin alfa (activated) for adults with severe sepsis and a low risk of death. N Engl J Med. 2005, 353: 1332-1341. 10.1056/NEJMoa050935.
Friedrich JO: Drotrecogin alfa (activated) in severe sepsis. N Engl J Med. 2006, 354: 94-95. 10.1056/NEJMc052759.
Bernard GR, Ely EW, Wright TJ, Fraiz J, Stasek JE, Russell JA, Mayers I, Rosenfeld BA, Morris PE, Yan SB: Safety and dose relationship of recombinant human activated protein C for coagulopathy in severe sepsis. Crit Care Med. 2001, 29: 2051-2059. 10.1097/00003246-200111000-00003.
Eisenberg P: Re: Discontinuation of Study F1K-MC-EVBP, Investigation of the Efficacy and Safety of Drotrecogin Alfa (Activated) in Pediatric Severe Sepsis. [http://www.fda.gov/medwatch/safety/2005/Xigris_dearhcp_4-21-05.htm]
Green C, Dinnes J, Takeda A, Shepherd J, Hartwell D, Cave C, Payne E, Cuthbertson BH: Clinical effectiveness and cost-effectiveness of drotrecogin alfa (activated) (Xigris) for the treatment of severe sepsis in adults: a systematic review and economic evaluation. Health Technol Assess. 2005, 9: 1-126. iii–iv
Knaus WA, Draper EA, Wagner DP, Zimmerman JE: APACHE II: a severity of disease classification system. Crit Care Med. 1985, 13: 818-829. 10.1097/00003246-198510000-00009.
Ely EW, Laterre PF, Angus DC, Helterbrand JD, Levy H, Dhainaut JF, Vincent JL, Macias WL, Bernard GR, PROWESS Investigators: Drotrecogin alfa (activated) administration across clinically important subgroups of patients with severe sepsis. Crit Care Med. 2003, 31: 12-19. 10.1097/00003246-200301000-00002.
Abraham E, Laterre P-F: Drotrecogin alfa (activated) in severe sepsis. N Engl J Med. 2006, 354: 95-96.
Higgins JP, Thompson SG, Deeks JJ, Altman DG: Measuring inconsistency in meta-analyses. BMJ. 2003, 327: 557-560. 10.1136/bmj.327.7414.557.
Booth FV, Short M, Shorr AF, Arkins N, Bates B, Qualy RL, Levy H: Application of a population-based severity scoring system to individual patients results in frequent misclassification. Crit Care. 2005, 9: R522-R529. 10.1186/cc3790.
Carlet J: Prescribing indications based on successful clinical trials in sepsis: a difficult exercise. Crit Care Med. 2006, 34: 525-529. 10.1097/01.CCM.0000198329.85851.8E.
Montori VM, Devereaux PJ, Adhikari NKJ, Burns KEA, Eggert CH, Briel M, Lacchetti C, Leung TW, Darling E, Bryant DM, et al: Randomized trials stopped early for benefit: a systematic review. JAMA. 2005, 294: 2203-2209. 10.1001/jama.294.17.2203.
Pocock SJ, Hughes MD: Practical problems in interim analyses, with particular regard to estimation. Control Clin Trials. 1989, 10 (Suppl): 209S-221S. 10.1016/0197-2456(89)90059-7.
Abraham E, Reinhart K, Opal S, Demeyer I, Doig C, Rodriguez AL, Beale R, Svoboda P, Laterre PF, Simon S, et al: Efficacy and safety of tifacogin (recombinant tissue factor pathway inhibitor) in severe sepsis. A randomized controlled trial. JAMA. 2003, 290: 238-247. 10.1001/jama.290.2.238.
Wheatley K, Clayton D: Be skeptical about unexpected large apparent treatment effects: the case of an MRC AML12 randomization. Control Clin Trials. 2003, 24: 66-70. 10.1016/S0197-2456(02)00273-8.
Parmar MK, Griffiths GO, Spiegelhalter DJ, Souhami RL, Altman DG, van der Scheuren E, CHART steering committee: Monitoring of large randomised clinical trials: a new approach with Bayesian methods. Lancet. 2001, 358: 375-381. 10.1016/S0140-6736(01)05558-1.
Peto R: Clinical trials. Treatment of Cancer. Edited by: Sikora K, Halnan KE. 1990, London: Chapman & Hall, 873-877. 2
Oxman AD, Guyatt GH: A consumer's guide to subgroup analyses. Ann Intern Med. 1992, 116: 78-84.
Assmann SF, Pocock SJ, Enos LE, Kasten LE: Subgroup analysis and other (mis)uses of baseline data in clinical trials. Lancet. 2000, 355: 1064-1069. 10.1016/S0140-6736(00)02039-0.
van den Berghe G, Wouters P, Weekers F, Verwaest C, Bruyninckx F, Schetz M, Vlasselaers D, Ferdinande P, Lauwers P, Bouillon R: Intensive insulin therapy in critically ill patients. N Engl J Med. 2001, 345: 1359-1367. 10.1056/NEJMoa011300.
Annane D, Sebille V, Charpentier C, Bollaert PE, Francois B, Korach JM, Capellier G, Cohen Y, Azoulay E, Troche G, et al: Effect of treatment with low doses of hydrocortisone and fludrocortisone on mortality in patients with septic shock. JAMA. 2002, 288: 862-871. 10.1001/jama.288.7.862.
Dellinger RP, Carlet JM, Masur H, Gerlach H, Calandra T, Cohen J, Gea-Banacloche J, Keh D, Marshall JC, Parker MM, et al: Surviving sepsis campaign guidelines for management of severe sepsis and septic shock. Crit Care Med. 2004, 32: 858-873. 10.1097/01.CCM.0000117317.18092.E4.
Van den Berghe GH, Wilmer A, Hermans G, Meersseman W, Wouters PJ, Milants I, Van Wijngaerden E, Bobbaers H, Bouillon R: Intensive insulin therapy in the medical ICU. N Engl J Med. 2006, 354: 449-461. 10.1056/NEJMoa052521.
Clinical trial: Corticosteroid therapy of septic shock – Corticus. [http://www.clinicaltrials.gov/show/NCT00147004]
Brunkhorst FM, Kuhnt E, Engel C, Meier-Hellmann A, Ragaller M, Quintel M, Weiler N, Grundling M, Oppert M, Deufel T, et al: Intensive insulin therapy in patients with severe sepsis and septic shock is associated with an increased rate of hypoglycemia – results from a randomized controlled study (VISEP) [abstract]. Infection. 2005, 33 (Suppl 1): 19-20.
Clinical trial: Glucontrol study: comparing the effects of two glucose control regimes by insulin in intensive care unit patients. [http://clinicaltrials.gov/show/NCT00107601]
Normoglycaemia in Intensive Care Evaluation and Survival Using Glucose Algorithm Regulation – NICE-SUGAR Study. [http://controlled-trials.com/isrctn/trial/|/0/04968275.html]
Vincent JL, Bernard GR, Beale R, Doig C, Putensen C, Dhainaut JF, Artigas A, Fumagalli R, Macias W, Wright T, et al: Drotrecogin alfa (activated) treatment in severe sepsis from the global open-label trial ENHANCE: further evidence for survival and safety and implications for early treatment. Crit Care Med. 2005, 33: 2266-2277. 10.1097/01.CCM.0000181729.46010.83.
Eichacker PQ, Danner RL, Suffrendini AF, Cui X, Natanson C: Reassessing recombinant human activated protein C for sepsis: time for a new randomized controlled trial. Crit Care Med. 2005, 33: 2426-2428. 10.1097/01.CCM.0000183002.26587.FF.
Wiedermann CJ, Kaneider NC: A meta-analysis of controlled trials of recombinant human activated protein C therapy in patients with sepsis. BMC Emerg Med. 2005, 5: 7-10.1186/1471-227X-5-7.
Mackenzie AF: Activated protein C: do more survive?. Intensive Care Med. 2005, 31: 1624-1626. 10.1007/s00134-005-2829-4.
LaRosa SP: Drotrecogin alfa (activated) in severe sepsis. N Engl J Med. 2006, 354: 95-
FDA Briefing Document: Anti-Infective Advisory Committee. Drotrecogin alfa (activated) [Recombinant human activated protein C (rhAPC)], Xigris™, BLA #125029/0. [http://www.fda.gov/ohrms/dockets/ac/01/briefing/3797b1_02_FDAbriefing.doc]
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
JF was involved with the conception and design of the study, acquisition, analysis and interpretation of data, and wrote the first draft of the manuscript. NA was involved with the conception and design of the study, analysis and interpretation of data, and critical revision of the manuscript for important intellectual content. MM was involved with the interpretation of data and critical revision of the manuscript for important intellectual content. All authors read and approved the final version of the manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
About this article
Cite this article
Friedrich, J.O., Adhikari, N.K. & Meade, M.O. Drotrecogin alfa (activated): does current evidence support treatment for any patients with severe sepsis?. Crit Care 10, 145 (2006). https://doi.org/10.1186/cc4947
Published:
DOI: https://doi.org/10.1186/cc4947