Abstract
Purpose of Review
There are over 25 million patients living with heart failure globally. Overall, and especially post-discharge, clinical outcomes have remained poor in heart failure despite multiple trials, with both successes and failures over the last two decades. Matching therapies to the right patient population, identifying high-quality sites, and ensuring optimal trial design and execution represent important considerations in the development of novel therapeutics in this space.
Recent Findings
While clinical trials have undergone rapid globalization, this has come with regional variation in comorbidities, clinical parameters, and even clinical outcomes and treatment effects across international sites.
Summary
These issues have now highlighted knowledge gaps about the conduct of trials, selection of study sites, and an unmet need to develop and identify “ideal” sites. There is a need for all stakeholders, including academia, investigators, healthcare organizations, patient advocacy groups, industry sponsors, research organizations, and regulatory authorities, to work as a multidisciplinary group to address these problems and develop practical solutions to improve trial conduct, efficiency, and execution. We review these trial-level issues using examples from contemporary studies to inform and optimize the design of future global clinical trials in heart failure.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Heart failure (HF) has a tremendous impact on the population worldwide with prevalence of over 25 million globally and ~6.5 million in the USA [1]. Both in the USA and in Europe, there are more than 1 million hospitalizations for HF (HHF) annually [2]. The overall cost of HF in the USA has been projected to increase from $39.2 billion in 2010–2012 to $70 billion in 2030 [3,4,5]. Despite this heavy burden and some improvement in HF therapies, there is lack of therapeutic progress for a large group of patients with worsening chronic HF and those with HHF [6••, 7, 8]. The factors implicated in the failure of clinical trials in HF include inability to fully understand and match therapies to target patient subgroups, problems in study design and execution, and undue prioritization of short-term surrogate markers (e.g., dyspnea relief, natriuretic peptides) rather than long-term key clinical endpoints (e.g., mortality, rehospitalization) [6••, 9, 10, 11•]. Among these factors, study site selection is now being recognized as an important factor that may have a significant impact on background event rates and treatment effects [8, 12, 13], both of which may heavily influence the overall success of the trial. Heterogeneity across sites introduces issues with respect to quality and reliability of data from sites with issues in study execution and generalizability of data across various patient groups [14,15,16]. We highlight problems in trial conduct, efficiency, and execution; discuss the importance of site selection; and identify practical solutions to improve the design of future global clinical trials in HF.
Issues Facing Clinical Trials and Outcomes: an Overview
HF is a heterogeneous condition with multifaceted pathophysiology. Many patients, despite achieving standard treatment goals of improvement in exacerbating symptoms, fluid loss, and improved pulmonary pressures, still have poor post-discharge outcomes. At the trial level, there is a similar disconnect between positive early-phase trial experiences showing improvement in surrogate markers of treatment efficacy, followed by negative or neutral phase III trials testing definitive clinical endpoints [7, 17]. A focus on long-term treatment effects and prognosis may be especially important in patients with HHF [6••]. Interventions made around the time of hospital discharge and continued into the high-risk post-discharge period are therefore increasingly being evaluated [18, 19]. However, trials with this strategy have also failed to improve outcomes in some trials, e.g., EVEREST (Efficacy of Vasopressin Antagonism in Heart Failure Outcome Study with Tolvaptan) and ASTRONAUT (Aliskiren Trial on Acute Heart Failure Outcomes) [8, 20]. The complexity of the disease may also lead to problems in understanding the mechanism of action of the drug, matching it to the intended target, and selection of the right patient population [10, 21]. Key factors associated with problems in HF trials are discussed in Table 1 .
Recently, HF trials have undergone marked globalization with concurrent decline in enrollment rates at sites in the USA and Western Europe [22]. There are multiple reasons for this shift, of which the important ones are highlighted in Fig. 1. Globalization of trials in HF has driven increased regional heterogeneity in enrolled populations, larger trial size, higher trial costs, issues with reliability and security of data, and challenges with characterizing global study sites [6••] (Fig. 2). A key factor is the problem in the execution of a study, where, despite experienced teams, avoiding issues with data collection can be a major obstacle towards approval of a new therapy by the regulatory authorities [23]. Hence, we attempt to better understand these trial-level issues with site selection and study execution and provide a mechanistic approach to minimize the impact of these factors on the future design of global clinical trials in HF.
Site Selection
Enrollment in global clinical trials is determined by the ability of individual sites to effectively enroll appropriate patients that fit the specific trial eligibility criteria [6••]. Although globalization in selection of sites may improve the generalizability of the trial findings to certain populations, there appears to be important site- and region-specific variation in enrollment patterns. For instance, in the EVEREST trial (4133 enrolled patients from 359 global sites with an overall enrollment rate of 0.41 patients/site/month), significant site- and region-based heterogeneity was observed in patient profiles, baseline comorbidities, and serologic markers of disease severity [8]. Similarly, there was variation in background event rates (HF hospitalizations and mortality), such that sites with lower recruitment rates (<10 patients/site/month) had worse outcomes compared to the sites with higher enrollment [8]. Regional heterogeneity may also impact the eventual success of the overall trial. In the TOPCAT (Treatment of Preserved Cardiac Function Heart Failure With and Aldosterone Antagonist) trial [24] of patients with HF with preserved ejection fraction, 3445 patients were enrolled from six countries that were divided into two regions (the Americas and Russia/Georgia). Region-specific analysis demonstrated clinically relevant variation in patient profiles, eligibility criteria, drug adherence, event rates, and treatment effects. In the overall trial, the primary composite endpoint of cardiovascular mortality, aborted cardiac arrest, and hospitalizations for HF was 18.6% in the spironolactone group and 20.4% in the placebo group (p = 0.14) [24]. However, when analyzing event rates by region, 31.8% (n = 881) of the patients in the placebo group in the Americas experienced the primary endpoint compared with only 8.4% (n = 842) of patients enrolled from Russia and Georgia. Furthermore, spironolactone reduced the primary endpoint in the Americas (hazard ratio 0.82, 95% confidence interval 0.69–0.98), but failed to impact the primary endpoint in Russia/Georgia when compared with placebo (hazard ratio 1.1, 95% confidence interval 0.79–1.51; treatment-by-region interaction P = 0.12) [24, 25].
Thus, sites with varying enrollment may play a significant role in the results of a study and make the true evaluation of an investigational therapy challenging. Analysis of trials conducted between 2001–2003 and 2009–2012 show that the trials conducted exclusively in North America have reduced in number compared to multiregional trials in recent years [11•]. Examples of lower participation of North American sites in recently conducted large multicenter international clinical trials in HF are shown in Table 2 [8, 12, 26,27,28].
Sites with low enrollment rates may lead to decreased exposure and inadequate training of the study investigators and reduced support from the administration, both of which are keys to developing research protocols and structure at the participating sites. Limited trial participation and volume would also not justify the cost of trial-related training and infrastructure at the participating sites [8].
As such, mechanisms to identify high-quality, reliable, and efficient sites are needed. The development of large patient registries may help in identifying sites with sufficient quantity and quality [29]. However, an obstacle in developing a pre-trial global HF registry may come from the sites themselves, where the performance of the study site is presented to the accessible registries in a non-anonymous way and hence, exposing the site-specific data to the public. Data regarding the efficiency of the sites that have participated in prior trials may also be available to the trial execution organizations including academic research organization and contract research organization networks. This information can be used to create a separate repository of sites which may be utilized to enroll patient populations with desired characteristics for the trial with acceptable performance metrics. Leveraging novel methods of natural language processing of electronic health records and quantifying hospital volume for specific conditions may be further used to identify optimal sites [30]. For instance, the number of HF visits in US emergency departments in 2012 showed that out of 130 million total visits, 1.3 million were for acute HF and 1.04 million led to hospitalization [31]. Site-specific ED volume may be an indicator of the ability of the site to effectively participate in a given trial and may help differentiate whether low enrollment rates at a site are a function of low site performance or inadequate volume of patients with HF.
Aligning Interests and Incentives
Developing a protocol or questionnaire for the study sites to match the goals and expectations of the study administrators with that of the site managers may also represent a step in improving coordination and detecting trial-level issues early. This may be followed by verification visits of selected sites that may prove to be expensive, but invaluable and cost-effective in the long-term in minimizing errors at later stages.
Current systems, especially in the USA, poorly incentivize trial participation by investigators. Incentives, both for study sites and investigators, have become more relevant as healthcare institutions have linked financial incentives to performance goals in clinical care. Participation by investigators in clinical trials must often be integrated into usual clinical care, which is often challenging and burdensome. Performance of study investigators and coordinators can be improved by linking incentives into their performance metric. The support and resources for these incentives are further diminished as concerns for liability and ethical consequences from funding agencies and regulators come into play, resulting in almost no incentive for the teams involved in clinical trials [6••].
Study Design
With development of effective therapies, improvements in care of coexisting comorbidities, and increases in the relative prevalence of HF with preserved ejection fraction, patients with HF are expected to be older with greater comorbidity burden. Trial designs, on the other hand, incorporate strict inclusion and exclusion criteria and most require the patients to be on an optimal medical therapy. While this may increase the chances of a positive effect of an investigational therapy, it makes recruitment more difficult and narrows the patient population likely to benefit from the novel therapy. For instance, the eligibility criteria applied to the PARADIGM-HF (Prospective Comparison of ARNI [Angiotensin Receptor-Neprilysin Inhibitor] with ACEI [Angiotensin-Converting-Enzyme Inhibitor] to Determine Impact on Global Mortality and Morbidity in Heart Failure [HF]) trial was significantly narrower than the target population with approved use by the US Food and Drug Administration [32]. As such, eligibility criteria in future HF trials should be expanded to be more representative of a general “real-world” HF population, especially in the face of low enrollment patterns [33]. SPIRRIT (Spironolactone Initiation Registry Randomized Interventional Trial in Heart Failure with Preserved Ejection Fraction) trial (ClinicalTrials.gov Unique Identifier: NCT02901184) is a planned, registry-based randomized clinical trial which aims to test spironolactone in HF with preserved ejection fraction in a broader target population, in light of the uncertain results of TOPCAT [34].
Simplification of the study protocol and consent process is important for the site investigators and patients. Complex consent forms are prohibitive [35], especially in patient populations with low health literacy. Lengthy consent processes may present another barrier for enrollment, especially during time-sensitive periods such as early during hospitalization for HF [36]. Extensive and unnecessary data collection requires more time and increase the cost of trial conduct, while data collection that is restricted to regulatory requirements and pertinent to the immediate clinical question will improve the consumption of site resources [33]. Most large multicenter trials have large committees and there is extensive input from the members which make the protocols more complex. The committees responsible for study design need to be smaller and if needed, the study protocol can be subsequently reviewed by a larger supervising committee [6••].
With growing national focus on reducing hospital length of stay, there is limited research coordination between various departments (for example, emergency and hospital medicine departments), potentially impacting the ability of sites to efficiently enroll patients in a timely manner. In trials of HHF patients, this is especially problematic given focus on short-term surrogate endpoints (largely based on improvements in symptoms), which require timely assessment early during hospitalization [28]. In order to optimize patient enrollment, sufficient administrative staffing should be available during key periods (based on site-specific historical emergency department visit records) including the nights and weekends. Furthermore, study personnel should not only establish contact with patients in emergency departments, but also in short stay and observation units. Outside the USA, most investigators have more time to enroll and evaluate patients early, owing to longer hospital length of stay from 7 to 21 days [37] and a different healthcare system than the USA. It is essential to establish an efficient multidisciplinary structure to identify these key problems and address them in a mechanistic way (Table 3).
Conclusion
Patients with HF constitute a large population at high risk for morbidity and mortality. The future design of trials in this population requires special consideration by the clinicians, investigators, industry, and regulators. In recent years, the globalization of HF trials and widening disparities between geographical regions, associated with intrinsic heterogeneity and lack of HF site information, have introduced significant variability of the trial population. Marked heterogeneity in the trial sample has posed unique challenges to the efficient development and testing of novel therapies. Hence, it is imperative to recognize and address these trial-level issues to inform and optimize the design of future global clinical trials in HF.
Abbreviations
- HF:
-
Heart failure
References
Papers of particular interest, published recently, have been highlighted as: • Of importance •• Of major importance
Benjamin EJ, Blaha MJ, Chiuve SE, et al. Heart disease and stroke statistics-2017 update: a report from the American Heart Association. Circulation. 2017;135:e146–603.
Lloyd-Jones D, Adams RJ, Brown TM, et al. Heart disease and stroke statistics—2010 update: a report from the American Heart Association. Circulation. 2010;121:e46–e215.
Lloyd-Jones D, Adams RJ, Brown TM, et al. Executive summary: heart disease and stroke statistics—2010 update: a report from the American Heart Association. Circulation. 2010;121:948–54.
Heidenreich PA, Albert NM, Allen LA, et al. Forecasting the impact of heart failure in the United States: a policy statement from the American Heart Association. Circulation Heart failure. 2013;6:606–19.
Lloyd-Jones D, Adams R, Carnethon M, et al. Heart disease and stroke statistics—2009 update: a report from the American Heart Association Statistics Committee and Stroke Statistics Subcommittee. Circulation. 2009;119:480–6.
•• Gheorghiade M, Vaduganathan M, Greene SJ, et al. Site selection in global clinical trials in patients hospitalized for heart failure: perceived problems and potential solutions. Heart Fail Rev. 2014;19:135–52. This reference is a summary of a round-table discussion in an open forum between globally recognized experts in international clinical trials as discussing site selection.
Butler J, Fonarow GC, Gheorghiade M. Need for increased awareness and evidence-based therapies for patients hospitalized for heart failure. JAMA. 2013;310:2035–6.
Konstam MA, Gheorghiade M, Burnett JC Jr, et al. Effects of oral tolvaptan in patients hospitalized for worsening heart failure: the EVEREST Outcome Trial. JAMA. 2007;297:1319–31.
Massie BM, O’Connor CM, Metra M, et al. Rolofylline, an adenosine A1-receptor antagonist, in acute heart failure. N Engl J Med. 2010;363:1419–28.
Mebazaa A, Pang PS, Tavares M, et al. The impact of early standard therapy on dyspnoea in patients with acute heart failure: the URGENT-dyspnoea study. Eur Heart J. 2010;31:832–41.
• Butler J, Tahhan AS, Georgiopoulou VV, et al. Trends in characteristics of cardiovascular clinical trials 2001–2012. Am Heart J. 2015;170:263–72. This trial-level analysis tracks trends in characteristics of major cardiovascular trials over the past decade.
Pitt B, Pfeffer MA, Assmann SF, et al. Spironolactone for heart failure with preserved ejection fraction. N Engl J Med. 2014;370:1383–92.
McMurray JJ, O’Connor C. Lessons from the TOPCAT trial. N Engl J Med. 2014;370:1453–4.
Blair JE, Zannad F, Konstam MA, et al. Continental differences in clinical characteristics, management, and outcomes in patients hospitalized with worsening heart failure results from the EVEREST (Efficacy of Vasopressin Antagonism in Heart Failure: Outcome Study with Tolvaptan) program. J Am Coll Cardiol. 2008;52:1640–8.
O’Connor CM, Fiuzat M, Swedberg K, et al. Influence of global region on outcomes in heart failure beta-blocker trials. J Am Coll Cardiol. 2011;58:915–22.
MacMahon S, Perkovic V, Patel A. Industry-sponsored clinical trials in emerging markets: time to review the terms of engagement. JAMA. 2013;310:907–8.
Vaduganathan M, Greene SJ, Ambrosy AP, Gheorghiade M, Butler J. The disconnect between phase II and phase III trials of drugs for heart failure. Nat Rev Cardiol. 2013;10:85–97.
Felker GM, Pang PS, Adams KF, et al. Clinical trials of pharmacological therapies in acute heart failure syndromes: lessons learned and directions forward. Cir Heart Fail. 2010;3:314–25.
Gheorghiade M, Adams KF, Cleland JG, et al. Phase III clinical trial end points in acute heart failure syndromes: a virtual roundtable with the Acute Heart Failure Syndromes International Working Group. Am Heart J. 2009;157:957–70.
Gheorghiade M, Albaghdadi M, Zannad F, et al. Rationale and design of the multicentre, randomized, double-blind, placebo-controlled Aliskiren Trial on Acute Heart Failure Outcomes (ASTRONAUT). Eur J Heart Fail. 2011;13:100–6.
Gheorghiade M, Pang PS, O’Connor CM, et al. Clinical development of pharmacologic agents for acute heart failure syndromes: a proposal for a mechanistic translational phase. Am Heart J. 2011;161:224–32.
Glickman SW, McHutchison JG, Peterson ED, et al. Ethical and scientific implications of the globalization of clinical research. N Engl J Med. 2009;360:816–23.
Mega JL, Braunwald E, Wiviott SD, et al. Rivaroxaban in patients with a recent acute coronary syndrome. N Engl J Med. 2012;366:9–19.
Pfeffer MA, Claggett B, Assmann SF, et al. Regional variation in patients and outcomes in the Treatment of Preserved Cardiac Function Heart Failure With an Aldosterone Antagonist (TOPCAT) trial. Circulation. 2015;131:34–42.
Egwim C, Dixon B, Ambrosy AP, Mentz RJ. Global variations in patient populations and outcomes in heart failure clinical trials. Curr Heart Fail Rep. 2017;14:30–9.
McMurray JJ, Packer M, Desai AS, et al. Angiotensin-neprilysin inhibition versus enalapril in heart failure. N Engl J Med. 2014;371:993–1004.
Gheorghiade M, Bohm M, Greene SJ, et al. Effect of aliskiren on postdischarge mortality and heart failure readmissions among patients hospitalized for heart failure: the ASTRONAUT randomized trial. JAMA. 2013;309:1125–35.
Teerlink JR, Cotter G, Davison BA, et al. Serelaxin, recombinant human relaxin-2, for treatment of acute heart failure (RELAX-AHF): a randomised, placebo-controlled trial. Lancet (London, England). 2013;381:29–39.
Greene SJ, Shah AN, Butler J, et al. Designing effective drug and device development programs for hospitalized heart failure: a proposal for pretrial registries. Am Heart J. 2014;168:142–9.
Vaduganathan M, Patel RB, Butler J, Metra M. Integrating electronic health records into the study of heart failure: promises and pitfalls. Eur J Heart Fail 2017.
Roger VL, Go AS, Lloyd-Jones DM, et al. Heart disease and stroke statistics—2012 update: a report from the American Heart Association. Circulation. 2012;125:e2–e220.
Parikh KS, Lippmann SJ, Greiner M, et al. Scope of sacubitril/valsartan eligibility after heart failure hospitalization: findings from the GWTG-HF Registry (Get With The Guidelines-Heart Failure). Circulation. 2017;135:2077–80.
Harinstein ME, Butler J, Greene SJ, et al. Site selection for heart failure clinical trials in the USA. Heart Fail Rev. 2015;20:375–83.
Lund LH, Oldgren J, James S. Registry-based pragmatic trials in heart failure: current experience and future directions. Curr Heart Fail Rep. 2017;14:59–70.
Dickert NW, Llanos A, Samady H. Re-visiting consent for clinical research on acute myocardial infarction and other emergent conditions. Prog Cardiovasc Dis. 2012;55:251–7.
Shahzad A, Kemp I, Mars C, et al. Unfractionated heparin versus bivalirudin in primary percutaneous coronary intervention (HEAT-PPCI): an open-label, single centre, randomised controlled trial. Lancet (London, England). 2014;384:1849–58.
Oliva F, Mortara A, Cacciatore G, et al. Acute heart failure patient profiles, management and in-hospital outcome: results of the Italian Registry on Heart Failure Outcome. Eur J Heart Fail. 2012;14:1208–17.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
Chaudhry MS Sarwar and Muthiah Vaduganathan declare no conflicts of interest.
Javed Butler reports receiving research support from the National Institutes of Health, and European Union, and serves as a consultant to Amgen, Bayer, Boehringer Ingelheim, Cardiocell, Celladon, Novartis, Trevena, Relypsa, Z Pharma, and Zensun.
Human and Animal Rights and Informed Consent
This article does not contain any studies with human or animal subjects performed by any of the authors.
Additional information
This article is part of the Topical Collection on Clinical Trials
Rights and permissions
About this article
Cite this article
Sarwar, C.M.S., Vaduganathan, M. & Butler, J. Impact of Site Selection and Study Conduct on Outcomes in Global Clinical Trials. Curr Heart Fail Rep 14, 203–209 (2017). https://doi.org/10.1007/s11897-017-0335-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11897-017-0335-y