Introduction

Osteoporosis is a systemic skeletal disease characterised by low bone mineral density (BMD) and deterioration of bone architecture resulting in reduced bone strength and, consequently, an increased susceptibility to fracture [1]. In patients without fracture, measurement of BMD by dual energy x-ray absorptiometry (DXA) is commonly used for the diagnosis of osteoporosis. According to the World Health Organisation and the International Society for Clinical Densitometry Position, postmenopausal women and men older than 50 years with a BMD T-score of −2.5 or below have osteoporosis and those with a BMD T-score between −1 and −2.5 have low bone mass or osteopenia [24].

Several treatments are available for osteoporosis and fracture prevention, including bisphosphonates, teriparatide, raloxifene, and denosumab, which was approved by the Food and Drug Administration in 2010 [5]. Like bisphosphonates, denosumab inhibits bone resorption. It acts by binding to and inhibiting the effect of the receptor activator of nuclear factor KB ligand (RANKL), a protein that stimulates osteoclast activity. Denosumab is indicated in the treatment of women and men with osteoporosis at high risk for fracture. It is administered subcutaneously every 6 months at a dosage of 60 mg [6]. In the FREEDOM study, denosumab given twice yearly for 36 months has been shown to reduce the risk of new radiographic vertebral fractures by 68 %, hip fractures by 40 %, and non-vertebral fractures by 20 % when compared to placebo [7].

While the mechanism of action of denosumab differs to that of other treatments, its comparability in terms of efficacy and safety is unknown. We therefore conducted a systematic review and meta-analysis of randomised controlled trials to evaluate the efficacy and safety of denosumab compared to other approved treatments for osteoporosis, in individuals at risk of fractures or suffering from osteoporosis.

Methods

This systematic review was developed according to recommendations from The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statements [8] and the Cochrane Handbook for Systematic Reviews of Interventions [9]. Eligibility criteria, outcomes, data to be extracted, risk of bias assessment and statistical analyses were determined a priori and formulated in a protocol (unpublished).

Eligibility criteria

Randomized controlled trials comparing the effect of denosumab (at any dose level) with another pharmacological treatment for osteoporosis were retained for this review if the study population included at least 80 % of men or women aged 40 years and older and if at least 80 % of participants were at risk of fracture or suffered from osteoporosis. Being at risk of fracture or suffering from osteoporosis was defined as (i) having suffered a non-traumatic fracture, (ii) having a BMD T-score lower than −1.8 (arbitrary value corresponding approximately to the midpoint of the osteopenic BMD interval (−2.5 to −1)), (iii) being diagnosed with primary osteoporosis or (iv) being considered at risk of fracture by study investigators. Studies published in any language, peer-reviewed or not, were included. Trials comparing the effect of denosumab with calcium or vitamin D or including only individuals with a specific condition other than osteoporosis were excluded.

Outcomes

Our primary outcomes were fractures (vertebral, hip or at all skeletal sites) and adverse events (all adverse events, withdrawals due to adverse events, death). Our secondary outcomes were the changes in areal BMD from baseline at the total hip, lumbar spine, femoral neck and one-third distal radius, as measured by DXA.

Search strategy

The electronic databases MEDLINE, EMBASE and Cochrane Central Register of Controlled Trials (CENTRAL) were searched from their inception through May 2015 for published studies on the effect of denosumab. The search strategy was first designed for MEDLINE (Appendix A) and then adapted for the other databases using a combination of exploded MeSH or Emtree terms and keywords related to the terms “denosumab”, “osteoporosis”, “fracture” and “low bone mass”. Highly sensitive filters were used to identify randomised controlled trials in humans [9, 10]. To identify additional studies, references from identified articles and existing reviews were screened. All references were imported into EndNote (version X7.0.2, Thomson Reuters) software and duplicates were removed.

Study selection

Based on the inclusion and exclusion criteria, two independent reviewers (CB and SJ) screened titles and abstracts of each study to determine eligibility. Both reviewers independently assessed the full text of studies classified as included or unclear for final inclusion. Disagreements were discussed and, when required, resolved by a third reviewer (JPB).

Data abstraction

Using standardized data extraction forms, piloted on two representative studies, two reviewers (CB and SJ) independently extracted data on study characteristics (e.g. design, country, inclusion and exclusion criteria, funding sources), participants’ clinical characteristics (e.g. age, gender, ethnicity, BMD T-score, prior treatment for osteoporosis), interventions and cointerventions (name, dosage, frequency, duration) and outcomes. Data not reported in an article were extracted from protocols when available. Numerical data only available from plots or images were extracted using WebPlotDigitizer (version 2.6). Authors were not contacted for missing data.

Risk of bias assessment

Two reviewers (CB and SJ) independently assessed the risk of bias of selected studies using the Cochrane Collaboration’s tool for assessing risk of bias [9]. A low, high or unclear risk of bias was assigned to each of the following domains: random sequence generation, allocation concealment, blinding of participants and personnel, blinding of outcome assessment, incomplete outcome data and selective reporting. Protocols of studies were searched and used to better evaluate the risk of bias. An overall high risk of bias was attributed to studies in which (i) the analyses included fewer than 80 % of randomized subjects, (ii) participants were not blinded to treatment or (iii) two domains or more had a high risk of bias. Studies were considered to have an unclear overall risk of bias if (i) fewer than two domains had a high risk of bias and (ii) two domains or more had an unclear risk of bias. Otherwise, studies were considered to have a low overall risk of bias.

Statistical analyses

Meta-analyses were conducted with Review Manager (version 5.2, Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2012) using data reported on the longest follow-up period of the study (unless treatments assigned at randomisation were changed for the extension period). The comparative effect of denosumab and other treatments for osteoporosis was expressed as relative risk (RR) for fractures or adverse events, Peto odds ratio (OR) for withdrawals due to adverse events and death and mean difference for percent BMD change from baseline. A 95 % confidence interval (95 % CI) was constructed for each measure of effect. The Mantel-Haenszel method was used for the meta-analysis on fractures [11] and the generic inverse variance method for those on adverse events and percent BMD changes from baseline. To account for between-study heterogeneity, random effects methods were used except when a Peto OR was computed. Results for hip and vertebral fractures were summarised qualitatively as too few events were reported for meta-analyses. Heterogeneity was quantified using the I2 statistic and the thresholds proposed in the Cochrane Handbook for Systematic Reviews of Interventions (0–40 %: low, 30–60 %: moderate, 50–90 %: substantial, 75–100 %: considerable heterogeneity) [9]. Subgroup analyses were planned a priori and conducted for the following variables: gender, treatment for osteoporosis before the study, BMD level at the beginning of the study (lower vs higher), administration of a cointervention, comparison treatment (alendronate vs other treatments, bisphosphonates vs other treatments), treatment frequency and dosage, overall risk of bias and funding source. A study was assigned to the lower BMD T-score subgroup if its population included only participants with a BMD T-score lower than −2, but also some with a BMD T-score lower than −3. In sensitivity analyses, meta-analyses on all outcomes were performed using 12-month follow-up data. For each meta-analysis conducted, a funnel plot was constructed to assess risk of publication bias.

Results

Among the 1764 articles identified using our search strategy, 13 satisfied the eligibility criteria (Fig. 1). These articles refer to 9 different studies which included a total of 4890 postmenopausal women (Table 1). Denosumab was administered subcutaneously at a dosage of 60 mg every 6 months in eight studies [1221]. In one study [2224], 6, 14, 30, 60, 100 or 210 mg of denosumab was administered every 3 or 6 months. In the meta-analyses, data from this study were first used by regrouping all participants who received denosumab, regardless of dosage and frequency. In a sensitivity analysis on the comparative effect of 60 mg of denosumab every 6 months, we then only used data from the appropriate randomisation group when available. The effect of denosumab was compared to alendronate in five studies [1216, 2224] and to zoledronic acid, risedronate, ibandronate or teriparatide in four individual studies [1721]. Follow-up duration varied from 12 to 24 months.

Fig. 1
figure 1

Flow diagram of studies

Table 1 Characteristics of included studies

A high, unclear and low overall risk of bias was respectively adjudicated to five [1520, 2224], one [21] and three [1214] studies. In all studies, adverse events were collected in at least 80 % of randomised subjects (Appendix B). The authors of only five studies [12, 13, 17, 20, 21] specified that at least 80 % of randomised patients were included in the BMD analyses. Participants and assessors were blinded to treatments in three studies [1214]. In only one study [18, 19], AMGEN had no role in the study design, data collection, data analysis, data interpretation or writing of the report. All studies were funded by AMGEN.

Comparative effect of denosumab on fracture risk

Seven studies [12, 13, 1517, 2024] in which the number of fractures was specified for each treatment group were included in the meta-analysis on fracture risk. In all studies, the effect of denosumab was compared to a specific bisphosphonate. No statistically significant difference was detected between the fracture risk of participants who received denosumab and those who received a bisphosphonate (n = 4602, RR[95 % CI] = 1.15 [0.84–1.58], I2 = 0 %, Fig. 2). The funnel plot did not suggest the presence of a publication bias (Appendix C). No significant difference was detected in any of the sensitivity or subgroup analyses (Table 1 of Appendix D).

Fig. 2
figure 2

Meta-analysis of fracture risk. SD: standard deviation, M-H: Mantel-Haenszel, CI: confidence interval. In all studies, comparator treatment is a bisphosphonate

Only three studies reported the number of participants who suffered a hip or vertebral fracture [13, 1517]. In two studies [13, 15, 16], no participants in the denosumab or alendronate group suffered a fracture at these sites. In another study [17], 1/410 and 2/410 participants randomised to ibandronate suffered a hip and vertebral fracture, respectively, and 2/411 randomised to denosumab suffered a vertebral fracture.

Comparative effect of denosumab on adverse events

Among the nine studies included in this review, eight [1217, 2024] specified the total number of adverse events reported in each randomisation group. All studies compared the effect of denosumab to a bisphosphonate. Based on data from these studies, the risk of adverse events was not significantly different between participants who received denosumab and those who received a bisphosphonate (n = 4766, RR[95 % CI] = 0.99 [0.96–1.02], I2 = 0 %, Fig. 3). The absence of symmetry in the funnel plot suggests that smaller studies favouring denosumab instead of other treatments for osteoporosis may not have been published (Appendix E). Since all studies included in this review were funded by AMGEN, the manufacturer of denosumab, the presence of such a publication bias is unlikely. We did not detect a significant difference in the risk of adverse events between the groups in any of the subgroups analysed (Table 2 of Appendix D).

Fig. 3
figure 3

Meta-analysis of risk of adverse events. SD: standard deviation, IV: inverse variance, CI: confidence interval. In all studies, comparator treatment is a bisphosphonate

All studies [1224] specified the number of withdrawals due to adverse events and could thus be included in the meta-analysis on this outcome. The risk of withdrawals due to adverse events was lower in participants treated with denosumab than in those randomised to another treatment, but the difference did not reach statistical significance (n = 4887, OR[95 % CI] = 0.68 [0.45–1.04], I2 = 57 %, Fig. 4). Results were similar when denosumab was compared to bisphosphonates (n = 4545, OR[95 % CI] = 0.70 [0.46–1.08], Table 3 of Appendix D). In the studies not exclusively including subjects who had previously received a treatment for osteoporosis [12, 1416, 18, 19, 2224], the risk of withdrawals due to adverse events was significantly lower in participants treated with denosumab (n = 2040, OR[95 % CI] = 0.48 [0.25–0.92], I2 = 0 %). In studies including participants with a lower BMD T-score [12, 13, 1517, 21], treatment with denosumab was also associated with a lower risk of withdrawals due to adverse events (n = 3416, OR[95 % CI] = 0.49 [0.29–0.83], I2 = 25 %).

Fig. 4
figure 4

Meta-analysis of risk withdrawals due to adverse events. SD: standard deviation, CI: confidence interval. In all studies except DATA, comparator treatment is a bisphosphonate

In the six studies included in the meta-analysis on death [12, 13, 17, 2024], the comparator treatment was a bisphosphonate. The risk of death was not statistically different between denosumab and bisphosphonate groups (n = 4360, OR[95 % CI] = 0.58 [0.12–2.71], I2 = 0 %, Fig. 1 of Appendix F). No significant association was detected in any of the subgroups examined (Table 4 of Appendix D).

Comparative effect of denosumab on changes in bone mineral density

Among the nine studies included in this review, eight [12, 13, 1524] evaluated the comparative effect of denosumab on BMD at the total hip, lumbar spine, femoral neck or one-third radius. The percent changes in BMD measured at all of these sites were statistically higher in participants randomised to denosumab than in other treatment groups (n, mean difference [95 % CI]; total hip 4434, 1.06 [0.86–1.25], lumbar spine 4415, 1.46 [0.97–1.95], femoral neck 4153, 1.06 [0.81–1.30], one-third radius 2571, 1.12 [0.47–1.78], Fig. 5 and Figs. 2 to 4 of Appendix F). Results of the meta-analyses comparing the effect of denosumab to bisphosphonates were similar (mean difference [95 % CI]; total hip 1.05 [0.85–1.26], lumbar spine 1.55 [1.09–2.02], femoral neck 1.06 [0.79–1.32], one-third radius 0.83 [0.34–1.31], Tables 5–8 of Appendix D). At the total hip and femoral neck, the difference in treatment effects was significant in all subgroups investigated (Tables 5 and 7 of Appendix D). While the change in BMD at the lumbar spine and one-third radius was almost always higher in the denosumab group, there was considerable heterogeneity in the meta-analyses on these outcomes (I2 = 73 and 76 %, respectively). When comparing the effect of denosumab to alendronate only, denosumab was still more effective in increasing BMD at the lumbar spine and heterogeneity was no longer present (I2 = 0 %) (Table 6 of Appendix D).

Fig. 5
figure 5

Meta-analysis of percent change in total hip bone mineral density. SD: standard deviation, IV: inverse variance, CI: confidence interval. In all studies except DATA, comparator treatment is a bisphosphonate

Discussion

In this meta-analysis, no significant difference between denosumab and bisphosphonates was detected in total adverse events, death or fracture occurrence over a period of 12 to 24 months. Withdrawals due to adverse events tended to be less frequent in participants treated with denosumab, but the difference did not reach statistical significance. Denosumab was slightly more effective than other treatments were, including bisphosphonates, in increasing areal BMD.

When compared to other treatments for osteoporosis, mostly bisphosphonates, denosumab provided an additional approximate gain of 1 % in BMD over 12 to 24 months. The superiority of denosumab over bisphosphonates in increasing BMD could be explained by a greater antiresorptive effect. While bisphosphonate inhibition of osteoclasts requires binding to bone mineral, denosumab acts directly by binding to RANKL. When bound to RANKL, denosumab distinctively inhibits osteoclast formation, function and survival [25].

While denosumab showed a superior effect on BMD, we did not observe a higher efficacy than bisphosphonates in reducing fracture risk. We could presume that the gain in BMD over a short period of time was not large enough to reduce fracture incidence. The differential effect of denosumab on fracture risk may only become apparent after a longer period of treatment than that used in included studies.

In a network meta-analysis on the efficacy of different drugs to prevent fragility fractures [26], denosumab, teriparatide, alendronate, zoledronate and risedronate were all more effective than the placebo was in reducing the risk of non-vertebral fractures. No significant differences between treatment effects were observed which is consistent with our findings. In a Bayesian analysis based on indirect comparisons of treatments, teriparatide had the highest probability of being ranked as the most effective treatment to reduce fracture incidence. In our review, we only included head-to-head trials comparing denosumab to other treatments for osteoporosis. Since we identified only one small study which compared the effect of denosumab to teriparatide, we could not draw conclusions on this specific treatment comparison.

In another meta-analysis on the comparative efficacy and safety of denosumab and alendronate [27], Lin et al. did not detect a difference for safety or fracture risk over a 1-year follow-up period. They also concluded that denosumab was more effective in increasing BMD. Although their conclusions on the comparative effect of denosumab on BMD are similar to ours, our results are slightly different. We noted that they inadvertently used standard errors instead of the standard deviation in their meta-analysis on the change in BMD, which created narrower confidence intervals.

Recent reviews [28, 29] have shown that, in a clinical setting, persistence and compliance with denosumab is significantly better than with oral bisphosphonates. In the present review, only randomised controlled trials were included. In such studies, patients are closely followed and persistence and compliance tend to be higher than in a real-world setting. In the real-world clinical practice, denosumab may thus be more effective than what is shown in this review.

A recent literature review [30] on the cost-effectiveness of denosumab complements the results of our review. The authors showed that denosumab was more cost-effective than most other treatments are for osteoporosis, including oral medication for which the average wholesale price is considerably lower [31]. As they suggested, the higher cost-effectiveness of denosumab compared to many other medications for osteoporosis could, amongst other things, be attributable to frequency of administration. Since denosumab is administered once every 6 months rather than every week, patients’ adherence may be increased, thus increasing its effectiveness to prevent fractures in a clinical setting.

The main limitation of our systematic review is that included studies have a high risk of bias and all studies were funded by AMGEN which was actively involved in the study design and/or conduct of all but one study. Another important limitation is that none of the studies were designed to evaluate the comparative efficacy of denosumab in decreasing fracture risk. The change in BMD and level of bone turnovers were the main outcomes and fractures were reported as adverse events without a specific adjudication process. None of the individual studies were powered to detect a significant difference in fracture risk between groups. While performing a meta-analysis is a way to increase statistical power, the number of individuals included in meta-analyses on fracture risk may still not be sufficient [32]. Since very few deaths were reported in each study, results of the meta-analysis on death are imprecise. None of the included studies were performed in men; thus, the results of this meta-analysis cannot be generalised to males. This review includes only studies that were conducted over a follow-up period of 12 or 24 months. Consequently, the comparative effect of prolonged use of denosumab could not be studied. Despite these limitations, the results of our review are based on an exhaustive literature search and rigorous methodology. The probability of publication bias was judged low and only head-to-head randomised control trials were included.

The results of this meta-analysis do not offer evidence of the differential safety of denosumab compared to bisphosphonates in treating individuals at risk for osteoporosis. While denosumab was significantly more effective in increasing BMD, its use did not lead to a significant reduction in fracture risk. In real-world clinical practice, denosumab may, however, be more effective given its higher persistence and compliance. Until more studies are conducted, this research suggests that denosumab could be a good alternative to other antifracture medications. When choosing a patient’s medication, patient particularities (tolerance, adherence, comorbidities, etc.) should be considered. More studies on the comparative efficacy and safety of denosumab should be performed, particularly in men, on longer follow-up periods and using fracture as the primary outcome.