Introduction

Daily adherence to antiretroviral therapy (ART) can suppress the concentration of HIV-1 RNA in an individual’s blood—commonly referred to as “viral load”—to the extent that it is “undetectable” and not transmittable to others through unsafe sex [1]. For people living with HIV, viral suppression is key in living a healthy life and preventing harms associated with HIV and AIDS [2]. On a larger scale, viral suppression is key to reducing HIV transmission and ending the HIV/AIDS epidemic [3]. In 2015, the Joint United Nations Programme on HIV/AIDS (UNAIDS) reported that the HIV/AIDS epidemic could be eradicated by the year 2030 if 73% of all people living with HIV achieve and maintain an undetectable HIV viral load [4]; however, recent estimates suggest that the number of people in the United States and dependent areas who maintain an undetectable HIV viral load is well below this goal (64%) [5]. Because the achievement and maintenance of an undetectable HIV viral load is key to promoting the health of people living with HIV and to eradicating the HIV/AIDS epidemic, the suppression of HIV to undetectable levels should be a primary focus to improve public health.

A review published in 2017 evaluated all studies of interventions designed to promote ART adherence [6]. The review included 85 studies. Of these studies, only 47 reported a measure of viral suppression. The review did not analyze effects of the interventions on suppressing HIV viral loads to undetectable levels. To determine the extent to which available antiretroviral medication adherence interventions promote viral suppression below detectable thresholds, we conducted a systematic review and meta-analysis that updated the 2017 review [6] and included only studies that reported a measure of viral suppression. We included all 47 studies identified in the prior review that reported viral suppression. Using the same search criteria employed in the previous review, we added all relevant studies published through November 22, 2019. Our analyses sought to determine which interventions significantly increased undetectable HIV viral loads and whether interventions in general increased undetectable HIV viral loads. Because of the relatively recent recognition that undetectable viral loads can eliminate some transmission of HIV, we also conducted an analysis to determine if the effectiveness of interventions to promote undetectable viral loads increased over time.

Method

We used the research strategy identified in the prior systematic review and meta-analysis to create an updated search to identify studies for the present review and meta-analysis [6]. First, we included the 47 studies identified by the prior review that aimed to promote ART adherence and contained a measure of HIV viral suppression [6]. Then we used the PRISMA extension [7] to search the Cochrane Central Register of Controlled Trials, Embase, and MEDLINE for reports published through November 22, 2019 with the same search terms as the prior review [6]. To be eligible for the present review, each study must have included a randomized controlled trial, a Standard of Care (SOC) or enhanced Standard of Care (eSOC) control group, an intervention to enhance ART adherence, and reported the following information regarding viral suppression: The number of participants assigned to the intervention and control groups, the number of participant blood samples that were collected from each group at a measurement following the start of an intervention, and the number of collected samples from each group with viral load suppressed below a specific threshold (e.g., “undetectable” =  < 200 copies/mL).

Two investigators (FT and AR, MN, or KS) independently extracted data from each study that passed the initial screening stage. Extracted data included: the first author, study year, type of control group, type of treatment group, country, criterion for undetectable HIV viral load, number of participants randomized into each group, timepoint of the primary measurement, number of blood samples collected from each group at the primary measurement, and the number of collected samples from each group at the primary measurement with an undetectable viral load. The two investigators who extracted data for the study also assessed risk-of-bias using the Cochrane Collaboration Tool [8]. Any discrepancies between the data extracted by the two extractors during data extraction or risk-of-bias assessments were resolved by consensus between the extractors through discussion and examination of the study in question.

To facilitate interpretations of the comparisons in the present study, we adopted the same strategy used previously [6] to create ten categories of treatment conditions (See Supplementary Materials A for detailed descriptions): Standard of Care (SOC), enhanced Standard of Care (eSOC), Telephone (TELE), Short Message Service (SMS), Behavioral Skills Training or Medication Adherence Training (BST/MAT), Multimedia (MULTI), Cognitive Behavioral Therapy (CBT), Supporter (SUPP), Incentives (INCENT), and Device Reminders (DEV).

Dependent Measures

The primary outcome was based on the percentage of blood samples submitted by participants in the control (usually SOC) and treatment groups that contained an undetectable viral load (as judged by criteria set within each study) at the primary measurement. The primary measurement was the assessment of viral load in blood samples that followed the start of an intervention and coincided most closely with the end of the intervention. If there was at least one assessment of viral load in blood samples during the intervention, then the assessment that occurred closest to the end of the intervention was treated as the primary measurement. If no assessments occurred during the intervention, then the first assessment following completion of the intervention was treated as the primary measurement.

Data Analysis

The data extracted from the studies included the number of participants assigned to each group, the number in each group who provided a blood sample that was assessed at the primary timepoint, and the number of those assessed blood samples from each group that had an undetectable HIV viral load as judged by the criteria identified in each study. We calculated the percentage of samples with an undetectable viral load using two methods of treating missing samples: with imputation and without imputation. To conduct these analyses, each study must have reported the number of participants assigned to each group, the number of participants from each group who provided blood samples that were assessed at a timepoint following the start of an intervention, and the number of those assessed blood samples that contained an undetectable viral load. In the analysis with imputation, the missing-detectable analysis, missing samples were treated as though they contained a detectable viral load. In the analysis without imputation, the missing-missing analysis, missing samples were ignored and the percentage of participants with an undetectable viral load for each group was based on the number of participants assessed in each group.

After extracting data from the studies included in this review, it became clear that the procedures included within the ten intervention-type categories varied widely [6]. For example, within the INCENT category, some studies arranged incentives to be delivered at regular intervals if viral suppression criteria were met [9], whereas other studies delivered incentives irregularly if participants engaged in aspects of the treatment that were not tied directly to viral suppression, such as attending meetings with a peer supporter [10]. Procedural variability of this kind obscures individual treatment effects in an analysis that aggregates effects of all studies within a treatment category. Therefore, it was determined that comparisons of treatment effects should occur at the level of the individual intervention used in each study rather than across studies that would fall into the same treatment category. The present analysis does not include a statistical comparison of treatment effects across treatment categories.

Statistical Analysis

A logistic regression model was used to examine treatment effects of interventions within each intervention and across interventions. This analysis yielded results that indicate whether treatments used in each study produced significant differences compared to the control group. The magnitude of effect was expressed using risk ratios (RR) with 95% confidence intervals (95%CI), and p-values in relation to an α of 0.05. Stata Statistical Software: Release 15 (College Station, TX; StataCorp LLC) and R software 4.0.0 were used to perform these analyses.

We hypothesized that, because recent findings indicate that undetectable levels of HIV viral load are not transmittable to others even through unsafe sex (undetectable = untransmittable; U = U) and highlight the importance of promoting undetectable HIV viral loads [1, 3, 11], studies conducted more recently may be more likely to measure HIV viral suppression and may be more effective in promoting undetectable viral loads. Therefore, in addition to the statistical analysis to assess the effects of treatment in each study, we used a mixed-effects meta-regression model to analyze whether the effectiveness of studies at promoting undetectable HIV viral load changed as a function of publication year. We also evaluated publication bias using Egger’s regression test checking for funnel plot asymmetry.

Results

Figure 1 shows a flowchart of the studies and interventions included in the main analysis. Of the 677 studies identified in our search, 574 were excluded in the screening process because they did not meet criteria for inclusion. The studies were excluded because they did not include a randomized controlled trial (n = 298), they did not include an intervention to promote ART adherence or viral suppression (n = 231), they did not include a SOC or eSOC control group (n = 8), or they did not include the information required for the missing-detectable and missing-missing analyses (n = 37). The remaining 117 interventions were from 103 studies and were reviewed in-depth for data extraction.

Fig. 1
figure 1

Study selection

Following in-depth review of the remaining articles, 51 interventions were excluded because they did not include a randomized controlled trial (n = 11), they did not include an intervention to promote ART adherence or viral suppression (n = 2), they did not include a SOC or eSOC control group (n = 1), or they did not include the information required for the missing-detectable and missing-missing analyses (n = 37; see Supplementary Materials B for more information). Information from 66 interventions were from 58 studies [9, 10, 12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67] and were extracted and assessed using the Cochrane Collaboration Tool (results reported in Supplementary Materials C and D). Most interventions had a high risk of bias from blinding—which resulted naturally from the additional supports provided to participants in the intervention groups—and a low risk of bias from sequence generation, allocation concealment, selective reporting, and other sources of bias. Some interventions (n = 15) assessed less than 70% of the enrolled participants in the primary measurement, which put them at high risk of bias from incomplete data [55,56,57,58,59,60,61,62,63,64,65,66,67]. These 15 interventions were from 13 studies and were excluded from the main analysis because of this risk. The remaining 51 interventions were from 45 studies [9, 10, 12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54] and were included in the main analysis.

Table 1 and Fig. 2 show the effectiveness of analyzed interventions in suppressing viral load to the undetectable threshold identified in each study in the main analysis, as judged by logistic regression using the missing-detectable analysis (see Supplementary Materials E and F for results for interventions included in the main analysis as judged by the missing-missing analysis and results from both analyses for interventions excluded due to high risk of bias from incomplete data). Overall, the results presented in Table 1 and Fig. 2 show that most studies were not effective in promoting undetectable viral loads. According to logistic regression, only five interventions (10%) [9, 10, 34, 38, 44] significantly increased undetectable viral loads (p < 0.05) as judged by the missing-detectable analysis. These five interventions were also judged significant at the p < 0.05 level by the missing-missing analysis, lending some support to the effects of these treatments. These five interventions included eSOC [44], INCENT [9], SMS [34], SUPP [38], and a combination of INCENT and SUPP [10]. See Supplementary Materials G for information about the number of interventions of each type evaluated in the present analysis and significant results of the interventions as judged by logistic regression using missing-detectable and missing-missing analyses.

Table 1 Effects of interventions included in the main analysis (n = 51)
Fig. 2
figure 2

Effects of interventions in the main analysis (n = 51). The number of participants assigned to the compared study groups are shown next to the first author and year. Interventions are grouped by whether interventions produced increases in undetectable viral loads (UDLs) that were significant at the p < .05 level. Full statistical analyses are provided for each study in Table 1. Filled circles represent the percentage of blood samples collected at the primary measurement of the study that contained an undetectable HIV viral load, as defined in the study, for participants in the treatment group; unfilled circles show the percentage of samples with an undetectable viral load for the control group. In this analysis, missing samples were imputed as having a detectable viral load. Asterisks in the left portion of the figure show treatment effects that were judged significant in the analysis without imputation of missing samples. The difference in the percentage undetectable between study groups (Treatment–Control) for each intervention is shown to the right of the figure. Superscript numbers (1, 2, or 3) designate the first, second, or third intervention evaluated within a single study and correspond with the superscript numbers in Table 1

According to the logistic regression model analysis conducted to compare overall effects of treatment across interventions in the main analysis, participants in a treatment group were more likely to achieve an undetectable viral load than participants in a control group using the missing-detectable analysis (RR[95%CI]: 1.08[1.04, 1.13], Z = 3.745, p < 0.05) and the missing-missing analysis (RR[95%CI]: 1.07[1.03, 1.11], p < 0.05). However, it is important to note that this overall effect is influenced by results of individual interventions, of which few produced significant increases in the number of blood samples with an undetectable viral load. See Supplementary Materials H–S for Forest Plots and Funnel Plots that show results of the interventions, evaluations of publication bias, and evaluations of participant attrition for interventions in the main analysis and for all evaluated interventions.

The evaluation of the relation between study publication date and treatment effects was not significant (slope coefficient[SE]: − 0.0005[0.005], p = 0.920). This indicates that, to date, there is no relation between intervention publication date and treatment effects.

The interventions included in the main analysis differed based on the type of treatment that was compared against the Standard of Care control group, the criterion used to determine whether HIV viral load was undetectable, and the country in which the intervention took place (see Table 1 and Supplementary Materials G). The intervention type used most frequently as the sole intervention was supporter (SUPP; n = 19), but across interventions, each type of treatment was used, and some were used in combination. The criterion used to judge whether blood samples contained a detectable or undetectable HIV viral load also varied across studies, but the most frequent criterion used was 400 copies/mL (n = 19; see Supplementary Materials G). Finally, the interventions were conducted in 15 different countries, but most took place in the USA (n = 30).

Discussion

The suppression of HIV viral load below detectable thresholds is key to ending the HIV/AIDS epidemic, but few interventions published to date have effectively increased the percentage of participants who achieve undetectable viral loads. The present review includes the results of interventions published through November 22, 2019 and compares intervention effects with and without imputation of missing samples using a logistic regression model. Results of the statistical analysis revealed that five interventions were associated with significant increases in the percentage of blood samples submitted with an undetectable HIV viral load as judged by both methods of analysis. The 51 evaluated interventions were associated with an overall increase in percentage of blood samples with an undetectable viral load relative to the SOC or eSOC control groups. There was no association between the publication date and the effectiveness of the interventions, suggesting that, at present, studies published more recently were not more effective in suppressing HIV viral load.

A feature of the present systematic review and meta-analysis that distinguishes it from prior reviews is that the focus is solely on the outcome measure of ART medication adherence: Undetectable viral loads. As such, findings from our review may differ from existing reviews. For example, the Centers for Disease Control and Prevention’s (CDC) Compendium of Evidence-Based Interventions and Best Practices for HIV Prevention included 23 studies that earned ratings as “Good” or “Best” evidence-based interventions for promoting medication adherence [68]. Interventions from six of the studies that received ratings as “Good” or “Best” evidence in the CDC’s compendium were included in the main analysis of the present review. Five studies were categorized as “Good” evidence [12, 20, 24, 28, 31] and one was categorized as “Best” evidence [9]. Although these studies received high ratings from the CDC for promoting medication adherence, only one intervention [9] produced a significant increase in undetectable viral loads as judged by both methods of analysis in the present review; three were judged significant by only the missing-missing analysis [9, 20, 28]. The poor correspondence between interventions that produced significant increases in undetectable viral load and ratings from the CDC on medication adherence might result from the different focuses of measuring increases in medication adherence versus the biological outcome of medication adherence (i.e., viral suppression). These results suggest that recommendations based on medication adherence alone may not lead to effective HIV viral suppression. In the future, the CDC might consider developing a method of evaluating interventions that is focused specifically on HIV viral suppression.

The present analysis has limitations. Comparisons of interventions are complicated by multiple factors, including the socio-demographic characteristics of the participants in the interventions, the context in which the intervention was implemented (e.g., as a procedure to promote achievement of an undetectable viral load vs maintenance of an undetectable viral load), the criteria used to determine whether HIV viral load was “undetectable,” and the specific procedures used to promote HIV viral suppression across interventions within the same category. The last two limitations warrant additional consideration and will be expanded upon below.

Across interventions, “undetectable” viral load was defined in various ways (see Supplementary Materials G for more information) and, across studies, participants had different histories of prior achievement of undetectable viral load. For example, participants in Cunningham (2018) had all achieved undetectable HIV viral loads (measured as < 75 copies/mL) while they were incarcerated. In this study, the aim of the intervention could be interpreted as the maintenance of undetectable HIV viral loads rather than the initial achievement of undetectable viral loads. This aim contrasts slightly with most of the reviewed interventions, which aimed to promote the initial achievement of undetectable viral loads among individuals with uncontrolled HIV viral loads. The present review was not aimed to address these complications. It simply reports treatment effects by comparing the number of samples that met the undetectable viral load criteria used in each study at the timepoint that aligned most closely with the end of each intervention. Because criteria for determining undetectable viral loads, participants, and participant history varied across studies (e.g., Barnabus 2016 used < 49 copies/mL whereas Chewana 2017 used < 1000), comparisons of treatment effects across interventions are complicated; However, the fact that the same measure (i.e., the percentage of participants with undetectable viral loads) and the same viral suppression criteria were applied to the control and treatment groups within each study ensures that the within-intervention comparisons are sound. Nevertheless, readers should be cautioned about making interpretations based on across-intervention comparisons in this review.

Another limitation is that there was wide procedural variability within the intervention-type categories. These variations affected our decision to conduct a meta-analysis similar to the one conducted in the prior review and meta-analysis [6]. A thorough description of these variations is outside of the scope of the present review, however future research may consider evaluating aspects that differed between interventions of the same type that did and did not produce significant increases in the percentage of blood samples that contained an undetectable viral load, as doing so could lead to improved interventions.

Conclusions

Only five of 51 evaluated interventions (10%) produced significant improvements in undetectable viral loads. Because no treatment category consistently produced significant increases in undetectable viral loads, we cannot identify any specific category of treatments as being effective. Individuals interested in effective treatments will need to examine procedures used in specific interventions. Efforts aimed at ending the HIV/AIDS epidemic should focus on interventions identified in this review that produced significant increases in undetectable viral loads.