Abstract
When used with other proven strategies for prevention of HIV-1 acquisition, oral and topical preexposure prophylaxis (PrEP) has been shown to be effective in multiple randomized, placebo-controlled clinical trials throughout the world. Preexposure prophylaxis trials have included over 20,000 men and women at risk for HIV infection through sexual or intravenous exposure. A consistent finding is that drug exposure is essential for PrEP efficacy. In PrEP users with breakthrough infection, selection of drug-resistant virus is a possible outcome, presenting a unique sequence of events and outcomes compared with therapeutic use of antiretroviral drugs. Study findings have indicated that drug resistance selected by PrEP occurs rarely, except in cases where PrEP is initiated in very early infection, prior to seroconversion, and detectable only with nucleic acid tests. In this review, we discuss the factors associated with PrEP which may contribute to drug resistance and summarize the frequency and characteristics of HIV-1 drug resistance reported to date from global clinical trials. A theoretical framework of the causes and consequences of drug resistance in PrEP is considered as a basis of the real-life outcomes and challenges in implementing PrEP.
Access provided by CONRICYT-eBooks. Download reference work entry PDF
Similar content being viewed by others
Keywords
Introduction
The concept of chemoprophylaxis, or using antimicrobial agents in uninfected humans to prevent infection, is a widely used and successful strategy for prevention of infection with endemic microbes such as malaria (Breman and Brandling-Bennett 2011). One of the great successes in HIV prevention is providing antiretroviral therapy (ART ) perinatally to infected pregnant women to block mother-to-child transmission (MTCT) (Connor et al. 1994). Now with the availability of a large number of potent antiviral drugs, coupled with reduced toxicities and convenient dosing formulations (Gandhi and Gandhi 2014), the benefits of using oral or topical ART as preexposure prophylaxis (PrEP ) may outweigh risks of prolonged drug exposure in healthy, uninfected people. As a result, using preexposure prophylaxis (PrEP) to prevent HIV infection in at-risk individuals has moved from the conceptual realm (Youle and Wainberg 2003a, b) to phase II/III safety and efficacy trials and now to initial implementation in demonstration projects and clinical practice.
However, as was revealed in early single-dose treatment strategies for MTCT prevention, suboptimal exposure to ART can result in PrEP failure and selection for drug-resistant variants in the infected infants (Arrive et al. 2007; Eshleman and Jackson 2002; Eshleman et al. 2001; Johnson et al. 2005; Micek et al. 2010). Due to the incidence and nature of drug resistance in this setting, concern over the use of PrEP for sexual transmission has been raised (Cohen and Baden 2012; Hurt et al. 2011; Liu et al. 2006). While the clinical impact and treatment options of viruses harboring drug-resistance mutations acquired by suboptimal ART initiated after established infection are well known and may be relevant to breakthrough infections during PrEP, the potential impact of PrEP-selected drug resistance at the population level is less clear. The benefits (infections averted) versus risks (drug resistance) with PrEP use have been modeled with significantly differing outcomes and interpretations based on input variables and assumptions (Abbas et al. 2011; Baggaley et al. 2011; Dolling et al. 2012). In addition, in antiretroviral drug-experienced populations, the prevalence of circulating strains with drug resistance to PrEP agent(s) may impair the efficacy of PrEP. Now, with accumulating results from initial global randomized PrEP efficacy trials, the benefits and risks of PrEP use for HIV acquisition can undergo evidence-based assessment, allowing an in-depth understanding of the nature and frequency of PrEP-associated drug resistance, a critical step toward optimizing its use as a prevention strategy in all at-risk populations.
PrEP Efficacy for Prevention of HIV Sexual Transmission: Summary of Results from Randomized Controlled Trials
There are now multiple reports from randomized double-blind placebo-controlled clinical trials spanning four continents and over 20,000 individuals testing the safety and efficacy of oral and topical PrEP coupled with other proven prevention strategies [reviewed in (Baeten and Celum 2013; Celum and Baeten 2012)]. Topical PrEP as 1 % tenofovir (TVF) vaginal gel used pre- and postcoitally was first shown to be effective in preventing HIV transmission by sexual exposure in African women (Abdool Karim et al. 2010). Daily oral dosing of tenofovir disoproxil fumarate (TDF, the oral prodrug of TFV) used alone or co-formulated with emtricitabine (FTC) proved efficacious in preventing sexual transmission in men who have sex with men and transgender women (MSM/TGW) from South America, South Africa, Thailand, and the United States in the iPrEx study (Grant et al. 2010), in serodiscordant African male and female partners in the Partners PrEP study (Baeten et al. 2012), and in African men and women in the TDF2 study (Thigpen et al. 2012). Finally, the Bangkok tenofovir study demonstrated that daily oral TDF dosing was associated with a 48.9 % reduction in HIV infections in injecting drug users randomized to taking TDF compared with placebo (Choopanya et al. 2013). A consistent finding from these studies showing a reduction in HIV-1 acquisition ranging from 42 % to 73 % in participants randomized to the PrEP arms is that PrEP efficacy is directly associated with drug exposure. In nested, case-control studies within each of these trials, the overall relative infection risk reduction further increased to over 90 % in participants with measurable plasma or cellular drug levels.
Not all PrEP trials with similar designs have shown reduced infections in the active drug arms when compared to placebo. The FEM-PrEP study, which enrolled African women, was stopped early due to futility where a similar infection frequency occurred in participants randomized to oral FTC/TDF and placebo (Van Damme et al. 2012). And in the multi-arm VOICE trial, a statistically indistinguishable number of infections occurred in women randomized to either 1 % TFV vaginal gel, daily oral TDF or FTC/TDF, or placebo (Marrazzo et al. 2013). The basis of differences in efficacy outcomes between these two studies and those demonstrating protection against HIV acquisition is an active area on investigation. One key factor is product adherence, determined directly by antiretroviral drug level measurements in the blood plasma and cells. Overall, women randomized to the active arms in the FEM-PrEP and VOICE trials had insufficient product use to measure efficacy. While it is evident that distinct PrEP modalities will need to be tailored to particular at-risk populations and their circumstances contributing to HIV-1 transmission and that tenofovir-based PrEP regimens can effectively block HIV acquisition when used regularly and in combination with other prevention methods, a setting of incomplete adherence coupled with exposure risk potentially increases the chances of infection and selection for PrEP-associated resistance.
Selection and Expansion of Drug-Resistant HIV in Response to Suboptimal Antiretroviral Therapy
There are now nearly three decades of experience with therapeutic antiretroviral agents designed to target multiple stages in the HIV-1 life cycle (Arts and Hazuda 2012). Regular use of combination therapy can provide durable virologic suppression within an individual to levels below that detected by standard clinical viral load assays and can have a favorable impact in lowering the community viral load or the aggregate level within a defined geographical region (Das et al. 2010; Montaner et al. 2010). But although the available arsenal of antiretroviral drugs shows continued improvement in potency, pharmacodynamics, formulation, and toxicities, the generation and selection of drug-resistant variants continue to be a barrier to durable suppression, especially in developing countries with limited regimen choice and lack of regular virologic monitoring (Hamers et al. 2013; Sigaloff et al. 2011).
In individuals with existing infection and ongoing viral replication, sustained use of non-suppressive therapy or intermittent use of suppressive therapy will quickly promote selection and expansion of drug-resistant variants. Even during subsequent virologic suppression following a regimen change, drug-resistant variants remain archived in target cells as proviral DNA, potentially limiting future therapeutic options. Distinct outcomes of ART use following established infection within an individual are shown schematically in Fig. 1a–c to highlight the dynamic makeup of quasispecies that may arise during treatment failure. The same ART used as PrEP can also select for drug-resistant variants when breakthrough infections occur or when PrEP is initiated with unrecognized infection (Fig. 1d–f), underscoring the importance of careful virologic monitoring before and during PrEP use. The outcomes schematized in Fig. 1 have been observed in many of the PrEP trials where regular serologic testing was performed.
The development of resistance to any particular drug is driven by the high error rate in HIV-1 reverse transcriptase. With a mutation frequency of approximately 4 × 10−5 per target base per replication cycle and a nearly 10 kb genome size, there is roughly one mutation produced per replication cycle (Mansky 1996; Mansky and Temin 1995). Coupled with an estimated 1010 virions produced per day (Ho et al. 1995; Wei et al. 1995; Perelson et al. 1996), the fixation of a new, randomly generated mutation under targeted selection can be rapid, as notably illustrated by M184V selection after suboptimal lamivudine monotherapy (Wainberg et al. 1995; Larder et al. 1995; Schuurman et al. 1995). While mutations conferring reduced susceptibility to ART often have impaired fitness in the absence of selection compared with wild-type, drug-susceptible strains, continued replication under selection can further select for additional compensatory mutations conferring fitness gains in the host’s viral population (Condra et al. 1995; Cote et al. 2001; Gatanaga et al. 2002; Molla et al. 1996; Zhang et al. 1997), altered tropism, and virulence (Coffin 1995; Kuritzkes 1996; Milich et al. 1993; Nijhuis et al. 2001) as shown in Fig. 1c. Following transmission of monophyletic or a limited number of polyphyletic founder viruses (Keele et al. 2008), the rapid expansion, high mutation and recombination frequencies (Onafuwa-Nuga and Telesnitsky 2009), multiple host, and therapeutic selection pressures can collectively promote the creation of complex viral quasispecies within an individual. Sensitive diagnostic assays that can quantify drug-resistant variants present at a minor proportion of the population within an individual have revealed mutations conferring drug resistance in ART-naïve individuals at residual levels (≈1 %) within the viral quasispecies (Johnson et al. 2007, 2008; Liu et al. 2011; Metzner et al. 2011; Simen et al. 2009; Havlir et al. 1996). Preexisting low-level or minor variant drug resistance in treatment-naïve individuals can affect treatment outcomes, especially with particular NRTI- and NNRTI-selected mutations (Simen et al. 2009; Johnson et al. 2008; Havlir et al. 1996; Metzner et al. 2009; Li et al. 2011).
An alternative source of drug-resistant HIV-1 is that transmitted from a treatment-experienced partner, also known as primary resistance. Individual mutations conferring drug resistance can be detected in upwards of 20 % of the circulating strains in geographical areas that have access to ARV, changing with regional exposure levels and predominate treatment regimens over time (Chaix et al. 2009; Grant et al. 2002; Hamers et al. 2011; Jain et al. 2010; Little et al. 2002; Yerly et al. 2007; Wheeler et al. 2010). Such levels of circulating resistance within a population have driven national treatment guidelines to include baseline, pretreatment genotyping. How transmitted resistance might impact PrEP efficacy is an area of interest, especially where ARV included in PrEP regimens are also a component of first- and second-line therapies. Interestingly, numerous outcome predictions based on modeling the impact of the spread of drug resistance result in disparate scenarios [reviewed in (Baggaley et al. 2011)].
When assessing the role of PrEP agents in contributing to the selection and expansion of drug-resistant viruses, it is important to consider drug resistance in the context of drug exposure within the infection window to aid in differentiating transmitted from acquired (drug-selected) resistance. While transmitted resistance can be unequivocally confirmed by phylogenetic mapping of the source and index virus within the partnership, the presence of drug-resistance mutations associated with any particular PrEP regimen in the absence of drug exposure is highly likely to originate from transmitted strain(s) and not selected de novo by PrEP. As the frequency, nature, and origin (e.g., whether PrEP selected or transmitted) of drug-resistance findings accumulate from randomized clinical trials and demonstration projects, the impact of circulating resistance on PrEP efficacy can be directly assessed.
Detecting Drug Resistance in PrEP Studies
HIV-1 drug resistance in clinical practice is primarily measured and interpreted through two distinct but complementary approaches: (1) genotype testing, which includes direct sequencing of the HIV-1 drug target reading frames, usually pol, and (2) phenotypic susceptibility testing, which involves determining the concentration of a given compound necessary to inhibit viral growth in vitro [reviewed in (Tang and Shafer 2012)]. Both approaches measure the bulk population of viruses within an individual and, as a result, are insensitive to viral species carrying drug-resistance mutations below a given threshold (e.g., ≈20 % for population genotyping). As a research tool, multiple methods have been used to detect and quantify minor variant drug resistance within a population but below that detected by clinical tests, including allele-specific PCR-based assays that differentiate single-base changes conferring resistance, probe-based ligation assays, clonal sequencing, and highly parallel ultradeep sequencing [reviewed in (Gianella and Richman 2010)]. Ideally, genotype, phenotype, and ultrasensitive detection methods would be used together for monitoring drug resistance in PrEP failures as each approach can provide unique insights into the extent and nature of drug resistance. However, due to the high clinical diagnostic value, global accessibility, standardization of interpretation, and relatively low cost, drug-resistance genotyping is the primary diagnostic tool for drug-resistance monitoring in PrEP clinical trials (Table 1).
Designing PrEP Regimens to Minimize Drug Resistance
When designing effective regimens for PrEP, a number of factors are taken into consideration (Anderson et al. 2011; Derdelinckx et al. 2006; Fernandez-Montero et al. 2012; Garcia-Lerma et al. 2008; Amico 2012). Ideally, these include selecting compounds that target pre-integration events in the viral life cycle, demonstrate high antiviral activity and extended half-life in target tissues, exhibit synergies in activity and mutation impact if used in combination, and posses a high genetic barrier to resistance, which is the combined components that contribute to the generation of the specified resistance mutation and maintenance of the viral species in the population (Luber 2005). For these reasons, coupled with relatively favorable toxicity profiles, flexible formulations, efficacy in preventing transmission in nonhuman primate models under conditions that mimic sexual transmission in humans (Garcia-Lerma et al. 2008; Van Rompay et al. 2006; Subbarao et al. 2006; Radzio et al. 2012), and extensive history of therapeutic use, two nucleoside/nucleotide reverse transcriptase inhibitors (NRTI) have been used in the completed clinical trials to date. Tenofovir (TFV), formulated as either a 1 % topical vaginal gel or as the orally available prodrug tenofovir disoproxil fumarate (TDF), has been administered as PrEP alone or together with emtricitabine (FTC). The co-formulated FTC/TDF oral pill TRUVADA™ is cleared by the US Food and Drug Administration for use as prevention in uninfected adults at high risk of HIV acquisition through sexual exposure. Both compounds act at pre-integration steps by terminating the nascent DNA chains in RNA-dependent and DNA-dependent DNA synthesis during the viral life cycle (Arts and Hazuda 2012).
The viral mutations associated with reduced susceptibility to TFV/TDF and related drugs are K65R and K70E (Margot et al. 2006a; Miller et al. 1999; Wainberg et al. 1999; Gallant et al. 2004) and to FTC are M184V and M184I (M184V/I)(Margot et al. 2006b), where the first amino acid listed for a given codon in RT represents the wild-type, drug-susceptible form and the second represents the mutant, drug-resistant form (Fig. 2). Additional RT mutations A62V and S68G associated with TDF exposure are considered compensatory mutations that improve viral replication capacity of poorly fit K65R mutants (Margot et al. 2006b; Svarovskaia et al. 2008). Although K65R and M184V/I are generated by a single-base substitution and thus may arise frequently in the course of HIV replication, viral species with these mutations demonstrate significantly reduced replication capacity and fitness in vitro and in vivo in the absence of selection (Yerly et al. 2007; Wheeler et al. 2010; Margot et al. 2006a; Petrella and Wainberg 2002; Miller et al. 2002; White et al. 2002; Frankel et al. 2007) thus conferring a relatively high barrier to resistance. Additionally, the presence of M184V causes increased sensitivity to TDF (Miller et al. 1999; Whitcomb et al. 2003; Deval et al. 2004), a synergy that is often taken advantage of in clinical practice (Wainberg and Gotte 2000). Finally, these ARVs provide a strong pharmacological barrier for sexual transmission. Emtricitabine concentrations are significantly higher in vaginal secretions compared to that measured in blood after single oral dosing, while TDF-DP (the active intracellular form) is up to 100× higher in the colorectal mucosa compared with vaginal and cervical tissues following a single dose (Anderson et al. 2011; Kwara et al. 2008; Patterson et al. 2011).
Genotypic, Phenotypic, and Minor Variant Drug Resistance in PrEP Trials
To date there are six completed phase III, randomized, placebo-controlled PrEP trials reporting drug-resistance results. The overall study design for monitoring HIV-1 infection status and drug resistance was similar across studies. HIV status at screening, entry, and post-randomization visits was assessed by serologic monitoring. Blood plasma, cells, or other tissue samples were typically collected and archived for retrospective measurements of HIV-1 nucleic acid and/or drug levels and, when collected at sufficient frequency, were used to establish the infection window and drug exposure levels. Upon receiving a positive rapid test result post-randomization, study drug was discontinued and confirmatory serotesting and/or RNA testing performed. In the iPrEx, Partners PrEP and TDF2 studies, participants with unrecognized, acute infection (RNA positive, seronegative) at entry were retrospectively identified. In confirmed seropositives, blood plasma collected at or proximal to the initial seropositive visit was tested for drug resistance by standard genotyping. In some studies, additional diagnostics were performed including drug-resistance phenotype and allele-specific PCR and/or deep sequencing for ultrasensitive detection of minor variant drug resistance (Table 1). In the iPrEx and FEM-PrEP studies, longitudinal sampling and testing was performed to monitor drug resistance over time in participants with FTC/TDF-associated resistance at seroconversion and randomized to the active drug arm (Grant et al. in press; Liegler et al. 2014).
The drug-resistance mutations and frequencies reported from the CAPRISA 004 (Abdool Karim et al. 2010; Wei et al. 2014), the iPrEx (Grant et al. 2010; Liegler et al. 2014), Partners PrEP (Baeten et al. 2012; Lehman et al. in press), TDF2 (Thigpen et al. 2012), FEM-PrEP (Van Damme et al. 2012; Grant et al. in press), and the Bangkok tenofovir (Choopanya et al. 2013) trials are summarized in Table 2, categorized by participants’ timing of infection (pre-randomization vs incident) and randomization arm. Overall, in participants with incident (on-study post-randomization) infection, the frequency of TFV/TDF- or FTC-associated drug resistance was low, including those randomized to the PrEP arms with measurable drug levels near the infection window. Of the 142 seroconverters with incident infections and in the PrEP arms of the CAPRISA 004, iPrEx, Partners PrEP, TDF2, and Bangkok tenofovir studies, none showed genotypic or phenotypic drug resistance associated with the PrEP regimens used at or near the seroconversion visit. In contrast, four of 33 (12 %) women on the oral FTC/TDF arm in the FEM-PrEP study showed genotypic and phenotypic resistance to FTC (M184V/I) at the seroconversion visit (Van Damme et al. 2012; Grant et al. in press). Tenofovir resistance was not observed, and two showed phenotypic hypersusceptibility to this drug. Two of these participants, 1 with M184I and 1 with M184V, had moderate- and high-study drug levels at seroconversion, respectively, implicating selection by the PrEP regimen. However, seroconversion occurred within 4 (M184V) and 8 (M184I) weeks of study entry, leaving open the possibility that infection was incubating prior to PrEP initiation – a situation with increased frequencies of emergent drug resistance.
In PrEP studies reporting ultrasensitive testing for minor variant drug resistance in seroconverters performed by AS-PCR and/or deep sequencing, background mutation frequencies (that observed in WT viruses in the absence of drug selection) were established for each individual assay and were typically ≤1 %. While minor variant drug resistance was observed above background levels from seroconverters in both placebo and active drug arms, examples seen in subjects randomized to the PrEP arms and therefore potentially PrEP selected are highlighted here.
In CAPRISA 004 (Wei et al. 2014) and TDF2 (Thigpen et al. 2012), AS-PCR measurements in blood plasma and vaginal swabs (CAPRISA 004) near the seroconversion visit showed no evidence of minor variant resistance to TFV. Seven of 27 (26 %) women in the CAPRISA 004 TFV gel arm had measurable TFV in vaginal fluids. However the majority had insignificant or undetectable TFV levels indicating the absence of drug selection pressure.
In the iPrEx and FEM-PrEP studies, minor variant DR in blood plasma from participants randomized to the FTC/TDF arms was observed, however infrequent and at very low proportions within the population measured by AS-PCR and 454 deep sequencing (Grant et al. in press; Liegler et al. 2011). In iPrEx, one seroconverter’s virus had M184I detected at 0.53 % of the plasma viral population by AS-PCR but below background by 454 sequencing This subject had detectable but low drug levels in blood plasma and cells, opening the possibility of selection by PrEP but without significant outgrowth within the population. Similarly, one FEM-PrEP seroconverter showed M184I at 0.66 % of the population but at background levels by 454 sequencing. Study drug was not detected in this woman near the seroconversion window, suggesting spurious detection of drug-resistance mutations near the background cutoff level, rather than PrEP-selected resistance.
Blood plasma samples at the seroconversion and proximal follow-up visits from subjects in the Partners PrEP study (oral FTC/TDF, TDF alone, placebo) were analyzed for minor variant drug resistance by 454 deep sequencing (Lehman et al. in press). Of those in the oral FTC/TDF arm, a virus from 1 subject showed M184V at 16 % of the viral population (SC visit), decreasing to 1.7 % 4 weeks later, without detectable study drug. Viruses from two other participants with detectable drug showed minor variant resistance mutations: 1 with M184V at 1.9 % from the post-seroconversion visit and another with M184V (at 7.7 %), M184I (at 5.4 %), and K65R (at 1.2 %) in the seroconversion visit sample. This rare example of K65R in incident infections may reflect the significantly impaired fitness or replication capacity conferred by K65R, especially when in combination with M184V (Miller et al. 1999, 2002; Margot et al. 2006b; Petrella and Wainberg 2002; White et al. 2002; Frankel et al. 2007), and/or insufficient drug exposure, as PrEP was discontinued at the first evidence of seroconversion. In the oral TDF arm, 1 of 30 participants showed M184I at a low level (2.5 %), a mutation that is not selected by TDF. This mutation was detected as a minor variant in the placebo arm of Partners PrEP, FEM-PrEP, and iPrEx participants, possibly maintained at low levels by APOBEC3G-induced G-to-A hypermutation (Neogi et al. 2013).
Development of Elevated Drug-Resistance Frequencies When Initiating PrEP During Acute, Seronegative Infection
A striking finding from these studies is the relatively high frequency of PrEP-associated drug-resistance mutations seen in subjects who inadvertently initiated PrEP with unrecognized (RNA positive, seronegative) infection at randomization when compared to that seen in study participants with incident infections. Of the 13 participants with unknown acute infection initiating PrEP at randomization, five in the combined iPrEx, Partners PrEP, and TDF2 studies showed genotypic resistance to FTC (M184V) or TDF (K65R) at their initial seroconversion visit. In four of these participants, the virus at enrollment did not carry these resistance mutations, favoring selection by PrEP regimens during the initial 4 weeks of use. The additional subject from the iPrEx study with M184I had a low viral load at entry that was insufficient for a genotype (48 copies/mL), so it cannot be unequivocally determined whether the mutation conferring resistance to FTC was transmitted or selected. Of note, one subject from the TDF2 study developed multidrug resistance in a stepwise manner over time where M184V was detected at the first visit after study entry, followed by additional TDF-associated mutations K65R and A62V at the second visit 6 months later. Although enrollment of participants with unrecognized acute infection who went on to develop PrEP-selected resistance was rare among all in PrEP studies, the relative frequency of generating resistance in this subset of participants was high (5/13, 38 %) and possibly avoidable with HIV-1 RNA testing prior to PrEP initiation and delaying PrEP in those with symptoms consistent with acute viral infections.
In the absence of continued selection by PrEP, the FTC-associated resistance in blood plasma virions declines to residual levels over time, through outgrowth of the more highly fit WT variant generated through back mutation, or presents at very low levels under PrEP selection. Participants in both the iPrEx and FEM-PrEP trials with FTC resistance mutations M184V/I were followed longitudinally after stopping PrEP for up to nearly 18 months, and blood plasma samples were assayed for the relative proportion of coexisting drug-resistant and susceptible variants by sensitive allele-specific PCR and deep sequencing assays (Grant et al. in press; Liegler et al. 2012, 2014) and unpublished data). In all cases analyzed from both the placebo and control arms (n = 7), the drug-resistant variants proportionally decreased from 95 % to 100 % at seroconversion to residual levels (<0.5 %) in the blood plasma over time. Although most demonstrated a more prolonged time course for complete reversion (median 9 months), one participant showed complete reversion and overgrowth at the RT codon 184 from Ile to Met within 4 weeks of discontinuing study drug. These results are consistent with the time course of transmitted M184V reversion over time in ARV-naïve subjects (Liegler et al. 2011; Jain et al. 2011) and highlight the value of baseline resistance testing as early in infection as possible.
Distinct Patterns of Drug Resistance in PrEP: What Is Driving It?
The frequencies and nature of PrEP-associated drug resistance fall into distinct patterns that are likely outcomes of multiple diverse factors including the temporal sequela of exposure to drug and infectious virus, the pharmacodynamics of the individual compounds and formulations in diverse anatomical target sites under changing physiologic states, and the genetic barrier to resistance specific for each PrEP regimen and other factors. The interplay between the drug activity, viral resistance barriers, and how these factors might affect the relative risk of infection and frequency of resistance is schematized in Fig. 3. The distinct scenarios diagramed in panels A to D reflect various outcomes noted with use of chemoprophylaxis and HIV infection. Panel A represents effective PrEP where infection occurs only with very low drug exposure and where the overall genetic barrier to resistance is sufficiently high to prevent its emergence. This scenario reflects WT infection seen in the majority of seroconverters in PrEP studies with low or undetectable drug levels. Panels B and C may reflect the infrequent cases of resistance seen in PrEP where local concentrations of the drug may be insufficient to block infection and/or create a sufficient barrier to resistance. Distinct tissue-specific pharmacodynamics for FTC and TFV may uncouple the combined synergy in target tissues such as the cervicovaginal or colorectal mucosa (Thompson et al. 2013), leading to the observed predominance of FTC-selected mutations M184V/I in FTC/TDF oral PrEP. Finally, panel D represents settings where drug resistance is high, such as that observed with limited dosing monotherapy for prevention of MTCT. A deeper understanding of the factors that influence ARV activity and emergence of resistance in target tissues of viral entry and dissemination is critical for designing more effective PrEP regimens, formulations, and dosing strategies.
Progress Toward Next-Generation PrEP
Favorable results from initial randomized placebo-controlled PrEP efficacy trials and the US Food and Drug Administration’s first label approval for an antiretroviral compound to be used as chemoprophylaxis for prevention of sexual HIV-1 transmission have led to demonstration projects worldwide where PrEP efficacy is tested in open-label, clinical settings. Ongoing demonstration projects include daily oral FTC/TDF PrEP [reviewed in (Baeten et al. 2013)], allowing direct comparisons to the PrEP efficacy trials. Comprehensive monitoring for drug resistance and drug exposure in seroconverters from these studies should yield additional insights into the overall impact of PrEP use and drug resistance. There is, however, room for overall improvement in strategies for optimizing PrEP and monitoring virologic, behavioral, toxicity, and other outcomes.
Additional compounds and formulations with improved penetration in target tissues, innovative dosing and delivery strategies, and additional viral targets are needed to further increase PrEP efficacy with expanded use while maintaining low toxicity and high genetic resistance barriers [reviewed in (Abraham and Gulick 2012)]. The ÉCLAIR study is a phase IIa safety and tolerability study evaluating the injectable long-acting investigational integrase inhibitor GSK-744 LA in uninfected men. Promising results were reported using a long-lasting nanoparticle formulation of the HIV-1 integrase inhibitor dolutegravir, with successful protection against rectal SHIV challenges (Andrews et al. 2013). Other long-lasting nanoparticle ARV formulations intended for periodic injections and targeting multiple HIV-1 pol enzymes are in various stages of investigation in small animal models measuring pharmacokinetic profiles in target tissues and cells (Puligujja et al. 2013; Martin et al. 2013).
There are multiple ongoing trials testing oral tenofovir-based PrEP dosing strategies and drug combinations to reduce pill burden and minimize overall drug exposure but maintain effective exposure for situational risk. Intermittent PrEP (pre- and postexposure) use has been shown to be efficacious in reducing SHIV infection through rectal exposure in macaques (Garcia-Lerma et al. 2010). In this study of multiple dosing strategies, none of the breakthrough infections showed evidence of drug resistance. The ANRS IPERGAY study includes MSM and “on demand” oral FTC/TDF, taken at the time of sexual exposure. The HIV Prevention Trials Network (HPTN) 067 study ADAPT, enrolling MSM/TGW and women who have sex with men (WSM), is a behavioral study with a 1:1:1 randomization of three arms using oral FTC/TDF with either daily dosing, time-driven dosing, or event-driven dosing. The NEXT-PrEP (HPTN 069/ACTG 5305) study is a four-arm phase II safety and tolerability trial investigating combinations of oral daily FTC, TDF, and the HIV-1 entry inhibitor maraviroc (MVC). Drug concentration measurements in all study participants and drug resistance testing in seroconverters in these various studies will aid in determining the oral dosing formulation and timing needed to prevent infection while minimizing exposure for reduced toxicity. This relationship was estimated using drug level measurements in blood and levels of protection from HIV acquisition in the iPrEx trial combined with defined intermittent and daily dosing strategies in the STRAND study (Anderson et al. 2012). While this serves as an important basis for determining the most effective and least harmful dosing strategy, further evaluations within these and other trials are necessary to further optimize the next-generation PrEP for diverse user needs.
Conclusions
The proven efficacy of PrEP in preventing HIV acquisition in clinical trial settings is one of the celebrated successes in HIV prevention research and brings cautious optimism for continued success with more widespread use. One clear message from PrEP trials is that successful PrEP requires drug uptake. The risk of infection increases with suboptimal PrEP use, as does the potential drug resistance. Despite a range of efficacies and adherence levels reported, drug resistance selected by PrEP was largely seen in subjects initiating PrEP during acute, unrecognized infection. Monitoring for acute viral symptomatology and the presence of HIV nucleic acids may be useful diagnostic tools at PrEP initiation. Additionally, using combination regimens and drug formulations with increased potency at PrEP initiation may minimize this occurrence. In incident infections, the occurrence of drug resistance, even as minor variants, was infrequent in participants with measurable drug levels indicating exposure. However, there are limitations in interpreting these findings – in all PrEP trials, study drug was discontinued at the first evidence of infection, thus limiting drug exposure that may generate resistance with longer duration. Guidelines for PrEP use in clinical practice indicate monitoring for infection with PrEP at a minimum of every 12 weeks (Centers for Disease Control and Prevention 2011, 2012), less frequent than the monthly monitoring in clinical trials.
Continued rigorous assessment of drug resistance in breakthrough infections while using PrEP is necessary with expanded use in clinical settings and as other compounds, formulations, dosing strategies, and novel drugs are tested and implemented.
References
Abbas UL, Hood G, Wetzel AW, Mellors JW (2011) Factors influencing the emergence and spread of HIV drug resistance arising from rollout of antiretroviral pre-exposure prophylaxis (PrEP). PLoS One 6:e18165
Abdool Karim Q et al (2010) Effectiveness and safety of tenofovir gel, an antiretroviral microbicide, for the prevention of HIV infection in women. Science 329:1168
Abraham BK, Gulick R (2012) Next-generation oral preexposure prophylaxis: beyond tenofovir. Curr Opin HIV AIDS 7:600
Amico KR (2012) Adherence to preexposure chemoprophylaxis: the behavioral bridge from efficacy to effectiveness. Curr Opin HIV AIDS 7:542
Anderson PL et al (2011) Pharmacological considerations for tenofovir and emtricitabine to prevent HIV infection. J Antimicrob Chemother 66:240
Anderson PL et al (2012) Emtricitabine-tenofovir concentrations and pre-exposure prophylaxis efficacy in men who have sex with men. Sci Transl Med 4:151ra125
Andrews CGA, Russell-Lodrigue K, Moss L, Mohri H, Spreen W, ChengMayer HZ, Markowitz M, Ho D (2013) Paper presented at the 20th conference on retroviruses and opportunistic infections, Atlanta
Arrive E et al (2007) Prevalence of resistance to nevirapine in mothers and children after single-dose exposure to prevent vertical transmission of HIV-1: a meta-analysis. Int J Epidemiol 36:1009
Arts EJ, Hazuda DJ (2012) HIV-1 antiretroviral drug therapy. Cold Spring Harbor Perspect Med 2:a007161
Baeten J, Celum C (2013) Systemic and topical drugs for the prevention of HIV infection: antiretroviral pre-exposure prophylaxis. Annu Rev Med 64:219
Baeten JM et al (2012) Antiretroviral prophylaxis for HIV prevention in heterosexual men and women. N Engl J Med 367:399
Baeten JM, Haberer JE, Liu AY, Sista N (2013) Preexposure prophylaxis for HIV prevention: where have we been and where are we going? J Acquir Immune Def Syndr 63(Suppl 2):S122
Baggaley RF, Powers KA, Boily MC (2011) What do mathematical models tell us about the emergence and spread of drug-resistant HIV? Curr Opin HIV AIDS 6:131
Breman JG, Brandling-Bennett AD (2011) The challenge of malaria eradication in the twenty-first century: research linked to operations is the key. Vaccine 29(Suppl 4):D97
Centers for Disease Control and Prevention (2011) MMWR 60:65–68
Centers for Disease Control and Prevention (2012) MMWR 61:586–589
Celum C, Baeten JM (2012) Tenofovir-based pre-exposure prophylaxis for HIV prevention: evolving evidence. Curr Opin Infect Dis 25:51
Chaix ML et al (2009) Stable frequency of HIV-1 transmitted drug resistance in patients at the time of primary infection over 1996–2006 in France. Aids 23:717
Choopanya K et al (2013) Antiretroviral prophylaxis for HIV infection in injecting drug users in Bangkok, Thailand (the Bangkok Tenofovir Study): a randomised, double-blind, placebo-controlled phase 3 trial. Lancet 381:2083
Coffin JM (1995) HIV population dynamics in vivo: implications for genetic variation, pathogenesis, and therapy. Science 267:483
Cohen MS, Baden LR (2012) Preexposure prophylaxis for HIV–where do we go from here? N Engl J Med 367:459
Condra JH et al (1995) In vivo emergence of HIV-1 variants resistant to multiple protease inhibitors. Nature 374:569
Connor EM et al (1994) Reduction of maternal-infant transmission of human immunodeficiency virus type 1 with zidovudine treatment. Pediatric AIDS Clinical Trials Group Protocol 076 Study Group. N Engl J Med 331:1173
Cote HC, Brumme ZL, Harrigan PR (2001) Human immunodeficiency virus type 1 protease cleavage site mutations associated with protease inhibitor cross-resistance selected by indinavir, ritonavir, and/or saquinavir. J Virol 75:589
Das M et al (2010) Decreases in community viral load are accompanied by reductions in new HIV infections in San Francisco. PLoS One 5:e11068
Derdelinckx I et al (2006) Criteria for drugs used in pre-exposure prophylaxis trials against HIV infection. PLoS Med 3:e454
Deval J et al (2004) Mechanistic basis for reduced viral and enzymatic fitness of HIV-1 reverse transcriptase containing both K65R and M184V mutations. J Biol Chem 279:509
Dolling D et al (2012) Evaluating the extent of potential resistance to pre-exposure prophylaxis within the UK HIV-1-infectious population of men who have sex with men. HIV Med 13:309
Eshleman SH, Jackson JB (2002) Nevirapine resistance after single dose prophylaxis. AIDS Rev 4:59
Eshleman SH et al (2001) Selection and fading of resistance mutations in women and infants receiving nevirapine to prevent HIV-1 vertical transmission (HIVNET 012). Aids 15:1951
Fernandez-Montero JV, Barreiro P, Del Romero J, Soriano V (2012) Antiretroviral drugs for pre-exposure prophylaxis of HIV infection. AIDS Rev 14:54
Frankel FA, Invernizzi CF, Oliveira M, Wainberg MA (2007) Diminished efficiency of HIV-1 reverse transcriptase containing the K65R and M184V drug resistance mutations. Aids 21:665
Gallant JE et al (2004) Efficacy and safety of tenofovir DF vs stavudine in combination therapy in antiretroviral-naive patients: a 3-year randomized trial. JAMA 292:191
Gandhi M, Gandhi RT (2014) Single-pill combination regimens for treatment of HIV-1 infection. N Engl J Med 371:248
Garcia-Lerma JG et al (2008) Prevention of rectal SHIV transmission in macaques by daily or intermittent prophylaxis with emtricitabine and tenofovir. PLoS Med 5:e28
Garcia-Lerma JG et al (2010) Intermittent prophylaxis with oral truvada protects macaques from rectal SHIV infection. Sci Transl Med 2:14ra4
Gatanaga H et al (2002) Amino acid substitutions in Gag protein at non-cleavage sites are indispensable for the development of a high multitude of HIV-1 resistance against protease inhibitors. J Biol Chem 277:5952
Gianella S, Richman DD (2010) Minority variants of drug-resistant HIV. J Infect Dis 202:657
Grant RM et al (2002) Time trends in primary HIV-1 drug resistance among recently infected persons. JAMA 288:181
Grant RM et al (2010) Preexposure chemoprophylaxis for HIV prevention in men who have sex with men. N Engl J Med 363:2587
Grant RM et al (in press) Drug resistance and plasma viral RNA level after ineffective use of oral pre-exposure prophylaxis in women. Aids
Hamers RL et al (2011) HIV-1 drug resistance in antiretroviral-naive individuals in sub-Saharan Africa after rollout of antiretroviral therapy: a multicentre observational study. Lancet Infect Dis 11:750
Hamers RL, Sigaloff KC, Kityo C, Mugyenyi P, de Wit TF (2013) Emerging HIV-1 drug resistance after roll-out of antiretroviral therapy in sub-Saharan Africa. Curr Opin HIV AIDS 8:19
Havlir DV, Eastman S, Gamst A, Richman DD (1996) Nevirapine-resistant human immunodeficiency virus: kinetics of replication and estimated prevalence in untreated patients. J Virol 70:7894
Ho DD et al (1995) Rapid turnover of plasma virions and CD4 lymphocytes in HIV-1 infection. Nature 373:123
Hurt CB, Eron JJ Jr, Cohen MS (2011) Pre-exposure prophylaxis and antiretroviral resistance: HIV prevention at a cost? Clin Infect Dis 53:1265
Jain V et al (2010) Transmitted drug resistance in persons with acute/early HIV-1 in San Francisco, 2002–2009. PLoS One 5:e15510
Jain V et al (2011) Differential persistence of transmitted HIV-1 drug resistance mutation classes. J Infect Dis 203:1174
Johnson JA et al (2005) Emergence of drug-resistant HIV-1 after intrapartum administration of single-dose nevirapine is substantially underestimated. J Infect Dis 192:16
Johnson JA et al (2007) Simple PCR assays improve the sensitivity of HIV-1 subtype B drug resistance testing and allow linking of resistance mutations. PLoS One 2:e638
Johnson JA et al (2008) Minority HIV-1 drug resistance mutations are present in antiretroviral treatment-naive populations and associate with reduced treatment efficacy. PLoS Med 5:e158
Keele BF et al (2008) Identification and characterization of transmitted and early founder virus envelopes in primary HIV-1 infection. Proc Natl Acad Sci U S A 105:7552
Kuritzkes DR (1996) Clinical significance of drug resistance in HIV-1 infection. Aids 10(Suppl 5):S27
Kwara A et al (2008) Antiretroviral drug concentrations and HIV RNA in the genital tract of HIV-infected women receiving long-term highly active antiretroviral therapy. Clin Infect Dis 46:719
Larder BA, Kemp SD, Harrigan PR (1995) Potential mechanism for sustained antiretroviral efficacy of AZT-3TC combination therapy. Science 269:696
Lehman DA et al (in press) Risk of drug resistance among persons acquiring HIV within a randomized clinical trial of single or dual-agent pre-exposure prophylaxis. J Infect Dis
Li JZ et al (2011) Low-frequency HIV-1 drug resistance mutations and risk of NNRTI-based antiretroviral treatment failure: a systematic review and pooled analysis. JAMA 305:1327
Liegler T, Abdel-Mohsen M, Jain V, Schmidt T, Spotts G, Hartogensis W, Grant R, Hecht F (2011) Paper presented at the 18th conference on retroviruses and opportunistic infections, Boston
Liegler T et al (2012) Drug resistance among HIV-1 seroconverters in the FEM-PrEP Study. Antiviral therapy 17(Suppl 1):37
Liegler T et al (2014) HIV-1 drug resistance in the iPrEx preexposure prophylaxis trial. J Infect Dis 210:1217
Little SJ et al (2002) Antiretroviral-drug resistance among patients recently infected with HIV. New Engl J Med 347:385
Liu AY, Grant RM, Buchbinder SP (2006) Preexposure prophylaxis for HIV: unproven promise and potential pitfalls. JAMA 296:863
Liu J et al (2011) Analysis of low-frequency mutations associated with drug resistance to raltegravir before antiretroviral treatment. Antimicrob Agents Chemother 55:1114
Luber AD (2005) Genetic barriers to resistance and impact on clinical response. Med Gen Med 7:69
Mansky LM (1996) Forward mutation rate of human immunodeficiency virus type 1 in a T lymphoid cell line. AIDS Res Hum Retroviruses 12:307
Mansky LM, Temin HM (1995) Lower in vivo mutation rate of human immunodeficiency virus type 1 than that predicted from the fidelity of purified reverse transcriptase. J Virol 69:5087
Margot NA, Lu B, Cheng A, Miller MD (2006a) Resistance development over 144 weeks in treatment-naive patients receiving tenofovir disoproxil fumarate or stavudine with lamivudine and efavirenz in Study 903. HIV Med 7:442
Margot NA, Waters JM, Miller MD (2006b) In vitro human immunodeficiency virus type 1 resistance selections with combinations of tenofovir and emtricitabine or abacavir and lamivudine. Antimicrob Agents Chemother 50:4087
Marrazzo J et al (2013) Paper presented at the 20th Conference on Retroviruses and Opportunistic Infections, Atlanta
Martin PLN, McDonald T, Giardiello M, Roberts P, Curley P, Smith D, Siccardi M, Rannard S, Owen A (2013) Paper presented at the 20th conference on retroviruses and opportunistic Infections, Atlanta
Metzner KJ et al (2009) Minority quasispecies of drug-resistant HIV-1 that lead to early therapy failure in treatment-naive and -adherent patients. Clin Infect Dis 48:239
Metzner KJ et al (2011) Prevalence of key resistance mutations K65R, K103N, and M184V as minority HIV-1 variants in chronically HIV-1 infected, treatment-naive patients. J Clin Virol 50:156
Micek MA et al (2010) Nevirapine resistance by timing of HIV type 1 infection in infants treated with single-dose nevirapine. Clin Infect Dis 50:1405
Milich L, Margolin B, Swanstrom R (1993) V3 loop of the human immunodeficiency virus type 1 Env protein: interpreting sequence variability. J Virol 67:5623
Miller MD, Anton KE, Mulato AS, Lamy PD, Cherrington JM (1999) Human immunodeficiency virus type 1 expressing the lamivudine-associated M184V mutation in reverse transcriptase shows increased susceptibility to adefovir and decreased replication capability in vitro. J Infect Dis 179:92
Miller V, Stark T, Loeliger AE, Lange JM (2002) The impact of the M184V substitution in HIV-1 reverse transcriptase on treatment response. HIV Med 3:135
Molla A et al (1996) Ordered accumulation of mutations in HIV protease confers resistance to ritonavir. Nat Med 2:760
Montaner JS et al (2010) Association of highly active antiretroviral therapy coverage, population viral load, and yearly new HIV diagnoses in British Columbia, Canada: a population-based study. Lancet 376:532
Neogi U et al (2013) Human APOBEC3G-mediated hypermutation is associated with antiretroviral therapy failure in HIV-1 subtype C-infected individuals. J Int AIDS Soc 16:18472
Nijhuis M, Deeks S, Boucher C (2001) Implications of antiretroviral resistance on viral fitness. Curr Opin Infect Dis 14:23
Onafuwa-Nuga A, Telesnitsky A (2009) The remarkable frequency of human immunodeficiency virus type 1 genetic recombination. Microbiol Mol Biol Rev 73:451
Patterson KB et al (2011) Penetration of tenofovir and emtricitabine in mucosal tissues: implications for prevention of HIV-1 transmission. Sci Transl Med 3:112re4
Perelson AS, Neumann AU, Markowitz M, Leonard JM, Ho DD (1996) HIV-1 dynamics in vivo: virion clearance rate, infected cell life-span, and viral generation time. Science 271:1582
Petrella M, Wainberg MA (2002) Might the M184V substitution in HIV-1 RT confer clinical benefit? AIDS Rev 4:224
Puligujja PGH, Kendrick L, Smith N, Balkundi S, Roy R, Veerubhotla R, McMillan J, Liu X (2013) Paper presented at the 20th conference on retroviruses and opportunistic infections, Atlanta
Radzio J et al (2012) Prevention of vaginal SHIV transmission in macaques by a coitally-dependent Truvada regimen. PLoS One 7:e50632
Schuurman R et al (1995) Rapid changes in human immunodeficiency virus type 1 RNA load and appearance of drug-resistant virus populations in persons treated with lamivudine (3TC). J Infect Dis 171:1411
Sigaloff KC, Calis JC, Geelen SP, van Vugt M, de Wit TF (2011) HIV-1-resistance-associated mutations after failure of first-line antiretroviral treatment among children in resource-poor regions: a systematic review. Lancet Infect Dis 11:769
Simen BB et al (2009) Low-abundance drug-resistant viral variants in chronically HIV-infected, antiretroviral treatment-naive patients significantly impact treatment outcomes. J Infect Dis 199:693
Subbarao S et al (2006) Chemoprophylaxis with tenofovir disoproxil fumarate provided partial protection against infection with simian human immunodeficiency virus in macaques given multiple virus challenges. J Infect Dis 194:904
Svarovskaia ES et al (2008) The A62V and S68G mutations in HIV-1 reverse transcriptase partially restore the replication defect associated with the K65R mutation. J Acquir Immune Defic Syndr 48:428
Tang MW, Shafer RW (2012) HIV-1 antiretroviral resistance: scientific principles and clinical applications. Drugs 72:e1
Thigpen MC et al (2012) Antiretroviral preexposure prophylaxis for heterosexual HIV transmission in Botswana. N Engl J Med 367:423
Thompson CG, Cohen MS, Kashuba AD (2013) Antiretroviral pharmacology in mucosal tissues. J Acquir Immune Defic Syndr 63(Suppl 2):S240
Van Damme L et al (2012) Preexposure prophylaxis for HIV infection among African women. N Engl J Med 367:411
Van Rompay KK et al (2006) Evaluation of oral tenofovir disoproxil fumarate and topical tenofovir GS-7340 to protect infant macaques against repeated oral challenges with virulent simian immunodeficiency virus. J Acquir Immune Defic Syndr 43:6
Wainberg MA, Gotte M (2000) Should the M184V mutation in RT be maintained as a component of HIV treatment strategies? Aids 14:S33
Wainberg MA et al (1995) Development of HIV-1 resistance to (−)2'-deoxy-3'-thiacytidine in patients with AIDS or advanced AIDS-related complex. Aids 9:351
Wainberg MA et al (1999) In vitro selection and characterization of HIV-1 with reduced susceptibility to PMPA. Antivir Ther 4:87
Wei X et al (1995) Viral dynamics in human immunodeficiency virus type 1 infection. Nature 373:117
Wei X et al (2014) Sensitive tenofovir resistance screening of HIV-1 from the genital and blood compartments of women with breakthrough infections in the CAPRISA 004 tenofovir gel trial. J Infect Dis 209:1916
Wheeler WH et al (2010) Prevalence of transmitted drug resistance associated mutations and HIV-1 subtypes in new HIV-1 diagnoses, US-2006. Aids 24:1203
Whitcomb JM, Parkin NT, Chappey C, Hellmann NS, Petropoulos CJ (2003) Broad nucleoside reverse-transcriptase inhibitor cross-resistance in human immunodeficiency virus type 1 clinical isolates. J Infect Dis 188:992
White KL et al (2002) Molecular mechanisms of resistance to human immunodeficiency virus type 1 with reverse transcriptase mutations K65R and K65R + M184V and their effects on enzyme function and viral replication capacity. Antimicrob Agents Chemother 46:3437
Yerly S et al (2007) Transmission of HIV-1 drug resistance in Switzerland: a 10-year molecular epidemiology survey. Aids 21:2223
Youle M, Wainberg MA (2003a) Pre-exposure chemoprophylaxis (PREP) as an HIV prevention strategy. J Int Assoc Physicians AIDS Care 2:102
Youle M, Wainberg MA (2003b) Could chemoprophylaxis be used as an HIV prevention strategy while we wait for an effective vaccine? Aids 17:937
Zhang YM et al (1997) Drug resistance during indinavir therapy is caused by mutations in the protease gene and in its Gag substrate cleavage sites. J Virol 71:6662
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer Science+Business Media New York
About this entry
Cite this entry
Liegler, T., Grant, R. (2017). HIV-1 Drug Resistance in Pre-exposure Prophylaxis Trials. In: Berghuis, A., Matlashewski, G., Wainberg, M., Sheppard, D. (eds) Handbook of Antimicrobial Resistance. Springer, New York, NY. https://doi.org/10.1007/978-1-4939-0694-9_24
Download citation
DOI: https://doi.org/10.1007/978-1-4939-0694-9_24
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4939-0693-2
Online ISBN: 978-1-4939-0694-9
eBook Packages: Biomedical and Life SciencesReference Module Biomedical and Life Sciences