Background

Mesenchymal stromal cells represent a subset of adult stem-like cells which have been extensively investigated for therapeutic potential in a variety of disease states. Mesenchymal stromal cells have been isolated from numerous tissue sources including adipose tissue, umbilical cord, and synovial membrane [1], and they can be derived from induced pluripotent stem cells [2]. Their multilineage differentiation potential, in vitro expansive capacity, and ability for immunomodulation has led to nearly 500 clinical trials [3], including studies of septic shock [4], acute respiratory distress syndrome [5], and ischemic heart disease [6]. In particular, mesenchymal stromal cells have received approval as a therapy to treat graft versus host disease in New Zealand, Canada, and Japan [7, 8]. Cell therapies may be limited by potentially serious adverse events of cell embolus and tumor formation [9]. Thus, there is immense interest in harnessing the therapeutic effects of mesenchymal stromal cells in ways that avoid potential harms.

Mesenchymal stromal cells’ effects are largely mediated by paracrine mechanisms, and so mesenchymal stromal cell-derived extracellular vesicles may represent a safer cell-free alternative to whole cell injections. Extracellular vesicles contain biologically active factors and signaling molecules to facilitate intercellular communication. With opportunities for diminished manufacturing and storage costs for extracellular vesicles, they can also be produced as a more readily available “off-the-shelf” product, as extracellular vesicles are more stable than whole cells when cryogenically frozen. Research into the development of cell-free therapies has focused primarily on two types of extracellular vesicles, medium-large vesicles known as microvesicles, and small extracellular vesicles, which include exosomes.

Microvesicles and exosomes are subsets of extracellular vesicles that range from 150–1000 and 30–150 nm in diameter, respectively [10] (Fig. 1). Both microvesicles and exosomes are prolifically produced by mesenchymal stromal cells [11] and are believed to carry bioactive cargo, such as microRNA, transcription factors, growth factors, and other regulatory proteins that help mediate their potentially efficacious properties [12]. Extracellular vesicles may serve as ideal vesicles for encapsulating therapeutic products, protect these products from degradation, and aid their delivery to specific target tissues. The opportunity to introduce or manipulate the expression of contents inside extracellular vesicles (e.g., through overexpression of protective microRNAs) has created an intriguing new domain of regenerative medicine.

Fig. 1
figure 1

Overview of extracellular vesicles derived from mesenchymal stromal cells. Size, biogenesis, protein markers, and vesicular cargo for both exosomes and microvesicles are described. Potential mechanisms by which extracellular vesicles communicate with target cells include receptor-mediated interactions, cellular endocytosis, direct fusion with cellular membrane, and indirect interactions such as immune modulation, reactive oxygen species production, and coagulation. MVB, multivesicular body; TSG101, tumor susceptibility gene 101; ROS, reactive oxygen species

The systematic review stemming from this protocol will synthesize current evidence on mesenchymal stromal cell-derived microvesicles and exosomes as therapeutic options in preclinical models of disease, inflammation, or injury. A scoping review previously published by our group systematically reviewed preclinical data on extracellular vesicles up to 2013 and found that sixteen of seventeen preclinical studies demonstrated therapeutic benefits associated with administration of mesenchymal stromal cell-derived extracellular vesicles [13]. Subsequently, the terminology surrounding extracellular vesicle research has matured, and interest in studying microvesicles and exosomes has increased exponentially, necessitating a re-evaluation of this body of evidence.

Research objectives

We will review in vivo preclinical studies evaluating mesenchymal stromal cell-derived extracellular vesicles as an intervention for any animal model of disease or injury. Our primary objective will assess the methodology being utilized in these animal studies including (1) interventional characteristics, (2) methods of extracellular vesicle enrichment and characterization, and (3) experimental design. Given the expected heterogeneity of methods used (e.g., cell sources, isolation techniques) and outcomes assessed across various disease domains, a synthesis of these issues is needed to provide context for any subsequent meta-analysis. For our secondary objective, studies will be categorized by disease domains with subsequent meta-analyses of study outcomes to determine the therapeutic efficacy of mesenchymal stromal cell-derived extracellular vesicles in different conditions. Results of this analysis will help guide future preclinical studies of extracellular vesicles and inform whether possible human participant studies are feasible.

Methods and design

Review team

The team members for this systematic review encompass researchers across different scientific disciplines. The team has expertise in systematic reviews (DAF, MML, JM, DSA), basic science studies investigating novel cell therapies (AT, MML, DJS, DSA), and translational cell therapy trials (DJS, DAF) [6, 14, 15]. As well, DB participated in the development of the recently published Minimal Information for Studies of Extracellular Vesicles 2018 (MISEV2018) position statement and provides considerable experience in the field of extracellular vesicle research [16]. The student leads for this project (AT and MS) have experience in both basic science and clinical epidemiology and will be the two primary reviewers for article selection and data extraction.

Protocol

This systematic review protocol is reported in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analysis Protocol (PRIMSA-P) reporting guidelines (Additional file 1) [17]. A summary of the protocol has been registered at the International Prospective Registry of Systematic Reviews (PROSPERO CRD42019123918).

Eligibility criteria

Population

Inclusion—in vivo preclinical animal models of disease, organ injury, tumor growth, or altered immune response. Exclusion—ex vivo, in vitro, and invertebrate animal models will be excluded.

Intervention

Inclusion— mesenchymal stromal cell-derived extracellular vesicles including microvesicles (150–1000 nm) and exosomes (30–150 nm). Extracellular vesicles can be derived from xenogeneic, syngeneic, or allogeneic mesenchymal stromal cells from any tissue source. All routes of intervention administration will be considered, including direct tissue, intravenous, and intra-arterial injections. Experiments involving pre-treatment of mesenchymal stromal cells, co-treatment, and/or genetic manipulation (e.g., over- or under-expression of genes) before extracellular vesicle isolation will be classified as “modifications” for subgroup analysis. Exclusion—studies where extracellular vesicles are not directly administered to animals as a therapy (e.g., used as a pre-treatment for other interventions) or investigated only for their biodistribution will be excluded.

Comparators

Studies with any comparator (e.g., vehicle control, placebo, mesenchymal stromal cells, and fibroblast microvesicles) will be considered.

Outcomes

Inclusion—studies that provide information regarding intervention characteristics, methodologic approaches and experimental design parameters utilized in studies will be included. For the purposes of a potential quantitative synthesis and meta-analysis, we will extract each study’s primary outcome. If a primary outcome has not been outlined in the study, expert opinion or consensus statements will be sought to determine which in vivo outcome may be most clinically relevant for diseases treated.

Study design

Inclusion—interventional in vivo studies with a comparator-control will be included. Studies may be randomized, pseudo-randomized, or non-randomized. Exclusion—unpublished gray literature, abstracts, review articles, editorials, and letters will be excluded. Single arm interventional studies will also be excluded.

Data sources

We will search Ovid MEDLINE®, Ovid MEDLINE® In-Process & Other Non-Indexed Citations, Embase Classic + Embase, and BIOSIS from inception to present day. In addition, hand searches of the bibliographies of included articles and relevant reviews will be performed.

Search strategy

The search strategies (Additional file 2) to be used for this review will be generated by a health sciences librarian (RS) with experience designing systematic literature searches. A second information specialist with no association to the project will also review the strategy using Peer Review of Electronic Search Strategies (PRESS) before the final search procedure is executed [18, 19]. The search strategy will utilize both calculated vocabulary and MeSH terms (e.g., mesenchymal stem cells, mesenchymal stromal cells, extracellular vesicles, exosomes, and microvesicles), acronyms (e.g., MSCs, microvesicles, and extracellular vesicles), and MeSH terms with alterations as required per database. Our previous search strategy published in 2015 was updated to reflect evolving terminology in the extracellular vesicle field [13]. Preclinical filters will also be applied to improve search efficiency [20,21,22]. No search restrictions will be created for language or publication date.

Study records

Data management

Search results will be uploaded to Distiller Systematic Review Software (DistillerSR, Evidence Partners, Ottawa, Canada). DistillerSR is an online software that allows for improved transparency, reproducibility, and accessibility for literature review.

Selection process

Two reviewers (AT, MS) will independently screen titles and abstracts from search results using the predefined inclusion criteria outlined above. A calibration test involving sets of 10 studies will be performed (AT, MS) to refine the screening question and ensure high inter-rater correlation (kappa > 0.8), prior to formally commencing the screening process. For all titles that appear to meet the inclusion criteria or where there is any uncertainty, we will obtain the full-text article. Two reviewers (AT, MS) will assess the eligibility of full-text articles. A calibration test involving a set of 10 studies will be performed (AT, MS) to ensure high inter-rater correlation. After every calibration test, the entire review team will be consulted to resolve any issues concerning full-text inclusion. After refining the full-text screening criteria, a formal screening process (AT, MS) will be commenced. Any disagreement will be resolved through discussion with a third-party member (MML, DSA). Reasons for study exclusion at this level will be recorded. There will be no restrictions on language. Articles of non-English text will be translated by native speakers at the Ottawa Methods Centre.

Data collection process

A standardized data extraction form will be designed by the review team and uploaded to DistillerSR. Information will be extracted independently and in duplicate from each eligible study (AT, MS). Calibration exercises of 10 studies will be conducted, and the review team will be consulted to refine the data extraction form. After commencing formal data abstraction, any disagreements will be first discussed between two independent reviewers (AT, MS). If no resolution can be made, a third-party team member will be consulted (MML).

Data items

Broad categories of data items include methods of vesicle separation and characterization (Table 1), intervention details (e.g., tissue type of mesenchymal stromal cell, dose, route of administration, and timing of administration) (Table 2), study characteristics (e.g., study design, population of species, model of disease) (Table 3), and preclinical outcomes.

Table 1 Isolating and characterizing mesenchymal stem cell-derived extracellular vesicles
Table 2 Interventional traits and dosage regimen of the extracellular vesicle therapy
Table 3 Disease domains, preclinical models, and randomization

Risk of bias assessment

For each included study, risk of bias assessments will be carried out by two independent reviewers (AT, MS) using the Systematic Review Centre for Laboratory animal Experimentation (SYRCLE) risk of bias tool [23]. The SYRCLE tool was adapted from the Cochrane Risk of Bias Tool to assess the methodologic quality using criteria specific to animal studies. Items in this tool include assessments for selection bias (sequence generation, baseline characteristics, allocation concealment), performance bias (random housing, blinding), detection bias (random and blinded outcome assessment), attrition bias (completeness of outcome data), and reporting bias. Each parameter of bias for each included study will be scored as having a low, high, or unclear risk of bias. Any disagreements between the two reviewers will be resolved through discussion with a third-party member (MML).

Data analysis

Before a meta-analysis will be deemed appropriate to execute, the heterogeneity of included studies will be assessed. A senior author (MML, DA, DB) will review the study populations and study characteristics to judge the presence of methodologic heterogeneity. If sufficient homogeneity across studies exists, a meta-analysis will be considered appropriate to carry out. Continuous endpoints will be pooled using standardized mean differences with an inverse variance random effects method [24, 25]. Dichotomous outcomes (e.g., mortality) from each study will be pooled and described as risk ratios with 95% confidence intervals using the DerSimonian and Laird random-effects method (Comprehensive Meta-Analysis v3.1) [26]. Statistical heterogeneity of effect sizes will be assessed using the Cochrane I2 statistic test [27]. Thresholds for interpretation of I2 are as follows: 0–40% (low heterogeneity), 30–60% (moderate heterogeneity), 50–90% (substantial heterogeneity), and 75–100% (considerable heterogeneity) [27]. If there is considerable heterogeneity (75–100%), sources of heterogeneity will be explored through subgroup and sensitivity analyses.

Subgroup analyses

Planned subgroup analyses include intervention characteristics, such as tissue source of mesenchymal stromal cells (e.g., bone marrow, umbilical cord, and adipose), size of extracellular vesicles (e.g., small extracellular vesicles from 30–150 nm, or medium/large extracellular vesicles from 150–1000 nm), method of extracellular vesicle isolation (e.g., ultracentrifugation, tangential flow filtration, and size exclusion chromatography), and methods of vesicle characterization (e.g., Western Blot, electron microscopy, and flow cytometry). Additionally, studies will be subgrouped by disease domain for preclinical outcome assessment.

Meta-biases assessment

Evaluation for publication bias and selective reporting bias will be conducted using a funnel plot, generated by Comprehensive Meta-Analyst, and Egger’s regression test [28, 29].

Knowledge dissemination

Understanding that there has been a markedly heightened interest to evaluate the therapeutic potential of mesenchymal stromal cell-derived extracellular vesicles, this review will first assess the feasibility of conducting a meta-analysis based on the final number of included preclinical studies. If a feasible number of articles are included, our team will summarize the methodology data and conduct a meta-analysis of outcomes. If the included number of articles is too large to feasibly perform multiple analyses in a single publication, a systematic review of the overall methodology being used for in vivo extracellular vesicle studies will be first published. Subsequently, analyses for each disease domain with more details (e.g., risk of bias and outcome measures) will be published as separate manuscripts in peer-reviewed journals. Finally, findings will be disseminated through international conferences with basic and translational scientists to help guide future preclinical and clinical study design of extracellular vesicle therapy.

Amendments

If any amendments to this protocol are necessary, the date and specific changes to the protocol will be documented on PROSPERO with rationales as to why the alterations were required.

Discussion

Our systematic review intends to identify and summarize preclinical studies investigating the therapeutic efficacy of both small and large extracellular vesicles derived from mesenchymal stromal cells. This work updates our previous study that captured studies through 2013 [13]. Although only 17 studies were included in the previous systematic review, the therapeutic potential for this novel cell-free therapy was evident as many disease and injury states had been investigated. Since then, many more research groups around the world have begun to study extracellular vesicles, and they are now well-recognized to carry biologically active factors that mediate the therapeutic effects of mesenchymal stromal cells. Extracellular vesicles represent a novel investigative direction within regenerative medicine.

We anticipate that this comprehensive synthesis and meta-analysis of preclinical studies assessing the beneficial or adverse effects of mesenchymal stromal cell-derived extracellular vesicles will generate valuable data to help guide future preclinical study design. More importantly, these findings can help provide considerations of future translational human participant studies.