Abstract
Antimicrobial resistance (AMR) is a serious threat to global public health, necessitating rapid and precise diagnostic tools. The prevalence of novel antibiotic resistance genes (ARGs) has increased due to microbial sequencing, resulting in the need to extract vital information from vast amounts of data. Although many AMR prediction tools exist, only a few are accurate and scalable. We examined 20 widely used AMR prediction tools and chose 4 web-based tools for antimicrobial resistance surveillance over standalone software due to their easy accessibility, portability, and centralized data management, eliminating the need for complex installation and maintenance. CGE (Center for Genomic Epidemiology) provides bioinformatics tools and promotes open data sharing. At the same time, CARD (Comprehensive Antibiotic Resistance Database) is a valuable resource for antibiotic resistance gene information, collectively contributing to our understanding and management of antibiotic resistance. We highlighted web-based AMR prediction tools and performed a case study using the Pseudomonas aeruginosa complete plasmid sequence (CPS) to identify strengths and weaknesses in the system. Our study explored four web-based antibiotic resistance gene prediction tools: ResFinder, KmerResistance, ResFinderFG, and RGI. ResFinder excelled at finding acquired antimicrobial resistance genes as well as maintaining a database up to date. KmerResistance identified resistance genes using k-mer analysis. esFinderFG offered a unique perspective, excelling in detecting a broad range of resistant phenotypes, due to its inclusion of sequences discovered through functional metagenomics. RGI was versatile in detecting a wide range of resistance genes and provided extensive resistance mechanism information. Researchers must understand the capabilities and trade-offs of these tools to make well-informed choices for efficient resistance gene identification and surveillance as the antibiotic resistance landscape evolves.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
The world's most severe public health concern is the rapid growth of resistant superbugs, as well as the ongoing battle between bactericidal drugs and extensively drug-resistant bacteria. Antibiotic overuse in both medical and agricultural contexts has aided in the development of multidrug-resistant (MDR) bacteria [1]. Unfortunately, many antibiotics lack specificity, indiscriminately killing pathogenic and non-pathogenic bacteria and leading to antibiotic-associated illnesses [2]. The innovation of new antibiotics to treat resistant infections is a major goal in healthcare, yet no obvious answer to this problem has been identified. These antibiotic-resistant genes allow bacteria to resist antibiotics in a variety of ways, including the activation of efflux pumps, antibiotic molecule degradation by enzymes, and chemical alteration (ribosome and cell wall) to protect antibiotic-targeted cellular targets. These resistance mechanisms, when combined, represent a danger to the therapeutic effectiveness of antibiotics [3,4,5]. The World Health Organization (WHO) lists AMR as one of the top ten global public health threats to humanity [6, 7]. Drug-resistant diseases are also expected to kill ten million people every year by 2050 [8]. This indicates that drug-resistant diseases will result in more fatalities than road accidents, diabetes, and cancer combined [9]. Antibiotic formulation, testing, and screening are resource-intensive and expensive, limiting possible treatment choices for resistant bacterial species [2].
In addition to the challenges posed by antibiotic-resistant bacteria, antibiotic resistance genes (ARGs) can threaten public health [10]. ARGs are commonly present in transposons or plasmids, and they can be transferred from one cell to another by transduction, transformation, or conjugation. Resistance spreads rapidly within a bacterial population and among different types of bacteria due to gene transfer, a phenomenon known as horizontal gene transmission [11]. The detection of these genes is essential for identifying resistant strains, validating non-susceptible phenotypes, and better understanding resistance epidemiology [12].
The spread of antibiotic resistance genes (ARGs) among bacterial populations is greatly aided by plasmids, which are tiny DNA molecules distinct from chromosomal DNA. These mobile genetic components can easily travel across bacteria, allowing for the fast spread of resistance traits. Plasmids are like little vehicles holding ARGs, and they can transport these genes from one bacteria to another using methods including conjugation, transformation, and transduction [13]. This means that even if a bacterial strain develops resistance through mutation or other methods, the existence of plasmids allows it to rapidly share these ARGs with unrelated bacteria [14]. Plasmids can carry many ARGs at the same time, potentially generating a “reservoir” of resistance genes that can easily travel between bacteria. Understanding the role of plasmids in the spread of ARGs is essential in our efforts to prevent antibiotic resistance. Strategies for limiting the spread of ARGs must consider the role of these mobile genetic components, as targeting plasmids can be an effective strategy for limiting the spread of antibiotic resistance within microbial communities [15].
Phenotypic assays have traditionally been used to detect AMR. The criterion for determining antibiotic sensitivity is diffusion-based or standardized dilution in vitro antibiotic susceptibility test (AST), and much research and testing has been done to link AST findings with treatment response. Resistance surveillance and in some cases clinical therapeutic guidance are increasingly using molecular approaches. These approaches include everything from PCR-based resistance element detection to mass spectrometry-based methods [16]. Sequencing has become a viable approach for routine bacterial characterization due to the enhanced accessibility and cheaper cost of NGS [17]. Over the past few years, it has significantly improved our ability to combat AMR. Although NGS-based technologies can detect practically any known AMR gene or mutation and explore new variations of known AMR determinants, they have largely replaced traditional genotypic approaches for AMR identification [18,19,20]. Furthermore, as new phenotypic AMR determinants are discovered, sequence data can be continuously stored and re-analyzed. The primary drawback of any genotypic AST approach is that it can detect only proven AMR mechanisms, while resistance induced by novel mechanisms and/or gene expression regulation (hetero-resistance, increased efflux pump expression, etc.) cannot be detected [21].
Antimicrobial surveillance is therefore extremely crucial for forecasting antibiotic resistance developments and tracking the outcomes of medical interventions. The prediction of AMR in NGS data using a simple and quick method is essential for source tracking, infectious disease detection, diagnostics, and epidemiological surveillance, and additional research is highly required [22]. The development of tools for continuously monitoring AMR globally has become more important because these tools may provide useful information to assist healthcare professionals in developing stewardship programs and implementing public health measures. It is also required to create an infrastructure and network to support this huge amount of data [23].
Pseudomonas aeruginosa is a well-known opportunistic pathogen with inherent resistance to several antibiotics, making it a serious problem in clinical settings [24]. Due to its unique combination of features, Pseudomonas aeruginosa is distinguished in the field of plasmid transmission and antibiotic resistance genes. It poses considerable difficulty in healthcare settings due to its broad host range of plasmids, innate and acquired resistance mechanisms, biofilm-forming properties, and high clinical significance [25, 26]. The ability of this bacteria to rapidly transfer resistance genes via plasmids within clinical settings highlights its significance in the wider field of antibiotic resistance research and management efforts [27].
In this context, the significance of understanding the resistance profile of Pseudomonas aeruginosa cannot be overstated. Using several ARG identification methods on Pseudomonas plasmid sequences can provide useful information into the specific resistance genes prevalent in this bacterium and their ability to spread to different strains or species. This understanding is essential for efficient treatment and infection control measures in healthcare settings, making it an important component of the overall effort to battle antibiotic resistance [28,29,30,31].
AMR is detected computationally by querying input DNA or amino acid sequence data for the existence of a pre-determined set of AMR determinants provided in AMR reference databases using a search algorithm (Fig. 1) [22]. Numerous drug resistance prediction tools have been developed and made publicly available online over the last couple of years [32]. There is, however, a requirement for the standardization of tools. In this study, we conducted a thorough evaluation of several commonly available web-based drug resistance prediction tools, including ResFinder, ResFinderFG, KmerResistance, and Resistance Gene Identifier (RGI). We chose these tools primarily because of their user-friendly interfaces, which make them accessible even to people with no background in bioinformatics. These tools have many advantages over standalone applications, including convenience and access from any location with an internet connection. Real-time updates and scalability are other advantages, as web-based systems can easily adapt to expanding data quantities. Data backup and security features offer peace of mind, while collaboration tools promote teamwork and information exchange. Furthermore, because of their cross-platform portability and low cost, they are perfect for research projects with various technology setups and restricted resources. Using these benefits, we improve the efficiency and dependability of our research, resulting in more meaningful outcomes and advancing our understanding of drug resistance.
Materials and Methods
The framework employed in this study is described in the subsequent sections, and the comprehensive methodology is depicted in the figure below (Fig. 2).
Validation Dataset
Pseudomonas aeruginosa is a pathogenic Gram-negative bacterium that is becoming more common in infections caused by multidrug-resistant (MDR) and extensively drug-resistant (XDR) strains, limiting available effective treatments. Plasmids contribute significantly to antibiotic resistance because they are the means by which resistance genes are captured and then disseminated. Pseudomonas aeruginosa plasmid nucleotide sequences were acquired using the key phrase “Pseudomonas aeruginosa” from the nucleotide database of the NCBI (https://www.ncbi.nlm.nih.gov/nuccore/). The organism was then chosen as Pseudomonas aeruginosa, the species as bacteria, the molecular type as genomic DNA/RNA, the sequence type as nucleotide, the genetic compartment as plasmid, and the length from 900 to 1100 bps. We picked this range of plasmid lengths for our investigation to compare the effectiveness of various antibiotic resistance gene prediction methods on shorter sequences, which are more difficult to annotate than longer ones. This option was chosen to test the tools' versatility and robustness in detecting antibiotic resistance genes in plasmids of varied lengths, particularly in cases involving relatively short plasmids. A thorough evaluation of these prediction tools requires assessing their performance in challenging scenarios. To obtain a standard range, the length of the sequence was taken into account by the Romaniuk et al., 2019 article [33]. We obtained 26 Pseudomonas aeruginosa plasmid sequences from the aforementioned screening, which are further considered for the AMR prediction. Table 1 includes NCBI accession numbers, plasmid length, and species of the retrieved sequences.
Segregation of In Silico AMR Determination Tools
The development of online databases and bioinformatics tools has been required for drug-resistance gene prediction. After conducting a scientific literature search from 2012 to 2022, 47 freely accessible bioinformatics tools for identifying AMR determinants were discovered, including the most commonly used tools listed below (Table 2).
Center for Genomic Epidemiology (CGE) is fully non-profit and provides a variety of free online bioinformatics services. The Technical University of Denmark (DTU) provides core funding, as well as funding from a variety of public and commercial sources [51]. The Center for Genomic Epidemiology offers 38 services, including nine phenotyping tools: ResFinder, ResFinderFG, LRE-finder, KmerResistance, PathogenFinder, VirulenceFinder, Restriction-ModificationFinder, SPIFinder, and ToxFinder (Fig. 3). From the mentioned nine phenotypic tools, we selected four tools with versions (ResFinder 4.1, KmerResistance 2.2, ResFinderFG 2.0, and RGI 6.0.2) based on similarities of their objective i.e., to find out the resistance factors. Here we did not include LRE-Finder in our study because the input data format is FASTQ sequence, it only predicts AMR for a single species i.e., Enterococcus faecalis, and only identifies acquired linezolid resistance genes without considering other antibiotics.
The comprehensive antibiotic resistance database (CARD) contains a large collection of rigorously curated antibiotic resistance genes that serve as the foundation for our study into antibiotic resistance mechanisms. The resistance gene identifier (RGI), one of the several tools offered by CARD, is especially significant for our research. RGI is an important part of our research because of its unique capacity to detect and identify resistance genes.
Steps and Parameters Setup for Segregated Tools
ResFinder 4.1 searched the database for all seventeen classes of antibiotic drugs, regardless of the target region. The sequences were entered into the database, and the acquired resistance gene testing parameters were adjusted to predict resistance genes for all seventeen drug classes provided by the server. The minimum percentage identity was set to 90%, with perfect alignment set to 100%. The percentage of identity was computed by counting the number of identical nucleotides between the best-matching resistance gene in the database and the equivalent sequence in the plasmid. The tool was run with the aforementioned parameters, and the results were recorded.
The scoring method in KmerResistance 2.2 was species identification on maximum query coverage. Similarly, all sequences were entered into the database. The host database was set to the bacterial plasmid. The gene database was set to resistant genes, and the identity threshold was left at 70%, with a depth correction threshold of 10%. The AMR genes identified in the resulting output were recorded, and the host organism and template sequence were also noted.
The functional genomics database ResFinderFG 2.0 uses functional metagenomic antibiotic resistance determinants to identify resistance phenotypes. Here again, all sequences were entered into the database. The percentage identity setting was set to 98%, along with the minimum query length was set to 60%. The read type used was 'assembled contigs/genomes,' and the sequences were screened for all the thirteen antibiotic resistance determinant (ARD) families present in the database.
The RGI 6.0.2 tool was executed with the default parameters. These default settings were used by the tool to guarantee a thorough and consistent analysis. All sequences were uploaded into the tool, and the analysis was carried out using the default settings. The outcomes produced with these default settings were meticulously recorded and analyzed.
Results
This study provides better insights into the advantages and drawbacks of the tools, such as user-friendliness, to determine which tool has the best visualization and which tool offers the maximum information.
Results have been discussed with the following aspects:
-
Comparison based on the output-resistant sequence IDs
-
Comparison based on the output antibiotic resistance genes (ARGs)
-
Comparison based on the amount of information provided and result visualization
-
In detailed results of each tool
Comparison Based on the Output-Resistant Sequence IDs
In this analysis, four distinct resistance prediction tools were used to find and evaluate the presence of antibiotic-resistance genes in 26 plasmid DNA sequences. The data from each tool showed diverse patterns of shared and unique elements. ResFinder and KmerResistance, interestingly, shared 2 elements. In contrast, ResFinderFG featured a unique element that was absent in the other tools. In addition, all four tools uniformly identified 5 elements. ResFinder, KmerResistance, and RGI additionally shared 11 elements in common (Fig. 4).
Comparison Based on the Output Antibiotic Resistance Genes (ARGs)
ResFinder, KmerResistance, and RGI were three different tools that were used in the analysis of antibiotic resistance gene predictions. Notably, these three techniques had 2 resistance genes as common elements. 13 more common resistance gene sequences have been identified from ResFinder and KmerResistance. RGI, on the other hand, provided 12 distinct resistance gene sequences. Additionally, ResFinder only identified 1 distinct resistance gene, whereas KmerResistance identified 2 exclusive elements (Fig. 5). ResFinderFG uses gene names that are distinct from those used by the other two tools since they are based on functional annotation of gene products, which is another important point to take into consideration.
Comparison Based on the Amount of Information Provided and Result visualization
The results of all three CGE tools are made available through email, whereas the results of RGI can be downloaded directly from the webpage. The outcomes of the analysis were displayed in a tabular manner in ResFinder, with the first table containing Antimicrobial, Class, WGS-predicted phenotype, and Genetic background. Other tables in ResFinder are organized by drug class, with each table containing various drug class information, such as Resistance gene, Identity, Alignment Length/Gene Length, Position in reference, Contig or Depth, Position in contig, Phenotype, PMID, Accession no., and Notes. There is an extended output option at the bottom of the result page that displays the alignment result. The results for KmerResistance are provided in a single table, which contains the following columns: Template, Score, Expected, Template Length, Q Value, P Value, Template Id, Template Coverage, Query Id, Query Coverage, Depth, and Depth Corr. The ResFinderFG result is displayed as a tabular box with numerous columns containing Hit name, Identity, Query/HSP, Contig, Position in contig, Drug treatment, and Accession no. Each of the three CGE tools offers a variety of downloadable files containing various types of information (Table 3). The results for RGI are provided in two tables: the 1st table contains the following columns: Filename, Date (UTC), RGI Criteria, Perfect Hits, Strict Hits, Loose Hits along with the download option, and the 2nd table consists of the following columns: RGI Criteria, ARO Term, SNP, Detection Criteria, AMR Gene Family, Drug Class, Resistance Mechanism, % Identity of Matching Region, % Length of Reference Sequence.
In Detailed Result of Each Tool
As a case study, we took 26 plasmid sequences and executed them through four different prediction tools to identify AMR factors.
ResFinder 4.1
ResFinder 4.1 predicted that plasmid X60321.1 contains the majority of AMR genes. It carries two AMR genes, aac(6')-Ib3 resistance to aminoglycosides and aac(6')-Ib-cr resistance to fluoroquinolone classes of antibiotics. The presence of AMR genes was found in 18 of the 26 plasmid sequences tested in this study, with no resistance gene found for thirteen of the drug classes: Colistin, Disinfectant, Fosfomycin, Fusidic acid, Glycopeptide, Macrolide, Lincosamide, and Streptogramins (MLS), Nitroimidazole, Oxazolidinone, Phenicol, Pseudomonic acid, Rifampicin, Tetracycline, and Trimethoprim. A fair number of AMR gene homologs were identified in the other four drug classes (Supplementary Table 1). The drug classes in which AMR genes were detected were beta-lactams (13 out of 19; 68.42%), followed by aminoglycosides (21.05%), fluoroquinolones (5.2%), and sulfonamides (5.2%). There were 16 number of different acquired AMR genes found to be resistant to the four drug classes, with aminoglycosides and beta-lactams showing the highest frequency (Table 4). The most common genes are aadA10 (2/19), blaNPS (2/19), and blaPAU-1 (2/19), each of which was found to be present in 10.52% of the outcomes observed (Fig. 6).
KmerResistance 2.2
The sequences were uploaded to the KmerResistance database. 8 plasmid template genes were linked to other Gram-negative bacteria, while one plasmid template gene was linked to a Gram-positive bacterium, indicating that they could be the source of acquisition (Supplementary Table 2). Two Escherichia coli, one each of Klebsiella pneumoniae, Comamonas testosteroni, Acinetobacter sp., Pseudomonas putida, Achromobacter xylosoxidans, and Providencia sp. linked with Gram-negative strain. Glutamicibacter nicotianae Gram-positive strain is associated with one of the plasmids. Out of 26 input plasmid sequences, it predicted 19 ARGs in 13 plasmids.
ResFinderFG 2.0
In ResFinderFG 2.0, three distinct ARD families were identified in six input plasmid sequences. The most common was beta-lactamase, which was found in four different input plasmid sequences. Three of the four plasmids with beta-lactamase ARDs conferred resistance to ampicillin and one conferred resistance to piperacillin. Others include one dihydropteroate synthase (dpr) and one aminoglycoside acetyl-transferase (AAC), as both are resistant to Sulfamethazine and Amikacin respectively (Supplementary Table 3).
RGI 6.0.2
The sequences were submitted to the RGI database, revealing the presence of AMR genes in 16 out of the 26 plasmid sequences examined in this study. The results show that the observed plasmids have a wide range of resistance profiles. Several plasmids were shown to be a perfect match to certain AMR gene families, including IMP beta-lactamase, ANT(3'') aminoglycoside resistance, sul1 sulfonamide resistance, and several beta-lactamase types, including CARB, LCR, NPS, OXA, and OXA-935. These plasmids had a high identity and closely matched the reference sequences. Some plasmids, on the other hand, showed a strict match to resistance genes, such as APH(3'')-Ib and AAC(6')-Ib10, showing their participation in aminoglycoside resistance. Furthermore, some plasmids did not match any known resistance genes in the database (Supplementary Table 4).
Discussion
Currently, the use of sequencing technology is revolutionizing practically every component of biological study. In the field of infectious diseases, scientific discoveries, as well as diagnostic and outbreak investigations, are developing at a rapid pace. The ability to interpret sequencing data and the benefit of quick development, on the other hand, is not evenly distributed between institutions and countries [52, 53]. We choose CGE tools because its goal is to give access to bioinformatics tools to those with limited knowledge, allowing all countries, institutions, and individuals to benefit from new sequencing technology. It is believed that doing so, will encourage more open data sharing around the world and give equal advantages to all. CGE is fully non-profitable and provides a variety of free online bioinformatics services [51].
We next opted to explore the CARD and its RGI tool. CARD is well-known for its large collection of curated antibiotic-resistance genes, which makes it a useful tool for understanding antibiotic resistance in bacterial genomes [54]. The RGI tool, which is part of CARD, is specifically designed for identifying and characterizing antibiotic resistance genes, providing detailed information about their distribution and processes.
The AMR prediction methods have been built using DNA or amino acid sequence data. The presence or absence of software for searching within an AMR determinant database, which can be precise to a tool or replicated from other resources, the type of input data accepted, and the search approach used, which can be alignment or mapping, are all factors that distinguish bioinformatics resources. Each tool has its own set of capabilities and limitations when it comes to AMR prediction, which includes the identification of AMR sequences, ARGs, the volume of information produced, and visualization. The web-based application uses a website as its interface or front-end. It has the potential to provide competitive benefits over traditional software-based systems by allowing researchers to streamline data and information at a lower cost, time, and maintenance [51]. Using a regular browser, users can quickly access the application across any computer with internet access. Functionality and features were the two main elements that were prioritized. From this study, a non-bioinformatician or a non-technician can gain subject-specific knowledge as well as determine which tool is appropriate for their specific work. The table below compares the three tools used for identifying drug resistance genes and resistance sequence IDs as well as the amount of information they provide and the way their results are displayed (Table 5).
Description and Significant Observations of Each Selected Web-Based Tools Have Been Discussed Below
ResFinder is a web-based tool that finds chromosomal alterations that promote antibiotic resistance in bacteria's whole or partial DNA sequence and identifies acquired antimicrobial resistance genes in the whole-genome data using BLAST. As input, this tool accepts pre-assembled, whole, or partial genomes, along with fragmented sequence reads from four distinct sequencing technologies. It is accessible at (https://cge.food.dtu.dk/services/ResFinder/). It is also constantly being updated whenever different resistance genes are discovered [55]. Here, we found that the database showed a restriction that stated it only looked for acquired genes and did not detect chromosomal mutations. Since new resistance genes are continuously discovered, it may be necessary to confirm the presence or absence of identified AMR genes phenotypically. According to a study [56], genotyping using aligned whole-genome sequences is a practical substitute for surveillance based on phenotypic antimicrobial susceptibility due to the high concordance (99.74%) between phenotypic and predicted whole-genome sequence antimicrobial susceptibility. One of the three most common genes, the aadA10 gene, was found to be resistant to the drug class aminoglycoside, while the other two genes, blaNPS and blaPAU-1, were found to be resistant to the beta-lactam drug class. AadA10 is a class 1 integron containing gene cassette, which suggests that rather than transposition, the resistance determinants from one plasmid to another plasmid were moved by recombination between two class 1 integrons [57]. The ability of integrons in bacteria to acquire new cassettes and recombine cassette rows emphasizes the adaptability of integron diversity. It is necessary to be aware of what other integron-mediated traits, such as increased resistance to antimicrobials, virulence, or pathogenicity, might affect human health in future given their capacity to quickly spread resistance phenotypes. There is an urgent need for control integrons and cassette formation [58]. Tauch et al., 2003 found that blaNPS can rapidly transfer from one species to another [59]. According to Subedi et al., 2018, environmental resistance gene pools contain blaNPS, which can be acquired and maintained in clinical isolates [60]. In a prior study, it was discovered that a clinical isolate of Pseudomonas aeruginosa contained a transferable plasmid containing the gene known as blaPAU-1, which is connected to the mobile genetic element [61]. Considering the high ubiquity of beta-lactam resistance genes, it is preferable to monitor the level of antibiotic resistance and resistance genes in patients with Pseudomonas aeruginosa infection [62]. In this study, we found that Pseudomonas aeruginosa plasmids contain many beta-lactam resistance genes, several of which are found in a single plasmid. This leads us to the conclusion that beta-lactam resistance genes are rapidly spreading through plasmids, and the need of the hour is to control their spread.
KmerResistance (https://cge.food.dtu.dk/services/KmerResistance/) is primarily based on KmerFinder, which has been developed for the typing of bacteria with raw WGS data. KmerResistance and KmerFinder search for co-occurring k-mers between such a query genome and a resistance gene database. KmerResistance, like KmerFinder, biases the threshold based on the quality of the data, as shown by the coverage as well as the depth of the detected species genome. Since these k-mers in this scenario are dispersed across the total sample, we can estimate both depth and coverage. Unlike KmerFinder, KmerResistance may generate an outcome for species prediction in addition to getting acquired antimicrobial resistance genes [38]. This database improves on poor-quality assembly using k-mers to map raw whole-genome sequence data against reference databases and species. (Fragments of a DNA sequence of length k) [12]. Additionally, it can find host or template genes. The KmerResistance database displays the resistance genes but not the drug classes as an analysis output, even though it is claimed to be more precise than ResFinder. As a result, comparisons were restricted to resistance genes that were present in both databases rather than an overall assessment of their sensitivity. ResFinder, ResFinderFG, and RGI accept input sequences in a single input file and provide results based on each sequence, while KmerResistance requires us to provide the sequence file separately and perform separate executions. If we provide the input sequence to KmerResistance in a single file, the results are very perplexing and unrelated to the input sequence.
The ResFinderFG (https://cge.food.dtu.dk/services/ResFinderFG/) approach is based on databases containing sequences detected by functional metagenomics but not represented in existing databases constructed mostly from antibiotic-resistant genes in clinical isolates. It identifies a resistant phenotype in general [63]. Here this tool provides valuable insights into the presence of these beta-lactamase genes. One of the main causes of beta-lactam resistance in Pseudomonas aeruginosa is the increased prevalence of beta-lactamase [62]. Beta-lactamase enzymes render beta-lactam antibiotics ineffective by hydrolyzing the peptide bond of the characteristic four-membered beta-lactam ring. The bacterium gains resistance after the antibiotic is rendered inactive. Over 300 beta-lactamase enzymes have been described so far, with numerous kinetic, structural, computational, and mutagenesis studies. The threat posed by more and more powerful beta-lactamases to antimicrobial therapy is only going to increase [64]. The scientific and medical communities are only one step ahead and must continue to put forth diligent effort to prevent being overcome by the difficult and rapidly rising nosocomial pathogen resistance.
The RGI is a powerful tool for identifying antibiotic resistance genes [65]. The results show that the plasmids analyzed by RGI contain a variety of antibiotic resistance genes (ARGs) that confer resistance to numerous antibiotic classes, including carbapenems, cephalosporins, penams, penem, aminoglycosides, and sulfonamides. The bulk of ARGs identified by RGI is based on protein homolog models, which means they have a high degree of sequence similarity to existing ARGs in the CARD database. RGI observed ARGs from several families and resistance mechanisms, including beta-lactamases, aminoglycoside-modifying enzymes, and sulfonamide-resistant sulfonamides. These ARGs can inactivate or alter the target antibiotics, as well as replace the target enzymes with resistant ones [54].
The results also show that RGI can detect both homology-based and SNP-based ARGs, which is critical for understanding the diversity and evolution of resistance mechanisms. RGI discovered IMP-9, a variation of IMP-1 with a single amino acid change (Glu140Gly) that gives enhanced imipenem resistance [66]. RGI additionally identified OXA-5, OXA-28, OXA-31, OXA-45, and OXA-935, which are OXA-1 variations with distinct SNPs that give varying amounts of carbapenem resistance [67].
RGI can also handle complete and partial genes, which is useful for analyzing low-quality or low-coverage assemblies, metagenomic contigs, or small plasmids. For example, RGI identified OXA-5 with a reference sequence length of 109.74%, indicating that the input sequence contains some additional nucleotides at the ends of the gene. RGI additionally detected OXA-28 with a reference sequence length of 103.76%, indicating that the input sequence contains some insertions inside the gene. RGI identified OXA-935 with a reference sequence length of 112.41%, indicating that the input sequence contains some duplications within the gene.
The results also reveal that RGI can offer thorough annotations and classifications of the predicted ARGs, such as gene name, family, mechanism, drug class, and ontology. RGI, for example, identified APH(3'')-Ib as an APH(3'') family aminoglycoside-modifying enzyme that confers resistance to aminoglycosides via phosphorylation [54]. CARB-4 was also identified by RGI as a beta-lactamase from the CARB family that imparts resistance to penams via hydrolysis [54]. RGI also identified sul1 as a sulfonamide-resistant sul that belongs to the sul family and confers sulfonamide resistance by replacing the target enzyme dihydropteroate synthase [54].
However, the findings highlight some of RGI's limitations and concerns. RGI, for example, cannot directly analyze raw metagenomic reads, it only accepts data in FASTA format. It requires an additional process of assembly or mapping before using RGI. Depending on the quality of the assembly or mapping techniques, this can result in errors or biases in the output. Some plasmids in the data, for example, had no ARGs discovered by RGI, which could be owing to poor assembly or mapping quality [21]. RGI also relies on CARD reference data, which is updated and curated regularly. This means that depending on the version of CARD used, the RGI information could vary over time. This also implies that RGI may overlook some novel or rare ARGs that are not yet listed in CARD. Some plasmids in the results, for example, have no ARGs detected by RGI, which could be the result of rare or novel ARGs not found in CARD [21]. RGI additionally employs a defined cut-off for homology-based ARG detection based on curated bit scores. This may not be optimal for a wide range of sequences or organisms, resulting in false positives or false negatives. For example, some plasmids in the data had ARGs discovered by RGI using strict criteria rather than perfect criteria, implying that their bit scores are lower than the cut-off. This could be due to a low identity or a short matching region between the input and reference sequences [21].
Conclusion
Finally, our study compared four different web-based antibiotic resistance gene prediction tools: ResFinder, KmerResistance, ResFinderFG, and RGI. ResFinder is a web-based application that specializes in detecting chromosomal changes in bacterial DNA sequences that increase antibiotic resistance. It excelled at identifying acquired antimicrobial resistance genes in whole-genome data and kept its database up to date with newly found resistance genes. ResFinder, on the other hand, is confined to acquired genes and does not include chromosomal alterations. Based on the KmerFinder approach, KmerResistance presented an alternative solution. It searched for co-occurring k-mers in query genomes and resistance gene databases, revealing information on species predictions and acquired antimicrobial resistance genes. The ability of KmerResistance to overcome poor-quality assembly concerns using k-mers to map raw WGS data is an important feature. ResFinderFG brought a unique perspective to our study. It excelled in detecting resistant phenotypes in general, due to databases including sequences discovered by functional metagenomics. As already stated RGI proved to be a strong technique for discovering antibiotic resistance genes. It excelled in detecting a wide range of resistance genes, both homology-based and SNP-based, revealing important information about resistance mechanisms. Furthermore, RGI's capacity to handle full and partial genes made it a versatile candidate for analyzing various types of sequences. RGI distinguishes itself by providing detailed information regarding gene name, family, mechanism, drug class, and ontology in its annotations and classifications of predicted ARGs. The four tools were empirically evaluated in this study, with their features, limitations, and sensitivities examined. As sequencing technology advances the area of infectious disease research, enabling fair access to bioinformatics tools is critical for global pathogen surveillance and effective tracking of antibiotic resistance based on genomic data. Researchers can make informed selections on which tool most effectively achieves their study goals by understanding the capabilities and trade-offs of different tools. The constantly evolving landscape of antibiotic resistance needs continuous attempts to improve tools and methods for more efficient resistance gene identification and surveillance.
Data Availability
The data presented in this study are available in the supplementary files.
References
Aslam B, Wang W, Arshad MI, et al. Antibiotic resistance: a rundown of a global crisis. Infect Drug Resist. 2018;11:1645–58. https://doi.org/10.2147/IDR.S173867. (Epub ahead of print).
Uluseker C, Kaster KM, Thorsen K, et al. A review on occurrence and spread of antibiotic resistance in wastewaters and in wastewater treatment plants: mechanisms and perspectives. Front Microbiol. 2021. https://doi.org/10.3389/fmicb.2021.717809. (Epub ahead of print).
Baran A, Kwiatkowska A, Potocki L. Antibiotics and bacterial resistance—a short story of an endless arms race. Int J Mol Sci. 2023. https://doi.org/10.3390/ijms24065777. (Epub ahead of print).
Pagès JM, Amaral L. Mechanisms of drug efflux and strategies to combat them: challenging the efflux pump of gram-negative bacteria. Biochim Biophys Acta Prot Proteom. 2009. https://doi.org/10.1016/j.bbapap.2008.12.011. (Epub ahead of print).
Hutchings M, Truman A, Wilkinson B. Antibiotics: past, present and future. Curr Opin Microbiol. 2019. https://doi.org/10.1016/j.mib.2019.10.008. (Epub ahead of print).
Matlock A, Garcia JA, Moussavi K, et al. Advances in novel antibiotics to treat multidrug-resistant gram-negative bacterial infections. Intern Emerg Med. 2021. https://doi.org/10.1007/s11739-021-02749-1.
Ferri M, Ranucci E, Romagnoli P, et al. Antimicrobial resistance: a global emerging threat to public health systems. Crit Rev Food Sci Nutr. 2017. https://doi.org/10.1080/10408398.2015.1077192. (Epub ahead of print).
Matthiessen LE, Hald T, Vigre H. System mapping of antimicrobial resistance to combat a rising global health crisis. Front Public Health. 2022;10:816943. https://doi.org/10.3389/fpubh.2022.816943.
Jasovský D, Littmann J, Zorzet A, et al. Antimicrobial resistance—a threat to the world’s sustainable development. Upsala J Med Sci. 2016. https://doi.org/10.1080/03009734.2016.1195900. (Epub ahead of print).
Zhang AN, Gaston JM, Dai CL, et al. An omics-based framework for assessing the health risk of antimicrobial resistance genes. Nat Commun. 2021. https://doi.org/10.1038/s41467-021-25096-3. (Epub ahead of print).
Lerminiaux NA, Cameron ADS. Horizontal transfer of antibiotic resistance genes in clinical environments. Can J Microbiol. 2019. https://doi.org/10.1139/cjm-2018-0275. (Epub ahead of print).
Zankari E, Hasman H, Cosentino S, et al. Identification of acquired antimicrobial resistance genes. J Antimicrob Chemother. 2012. https://doi.org/10.1093/jac/dks261. (Epub ahead of print).
Okoye EL, Kemakolam C, Ugwuoji ET, et al. Multidrug resistance tracing by plasmid profile analysis and the curing of bacteria from different clinical specimens. Adv Gut Microb Res. 2022. https://doi.org/10.1155/2022/3170342. (Epub ahead of print).
Liu YY, Chen S, Burrus V, et al. Editorial: Globally or regionally spread of epidemic plasmids carrying clinically important resistance genes: epidemiology, molecular mechanism, and drivers. Front Microbiol. 2021. https://doi.org/10.3389/fmicb.2021.822802. (Epub ahead of print).
Svara F, Rankin DJ. The evolution of plasmid-carried antibiotic resistance. BMC Evol Biol. 2011. https://doi.org/10.1186/1471-2148-11-130. (Epub ahead of print).
Gajic I, Kabic J, Kekic D, et al. Antimicrobial susceptibility testing: a comprehensive review of currently used methods. Antibiotics. 2022. https://doi.org/10.3390/antibiotics11040427. (Epub ahead of print).
Vincent AT, Derome N, Boyle B, et al. Next-generation sequencing (NGS) in the microbiological world: how to make the most of your money. J Microbiol Methods. 2017. https://doi.org/10.1016/j.mimet.2016.02.016. (Epub ahead of print).
Motro Y, Moran-Gilad J. Next-generation sequencing applications in clinical bacteriology. Biomol Detect Quantif. 2017. https://doi.org/10.1016/j.bdq.2017.10.002. (Epub ahead of print).
Nayak DSK, Mahapatra S, Swarnkar T. Gene selection and enrichment for microarray data—a comparative network based approach. Adv Intell Syst Comput. 2018. https://doi.org/10.1007/978-981-10-6875-1_41. (Epub ahead of print).
Khan ZA, Siddiqui MF, Park S. Current and emerging methods of antibiotic susceptibility testing. Diagnostics. 2019. https://doi.org/10.3390/diagnostics9020049. (Epub ahead of print).
Mahfouz N, Ferreira I, Beisken S, et al. Large-scale assessment of antimicrobial resistance marker databases for genetic phenotype prediction: a systematic review. J Antimicrob Chemother. 2020. https://doi.org/10.1093/jac/dkaa257. (Epub ahead of print).
Hendriksen RS, Bortolaia V, Tate H, et al. Using genomics to track global antimicrobial resistance. Front Public Health. 2019. https://doi.org/10.3389/fpubh.2019.00242. (Epub ahead of print).
Seoane A, Bou G. Bioinformatics approaches to the study of antimicrobial resistance. Revista Espanola de Quimioterapia. 2021. https://doi.org/10.37201/req/s01.04.2021. (Epub ahead of print).
Gürpınar Ö, Köseoğlu-Eser Ö. Pseudomonas aeruginosa resistome and epidemic high-risk clones. KLIMIK Derg. 2022. https://doi.org/10.36519/kd.2022.4002. (Epub ahead of print).
Gao J, Wei X, Yin L, et al. Emergence and transfer of plasmid-harbored rmtB in a clinical multidrug-resistant pseudomonas aeruginosa strain. Microorganisms. 2022. https://doi.org/10.3390/microorganisms10091818. (Epub ahead of print).
Patil S, Chen X, Dong S, et al. Resistance genomics and molecular epidemiology of high-risk clones of ESBL-producing Pseudomonas aeruginosa in young children. Front Cell Infect Microbiol. 2023. https://doi.org/10.3389/fcimb.2023.1168096. (Epub ahead of print).
Perron GG, Inglis RF, Pennings PS, et al. Fighting microbial drug resistance: a primer on the role of evolutionary biology in public health. Evol Appl. 2015. https://doi.org/10.1111/eva.12254. (Epub ahead of print).
Mu X, Li X, Yin Z, et al. Abundant diversity of accessory genetic elements and associated antimicrobial resistance genes in Pseudomonas aeruginosa isolates from a single Chinese hospital. Ann Clin Microbiol Antimicrob. 2023. https://doi.org/10.1186/s12941-023-00600-3. (Epub ahead of print).
Sanya DRA, Onésime D, Vizzarro G, et al. Recent advances in therapeutic targets identification and development of treatment strategies towards Pseudomonas aeruginosa infections. BMC Microbiol. 2023. https://doi.org/10.1186/s12866-023-02832-x. (Epub ahead of print).
Ahmed OB. Detection of antibiotic resistance genes in Pseudomonas aeruginosa by whole genome sequencing. Infect Drug Resist. 2022. https://doi.org/10.2147/IDR.S389959. (Epub ahead of print).
Feldgarden M, Brover V, Haft DH, et al. Validating the AMRFINder tool and resistance gene database by using antimicrobial resistance genotype-phenotype correlations in a collection of isolates. Antimicrob Agents Chemother. 2019. https://doi.org/10.1128/AAC.00483-19. (Epub ahead of print).
Köser CU, Ellington MJ, Peacock SJ. Whole-genome sequencing to control antimicrobial resistance. Trends Genet. 2014. https://doi.org/10.1016/j.tig.2014.07.003. (Epub ahead of print).
Romaniuk K, Styczynski M, Decewicz P, et al. Diversity and horizontal transfer of antarctic Pseudomonas spp. plasmids. Genes (Basel). 2019. https://doi.org/10.3390/genes10110850. (Epub ahead of print).
Gupta SK, Padmanabhan BR, Diene SM, et al. ARG-annot, a new bioinformatic tool to discover antibiotic resistance genes in bacterial genomes. Antimicrob Agents Chemother. 2014. https://doi.org/10.1128/AAC.01310-13. (Epub ahead of print).
Hunt M, Mather AE, Sánchez-Busó L, et al. ARIBA: rapid antimicrobial resistance genotyping directly from sequencing reads. Microb Genom. 2017. https://doi.org/10.1099/mgen.0.000131. (Epub ahead of print).
Arango-Argoty G, Garner E, Pruden A, et al. DeepARG: a deep learning approach for predicting antibiotic resistance genes from metagenomic data. Microbiome. 2018. https://doi.org/10.1186/s40168-018-0401-z. (Epub ahead of print).
Rowe WPM, Winn MD. Indexed variation graphs for efficient and accurate resistome profiling. Bioinformatics. 2018. https://doi.org/10.1093/bioinformatics/bty387. (Epub ahead of print).
Clausen PTLC, Zankari E, Aarestrup FM, et al. Benchmarking of methods for identification of antimicrobial resistance genes in bacterial whole genome data. J Antimicrob Chemother. 2016. https://doi.org/10.1093/jac/dkw184. (Epub ahead of print).
Feldgarden M, Brover V, Haft DH, et al. Using the NCBI AMRFinder tool to determine antimicrobial resistance genotype-phenotype correlations within a collection of NARMS isolates. bioRxiv. 2019. https://doi.org/10.1101/550707. (Epub ahead of print).
Gschwind R, Ugarcina Perovic S, Weiss M, et al. ResFinderFG v2.0: a database of antibiotic resistance genes obtained by functional metagenomics. Nucleic Acids Res. 2023. https://doi.org/10.1093/nar/gkad384. (Epub ahead of print).
Rowe W, Baker KS, Verner-Jeffreys D, et al. Search engine for antimicrobial resistance: a cloud compatible pipeline and web interface for rapidly detecting antimicrobial resistance genes directly from sequence data. PLoS ONE. 2015. https://doi.org/10.1371/journal.pone.0133492. (Epub ahead of print).
Kaminski J, Gibson MK, Franzosa EA, et al. High-specificity targeted functional profiling in microbial communities with ShortBRED. PLoS Comput Biol. 2015. https://doi.org/10.1371/journal.pcbi.1004557. (Epub ahead of print).
Inouye M, Dashnow H, Raven LA, et al. SRST2: rapid genomic surveillance for public health and hospital microbiology labs. Genome Med. 2014. https://doi.org/10.1186/s13073-014-0090-6. (Epub ahead of print).
de Man TJB, Limbago BM. SSTAR, a stand-alone easy-to-use antimicrobial resistance gene predictor. mSphere. 2016. https://doi.org/10.1128/msphere.00050-15. (Epub ahead of print).
Chiu JKH, Ong RTH. ARGDIT: a validation and integration toolkit for antimicrobial resistance gene databases. Bioinformatics. 2019. https://doi.org/10.1093/bioinformatics/bty987. (Epub ahead of print).
Hasman H, Clausen PTLC, Kaya H, et al. LRE-Finder, a web tool for detection of the 23S rRNA mutations and the optrA, cfr, cfr(B) and poxtA genes encoding linezolid resistance in enterococci from whole-genome sequences. J Antimicrob Chemother. 2019. https://doi.org/10.1093/jac/dkz092. (Epub ahead of print).
Matthews TC, Bristow FR, Griffiths EJ, et al. The integrated rapid infectious disease analysis (IRIDA) platform. bioRxiv. 2018. https://doi.org/10.1101/381830. (Epub ahead of print).
Chowdhury AS, Call DR, Broschat SL. PARGT: a software tool for predicting antimicrobial resistance in bacteria. Sci Rep. 2020. https://doi.org/10.1038/s41598-020-67949-9. (Epub ahead of print).
Li Y, Xu Z, Han W, et al. HMD-ARG: hierarchical multi-task deep learning for annotating antibiotic resistance genes. Microbiome. 2021. https://doi.org/10.1186/s40168-021-01002-3. (Epub ahead of print).
Ren Y, Chakraborty T, Doijad S, et al. Prediction of antimicrobial resistance based on whole-genome sequencing and machine learning. Bioinformatics. 2022. https://doi.org/10.1093/bioinformatics/btab681. (Epub ahead of print).
Thomsen MCF, Ahrenfeldt J, Cisneros JLB, et al. A bacterial analysis platform: an integrated system for analysing bacterial whole genome sequencing data for clinical diagnostics and surveillance. PLoS ONE. 2016. https://doi.org/10.1371/journal.pone.0157718. (Epub ahead of print).
Gardy JL, Loman NJ. Towards a genomics-informed, real-time, global pathogen surveillance system. Nat Rev Genet. 2018. https://doi.org/10.1038/nrg.2017.88. (Epub ahead of print).
Gilchrist CA, Turner SD, Riley MF, et al. Whole-genome sequencing in outbreak analysis. Clin Microbiol Rev. 2015. https://doi.org/10.1128/CMR.00075-13. (Epub ahead of print).
Alcock BP, Raphenya AR, Lau TTY, et al. CARD 2020: antibiotic resistome surveillance with the comprehensive antibiotic resistance database. Nucleic Acids Res. 2020. https://doi.org/10.1093/nar/gkz935. (Epub ahead of print).
Bortolaia V, Kaas RS, Ruppe E, et al. ResFinder 4.0 for predictions of phenotypes from genotypes. J Antimicrob Chemother. 2020. https://doi.org/10.1093/jac/dkaa345. (Epub ahead of print).
Zankari E, Hasman H, Kaas RS, et al. Genotyping using whole-genome sequencing is a realistic alternative to surveillance based on phenotypic antimicrobial susceptibility testing. J Antimicrob Chemother. 2013. https://doi.org/10.1093/jac/dks496. (Epub ahead of print).
Partridge SR, Collis CM, Hall RM. Class 1 integron containing a new gene cassette, aadA10, associated with Tn1404 from R151. Antimicrob Agents Chemother. 2002. https://doi.org/10.1128/AAC.46.8.2400-2408.2002. (Epub ahead of print).
Sabbagh P, Rajabnia M, Maali A, et al. Integron and its role in antimicrobial resistance: a literature review on some bacterial pathogens. Iran J Basic Med Sci. 2021. https://doi.org/10.22038/ijbms.2020.48905.11208. (Epub ahead of print).
Tauch A, Schlüter A, Bischoff N, et al. The 79,370-bp conjugative plasmid pB4 consists of an IncP-1β backbone loaded with a chromate resistance transposon, the strA-strB streptomycin resistance gene pair, the oxacillinase gene blaNPS-1, and a tripartite antibiotic efflux system of the resistance-nodulation-division family. Mol Genet Genom. 2003. https://doi.org/10.1007/s00438-002-0785-z. (Epub ahead of print).
Subedi D, Vijay AK, Kohli GS, et al. Nucleotide sequence analysis of NPS-1 β-lactamase and a novel integron (In1427)-carrying transposon in an MDR Pseudomonas aeruginosa keratitis strain. J Antimicrob Chemother. 2018. https://doi.org/10.1093/jac/dky073. (Epub ahead of print).
Wang J, Xu T, Ying J, et al. PAU-1, a novel plasmid-encoded ambler class a β-lactamase identified in a clinical Pseudomonas aeruginosa isolate. Infect Drug Resist. 2019. https://doi.org/10.2147/IDR.S225288. (Epub ahead of print).
Haghighi S, Goli HR. High prevalence of blaVEB, blaGES and blaPER genes in beta-lactam resistant clinical isolates of Pseudomonas aeruginosa. AIMS Microbiol. 2022;8:153–66.
Blake KS, Choi JH, Dantas G. Approaches for characterizing and tracking hospital-associated multidrug-resistant bacteria. Cell Mol Life Sci. 2021. https://doi.org/10.1007/s00018-020-03717-2. (Epub ahead of print).
Majiduddin FK, Materon IC, Palzkill TG. Molecular analysis of beta-lactamase structure and function. Int J Med Microbiol. 2002. https://doi.org/10.1078/1438-4221-00198. (Epub ahead of print).
Lee K, Kim DW, Cha CJ. Overview of bioinformatic methods for analysis of antibiotic resistome from genome and metagenome data. J Microbiol. 2021. https://doi.org/10.1007/s12275-021-0652-4. (Epub ahead of print).
Poirel L, Nordmann P. Acquired carbapenem-hydrolyzing beta-lactamases and their genetic support. Curr Pharm Biotechnol. 2005. https://doi.org/10.2174/1389201023378427. (Epub ahead of print).
Overmeyer AJ, Prentice E, Brink A, et al. The genomic characterization of carbapenem-resistant Serratia marcescens at a tertiary hospital in South Africa. JAC Antimicrob Resist. 2023. https://doi.org/10.1093/jacamr/dlad089. (Epub ahead of print).
Acknowledgements
The author acknowledges and thanks the Center for Genomic Epidemiology and Comprehensive Antibiotic Resistance Database for providing web tools.
Funding
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the topical collection “Diverse Applications in Computing, Analytics and Networks” guest edited by Archana Mantri and Sagar Juneja.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Routray, S.P., Sahoo, S., Nayak, D.S.K. et al. Web-Based Tools Validation for Antimicrobial Resistance Prediction: An Empirical Comparative Analysis. SN COMPUT. SCI. 5, 147 (2024). https://doi.org/10.1007/s42979-023-02460-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s42979-023-02460-2