Figures
Abstract
Recently diverged species are challenging for identification, yet they are frequently of special interest scientifically as well as from a regulatory perspective. DNA barcoding has proven instrumental in species identification, especially in insects and vertebrates, but for the identification of recently diverged species it has been reported to be problematic in some cases. Problems are mostly due to incomplete lineage sorting or simply lack of a ‘barcode gap’ and probably related to large effective population size and/or low mutation rate. Our objective was to compare six methods in their ability to correctly identify recently diverged species with DNA barcodes: neighbor joining and parsimony (both tree-based), nearest neighbor and BLAST (similarity-based), and the diagnostic methods DNA-BAR, and BLOG. We analyzed simulated data assuming three different effective population sizes as well as three selected empirical data sets from published studies. Results show, as expected, that success rates are significantly lower for recently diverged species (∼75%) than for older species (∼97%) (P<0.00001). Similarity-based and diagnostic methods significantly outperform tree-based methods, when applied to simulated DNA barcode data (P<0.00001). The diagnostic method BLOG had highest correct query identification rate based on simulated (86.2%) as well as empirical data (93.1%), indicating that it is a consistently better method overall. Another advantage of BLOG is that it offers species-level information that can be used outside the realm of DNA barcoding, for instance in species description or molecular detection assays. Even though we can confirm that identification success based on DNA barcoding is generally high in our data, recently diverged species remain difficult to identify. Nevertheless, our results contribute to improved solutions for their accurate identification.
Citation: van Velzen R, Weitschek E, Felici G, Bakker FT (2012) DNA Barcoding of Recently Diverged Species: Relative Performance of Matching Methods. PLoS ONE 7(1): e30490. https://doi.org/10.1371/journal.pone.0030490
Editor: Indra Neil Sarkar, University of Vermont, United States of America
Received: June 22, 2011; Accepted: December 22, 2011; Published: January 17, 2012
Copyright: © 2012 van Velzen et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by the National Herbarium of the Netherlands (now NCB Naturalis). The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Recently diverged species are frequently of special interest, for example in ecology, regulation or forensics [1], [2], [3], and hence their accurate identification is warranted. DNA barcoding [4], [5], [6], [7] has proven instrumental in identifying recently diverged species (e.g. species complexes or cryptic species) that are of importance to conservation biology [8], [9], [10], [11], pest management [12], [13], [14], fishery [15], [16], [17], [18], [19], [20], invasive biology [21], [22], [23], [24], [25], [26] and disease control [27], [28], [29], [30]. In some cases, however, identification of recently diverged species using DNA barcodes has been reported to be problematic [1], [2], [31], [32], [33], [34] due to ambiguous barcode matches or the absence of barcode clusters in DNA barcode trees.
Failure of DNA barcodes to properly resolve recently-diverged species can be attributed to population genetic factors of the species involved [31], [35], [36], [37], [38], [39]. Coalescent theory [40] predicts that the chance that gene sequences sampled from a species are monophyletic is dependent on the age of that species (measured in number of generations since speciation) and reversely dependent on its effective population size (Ne) [40], [41]. This is because species with large Ne are predicted to have larger within-species genetic variation [40], [41], [42]. When such species have diverged only recently their gene sequences are likely to have a most recent common ancestor predating the speciation event (incomplete lineage sorting) [42]. This results in overlapping within- and between-species genetic distances (lack of a ‘barcode gap’) and paraphyly or even polyphyly of conspecific samples in gene trees [42], [43], [44], [45]. For example, in Lycaenidae (Blue butterflies) Wiemers and Fiedler [38] found a general lack of ‘barcode gaps’ and paraphyly or polyphyly of conspecific DNA sequences, probably caused by incomplete lineage sorting [38], as did McFadden et al. in Octocorals [36]. Meyer and Paulay [31], in their DNA barcode study of marine gastropods, explained non-monophyly of some species by incomplete lineage sorting effects. Elias et al. [43] reported limited performance of DNA barcoding in two butterfly communities in Ecuador, which they attributed in part to large Ne and associated long coalescent times [39]. Based on simulated DNA barcode data sets Ross et al. [37] and Austerlitz et al. [35] found that species monophyly and identification success generally decreased with increasing coalescent depth.
Regardless of Ne, recently diverged species have acquired only few genetic differences meaning that there are few characters to discriminate them. The rate at which two sister species genetically diversify is dependent on their effective mutation rate (µ). If µ is sufficiently low, even reciprocally monophyletic species will share identical haplotypes. Indeed, some morphologically well-differentiated species may share identical DNA barcode sequences, preventing accurate identification using DNA barcodes [33], [36], [38]. If µ is higher, identification success depends on the extent of lineage sorting: on the one hand, a single fixed mutation can be enough for successful identification [36], [46], [47]; on the other hand, non-monophyletic (i.e. incompletely-sorted) species will have overlapping genetic variation even when µ is high. Therefore, we consider the factors governing lineage sorting: time (measured in generations), and Ne, to be the most important factors contributing to DNA barcode identification problems with recently diverged species. Obviously, when given enough time any Ne or µ will ultimately result in high levels of between-species divergence. We therefore emphasize time here and focus on ‘recent’ versus ‘old’ species.
Various methods have been proposed to match DNA barcodes to a reference library for identification, amongst which we recognize the following:
Tree-based methods assign unidentified (query) barcodes to species based on their membership of clusters (or clades) in a DNA barcode tree. This approach is usually based on neighbor joining [48], [49], parsimony [50] or Bayesian inference [51]. Tree-based methods assume that samples of distinct species form discrete clusters in a DNA barcode tree [4], [49]. It is generally acknowledged, however, that gene trees (i.e. DNA barcode trees) do not necessarily reflect organismal history [42], and that the incomplete lineage sorting effects outlined above may lead to incorrect identifications based on such trees [31], [35], [37], [38], [39].
Similarity-based methods assign query barcodes to species based on how much DNA barcode characters they have in common. Similarity can be calculated directly from nucleotide sites (e.g. using MOTU [52], nearest neighbor [35], [53], or BLAST [54]) or from a projection of nucleotides (e.g. Kernel methods [35], [55], [56], ATIM [57], BRONX [58]). Similarity-based methods assume that conspecific samples will be more similar to each other than to samples of any other species. However, this need not be true in all cases. For instance, if we consider two hypothetical sister species that share two polymorphisms and have only one nucleotide differentiating them from each other, tree- and similarity-based methods will fail to correctly identify (some of the) haplotypes in these species, see Figure 1.
A. Alignment where two recently diverged sister species (species1 and species2) have only one diagnostic nucleotide differentiating them from each other (position 1) and at the same time share two polymorphisms (positions 2 and 3). Species3 is included as outgroup; B. Pairwise uncorrected similarities based on the alignment with highest pairwise similarities in boldface; C. Neighbor joining tree; D. Strict consensus of all maximum parsimony trees.
Statistical methods estimate confidence measures on DNA barcode matches for species identification. These methods typically employ Bayesian estimation based on explicit population genetic or phylogenetic models [44], [59], [60]. Obviously, confidence measures are of great importance when dealing with regulated species, forensics or disease vectors [44]. However, because statistical methods for species identification are computationally intensive and the appropriate model parameters are not known for the majority of species we will not treat them further.
Diagnostic methods (sometimes included in ‘character-based’ methods [46]) rely on the presence/absence of particular characters in DNA barcode sequences for identification, instead of using them all. Diagnostics can be either “simple” when based on a single unique character or “compound” when based on a unique combination of characters [61]. Some methods use nucleotide data and require a multiple sequence alignment (e.g. CAOS [61], [62], [63], BLOG [64]. Others use diagnostic nucleotide strings as diagnostics and are therefore alignment-free (e.g. DNA-BAR [65]). Diagnostic methods are analogous to classical taxonomic practices that rely on morphological diagnostic characters [46], [66]. As opposed to other methods, diagnostic methods have the potential to select the differentiating nucleotide only and ignore any within-species variation obscuring that signal [46], [67], [68]. For example, a diagnostic method could correctly identify the two hypothetical species in Figure 1 based on the diagnostic nucleotide at position 1.
Our objective was to compare relative performance of six DNA barcode matching methods in correctly identifying barcodes of recently diverged species. Below we provide some motivations for choosing each of these six methods:
- Tree-based neighbor joining (NJ) [48] because it is the most widely used method for classifying DNA barcodes in the literature, and implemented in, for instance, the Barcode Of Life Database [69]. Speed being its main advantage, NJ is a bottom-up clustering algorithm that calculates a single tree from a distance matrix. Results can be dependent on the ordering of the matrix, however, making results sometimes less reproducible. The underlying assumption in NJ barcode matching is that barcode sequences of distinct species form discrete clusters in a NJ tree [4]. For identification, query sequences are included in the NJ tree to see in which cluster they appear.
- Tree-based parsimony (PAR) [50] as it outperformed other tree-based methods (such as the Statistical Assignment Package SAP [49]), in a published comparative study [58]. PAR adopts the optimality criterion under which the preferred tree is the tree that requires the least evolutionary change to explain the data. Assessing all possible trees for more than 20 sequences is computationally impossible and therefore PAR methods employ heuristics to find the preferred tree(s).
- Similarity-based nearest neighbor (NN) because it gave high correct identification rates in previous studies [35], [53]. Based on a distance matrix, NN simply assigns a query sequence to the same species membership as its closest sequence in the reference data base. It is equivalent to the ‘Best Match’ method by Meier et al. [53] and the ‘1-NN’ method used by Austerlitz et al. [35].
- Similarity-based BLAST [54] as it is probably the most commonly used method for classifying DNA sequences in practice. It is an algorithm for comparing query sequences with an unaligned reference data base calculating pairwise alignments in the process. It is faster than NN, but can give incorrect matches in some cases, especially with incomplete reference data bases [70].
- The diagnostic method DNA-BAR [65] because it showed higher levels of accurate species identification in previous studies [57], [58] compared to the other diagnostic method CAOS [61]. DNA-BAR first selects sequence substrings (distinguishers) differentiating the sequences in the reference data set, and then records presence/absence of these distinguishers. An advantage of using substrings is that the method does not require an alignment.
- The recently developed diagnostic logic mining method BLOG [64] because it has not been used in any comparative test before (except [71]). BLOG first selects a number of characters (‘features’) from the reference data set that optimize discrimination of a particular species, based on an integer programming feature selection method. It then uses the selected features to search for the simplest logic formula that discriminates that species from all others using a learning method based on decomposition techniques [64], [71]. This process is reiterated for every species in the reference data set. Subsequently, query sequences are screened for their recognition by the formulas for identification. The reader may refer to [64], [72], [73] and [74] for a complete description of the mathematical models that constitute the main characteristics of BLOG.
We use simulated and empirical DNA barcode datasets, the latter from published studies. In general, data simulations allow for replication and, hence, statistical testing of method performance. For instance, Austerlitz et al. [35] assessed relative performance of NJ, NN, classification and regression trees, random forest, and kernel methods in correctly assigning query barcodes to predefined species. They concluded that, although NN was the most reliable method overall, none was found to be best under all circumstances. However, the authors simulated datasets with only 2–5 species and assumed simultaneous divergence of all species which seems biologically unrealistic [35]. Here, we simulated more realistic DNA barcode datasets comprising 50 species along a phylogenetic tree, thus producing more typical levels of sequence divergence. In this regard our approach is similar to that of Ross et al. [37] who tested similarity and tree-based methods of species identification using ‘realistic’ simulated datasets. They concluded that tree-based methods returned ambiguous identifications. However, they did not take species divergence times explicitly into account, nor did they include diagnostic methods, which we do here.
Our results show that, even though recently diverged species pose a significant problem for effective DNA barcoding, sensitive similarity-based and diagnostic methods can significantly improve identification performance compared with the commonly used tree-based methods such as NJ.
Materials and Methods
Our analytical pipeline started with generating simulated DNA barcode data sets and selection of published empirical data sets. Subsequently, we assessed both ‘barcode gap’ and monophyly of species and performed matching analyses with tree-based (NJ,PAR), similarity-based (NN, BLAST) and diagnostic (DNA-BAR, BLOG) methods on both types of data. The pipeline concluded with a comparative evaluation of methods used in terms of accuracy of species identification.
Data simulation
DNA barcode datasets were simulated using the Coalescent package in Mesquite version 2.73 build 544 [75], [76]. We simulated along two axes: time of species divergence and effective population size (Ne). We started by simulating a random ultrametric species tree for 50 species using the Yule model [77], with a total tree depth of 1 million generations. Species were divided into two equally-sized groups (N = 25) based on their rank in divergence times: one with ‘recently diverged’ species and another with ‘old’ species.
Ultrametric gene trees were simulated on the ultrametric species tree according to the coalescence model, generating 20 individuals per species. Gene trees were simulated using Ne = 1,000 10,000 and 50,000 with each simulation replicated 100-fold, resulting in 300 gene trees in total. Additive gene trees were then obtained by adding noise to the branch lengths of gene trees in order to ensure more realistic (i.e. non-ultrametric) data structure. Thereby we effectively mimicked heterogeneity of the effective mutation rate (µ) over branches of the gene trees. Noise was normally distributed, with a variance σ of 0.7 times the original branch length.
DNA barcode sequences were then simulated on the additive gene trees according to a HKY substitution model [78], the choice of which was based on the best-fitting model for a representative empirical dataset of 527 Nymphalidae DNA barcodes as selected using JModelTest 0.1.1 [79] applying the AIC criterion. Model parameters encompassed a transition/transversion ratio κ of 8.3, nucleotide frequencies of 0.30 (A), 0.15 (C), 0.10 (G), 0.45 (T), and gamma-distributed rate variation over sites with 4 rate categories and a shape parameter α of 0.2. Sequence length was 650 base pairs, approximating the length of the standard DNA barcode for animals (COI). Simulated sequences were divided over reference data sets (16 sequences per species) and query data sets (4 sequences per species). The reference data sets were considered as DNA barcode reference libraries containing sequences with a priori assigned species membership. The query data sets were considered to comprise unknown DNA barcodes, although in our case species membership was known because they were simulated together with the reference data set. Consequently, accuracy of their identification could be evaluated a posteriori.
Empirical data sets
We selected three published empirical DNA barcode data sets based on the following criteria: 1. Data contain species that are problematic to identify using DNA barcodes because of incomplete clustering in barcode trees; 2. Data encompass high phylogenetic diversity, i.e. from different phyla (Plantae, Mollusca and Arthropoda), to ensure the general applicability of our outcomes; 3. Data come from different markers, i.e. from all three genomic compartments. A summary of the selected data can be found in Table 1; details are below:
Drosophila. Lou and Golding [33] used this data set to test the ability of algorithms to assign sequences to species in the absence of a barcode gap. They found that many species are siblings with low between-species distances and some have no ‘barcode gap’ [23], [33]. Drosophila species are also known to have relatively large Ne’s and associated high within-species divergence [80], [81]. The data set comprised 615 barcodes from 19 species.
Inga (Fabaceae) is a large genus of tropical leguminous trees. Many morphologically distinct Inga species collected in the southwestern Amazon are incompletely sorted in DNA barcode trees [1]. No Ne estimates for Inga are available. We selected the data set from Dexter et al. [1] who linked cpDNA trnTD intron and nrDNA Internally Transcribed Spacer (ITS) sequences into a multi-locus DNA barcode of 1713–1771 nucleotides in total. The data set comprised 913 barcodes from 56 species
Cypraeidae (Mollusca) are taxonomically one of the most extensively studied marine gastropods. Although Meyer & Paulay showed that subspecies rather than species best represent diversity in these DNA barcodes [31] we adhered to species names, mainly because subspecies were generally less well sampled. No Ne estimates for Cypraeidae are available. The data set comprised 2008 mtDNA COI sequences of 211 species and had almost complete coverage of sister-species, some of which are reported to have diverged only recently [31].
Only those species represented by 5 or more sequences were evaluated in the identification assessments. Their sequences were randomly distributed over a reference data set (80% per species) and a query data set (20% per species). Species represented by less than 5 sequences were kept in the reference data set, but not evaluated in the identification assessments (i.e. their sequences could therefore only contribute to the false positive rate of the query sequences that were evaluated).
Species ‘barcode gap’ and monophyly
To assess the existence of a ‘barcode gap’ in our data sets, we extracted within- and between- species K2P [82] distances from all 50 species in all 300 simulated reference data sets (100 of each Ne) and made comparisons between Ne's. We are aware that using K2P implies effective under-parameterization [83] as we used HKY in the simulations, but we chose K2P as it is typically used in DNA barcode analyses (e.g. [10], [15], [17], [25], [84]). Repeating the analysis using HKY did not give different results (not shown). We evaluated the existence of ‘barcode gaps’ at species level by scoring a species as having a ‘barcode gap’ when the minimum between-species sequence distance exceeded the maximum within-species distance [31], [85].
We assessed species-monophyly in DNA barcode trees of all 50 species in all 300 simulated reference data sets and subsequently compared results between Ne's. DNA barcode trees were reconstructed using NJ and parsimony using settings described below, and species were scored as either monophyletic or non-monophyletic based on the DNA barcode tree topologies.
Method performance
Neighbor joining (NJ).
We used the neighbor joining algorithm [48] implemented in the R. package APE 2.5–3 [86] and applied randomly shuffling of input order of sequences. We assessed tree topology in two ways, following Ross et al. [37]. 1. ‘Strict assessment’ meant that if the query was nested within a mono-specific cluster or clade it was identified as that species. Otherwise its identification was considered uncertain. This is equivalent to the ‘Tree based identification, revised criteria’ used by Meier et al. [53] and is reported to have significantly lower false-positive rates [37]. 2. ‘Liberal assessment’ meant that if the query was sister to a mono-specific cluster it was identified as that species. Otherwise its identification was considered uncertain.
Parsimony (PAR).
Maximum parsimony trees were estimated using TNT version 1.1 [87]. Heuristic searches consisted of iterations of ratchet, sectorial searches, tree drift and tree fusing algorithms [88] through the TNT built-in function ‘xmult’, holding 1000 trees during search (‘hold 1000’). Searches were stopped when four independent replicates found shortest trees of the same length (‘xmult = hits 4’). Identical sequences were excluded before analysis and later restored to save computation time (‘riddup’). Only one maximum parsimony tree was held after each analysis to make results comparable to NJ. We assessed tree topology in the same way as described for NJ above.
Nearest neighbor (NN).
Nearest neighbors were calculated using the ‘dist.dna’ function in the R. package APE version 2.5–3 [86] based on the K2P model of sequence evolution [82]. A query was identified as the species associated with its nearest neighbor (reference sequence with lowest distance to that query). In case nearest neighbors were from more than one species the query's identification was considered uncertain.
BLAST.
Identification based on BLAST was performed using NCBI software version 2.2.25+ [89]. Reference data sets were stored in a BLAST database for subsequent matching with query sequences. Up to 100 hits with at least 80% identity were returned for each query, which was identified as the species associated with its best hit (highest bit score). In case more than one species were associated the query's identification was considered uncertain.
DNA-BAR.
Reference data sets were converted to a matrix comprising presence/absence of distinguishers (sequence substrings) using the software ‘degenbar’ [65]. Input parameters were as follows: distinguishers of length 5–50 nucleotides (‘l-min 5’, ‘l-max 50’), up to 100 redundant distinguishers (‘Redundancy 100’), GC content 0–100% (‘MinCandidGC 0’, ‘MaxCandidGC 100’), annealing temperature 0–100°C (‘MinCandidTemp 0’, ‘MaxCandidTemp 100’), salt and DNA concentration 50 nM (‘SaltConc 50’, ‘DNAconc 50’), and a maximum common substring weight of 100 (‘MaxCommSubstrWt 100’) (note that degenbar was originally designed to pick DNA probes). In case of multi-locus DNA barcodes (i.e. Inga data set) loci in the reference alignment were separated by 50 ‘N’ positions. The presence/absence matrix of distinguishers was then used as reference data set. Each query sequence was scored for presence/absence of distinguishers and identified as the species associated with the reference sequence with the greatest number of matching presence/absences. In case more than one reference sequence of the same species membership shared the greatest number of matches the query was identified as that species. In case reference sequences associated with different species shared the greatest number of matches identification was considered uncertain.
BLOG.
Diagnostic logic mining analyses were performed with BLOG software version 2.4 [64] which is available online [90] and on the Barcode Of Life Data Portal [91], [92] (an off-line version is available from EW upon request). Input parameters for feature selection were as follows: a maximum number of 35 features chosen (‘BETA = 35’), a maximum of 200 iterations (‘GRASPITER = 200’), and a maximum time of 500 minutes for analysis (‘GRASPSECS = 30000’). Each query sequence was scanned to see if it satisfied any of the logic formulas generated by BLOG and identified as the species associated with the matching logic formula. In case a query satisfied more than one logic formula the logic formula having lowest false positive rate on the reference data set was taken as the identification. In case error rates of logic formulas were equal identification was considered uncertain.
Statistical tests
We assessed relative performance of the six methods in terms of their identification success with simulated and empirical data. Identification success was defined in two ways: 1. ‘Species identification success’ was scored as the number of species for which all query sequences were correctly identified. 2. ‘Sequence identification success’ was scored as the number of correctly identified query sequences per data set, which is equivalent to sensitivity (i.e. true positives/[true positives + false negatives]).
We evaluated the influence of i) species divergence times (recently diverged versus old), ii) method used, and iii) Ne on species identification success, using Friedman tests [93] in which the sum of identification success measures per replicate was used as the observation. Significant differences between methods were revealed in post-hoc pairwise Wilcoxon signed rank tests based on paired observations [94]. To account for the large number of comparisons we applied Bonferroni correction [95] to all tests combined (i.e. multiplying p-values by total number of tests performed). A corrected value of P<0.01 was considered statistically significant.
Results
Data simulation
The 50 species in the simulated ultrametric species tree had divergence times between 98 and 553116 generations (see Figure S1). We classified half the species (with divergence times between 98 and 76621 generations) as ‘recently diverged’ and the other half (with divergence times between 76621 and 553116 generations) as ‘old’, see figure S1.
Species ‘barcode gap’ and monophyly
Maximum within-species distance equals or exceeded minimum between species distance for a substantial proportion (37%) of the species in the simulated data sets, indicating absence of a barcode gap. This proportion positively correlates with effective population size (Ne), which is explained mainly by an increase of the within-species distances under larger Ne, see Figure 2. On the contrary, with 54% for old species and 20% for recently diverged species this proportion decreases with increasing divergence time (mostly dark dots fall below the ‘barcode gap’ line in Figure 2).
Scatterplots of minimum between- over maximum within-species distance for 5000 simulated species in the reference data sets with 16 samples per species. Simulations under coalescence with effective population sizes (Ne) of 1000 (yellow, top), 10000 (purple, middle) and 50000 (blue, down) individuals. Brightness of the dots correlates with species divergence times, i.e. recently diverged species are dark and old species are light. Species plotted above the diagonal lines have a barcode gap.
As expected, percentage of species-monophyly was lower for species that had diverged more recently (Figure 3). While the oldest species (553116 generations) was always monophyletic the two youngest species (98 generations) were never. Between these extremes, percentages increased more rapidly for data sets simulated under coalescence with smaller Ne (Figure 3).
Scatterplot of percentage species monophyly (N = 100) based on NJ DNA barcode trees for 50 simulated species from the reference data sets (16 individuals per species) plotted against their divergence times. Simulations under coalescence with effective population sizes of 1000 (yellow squares), 10000 (purple dots) and 50000 (blue triangles) individuals.
Method performance
The comparative evaluation of methods shows, as expected, that species identification success generally decreased with increasing Ne, see Figure 4 for results across all methods (results for all methods separately are in Table S1). Data sets that were simulated according to the smallest Ne (1,000 individuals) had highest average success score with 89% (P<0.00001). With an average success score of 81%, datasets that were simulated according to the largest Ne (50,000 individuals) were most challenging in terms of species identification (P<0.00001). Similarly, species identification success rates of all methods are lower for species that have diverged more recently, see Figure 5 for results across all methods (results for all methods separately are in Table S2). On average, the 25 recently diverged species were correctly identified in 75% of cases, significantly less than 97% for the 25 old species (P<0.00001). Query identification success showed the same pattern, where scores for old species were generally higher than for recently diverged species and showed less variation (data not shown). We therefore report relative performance of methods compared for recently diverged species only (results for all species are given as supporting information in Table S3 and Figure S2).
Boxplots of percent species identification success (N = 100) based on query data sets simulated under coalescence with effective population sizes of 1000 (yellow), 10000 (purple) and 50000 (blue) individuals.
Boxplots of percent species identification success (N = 300) based on query data sets for species that were either recently diverged (divergence times between 98 and 76621 generations) or old (divergence times between 76621 and 553116 generations).
Diagnostic method BLOG performed best (86.2%) in terms of overall query identification success for recently diverged species based on simulated data (Table 2, Figure 6), although not significant (p = 0.033). Diagnostic method DNA-BAR (86.1%) as well as similarity-based methods NN (85.7%) and BLAST (85.6%) performed only slightly worse than BLOG and significantly better than tree-based methods (P<0.00001). Of the two tree-based methods NJ generally performed better than PAR and liberal assignment performed better than strict assignment for both methods (all P<0.00001).
Boxplots of sequence identification success (N = 300) of six methods that were applied to recently diverged species in simulated query data sets. NJ = neighbor joining, PAR = parsimony, NN = nearest neighbor. Success scores not significantly different in post-hoc pairwise Wilcoxon tests are indicated by same superscripts.
Empirical data sets
Based on empirical data diagnostic method BLOG performed best (93.1%) in terms of overall query identification success (see Table 3). Diagnostic method DNA-BAR performed only slightly worse (90.4%) and had the best score for two out of three empirical data sets (Inga and Cypraeidae). Detailed results per empirical data set can be found in Tables S4, S5, and S6.
Drosophila .
The most divergent Drosophila sequences had 19.5% pairwise distance, and the largest within-species divergence was 17.5% for D. angor. Fifteen of 19 species had sufficient coverage (i.e. were represented by 5 or more sequences). Based on the reference data set comprising 497 sequences, 11 species were monophyletic in a NJ tree (73.3%) and 9 had a ‘barcode gap’ (60.0%). Based on the query data set (118 sequences) BLOG outperformed all other methods in terms of query identification success (114 query sequences correctly identified). DNA-BAR and BLAST identified 99 query sequences correctly as did NJ and PAR based on liberal assignment; NN identified 97 query sequences correctly; NJ and PAR identified 95 query sequences correctly based on strict assignment; see Table 3.
Inga .
The two most divergent Inga sequences had 1.5% pairwise distance, and largest within-species divergence was 0.7% for I. capitata. Thirty five of 56 species had sufficient coverage (i.e. were represented by 5 or more sequences). Based on the reference data set (736 sequences) 25 species were monophyletic in a NJ tree (71.4%) and only 16 had a ‘barcode gap’ (45.7%). Based on the query data set (172 sequences) DNA-BAR outperformed all other methods in terms of query identification success (162 query sequences correctly identified). NJ identified 157 query sequences correctly based on liberal assignment; BLOG identified 155 query sequences correctly as did NJ based on strict assignment. NN identified 152 query sequences correctly; BLAST identified 142 query sequences correctly; PAR identified 140 query sequences correctly based on liberal assignment and 138 based on strict assignment.
Cypraeidae.
The most divergent Cypraeidae sequences had 28.5% pairwise distance, and largest within-species divergence was 17.1% for Leporicypraea mappa. Hundred twelve of 211 species had sufficient coverage (i.e. were represented by 5 or more sequences). Based on the reference data set (1654 sequences) only 81 species were monophyletic in a NJ tree (38.4%) and only 77 had a ‘barcode gap’ (36.5%). Based on the query data set (354 sequences) DNA-BAR outperformed all other methods in terms of query identification success (330 query sequences correctly identified). BLOG and BLAST identified 328 query sequences correctly; NJ identified 324 query sequences correctly based on strict assignment; NN identified 323 query sequences correctly; NJ identified 320 query sequences correctly based on strict assignment; PAR identified 302 query sequences correctly based on liberal assignment and 297 based on strict assignment.
Discussion
DNA barcoding works well for most species, although significant differences in population dynamics probably exist between, e.g. vertebrates, insects and plants. Indeed, DNA barcoding success rates have been estimated to be around 98% for animals and 70% for plants [96], [97], [98] with the relatively low success rate for the latter having been attributed to various causes such as high incident of hybrid species in angiosperms [99], long generation times or slow mutation rates of woody species [100] and limited dispersal of seeds [100], [101]. Overall, the fact that DNA barcoding works so well is considered to be mainly due to conspecific sequences generally having their coalescent well after time of species divergence [5].
Our results corroborate this notion in that, although our data sets contained incompletely-sorted species, identification success rates were generally high (>80%). Nevertheless, species that are recently diverged pose a consistent problem for identification based on DNA barcodes [1], [2], [31], [32], [33], [34], [39], as indicated by our findings in which methods proved not to be equally robust with regard to incomplete lineage sorting effects in recently diverged species (Figures 3 and 5). As such species are usually of special interest scientifically or from regulatory perspective [1], [2], [3], [12], [13], [14], [27], [28], [29], yet also difficult to identify using morphology [1], [11], [24], [27], [32], [84], finding robust analytical methods is warranted, and commonly used methods such as neighbor joining may not suffice.
Method performance
Tree-based methods.
Our results based on simulated data of recently diverged species show that DNA barcode identification of recently diverged species can be significantly improved by applying methods that do not rely on tree representation. The two tree-based methods tested here, i.e. neighbor joining (NJ) and parsimony (PAR), perform worst in terms of query identification success, even with liberal assignment. This finding is in concordance with results from other studies comparing relative performance of DNA barcoding methods [53], [57], [58], [102], as well as with the generally accepted notion that gene trees (i.e. DNA barcode trees) do not necessarily reflect organismal history [42].
PAR consistently and significantly achieved the lowest identification rates here. We see two possible explanations for this result: First, heuristic searches are not guaranteed to find the shortest (i.e. most parsimonious) tree(s) and our search settings may have been insufficiently thorough [88]. Further analysis of some data sets with more thorough search settings did not result in shorter trees being found, however (data not shown), indicating that settings were in fact adequate. Second, several equally parsimonious trees may exist of which only one was used for identification here. Having chosen randomly among equally parsimonious trees may therefore have affected results negatively. NJ will always find a single, fully resolved tree [48] which may have more biological relevance than a randomly chosen maximum parsimony tree, hence resulting in more correct identifications using NJ. We did not include barcode query identification based on a consensus of all most parsimonious trees, but because a consensus tree by definition has reduced resolution we do not expect this could increase performance based on PAR.
For both tree-based methods (i.e. NJ and PAR) strict assignment (i.e. requiring a query to be nested within a monospecific clade for identification) significantly reduced identification success compared to liberal assignment (i.e. allowing identification of a query that is sister to a monospecific clade). This was as expected because when a query is sister to a monospecific clade strict assignment yields an uncertain identification whereas liberal assignment will assign it to the species associated with that clade [37]. Although identification can be wrong in some of these cases, even few correct identifications will result in a higher success rate for liberal assignment compared with strict assignment [37], [57].
There are other tree-based methods for matching DNA barcodes available but we expect that these do not outperform NJ as tested here. For example, Bayesian methods for tree inference [51] do not find a single, fully resolved tree and will therefore share the drawbacks of PAR. The Statistical Assignment Package (SAP) [49] was already found to perform less well than NJ on a Gymnosperm multi-locus DNA barcode data set, even when using the ‘constrained NJ’ algorithm for tree estimation [58].
Similarity-based and diagnostic methods.
These methods perform significantly better with 31% reduction of error rates compared to tree-based methods (26% when counting tree-based results using liberal assignment only), see Table 2 and Figure 6. Although not significant, diagnostic methods (i.e. BLOG and DNA-BAR) outperformed all other methods tested here. This confirms their suspected superiority as they allow selecting differentiating characters whilst ignoring any obscuring within-species variation [46]. Obviously, diagnostic methods are not guaranteed to have this advantage in all cases. For example, in another study [58] the diagnostic method CAOS [61] did not perform well; possibly because it is dependent upon tree topology for extracting diagnostic characters. The two similarity-based methods (i.e. NN and BLAST) performed only slightly worse compared to the diagnostic methods. This may seem surprising because of the large overlap of within- and between-species distances in our data sets (see Figure 2). But even when there is no ‘barcode gap’ for a particular species, the closest match for a query sequence can well be conspecific, resulting in correct identification [53]. The two methods tested here either require (NN) or produce (BLAST) a sequence alignment, but reliable homology assessment and alignment can be problematic when sequences are variable in length [55], [57]. Alternative similarity-based methods have been proposed that make a projection of sequences based on the decomposition of sequence strings and are therefore in effect alignment-free [35], [55], [56], [57], [58]. String decomposition can be performed in various ways, however, and optimal settings may differ between data sets. For example, preliminary tests of query identification using the recently proposed alignment-free method BRONX [58] showed high success rates for the multi-locus Inga data set (90.1%) but very low success rates for the Drosophila (53.4%) and Cypraeidae (74.6%) data sets, using the same (default) settings (data not shown).
Although diagnostic and similarity-based methods show similar performance in terms of correct query identification, they markedly differ in their computational cost. Similarity methods such as NN and BLAST are computationally relatively inexpensive because they only involve finding a query’s closest match [37]. By contrast, diagnostic methods must select and extract diagnostic characters, which is computationally expensive [64]. As an example, while the NN analysis of a simulated data set took only ∼2 seconds on a 3GHz dual core desktop computer, analyzing the same data set with BLOG required ∼7 minutes of computation (both analyses using one thread only). Nevertheless, a similarity analysis such as NN has to be repeated for every query sequence requiring identification, thus multiplying the computation time by the number of queries. Diagnostic characters, once they are extracted, can be used to identify any query sequence by simply matching it to these diagnostics – which is much faster than similarity matching in the case of BLOG.
An essential advantage of BLOG over all other methods tested here is that the diagnostic logic formulas extracted by BLOG contain additional information with regards to species identification [64]. Such formulas list the nucleotide(s) by which a species can be differentiated from others and as such can be compared with species descriptions in the traditional taxonomic sense [66]. Other methods can then be compared with trying to match an unknown specimen to all specimens in a collection. We envision that the logic formulas can provide valuable information for other applications. For example, the formulas can be included in species descriptions and taxonomic revisions [103], whereas relative similarities cannot. Obviously, diagnostic formulas exist only relative to a particular alignment but the same is true for morphological characteristics traditionally used for describing species, and in well-sampled clades this problem may well disappear. Diagnostic logic formulas can also be used for designing detection assays based on species-specific nucleotides (e.g. DNA chips and microarrays) and hence assist the development of tools for monitoring and regulation of species. For this purpose DNA-BAR is potentially even better suited than BLOG because it extracts diagnostics that are (combinations of) actual sequence strings that can be used as DNA probes [65]. However, DNA-BAR does not incorporate species-level information in its analysis and selects diagnostics for sequences rather than for species [65]. Moreover, diagnostics selected by DNA-BAR appear to be much more complex than the diagnostic logic formulas extracted by BLOG (personal observations), making DNA-BAR less suitable for extracting species-specific information.
The greatest challenge for diagnostic methods is scalability. Because diagnostic characters are dependent on their context, finding simple diagnostics becomes more difficult with increasing size of the reference database. For example, preliminary analysis of a large data set with 3000 DNA barcodes from over 600 bird species (data not shown) indicate that an alignment of such size is prohibitive for finding simple species-specific logic formulas using the current version of BLOG. Because datasets are ever increasing in size this is an important problem that can be in general tackled in different ways. With reference to this specific application, we see two solutions: 1. A similarity approach with some species groups flagged as ‘problematic’: Identification of a member of such group would then need to be confirmed with diagnostics specific for species in that group. 2. A combined similarity- and diagnostic approach where sequences are first binned into local alignments (e.g. at the level of families or genera) based on similarity; subsequently, diagnostics are applied only within these local alignments.
Statistical methods.
We did not test any statistical methods for identification based on DNA barcodes. Nevertheless, when species identifications have economic or legal implications (e.g. in detection of quarantine organisms or forensics) there is an obvious need for probabilities associated with barcode matches. However, DNA barcode sequences are essentially short, meaning that they typically contain insufficient information to feed probabilistic models, especially when recently diverged species are concerned. We would therefore advocate confirmation of identifications based on DNA barcodes by other lines of evidence (e.g. multiple independent loci, serological tests or morphological expert opinion) rather than relying on DNA barcodes only in such cases.
Empirical data sets
Our results based on empirical data are largely consistent with results based on simulated data. Few differences in overall results exist, however: Where scores for tree-based NJ were suboptimal based on simulated data, they were comparable to at least some of the similarity-based and diagnostic methods when applied to the empirical data sets. For the Drosophila data set PAR performed equally well as NJ. It should be noted that with only three data sets assessing significance of differences in method performance is limited, underlining the advantage of using simulated data. In addition, DNA barcode identification success can depend on taxonomic sampling. In ‘regional’ data sets (i.e. samples from a particular geographic region only) within-species variation is usually underestimated because of un-sampled haplotypes, while between-species differences are usually overestimated because of un-sampled taxa [31], [38], [39], [53], [104]. Therefore, regional data sets such as Inga are expected to inflate DNA barcode identification success rates in contrast to ‘clade-based’ data sets (i.e. sampling all extant species across their entire distribution) such as Cypraeidae. Nevertheless, because the selected data sets comprise genetic markers from all three genomic compartments, result from different sampling efforts and represent broad phylogenetic diversity (i.e. insects, plants and gastropods) we interpret consistency in our findings as an indication that they will equally apply to other genetic markers and clades.
Conclusion
We found similarity-based (NN, BLAST) and diagnostic methods (BLOG, DNA-BAR) to significantly outperform tree-based methods (NJ, PAR), when applied to simulated DNA barcode data of recently diverged species. Diagnostic methods BLOG and DNA-BAR performed best on both simulated and empirical data and BLOG had the highest correct query identification rate overall. Although similarity-based methods have better scalability compared to BLOG they do not reveal any species-level information that can be used outside the realm of DNA barcoding. Diagnostic logic formulas extracted by BLOG provide information that can be used for e.g. taxonomy and species detection assays. Method choice therefore should depend on requirement of either computation speed or information content. In the end, recently diverged species remain difficult to identify, but we expect that our results contribute to alleviating this problem.
Supporting Information
Figure S1.
Simulated ultrametric species tree. Tree with 50 species simulated under the Yule model and with a total tree depth of 1 million generations. Terminal branches subtending species considered as ‘recently diverged’ are in red, those subtending species considered as ‘old’ are in blue.
https://doi.org/10.1371/journal.pone.0030490.s001
(TIF)
Figure S2.
Relative method performance based on simulated data for all species. Boxplots of query identification success (N = 300) of six methods that were applied to ‘recently diverged’ species in simulated query data sets. NJ = neighbor joining, PAR = parsimony, NN = nearest neighbor. Success scores not significantly different in post-hoc pairwise Wilcoxon tests are indicated by same superscripts.
https://doi.org/10.1371/journal.pone.0030490.s002
(TIF)
Table S1.
Influence of effective population size ( Ne ) on species identification success per method compared.
https://doi.org/10.1371/journal.pone.0030490.s003
(PDF)
Table S2.
Influence of divergence time on species identification success per method compared.
https://doi.org/10.1371/journal.pone.0030490.s004
(PDF)
Table S3.
Method performance based on simulated data for all species.
https://doi.org/10.1371/journal.pone.0030490.s005
(PDF)
Table S4.
Results for all 15 species represented by 5 or more sequences in the Drosophila empirical data set.
https://doi.org/10.1371/journal.pone.0030490.s006
(PDF)
Table S5.
Results for all 35 species represented by 5 or more sequences in the Inga empirical data set.
https://doi.org/10.1371/journal.pone.0030490.s007
(PDF)
Table S6.
Results for all 112 species represented by 5 or more sequences in the Cypraeidae empirical data set.
https://doi.org/10.1371/journal.pone.0030490.s008
(PDF)
Acknowledgments
We thank the following people for kindly sharing empirical data sets for analysis: Brian Golding and Melanie Lou provided data of Drosophila, Kyle Dexter provided data of Inga, Chris Meyer provided data of Cypraeidae. Paola Bertolazzi and Guido Drovandi are acknowledged for their contribution to BLOG software engineering and scientific advice. Leandro Jones and Wayne Matten gave advice on configuration of TNT and BLAST, respectively. Marleen Botermans and Marc Sosef commented on early drafts of the manuscript and the editor and a reviewer provided valuable suggestions for further improvement.
Author Contributions
Conceived and designed the experiments: RvV FTB. Performed the experiments: RvV. Analyzed the data: RvV EW. Contributed reagents/materials/analysis tools: EW GF. Wrote the paper: RvV FTB. Designed BLOG software used in the analysis: EW GF. Contributed to improvement of BLOG software: RvV. Helped draft the manuscript: EW GF.
References
- 1. Dexter KG, Pennington TD, Cunningham CW (2010) Using DNA to assess errors in tropical tree identifications: How often are ecologists wrong and when does it matter? Ecol Monogr 80: 267–286.
- 2. Wallman JF, Donnellan SC (2001) The utility of mitochondrial DNA sequences for the identification of forensically important blowflies (Diptera: Calliphoridae) in southeastern Australia. Forensic Sci Int 120: 60–67.
- 3. Armstrong KF, Cameron CM, Frampton ER (1997) Fruit fly (Diptera: Tephritidae) species identification: A rapid molecular diagnostic technique for quarantine application. Bull Entomol Res 87: 111–118.
- 4. Hebert PDN, Cywinska A, Ball SL, DeWaard JR (2003) Biological identifications through DNA barcodes. Proc R Soc B 270: 313–321.
- 5. Hebert PDN, Ratnasingham S, deWaard JR (2003) Barcoding animal life: cytochrome c oxidase subunit 1 divergences among closely related species. Proc R Soc B 270: S96–S99.
- 6. Hebert PDN, Gregory TR (2005) The promise of DNA barcoding for taxonomy. Syst Biol 54: 852–859.
- 7. Schindel DE, Miller SE (2005) DNA barcoding a useful tool for taxonomists. Nature 435: 17–17.
- 8. Bickford D, Lohman DJ, Sodhi NS, Ng PKL, Meier R, et al. (2007) Cryptic species as a window on diversity and conservation. Trends Ecol Evol 22: 148–155.
- 9. Lahaye R, Van der Bank M, Bogarin D, Warner J, Pupulin F, et al. (2008) DNA barcoding the floras of biodiversity hotspots. Proc Natl Acad Sci U S A 105: 2923–2928.
- 10. Neigel J, Domingo A, Stake J (2007) DNA barcoding as a tool for coral reef conservation. Coral Reefs 26: 487–499.
- 11. McBride CS, Van Velzen R, Larsen TB (2009) Allopatric origin of cryptic butterfly species that were discovered feeding on distinct host plants in sympatry. Mol Ecol 18: 3639–3651.
- 12. Aveskamp MM, Woudenberg JHC, De Gruyter J, Turco E, Groenewald JZ, et al. (2009) Development of taxon-specific sequence characterized amplified region (SCAR) markers based on actin sequences and DNA amplification fingerprinting (DAF): a case study in the Phoma exigua species complex. Mol Plant Pathol 10: 403–414.
- 13. Boykin LM, Shatters RG, Hall DG, Burns RE, Franqui RA (2006) Analysis of host preference and geographical distribution of Anastrepha suspensa (Diptera : Tephritidae) using phylogenetic analyses of mitochondrial cytochrome oxidase I DNA sequence data. Bull Entomol Res 96: 457–469.
- 14. Skoracka A, Dabert M (2010) The cereal rust mite Abacarus hystrix (Acari: Eriophyoidea) is a complex of species: evidence from mitochondrial and nuclear DNA sequences. Bull Entomol Res 100: 263–272.
- 15. Bucciarelli G, Golani D, Bernardi G (2002) Genetic cryptic species as biological invaders: the case of a Lessepsian fish migrant, the hardyhead silverside Atherinomorus lacunosus. J Exp Mar Biol Ecol 273: 143–149.
- 16. Hubert N, Hanner R, Holm E, Mandrak NE, Taylor E, et al. (2008) Identifying Canadian Freshwater Fishes through DNA Barcodes. PLoS ONE 3: e2490.
- 17. Ward RD, Costa FO, Holmes BH, Steinke D (2008) DNA barcoding of shared fish species from the North Atlantic and Australasia: minimal divergence for most taxa, but Zeus faber and Lepidopus caudatus each probably constitute two species. Aquatic Biology 3: 71–78.
- 18. Zemlak TS, Ward RD, Connell AD, Holmes BH, Hebert PDN (2009) DNA barcoding reveals overlooked marine fishes. Mol Ecol Resour 9: 237–242.
- 19. Griffiths AM, Sims DW, Cotterell SP, El Nagar A, Ellis JR, et al. (2010) Molecular markers reveal spatially segregated cryptic species in a critically endangered fish, the common skate (Dipturus batis). Proc R Soc B 277: 1497–1503.
- 20. Ward RD, Zemlak TS, Innes BH, Last PR, Hebert PDN (2005) DNA barcoding Australia's fish species. Phil Trans R Soc B 360: 1847–1857.
- 21. May GE, Gelembiuk GW, Panov VE, Orlova MI, Lee CE (2006) Molecular ecology of zebra mussel invasions. Mol Ecol 15: 1021–1031.
- 22. Hsieh CH, Wang CH, Ko CC (2007) Evidence from molecular markers and population genetic analyses suggests recent invasions of the western north pacific region by biotypes B and Q of Bemisia tabad (Gennadius). Environ Entomol 36: 952–961.
- 23. Yassin A, Capy P, Madi-Ravazzi L, Ogereau D, David JR (2008) DNA barcode discovers two cryptic species and two geographical radiations in the invasive drosophilid Zaprionus indianus. Mol Ecol Resour 8: 491–501.
- 24. Newmaster SG, Ragupathy S (2009) Testing plant barcoding in a sister species complex of pantropical Acacia (Mimosoideae, Fabaceae). Mol Ecol Resour 9: 172–180.
- 25. Armstrong KF, Ball SL (2005) DNA barcodes for biosecurity: invasive species identification. Phil Trans R Soc B 360: 1813–1823.
- 26. Bastos A, Nair D, Taylor P, Brettschneider H, Kirsten F, et al. (2011) Genetic monitoring detects an overlooked cryptic species and reveals the diversity and distribution of three invasive Rattus congeners in south Africa. BMC Genet 12: 26.
- 27. Nolan DV, Carpenter S, Barber J, Mellor PS, Dallas JF, et al. (2007) Rapid diagnostic PCR assays for members of the Culicoides obsoletus and Culicoides pulicaris species complexes, implicated vectors of bluetongue virus in Europe. Vet Microbiol 124: 82–94.
- 28. Paredes-Esquivel C, Donnelly MJ, Harbach RE, Townson H (2009) A molecular phylogeny of mosquitoes in the Anopheles barbirostris Subgroup reveals cryptic species: Implications for identification of disease vectors. Mol Phylogenet Evol 50: 141–151.
- 29. Azpurua J, De La Cruz D, Valderama A, Windsor D (2010) Lutzomyia Sand Fly Diversity and Rates of Infection by Wolbachia and an Exotic Leishmania Species on Barro Colorado Island, Panama. PLoS Negl Trop Dis 4: e627.
- 30. McKeon S, Lehr M, Wilkerson R, Ruiz J, Sallum M, et al. (2010) Lineage divergence detected in the malaria vector Anopheles marajoara (Diptera: Culicidae) in Amazonian Brazil. Malar J 9: 271.
- 31. Meyer CP, Paulay G (2005) DNA barcoding: Error rates based on comprehensive sampling. PLoS Biol 3: 2229–2238.
- 32. Kaila L, Stahls G (2006) DNA barcodes: Evaluating the potential of COI to diffentiate closely related species of Elachista (Lepidoptera: Gelechioidea: Elachistidae) from Australia. Zootaxa 1170: 1–26.
- 33. Lou M, Golding GB (2010) Assigning sequences to species in the absence of large interspecific differences. Mol Phylogenet Evol 56: 187–194.
- 34. Yassin A, Markow TA, Narechania A, O'Grady PM, DeSalle R (2010) The genus Drosophila as a model for testing tree- and character-based methods of species identification using DNA barcoding. Mol Phylogenet Evol 57: 509–517.
- 35. Austerlitz F, David O, Schaeffer B, Bleakley K, Olteanu M, et al. (2009) DNA barcode analysis: a comparison of phylogenetic and statistical classification methods. BMC Bioinformatics 10 Suppl 14S10.
- 36. McFadden CS, Benayahu Y, Pante E, Thoma JN, Nevarez PA, et al. (2011) Limitations of mitochondrial gene barcoding in Octocorallia. Mol Ecol Resour 11: 19–31.
- 37. Ross HA, Murugan S, Li WLS (2008) Testing the reliability of genetic methods of species identification via simulation. Syst Biol 57: 216–230.
- 38. Wiemers M, Fiedler K (2007) Does the DNA barcoding gap exist? - a case study in blue butterflies (Lepidoptera: Lycaenidae). Front Zool 4: 8.
- 39. Elias M, Hill RI, Willmott KR, Dasmahapatra KK, Brower AVZ, et al. (2007) Limited performance of DNA barcoding in a diverse community of tropical butterflies. Proc R Soc B 274: 2881–2889.
- 40. Kingman JFC (1982) On the Genealogy of Large Populations. Journal of Applied Probability 19A: 27–43.
- 41.
Hudson R, Futuyama D, Antonovics J (1990) Gene genealogies and the coalescent process. Oxford Surveys in Evolutionary Biology vol. 7: Oxford University Press.
- 42. Nichols R (2001) Gene trees and species trees are not the same. Trends Ecol Evol 16: 358–364.
- 43. Elias M, Hill RI, Willmott KR, Dasmahapatra KK, Brower AVZ, et al. (2007) Limited performance of DNA barcoding in a diverse community of tropical butterflies. Proceedings of the Royal Society B-Biological Sciences 274: 2881–2889.
- 44. Nielsen R, Matz M (2006) Statistical approaches for DNA barcoding. Syst Biol 55: 162–169.
- 45. Funk DJ, Omland KE (2003) Species-level paraphyly and polyphyly: Frequency, causes, and consequences, with insights from animal mitochondrial DNA. Annu Rev Ecol Evol Syst 34: 397–423.
- 46. DeSalle R, Egan MG, Siddall M (2005) The unholy trinity: taxonomy, species delimitation and DNA barcoding. Phil Trans R Soc B 360: 1905–1916.
- 47. Rach J, DeSalle R, Sarkar IN, Schierwater B, Hadrys H (2008) Character-based DNA barcoding allows discrimination of genera, species and populations in Odonata. Proc R Soc B 275: 237–247.
- 48. Saitou N, Nei M (1987) The neighbor joining method - a new method for reconstructing phylogenetic trees. Mol Biol Evol 4: 406–425.
- 49. Munch K, Boomsma W, Willerslev E, Nielsen R (2008) Fast phylogenetic DNA barcoding. Phil Trans R Soc B 363: 3997–4002.
- 50. Edwards A, Cavalli-Sforza L (1963) The reconstruction of evolution. Ann Hum Genet 27: 105–106.
- 51. Huelsenbeck JP, Ronquist F (2001) MRBAYES: Bayesian inference of phylogenetic trees. Bioinformatics 17: 754–755.
- 52. Floyd R, Abebe E, Papert A, Blaxter M (2002) Molecular barcodes for soil nematode identification. Mol Ecol 11: 839–850.
- 53. Meier R, Shiyang K, Vaidya G, Ng PKL (2006) DNA barcoding and taxonomy in diptera: A tale of high intraspecific variability and low identification success. Syst Biol 55: 715–728.
- 54. Altschul SF, Madden TL, Schäffer AA, Zhang J, Zhang Z, et al. (1997) Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Res 25: 3389–3402.
- 55. Kuksa P, Pavlovic V (2009) Efficient alignment-free DNA barcode analytics. BMC Bioinformatics 10:
- 56. Seo T-K (2010) Classification of Nucleotide Sequences Using Support Vector Machines. J Mol Evol 71: 250–267.
- 57. Little DP, Stevenson DW, Cullman LB, Cullman D (2008) A comparison of algorithms for identification of specimens using DNA barcodes: examples from gymnosperms. Cladistics 24: 97–97.
- 58. Little DP (2011) DNA Barcode Sequence Identification Incorporating Taxonomic Hierarchy and within Taxon Variability. PLoS ONE 6: e26619.
- 59. Matz MV, Nielsen R (2005) A likelihood ratio test for species membership based on DNA sequence data. Phil Trans R Soc B 360: 1969–1974.
- 60. Abdo Z, Golding GB (2007) A step toward barcoding life: A model-based, decision-theoretic method to assign genes to preexisting species groups. Syst Biol 56: 44–56.
- 61. Sarkar IN, Planet PJ, Desalle R (2008) CAOS software for use in character-based DNA barcoding. Mol Ecol Resour 8: 1256–1259.
- 62. Sarkar IN, Planet PJ, Bael TE, Stanley SE, Siddall M, et al. (2002) Characteristic attributes in cancer microarrays. J Biomed Inform 35: 111–122.
- 63. Sarkar IN, Thornton JW, Planet PJ, Figurski DH, Schierwater B, et al. (2002) An automated phylogenetic key for classifying homeoboxes. Mol Phylogenet Evol 24: 388–399.
- 64. Bertolazzi P, Felici G, Weitschek E (2009) Learning to classify species with barcodes. BMC Bioinformatics 10(Suppl 14): S7.
- 65. DasGupta B, Konwar KM, Măndoiu II, Shvartsman AA (2005) DNA-BAR: distinguisher selection for DNA barcoding. Bioinformatics 21: 3424–3426.
- 66. Goldstein PZ, DeSalle R (2011) Integrating DNA barcode data and taxonomic practice: Determination, discovery, and description. BioEssays 33: 135–147.
- 67. Zou S, Li Q, Kong L, Yu H, Zheng X (2011) Comparing the Usefulness of Distance, Monophyly and Character-Based DNA Barcoding Methods in Species Identification: A Case Study of Neogastropoda. PLoS ONE 6: e26619.
- 68. Reid BN, Le M, McCord WP, Iverson JB, Georges A, et al. (2011) Comparing and combining distance-based and character-based approaches for barcoding turtles. Mol Ecol Resour 11: 956–967.
- 69. Ratnasingham S, Hebert PDN (2007) BOLD: The Barcode of Life Data System. 7: 355–364. Available: www.barcodinglife.org. Mol Ecol Notes.
- 70. Koski LB, Golding GB (2001) The closest BLAST hit is often not the nearest neighbor. J Mol Evol 52: 540–542.
- 71. Weitschek E, van Velzen R, Felici G (2011) Species classification using DNA Barcode sequences: A comparative analysis. IASI-CNR. R 11-07:
- 72. Bertolazzi P, Felici G, Festa P, Lancia G (2008) Logic classification and feature selection for biomedical data. Comput Math Appl 55: 889–899.
- 73.
Bertolazzi P, Felici G, Lancia G (2010) Application of Feature Selection and Classification to Computational Molecular Biology. In: Chen JY, Lonardi S, editors. Biological Data Mining. Boca Raton: Chapman & Hall/CRC. pp. 257–294.
- 74. Felici G, Truemper K (2002) A MINSAT approach for learning in logic domains. INFORMS Journal on Computing 14: 20–36.
- 75. Maddison WP, Maddison DR (2010) Mesquite: a modular system for evolutionary analysis. 2.73. Available: http://mesquiteproject.org. Accessed 2011 Dec 27.
- 76. Maddison WP, Maddison DR (2010) Coalescence Package for Mesquite. 2.73. Available: http://mesquiteproject.org. Accessed 2011 Dec 27.
- 77. Steel M, McKenzie A (2001) Properties of phylogenetic trees generated by Yule-type speciation models. Math Biosci 170: 91–112.
- 78. Hasegawa M, Kishino H, Yano TA (1985) Dating of the human ape splitting by a molecular clock of mitochondrial-DNA. J Mol Evol 22: 160–174.
- 79. Posada D (2008) jModelTest: Phylogenetic model averaging. Mol Biol Evol 25: 1253–1256.
- 80. Castillo D, Mell J, Box K, Blumenstiel J (2011) Molecular evolution under increasing transposable element burden in Drosophila: A speed limit on the evolutionary arms race. BMC Evol Biol 11: 258.
- 81. Petit N, Barbadilla A (2009) Selection efficiency and effective population size in Drosophila species. J Evol Biol 22: 515 - 526:
- 82. Kimura M (1980) A simple method for estimating evolutionary rates of base substitutions through comparative studies of nucleotide-sequences. J Mol Evol 16: 111–120.
- 83. Lemmon AR, Moriarty EC (2004) The Importance of Proper Model Assumption in Bayesian Phylogenetics. Syst Biol 53: 265–277.
- 84. Van Velzen R, Larsen TB, Bakker FT (2009) A new hidden species of the Cymothoe caenis-complex (Lepidoptera: Nymphalidae) from western Africa. Zootaxa 2197: 53–63.
- 85. Meier R, Zhang G, Ali F (2008) The Use of Mean Instead of Smallest Interspecific Distances Exaggerates the Size of the “Barcoding Gap” and Leads to Misidentification. Syst Biol 57: 809–813.
- 86. Paradis E, Claude J, Strimmer K (2004) APE: Analyses of Phylogenetics and Evolution in R language. Bioinformatics 20: 289–290.
- 87. Goloboff PA, Farris JS, Nixon KC (2008) TNT, a free program for phylogenetic analysis. Cladistics 24: 774–786.
- 88. Goloboff PA (1999) Analyzing Large Data Sets in Reasonable Times: Solutions for Composite Optima. Cladistics 15: 415–428.
- 89. Zhang Z, Schwartz S, Wagner L, Miller W (2000) A greedy algorithm for aligning DNA sequences. J Comput Biol 7: 203–214.
- 90. BLOG - Barcoding with LOGic formulas. Available: http://dmb.iasi.cnr.it/blog.php. Accessed 2011 Dec 23.
- 91. Sarkar IN, Trizna M (2011) The Barcode of Life Data Portal: Bridging the Biodiversity Informatics Divide for DNA Barcoding. PLoS ONE 6: e14689.
- 92. Barcode of Life Data Portal. Available: http://bol.uvm.edu. Accessed 2011 Dec 23.
- 93. Friedman M (1937) The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance. J Amer Statist Assoc 32: 675–701.
- 94. Wilcoxon F (1947) Probability Tables for Individual Comparisons by Ranking Methods. Biometrics 3: 119–122.
- 95.
Bonferroni C (1935) Il calcolo delle assicurazioni su gruppi di teste. Studi in Onore del Professore Salvatore Ortu Carboni. Rome: Tipografi del Senato. pp. 13–60.
- 96. Hebert PDN, deWaard JR, Landry JF (2010) DNA barcodes for 1/1000 of the animal kingdom. Biology Letters 6: 359–362.
- 97. Hollingsworth PM, Forrest LL, Spouge JL, Hajibabaei M, Ratnasingham S, et al. (2009) A DNA barcode for land plants. Proc Natl Acad Sci U S A 106: 12794–12797.
- 98. Dinca V, Zakharov EV, Hebert PDN, Vila R (2011) Complete DNA barcode reference library for a country's butterfly fauna reveals high performance for temperate Europe. Proc R Soc B 278: 347–355.
- 99. Fazekas AJ, Kesanakurti PR, Burgess KS, Percy DM, Graham SW, et al. (2009) Are plant species inherently harder to discriminate than animal species using DNA barcoding markers? Mol Ecol Resour 9: 130–139.
- 100. Hollingsworth PM, Graham SW, Little DP (2011) Choosing and Using a Plant DNA Barcode. PLoS ONE 6: e19254.
- 101. Petit RJ, Excoffier L (2009) Gene flow and species delimitation. Trends Ecol Evol 24: 386–393.
- 102. Virgilio M, Backeljau T, Nevado B, De Meyer M (2010) Comparative performances of DNA barcoding across insect orders. BMC Bioinformatics 11: 206.
- 103. Damm S, Schierwater B, Hadrys H (2010) An integrative approach to species discovery in odonates: from character-based DNA barcoding to ecology. Mol Ecol 19: 3881–3893.
- 104. Moritz C, Cicero C (2004) DNA barcoding: Promise and pitfalls. PLoS Biol 2: 1529–1531.