Main

Sexual selection can drive rapid divergence in mating signals and preferences, which may then lead to behavioural isolation among phenotypic variants and thereby facilitate speciation2. Although the potential for speciation by sexual selection has long been acknowledged, theoretical work has identified two major challenges for this mechanism to occur when there is gene flow between incipient species: (i) the association between a genetic mating trait and a genetic preference can easily be broken down by recombination5 and (ii) assortative mating often degrades genetic variation in mating traits and preferences, which eliminates the polymorphisms that provide the basis for future divergence6,7. Sexual imprinting—a phenomenon in which offspring learn parental phenotypes as the basis of their own mate preferences—presents a solution to the problem of recombination1,8. Because offspring inherit their mating trait from the parent or parents that they imprint on, the association between trait and preference reforms anew in each generation. The second challenge, of achieving stable polymorphisms, can be resolved by incorporating divergent ecological selection that acts directly on mating traits3 (known as ‘magic traits’9) or mating preferences (such as sensory drive10). However, in these scenarios natural selection is arguably a more important driver of speciation than is sexual selection, because of the contribution of natural selection to the origin and maintenance of trait and preference variation.

Assortative male–male competition that is mediated by the same mating signal that female preferences act on can also generate divergent selection through negative-frequency-dependent selection (known as ‘rare male advantage’11), and may provide an alternative mechanism by which sexual selection, on its own, can stabilize a polymorphism6,12. In this scenario, the mating trait inherently becomes a magic trait, which affects both divergence and reproductive isolation solely via sexual selection and without the need for a pleiotropic ecological effect. This mechanism may be widespread because sexually selected traits are often used for both mate choice and intrasexual aggression13. Furthermore, ‘species recognition’ (stronger behavioural responses towards conspecifics) often involves behavioural biases in both sexes14. Mathematical models6,15 that have incorporated male–male competition as the source of balancing selection have assumed that individuals are more competitive or aggressive towards individuals that share their own phenotype. However, as has been demonstrated for mating biases8, the mechanisms that shape aggressive behavioural biases are diverse (for example, genetic versus plastic)12,16,17, and the evolutionary trajectories that result from biases generated through these various mechanisms remain largely unexplored.

Here we tested for imprinted behaviours in a species that shows evidence of recent, rapid divergence in a sexually selected trait on which both female mate preferences and male aggressive biases act. In and around the Bocas del Toro archipelago of Panama, O. pumilio exhibits extreme, heritable polymorphisms in coloration18,19. Although most of the colour variation occurs among isolated island populations, there are a few areas of sympatric polymorphism18,20,21 (Fig. 1). The populations of O. pumilio in this region have probably experienced periods of vicariance and reconnection due to the rise and fall of sea levels; however, comparisons of neutral genotypic variation with phenotypic variation suggest a major role of selection in the rapid divergence of colours4. Despite evidence that colour can be aposematic in this species22, colour variants appear to incur similar risks of predation23,24. This suggests that differential predation—the most obvious candidate for natural selection—may have had a relatively minor role in shaping coloration in O. pumilio, compared to other poison frog species25. By contrast, sexual selection seems to be a strong driver of the evolution of colour differences in O. pumilio. In general, females prefer to court males that share their own colour morph over males with novel colour morphs21,26. Although males have not been studied as extensively, they are more aggressive towards their own colour morph27. Because no post-zygotic incompatibilities appear to exist19, these divergent, colour-biased sexual behaviours probably represent the most salient reproductive barrier among the colour morphs.

Fig. 1: Map of the Bocas del Toro archipelago, showing the diversity of colour and pattern among populations of O. pumilio.
figure 1

Top right, species range of O. pumilio across Nicaragua, Costa Rica and Panama. The location pin indicates the Bocas del Toro archipelago. Left, colour-monomorphic populations are labelled with a solid dot and an exemplar of the colour morph is shown next to the respective dot. Sympatric colour-polymorphic populations are labelled with a circled dot, and exemplars of the colour variants are shown on the right. Colour variation at Bastimentos West20 is discrete, whereas colour variation at Dolphin Bay21,27 and Rio Uyama18 is continuous. We used three allopatric colour morphs in the rearing experiment: those from Isla Popa, Isla Bastimentos and Tierra Oscura. Photographs by V. Prémel, J. P. Lawrence, S. A. Echeverri, I. J. Wang and Y.Y. Map data 2018, Google.

We tested the hypothesis that imprinting shapes both female mate preferences (referred to as ‘sexual imprinting’1,8) and male aggression biases (referred to as ‘rival imprinting’16) among three colour morphs of O. pumilio using a rearing experiment (Fig. 2). The biparental care exhibited by this species provides ample opportunity for tadpoles to observe adult colours. Adult males tend their eggs, and females transport tadpoles to waterholes on their backs and later feed their begging tadpoles with their own unfertilized eggs throughout larval development28. We tested for colour biases in female mate preference and male–male aggression of laboratory-reared, socially naive frogs that were either purebred (with both parents being of the same colour), crossbred (with each parent of a different colour) or cross-fostered (raised by foster parents of a different colour than the biological parents) (Fig. 2a, b). With one exception, males and females from the three rearing treatments spent similar amounts of time with the stimulus individuals (that is, were similarly responsive) (Supplementary Information). Overall, the behavioural patterns of courtship (in females) and rival aggression (in males) of the frogs were similar in all three treatments (Fig. 2c, d, Extended Data Table 1). Purebred offspring of either sex biased their interactions towards males of their own colour over those of another colour, which established the fact that laboratory-reared frogs exhibit similar colour-biased behaviours to those of wild O. pumilio. Cross-fostered offspring showed a bias towards the colour of their foster parents over that of their biological parents, which suggests that imprinting is more influential than genetics in shaping these colour-mediated behaviours. Additionally, crossbred offspring of either sex biased their interactions towards males that shared the colour of the offspring’s mother over males that shared the colour of the father, which suggests that interaction with the mother is more influential than interaction with the father in determining colour biases. We hypothesize that O. pumilio learn the coloration of their mother during the tadpole stage, and use it as a template for mate preference and rival aggression biases in adulthood. Our results suggest that maternal imprinting may be the key mechanism that mediates the colour-assortative behaviours that are seen among recently diverged colour morphs of O. pumilio.

Fig. 2: O. pumilio rearing experiment.
figure 2

a, Experimental design. Purebred denotes offspring raised by their biological parents, both of which were of the same colour morph. Crossbred denotes offspring raised by their biological parents, each of which was a different colour morph. Cross-fostered denotes offspring raised by foster parents (which had a colour morph different to that of the biological parents). The coloration of offspring from crossbred pairs has previously been described19. b, Experimental apparatus used in the behavioural assays. During behavioural observations, the two stimulus males were confined under clear plastic domes, and the focal individual could move freely in the arena. c, d, The proportions of the total time that female (c) and male (d) offspring spent with one of the two stimulus-male phenotypes during the behavioural assay. Purebred, own colour/(own colour + other colour); crossbred, colour of the mother/(colour of the mother + colour of the father); cross-fostered, colour of the foster parent/(colour of the foster parent + colour of the biological parent). Values above the dashed line (y = 0.5) indicate a preference or aggression bias that is consistent with maternal imprinting. P values were based on one-sided, one-sample permutational t-tests (Extended Data Table 1, Supplementary Information). Bold lines indicate medians. Boxes enclose 25th to 75th percentiles. Error bars enclose data range, excluding outliers. Dots are data points; dots that are vertically outside the error bars are outliers (below quartile 1, minus 1.5× the interquartile range or above quartile 3, plus 1.5× the interquartile range). The sample sizes (number of focal frogs) were purebred male, 11; purebred female, 12; crossbred male, 16; crossbred female, 19; cross-fostered male, 7; and cross-fostered female, 7.

We further explored the evolutionary implications of these imprinted behaviours using a simple population-genetics model, in which imprinting shapes both female mate preferences and male aggression biases. In nature, the genetic architecture of polymorphic mating traits appears highly variable (ranging from simple Mendelian to highly polygenic inheritance); a commonly observed pattern is one in which a single mutated allele leads to a marked phenotypic change (such as in the influence of MC1R on animal melanic coloration29,30). Although studies of the genetic architecture of coloration in O. pumilio are in their infancy, there are examples that suggest both polygenic19,27 and simple Mendelian inheritance of colour20 (Fig. 1). As an initial step, we used a diploid model that incorporates a mating trait governed by a diallelic Mendelian locus (with dominant and recessive alleles), on which both female mate preferences and male aggression biases act. In our model, both female preferences and male aggression biases are learned by imprinting on the mating trait of a parent (as we found evidence for in O. pumilio). We defined preference strength (α) and aggression-bias strength (β) such that, upon encountering a conspecific, females are 1 + α times as likely to mate with the imprinted phenotype than with the alternative phenotype and males are 1 + β times as aggressive towards the imprinted phenotype in male–male competition. We assumed that males that receive more aggression from other males are less likely to establish a territory (and thereby have reduced reproductive success14), and calculated the effective frequencies of male genotypes that enter the mating pool (from which the females choose their mates).

We compared results from two versions of the model that differ only in whether the imprinting was on the mating trait of the mother or of father. The two models yield qualitatively similar conclusions. We were interested in identifying the conditions under which both mating-trait phenotypes coexist stably in our model. We found that the stability of such a polymorphism is dependent on the relative strengths of the female mate preference (α) and male aggression bias (β) (Fig. 3a). Although initial allele frequencies affect the maintenance of trait variation, an initially rare trait allele (frequency = 0.0001) can increase in frequency to reach stable polymorphism across a wide range of preference and aggression strengths (Extended Data Fig. 1). In addition, incomplete imprinting (when not every individual imprints successfully on the phenotype of the parent) will linearly decrease the realized strength of both α and β, which results in a simulation outcome similar to that seen in Fig. 3a with smaller values on the x and y axes (Supplementary Information). Mechanistically, through sexual imprinting, mating trait frequencies determine the behaviour frequencies of offspring (both female mate preferences and male aggression biases); these behaviours then serve as the source of sexual selection that acts on the mating trait in the next generation. Therefore, selection generated by both female preference and male aggression is frequency-dependent, and delayed by one generation. Consistent with previous studies3,31, imprinted female mate preference exerts positive-frequency-dependent selection that favours the more-common mating trait allele and would on its own drive that allele to fixation. By contrast, male aggression bias generates negative-frequency-dependent selection that counters the pull towards fixation6, which generates a stable polymorphism in the mating trait when the aggression bias is sufficiently strong (the grey area of Fig. 3a). In this basic model, the frequency of the mating trait phenotype always stabilizes at 0.5. However, when we extend the model to allow asymmetry in the strengths of selection (that is, when the values of α and β vary with the phenotype on which the individual imprinted), the trait polymorphism can stabilize at broad range of frequencies (Extended Data Figs. 2, 3, Supplementary Information).

Fig. 3: Polymorphism stability and associations between trait and preference.
figure 3

a, Stability of polymorphic equilibria for combinations of α and β from 0.01 to 100, with a step size of 100.05. Axes are on logarithmic scales. Maternal and paternal imprinting models yield visually identical results. Across the range of parameters that we tested, the strength of β required to maintain a stable polymorphism increases nonlinearly with α. b, Association between mating trait locus T and female mate preference ‘locus’ P (measured as the phenogenotypic linkage disequilibrium between the trait genotype and the preference phenotype, presented as a proportion of the maximum coefficient of the linkage disequilibrium (D); Supplementary Information) at the polymorphic equilibrium (trait 1 phenotype frequency = 0.5) increases with α. Note that the stability of such a polymorphic equilibrium depends on the relative strength of α and β (a). The trait–preference linkage disequilibrium, expressed in terms of α (it is independent of β), is described in the Supplementary Information.

We also evaluated the association between the mating trait and mate preference at the polymorphic equilibrium. Divergent mating and aggressive behaviours will not generate two completely isolated mating groups unless female mate preference is absolute (females never mate with the non-preferred phenotype (α = ∞)). Instead, we looked for parameter space in which a positive association between trait and behaviour was formed, as this indicates reduced gene flow between the two trait variants—which could set the stage for speciation5. We found that the formation of this positive association between trait and behaviour (calculated as the phenogenotypic linkage disequilibrium between the behavioural phenotype and the trait genotype) (Methods, Supplementary Information) is independent of β and increases with α (Fig. 3b). However, as α increases the minimum β required for a stable polymorphism also increases (Fig. 3a). Consequently, pre-mating behavioural isolation is most likely to evolve via this mechanism when female preference is strong—but it cannot do so without being accompanied by a male aggression bias that is strong enough to maintain a stable polymorphism during the process. Along with simulations that explore the robustness of these findings to other initial frequencies of the mating trait, our model suggests that maternally imprinted sexual behaviours may begin to generate reproductive isolation when allopatric colour morphs come into secondary contact (as has probably occurred many times, owing to changes in sea level), when parapatric populations contribute new trait variants by infrequent migrations—or even among colour morphs that arise in sympatry, as long as sexual selection is strong.

Sexual selection is likely to facilitate speciation when divergent traits are accompanied by divergent sexual behaviours. We provide empirical evidence that suggests that maternal sexual imprinting on a heritable, polymorphic mating trait mediates both female mate choice and male–male competition in a poison frog. We also demonstrate using a mathematical model that imprinted aggression biases towards rival males can act in concert with sexually imprinted female mate preferences to maintain a stable polymorphism and reduce gene flow between divergent mating phenotypes in sympatry. Thus, parental imprinting provides a plausible and effective mechanism through which a sexually selected trait and the behaviours that act on it may co-diverge as a result of sexual selection alone, leading to reduced gene flow between sympatric lineages and setting the stage for speciation.

Methods

No statistical methods were used to predetermine sample size. The experiments were not randomized and investigators were not blinded to allocation during experiments and outcome assessment.

Rearing experiment

We reared socially naive O. pumilio individuals from frogs in a breeding colony, haphazardly selecting from three contrasting colour morphs (red, blue and green) (Fig. 1, Supplementary Information). The rearing experiment included three treatments: (i) purebred (offspring raised by their biological parents, both of which were of the same colour morph); (ii) crossbred (offspring raised by their biological parents, each of which was a different colour morph); and (iii) cross-fostered (offspring raised by foster parents that were of a colour different from that of the biological parents) (Fig. 2a). Offspring were removed from rearing enclosures within 24 h of reaching Gosner stage 46 (complete metamorphosis32) and transferred to a separate enclosure, and were kept physically and visually isolated from other frogs in the colony until the behavioural assay, which was conducted after the individual had reached sexual maturity (10–12 months after metamorphosis). We tested for colour-based behavioural biases in the male and female offspring using a two-way choice test (Fig. 2b) among males of contrasting colours (purebred, own colour versus another colour; crossbred, colour of the mother versus colour of the father; cross-fostering, colour of biological parents versus colour of foster parents). Sample sizes were 11 (purebred male), 12 (purebred female), 16 (crossbred male), 19 (crossbred female), 7 (cross-fostered male) and 7 (cross-fostered female).

Behavioural assay

Two-way choice experiments were carried out to assess the behaviour of offspring towards males of various phenotypes: the focal individual could move freely in an arena, and the two stimulus males were confined under transparent plastic domes (Fig. 2b). Unrelated adult males were used as stimulus males, and stimulus-male pairs were matched for size and mass but differed in colour. Details of the experimental setup and protocol are described in the Supplementary Information. We quantified (i) association time (defined as the cumulative time that the focal frog spent in each of the 4-cm (about 2 body lengths) interaction zones that surrounded the dome of each male) and (ii) approaches (defined as the number of times that the focal frog oriented towards and entered each interaction zone).

Statistical analyses

To test for female mate preference and male aggression biases, we calculated the proportions of the total association time that male and female offspring spent with one of the two male phenotypes presented to them (purebred, own colour /(own colour + other colour); crossbred, colour of the mother/(colour of the mother + colour of the father); and cross-fostered, colour of the foster parent/(colour of the foster parent + colour of the biological parent)). We tested the hypothesis that these proportions of association time were >0.5 for the three rearing treatments and two sexes separately, using one-tailed one-sample permutational t-tests (Extended Data Table 1). We also ran the same analyses with ratios of the number of approaches to each stimulus phenotype as a second, supplementary confirmation of the pattern (Extended Data Table 2). Additional details in given in the Supplementary Information.

Population-genetics model

We developed a diploid model with discrete, non-overlapping generations. The mating trait is governed by a single diallelic locus T with a dominant allele (T1) and a recessive allele (T2) (T11 denotes two copies of the dominant allele, T22 denotes two copies of the recessive allele and T12 denotes heterozygosity). We also used a behaviour ‘locus’ P (actually a phenotype) to denote the trait on which the individuals have imprinted. P is inherited via maternal or paternal imprinting, and governs both female mate preference and male aggression biases, being either P1 (biased towards trait 1) or P2 (biased towards trait 2). Each individual can therefore be described by combination of a phenotype and a genotype (a ‘phenogenotype’) that contains a diploid mating trait locus T (the genotype) and a haploid behaviour ‘locus’ P (the phenotype). The frequencies of the six phenogenotypes T11P1, T12P1, T22P1, T11P2, T12P2 and T22P2 are designated x1, x2, x3, x4, x5 and x6, respectively.

In our model, the lifecycle consists of male–male competition, female mate choice, reproduction and imprinting. During male–male competition, males are 1 + βk times as aggressive towards the imprinted mating-trait phenotype (k). For example, the total aggression received by mating phenotype 1 is A1 = (1 + β1)p1 + p2 where p1 and p2 represent the frequencies of trait-1-biased and trait-2-biased males, respectively (p1 = x1 + x2 + x3, p2 = x4 + x5 + x6). The fitness (ω) of males with mating phenotype k decreases as the total aggression received increases, such that ωk = 1 − sk where sk = Ak/ΣkAk. Because the behavioural bias of males is not relevant in the portion of the lifecycle that comes after male–male competition, we pool males with the P1 and P2 phenotypes and calculate only the frequencies of the three male genotypes. T11, T12 and T22 males are designated x1,m, x2,m and x3,m, respectively (subscript m denotes male). The effective frequency of males with mating genotype i that enter the mating pool after male competition is therefore:

$${x}_{i,{\rm{m}}}^{\ast }=\frac{{\omega }_{k}{x}_{i,{\rm{m}}}}{{\sum }_{i}{\omega }_{k}{x}_{i,{\rm{m}}}}$$

in which k = 1 when i = 1 or 2, and k = 2 when i = 3. There is no competition between females (denoted by subscript f) in this model, so the frequency of female phenogenotypes that enter the mating pool is \({x}_{j,{\rm{f}}}^{\ast }={x}_{j,{\rm{f}}}\) where the six female phenogenotypes T11P1, T12P1, T22P1, T11P2, T12P2 and T22P2 are designated x1,f, x2,f, x3,f, x4,f, x5,f and x6,f, respectively.

After male competition, the females choose their mates according to the behaviour ‘locus’ P, such that upon encountering a male, females are 1 + αk times as likely to mate with males that possess the imprinted mating phenotype k (following a previous publication33). Thus, the frequency of mating between each combination of male genotype i and female phenogenotype j is:

$${F}_{i,j}=\frac{{x}_{i,{\rm{m}}}^{\ast }{x}_{j,{\rm{f}}}^{\ast }(1+{d}_{i,j}{\alpha }_{k})}{{\sum }_{i}{x}_{i,{\rm{m}}}^{\ast }(1+{d}_{i,j}{\alpha }_{k})}$$

where di,j = 1 if the female behaviour ‘locus’ P matches the male trait phenotype T (i = 1 or 2 with j = 1, 2 or 3, and i = 3 with j = 4, 5 or 6) and di,j = 0 otherwise, and where k = 1 when j = 1, 2 or 3, and k = 2 when j = 4, 5, or 6. The denominator normalizes the frequencies to ensure that females have equal mating success (strict polygyny).

Reproduction and imprinting happen after mating, at which point the phenogenotype frequencies of the resulting zygotes are calculated. The mating trait locus T is genetically inherited with Mendelian segregation. The phenotypic ‘locus’ P is obtained either by maternal or by paternal imprinting. All offspring with a trait-1 (T11 or T12) parent (mother for maternal printing or father for paternal printing) are P1 individuals, and all offspring with a trait 2 (T22) parent are P2 individuals.

Details of the recursion equations and numerical analyses are described in the Supplementary Information. The recursion equations were not solvable analytically, and were analysed by estimating numerical solutions using Mathematica34 and using deterministic simulations. We considered two conditions to be important for assessing progress towards the evolution of reproductive isolation31: (i) whether the polymorphic equilibrium of mating trait T is stable (Fig. 3a) and (ii) whether the mating traits (T) and the behaviours (P) were associated (that is, in phenogenotypic linkage disequilibrium between the mating trait genotype and the behavioural phenotype) at the polymorphic equilibrium (Fig. 3b). We also assessed the extent to which the potential for achieving a stable polymorphic state depended upon the starting frequencies of the alleles (Extended Data Fig. 1). Our basic model (discussed in the main text) assumed symmetrical selective strengths on both mating phenotypes (α1 = α2 and β1 = β2). We also analysed scenarios in which the strength of the behavioural biases differs between the P1 and P2 individuals (α1 ≠ α2 and β1 ≠ β2; Supplementary Information). The asymmetries allow the polymorphic equilibrium to stabilize at a wide range of phenotype frequencies (from 0 to 1), but the qualitative conclusions reported above regarding polymorphism stability and the evolution of linkage disequilibrium between the mating trait and the behaviours were robust (Extended Data Figs. 2, 3, Supplementary Information). All analyses were performed using Mathematica.

Reporting Summary

Further information on research design is available in the Nature Research Reporting Summary linked to this paper.