Abstract
Bio-hybrid systems made of robots and animals can be useful tools both for biology and robotics. To socially integrate robots into animal groups the robots should behave in a biomimetic manner with close loop interactions between robots and animals. Behavioural zebrafish experiments show that their individual behaviours depend on social interactions producing collective behaviour and depend on their position in the environment. Based on those observations we build a multilevel model to describe the zebrafish collective behaviours in a structured environment. Here, we present this new model segmented in spatial zones that each corresponds to different behavioural patterns. We automatically fit the model parameters for each zone to experimental data using a multi-objective evolutionary algorithm. We then evaluate how the resulting calibrated model compares to the experimental data. The model is used to drive the behaviour of a robot that has to integrate socially in a group of zebrafish. We show experimentally that a biomimetic multilevel and context-dependent model allows good social integration of fish and robots in a structured environment.
Access provided by CONRICYT-eBooks. Download conference paper PDF
Similar content being viewed by others
Keywords
1 Introduction
Robotics stands now as a convenient tool to study the animal behaviour. In recent ethological and animal behavioural studies, robots are used to induce specific and controlled stimuli and assess the response of the animals under scrutiny. This allows to test various hypothesises on the nature of the signals used by the animals for social interactions [16, 21].
Autonomous robots interacting in real-time with animals [19] makes it possible to create social interactions between both of them. This has already been demonstrated by several authors for studying the behaviours of sheepdogs [26], cows [12] or drosophila [27] to cite a few. In this paper, we focus on zebrafish (Danio rerio), and we describe a biomimetic model that can be implemented in a robotic lure and validated its acceptance by four zebrafish in a structured environment.
The main difficulty is to make the robotic lure behave in such a way that it is accepted by the animals as social companion, just as any other interacting fish would be. Beyond the scope of this paper, this is a first step to enable the modulation (though action) of the collective behaviours of the observed zebrafish [15].
Different approaches have been proposed to control the movement of fish-lures [9]. Most of them do not involve a closed loop of social interaction with the fish. This is often the case for lures fixed to a robotic arm that performs repeated movements, but also for studies with autonomous fish-lures. Closing the loop of social interactions requires a real-time tracking, or perception, of the agents (fish and robot), and a decision-making algorithm to control the robot behaviours. In most of the experiments reported in the literature, the robots driven with closed-loop control are programmed to follow the centroid of the fish group, to ensures that the robot will join and follow the group of fish. However, this type of controller implies that the robot is more a passive follower than a real group-member making its own decisions. The embodiment of bio-inspired models can lead to a better social integration of the artificial agents in animal groups and can allow the robots to influence the collective decision of the mixed group by giving specific preferences to the robot by tuning parameter values of the model [9, 15].
We present a method to calibrate automatically a new behavioural zebrafish model by evolutionary parameters optimisation. This multilevel model describes collective behaviour in a structured environment in agreement with experimental observations. This model makes important extensions to our previous model for collective behaviour in a homogeneous environment [10]. The model takes into account a simple structured environment composed of two rooms and the fact that the fish adapt their behaviour to the zones where they are while performing collective behaviour. For such multilevel and spatially dependent social behaviour model it is an issue to calibrate the model because it involves trade-offs between social tendencies (aggregation, group formation), and response to the environment (wall-following, zone occupation). We use an evolutionary algorithm (NSGA-II [13]) to optimise the parameters of this model so that the exhibited collective dynamics correspond to those observed in biological experiments. Then, we validate experimentally this model by implementing it as the controller of robots that are integrated in small fish groups.
2 Materials and Methods
2.1 Experimental Set-Up
We use the experimental set-up described in [3, 9, 11, 24], with the arena presented in [9, 24]. This set-up (Fig. 1A) consists of a white plexiglass arena (Fig. 1C) of \(1000\times 1000\times 100\) mm, that is composed of two rooms linked by a corridor. To validate experimentally our calibrated model, we use a robot developed by the EPFL [2,3,4,5] for the ASSISI project [23]. This robot is powered by two conductive plates under the aquarium. An overhead camera captures frames that are then processed for tracking and control purposes (see Fig. 1A).
All trials have a duration of 15 min. We tracked the positions of the agents by using the idTracker software [22]. Using this software, we obtain the positions P(x, y, t) of all agents at each time step \(\varDelta t = 1/15\) s for all experiments, and build the trajectories of each agent. The experiments performed in this study were conducted under the authorisation of the Buffon Ethical Committee (registered to the French National Ethical Committee for Animal Experiments #40) after submission to the French state ethical board for animal experiments.
2.2 Behavioural Model
Most of the fish collective behaviour models do not take into account the environment i.e. the walls or the structure of the tanks because they only focus on the social interactions [18, 25].
However, zebrafish show context-dependent behaviours when they are in a structured environment. Depending on their spatial position in the environment they adapt their individual behavioural pattern. Moreover, because they are a gregarious species they also take into account the position and the behaviours of the other fish and can aggregate or start collective behaviours. As many animal species, zebrafish display strong thigmotactism and follow walls or edges. We show that they adapt their behaviour in three different zones of the structured set-up: first the zone when they are close to the walls, second the zone when they are in the centre of the rooms and third when they use the corridor to change room. We take into account this spatial and context-dependent behaviours.
Each zone corresponds to a behavioural attractor. When the individuals are in one of the three zones they adapt their behaviour and perform specific behavioural patterns. In the zone near the walls they perform mainly thigmotactism (wall following), in the centre of the room they explore, in the corridor they transit from one room to the other. At the same time they also take into account the behaviour of the other fish as they also do collective behaviour such as collective departures from the rooms. The other fish can be in any of the other zones and thus can also induce behavioural attractor switching of their companions.
We extend the biomimetic hybrid model [9, 10] using microscopic and macroscopic information [7, 8]. This new model (described in Fig. 2) takes into account zones that correspond to different behavioural attractors and thus allows context-dependent behaviours. The individual can switch from one behavioural attractor to the other and at the same time perform collective behaviour. Our model describes individual choices close to action selection and collective behaviours at the same time. It is a step towards modelling action selection in the context of collective behaviours.
We present a multi-level and multi-agent biomimetic model, inspired from [9, 10] that describes the individual and collective behaviours of fish. As in [10], this model makes the link between fish visual perception (of congeners and walls) and motor response (i.e.: trajectories of the agents). However, it is also capable of expressing a variability in agents behaviours when they occupy specific zones of the arena (behavioural attractors). Figure 3B lists the model parameters.
In this model, the agents update their position vector \({X_i}\) with a velocity vector \({V_i}\):
The model computes a circular probability distribution function (PDF) [10] corresponding to the probability of the agent to move in a specific direction (\(\varTheta _i\)). This PDF is as a mixture of von Mises distributions, an equivalent to the Gaussian distribution in circular probability. The computation of this PDF involves the calculation of two other PDF functions: the first one describing agent behaviour when no stimuli is present, and the second one characterising agent behaviour when conspecifics are perceived by the agent.
The PDF capturing agent behaviour when no stimuli is present is given by:
for an agent situated in zone \(z_j\), and with \(I_0\) the modified Bessel function of first kind of order zero. When the agent is situated in a zone close to a wall (zones 1 and 2 of Fig. 1D), we implement a wall-following behaviour, by increasing the probabilities of moving towards either side of the closest wall. This is achieved by using the following PDF:
with \(\mu _{w_k}\) the two possible directions along the considered wall.
Examples of agents trajectories are found in Fig. 5B. The probability of the focal fish to orient towards a perceived fish is given by a von Mises distribution clustered around the fish position:
with \(\mu _{f_i}\) the direction towards the perceived agent, \(A_{f_T} = \sum _{i=1}^{n_f} A_{f_i}\) the sum of the solid angles \(A_{f_i}\) captured by each agent and \(n_f\) the number of perceived agents.
The final PDF \(f(\theta )\) is computed as follow:
The parameter \(\gamma _{z_1, z_2}\), used as a multiplicative term of the final PDF, modulates the attraction of agents towards target zones. Figure 3A describes how the final PDF is computed and how it is used to determine the agents next positions.
Unreachable areas of the PDF (e.g. the walls) are attributed a probability of 0. Then, we numerically compute the cumulative distribution function (CDF) corresponding to this custom PDF \(f(\theta )\) by performing a cumulative trapezoidal numerical integration of the PDF in the interval \([-\pi ,\pi ]\). Finally, the model draws a random direction \(\varTheta _i\) in this distribution by inverse transform sampling. The position of the fish is then updated according to this direction and his velocity with Eqs. 1 and 2.
3 Results
We consider four cases. We define the Control results as obtained from biological experiments with five zebrafish in the experimental set-up described in Sect. 2.1. The Sim-MonoObj and Sim-MultiObj results are defined to correspond to the model in simulation with five agents, calibrated respectively using mono-objective or multi-objective optimisation. The Biohybrid results are obtained from experiments with four zebrafish and one robot driven by the model using the best optimised parameters.
3.1 Optimisation of Model Parameters
We define a similarity measure (ranging from 0.0 to 1.0) to compare two experiments (\(e_1\) and \(e_2\)), and define it as:
with \(O_{e}\) the distribution of zones occupation, \(T_{e}\) the transition probabilities from zone e to the others, and \(D_{e}\) the distribution of inter-individual distances of all agents in zone e. The similarity measure \(S(e_1, e_2)\) corresponds to the geometric mean of these three features. The function I(P, Q) is defined as such:
The H(P, Q) function is the Hellinger distance between two histograms [14]. It is defined as:
We consider two optimization methods. In the Sim-MonoObj case, we use the CMA-ES [1] mono-objective optimisation algorithm, with the task of maximising the \(S_(e_1, e_2)\) function. In the Sim-MultiObj case, we use the NSGA-II [13] multi-objective algorithm with three objectives to maximise. The first objective is a performance objective corresponding to the \(S_{(e_1, e_2)}\) function. We also consider two other objectives used to guide the evolutionary process: one that promotes genotypic diversity [20] (defined by the mean euclidean distance of the genome of an individual to the genomes of the other individuals of the current population), the other encouraging behavioural diversity (defined by the euclidean distance between the \(O_{e}\), \(T_{e}\) and \(D_{e}\) scores of an individual). In both methods, we use populations of 60 individuals (approximately twice the number of dimensions of the problem) and 300 generations. The Sim-MonoObj stabilises around the 50-th generation. The Sim-MultiObj stabilises around the 250-th generation. The linear speed \(v_i\) of the agents is not optimized, and is randomly drawn from the instantaneous speed distribution measured in the control experiment. It should be noted that evolutionary algorithms do not over-fit (as it is an optimization process), even if we use the same data (trajectories) for both training and testing.
3.2 Robot Implementation
The robot is driven by the model described in Sect. 2.2, after calibration. Robotic trials have a duration of 15 min, and are repeated 10 times. They involve one robot and four zebrafish. Every 333 ms, we integrate the tracked positions of the four fish into the model, and compute the target position of a fifth agent. We then control the robot to follow this target position by using the biomimetic movement patterns described in [4, 9].
3.3 Model Performance Analysis and Experimental Validation
We assess the similarity between the results from the calibrated cases (Sim-MonoObj, Sim-MultiObj and Biobybrid) and those of the Control case by using the similarity measure defined in Sect. 3.1. The similarity scores are shown in Table 1.
Using information about zones occupation and probabilities of transition from one zone to another, we define a finite state machine corresponding to the behavioural attractors dynamics of the entire agent population. The resulting finite state machines obtained from the Control and Biohybrid cases are shown in Fig. 4. The probability of presence of an agent in each part of the arena is presented in Fig. 5A. Examples of agents trajectories are found in Fig. 5B.
The best-performing individuals of the Sim-MonoObj and Sim-MultiObj cases display distributions of inter-individual distances that are relatively close to those of the Control case, which suggests that these models can convincingly exhibit fish tendency to aggregate. However, of the two cases performed in simulation, only Sim-MultiObj is capable of displaying zones dynamics (occupation of the zones, and transition probabilities from one zone to the others) similar to the Control case. This suggests that multi-objective optimisation is required to handle the conflicting dynamics present in fish collective behaviour.
The robot of the Biohybrid case is driven by a controller using our model with the parameters of the best-performing individual obtained in the Sim-MultiObj. The results of the Biohybrid case correspond to those of the Sim-MultiObj case. The ethogram of the Biohybrid case (cf Fig. 4) shows an increased preference for the centre of the rooms compared to the Control case. This could be explained by our current lower level robotic implementation of wall-following behaviour that could still be sub-optimal.
4 Discussion and Conclusion
Collective behaviour models often focus on collective motion in homogeneous unbounded environment. Here we present a multi-level model that is space-dependent with individuals that behave in a context-dependent way. We make the hypothesis that the type of behaviour displayed by the agents depends on their position in the environment. This allows us to segment our environment into several characteristic zones, each corresponding to a particular behavioural attractor, matching different types of agent behaviour.
We present a methodology to calibrate this model to correspond to the collective dynamics exhibited by fish in the experiments. This calibration process is challenging, as it involves a trade-off between social tendencies (group formation), and response to the environment (wall-following, exploration). Moreover, our model encompasses the notion of behavioural attractors, allowing agents to exhibit several different behaviours depending on the context. Our methodology is able to cope with this trade-off by using multi-objective optimisation.
However, this calibration methodology could still be improved: the similarity measure we use to compare two cases only takes into account three aspects of collective behaviours corresponding to behavioural attractors, and aggregation dynamics. Other behavioural aspects could also be relevant at the level of collective dynamics and can be considered: e.g.: agent groups aspects, residence time in a zone, at the level of the individuals e.g.: agent trajectory aspects, curvature of trajectories, etc. Moreover, in relation to the environment e.g.: the distance of an agent to the nearest wall could also be taken into account. Alternatively, it would be possible to perform the calibration without defining a similarity measure explicitly, using a method similar to [17], by co-evolving simultaneously the parameters of the models and classifiers. These classifiers would be trained to identify whether or not the resulting behaviours of the optimised models are distinct from the behaviours from the reference experiments.
Here, we make the assumption that the behavioural attractors are linked to the position of the agent in their environment. This assumption could be relaxed, to handle ethograms with more complex classes of behaviours like behavioural attractors linked to agent group dynamics. Additionally, the idea that actions are selected and segmented by the fish is questionable. While our decomposition of fish behaviour in different behavioural attractors is convenient for modelling purpose and ease the implementation of a biomimetic robot controller by having a collection of discrete acts that it can perform, it is not determined that fish make this kind of decomposition into distinct elements (actions) [6]. Finally, we could apply our model in more complex set-up, involving large societies with a larger number of robots, and with a more complex topology.
References
Auger, A., Hansen, N.: A restart CMA evolution strategy with increasing population size. In: The 2005 IEEE Congress on Evolutionary Computation, vol. 2, pp. 1769–1776. IEEE (2005)
Bonnet, F., Binder, S., de Oliveria, M., Halloy, J., Mondada, F.: A miniature mobile robot developed to be socially integrated with species of small fish. In: 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 747–752. IEEE (2014)
Bonnet, F., Cazenille, L., Gribovskiy, A., Halloy, J., Mondada, F.: Multi-robots control and tracking framework for bio-hybrid systems with closed-loop interaction. In: 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE (Forthcoming)
Bonnet, F., Cazenille, L., Seguret, A., Gribovskiy, A., Collignon, B., Halloy, J., Mondada, F.: Design of a modular robotic system that mimics small fish locomotion and body movements for ethological studies. Int. J. Adv. Rob. Syst. 14(3), 1729881417706628 (2017)
Bonnet, F., Rétornaz, P., Halloy, J., Gribovskiy, A., Mondada, F.: Development of a mobile robot to study the collective behavior of zebrafish. In: 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), pp. 437–442. IEEE (2012)
Botvinick, M.: Multilevel structure in behaviour and in the brain: a model of fuster’s hierarchy. Philos. Trans. R. Soc. Lond. B Biol. Sci. 362(1485), 1615–1626 (2007)
Cazenille, L., Bredeche, N., Halloy, J.: Multi-objective optimization of multi-level models for controlling animal collective behavior with robots. In: Wilson, S.P., Verschure, P.F.M.J., Mura, A., Prescott, T.J. (eds.) Living Machines 2015. LNCS, vol. 9222, pp. 379–390. Springer, Cham (2015). doi:10.1007/978-3-319-22979-9_38
Cazenille, L., Bredeche, N., Halloy, J.: Automated optimisation of multi-level models of collective behaviour in a mixed society of animals and robots. arXiv preprint arXiv:1602.05830 (2016)
Cazenille, L., Collignon, B., Bonnet, F., Gribovskiy, A., Mondada, F., Bredeche, N., Halloy, J.: How mimetic should a robotic fish be to socially integrate into zebrafish groups? Bioinspiration & Biomimetics (Forthcoming)
Collignon, B., Séguret, A., Halloy, J.: A stochastic vision-based model inspired by zebrafish collective behaviour in heterogeneous environments. R. Soc. Open Sci. 3(1), 150473 (2016)
Collignon, B., Séguret, A., Chemtob, Y., Cazenille, L., Halloy, J.: Collective departures in zebrafish: profiling the initiators. arXiv preprint arXiv:1701.03611 (2017)
Correll, N., Schwager, M., Rus, D.: Social control of herd animals by integration of artificially controlled congeners. In: Asada, M., Hallam, J.C.T., Meyer, J.-A., Tani, J. (eds.) SAB 2008. LNCS, vol. 5040, pp. 437–446. Springer, Heidelberg (2008). doi:10.1007/978-3-540-69134-1_43
Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6(2), 182–197 (2002)
Deza, M., Deza, E.: Dictionary of Distances. Elsevier, Amsterdam (2006)
Halloy, J., Sempo, G., Caprari, G., Rivault, C., Asadpour, M., Tâche, F., Said, I., Durier, V., Canonge, S., Amé, J.: Social integration of robots into groups of cockroaches to control self-organized choices. Science 318(5853), 1155–1158 (2007)
Knight, J.: Animal behaviour: when robots go wild. Nature 434(7036), 954–955 (2005)
Li, W., Gauci, M., Gross, R.: Turing learning: a metric-free approach to inferring behavior and its application to swarms. arXiv preprint arXiv:1603.04904 (2016)
Lopez, U., Gautrais, J., Couzin, I.D., Theraulaz, G.: From behavioural analyses to models of collective motion in fish schools. Interface Focus 2(6), 693–707 (2012)
Mondada, F., Halloy, J., Martinoli, A., Correll, N., Gribovskiy, A., Sempo, G., Siegwart, R., Deneubourg, J.: A general methodology for the control of mixed natural-artificial societies, Chap. 15. In: Kernbach, S. (ed.) Handbook of Collective Robotics: Fundamentals and Challenges, pp. 547–585. Pan Stanford (2013)
Mouret, J., Doncieux, S.: Encouraging behavioral diversity in evolutionary robotics: an empirical study. Evol. Comput. 20(1), 91–133 (2012)
Patricelli, G.L.: Robotics in the study of animal behavior. In: Breed, M.D., Moore, J. (eds.) Encyclopedia of Animal Behavior, pp. 91–99. Greenwood Press Westport, CT (2010)
Pérez-Escudero, A., Vicente-Page, J., Hinz, R.C., Arganda, S., de Polavieja, G.G.: idTracker: tracking individuals in a group by automatic identification of unmarked animals. Nat. Methods 11(7), 743–748 (2014)
Schmickl, T., Bogdan, S., Correia, L., Kernbach, S., Mondada, F., Bodi, M., Gribovskiy, A., Hahshold, S., Miklic, D., Szopek, M., Thenius, R., Halloy, J.: ASSISI: mixing animals with robots in a hybrid society. In: Lepora, N.F., Mura, A., Krapp, H.G., Verschure, P.F.M.J., Prescott, T.J. (eds.) Living Machines 2013. LNCS, vol. 8064, pp. 441–443. Springer, Heidelberg (2013). doi:10.1007/978-3-642-39802-5_60
Séguret, A., Collignon, B., Cazenille, L., Chemtob, Y., Halloy, J.: Loose social organisation of abstrain zebrafish groups in a two-patch environment. arXiv preprint arXiv:1701.02572 (2017)
Sumpter, D.J., Mann, R.P., Perna, A.: The modelling cycle for collective animal behaviour. Interface Focus 2(6), 764–773 (2012)
Vaughan, R., Sumpter, N., Henderson, J., Frost, A., Cameron, S.: Experiments in automatic flock control. Rob. Auton. Syst. 31(1), 109–117 (2000)
Zabala, F., Polidoro, P., Robie, A., Branson, K., Perona, P., Dickinson, M.: A simple strategy for detecting moving objects during locomotion revealed by animal-robot interactions. Curr. Biol. 22(14), 1344–1350 (2012)
Acknowledgement
This work was funded by EU-ICT project ‘ASSISIbf’, no. 601074.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Cazenille, L. et al. (2017). Automated Calibration of a Biomimetic Space-Dependent Model for Zebrafish and Robot Collective Behaviour in a Structured Environment. In: Mangan, M., Cutkosky, M., Mura, A., Verschure, P., Prescott, T., Lepora, N. (eds) Biomimetic and Biohybrid Systems. Living Machines 2017. Lecture Notes in Computer Science(), vol 10384. Springer, Cham. https://doi.org/10.1007/978-3-319-63537-8_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-63537-8_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-63536-1
Online ISBN: 978-3-319-63537-8
eBook Packages: Computer ScienceComputer Science (R0)