Abstract
Robotic fish are nowadays developed for various types of research, such as bio-inspiredrobotics, biomimetics and animal behavior studies. In the context of our research on the social interactions of the zebrafish Danio Rerio, we developed a miniature robotic fish lure for direct underwater interaction with the living fish. This remotely controlled and waterproof device has a total length of 7.5 cm with the same size ratio as zebrafish and is able to beat its tail with different frequencies and amplitudes, while following the group of living animals using a mobile robot moving outside water that is coupled with the robotic lure using magnets. The robotic lure is also equipped with a rechargeable battery and can be used autonomously underwater for experiments of up to 1 h. We performed experiments with the robot moving inside an aquarium with living fish to analyze its impact on the zebrafish behavior. We found that the beating rate of the tail increased the attractiveness of the lure among the zebrafish shoal. We also demonstrated that the lure could influence a collective decision of the zebrafish shoal, the swimming direction, when moving with a constant linear speed inside a circular corridor. This new robotic fish design and the experimental results are promising for the field of fish–robot interaction.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
For humans, social animals can either be considered as a necessity, for instance in the case of a cattle herd, or a threat in the case of a medusa swarm. In both cases, the control of those societies could improve human welfare.
In recent years, with the progress of technology, especially in the robotic field, it became possible to create robotic lures that could generate relevant signals to control an animal society [1]. Once accepted by the society of animals as conspecific, the artificial agents could change the animal collective choice while also adapting to the animal society. One of the first concrete examples was the LEURRE project, where a mixed society consisting of cockroaches and mobile robots was created [2]. These types of experiments have been extended to more complex species, such as beetles [3], crickets [4] or even chicken [5], however, LEURRE was the only study in which the loop of interaction between the robots and the animal collective system was closed.
The group behavior of the zebrafish Danio Rerio, a fish used in many laboratories worldwide for different scientific topics [6], raised the interest of biologists, and several examples of automated lures designed to interact with zebrafish have already appeared. For instance, in [7–9], the zebrafish response to a robotic fish with the same ratio size as zebrafish, a beating tail and different colorations was observed. In [10–12], a lure attached to a support is moved using a mobile robot outside the aquarium and controlled using a tracking software. To our knowledge, none of these studies showed a significant acceptance of the artificial agents by the living fish.
In this study, we propose an innovative system to interact with the shoal of fish. We used biomimetics approach to design a robotic fish lure for direct underwater interaction with fish: RiBot, which is only 1.8 times bigger than a standard size zebrafish, with the same ratio dimensions (RiBot is a combination of the word Riba that means fish in Russian language and the word Robot). It is composed of an actuated tail (caudal peduncle) that can beat with frequencies up to 20 Hz and amplitude of \(\pm 23^\circ\), which are in the range of the caudal peduncle beating movements measured on our own zebrafish. RiBot is waterproof and totally autonomous with an internal Lithium Polymer (LiPo) battery and Infrared (IR) receptor for wireless control. Furthermore, RiBot can be magnetically coupled with an external mobile robot, FishBot, developed during preliminary research and that can reach similar speeds and accelerations to zebrafish [13, 14]). When compared to previously published solutions, our solution is combining a mobile robot outside of water as presented in [10–12] and a robotic lure as in [7–9] with smaller size. This allows us to have many different stimuli generated by the device to monitor the zebrafish society.
We performed experiments using this robotic system and measured its impact on the fish behavior. We measured the fish attractiveness while varying the amplitude and the frequency of the beating tail of RiBot, which was itself moving inside the aquarium with different linear speeds. Results from these experiments will help scientists to better understand the types of interaction between fish that lead to formation of shoal and to collective choices.
2 Hardware design
The design of underwater autonomous vehicle is always of great challenge, especially at very low scale. The device should be waterproof, wireless and, moreover in the case of this study, the robot has to interact with zebrafish and thus its size shall be in the range of zebrafish, whose average length rarely exceed 45 mm in laboratory conditions. Due to the size of the selected components, the length of RiBot was fixed at 75 mm while keeping the same ratio size as zebrafish, with a width of 10 mm and a height of 17 mm. For the first prototype, we have decided to include only one actuator, a stepper motor to actuate the tail, a rechargeable battery LiPo to allow the energy autonomy of the device and an infrared receiver to remotely control the device underwater. Figure 1 shows the different hardware subsystems of RiBot that will be described in the following subsections.
2.1 Actuator
There are several solutions that can be found in the literature to actuate a fish-like underwater vehicle tail or fin [15]. Concerning RiBot, a very small actuator that consumes very low energy but with enough torque to actuate a robotic fish caudal peduncle underwater was required. The actuator should also allow beating tail frequencies and amplitudes in the range of the zebrafish.
We considered a kinematic fish model shown in Fig. 2 to determine the required motor specifications. To simplify the model, we assumed that the caudal peduncle is a rigid body that does circular motion centered on the motor shaft.
If \(\theta\) is the angle between the tail and the longitudinal axis, the motion equation can be expressed by Eq. 1, where I is the inertial moment of the caudal peduncle, L is the length of the caudal peduncle, \(F_\mathrm{d}\) is the driven force of the motor, \(F_\mathrm{w}\) is the resistance of the water that is approximated as the drag force only (Eq. 2) and \(F_\mathrm{e}\) is the resistance force of the elastic skin with coefficient k that envelop the caudal peduncle and this resistance will thus be unbalanced on each sides of the caudal peduncle (Eq. 3).
Using Eqs. 1–3, we obtained a minimal value of 2 mNm for the torque needed for the actuator and selected a micro step gear motor “MF03G” of Seiko Precision Inc. to fulfill this. The motor has very small dimensions and can thus be easily integrated inside RiBot design. The advantage of using a stepper motor is that if the motor does not miss any steps, the position of the caudal peduncle can be estimated from the number of pulses emitted to drive the motor.
2.2 Communication
IR communication was chosen to remotely control RiBot. Indeed, Wi-Fi and bluetooth involve bulky chips and more power resources which was not affordable for this design. An IR sensor TSOP75436WTT is placed on the back of RiBot (Fig. 4) and IR signal can be sent from any direction to control the device underwater. The RC5 protocol is implemented and thus universal TV remote control with RC5 protocol can be used to control the device. RiBot was placed below a 10 cm water layer and the signal, emitted at 2 m from the water surface, could be perceived by the robot.
2.3 Power
In Sect. 2.1 we described the stepper motor selected to drive the caudal peduncle with the required voltage and current. As the other electronic components had very low power consumption, the motor power consumption was used to select the capacity of the battery (C) using the following equation
where V is the necessary voltage, R is the internal resistance of the motor and T is the desired duration of the experiment which was set to 30 min.
We obtained a required value of 52 mAh in capacity. As it was not possible to find a battery with very small size and the required capacity, we selected the SparkFun 40 mAh small LiPo battery. This battery is rechargeable, which gives the advantage that we do not need to change it on the device when it is empty. Indeed, the battery can be recharged through the eyes of the fish that are made of brass and that cross the Polyurethane layer to be accessed from the outside of RiBot (Fig. 4). A charge circuit was designed to manage the powering of the device and the recharging of the battery.
2.4 Electronic design
The main skeleton of RiBot consists of a Printed Circuit Board (PCB) of 1.6 mm width. All the components are soldered on the two faces of the PCB and are encapsulated with an impermeable coating made of Polyurethane.
The caudal peduncle of the fish is made of brass and connected to the ground (GND). It can be used for two purposes (Fig. 3): it can turn ON and OFF the device and also can be used to calibrate the tail position. When the caudal peduncle reaches one of its maximal position, a contact is made between pads on the PCB and the caudal peduncle. When the device is turned OFF and the tail reaches one of the two pads, the microcontroller is switched ON.
The PCB carries a microcontroller STM32f103. This microcontroller was selected due to its very small dimensions (6 mm \(\times\) 6 mm) and its functionalities.
The actuator is driven using a dual full-bridge A3901 also selected for its small dimensions (3 mm \(\times\) 3 mm \(\times\) 0.75 mm), its operating range for voltage (2.5–5.5V) and current (±400 mA).
2.5 Mechanical design
The motor with the tail docked on its axis is fixed inside a 3D part, called the ring as it has an elliptical external shape, that is glued on the PCB.
To isolate the actuator and the caudal peduncle from water and to create a soft skin that can mimic the tail of the zebrafish, an undercut of the tail was made in 3D printing and was dipped into liquid latex. The skin created was unmolded and attached on the ring using silicone. The caudal fin is also made of latex and is prepared apart from the tail using another mold, and is glued on the tail using latex.
Polyurethane is used to isolate the electronics from water. A mold with the desired undercut of Ribot was made of ABS by 3D printing. The mold is composed of two parts that are joined using pins and screws during the molding process to press the two parts against each other. The PCB is placed inside the mold and the eyes are used as a reference inside the mold. Finally, liquid polyurethane is injected inside the mold from the tail. The Polyurethane coats the entire PCB up to the ring and hardens inside the mold. After this process, RiBot is totally isolated from water and can start to swim underwater (Figs. 4, 5).
3 Performance evaluation
Figure 5 shows the prototype of RiBot in comparison with one of our zebrafish Danio Rerio. The final prototype has a mass of 9.0 g and sinks beneath the water surface due to its density.
3.1 System qualifications
The first prototype of RiBot presented in Fig. 5 was inserted inside water to measure its capabilities.
We could perform 23 min long test with the tail of RiBot moving continuously using the embedded LiPo battery. However, when reducing the use of the actuator, RiBot could be maintained turned ON for more than 1 h underwater.
To measure the beating tail of RiBot, we used the same experimental setup that was used to perform the experiments with fish presented in Fig. 7. We installed a color marker on the edge of the tail and above the position of the actuator axis and tracked these markers from top view using a camera.
We obtained a maximum amplitude of 23\(^\circ\) and a frequency of 20 Hz. This corresponds to the amplitude and vibrations that we have observed on our own zebrafish. Indeed, in rare cases, the zebrafish can move the tail at an angle of almost 90\(^\circ\), but in general, the amplitude does not exceed 20\(^\circ\).
3.2 Motion underwater
RiBot was primarily designed to simply beat its tail to increase its attractiveness towards real zebrafish. However, we discovered that the actuated tail could also be used to propel RiBot underwater autonomously without using another robot to propel it. The one degree of freedom actuator, which actuates the caudal peduncle, coupled with the thin caudal fin (Fig. 5), allow the device to move autonomously underwater with speeds up to 2.5 cm s\(^{-1}\), using a floating element to stabilize it as no elements to control buoyancy are implemented yet. This maximal speed is in the range of some results obtained with micro underwater vehicles [16, 17].
We measured the linear speed of RiBot underwater with all the different possible amplitudes and frequencies. One can observe in Fig. 6 that RiBot swims slightly faster at high amplitude than at high frequency. The maximal speed of 25 mms\(^{-1}\) is obtained at an amplitude of 22\(^\circ\) and a beating rate of 1 Hz.
4 Behavioral experiments
To qualify RiBot for behavior studies with zebrafish, we designed an experiment to test the attractiveness of the device among a group of living zebrafish.
4.1 Experimental setup
The experimental setup that was used for the experiments consisted of an aquarium of 1000 mm \(\times\) 1000 mm of surface covered on the inside with white teflon sheets (Fig. 7). These sheets are installed to avoid reflection on the glass and to have a smooth surface for the motion of the lure module inside the aquarium. The tank is filled with water up to a level of 60 mm. According to [6], this level of water is not introducing more stress for the fish and furthermore, the lure, whose height cannot vary, will be more visible for the fish that are swimming around. The water temperature is set to 26 °C, as suggested by [6]. A mobile robot, FishBot, designed also in our laboratory, is moving under the aquarium, and the motion is transmitted to RiBot using magnets. FishBot is powered using two conductive plates, one glued on the bottom of the aquarium and one on the support on which the mobile robot is moving.
Inside of the tank, a structure made of white teflon bands of 1 mm width and 8 cm height constrains the fish into a 10 cm large circular corridor (Fig. 8).
4.2 Tracking
During the experiments, video frames were grabbed by a high-definition webcam placed on top of the setup. The frames were retrieved on a computer and a blob detection based algorithm extracted the position of RiBot and the zebrafish (Fig. 8). The data acquired during the experiments were then processed using Matlab. The tracking did not allow to identify the fish but only detect their positions, and sometimes the detection could be disturbed if for instance two fish are very close to each others. However, the tracking was precise enough to measure the location of the fish majority in the experimental setup and thus measure the swimming direction of the fish shoal.
4.3 Animals
The experiments performed in this study were conducted under the authorization N\(^\circ\)2778 delivered by the Department of Consumer and Veterinary of the Canton de Vaud (Switzerland) after submission to the state ethical board for animal experiments.
For the experiments performed, we used 50 wild-type zebrafish Danio Rerio, with short fins. These zebrafish were acquired in a pet shop, and are stored in a 60 litres housing aquarium. The average total length of our zebrafish was \(\sim\)40 mm. The water temperature of the housing aquarium was 26 °C. The fish were fed twice a day using a food distributor with commercial food. The enrichment in the aquarium consisted of plastic plants, cladophoras, gravel, rocks and aquatic snails.
4.4 Experiment design
We tested 5 different modes for the beating tail of RiBot (Table 1) and three different linear constant speeds of the mobile robot: 0, 4 and 8 cm s\(^{-1}\). The modes were selected to test combinations of amplitudes and frequencies within the range of what is shown in Fig. 6. The linear speeds were selected based on the average linear speed of zebrafish, which is around 6 cm s\(^{-1}\) in this setup, so to measure the acceptance of the robot which has no speed, speed below the fish average speed and speed above the fish average speed. We have tested all different conditions with 8 trials randomly-instantiated of 1 min each. We used 5 zebrafish inside the circular corridor during the experiment that were picked randomly on the housing aquarium. The fish could thus move either clockwise (CW) or counter-clockwise (CCW) and RiBot was moving only CCW to determine if it could influence the fish to move inside the corridor with the same direction. After every 10 min of experiments, the group of five fish was replaced by another group of five zebrafish. We did not consider the visual aspect of RiBot in our experiment even if it is well known that it is an important factor in the attraction of zebrafish [18, 19]. This parameter will be tested in future experiments.
5 Results and discussion
In our experiments, we have considered two types of measurements to characterise the acceptance of RiBot: The percentage of time that zebrafish are located at a distance below 5 cm from RiBot, and the swimming direction of the zebrafish inside the ring shape setup, which is either CW or CCW. The first measurement is a good indication of the acceptance of a robotic device by the group of fish [7, 13], compared to the distance between the fish and the robot position, as for the latter we usually obtained less significant effect as we shown in [13]. The second measurement offers a good indication of the influence of RiBot on the collective decision of the group of zebrafish.
Figure 9 shows the percentage of time spent by zebrafish in a 5 cm radius distance from RiBot when the latter was beating its tail, for the three different linear speeds of the robot. When the tail was not beating (frequency of 0 Hz), the presence of zebrafish near RiBot did not depend on the robot linear speed. The standard deviation in these conditions is also relatively small. However, when increasing the frequency of vibration of the tail, we can observe that the impact on the fish attraction started to depend on the robot linear speed. Indeed, when RiBot was static, its attractiveness increased significantly with the increase of vibration, compare to the case when RiBot was moving for which the increase of attraction is not significant. It could be postulated that when RiBot is moving, it also generates vibration underwater, and thus the change of vibration perceived by the zebrafish is not as significant as when RiBot is static. But for the latter, we can argue that the increase of tail beating frequency has a small impact on the attraction of the fish. The increase of attractiveness of an actuated robotic lure towards a group of fish was already mentioned in [9], in which it was demonstrated that fish were more attracted towards the robot when its tail was beating rather than when it was not. It can also be noticed that the standard deviation is increasing with the increase of beating frequency. This could be explained by the fact that this factor has an effect on certain group of fish, but this effect is not constant. Another explanation of this effect can be that the zebrafish may get bored after a certain period of time with the tail beating of RiBot and thus after a short period of attraction, their interest decreases.
Figure 10 shows the swimming direction of the zebrafish for every linear speed conditions of RiBot. The direction was determined using the position of the fish retrieved by the tracking software. The corridor was divided into four quadrants and when the fish majority passes from one quadrant to the other, depending on the direction, the fish shoal is counted as swimming CW or CCW. Without any device present inside water, we noticed that the group of zebrafish swam half of the time in one direction (CW) and half of the time in the other direction (CCW) so the setup had no bias. When RiBot was not moving (linear speed \(=\) 0 cm s\(^{-1}\)), the zebrafish swam mostly half of the time CW and half of the time CCW as for the case when no robotic devices were present. When RiBot was moving with a linear speed of 4 cm s\(^{-1}\) with a CCW direction, the zebrafish started to swim more in the CCW direction, and this effect increased when RiBot was moving with a linear speed of 8 cm s\(^{-1}\) with the zebrafish swimming CCW 70 % of the time with very low standard deviation. We ran an Anderson-darling test on the data to determine the normality of the data and assumed the homogeneity of the variances. We then ran an ANOVA test (Table 2) that rejected the hypothesis that the lure had no effect on the collective decision of the fish shoal (p value \(=\) 0.0141 \(<<\) 0.05). This result demonstrates that the robotic system composed of FishBot and RiBot is able to change the collective decision of the zebrafish shoal, i.e. the swimming direction, when its linear speed is varied. Further works will investigate more deeply the factors that could generate this effect, but this is a promising result using a prototyped version of RiBot.
6 Conclusion and future works
This paper introduced the design of a new robotic fish lure, RiBot, for fish–robot interaction studies. This device could also be used for different research areas such as bio-inspired robotics, biomimetics and animal behavior studies.
We showed that the first prototype of RiBot is able to beat its tail with amplitude up to 23\(^\circ\) and frequency up to 20 Hz. The device has an autonomy of 23 min when the actuator is continuously active during the experiment, but can reach more than 1 h if the actuated tail is only intermittently used. We also measured the speed of the lure when varying the tail beating frequency and amplitude and obtained a maximum linear speed of RiBot underwater of 2.5 cm s\(^{-1}\).
Behavioural experiments, conducted using RiBot coupled with a wheeled mobile robot indicated that the linear speed of RiBot can influence the collective choice of a shoal of zebrafish. The tail beating can also have an effect on the attraction of the fish toward the device, especially when RiBot is not moving. However, when the robot is moving, the effect of the linear speed seems much more significant than the effect of the beating tail. This is an important step to evaluate which stimuli can be attractive for zebrafish to create a mixed society of fish and robots.
Several improvements will be made in future work to decrease the size of RiBot, and several electronic components, such as LEDs and speakers will be added to generate more stimuli to evaluate the attractiveness of the device among zebrafish. Experiments involving a swarm of robotic agents will also be performed to study the interaction between a group of robots and a group of fish.
References
Mondada F, Martinoli A, Correll N, Gribovskiy A, Halloy J, Siegwart R, Deneubourg J-L (2013) A general methodology for the control of mixed natural-artificial societies. In: Kernbach S (ed) Handbook of collective robotics, Chapter 15. Pan Stanford Publishing, Singapore, pp 547–586
Halloy J et al (2007) Social integration of robots into groups of cockroaches to control self-organized choices. Science 318(5853):1155–1158
Krause J, Winfield A, Deneubourg J-L (2011) Interactive robots in experimental biology. Trends Ecol Evol 26(7):369–375
Kawabata K, Aonuma H, Hosoda K, Xue J (2013) A system for automated interaction with the cricket utilizing a micro mobile robot. J Robot Mechatron 25(2):333–339
Gribovksiy A, Halloy J, Deneubourg J.-L., Mondada F (2010) The poulbot, a mobile robot for ethological studies on domestic chickens. Symposium on AI-Inspired Biology
Reed B, Jennings M (2010) Guidance on the housing and care of Zebrafish Danio Rerio. Research Animals Department, Science Group, RSPCA
Abaid A, Bartolini T, Macri S, Porfiri M (2012) Zebrafish responds differentially to a robotic fish of varying aspect ratio, tail beat frequency, noise and color. Behav Brain Res 233:545–553
Aureli M, Fiorilli F, Porfiri M (2012) Portraits of self-organization in fish schools interacting with robots. Phys D: Nonlinear Phenom 241(9):908–920
Marras S, Porfiri M (2012) Fish and robots swimming together: attraction towards the robot demands biomimetic locomotion. J R Soc Interface 9(73):1856–1868
Faria J, Dyer J, Clment R, Couzin I, Holt N, Ward A, Waters D, Krause J (2010) A novel method for investigating the collective behaviour of fish: Introducing Robofish. Behav Ecol Sociobiol 64:1211–1218
Swain D, Couzin I, Leonard N (2012) Real-time feedbackcontrolled robotic fish for behavioral experiments with fish schools. Proc IEEE 100(1):150–163
Landgraf T, Nguyen H, Forgo S, Schneider J, Schrer J, Krger C, Matzke H, Clment R, Krause J, Rojas R (2013) Interactive robotic fish for the analysis of swarm behavior. In: Tan Y, Shi Y, Mo H (eds) ICSI (1), ser. Lecture Notes in Computer Science. vol. 7928, pp 1–10
Bonnet F, Rétornaz P, Halloy J, Gribovskiy A, Mondada F (2012) Development of a mobile robot to study the collective behavior of zebrafish. Proc IEEE Int Conf Biomed Robot Biomechatron BioRob 4:437–442
Bonnet F, Binder S, Elias de Oliveira M, Halloy J and Mondada F (2014) A Miniature mobile robot developed to be socially integrated with species of small fish. IEEE international conference on robotics and biomimetics, Bali, Indonesia
Bandyopadhyay PR (2005) Trends in biorobotic autonomous undersea vehicles. IEEE J Ocean Eng 30:109–139
Heo S, Wiguna T, Park HC, Goo NS (2007) Effect of an artificial caudal fin on the performance of a biomimetic fish robot propelled by piezoelectric actuators. J Bionic Eng 4:151–158
Wang Z, Hanga G, Li J, Wang Y, Xiao K (2008) A micro-robot fish with embedded SMA wire actuated flexible biomimetic. Sens Actuators A 144:354–360
Rosenthal GG, Ryan MJ (2005) Assortative preferences for stripes in danios. Anim Behav 70(5):1063–1066
Saverino C, Gerlai R (2008) The social zebrafish: Behavioral responses to conspecific, heterospecific, and computer animated fish. Behav Brain Res 191(1):77–87
Acknowledgments
This work was supported by the EU-ICT project ASSISIbf, No. 601074. The information provided is the sole responsibility of the authors and does not reflect the European Commissions opinion. The European Commission is not responsible for any use that might be made of data appearing in this publication. We also thank Daniel Burnier and Norbert Crot (LSRO) for the technical support during RiBot design and production.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was presented in part at the 1st International Symposium on Swarm Behavior and Bio-Inspired Robotics, Kyoto, Japan, October 28–30, 2015.
About this article
Cite this article
Bonnet, F., Kato, Y., Halloy, J. et al. Infiltrating the zebrafish swarm: design, implementation and experimental tests of a miniature robotic fish lure for fish–robot interaction studies. Artif Life Robotics 21, 239–246 (2016). https://doi.org/10.1007/s10015-016-0291-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10015-016-0291-8