Abstract
The requirement that mobile robots become independent of external sensors, such as GPS, and are able to navigate in an environment by themselves, means that designers have few alternative techniques available. An increasingly popular approach is to use computer vision as a source of information about the surroundings. This paper presents an implementation of computer vision to hold a quadrocopter aircraft in a stable hovering position using a low-cost, consumer-grade, video system. However, such a system is not able to stabilize the aircraft on its own and must rely on a data-fusion algorithm that uses additional measurements from on-board inertial sensors. Special techniques had to be implemented to compensate for the increased delay in the closed-loop system with the computer vision system, i.e., video timestamping to determine the exact delay of the vision system and a slight modification of the Kalman filter to account for this delay. At the end, the validation results of the proposed filtering technique are presented along with the results of an autonomous flight as a proof of the proposed concept.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
AR.Drone Parrot: http://ardrone.parrot.com/. Accessed 26 Sept 2011
Achtelik, M., Bachrach, A., He, R., Prentice, S., Roy, N.: Autonomous navigation and exploration of a quadrotor helicopter in GPS-denied indoor environments. In: IEEE ICRA. http://iarc.angel-strike.com/oldauvs/5th_mission/2009SymposiumPapers/2009MIT.pdf (2009)
Altug, E., Ostrowski, J., Mahony, R.: Control of a quadrotor helicopter using visual feedback. In: Proceedings 2002 IEEE International Conference on Robotics and Automation, vol. 1, pp. 72–77. IEEE (2002)
Bailey, T., Durrant-Whyte, H.: Simultaneous localization and mapping (SLAM): part II. IEEE Robot. Autom. Mag. 13(3), 108–117 (2006)
Blösch, M., Weiss, S., Scaramuzza, D., Siegwart, R.: Vision based MAV navigation in unknown and unstructured environments. In: IEEE ICRA 2010, pp. 21–28 (2010)
Bourquardez, O., Mahony, R., Guenard, N., Chaumette, F., Hamel, T., Eck, L.: Image-based visual servo control of the translation kinematics of a quadrotor aerial vehicle. IEEE Trans. Robot. (C) 25(3), 2005–2008 (2009)
Bošnak, M.: Quadro: test 1. http://www.youtube.com/watch?v=0bpQeXlspAg
Bošnak, M.: Quadro: test 2. http://www.youtube.com/watch?v=xT-TxufjgVE
Chatterji, G., Menon, P., Sridhar, B.: GPS/machine vision navigation system for aircraft. IEEE Trans. Aerosp. Electron. Syst. 33(3), 1012–1025 (1997)
Conte, G., Doherty, P.: Vision-based unmanned aerial vehicle navigation using geo-referenced information. EURASIP J. Adv. Signal Process. 2009, 1–19 (2009)
Durrant-Whyte, H., Henderson, T.C.: Multisensor data fusion. In: Springer Handbook of Robotics, pp. 585–610 (2001)
Eberli, D., Scaramuzza, D., Weiss, S., Siegwart, R.: Vision based position control for MAVs using one single circular landmark. J. Intell. Robot. Syst. 61(1–4), 495–512 (2011)
Erhard, S., Wenzel, K.E., Zell, A.: Flyphone: visual self-localisation using a mobile phone as onboard image processor on a quadrocopter. J. Intell. Robot. Syst. 57(1–4), 451–465 (2009)
Forsyth, D.A., Ponce, J.: Computer Vision: a Modern Approach. Prentice Hall, Englewood Cliffs, NJ (2003)
Franklin, G., Powell, J., Workman, M.: Digital Control of Dynamic Systems. Prentice Hall, Englewood Cliffs, NJ (1998)
García Carrillo, L.R., Rondon, E., Sanchez, A., Dzul, A., Lozano, R.: Stabilization and trajectory tracking of a quad-rotor using vision. J. Intell. Robot. Syst. 61(1–4), 103–118 (2010)
Grewal, M.S., Andrews, A.P.: Kalman filtering: theory and practice using MATLAB. Wiley-IEEE (2008)
Griffiths, S., Saunders, J., Curtis, A., Barber, B., McLain, T., Beard, R.: Maximizing miniature aerial vehicles. IEEE Robot. Autom. Magazine 13(3), 34–43 (2006)
Guenard, N., Hamel, T., Mahony, R.: A practical visual servo control for an unmanned aerial vehicle. IEEE Trans. Robot. 24(2), 331–340 (2008)
Gurdan, D., Stumpf, J., Achtelik, M., Doth, K.M., Hirzinger, G., Rus, D.: Energy-efficient autonomous four-rotor flying robot controlled at 1 kHz. In: Proceedings of the 2007 IEEE International Conference on Robotics and Automation, pp. 361–366 (2007)
Hutchinson, S., Hager, G., Corke, P.: A tutorial on visual servo control. IEEE Trans. Robot. Autom. 12, 651–670 (1996)
Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., Fitzgibbon, A.: KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In: Proceedings ACM User Interface and Software Technologies (ACM UIST), pp. 559–568 (2011)
Kaiser, M.K., Gans, N.R., Dixon, W.E.: Vision-based estimation for guidance, navigation, and control of an aerial vehicle. IEEE Transactions On Aerospace And Electronic Systems 46(3), 1064–1077 (2010)
Kendoul, F., Fantoni, I., Nonami, K.: Optic flow-based vision system for autonomous 3D localization and control of small aerial vehicles. Robot. Auton. Syst. 57(6–7), 591–602 (2009)
Kim, J., Kang, M.S., Park, S.: Accurate Modeling and Robust Hovering Control for a Quadrotor VTOL Aircraft. J. Intell. Robot. Syst. 57(1–4), 9–26 (2009)
Kirillov, A.: AForge.NET: Glyphs’ Recognition. http://www.aforgenet.com/articles/glyph_recognition/ (2010)
Kis, L., Prohaszka, Z., Regula, G.: Calibration and testing issues of the vision, inertial measurement and control system of an autonomous indoor quadrotor helicopter. In: Proceedings of the RAAD 2008 (2008)
Kitanov, A., Tubin, V., Petrovic, I.: Extending functionality of RF ultrasound positioning system with dead-reckoning to accurately determine mobile robot’s orientation. In: Control Applications (CCA) & Intelligent Control (ISIC), pp. 1152–1157. IEEE (2009)
Klancar, G.: Wide-angle camera distortions and non-uniform illumination in mobile robot tracking. Robot. Auton. Syst. 46(2), 125–133 (2004)
Klein, G., Murray, D.: Parallel tracking and mapping for small AR workspaces. In: 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 1–10. IEEE (2007)
Lange, S., Sünderhauf, N., Protzel, P.: Autonomous landing for a multirotor UAV using vision. In: International Conference on Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR 2008), pp. 482–491 (2008)
Lange, S., Sünderhauf, N., Protzel, P.: A vision based onboard approach for landing and position control of an autonomous multirotor UAV in GPS-denied environments. In: International Conference on Advanced Robotics. ICAR 2009 (2009)
Larsen, T.D., Andersen, N.A., Ravn, O., Poulsen, N.K.: Incorporation of time delayed measurements in a discrete-time Kalman filter. In: Conference on Decision & Control, pp. 3972–3977 (1998)
Liu, C., Chen, W.H., Andrews, J.: Piecewise constant model predictive control for autonomous helicopters. Robot. Auton. Syst. 59(7–8), 571–579 (2011)
Lupashin, S., Sch, A., Sherback, M., Andrea, R.D.: A simple learning strategy for high-speed quadrocopter multi-flips. In: 2010 IEEE International Conference on Robotics and Automation, pp. 1642–1648 (2010)
Maciejowski, J.: Predictive Control with Constraints. Prentice-Hall, Englewood Cliffs, NJ (2002)
Michael, N., Mellinger, D., Lindsey, Q., Kumar, V.: The GRASP multiple micro-UAV testbed: experimental evaluation of multirobot aerial control algorithms. IEEE Robot. Autom. Mag. 17(3), 56–65 (2010)
Saripalli, S., Montgomery, J., Sukhatme, G.: Vision-based autonomous landing of an unmanned aerial vehicle. In: Proceedings of the 2002 IEEE International Conference on Robotics and Automation, vol. 3, pp. 2799–2804. IEEE (2002)
Saripalli, S., Montgomery, J., Sukhatme, G.: Visually guided landing of an unmanned aerial vehicle. IEEE Trans. Robot. Autom. 19(3), 371–380 (2003)
Teslić, L., Skrjanc, I., Klancar, G.: Using a LRF sensor in the Kalman-filtering-based localization of a mobile robot. ISA Transactions 49(1), 145–153 (2010)
Tournier, G.P., Valenti, M., How, J.P., Feron, E.: Monocular vision and moiré patterns. In: AIAA (2006)
Wenzel, K.E., Rosset, P., Zell, A.: Low-cost visual tracking of a landing place and hovering flight control with a microcontroller. J. Intell. Robot. Syst. 57(1–4), 297–311 (2009)
Zhang, P., Gu, J., Milios, E., Huynh, P.: Navigation with IMU/GPS/digital compass with unscented Kalman filter. In: Proceedings of the IEEE International Conference on Mechatronics and Automation, vol. 3, pp. 1497–1502. IEEE (2005)
Zhang, T., Kang, Y., Achtelik, M., Kuhnlenz, K., Buss, M.: Autonomous hovering of a vision/IMU guided quadrotor. In: 2009 International Conference on Mechatronics and Automation, pp. 2870–2875. IEEE (2009)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bošnak, M., Matko, D. & Blažič, S. Quadrocopter Hovering Using Position-estimation Information from Inertial Sensors and a High-delay Video System. J Intell Robot Syst 67, 43–60 (2012). https://doi.org/10.1007/s10846-011-9646-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10846-011-9646-5