Abstract
Unmanned aerial vehicles (UAVs) are highly focused and widely used in various domains, and the capability of autonomous aerial refueling (AAR) becomes increasingly important. Most of the research in this area concerns the verification of the algorithms while the experiments are conducted on the ground. In this work, in order to verify the vision system designed for boom approach AAR, an integrated platform is built and tested. The platform consists of a tanker UAV, a receiver UAV and a ground station. The pictures of the marker on the receiver UAV are captured by the binocular vision system on the tanker UAV and then used for flight control and boom control. Performance and feasibility of the platform are demonstrated by the real out-door flight tests, and the experimental results verified the feasibility and effectiveness of our developed binocular vision-based UAVs AAR.
摘要
无人机 (Unmanned aerial vehicles, UAVs) 在工程领域受到高度关注和广泛应用, 在这种情况下, 自动空中加油技术 (autonomous aerial refueling, AAR) 的实现则变得越来越重要。 当前, 该领域的研究重点关注算法的实现, 实际验证则多为地面验证。 为了测试硬管加油的视觉系统, 我们设计并开发了一个完整的实验平台。 该平台由一架加油无人机, 一架受油无人机和地面站组成。加油机上搭载的双目视觉系统采集受油机上的标志点图像,将其用于飞行控制和加油杆控制。实际飞行测试的结果验证了该平台的表现和稳定性。文中展示的结果数据证明视觉系统和控制系统可支持硬式自动空中加油技术的实现。
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Tsai W T, Bai X Y, Huang Y. Software-as-a-service (SaaS): perspectives and challenges. Sci China Inf Sci, 2014, 57: 051101
Dai W Q, Jin H, Zou D Q, et al. TEE: a virtual DRTM based execution environment for secure cloudend computing. Future Gener Comput Syst, 2015; 49: 47–57
Dai WQ, Paul P T, Jin H, et al. Enhancing data trustworthiness via assured digital signing. IEEE Trans Depend Secure Comput (TDSC), 2012; 9: 838–851
Shi L, Zou D Q, Jin H. Xen Virtualization Technology (in Chinese). Wuhan: Huazhong University of Science and Technology Press, 2009
Jin H. The Virtualization of Computing System Principles and Applications (in Chinese). Beijing: Tsinghua University Press, 2008
Zou D Q, Qiang WZ, Jin H. The Principles and Application of Trusted Computing Technology (in Chinese). Beijing: Science Press, 2011
Chen G, Jin H, Zou D Q, et al. A framework for practical dynamic software updating. IEEE Trans Parallel Distrib Syst, 2016; 27: 941–950
Liu K, Zou D Q, Jin H. UaaS: software update as a service for the IaaS cloud. In: Proceedings of IEEE International Conference on Services Computing, Chicago, 2015. 483–490
Tanner H G. Switched UAV-UGV cooperation scheme for target detection. In: Proceedings of IEEE International Conference on Robotics and Automation, Roma, 2007. 3457–3462
Wang X H, Duan H B. Biologically adaptive robust mean shift algorithm with cauchy predator-prey BBO and space variant resolution for unmanned helicopter formation. Sci China Inf Sci, 2014, 57: 112202
Jakob M, Semsch E, Pavlícek D, et al. Occlusion-aware multi-UAV surveillance of multiple urban areas. In: Proceedigns of the 6th Workshop on Agents in Traffic and Transportation, Toronto, 2010. 59–66
Duan H B, Qiu H X, Fan Y M. Unmanned aerial vehicle close formation cooperative control based on predatory escaping pigeon-inspired optimization (in Chinese). Sci Sin Tech, 2015; 45: 559–572
Baba Y, Takano H, Miyamoto S, et al. Air combat guidance law for an UCAV. In: Proceedings of the 1st Technical Conference and Workshop on Unmanned Aerospace Vehicles, Portsmouth, 2002. 1–11
Nalepka J P, Hinchman J L. Automated aerial refueling: extending the effectiveness of unmanned air vehicles. In: Proceedings of Modeling and Simulation Technologies Conference and Exhibit, San Francisco, 2005. 15–18
Valasek J, Gunnam K, Kimmett J, et al. Vision-based sensor and navigation system for autonomous air refueling. J Guid Control Dyna, 2005; 28: 979–989
Chen C I, Stettner R. Drogue tracking using 3D flash lidar for autonomous aerial refueling. Proc SPIE Laser Radar Technology and Applications XVI, 2011. 80370Q
Yin Y, Xu D,Wang X, et al. Detection and tracking strategies for autonomous aerial refueling tasks based on monocular vision. Int J Advanced Robot Syst, 2014; 11: 1–12
Wilson D B, Goktogan A H, Sukkarieh S. Experimental validation of a drogue estimation algorithm for autonomous aerial refueling. In: Proceedings of IEEE International Conference on Robotics and Automation (ICRA), Seattle, 2015. 5318–5323
Campa G, Fravolini M L, Ficola A, et al. Autonomous aerial refueling for UAVs using a combined GPS-machine vision guidance. In: Proceedings of Guidance, Navigation, and Control Conference and Exhibit, Providence, 2004. 1–11
Doebbler J, Spaeth T, Valasek J, et al. Boom and receptacle autonomous air refueling using visual snake optical sensor. J Guid Control Dynam, 2007; 30: 1753–1769
Zhang S J, Cao X B, Zhang F, et al. Monocular vision-based iterative pose estimation algorithm from corresponding feature points. Sci China Inf Sci, 2010; 53: 1682–1696
Lei T, Wang Y, Fan Y Y, et al. Vector morphological operators in HSV color space. Sci China Inf Sci, 2013; 56: 1–12
Zhang W L, Liu L B, Yin S Y, et al. An efficient VLSI architecture of speeded-up robust feature extraction for high resolution and high frame rate video. Sci China Inf Sci, 2013; 56: 1–14
Duan H B, Zhang Q F, Deng Y M, et al. Biologically eagle-eye-based autonomous aerial refueling for unmanned aerial vehicles. Chinese J Sci Instrum, 2014; 35: 1450–1458
Kimmett J, Valasek J, Junkins J L. Autonomous aerial refueling utilizing a vision based navigation system. In: Proceedings of the Guidance, Navigation and Control Conference and Exhibit, Monterey, 2002. 1–11
Lu C P, Hager G D, Mjolsness E. Fast and globally convergent pose estimation from video images. IEEE Trans Pattern Anal Mach Intell, 2000; 22: 610–622
Chen S Z, Xu H, Liu D K, et al. A vision of IoT: applications, challenges and opportunities, with China perspective. IEEE Int Things J, 2014; 1: 349–359
Bouabdallah S, Siegwart R. Full control of a quadrotor. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, 2007. 153–158
Bouabdallah S, Murrieri P, Siegwart R. Design and control of an indoor micro quadrotor. In: Proceedings of IEEE International Conference on Robotics and Automation (ICRA’04), New Orleans, 2004; 5: 4393–4398
Khatib O. Real-time obstacle avoidance for manipulators and mobile robots. Int J Robot Res, 1986; 5: 90–98
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Duan, H., Li, H., Luo, Q. et al. A binocular vision-based UAVs autonomous aerial refueling platform. Sci. China Inf. Sci. 59, 053201 (2016). https://doi.org/10.1007/s11432-016-5553-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11432-016-5553-5
Keywords
- unmanned aerial vehicles (UAVs)
- autonomous aerial refueling (AAR)
- boom approach
- binocular vision
- visual measurement