Abstract
This paper presents a visual servoing system which incorporates a novel three-dimensional model-based tracking system. This tracking system extends constrained active contour tracking techniques into three dimensions, placing them within a Lie algebraic framework. This is combined with modern graphical rendering technology to create a system which can track complex three dimensional structures in real time at video frame rate (25 Hz) on a standard workstation without special hardware. The system is based on an internal CAD model of the object to be tracked which is rendered using binary space partition trees to perform hidden line removal. The visible features are identified on-line at each frame and are tracked in the video feed. Analytical and statistical edge saliency are then used as a means of increasing the robustness of the tracking system.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
M. Armstrong and A. Zisserman. Robust object tracking. In Proceedings of Second Asian Conference on Computer Vision, pages 58–62, 1995.
R. Basri, E. Rivlin, and I. Shimshoni. Visual homing: Surfing on the epipoles. In Proceedings of International Conference on Computer Vision (ICCV’ 98), pages 863–869, 1998.
R. Cipolla and A. Blake. Image divergence and deformation from closed curves. International Journal of Robotics Research, 16(1):77–96, 1997.
N. Daucher, M. Dhome, J. T. Lapresté, and G. Rives. Modelled object pose estimation abd tracking by monocular vision. In Proceedings of the British Machine Vision Conference, pages 249–258, 1993.
T. Drummond and R. Cipolla. Visual tracking and control using Lie algebras. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR’99), volume 2, pages 652–657, 1999.
T. Drummond and R. Cipolla. Real-time tracking of complex structures with on-line camera calibration. In Proceedings of the 10th British Machine Vision Conference (BMVC’99), 1999. to appear.
B. Espiau, F. Chaumette, and P. Rives. A new approach to visual servoing in robotics. IEEE T-Robotics and Automation, 8(3), 1992.
M. Haag and H-H. Nagel. Tracking of complex driving manoeuvres in traffic image sequences. Image and Vision Computing, 16:517–527, 1998.
G. Hager, G. Grunwald, and K. Toyama. Feature-based visual servoing and its application to telerobotics. In V. Graefe, editor, Intelligent Robotic Systems. Elsevier, 1995.
C. Harris. Tracking with rigid models. In V. Blake editor, Active Vision, chapter 4, pages 59–73. MIT Press, 1992.
C. Harris. Geometry from visual motion. In A. Bedake, editor, Active Vision, chapter 16, pages 263–284. MIT Press, 1992.
P. J. Huber. Robust Statistic. Wiley series in probability and mathematical statistics. Wiley, 1981.
S. Hutchinson, G.D. Hager, and P.I. Corke. A tutorial on visual servo control. IEEET-Robotics and Automation, 12(5):651–670, 1996.
M. Isard and A. Blake. CONDENSATION-conditional density propagation for visual tracking. International Journal of Computer Vision, 29(1):5–28, 1998.
D. G. Lowe. Robust model-based motion tracking through the integration of search and estimation. International Journal of Computer Vision, 8(2):113–122, 1992.
J. MacCormick and A. Blake. Spatial dependence in the observation of visual contours. In Proceedings of the Fifth European Conference on Computer vision (ECCV’98), pages 765–781, 1998.
E. Marchand, P. Bouthemy, F. Chaumette, and V. Moreau. Robust real-time visual tracking using a 2d-3d model-based approach. In Proceedings of IEEE International Conference on Computer Vision (ICCV’99), 1999. to appear.
M. Paterson and F. Yao. Efficient binary space partitions for hidden surface removal and solid modeling. Discrete and Computational Geometry, 5(5):485–503, 1990.
D. Terzopoulos and R. Szeliski. Tracking with Kalman snakes. In A. Blake, editor, Active Vision, chapter 1, pages 3–20. MIT Press, 1992.
A. D. Worrall, G. D. Sullivan, and K. D. Baker. Pose refinement of active models using forces in 3d. In J. Eklundh, editor, Proceedings of the Third European Conference on Computer vision (ECC’ 94), volume 2, pages 341–352, May 1994.
P. Wunsch and G. Hirzinger. Real-time visual tracking of 3-d objects with dynamic handling of occlusion. In Proceedings of the 1997 International Conference on Robotics and Automation, pages 2868–2873, 1997.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Drummond, T., Cipolla, R. (2000). Real-Time Tracking of Complex Structures for Visual Servoing. In: Triggs, B., Zisserman, A., Szeliski, R. (eds) Vision Algorithms: Theory and Practice. IWVA 1999. Lecture Notes in Computer Science, vol 1883. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44480-7_5
Download citation
DOI: https://doi.org/10.1007/3-540-44480-7_5
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67973-8
Online ISBN: 978-3-540-44480-0
eBook Packages: Springer Book Archive