Skip to main content

Adaptive visual servoing for various kinds of robot systems

  • Chapter 12 Sensor-Based Control
  • Conference paper
  • First Online:
Experimental Robotics V

Part of the book series: Lecture Notes in Control and Information Sciences ((LNCIS,volume 232))

Abstract

This paper propose an adaptive visual servoing method consisting of an on-line estimator of the robot/image Jacobian matrix and a feedback/feedforward controller for uncalibrated camera-manipulator systems. The estimator does not need a priori knowledge on the kinematic structure nor on parameters of the camera-manipulator system. The controller consists of feedforward and feedback terms to make the image features converge to the desired trajectories using the estimated results. Some experimental results are given to show the validity of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. P. I. Corke. Visual control of robot manipulators — a review. In Visual Servoing, pages 1–31. World Scientific, 1993.

    Google Scholar 

  2. W. Jang and Z. Bien. Feature-based visual servoing of an eye-in-hand robot with improved tracking performance. In Proc. of IEEE Int. Conf. on Robotics and Automation, pages 2254–2260, 1991.

    Google Scholar 

  3. K. Hashimoto, T. Kimoto, T. Ebine, and H. Kimura. Manipulator control with image-based visual servo. In Proc. of IEEE Int. Conf. on Robotics and Automation, pages 2267–2272, 1991.

    Google Scholar 

  4. N. Maru, H. Kase, et al. Manipulator control by visual servoing with the stereo vision. In Proc. of the 1993 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pages 1865–1870, 1993.

    Google Scholar 

  5. P. Allen, A. Timcenko, B. Yoshimi, and P. Michelman. Automated tracking and grasping of a moving object with a robotic hand-eye system. IEEE Trans. on Robotics and Automation, RA-9(2):152–165, 1993.

    Article  Google Scholar 

  6. A. Castano and S. Hutchinson. Visual compliance: Task-derected visual servo control. IEEE Trans. on Robotics and Automation, 10(3):334–342, 1994.

    Article  Google Scholar 

  7. G. D. Hager, W.-C. Cang, and A. S. Morse. Robot feedback control based on stereo vision: Towards calibration-free hand-eye coordination. In Proc. of IEEE Int. Conf. on Robotics and Automation, pages 2850–2856, 1994.

    Google Scholar 

  8. L. E. Weiss, A. C. Sanderson, and C. P. Neuman. Dynamic sensor-based control of robots with visual feedback. IEEE J. of Robotics and Automation, RA-3(5):404–417, 1987.

    Article  Google Scholar 

  9. J. T. Feddema and C. S. G. Lee. Adaptive image feature prediction and control for visual tracking with a hand-eye coordinated camera. IEEE Trans. on System, Man, and Cybernetics, 20(5):1172–1183, 1990.

    Article  Google Scholar 

  10. N. P. Papanikolopoulos and P. K. Khosla. Adaptive robotic visual tracking: Theory and experiments. IEEE Trans. on Automatic Control, 38(3):429–445, 1993.

    Article  MATH  MathSciNet  Google Scholar 

  11. B. Nelson, N. P. Papanikolopoulos, and P. K. Khosla. Visual servoing for robotic assembly. In Visual Servoing, pages 139–164. World Scientific, 1993.

    Google Scholar 

  12. N. P. Papanikolopoulos, B. Nelson, and P. K. Khosla. Six degree-of-freedom hand/eye visual tracking with uncertain parameters. In Proc. of IEEE Int. Conf. on Robotics and Automation, pages 174–179, 1994.

    Google Scholar 

  13. B. H. Yoshimi and P. K. Allen. Alignment using an uncalibrated camera system. IEEE Trans. on Robotics and Automation, 11(4):516–521, 1995.

    Article  Google Scholar 

  14. R. Y. Tsai and R. K. Lenz. A new technique for fully autonomous and efficient 3d robotics hand/eye calibration. IEEE Trans. on Robotics and Automation, 5(3):345–358, 1989.

    Article  Google Scholar 

  15. C. Brown. Gaze controls with interactions and delays. IEEE Trans. on System, Man, and Cybernetics, 20(1):518–527, 1990.

    Article  Google Scholar 

  16. E. D. Dickmanns, B. Mysliwetz, and T. Christians. An integreted spatiotemporal approach to automatic visual guidance of autonomous vehicles. IEEE Trans. on System, Man, and Cybernetics, 20(6):1273–1284, 1990.

    Article  Google Scholar 

  17. W. J. Wilson. Visual servo control of robots using kalman filter estimates of robot pose relative to work-pieces. In Visual Servoing, pages 71–104. World Scientific, 1993.

    Google Scholar 

  18. K. Hosoda, K. Sakamoto, and M. Asada. Trajectory generation for obstacle avoidance of uncalibrated stereo visual servoing without 3d reconstruction. In Proc. of the 1995 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pages 29–34, 1995.

    Google Scholar 

  19. P. Eykhoff. System Identification, chapter 7. John Wiley & Sons Ltd., 1974.

    Google Scholar 

  20. M. Inaba, T. Kamata, and H. Inoue. Rope handling by mobile hand-eye robots. In Proc. of Int. Conf. on Advanced Robotics, pages 121–126, 1993.

    Google Scholar 

  21. Koh Hosoda, Katsuji Igarashi, and Minoru Asada. Adaptive hybrid visual servoing/force control in unknown environment. In Proc. of the 1996 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pages 1097–1103, 1996.

    Google Scholar 

  22. K. Hosoda, M. Kamado, and M. Asada. Vision-based servoing control for legged robots. In Proc. of IEEE Int. Conf. on Robotics and Automation, pages 3154–3159, 1997.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Alicia Casals Anibal T. de Almeida

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag London Limited

About this paper

Cite this paper

Hosoda, K., Asada, M. (1998). Adaptive visual servoing for various kinds of robot systems. In: Casals, A., de Almeida, A.T. (eds) Experimental Robotics V. Lecture Notes in Control and Information Sciences, vol 232. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0112991

Download citation

  • DOI: https://doi.org/10.1007/BFb0112991

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-76218-8

  • Online ISBN: 978-3-540-40920-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics