Abstract
Perspective-n-Point camera pose determination, or the PnP problem, has attracted much attention in the literature. This paper gives a systematic investigation on the PnP problem from both geometric and algebraic standpoints, and has the following contributions: Firstly, we rigorously prove that the PnP problem under distance-based definition is equivalent to the PnP problem under orthogonal-transformation-based definition when n > 3, and equivalent to the PnP problem under rotation-transformation-based definition when n = 3. Secondly, we obtain the upper bounds of the number of solutions for the PnP problem under different definitions. In particular, we show that for any three non-collinear control points, we can always find out a location of optical center such that the P3P problem formed by these three control points and the optical center can have 4 solutions, its upper bound. Additionally a geometric way is provided to construct these 4 solutions. Thirdly, we introduce a depth-ratio based approach to represent the solutions of the whole PnP problem. This approach is shown to be advantageous over the traditional elimination techniques. Lastly, degenerated cases for coplanar or collinear control points are also discussed. Surprisingly enough, it is shown that if all the control points are collinear, the PnP problem under distance-based definition has a unique solution, but the PnP problem under transformation-based definition is only determined up to one free parameter.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
M.A. Abidi and T. Chandra, “A new efficient and direct solution for pose estimation using quadrangular targets: Algorithm and evaluation,” IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 17, No. 5, pp. 534–538, 1995.
A. Ansar and K. Daniilidis, “Linear pose estimation from points or lines,” IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 25, No. 5, pp. 578–589, 2003.
D. Dementhon and L.S. Davis, “Exact and approximate solutions of the perspective-three-point problem,” IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 14, No. 11, pp. 1100–1105, 1992.
M.A. Fischler and R.C. Bolles, “Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography,” Communications of the ACM, Vol. 24, No. 6, pp. 381–395, 1981.
P.D. Fiore, “Efficient linear solution of exterior orientation,” IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 23, No. 2, pp. 140–148, 2001.
X.S. Gao, X.R. Hou, J.L. Tang and H.F. Cheng, “Complete solution classification for the perspective-three-point problem,” IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 25, No. 8, pp. 930–943, 2003.
J.A. Grunert, “Das pothenotische problem in erweiterter gestalt nebst bber seine anwendungen in der geodäsie,” Grunerts Archiv für Mathematik und Physik, Band 1, pp. 238–248, 1841.
R.M. Haralick, C. Lee, K. Ottenberg and M. Nölle, “Analysis and solutions of the three point perspective pose estimation problem,” in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1991, pp. 592–598.
R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, 2000.
R. Horaud, B. Conio, and O. Leboulleux, “An analytic solution for the perspective 4-point problem,” Computer Vision, Graphics, Image Processing, Vol. 47, No. 1, pp. 33–44, 1989.
Z.Y. Hu and F.C. Wu, “A note on the number of solutions of the non-coplanar P4P problem,” IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 24, No. 4, pp. 550–555, 2002.
L. Quan and Z.D. Lan, “Linear n-point camera pose determination,” IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 21, No. 8, pp. 774–780, 1999.
C. Su, Y.Q. Xu, H. Li, and S.Q. Liu, “Necessary and sufficient condition of positive root number of perspective-three-point problem,” Chinese Journal of Computers (in Chinese), Vol. 21, No. 12, pp. 1084–1095, 1998.
W.J. Wolfe, D. Mathis, C.W. Sklair and M. Magee, “The perspective view of three points,” IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 13, No. 1, pp. 66–73, 1991.
Y.H. Wu and Z.Y. Hu, “PnP problem revisited,” Technical Report, RV-NLPR, Institute of Automation, Chinese Academy of Sciences, 2003.
Author information
Authors and Affiliations
Additional information
Yihong Wu received her Bachelor of Science degree in Mathematics from Shanxi Yanbei Normal College in 1995; a Master of Science degree in Computational Algebra from Shaanxi Normal University in 1998; a Doctor of Science degree in Geometric Invariants and Applications from MMRC, Institute of Systems Science, Chinese Academy of Sciences, in 2001. From June 2001 to July 2003, she did her postdoctoral research in NLPR, Institute of Automation, Chinese Academy of Sciences. After then, she joined NLPR as an associate professor. Her research interests include polynomial elimination and applications, geometric invariant and applications, automated geometric theorem proving, camera calibration, camera pose determination, and 3D reconstruction. She has published more than 15 papers on major international journals and major international conferences.
Zhanyi Hu was born in Shanxi province, P. R. China in 1961. He received the B.S. Degree in Automation from the North China University of Technology in 1985, the Ph.D. Degree (Docteur d’Etat) in Computer Science from the University of Liege, Belgium, in Jan. 1993. Since 1993, he has been with the Institute of Automation, Chinese Academy of Sciences. From May 1997 to May 1998, he also acted as a visiting scholar of Chinese University of Hong Kong on invitation. Dr. Hu now is a Research Professor of Computer Vision, a member of the Executive Expert Committee of the Chinese National High Technology R&D Program, a deputy editor-in-chief for Chinese Journal of CAD and CG, and an associate editor for Journal of Computer Science and Technology. His current research interests include Camera Calibration, 3D Reconstruction, Feature Extraction, Vision Guided Robot Navigation etc. Dr. Hu has published more than 70 peer-reviewed papers on major national and international journals.
Rights and permissions
About this article
Cite this article
Wu, Y., Hu, Z. PnP Problem Revisited. J Math Imaging Vis 24, 131–141 (2006). https://doi.org/10.1007/s10851-005-3617-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10851-005-3617-z