Abstract
A fast and interactive implementation for camera pose registration and 3D point reconstruction over a physical surface is described in this paper. The method (called SRE—Smart Reverse Engineering) extracts from a continuous image streaming, provided by a single camera moving around a real object, a point cloud and the camera’s spatial trajectory. The whole per frame procedure follows three steps: camera calibration, camera registration, bundle adjustment and 3D point calculation. Camera calibration task was performed using a traditional approach based on 2-D structured pattern, while the Optical Flow approach and the Lucas-Kanade algorithm was adopted for feature detection and tracking. Camera registration problem was then solved thanks to the Essential Matrix definition. Finally a fast Bundle Adjustment was performed through the Levenberg-Marquardt algorithm to achieve the best trade-off between 3D structure and camera variations. Exploiting a PC and a commercial webcam, an experimental validation was done in order to verify precision in 3D data reconstruction and speed. Practical tests helped also to tune up several optimization parameters used to improve efficiency of most CPU time consuming algorithms, like Optical Flow and Bundle Adjustment. The method showed robust results in 3D reconstruction and very good performance in real-time applications.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Bolles, R.C., Baker, H.H.: Epipolar-plane image analysis: a technique for analyzing motion sequences. In: IEEE 3rdWorkshop on Computer Vision: Representation and Control, pp 168–178 (1985)
Broida T.J., Chandrashekhar S., Chellappa R.: Recursive 3D motion estimation from a monocular image sequence. IEEE Trans. Aerosp. Electron. Syst. 26(4), 639–656 (1990)
Faugeras, O.D., Luong, Q., Maybank, S.: Camera self-calibration: theory and experiment. European Conference on Computer Vision, (1992)
Fischler M.A., Bolles R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)
Hartley, R.I.: An investigation of the essential matrix. GE internal report, (1995)
Horn B.K.P, Schunck B.G.: Determining optical flow. Artif. Intell. 17, 185–203 (1981)
Kato, H., Billinghurst, M.: Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality (1999)
Kutulakos, K.J., Vallino, J.: Affine objects representation for calibration-free augmented reality. Virtual Reality Annual International Symposium (VRAIS ‘96), pp 430–436. (1996)
Lu, Y., Zhang, J.Z., Wu, Q.M.J., Li, Z.N.: A survey of motion-parallax-based 3-D reconstruction algorithms. IEEE Trans. Syst. Man Cybern. C Appl. Rev. vol. 34, no. 4, pp. 532–548 (2004)
Shariat H., Price K.E.: Motion estimation with more than two frames. IEEE Trans. Pattern Anal. Mach. Intell. 12(5), 417–434 (1990)
Triggs, B., McLauchlan, P., Hartley, R., Fitzgibbon A.: Bundle adjustment—a modern synthesis. Vision algorithms: theory and practice, (2000)
Zhang Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Liverani, A., Leali, F. & Pellicciari, M. Real-time 3D features reconstruction through monocular vision. Int J Interact Des Manuf 4, 103–112 (2010). https://doi.org/10.1007/s12008-010-0093-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12008-010-0093-5