Abstract
Most techniques for reconstructing 3D shapes from multi-view 2D photographic images require a large number of images. In this paper, we present a new method for reconstructing 3D surfaces, represented by sets of polygons, using a small number, e.g. 10, of 2D photographic images with full prior knowledge of camera configurations. The method is automatic. Unlike most currently available silhouette-based multiview reconstruction methods, 3D surface points and surfaces are reconstructed directly from 2D edges without costly intermediate voxel reconstruction. The surfaces reconstructed by the proposed method are self-optimized. More surface points and polygons are automatically generated on highly curved parts of a surface. Experiments on computer generated objects and real physical objects were conducted to verify the method.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
W.-S. Jang and Y.-S. Ho (2010) 3D Object reconstruction from multiple 2-D images, 3D Research 1(2): 02(2010)1-1–02(2010)1-5.
D. Cremers and K. Kolev (2011) Multiview stereo and silhouette consistency via convex functionals over convex domains, IEEE Transactions on Pattern Analysis and Machine Intelligence 33(6): 1161–1174.
K. Nurzynska, M. Kubo et al. (2011) Object Surface Reconstruction from Multi-View Images with Enhancement Driven by Image Forces, SICE Annual Conference. Tokyo.
K. Kolev, T. Brox et al. (2012) Fast Joint Estimation of Silhouettes and Dense 3D Geometry from Multiple Images, IEEE Transactions on Pattern Analysis and Machine Intelligence 34(3): 493–505.
Martin, W. N. and J. K. Aggarwal (1983) Volumetric descriptions of objects from multiple views, IEEE Transactions on Pattern Analysis and Machine Intelligence 5(2): 150–158.
C. Chien and J. Aggarwal (1986) Volume/Surface Octrees for the Representation of Three-Dimensional Objects, Computer Vision, Graphics, and Image Processing 36(1): 100–113.
R. Szeliski (1993) Rapid octree construction from image sequences, Computer Vision, Graphics and Image Processing CVGIP’93.
E. Boyer (1996) Object models from contour sequences, ECCV’96, Cambridge, U.K.
W. Niem and J. Wingbermuhle (1997) Automatic reconstruction of 3D objects using a mobile monoscopic camera, Int. Conf. Recent Advances in 3D Imaging and Modeling, Ottawa, Ont, Canada.
A. W. Fitzgibbon, G. Cross et al. (1998) Automatic 3D model construction for turn-table sequences, ECCV’98 Workshop on 3D Structure from Multiple Images of Large-Scale Environments, Freiburg, Germany.
S. Sullivan and J. Ponce (1998) Automatic model construction, pose estimation, and object recognition from photographs using triangular splines, Int. Conf. Computer Vision (ICCV), Bombay, India.
K. Atsushi, H. Sueyasu et al. (2011) System for reconstruction of three-dimensional micro objects from mulitple photographic images, Computer-Aided Design 43: 1045–1055.
Y. Iwashita, R. Kurazume et al. (2007) Patient-specific femoral shape estimation using a parametric model and two 2D fluoroscopic images, ACCV’07 Workshop on multidimensional and multi-view image processing 59–65.
R. Kurazume, K. Nakamura et al. (2007) 3D reconstruction of a femoral shape using a parametric model and two 2D fluoroscopic images, IEEE International Conference on Robotics and Automation 2007 3002–3008.
A. Szymczak, W. Hoff, et al. (2010) 3D shape from silhouettte points in registered 2D images using conjugate gradient method, Medical Imaging 2010: Image Processing, SPIE.
T. J. Cashman and A. W. Fitzgibbon (2012) What shape are dolphin? Buiding 3D morphable models from 2D images, IEEE Transactions on Pattern Analysis and Machine Intelligence DOI: http://doi.ieeecomputersociety.org/10.1109/TPAMI.2012.68
P. J. Giblin and R. Weiss (1987) Reconstruction of surfaces from profiles, Proc. First Int’l Conf. Computer Vision, London.
R. Cipolla and A. Blake (1992) Surface shape from the deformation of apparent contours, International journal of computer vision 9(2): 83–112.
R. Vaillant and O. D. Faugeras (1992) Using extremal boundaries for 3D object modeling, IEEE Transaction on pattern analysis and machine intelligence 14(2): 157–173.
C. S. Zhao and R. Mohr (1996) Global three-dimensional surface reconstruction from occluding contours, Computer Vision and Image Understanding 64(1): 62–96.
J. -S. Franco and E. Boyer (2003) Exact Polyhedral Visual Hulls, British Machine Vision Conference.
K. Y. K. Wong and R. Cipolla (2004) Reconstruction of Sculpture From Its Profiles With Unknown Camera Positions, IEEE Transactions on Image Processing 13(3): 381–389.
A. Sethi, D. Renaudie et al. (2004) Curve and Surface Duals and the Recognition of Curved 3D Objects from their Silhouette, International journal of computer vision 58(1): 77–86.
T. Joshi, B. Vijayakumar et al. (1997) Hot curves for modelling and recognition of smooth curved 3D objects, Image and Vision Computing 15: 479–498.
M. H. Kuo (2001) Automatic extraction of quadric surfaces from wire-frame models, Computer and Graphics 25: 109–119.
K. Inoue, S. Kenji et al. (2003) Solid model reconstruction of wireframe CAD models based on topological embeddings of planar graphs, Journal of Mechanical Design 125(3): 434–442.
J. -H. Gong, H. Zhang et al. (2007) Converting Hybrid wireframes to B-rep models, ACM Symposium on Solid and Physical Modeling, Beijing, China.
S. Prakoonwit and R. Benjamin (2007) 3D surface point and wireframe reconstruction from multiview photographic images, Image and Vision Computing 25(9): 1509–1518.
S. Prakoonwit and R. Benjamin (2009) Optimal 3D surface reconstruction from multiview photographic images, IEEE International Conference on CyberWorlds. Bradford 126–131.
R. Cipolla and P. Giblin (2000) Visual motion of curves and surfaces, Cambridge, U.K., Cambridge University Press.
P. R. S. Mendonca, K. -Y. K. Wong et al. (2001) Epipolar geometry from profiles under circular motion, IEEE Transaction on pattern analysis and machine intelligence 23(6): 604–616.
R. Koren and Y. Yitzhaky (2006) Automatic selection of edge detector parameters based on apatial and statistical measures, Computer Vision and Image Understanding 102(2): 204–213.
S. Kiranyaz, M. Ferreira et al. (2006) Automatic Object Extraction Over Multiscale Edge Field for Multimedia Retrieval, IEEE Transactions on Image Processing 15(12): 3759–3772.
C. Tomasi and R. Manduchi (1998) Bilateral filtering for gray and color images, 6th International Conference on Computer Vision. Bombay, India.
M. Lindenbaum and A. Berengolts (2000) A probabilistic interpretation of saliency network, ECCV’ 00 Proceedings of the 6th European Conference on Computer Vision-Part II 257–272.
M. Wertheimer (1938) Laws of organization in perceptual forms, A Sourcebook of Gestalt Psychology. W. B. Ellis. New York, Harcourt Brace 71–88.
T. -J. Cham and R. Cipolla (1999) Automated B-spline curve representation incorporating MDL and error-minimizing control point insertion strategies, IEEE Transactions on Pattern Analysis and Machine Intelligence 21(1): 49–53.
E. T. Y. Lee (1989) Choosing nodes in parametric curve interpolation, Computer-Aided Design 21: 363–370.
H. Chen, K. -Y. K. Wong et al. (2006) Extracting surface representation from rim curves, Computer Vision — ACCV 2006, Springer.
A. Bjorck (1996) Numerical Methods for Least Squares Problems, Linköping University, Linköping, Sweden.
M. Mantyla (1986) Boolean operation of 2-manifolds through vertex neighborhood, ACM Transactions on Computer Graphics 5(1): 1–29.
P. J. Giblin (1977) Graphs, surfaces and homology, London, Chapman and Hall.
M. Held (1998) Efficient and reliable triangulation of polygons. Computer Graphics International, IEEE Computer Society 633.
C. Liang, and K. -Y. K. Wong (2007) Robust recovery of shapes with unknown topology from the dual space, IEEE Transactions on Pattern Analysis and Machine Intelligence 29(12): 2205–2216.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Prakoonwit, S., Benjamin, R. 3D surface reconstruction from multiview photographic images using 2D edge contours. 3D Res 3, 6 (2012). https://doi.org/10.1007/3DRes.04(2012)6
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/3DRes.04(2012)6