Abstract
We present a system that detects 3D mirror-symmetric objects in images and then reconstructs their visible symmetric parts. Our detection stage is based on matching mirror symmetric feature points and descriptors and then estimating the symmetry direction using RANSAC. We enhance this step by augmenting feature descriptors with their affine-deformed versions and matching these extended sets of descriptors. The reconstruction stage uses a novel edge matching algorithm that matches symmetric pairs of curves that are likely to be counterparts. This allows the algorithm to reconstruct lightly textured objects, which are problematic for traditional feature-based and intensity-based stereo matchers.
Chapter PDF
Similar content being viewed by others
References
Liu, Y., Hel-Or, H., Kaplan, C.S., Gool, L.V.: Computational symmetry in computer vision and computer graphics. FnT CGCV 5, 1–195 (2010)
Tuytelaars, T., Turina, A., Van Gool, L.: Noncombinatorial detection of regular repetitions under perspective skew. IEEE PAMI 25, 418–432 (2003)
Loy, G., Eklundh, J.-O.: Detecting Symmetry and Symmetric Constellations of Features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 508–521. Springer, Heidelberg (2006)
Cornelius, H., Perďoch, M., Matas, J(G.), Loy, G.: Efficient Symmetry Detection Using Local Affine Frames. In: Ersbøll, B.K., Pedersen, K.S. (eds.) SCIA 2007. LNCS, vol. 4522, pp. 152–161. Springer, Heidelberg (2007)
Cho, M., Lee, K.M.: Bilateral symmetry detection and segmentation via symmetry-growing. In: BMVC 2009, pp. 4.1–4.1. BMVA Press (2009)
Rauschert, I., Brocklehurst, K., Kashyap, S., Liu, J., Liu, Y.: First symmetry detection competition: Summary and results. Technical Report CSE11-012, Department of Computer Science and Engineering, The Pennsylvania State University (2011)
Wu, C., Frahm, J.M., Pollefeys, M.: Repetition-based dense single-view reconstruction. In: CVPR, pp. 3113–3120 (2011)
Köser, K., Zach, C., Pollefeys, M.: Dense 3D Reconstruction of Symmetric Scenes from a Single Image. In: Mester, R., Felsberg, M. (eds.) DAGM 2011. LNCS, vol. 6835, pp. 266–275. Springer, Heidelberg (2011)
Mitsumoto, H., et al.: 3-D reconstruction using mirror images based on a plane symmetry recovering method. IEEE PAMI 14, 941–946 (1992)
François, A.R.J., Medioni, G.G., Waupotitsch, R.: Mirror symmetry ⇒ 2-view stereo geometry. IVC 21, 137–143 (2003)
Jiang, N., Tan, P., Cheong, L.-H.: Symmetric architecture modeling with a single image. ACM Transactions on Graphics 28 (2009)
Shimshoni, I., Moses, Y., Lindenbaum, M.: Shape Reconstruction of 3D Bilaterally Symmetric Surfaces. IJCV 39, 97–110 (2004)
Xue, T., Liu, J.: Symmetric piecewise planar object reconstruction from a single image. In: CVPR, pp. 2577–2584 (2011)
Sun, Y., Bhanu, B.: Reflection symmetry integrated image segmentation. IEEE PAMI (2011)
Hong, W., Yang, A.Y., Huang, K., Ma, Y.: On symmetry and multiple-view geometry: Structure, pose, and calibration from a single image. IJCV 60, 241–265 (2004)
Mitra, N.J., Guibas, L.J., Pauly, M.: Partial and approximate symmetry detection for 3D geometry. ACM Transactions on Graphics 25, 560–568 (2006)
Wu, C., Frahm, J.-M., Pollefeys, M.: Detecting Large Repetitive Structures with Salient Boundaries. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part II. LNCS, vol. 6312, pp. 142–155. Springer, Heidelberg (2010)
Okutomi, M., Kanade, T.: A multiple baseline stereo. IEEE PAMI 15, 353–363 (1993)
Hartley, R.I., Zisserman, A.: Multiple View Geometry. Cambridge University Press, Cambridge (2004)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. IJCV 60, 91–110 (2004)
Mikolajczyk, K., Schmid, C.: Scale & affine invariant interest point detectors. IJCV 60, 63–86 (2004)
Morel, J.M., Yu, G.: ASIFT: A new framework for fully affine invariant image comparison. SIAM J. Imaging Sciences 2, 438–469 (2009)
Brown, M., Hua, G., Winder, S.: Discriminative learning of local image descriptors. IEEE PAMI 33, 43–57 (2011)
Fischler, M.A., Bolles, R.C.: Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24, 381–395 (1981)
Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. IJCV 47, 7–42 (2002)
Ohta, Y., Kanade, T.: Stereo by intra- and inter-scanline search using dynamic programming. IEEE PAMI PAMI-7, 139–154 (1985)
Collins, R.T.: A space-sweep approach to true multi-image matching. In: CVPR, pp. 358–363 (1996)
Rosten, E., Porter, R., Drummond, T.: Faster and better: A machine learning approach to corner detection. IEEE PAMI 32, 105–119 (2010)
Zitnick, C.L., Ramnath, K.: Edge foci interest points. In: ICCV, pp. 359–366 (2011)
http://research.microsoft.com/en-us/um/redmond/groups/ivm/SymmRecon3D
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sinha, S.N., Ramnath, K., Szeliski, R. (2012). Detecting and Reconstructing 3D Mirror Symmetric Objects. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7573. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33709-3_42
Download citation
DOI: https://doi.org/10.1007/978-3-642-33709-3_42
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33708-6
Online ISBN: 978-3-642-33709-3
eBook Packages: Computer ScienceComputer Science (R0)