Abstract
Structure from motion (SfM) is a common technique to recover 3D geometry and camera poses from sets of images of a common scene. In many urban environments, however, there are symmetric, repetitive, or duplicate structures that pose challenges for SfM pipelines. The result of these ambiguous structures is incorrectly placed cameras and points within the reconstruction. In this paper, we present a post-processing method that can not only detect these errors, but successfully resolve them. Our novel approach proposes the strong and informative measure of conflicting observations, and we demonstrate that it is robust to a large variety of scenes.
Chapter PDF
Similar content being viewed by others
References
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstrunk, S.: SLIC Superpixels Compared to State-of-the-Art Superpixel Methods. TPAMI 34(11) (2012)
Agarwal, S., Furukawa, Y., Snavely, N., Simon, I., Curless, B., Seitz, S., Szeliski, R.: Building Rome in a Day. Comm. ACM (2011)
Bansal, M., Daniilidis, K., Sawhney, H.: Ultra-wide baseline facade matching for geo-localization. In: Fusiello, A., Murino, V., Cucchiara, R. (eds.) ECCV 2012 Ws/Demos, Part I. LNCS, vol. 7583, pp. 175–186. Springer, Heidelberg (2012)
Cao, S., Snavely, N.: Graph-based discriminative learning for location recognition. In: CVPR (2013)
Cho, M., Lee, K.M.: Bilateral Symmetry Detection via Symmetry-Growing. In: BMVC (2009)
Cho, M., Shin, Y.M., Lee, K.M.: Unsupervised Detection and Segmentation of Identical Objects. In: CVPR (2010)
Chum, O., Mikulík, A., Perdoch, M., Matas, J.: Total recall II: Query expansion revisited. In: CVPR (2011)
Cohen, A., Zach, C., Sinha, S.N., Pollefeys, M.: Discovering and Exploiting 3D Symmetries in Structure from Motion. In: CVPR (2012)
Crandall, D., Owens, A., Snavely, N., Huttenlocher, D.: Discrete-Continuous Optimization for Large-Scale Structure from Motion. In: CVPR (2011)
Dellaert, F., Seitz, S., Thorpe, C., Thrun, S.: Structure from Motion without Correspondence. In: CVPR (2000)
Frahm, J.-M., et al.: Building rome on a cloudless day. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part IV. LNCS, vol. 6314, pp. 368–381. Springer, Heidelberg (2010)
Jiang, N., Tan, P., Cheong, L.F.: Seeing Double Without Confusion: Structure-from-Motion in Highly Ambiguous Scenes. In: CVPR (2012)
Jiang, N., Tan, P., Cheong, L.: Multi-view Repetitive Structure Detection. In: ICCV (2011)
Köser, K., Zach, C., Pollefeys, M.: Dense 3D Reconstruction of Symmetric Scenes from a Single Image. In: Mester, R., Felsberg, M. (eds.) DAGM 2011. LNCS, vol. 6835, pp. 266–275. Springer, Heidelberg (2011)
Lee, S., Liu, Y.: Curved Glide-Reflection Symmetry Detection. TPAMI 34(2) (2012)
Liu, J., Liu, Y.: GRASP Recurring Patterns from a Single View. In: CVPR (2013)
Liu, Y., Hel-Or, H., Kaplan, C.S., Gool, L.V.: Computational Symmetry in Computer Vision and Computer Graphics. Foundations and Trends in Computer Graphics and Vision 5(1-2) (2010)
Lou, Y., Snavely, N., Gehrke, J.: Matchminer: Efficiently mining spanning structures in large image collections. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part II. LNCS, vol. 7573, pp. 45–58. Springer, Heidelberg (2012)
Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. TPAMI 27(10) (2005)
Raguram, R., Tighe, J., Frahm, J.: Improved geometric verification for large scale landmark image collections. In: BMVC (2012)
Roberts, R., Sinha, S.N., Szeliski, R., Steedly, D.: Structure from motion for scenes with large duplicate structures. In: CVPR (2011)
Schindler, G., Krishnamurthy, P., Lublinerman, R., Liu, Y., Dellaert, F.: Detecting and Matching Repeated Patterns for Automatic Geo-tagging in Urban Environments. In: CVPR (2008)
Sinha, S.N., Ramnath, K., Szeliski, R.: Detecting and Reconstructing 3D Mirror Symmetric Objects. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part II. LNCS, vol. 7573, pp. 586–600. Springer, Heidelberg (2012)
Snavely, N., Seitz, S., Szeliski, R.: Photo Tourism: Exploring image collections in 3D. In: SIGGRAPH (2006)
Torii, A., Sivic, J., Pajdla, T., Okutomi, M.: Visual Place Recognition with Repetitive Structures. In: CVPR (2013)
Wilson, K., Snavely, N.: Network principles for sfm: Disambiguating repeated structures with local context. In: ICCV (2013)
Wu, C.: VisualSFM: A Visual Structure from Motion System (2011), http://ccwu.me/vsfm/
Wu, C., Frahm, J., Pollefeys, M.: Repetition-based Dense Single-View Reconstruction. In: CVPR (2011)
Zach, C., Irschara, A., Bischof, H.: What Can Missing Correspondences Tell Us About 3D Structure and Motion. In: CVPR (2008)
Zach, C., Klopschitz, M., Pollefeys, M.: Disambiguating Visual Relations Using Loop Constraints. In: CVPR (2010)
Zhao, P., Quan, L.: Translation Symmetry Detection in a Fronto-Parallel View. In: CVPR (2011)
Zhao, P., Yang, L., Zhang, H., Quan, L.: Per-Pixel Translational Symmetry Detection, Optimization, and Segmentation. In: CVPR (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Heinly, J., Dunn, E., Frahm, JM. (2014). Correcting for Duplicate Scene Structure in Sparse 3D Reconstruction. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8692. Springer, Cham. https://doi.org/10.1007/978-3-319-10593-2_51
Download citation
DOI: https://doi.org/10.1007/978-3-319-10593-2_51
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10592-5
Online ISBN: 978-3-319-10593-2
eBook Packages: Computer ScienceComputer Science (R0)