Abstract
We address the problem of extending the field of view of a photo—an operation we call uncrop. Given a reference photograph to be uncropped, our approach selects, reprojects, and composites a subset of Internet imagery taken near the reference into a larger image around the reference using the underlying scene geometry. The proposed Markov Random Field based approach is capable of handling large Internet photo collections with arbitrary viewpoints, dramatic appearance variation, and complicated scene layout. We show results that are visually compelling on a wide range of real-world landmarks.
Chapter PDF
Similar content being viewed by others
References
Adobe: PhotoShop CS6 PhotoMerge, http://helpx.adobe.com/en/photoshop/using/create-panoramic-images-photomerge.html
Agarwala, A., Agrawala, M., Cohen, M., Salesin, D., Szeliski, R.: Photographing long scenes with multi-viewpoint panoramas. SIGGRAPH (2006)
Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., Cohen, M.: Interactive digital photomontage. SIGGRAPH (2011)
Apple: iPhone 5 Specifications, http://support.apple.com/kb/sp655
Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.B.: PatchMatch: A randomized correspondence algorithm for structural image editing. SIGGRAPH 28(3) (2009)
Delong, A., Osokin, A., Isack, H.N., Boykov, Y.: Fast approximate energy minimization with label costs. IJCV 96(1), 1–27 (2012)
Fay, D., Fay, J., Hoppe, H., Poulain, C.: Terapixel, http://research.microsoft.com/en-us/projects/terapixel/
Fuhrmann, S., Goesele, M.: Fusion of depth maps with multiple scales. SIGGRAPH Asia (2011)
Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R.: Towards internet-scale multi-view stereo. In: CVPR (2010)
Garg, R., Seitz, S.M.: Dynamic mosaics. 3DimPVT (2012)
Hays, J., Efros, A.A.: Scene completion using millions of photographs. SIGGRAPH 26(3) (2007)
He, K., Sun, J., Tang, X.: Guided image filtering. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part I. LNCS, vol. 6311, pp. 1–14. Springer, Heidelberg (2010)
Hertzmann, A., Jacobs, C.E., Oliver, N., Curless, B., Salesin, D.H.: Image analogies. SIGGRAPH (2001)
Jancosek, M., Pajdla, T.: Multi-view reconstruction preserving weakly-supported surfaces. In: CVPR (2011)
Kaneva, B., Sivic, J., Torralba, A., Avidan, S., Freeman, W.T.: Infinite images: Creating and exploring a large photorealistic virtual space. In: Proceedings of the IEEE (2010)
Kopf, J., Uyttendaele, M., Deussen, O., Cohen, M.F.: Capturing and viewing gigapixel images. SIGGRAPH 26(43) (2007)
Microsoft: Photosynth, http://photosynth.net/preview
Nomura, Y., Zhang, L., Nayar, S.: Scene collages and flexible camera arrays. In: Eurographics Symposium on Rendering (2007)
Pritch, Y., Kav-Venaki, E., Peleg, S.: Shift-map image editing. In: ICCV (2009)
Rav-Acha, A., Engel, G., Peleg, S.: Minimal aspect distortion (MAD) mosaicing of long scenes. IJCV 78(2-3), 187–206 (2008)
Richardt, C., Pritch, Y., Zimmer, H., Sorkine-Hornung, A.: Megastereo: Constructing high resolution stereo panoramas. In: CVPR (2013)
Shan, Q., Adams, R., Curless, B., Furukawa, Y., Seitz, S.M.: The visual Turing test for scene reconstruction. In: Joint 3DIM/3DPVT Conference (3DV) (2013)
Shum, H.Y., Szeliski, R.: Stereo reconstruction from multiperspective panoramas. In: ICCV (1999)
Whyte, O., Sivic, J., Zisserman, A.: Get out of my picture! internet-based inpainting. In: Proceedings of the 20th British Machine Vision Conference, London (2009)
Wu, C.: VisualSFM: A visual structure from motion system, http://ccwu.me/vsfm/
Zelnik-Manor, L., Peters, G., Perona, P.: Squaring the circle in panoramas. In: ICCV (2005)
Zhang, C., Gao, J., Wang, O., Georgel, P., Yang, R., Davis, J., Frahm, J.M., Pollefeys, M.: Personal photo enhancement using internet photo collections. TVCG (2014)
Zhang, Y., Xiao, J., Hays, J., Tan, P.: Framebreak: Dramatic image extrapolation by guided shift-maps. In: CVPR (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Shan, Q., Curless, B., Furukawa, Y., Hernandez, C., Seitz, S.M. (2014). Photo Uncrop. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8694. Springer, Cham. https://doi.org/10.1007/978-3-319-10599-4_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-10599-4_2
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10598-7
Online ISBN: 978-3-319-10599-4
eBook Packages: Computer ScienceComputer Science (R0)