Abstract
In this paper we present a fast video inpainting technique to infer the unknown information in the target region by maximizing box-based self-similarity and coherence measure. The video inpainting is already proposed in the literature and some of them are able to produce good quality results. However, the bottleneck of those algorithms is they are painfully slow. Here we fill the texture in the target region that preserves the smooth motion of the object without inclusion of any artifacts in reasonable amount of time. Our experiments show that the proposed method is quite efficient to synthesize unknown information in a video and comparable to the existing state-of-the-art methods. Moreover, proposed method is based on box filling and optimization is done on multiple scale using EM algorithm, and is computationally faster than the existing ones.
Chapter PDF
Similar content being viewed by others
References
Bertalmio, M., Sapiro, G.: Image In painting. In: Proc. of the ACM SIGGRAPH Conf. on Computer Graphics, New York, USA, pp. 417–424 (2000)
Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 341–346. ACM, New York (2001)
Criminisi, A., Perez, P., Toyama, K.: Object Removal by Exemplar-Based Image Inpainting. In: Proc. IEEE Int. Conf. on Computer Vision, vol. 2, pp. 721–728 (2003)
Sun, J., Yuan, L., Jia, J., Shum, H.: Image Completion with Structure Propagation. In: Proc. SIGGRAPH 2005, pp. 861–868 (2005)
Ashikhmin, M.: Synthesizing natural textures. In: Proc. of ACM Symp. on Interactive 3D Graphics, pp. 217–226 (2001)
Komodakis, N., Tziritas, G.: Image Completion using global optimization. In: Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition, pp. 442–452 (2006)
Bugeau, A., Bertalmio, M., Caselles, V.: A comprehensive framework for image inpainting. IEEE Transaction on Image Processing 19 (October 2010)
Wexler, Y., Shechtman, E., Irani, M.: Space-time video completion. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. I.120–I.127 (2004)
Jia, J., Pang Wu, T., Wing Tai, Y., Keung Tang, C.: Video repairing: Inference of foreground and background under severe occlusion. In: Proc. Computer Vision and Pattern Recognition, pp. 364–371 (2004)
Sapiro, G., Patwardhan, K.A., Bertalmio, M.: Video inpainting of occluding and occluded objects. In: IEEE Int. Conf. Image Processing., vol. 2, pp. 69–72 (2005)
Patwardhan, K.A., Sapiro, G., Bertalmio, M.: Video inpainting under constrained camera motion. IEEE Transc. on Image Processing 16, 545–553 (2007)
Efros, A.A., Leung, T.: Texture synthesis by non-parametric sampling. In: IEEE International Conference on Computer Vision (ICCV), vol. 2, pp. 1033–1038 (1999)
Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.B.: Patchmatch: a randomized correspondence algorithm for structural image editing. ACM Transactions on Graphics, SIGGRAPH, 24.1–24.11 (2009)
Arya, S., Mount, D.M., Netanyahu, N.S., Silverman, R., Wu, A.Y.: An optimal algorithm for approximate nearest neighbor searching fixed dimensions. Journal of ACM 45, 891–923 (1998)
Wexler, Y., Shechtman, E., Irani, M.: Space-time completion of video. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 463–476 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ghorai, M., Purkait, P., Chanda, B. (2013). A Fast Video Inpainting Technique. In: Maji, P., Ghosh, A., Murty, M.N., Ghosh, K., Pal, S.K. (eds) Pattern Recognition and Machine Intelligence. PReMI 2013. Lecture Notes in Computer Science, vol 8251. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-45062-4_59
Download citation
DOI: https://doi.org/10.1007/978-3-642-45062-4_59
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-45061-7
Online ISBN: 978-3-642-45062-4
eBook Packages: Computer ScienceComputer Science (R0)