Abstract
Video camera is now commonly used and demand of capturing a single frame from video sequence is increasing. Since resolution of video camera is usually lower than digital camera and video data usually contains a many motion blur in the sequence, simple frame capture can produce only low quality image; image restoration technique is inevitably required. In this paper, we propose a method to restore a sharp and high-resolution image from a video sequence by motion deblur for each frame followed by super-resolution technique. Since the frame-rate of the video camera is high and variance of feature appearance in successive frames and motion of feature points are usually small, we can still estimate scene geometries from video data with blur. Therefore, by using such geometric information, we first apply motion deblur for each frame, and then, super-resolve the images from the deblurred image set. For better result, we also propose an adaptive super-resolution technique considering different defocus blur effects dependent on depth. Experimental results are shown to prove the strength of our method.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Ben-Ezra, M., Nayar, S.: Motion Deblurring using Hybrid Imaging. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. I, pp. 657–664 (2003)
Tai, Y.W., Du, H., Brown, M.S., Lin, S.: Image/video deblurring using a hybrid camera. In: CVPR (2008)
Farsiu, S., Robinson, M.D., Elad, M., Milanfar, P.: Fast and robust multiframe super resolution. IEEE Trans. on Image Processing 13, 1327–1344 (2004)
Lucy, L.: An iterative technique for the rectification of observed distributions. J. of Astronomy 79, 745–754 (1974)
Irani, M.I., Peleg, S.: Improving resolution by image registration. CVGIP 53, 231–239 (1991)
Levin, A., Weiss, Y., Durand, F., Freeman, W.: Understanding and evaluating blind deconvolution algorithms. In: CVPR, pp. 1964–1971 (2009)
Li, F., Yu, J., Chai, J.: A hybrid camera for motion deblurring and depth map super-resolution. In: CVPR (2008)
Sroubek, F., Gabriel, C., Flusser, J.: A unified approach to superresolution and multichannel blind deconvolution. IEEE Trans. on Image Processing 16, 2322–2332 (2007)
Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.T.: Removing camera shake from a single photograph. In: SIGGRAPH, pp. 787–794 (2006)
Shan, Q., Jia, J., Agarwala, A.: High-quality motion deblurring from a single image. In: ACM Transactions on Graphics, SIGGRAPH (2008)
Levin, A., Fergus, R., Durand, F., Freeman, W.: Image and depth from a conventional camera with a coded aperture. In: SIGGRAPH (2007)
Levin, A., Sand, P., Cho, T.S., Durand, F., Freeman, W.T.: Motion-invariant photography. In: SIGGRAPH, pp. 1–9 (2008)
Cho, S., Matsushita, Y., Lee, S.: Removing non-uniform motion blur from images. In: ICCV, pp. 1–8 (2007)
Farsiu, S., Elad, M., Milanfar, P.: A practical approach to superresolution. In: Visual Communications and Image Processing, vol. 6077 (2006)
Katsaggelos, A.K., Molina, R., Mateos, J.: Super Resolution of Images and Video. Morgan & Claypool Publishers, San Francisco (2006)
Park, S.C., Park, M.K., Kang, M.G.: Super-resolution image reconstruction: a technical overview. IEEE Signal Processing Magazine 20, 21–36 (2003)
Tung, T., Nobuhara, S., Matsuyama, T.: Simultaneous super-resolution and 3d video using graph-cuts. In: CVPR (2008)
Levin, A.: Blind motion deblurring using image statistics. In: NIPS (2006)
Zucchelli, M., Santos-Victor, J., Christensen, H.: Multiple plane segmentation using optical flow. In: BMVC, pp. 313–322 (2002)
Dick, A., Torr, P., Cipolla, R.: Automatic 3d modelling of architecture. In: BMVC, pp. 372–381 (2000)
Bartoli, A.: Piecewise planar segmentation for automatic scene modeling. In: CVPR, pp. 283–289 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yamaguchi, T., Fukuda, H., Furukawa, R., Kawasaki, H., Sturm, P. (2011). Video Deblurring and Super-Resolution Technique for Multiple Moving Objects. In: Kimmel, R., Klette, R., Sugimoto, A. (eds) Computer Vision – ACCV 2010. ACCV 2010. Lecture Notes in Computer Science, vol 6495. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19282-1_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-19282-1_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-19281-4
Online ISBN: 978-3-642-19282-1
eBook Packages: Computer ScienceComputer Science (R0)