Abstract
A single captured image of a scene is usually insufficient to reveal all the details due to the imaging limitations of single senor. To solve this problem, multiple images capturing the same scene with different sensors can be combined into a single fused image which preserves the complementary information of all input images. In this paper, a novel K nearest neighbor (KNN) matting based image fusion technique is proposed which consists of the following steps: First, the salient pixels of each input image is detected using a Laplician filtering based method. Then, guided by the salient pixels and the spatial correlation among adjacent pixels, the KNN matting method is used to calculate a globally optimal weight map for each input image. Finally, the fused image is obtained by calculating the weighed average of the input images. Experiments demonstrate that the proposed algorithm can generate high-quality fused images in terms of good visual quality and high objective indexes. Comparisons with a number of recently proposed fusion techniques show that the proposed method generates better results in most cases.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
References
Goshtasby, A.A., Nikolov, S.: Image fusion: Advances in the state of the art. Inf. Fusion. 8, 114–118 (2007)
Looney, D., Mandic, D.: Multiscale image fusion using complex extensions of EMD. IEEE Trans. Signal Process. 57, 1626–1630 (2009)
Pajares, G., Cruz, J.M.: A wavelet-based image fusion tutorial. Pattern Recognit. 37, 1855–1872 (2004)
Li, S., Kang, X., Hu, J.: Image fusion with guided filtering. IEEE Trans. Image Process. 22, 2864–2875 (2013)
Shen, R., Cheng, I., Shi, J., Basu, A.: Generalized random walks for fusion of multi-exposure images. IEEE Trans. Image Process. 20, 3634–3646 (2011)
Li, S., Kang, X., Hu, J., Yang, B.: Image matting for fusion of multi focus images in dynamic scenes. Inf. Fusion. 14, 147–162 (2013)
Levin, A., Lischinski, D., Weiss, Y.: A closed-form solution to natural image matting. IEEE Trans. Pattern Anal. Mach. Intel. 30, 228–242 (2008)
Cheng, Q., Li, D., Tang, C.: KNN matting. IEEE Trans. Pattern Anal. Mach. Intel. 35, 2175–2188 (2013)
Li, S., Kang, X.: Fast multi-exposure image fusion with median filter and recursive filter. IEEE Trans. Consum. Electronics 20, 3634–3646 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, X., Lin, H., Kang, X., Li, S. (2014). Multi-modal Image Fusion with KNN Matting. In: Li, S., Liu, C., Wang, Y. (eds) Pattern Recognition. CCPR 2014. Communications in Computer and Information Science, vol 484. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-45643-9_10
Download citation
DOI: https://doi.org/10.1007/978-3-662-45643-9_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-45642-2
Online ISBN: 978-3-662-45643-9
eBook Packages: Computer ScienceComputer Science (R0)