Abstract
Face recognition based on the analysis of 3D scans has been an active research subject over the last few years. However, the impact of the resolution of 3D scans on the recognition process has not been addressed explicitly yet being of primal importance after the introduction of a new generation of low cost 4D scanning devices. These devices are capable of combined depth/rgb acquisition over time with a low resolution compared to the 3D scanners typically used in 3D face recognition benchmarks. In this paper, we define a super-resolution model for 3D faces by which a sequence of low-resolution 3D scans can be processed to extract a higher resolution 3D face model, namely the superface model. The proposed solution relies on the Scaled ICP procedure to align the low-resolution 3D models with each other and estimate the value of the high-resolution 3D model based on the statistics of values of the low-resolution scans in corresponding points. The approach is validated on a data set that includes, for each subject, one sequence of low-resolution 3D face scans and one ground-truth high-resolution 3D face model acquired through a high-resolution 3D scanner. In this way, results of the super-resolution process are evaluated qualitatively and quantitatively by measuring the error between the superface and the ground-truth.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Wang, Y., Liu, J., Tang, X.: Robust 3D face recognition by local shape difference boosting. IEEE Trans. on Pattern Analysis and Machine Intelligence 32, 1858–1870 (2010)
Berretti, S., Del Bimbo, A., Pala, P.: 3D face recognition using iso-geodesic stripes. IEEE Trans. on Pattern Analysis and Machine Intelligence 32, 2162–2177 (2010)
Colombo, A., Cusano, C., Schettini, R.: Gappy PCA classification for occlusion tolerant 3D face detection. Journal of Math. Imaging and Vision 35, 193–207 (2009)
Passalis, G., Perakis, P., Theoharis, T., Kakadiaris, I.A.: Using facial symmetry to handle pose variations in real-world 3D face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 33, 1938–1951 (2011)
Huang, T., Tsai, R.: Multi-frame image restoration and registration. In: Advances in Computer Vision and Image Processing, vol. 1, pp. 317–339 (1984)
Hardie, R., Barnard, K., Armstrong, E.: Joint map registration and high-resolution image estimation using a sequence of undersampled images. IEEE Trans. on Image Processing 6, 1621–1633 (1997)
Baker, S., Kanade, T.: Limits on super-resolution and how to break them. IEEE Trans. on Pattern Analysis and Machine Intelligence 24, 1167–1183 (2002)
Farsiu, S., Robinson, M., Elad, M., Milanfar, P.: Fast and robust multiframe super resolution. IEEE Trans. on Image Processing 13, 1327–1344 (2004)
Ebrahimi, M., Vrscay, E.: Multi-frame super-resolution with no explicit motion estimation. In: Proc. of Int. Conf. on Image Processing, Computer Vision, and Pattern Recognition (IPCV), pp. 455–459 (2008)
Smelyanskiy, V.N., Cheeseman, P., Maluf, D.A., Morris, R.D.: Bayesian super-resolved surface reconstruction from images. In: Proc. of IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR), pp. 375–382 (2000)
Peng, S., Pan, G., Wu, Z.: Learning-based super-resolution of 3D face model. In: Proc. of IEEE Int. Conf. on Image Processing (ICIP), vol. II, pp. 382–385 (2005)
Schuon, S., Theobalt, C., Davis, J., Thrun, S.: Lidarboost: Depth superresolution for tof 3D shape scanning. In: Proc. of IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR), pp. 343–350 (2009)
Yang, Q., Yang, R., Davis, J., Nister, D.: Spatial-depth super resolution for range images. In: Proc. of IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR), pp. 1–8 (2007)
Pan, G., Han, S., Wu, Z., Wang, Y.: Super-Resolution of 3D Face. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 389–401. Springer, Heidelberg (2006)
Arun, K., Huang, T., Blostein, S.: Least-squares fitting of two 3-D point sets. IEEE Trans. on Pattern Analysis and Machine Intelligence 9, 698–700 (1987)
Du, S., Zheng, N., Xiong, L., Ying, S., Xue, J.: Scaling iterative closest point algorithm for registration of m-D point sets. Journal of Visual Communication and Image Representation 21, 442–452 (2010)
Faugeras, O.: Three-dimensional computer vision: A geometric viewpoint. MIT Press, Cambridge (1993)
Powell, M.: A review of methods for multivariable interpolation at scattered data points. Cambridge University Press (1996)
Aspert, N., Santa-Cruz, D., Ebrahimi, T.: MESH: Measuring errors between surfaces using the Hausdorff distance. In: Proc. of the IEEE Int. Conf. on Multimedia and Expo, vol. I, pp. 705–708 (2002)
Cignoni, P., Montani, C., Scopigno, R.: A comparison of mesh simplification algorithms. Computers & Graphics 22, 37–54 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Berretti, S., Del Bimbo, A., Pala, P. (2012). Superfaces: A Super-Resolution Model for 3D Faces. In: Fusiello, A., Murino, V., Cucchiara, R. (eds) Computer Vision – ECCV 2012. Workshops and Demonstrations. ECCV 2012. Lecture Notes in Computer Science, vol 7583. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33863-2_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-33863-2_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33862-5
Online ISBN: 978-3-642-33863-2
eBook Packages: Computer ScienceComputer Science (R0)