Abstract
Dense and robust optical flow estimation is still a major challenge in low-level computer vision. In recent years, mainly variational methods contributed to the progress in this field. One reason for their success is their suitability to be embedded into hierarchical schemes, which makes them capable of handling large pixel displacements. Matching-based regularization techniques, like dynamic programming or belief propagation concepts, can also lead to accurate optical flow fields. However, results are limited to short- or mid-scale optical flow vectors, because these techniques are usually not combined with coarse-to-fine strategies. This paper introduces fSGM, a novel algorithm that is based on scan-line dynamic programming. It uses the cost integration strategy of semi-global matching, a concept well known in the area of stereo matching. The major novelty of fSGM is that it embeds the scan-line dynamic programming approach into a hierarchical scheme, which allows it to handle large pixel displacements with an accuracy comparable to variational methods. We prove the exceptional performance of fSGM by comparing it to current state-of-the-art methods on the KITTI Vision Benchmark Suite.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High Accuracy Optical Flow Estimation Based on a Theory for Warping. In: Pajdla, T., Matas, J. (eds.) ECCV 2004. LNCS, vol. 3024, pp. 25–36. Springer, Heidelberg (2004)
Brox, T., Malik, J.: Large displacement optical flow: descriptor matching in variational motion estimation. IEEE Trans. Pattern Analysis Machine Intelligence 33, 500–513 (2011)
Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient belief propagation for early vision. Int. J. of Computer Vision (IJCV) 70, 41–54 (2006)
Gehrig, S.K., Eberli, F., Meyer, T.: A Real-Time Low-Power Stereo Vision Engine Using Semi-Global Matching. In: Fritz, M., Schiele, B., Piater, J.H. (eds.) ICVS 2009. LNCS, vol. 5815, pp. 134–143. Springer, Heidelberg (2009)
Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? The KITTI Vision Benchmark Suite. In: Proc. Computer Vision Pattern Recognition, CVPR (2012)
Gong, M., Yang, Y.-H.: Estimate large motion using the reliability-based motion estimation algorithm. In: Proc. Int. Joint Conf. Artificial Intelligence (IJCAI), vol. 2, pp. 1120–1126 (1985)
Hermann, S., Morales, S., Vaudrey, T., Klette, R.: Illumination Invariant Cost Functions in Semi-Global Matching. In: Koch, R., Huang, F. (eds.) ACCV 2010 Workshops, Part II. LNCS, vol. 6469, pp. 245–254. Springer, Heidelberg (2011)
Hirschmüller, H.: Accurate and efficient stereo processing by semi-global matching and mutual information. In: Proc. IEEE Int. Conf. Computer Vision Pattern Recognition (CVPR), vol. 2, pp. 807–814 (2005)
Hirschmüller, H., Scharstein, D.: Evaluation of stereo matching costs on images with radiometric differences. IEEE Trans. Pattern Analysis Machine Intelligence 31, 1582–1599 (2009)
Kitt, B., Lategahn, H.: Trinocular optical flow estimation for intelligent vehicle applications. In: Proc. IEEE Int. Conf. Intelligent Transportation Systems (2012) (to appear)
Lempitsky, V., Roth, S., Rother, C.: FusionFlow: Discrete-continuous optimization for optical flow estimation. In: Proc. IEEE Int. Conf. Computer Vision Pattern Recognition, CVPR (2008)
Lei, C., Yang, Y.-H.: Optical flow estimation on coarse-to-fine region-trees using discrete optimization. In: Proc. Int. Conf. Computer Vision (ICCV), pp. 1562–1569 (2009)
Meister, S., Jähne, B., Kondermann, D.: Outdoor stereo camera system for the generation of real-world benchmark data sets. Optical Engineering 51, paper 021107, 6 pages (2012)
Ohta, Y., Kanade, T.: Stereo by two-level dynamic programming. In: Proc. Int. Joint Conf. Artificial Intelligence (IJCAI), vol. 2, pp. 1120–1126 (1985)
Quénot, G.M.: Computation of optical flow using dynamic programming. In: Proc. IAPR Workshop Machine Vision Appl. (MVA), vol. 3, pp. 249–252 (1996)
Ranftl, R., Gehrig, S., Pock, T., Bischof, H.: Pushing the limits of stereo using variational stereo estimation. In: Proc. IEEE Intelligent Vehicles Symposium (IV), pp. 401–407 (2012)
Sun, C.: Fast optical flow using 3D shortest path techniques. Image Vision Computing 20, 981–991 (2002)
Warren, H.S.: Hacker’s Delight, pp. 65–72. Addison-Wesley Longman, New York (2002)
Werlberger, M.: Convex approaches for high performance video processing, PhD thesis (2012)
Werlberger, M., Trobin, W., Pock, T., Wedel, A., Cremers, D., Bischof, H.: Anisotropic Huber-L1 optical flow. In: Proc. British Machine Vision Conference (BMVC), pp. 1–11 (2009)
Zabih, R., Woodfill, J.: Non-parametric Local Transform for Computing Visual Correspondence. In: Eklundh, J.-O. (ed.) ECCV 1994, Part II. LNCS, vol. 801, Springer, Heidelberg (1994)
Zach, C., Pock, T., Bischof, H.: A Duality Based Approach for Realtime TV-L 1 Optical Flow. In: Hamprecht, F.A., Schnörr, C., Jähne, B. (eds.) DAGM 2007. LNCS, vol. 4713, pp. 214–223. Springer, Heidelberg (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hermann, S., Klette, R. (2013). Hierarchical Scan-Line Dynamic Programming for Optical Flow Using Semi-Global Matching. In: Park, JI., Kim, J. (eds) Computer Vision - ACCV 2012 Workshops. ACCV 2012. Lecture Notes in Computer Science, vol 7729. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37484-5_45
Download citation
DOI: https://doi.org/10.1007/978-3-642-37484-5_45
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37483-8
Online ISBN: 978-3-642-37484-5
eBook Packages: Computer ScienceComputer Science (R0)