Abstract
Automobiles may acquire a rich variety of relevant information from image data and its analysis using machine vision techniques. This chapter provides an overview on the principles underlying image formation and image analysis. The perspective projection model is formulated to describe the mapping of the 3D real world onto the 2D image plane with its intrinsic and extrinsic calibration parameters. Image analysis typically begins with the identification of features. These may describe locations of particular local intensity patterns in a single image, such as edges or corners, or may quantify the 2D displacement of corresponding pixels between two images acquired at different time instances or by a multicamera system. Such features can be used to reconstruct the 3D geometry of the real world using stereo vision, motion stereo, or multiview reconstruction. Temporal tracking using Bayesian filters and its variations not only improves accuracy but readily allows for information fusion with data of other sensors. The chapter closes with two application examples. The first addresses object detection and tracking using multiple image features. The second application focuses on intersection understanding illustrating the large potential of high-level scene interpretation through machine vision.
Similar content being viewed by others
References
Bachmann A, Dang T (2007) Improving motion-based object detection by incorporating object-specific knowledge. Int J Intell Inf Database Syst, Special issue on: Information Processing in Intelligent Vehicles and Road Applications 2(2):258–276
Barker A, Brown DE, Martin WN (1994) Bayesian estimation and the Kalman filter, technical report, IPC-94-002, 5
Bay H, Tuytelaars T, van Gool L (2006) SURF: speeded up robust features. In: European conference on computer vision, Berlin, Heidelberg
Bertozzi M, Broggi A, Castellucio S (1997) A real-time oriented system for vehicle detection. J Syst Archit 1:317–325
Calonder M, Lepetit V, Ozuysal M, Trzcinski T, Stretcha C, Fua P (2012) BRIEF: computing a local binary descriptor very fast. IEEE Trans Pattern Anal Mach Intell 7:1281–1298
Canny J (1986) A computational approach to edge detection. IEEE Trans Pattern Anal Mach Intell 6:679–698
Chen Z (2003) Bayesian filtering: from Kalman filters to particle filters, and beyond. Statistics 182(1):1–69
Cuchiari R, Piccard M (1999) Vehicle detection under day and night illumination. In: International ICSC symposium intelligent industrial automation
Dang T, Hoffmann C, Stiller C (2009) Continuous stereo self-calibration by camera parameter tracking. IEEE Trans Image Process 18(7):1536–1550
Dickmanns ED (1994) The 4D-approach to visual control of autonomous systems. In: IAA NASA conference on intelligent robots in field factory service and space, Houston
Faugeras O (1993) Three dimensional computer vision: a geometric viewpoint. MIT Press, Cambridge, MA
Franke U (1991) Real time 3d-road modeling for autonomous vehicle guidance. In: 7th Scandinavian conference on image analysis, Aalborg
Geiger A (2013) Probabilistic Models for 3D urban scene understanding from movable platforms, PhD thesis, Karlsruhe Institute of Technology
Geiger A, Lenz P, Stiller C, Urtasun R (2013) Vision meets Robotics: the KITTI dataset. Int J Rob Res 32:1231–1237
Geiger A, Lauer M, Wojek C, Stiller C, Urtasun R (2014) 3D traffic scene understanding from movable platforms. IEEE Trans Pattern Anal Mach Intell 36(5):1012–1025
Ghanbarpour Asl H, Pourtakdoust SH (2007) UD Covariance factorization for unscented Kalman filter using sequential measurements update. Int J Eng Nat Sc 1:4
Gonzalez RC, Woods RE (2006) Digital image processing, 3rd edn. Prentice-Hall, Upper Saddle River
Grewe R, Komar M, Hohm A, Hegemann S, Lüke S (2012) Environment modelling for future ADAS functions. In: 19th ITS world congress
Harris CG, Stephens M (1988) A combined corner and edge detector. In: 4th Alvey vision conference, 1988, pp 147–151
Kalinke T, Tzokamkas C, von Seelen W (1998) A texture-based object detection and an adaptive model-based classification. In: IEEE intelligent vehicles symposium, pp 143–148
Lategahn H, Stiller C (2014) Vision-only localization. IEEE Trans Intell Transp Syst 15(3):1246–1257
Lategahn H, Beck J, Kitt B, Stiller C (2013) How to learn an illumination robust image feature for place recognition. In: IEEE intelligent vehicles symposium, Gold Coast
Liebner M, Klanner F, Baumann M, Ruhhammer C, Stiller C (2013) Velocity-based driver intent inference at urban intersections in the presence of preceding vehicles. IEEE Intell Transp Syst Mag 5(2):10–21
Liu Y, Bougani CS, Cheung PYK (2007) Efficient mapping of a Kalman filter into an FPGA using Taylor expansion. In: International conference on field programmable logic and applications, pp 345–350
Longuet-Higgins HC (1981) A computer algorithm for reconstructing a scene from two projections. Nature 293:133–135
Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110
Lucas BD, Kanade T (1981) An iterative image registration technique with an application to stereo vision. In: International joint conference on artificial intelligence, Vancouver, pp 674–679
Meinhold RJ, Singpurwalla ND (1983) Understanding the Kalman filter. Am Stat 37(2):123–127
Mohan A, Papageorgiou C, Poggio T (2001) Example-based object detection in images by components. IEEE Trans Pattern Anal Mach Intell 23(4):349–361
Nistér D (2004) An efficient solution to the five-point relative pose problem. IEEE Trans Pattern Anal Mach Intell 26(6):756–777
Papageorgiou C, Poggio T (2000) A trainable system for object detection. Int J Comput Vis 38(1):15–33
Saarinen J, Andreasson H, Stoyanov T, Luhtala JA, Lilienthal AJ (2013) Normal distributions transform occupancy maps: application to large-scale online 3d mapping. In: IEEE international conference on robotics and automation
Shi J, Tomasi C (1994) Good features to track. In: IEEE conference on computer vision and pattern recognition, Seattle
Stiller C, Konrad J (1999) Estimating motion in image sequences - a tutorial on modeling and computation in 2D motion. IEEE Signal Process Mag 7 and 9:70–91, 116–117
Stiller C, Puente Leon F, Kruse M (2011) Information fusion for automotive applications - an overview. Inf Fusion 12(4):244–252
Sun Z, Bebis B, Miller R (2002) On-road vehicle detection using Gabor-filters and SVM. In: IEEE international conference on digital signal processing, Santori, Greece
Tola E, Lepetit V, Fua P (2010) DAISY: an efficient dense descriptor applied to wide-baseline stereo. IEEE Trans Pattern Anal Mach Intell 32(5):815–830
Triebel R, Pfaff P, Burgard W (2006) Multi-level surface maps for outdoor terrain mapping and loop closing. In: IEEE/RSJ international conference on intelligent robots and systems, pp 2276–2282
Trucco E, Verri A (1998) Introductory techniques for 3–D computer vision. Prentice Hall, New York
Welch G, Bishop G (2006) An introduction to the Kalman filter. Technical report. http://www.cs.unc.edu/˜welch/kalman/kalmanIntro.html
Wojek C, Walk S, Roth S, Schindler K, Schiele B (2013) Monocular visual scene understanding: understanding multi-object traffic scenes. IEEE Trans Pattern Anal Mach Intell 35:882–897
Ziegler J, Bender P, Schreiber M, Lategahn H, Strauss T, Stiller C, Dang T, Franke U, Appenrodt N, Keller CG, Kaus E, Herrtwich RG, Rabe C, Pfeiffer D, Lindner F, Stein F, Erbs F, Enzweiler M, Knoppel C, Hipp J, Haueis M, Trepte M, Brenk C, Tamke A, Ghanaat M, Braun M, Joos A, Fritz H, Mock H, Hein M, Zeeb E (2014) Making Bertha drive - an autonomous journey on a historic route. IEEE Intell Transp Syst Mag 6(2):8–20
Acknowledgments
The authors thank Dr. Christian Duchow for valuable contributions to an early version of this chapter.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this entry
Cite this entry
Stiller, C., Bachmann, A., Geiger, A. (2015). Fundamentals of Machine Vision. In: Winner, H., Hakuli, S., Lotz, F., Singer, C. (eds) Handbook of Driver Assistance Systems. Springer, Cham. https://doi.org/10.1007/978-3-319-09840-1_21-1
Download citation
DOI: https://doi.org/10.1007/978-3-319-09840-1_21-1
Received:
Accepted:
Published:
Publisher Name: Springer, Cham
Online ISBN: 978-3-319-09840-1
eBook Packages: Springer Reference EngineeringReference Module Computer Science and Engineering