Abstract
Real-Time road detection is a demanding task in active safety and auto-driving of vehicle. Vision is the most popular sensing method for road detection, but it is easier to be influenced by illumination, shadows, shield, etc. To overcome those difficulties, the light detection and ranging (Lidar) sensor is a good choice for road detection. For either the urban environment or the rural areas, the important feature of the road is that the road surface could be approximately represented by some planes. Hence, the Lidar’s scanning plane and the road surface intersect at a set of line segments, and a line segment means a road plane. To extract the line segments from a scan, a least mean square problem is proposed, which is solved by a distance segment approach and an iterative line fitting approach. To eliminate the perception dead zone, some suitable historical data are adopted combining with the fresh data. In order to initial the road search range, a hypothesis is given that the area under the vehicle is road. The road detection is achieved for the scans from the close to the distance and in the meanwhile the search range of the next scan is updated. A lot of experiment results demonstrate the robustness and efficiency of the proposed approach for real-time auto-driving of the intelligent vehicles.
Access provided by Autonomous University of Puebla. Download conference paper PDF
Similar content being viewed by others
Keywords
1 Introduction
Real-Time road detection is one of the most important issues in intelligent vehicle due to its essentiality and necessary in active safety, auto-driving and navigation. To solve this problem a lot of research have been done using visible image [1–3], infrared image [4, 5] and point set of light detection and ranging (Lidar) [6, 7]. Visible image is the most common perception data. A lot of research based on Visible image have done to deal with this problem. To detect road from a single color image, Hui et al. [1] proposed a vanishing point and Foedisch et al. [2] introduced a neural network. For stereo visible image, Son et al. [3] combined a posteriori probability and visual information for image segmentation. Visible image is widely applied for its high resolution, abundant texture information, and lower cost, but it is easier to be influenced by illumination, shadows, shield, etc. Infrared image is mainly used to detect pedestrian [4], but Fardi et al. [5] proposed a Hough transformation-based approach to detect road. The weakness of infrared type sensors is too sensitive to the temperature. To overcome those difficulties, Lidar sensor is a good choice for it stability of illumination, shadows, and temperature. Hence, some research has been done using this type of active sensor. For example, Kirchner and Heinrich [6] proposed a model-based approach and Wijesoma et al. [7] introduced a extend kalman filter. However, the computational complexities of those methods are high and cannot be used to achieve real-time road detection.
To solve the aforementioned problem, a new method based on line segments extraction is approached. For either the urban environment or the rural areas, the important feature of the road is that the road surface could be approximately represented by some planes. Hence, the Lidar’s scanning plane and the road surface intersect at a set of line segments, and a line segment means a road plane. To extract the line segments from these segments, a least mean square problem is proposed, which can be solved by an iterative line fitting approach. To eliminate the perception dead zone, some suitable historical data are adopted combining with the fresh data. To extract road from those data, an initial road range is given based on the hypothesis that the area under the vehicle is road. A lot of experiment results demonstrate the robustness and efficiency of the proposed approach for real-time auto-driving of the intelligent vehicles.
The rest of this paper is organized as follows. In Sect. 2, the model of road is built, and the point set segment method and the iterative line fitting approach are proposed. In Sect. 3 the perception dead zone elimination and the road detection are presented. In Sect. 4, experiments in the urban environment and campus are carried out to demonstrate the robustness and efficiency of the proposed approach for real-time auto-driving of the intelligent vehicles.
2 Road Model and Line Segment Extraction
2.1 Road Model
The most important feature of the road in the urban and highway environment is the well-paved surface and the distinct edge such as isolation belt and curb. For the rural areas in Fig. 1, the road is not so paved and the boundary is ambiguous too.
Hence, a unified model is needed to present the road structure for all the above-mentioned environments. For either the urban environment or the rural areas, the important feature of the road is that the road surface could be approximately represented by some planes. The isolation belt and curb could also be treated as a plane perpendicular to the road surface. Hence, the Lidar’s scanning plane intersects with the road surface or edge at a set of line segments, and a line segment means a plane.
2.2 Point Set Segment
If the Lidar beams fire at the same object, the distance of the adjacent points is small, and it is clearly shown in Fig. 2. Otherwise a large distance means the adjacent points are belong to the different objects. Hence, the point set is segment according to the distances of each pair’s adjacent points, the unified road model is shown in Fig. 3 and Table 1 present the process of segmentation.
In the implementation, an average filtering is used after the segmentation to smooth the data in the same segment. The segments that have only one point are treated as the isolated point and those segments are removed, and the result of segmentation is shown in Fig. 4.
2.3 Line Segment Extraction
The point set is segmented in the previous step, but it is not mean that one segment contain only one line segment. Hence, the problem how many line segments are contained and how to extract the line segments in each segment is proposed. To solve this problem, an iterative line fitting approach is adopted [8], and Table 2 presents the process of line fitting.
This iterative approach for extracting the line segments from the segments is terminated until all the segments are fitted to the proper line, and the computation complexity of this algorithm is O(log2(N)).
3 Road Detection
3.1 Eliminate Perception Dead Zone
A small vertical perception angle is the main disadvantage of the Lidar sensor, consequently, it is important to enlarge the Lidar’s scanning rang to eliminate the perception dead zone in front of the intelligent vehicle. Here we suppose that the vehicle is driving forward and its pose information is available at each moment. Therefore, the suitable historical data can be adopted to eliminate the perception dead zone.
The scanning data of Lidar could be easily corresponding with the pose information. To eliminate perception dead zone, the suitable historical Lidar data right corresponding to the dead zone are selected according to the pose information. The selected historical Lidar data is transformed to the current vehicle coordination according to the change of corresponding pose information.
Here, a four scan-level Lidar sensor is used and one frame historical scan is transformed to the current vehicle coordination to eliminate the dead zone, so we have eight scan data for road detection. In Fig. 5, the result of dead zone elimination is shown, and it is clear that the red historical data enlarge the perception range of the sensor.
3.2 Road Detection
Before road extraction, the point sets are segmented as the approach mentioned in part B of Sect. 2, and then the line segments are extracted from those segments using the method in part C of Sect. 2. To extract road from those line segments, we hypothesize that the area under the vehicle is road. Hence, the initial road range is given as the areas occupied by the car. Then the road detection is achieved for the scans from the close to the distance with a road range value that is updated by the previous scan. The process of road extraction is presented in Table 3.
Here we have eight scan data to detection road. To ensure the accuracy, all the eight scan data are computed as the above-mentioned steps. The line segment extraction based on least mean square algorithm is the most time consuming step. The computation complexity of each scan data is O(log2(N)), so the total computation complexity of the road detection is O(8log2(N)). It is not a calculation burden for the current computer while N is 220 in this paper. The result of road extraction is shown in Fig. 6.
4 Experiment Results
To demonstrate the robustness and efficiency of the proposed approach for real-time auto-driving of the intelligent vehicles, a lot of experiments in the real urban traffic environment and campus have been done. Here some experiment results of different traffic scenes are carried out.
The most common case in the real traffic scene is the obstacle which mainly is vehicle and pedestrian on the adjacent lane or in front of the vehicle, so it is significant to detect the road areas in those situations robustly. The road extraction results of those environments are given in Figs. 7 and 8, and it is clear that our approach works well in this kind of scene.
The barrier is an important instrument on the road for it is essential to defend the vehicles turning back arbitrarily and the humans across the road. Consequently, it is important to detect road areas in this kind of situation and Fig. 9 illuminate that our approach is efficient.
Cross is a complex traffic scene, it is essential to deal with this kind of scene for auto-driving of intelligent vehicle. The result is shown in Figs. 10 and 11, it is obvious that our approach can give out right road areas for vehicle driving through the cross.
In some particular situation such as the traffic accident and road works, the road is bounded by the traffic cones. Hence, it is necessary to detect the safe areas of the road. Figure 12 demonstrates that our approach is valid for this situation.
5 Conclusion
This paper propose a real-time road detection approach using the Lidar data, meanwhile a lot of experiments in the real traffic scene and campus environment illuminate the efficiency and real-time capacity of the new approach. The feature work is to parameterize the present road.
References
Hui K, Audibert JY, Ponce J (2009) Vanishing point detection for road detection. In: IEEE conference on computer vision and pattern recognition 2009, CVPR 2009, pp 96–103
Foedisch M, Takeuchi A (2004) Adaptive real-time road detection using neural networks. In: Proceedings of the 7th international IEEE conference on intelligent transportation systems, 2004, pp 167–172
Son TT, Mita S, Takeuchi A (2008) Road detection using segmentation by weighted aggregation based on visual information and a posteriori probability of road regions. In: IEEE international conference on systems, man and cybernetics, 2008, SMC 2008, pp 3018–3025
Suard F, Rakotomamonjy A, Bensrhair A, Broggi A (2006) Pedestrian detection using infrared images and histograms of oriented gradients. In: IEEE intelligent vehicles symposium, 2006, pp 206–212
Fardi B, Wanielik G (2004) Hough transformation based approach for road border detection in infrared images. In: IEEE intelligent vehicles symposium, 2004, pp 549–554
Kirchner A, Heinrich T (1998) model based detection of road boundaries with a laser scanner. In: Proceedings of the 1998 IEEE international conference on intelligent vehicles, vol 1, pp 93–98
Wijesoma WS, Kodagoda KRS, Balasuriya AP (2004) Road-boundary detection and tracking using ladar sensing. IEEE Trans Robotics Autom 20:456–464
Nguyen V, Martinelli A, Tomatis N, Siegwart R (2005) A comparison of line extraction algorithms using 2D laser rangefinder for indoor mobile robotics. In: IEEE/RSJ international conference on intelligent robots and systems, 2005 (IROS 2005), pp 1929–1934
Acknowledgments
This work is supported by the National Natural Science Foundation of China under Grant Nos. 90920301, 61005014, 61005002 and the National Basic Research Program of China under Grant No. 2012CB316400.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, C., Xue, J., Du, S., Qi, X., Song, Y. (2014). Real-Time Road Detection Using Lidar Data. In: Sun, F., Li, T., Li, H. (eds) Knowledge Engineering and Management. Advances in Intelligent Systems and Computing, vol 214. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37832-4_52
Download citation
DOI: https://doi.org/10.1007/978-3-642-37832-4_52
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37831-7
Online ISBN: 978-3-642-37832-4
eBook Packages: EngineeringEngineering (R0)