Abstract
In this digital interconnected era, Intelligent Transportation System (ITS) bridges the gap between communication and transportation engineering in a smarter way, thereby facilitating the trespassers and travellers with forecasting of traffic and broadcasting of traffic incidents, and infotainment data. Automatic prediction of congestion and traffic flow at one point is a challenging task. Although many machine learning algorithms exist for prediction, the selection of appropriate parameters of algorithms had a great impact on the accuracy of prediction. Hybrid combination of Grey Wolf Optimization (GWO) with new emerging Bald Eagle Search (BES) Optimization algorithm has been proposed to optimize the parameters of Support Vector regression to predict the traffic flow. This hybrid SVR-GWO-BES, has been applied to real-time traffic data of the open-source Performance Measurement system dataset and Indian road traffic, which has been proven to be better than existing methodologies.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
Traffic congestion can be defined as blocking the way of movement of vehicles. Causes of congestion can be traffic incidents, work zones, weather conditions, and fluctuations in normal traffic, the occurrence of special events, the presence of traffic control devices and other physical bottlenecks (Cambridge Systematics 2005).
Socio-economic status and human desire result in an increasing trend of possessing one private vehicle per person instead of one vehicle per house. In developing nations, more usage of private vehicles and less usage of public transportation is one of the major causes of traffic congestion.
Experimental results (Zhang et al. 2012) show how additional traffic congestion increases pollution that negatively affects human health and how the road type has a great impact on the level of pollution. Extensive experiments on the mountain highway near Kathmandu, Nepal, demonstrates that high traffic activities in the roadways induce more metal concentration like Copper, Zinc, Lead, and Cadmium in the nearby farmland soils, which have adverse effects on agriculture (Zhang et al 2012). Khalid et al. demonstrated how an increase in vehicular exhausts significantly reduces the chlorophyll level in the Parthenium hysterophorus plant, which is commonly called Santa Maria and Carrot grass. This warns our human mankind that when chlorophyll levels get reduced in plants, human and animal species are in an endangered situation (Khalid et al. 2017). Intelligent Transportation System (ITS) paves the way to implement green transportation, by predicting traffic congestion, avoiding congested routes thereby reducing pollution. In ITS, nowadays machine learning approaches are being deployed to find the optimal prediction. Xiang shortly portrays the application of big data for Intelligent Transportation System (Li 2019).
Grey Wolf Optimization (GWO) is a bio-inspired Evolutionary Algorithm, coined by Seyedali Mirjalili in the year 2014 (Mirjalili et al 2014). This is inspired by the hunting nature and mimics the leadership attitude of Grey Wolves, biologically named as Canis lupus. Mirjalili coined this grey wolf as a metaheuristic algorithm. In GWO the hierarchical patterns of the grey wolves are constructed utilizing the leaders in the pack. Support Vector Regression (SVR), a variation of Support Vector Machine with regression, has been widely used for prediction.
Bald Eagle Search (BES) optimization is a new meta-heuristic algorithm proposed by Alsattar et al. (2019), inspired from the natural life style of Bald Eagles which follows an intelligent way of identifying the place where fishes are found (dead or alive), searching that location with keen observation and finally swooping out the fish at the better time. This methodology is imitated to predict the optimal solution out of problem domain and it has proven as a better scheme of nature inspired computing.
Grey Wolf Optimizer based SVR has been used to predict the forecasting of traffic flows. As a novel method, Grey Wolf Optimization is combined with Bald Eagle Search algorithm. This proposed methodology is applied to open source Caltrans Performance Measurement Systems (PeMS) dataset (Caltrans) and compared with the existing standard algorithm.
This paper is organized as follows—Sect. 2 illustrates various related works, Sects. 3 and 4 explains the various methods adopted and proposed hybrid methodology. Section 5 lists the experimental setup followed by Results and Discussion in Sect. 6. Section 7 concludes the paper with future enhancements.
2 Related work
Optimization algorithms have been used widely in healthcare system, security services (Kadam et al 2019; Pradeep et al 2019; Vijayakumar et al. 2019). Time series analysis is also called trend analysis that manipulates the data in a series of particular periods. It has a wide range of application domains like budget forecasting, inventory management, sales prediction, and census analysis, etc. In traffic flow forecasting too, time series analysis had a positive influence on predicting short term traffic level. Automatic traffic flow forecasting has been initially grown by application of time series analysis through Box-Jenkins Autoregressive Moving Average (ARIMA) and its variants (Moorthy 1988; Sangsoo 1999). Space–time autoregressive integrated moving average (STARIMA) and vector autoregressive moving average (VARMA) has been utilized (Kamarianakis et al. 2005). All the time series approaches endorsed only when a linear relationship exists.
Machine learning algorithms have been used for traffic flow forecasting for the period. Bayesian network (Shiliang et al 2006; Bidisha et al 2007), Genetic algorithms—with cross-entropy (Lopez-Garcia et al 2015), Time delay neural network (Abdulhai et al 2002).
A Genetic algorithm methodology which is used to adjust the weights of the neural network has been proposed by Liu et al. (2005), but it has failed to perform better with peak values. An iterative evolutionary optimization algorithm, namely Fruit Fly Optimization (FOA) has been used with Least Squares Support Vector Machine to forecast the traffic flow with the sample data from the Renmin street, China (Cong et al 2016). Deep learning-based methodologies like deep belief based multitasking network (Huang et al 2014), stacked encoder model with adaptive boosting scheme (Zhou et al 2017) and with greedy layer method (Lv et al 2015) and multimodal integration framework. A deep learning approach consumes more time and high computational complexity, in which the accuracy depends on the huge volumes of the data.
DE-GWO-SVM (support vector machine optimized by differential evolution and grey wolf optimization) algorithm has been proposed for the prediction of power grid investment (Shuyu et al 2018). Grey wolf Optimization has been combined with oppositional based Laplacian function for Support Vector Classification to cluster the intruder attacks (Anitha et al. 2019). Travel time has been predicted using SVM and SVR from The Taiwan Area National Freeway Bureau (TANFB) which deploys loop detectors to collect real-time data (Chun-Hsin 2004).
Rashedi et al. devised the new optimization methods, which use the law of gravity and interaction of masses (Rashedi et al 2009), called Gravitational Search Algorithm (GSA). GSA is used to determine the optimal parameters of SVR, to achieve global maxima (Cai et al. 2019). GSA is improved in its performance by having control over exploration and exploitation. Based on mass, position, and velocity, the parameters of GSA has been set and combined with SVR. GSA determines the optimal parameter combination of the SVR model by minimizing the value of MAPE. The position of the object with the heaviest mass is the combination of the optimal parameters.
Particle Swarm Optimization is used by Wenbin Hu et al., to optimise the Support vector Regression parameters (Wenbin et al 2016). Amaal et al. applies Grey Wolf Optimization with one class support vector machine for better detection of IoT botnet (Al Shorman 2019). Nonparametric technique (Fan et al. 2003) deployed for financial term dynamics, has been used to approximate the parameters of Extended Vasicek model. This model, which is, employed in economics for short-term prediction, has the advantage of modelling the instantaneous time-dependent mean and variance of a traffic dynamic using daily information and reducing modelling bias. Such a model considers the impact of varying environmental factors in evaluating parameters. In finance, the EV model is used to mathematically represent the changes in interest rates (Smith et al. 2002).
3 Method description
Meta heuristics algorithm can be either a single solution based or population-based. As population-based search techniques result better in estimating global optimum, the family of swarm intelligence has been chosen. Normally most of the swarm intelligent algorithms are in lack of a leader to control, whereas social hierarchy and leadership nature of grey wolves makes the Grey Wolf Optimization as a better choice. Also emerges an optimization algorithm which inherits the behaviour and hunting nature of bald eagles. This section describes the Support Vector Regression, Grey Wolf Optimization and Bald Eagle Search.
3.1 Support vector regression
Support vector machine is a supervised machine learning algorithm. This algorithm has two forms of representation, for Regression and Classification. SVR is proved to be better for time series analysis. A key benefit of using SVR is that the computational complexity does not get affected by the dimensionality of the input data (Mariette 2015). SVR overcomes the drawbacks of Neural Networks for prediction applications. An incremental Support vector regression methodology that outperforms a Back propagation neural network has been proposed (Su et al 2007).
While applying the time series analysis using support vector regression, the selection of SVR parameters plays a vital role, which determines the accuracy of the prediction.
The traffic flow data used for training dataset is represented as
where P represents the number of training data samples. xk and yk are formulated in multi-dimensional space as
where the weight vector w and the bias value b and a nonlinear function \({\varnothing }_{x}\) maps the training data. The weight vector ‘w’ and bias vector ‘b’ can be estimated by the minimization of the objective function’F’.
In which \({y}_{k}\) is the original value,\(f({x}_{k})\) is the estimated or predicted value, C is a constant and \({L}_{\varepsilon }\) is called \(\varepsilon\)—insensitive loss function which is a measure of training error.
The primary objective of our proposed work is to reduce the training error.
β and \(\stackrel{-}{\beta }\) are the non-negative variables that define the deviation of predicted value and original data samples. Using Karush Kuhn Tucker condition, prediction function can be formulated as
Such that \(0\le {a}_{k}^{*}\le C\)
\({a}_{k}\) and \({a}_{k}^{*}\) are the Lagrange multipliers.
The kernel function is a function that maps nonlinear data to linear form. Any function that satisfies Mercer's condition can act as a kernel function. Here kernel function \(K\left(x,{x}_{k}\right)\) is defined by well known Radial Bias function as below with a variable γ.
In SVR, the parameters C, ε, γ have an impact on the accuracy of forecasting.
3.2 Grey wolf optimization
Grey wolves mostly prefer to live in a pack. They follow the social hierarchy and group hunting. They are grouped into four types—Alpha, Beta, Delta and Omega to show the leadership hierarchy, as shown in Fig. 1.
Alpha is the dominant wolf (male or female) and is considered to be the most perfect leading wolf and a decision-maker in a pack. Beta wolves are subordinates to the leader and help in decision making, acts as an advisor and also command his subordinates. The next hierarchy of wolves which behaves like Scouts, Sentinels, and Caretakers of the pack is called Delta. The last layers of wolves which are scapegoats are called Omega. Delta can control omega but need to report to alpha and beta.
GWO algorithm has been compared with other benchmark optimization algorithms like Particle Swarm Optimization (PSO), Gravitational Search Algorithm (GSA), Differential Evolutionary Algorithm (DE) and a few others. Grey wolf hunting includes tracking, encircling and attacking the prey. The fittest wolf category—alpha in the group has the right to target, encircle and attack the prey for hunting.
To have a mathematical representation of the GWO, let us take that the wolves community is named as alpha (A), Beta (B), Delta (D), and Omega (O). Alpha wolves are the best fittest solution, followed by Beta and delta as the next fittest solutions. Beyond this, the residual solutions of the candidates are considered as Omega. The position of the prey is named Xp, the position of alpha, beta and delta are XA, XB, and XD.
where G and M are coefficient vectors
In which a takes the value between 0 and 2 for each iteration, r1 and r2 take random values between and 1.
While searching, positions of each wolf are defined by
Also updation of hunting agents is represented mathematically by
The final optimum solution for the hunter wolf can be given as
3.3 Bald eagle search (BES) algorithm
Bald Eagle Search Algorithm is a new heuristic algorithm developed from the inspiration of our Mother Nature (Alsattar et al 2019). Bald Eagles are intelligent in hunting their favourite food especially salmon fish. They are following an intelligent strategy of selecting the right domain where prey is available, searching the selected domain, and finally swooping out the prey at the appropriate time. These bald eagles exploit the wind speed and stormy air for its efficient hunting strategy.
The hunting behaviour of bald eagle comprises of selecting the appropriate search domain, searching the selected domain and swooping the prey at the right time.
Eagles usually choose a search domain that is nearer in space to previous search domain where it succeeded in hunting. Each movement of eagle is determined by its previous movements.
where E is the position of the eagle, Aʹ is the parameter to control positional change, varies from 1.5 to 2, and r takes the random values from 0 to 1. Ebest refers to the most optimal best position from the past whereas Emean considers all previous search spaces. After choosing a search domain, bald eagles search the selected domain in a spiral pattern, of various sizes.
where Aʹʹ is the parameter that takes value in the range of 5 to 10, which estimates the corner position, R indicates the count of search cycle, ranges from 0.5 to 2 and rd is a random value. After searching the domain and once it identifies the best position to target the prey, eagles swoop the prey from the chosen optimal position. The swooping stage can be represented mathematically as,
b1, b2 takes the range of values from 1 to 2.
4 Traffic flow forecasting using Hybrid SVR-GWO-BES algorithm
Support Vector Regression is one of the better methods for traffic flow forecasting. In any intelligent algorithms, selection of parameters plays a key role in the accuracy of prediction, Grey Wolf Optimization is deployed to estimate the combination of optimal parameters of SVR.
4.1 Hybrid SVR–GWO–BES algorithm
Our proposed methodology combines the grey wolf optimization and bald eagle optimization methods, as shown in Fig. 2. The phases of grey wolf optimization like searching and identification of prey, encircling the prey are used as such. Instead of exploitation, that is, attacking the prey, swooping phase from bald eagle search is adopted.
5 Experimental setup
Caltrans Performance Measurement Systems (PeMS) maintained by the California Department of Transportation, collects a repository of historical data and real-time data (Alsattar et al 2019). This system uses raw detectors and sensors to collect real-time traffic data which are hosted on a website with real-time maps. For testing the performance of SVR–GWO, October and November 2009 data has been used as mentioned (Yalda et al 2017; Chenyi et al 2011). October month data is used for training the model and November data is used for testing the same. The detector used is 1006210, NB 99 Milgeo Avenue at Northbound freeway SR99, California. For comparison purpose, March month of 2016 PeMS dataset has been used.
Traffic Regulation Observed Zone (TROZ) is collaborative work of Greater Chennai Traffic Police and Hyundai Motors India Foundation, for which the System Integrator is Alco System's Chennai, software support is provided by Videonetics (Third Eye 2019). 63 cameras are installed throughout the lanes covering the five main junctions of Chennai—Shanthi Colony, Round Tana, K4 police station, Thirumangalam junction and Anna Nagar West depot.
Although the main objective of TROZ is to monitor the violations in road traffic by monitoring the video footage with Artificial Intelligence software, they share their limited dataset of 15 days for the research purpose, from 1 November 2019 to 15 November 2019. The dataset clearly defines the volume of traffic volume in the Thirumangalam junction for four different categories of vehicles like: Two Wheelers, Three Wheelers, Light Vehicles and Heavy Vehicles.
Our proposed hybrid GWO-BES optimization algorithm is use to optimise the parameters of SVR (Fig. 3) for PeMS 2016, PeMS 2009 and 2019 Chennai datasets.
To measure the accuracy of the proposed methodology, Root Mean Square and Mean Absolute Percentage Error are chosen as the performance evaluation metrics used to assess the accuracy of the methodology. Root Mean Square Error (RMSE) is the standard deviation of the residual or prediction errors. It measures how far our prediction varies from the ground truth value.
Mean Absolute Percentage Error (MAPE) is a simple average of absolute percentage errors.
Lower the values of MAPE and RMSE, the higher the performance of the working model.
6 Results and discussion
In any road network, traffic flow intensity varies based on the time of day and day of the week. Peak hours where there are several transits in vehicles have a high chance of getting congested.
So, for the performance comparison forecasting has been used for weekday traffic data and weekend traffic data separately. Dataset for 2009 and 2016 period has been used for testing purposes. Out of the 2016 dataset, shown samples are weekdays—10.03.2016, 11.3.2016 and weekend 12.03.2016. Figure 4 illustrates the performance metrics when SVR, SVR-PSO, SVR-GSA, EV model, SVR-GWO and SVR-GWO-BES are applied to the above-mentioned datasets. Table 1a show that only the proposed hybrid methodology has a minimum MAPE of 15.38 and a minimum RMSE of 9.26.
Similarly, from the 2009 PeMS dataset, weekdays shown as samples are 15.10.2009, 16.10.2009 and weekend data is 17.10.2009. Likewise, Fig. 5 illustrates the performance metrics when SVR, SVR-PSO, SVR-GSA, EV model, SVR-GWO and SVR-GWO-BES are applied to the above-mentioned dataset, which clearly shows that SVR-GWO-BES has minimum MAPE of 19.24 and minimum RMSE of 13.407815, as tabulated in Table 1b.
For heterogeneous road traffic dataset extracted from Chennai, where traffic flow is categorised per vehicle type, all the algorithms have been applied (Fig. 6). Table 1c shows that the proposed methodology has shown better results.
Simulation results proved that the proposed hybrid SVR-GWO-BES methodology outperforms the performance of Support Vector Regression (SVR), SVR with Gravitational Search Algorithm (SVR-GSA), SVR with Particle Swarm Optimization (SVR-PSO), SVR with Grey Wolf Optimization (SVR-GWO) and Extended Vasicek model.
In general, it is shown that whether it is weekday or weekend traffics flow, SVR optimized by GWO shows more accuracy than SVR-GSA and SVR-PSO. Hybrid GWO-BES outperforms basic GWO. Table 2 illustrates the parameters of SVR, like C, € and γ, which determines the accuracy of the regression. This hybrid combination of two different optimization algorithms results in reduction of the computation time and achieves faster convergence.
7 Conclusion
A hybrid traffic flow forecasting model using SVR optimized by hybrid GWO-BES has been proposed. This case study shows that the SVR-GWO-BES outperforms other optimization algorithms like GSA and PSO to tune the parameters of SVR. The proposed hybrid GWO-BES can be used for prediction of live traffic flow data to show its efficient application in smart transportation. It is planned to apply Bald Eagle Search Algorithm with other variants of GWO.
Change history
14 June 2022
This article has been retracted. Please see the Retraction Notice for more detail: https://doi.org/10.1007/s12652-022-04148-6
References
Abdulhai B, Porwal H, Recker W (2002) Short-term traffic flow prediction using neuro-genetic algorithms. J Intell Transport Syst Technol Plan Oper 7(1):3–41
Al Shorman A, Faris H, Aljarah I (2019) Unsupervised intelligent system based on one class support vector machine and Grey Wolf optimization for IoT botnet detection. J Amb Intell Hum Comput. https://doi.org/10.1007/s12652-019-01387-y
Alsattar HA, Zaidan AA, Zaidan BB (2019) Novel meta-heuristic bald eagle search optimisation algorithm. Artif Intell Rev
Anitha P, Kaarthick B (2019) Oppositional based Laplacian grey wolf optimization algorithm with SVM for data mining in intrusion detection system. J Amb Intell Hum Comput. https://doi.org/10.1007/s12652-019-01606-6
Bidisha G, Biswajit B, Margaret O (2007) Bayesian time-series model for short-term traffic flow forecasting. J Transport Eng 133(3):180–189
Cai L, Chen Q, Cai W, Xu X, Zhou T, Qin J (2019) SVRGSA: a hybrid learning based model for short-term traffic flow forecasting. IET Intell Transp Syst
Caltrans PEMS (2020) http://pems.dot.ca.gov/
Cambridge Systematics (2005) Traffic congestion and reliability: trends and advanced strategies for congestion Mitigation. https://ops.fhwa.dot.gov/congestion_report/congestion_report_05.pdf. Accessed October 2019
Chenyi C, Hu J, Meng Q, Zhang Y (2011) Short-time traffic flow prediction with ARIMA-GARCH model. IEEE Intell Veh Symp
Chun-Hsin W, Ho JM, Lee DT (2004) Travel-time prediction with support vector regression. IEEE Trans Intell Transp Syst 5(4):276–281
Cong Y, Wang J, Li X (2016) Traffic flow forecasting by a least squares support vector machine with a fruit fly optimization algorithm. Proc Eng
Fan J, Jiang J, Zhang C, Zhou Z (2003) Time-dependent diffusion models for term structure dynamics. Stat Sin 965–992
Huang A, Song G, Hong H, Xie K (2014) Deep architecture for traffic flow prediction: deep belief networks with multitask learning. IEEE Trans Intell Transport Syst
Kadam VJ, Jadhav SM, Vijayakumar K (2019) Breast cancer diagnosis using feature ensemble learning based on stacked sparse autoencoders and softmax regression. J Med Syst. https://doi.org/10.1007/s10916-019-1397-z
Kamarianakis Y, Prastacos P (2005) Space-time modeling of traffic flow. Comput Geosci 119–133
Khalid N, Mumtaz H, Mansoor H, Rashid A et al (2017) Physiological, biochemical and defense system responses of Parthenium hysterophorus to vehicular exhaust pollution. Pak J Bot 49(1):67–75
Li X (2019) Intelligent transportation systems in big data. J Amb Intell Hum Comput. https://doi.org/10.1007/s12652-018-1028-4
Liu M, Wang R, Wu J, Kemp R (2005) A genetic-algorithm-based neural network approach for short-term traffic flow forecasting. International Symposium on Neural Networks, Berlin
Lopez-Garcia P, Onieva E, Osaba E, Masegosa AD, Perallos A (2015) A hybrid method for short-term traffic congestion forecasting using genetic algorithms and cross entropy. IEEE Trans Intell Transp Syst 17(2):557–569
Lv Y, Duan Y, Kang W, Li Z, Wang F (2015) Traffic flow prediction with big data: a deep learning approach. IEEE Trans Intell Transp Syst 16(2):865–873
Mariette A, Rahul K (2015) Support vector regression. Efficient learning machines theories, concepts, and applications for engineers and system designers 67–80
Mirjalili S, Seyed MM, Andrew L (2014) Grey wolf optimizer. Adv Eng Softw
Moorthy CK, Ratcliffe BG (1988) Short term traffic forecasting using time series methods. Transport Plan Technol 12(1):45–56
Pradeep MKK, Saravanan M, Thenmozhi M, Vijayakumar K (2019) Intrusion detection system based on GA-fuzzy classifier for detecting malicious attacks. Wiley, New York. https://doi.org/10.1002/cpe.5242
Rashedi E, Hossein NP, Saeid S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248
Sangsoo L, Fambro DB (1999) Application of subset autoregressive integrated moving average model for short-term freeway traffic volume forecasting. Transp Res Rec 1678(1):179–188
Shiliang S, Zhang C, Yu G (2006) A Bayesian network approach to traffic flow forecasting. IEEE Trans Intell Transp Syst 7(1):124–132
Shuyu D, Niu D, Han Y (2018) Forecasting of power grid investment in china based on support vector machine optimized by differential evolution algorithm and grey wolf optimization algorithm. Appl Sci 8:4
Smith BL, Williams BM (2002) Comparison of parametric and nonparametric models for traffic flow forecasting. Transp Res 10(4):303–321
Su H, Zhang L, Yu S (2007) Short-term traffic flow prediction based on incremental support vector regression. Third International Conference on Natural Computation
The Third Eye: Managing the traffic (2019) https://www.trafficinfratech.com/the-third-eye-managing-the-traffic/4/
Vijayakumar K, Pradeep MKK, Jesline D (2019) Implementation of software agents and advanced aoa for disease data analysis. J Med Syst. https://doi.org/10.1007/s10916-019-1411-5
Wenbin H, Yan L, Liu K, Wang H (2016) A short-term traffic flow forecasting method based on the hybrid PSO-SVR. Neural Process Lett 43:155–172. https://doi.org/10.1007/s11063-015-9409-6
Yalda R, Amir HR, Hamidreza A (2017) Short-term traffic flow prediction using time-varying Vasicek model. Transport Rese Part C Emerg Technol 74:168–181
Zhou T, Han G, Xu X, Lin Z, Han C, Huang Y, Qin J (2017) δ-agree AdaBoost stacked autoencoder for short-term traffic flow forecasting. Neurocomputing
Zhang F, Yan X, Zeng C, Zhang M, Shrestha S, Devkota LP, Yao T (2012) Influence of traffic activity on heavy metal concentrations of roadside farmland soil in mountainous areas. Int J Environ Res Public Health 9(5):1715–1731
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article has been retracted. Please see the retraction notice for more detail: https://doi.org/10.1007/s12652-022-04148-6"
About this article
Cite this article
Angayarkanni, S.A., Sivakumar, R. & Ramana Rao, Y.V. RETRACTED ARTICLE: Hybrid Grey Wolf: Bald Eagle search optimized support vector regression for traffic flow forecasting. J Ambient Intell Human Comput 12, 1293–1304 (2021). https://doi.org/10.1007/s12652-020-02182-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-020-02182-w