Abstract
This study presents a novel implementation of evolutionary heuristics through backtracking search optimization algorithm (BSA) for accurate, efficient and robust parameter estimation of power signal models. The mathematical formulation of fitness function is accomplished by exploiting the approximation theory in mean squared errors between actual and estimated responses, as well as, true and approximated decision variables. Variants of BSA-based meta-heuristics are applied for parameter estimation problem of power signals for identification of amplitude, frequency and phase parameters for different scenarios of noise variation. Analysis of performance evaluation for BSAs is conducted through exhaustive statistical observations in terms of mean weight deviation, root mean square error and Thiel inequality coefficient-based assessment metrics, as well as, ANOVA tests for statistical significance.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
In electrical power supply systems, frequency is a significant, as well as, fundamental parameter that specifies stability between power generation and power consumption [1]. Thus, the frequency component can be considered as a functional gauge to identify anomalous operating conditions [2]. In order to ensure regulated power supply to the clients and the utilities, it is mandatory requirement to scrutinize power quality of electrical grid through parameter estimation of power signal i.e., amplitudes, phases and frequencies [3, 4]. Research community has shown considerable interest in parameter estimation of power signal in power planning and distribution systems, for instance, Xu and Ding [5] presented the stochastic gradient (SG) and least squares (LS) procedures, Xu et al. [6] developed the hierarchical parameter estimation method, Li et al. [7] applied the reconstructing time sample techniques, Cao and Liu [8] gave the concept of the hierarchical identification approach, Phan et al. [3] described dedicated state space method, Chen et al. [9, 10] provided fast Fourier transform methods and Chaudhary et al. [11,12,13] provided the scheme of fractional adaptive filtering. The parameters of modeling power signals are identified by variety of the procedures introduced recently [14,15,16,17,18,19,20]. These are all deterministic procedures with their own perks, benefits and limitations while stochastic computing paradigm based on bioinspired heuristic looks promising to be explored exhaustively in the domain of power signal modeling.
The backtracking search optimization algorithm (BSA)-based evolutionary computing solvers have been explored to solving many problems arising in engineering and technological domains. A few latest applications of these schemes are in fluid dynamics [21], nanotechnology [22], wireless networks [23], system identification [24], power electronics [25], control [26], electric machines [27], economic load dispatch problems [28], nonlinear electric circuits [29], signal processing [30], biomedical [31], bioinformatics [32], finance [33]. All these contributions motivate authors to explore in meta-heuristic paradigm of BSA for accurate, reliable and robust system identification problems arising in power signal models. The aim of this research study is to exploit the well-known strength of BSA for parameter estimation of power signal systems. The prominent features of the proposed scheme are:
-
A novel application of evolutionary computational heuristics through BSA is presented for effective, viable and reliable estimation of parameters in power signal modeling problems.
-
Approximation theory is exploited for formulation of fitness function in terms of mean squared errors of actual and approximated parameters as well as responses for power signal models.
-
Variants of BSA are implemented for parameter estimation of power signals with different degrees of freedom based on amplitude, frequency and phase for number of noise variances.
-
Performance verification is ascertained through statistical results in terms of mean weight deviation, root mean square error and Thiel inequality coefficient-based evaluations metrics. Further, significance of the model is evaluated on the basis of ANOVA test.
Rest of the paper is organized as follows: Sect. 2 presents the necessary details of power signal modeling problem, designed methodology for parameter estimation is provided in Sect. 3, simulation of experimentation with interpretations is given in Sect. 4, while the conclusions and future recommendations are listed in Sect. 5.
2 System model: power signals
A distorted electric signal s(t) from an AC power system can be expressed in the form of Fourier series [6, 34]:
here, c and d are the Fourier coefficients, K is the harmonics index and ω is the fundamental frequency of the AC system.
The generic description of alternating current electrical signal can be derived from Eq. (1) and given below in terms of amplitudes, frequencies and phases as [8]:
for xi(t) = ωit + φi.
The amplitudes, the frequencies and phases (in radians) are represented as \(\varvec{r} = [r_{1} ,r_{2} , \ldots ,r_{k} ]\), \(\varvec{\omega}= [\omega_{1} ,\omega_{2} , \ldots ,\omega_{k} ],\) and \(\varvec{\varphi } = [\varphi_{1} ,\varphi_{2} , \ldots ,\varphi_{k} ],\), respectively. For all non-zero magnitudes of \(\varphi\), the whole signal waveform appears to be shifted in time scale by \(\varphi /\omega\) seconds. A positive magnitude of \(\varphi\) indicates an advance while a negative value is for a delay in the electric signal. Eqs. (1)–(2) have been reported from many studies of electrical and electronic engineering [35,36,37,38] and reference therein.
In this experimental procedure, \(t_{n} = nh\) is the sampling whose sampling period is h. The observed data are \(\left\{ {t_{k} ,s(t_{k} )} \right\}\). Let \(r_{n} = s(t_{n} )\) for inference, then, the discretized electrical signal on the basis of sinusoidal function is formalized as:
The expression for the power signal (2) in discrete form as:
Amplitudes, frequencies and phases are components of the electrical signals described in Eqs. (1)–(4). In addition to individual any arbitrary combination of these parameters based on can be formulized for the parameter estimation problems. The unknown fundamental components of power signal to be estimated are given as:
The individual parameter estimation problems are given in Eqs. (6)–(8), while parametric Eqs. (9)–(12) indicate the integrated parameter estimation systems.
3 Proposed methodology
In this section, proposed methodology for parameter estimation of signal modeling problem is presented in two steps; fitness function formulation and learning procedure by exploitation of meta-heuristics of BSA. The framework of the proposed methodology is presented graphically in Fig. 1.
3.1 Construction of fitness function
In the first step, the fitness/merit function e is constructed in mean square sense as:
where \(e_{1}\) is the difference actual \(s\) and estimated \(\hat{s}\) response and is expressed as:
while \(e_{2}\) is an error term associated with parameter vector,
For example, the fitness function formulation for power signal model represented in Eq. (3) with decision variables as given in Eq. (5) in case of e1 is given as:
Accordingly, \(e_{2}\) is error function associated with the parameter vector in case of Eq. (5) is given as:
using Eq. (5), we have
Now, the fitness function e as given in Eq. (13) is written as:
Similarly, the fitness function formulation for power signal model represented in Eq. (4) with decision variables as given in Eq. (11) is given as:
Accordingly, the fitness function formulation for power signal model represented in Eq. (4) with decision variables as given in Eq. (11) is given as:
On a similar pattern, the rest of the fitness functions are constructed for different power signal models.
Now, objective is optimization of the error functions given in Eqs. (19)–(21) in such a way that as e approaches zero, the adaptive parameter vectors of decision variable \(\hat{\varvec{\vartheta }}_{cd}\), \(\hat{\varvec{\vartheta }}_{\omega ,\varphi }\) and \(\hat{\varvec{\vartheta }}_{r,\omega ,\varphi }\) matches the desired variables \(\varvec{\vartheta}_{cd}\), \(\varvec{\vartheta}_{\omega ,\varphi }\) and \(\varvec{\vartheta}_{r,\omega ,\varphi }\) of the power signal models, respectively.
3.2 Learning method: variants of BSA
The second phase of designed methodology, we introduced BSA for optimization of decision variable of power signal model.
BSA is an initial population-based stochastic algorithm introduced by Civicioglu [39] in 2012 for the solution of constraint and unconstraint optimization problem. In BSA, trial population is generated using three basic recombination operators including selection, mutation and crossover. BSA employs random mutation process and non-uniform crossover strategy which is relatively complex than traditional ones. BSA belongs to the class of global optimization technique designed to solve high dimensional multimodal optimization problems having simple structure, single control parameter and additional benefit of possessing a memory. Few recent potential applications of BSA include beach realignment [40], solving constrained engineering problem [41], parameter estimation [42], economic load dispatch problem [43], wireless communication [44, 45], photovoltaic models [46] and nonlinear system identification [47]. Graphical flow chart describing the procedural steps of BSA is shown in Fig. 1, while necessary further detailed of these steps is provide in the pseudocode presented in Table 1.
The performance analysis for parameter estimation of signal modeling problem has also been carried out based on fitness function, normalizing error calculation, root mean squared error (RMSE) and Thiel’s inequality coefficient (TIC). The mathematical definitions of these performance indices can be seen in [47] for interested readers.
4 Numerical experimentation
Simulations are performed for three different examples of power signals parameter estimation problems through the evolutionary computing heuristics of BSA under varying noise scenarios. The variants of BSA are designed by means of different population size (PS) and generations (GENS) as tabulated in Table 2.
Example 1
In this case study, the power signal estimation problem with known amplitude while, unknown frequency and phase parameters is taken. The mathematical expressions for Example 1 are written as [8]:
Example 2
The power signal modeling problem with unknown amplitude, frequency and phase in the parameter vector is taken. The mathematical expressions for Example 2 are given as [8]:
Example 3
The power signal modeling problem with unknown amplitude in the parameter vector is presented mathematically as [34]:
In the simulations, s(t) is taken as the input signal and v(t) represents noise signal having zero mean and three different noise levels i.e., no noise, 30 db and 70 db. The power signal modeling problem as described in Eqs. (22)–(24) is executed with the proposed scheme and the objective function is implemented for N = 20 snap shots. The meta-heuristic algorithm, BSA together with all its six variants is performed for 100 independent runs. The results of each BSA variant against the values of fitness function are shown graphically in Fig. 2, for all three signal models given in Examples 1–3 and noise levels. It is observed from the results presented in Fig. 2 that all the variants of BSA are convergent for all noise levels, but convergence of the variant-III of BSA is slightly better than all others. Comparison of the actual signals is also made with the approximated signal, and the resultant graphs are presented in Fig. 3 for all three examples. The actual and estimation decision variables are listed in Table 3 for Example 1 in case of all three noise levels, while these results for Examples 2 and 3 are provided in Table 4 for each noise variation. The estimated signals overlap the actual signals consistently, as well as, relatively small difference between actual and estimation parameters which prove the accuracy of the scheme. However, with the rise in the noise level, there is a decrease in the accuracy level is observed for all six variants of BSA.
In order to access the minute difference, the values of absoluter error (AE), i.e., difference between actual and estimated parameter, is calculated for each case. The values of AE are plotted in Fig. 4 for Example 1 in case of all six variants of BSA, while the results for Examples 2 and 3 are shown in Fig. 5. It is seen that the range of AE values lie around 10−02 to 10−04 for BSA-I while, for BSA-II, range is around 10−05 to 10−06 and similar trend for rest of the variants is observed.
The performance indices magnitudes based on fitness e, normalized error δ, MAE, RMSE and TIC for best independent run of the scheme are listed in Table 5 for each noise variation in case of all six variants of BSA. Near-to-optimal magnitudes of all these metrics achieved for all three examples of power signal estimation problem which evidently demonstrate the accuracy of the proposed scheme. Additionally, the computational complexity measures in terms of mean execution time, iteration consumed and function counts (FC) during the whole optimization procedure are also tabulated in Table 5 for all three example for each scenario. The complexity analysis shows that BSA-III consumed more iterations and time than other variants but is comparatively accurate from rest of the methodologies.
The results of each variant of BSA against the fitness values are graphically presented in Fig. 4g–l for several independent runs, i.e., 100 trials, all three noise levels in case of Example 1, while these illustrations for Examples 2 and 3 are shown in Fig. 5g–l. All these graphs are given in sorted and zoomed plots for better assessment of the results. It is evident from the plots that all the variants of the BSA converge but accuracy degrades as noise increases.
Convergence analysis is performed to evaluate reliability of the scheme for attaining the various accuracy levels on the basis of fitness gauges, i.e., fitness ε ≤ 10−03, 10−04, 10−05 and 10−06. The results of percentage independent runs fulfilling these criterions are listed in Table 6 for each scenario of all three example of power signal estimation problem. It is seen that nearly 100% of the independent runs meet the primary level of the basic fitness measure and also even a few trials attained relatively tough criteria. The results are comparatively more accurate and convergent for BSA-IV and BSA-V for rest of the scheme.
The statistical performances in terms of MAE, RMSE and TIC metrics are also evaluated and results of these indices are shown in Figs. 6 and 7 for each scenario of Examples 1 and 2, respectively. In Fig. 6a–d, MAE magnitudes are plotted for 100 independent trials of all the variants of BSA algorithm on semi log scale. The results show that MAE are near 10−3 to 10−2, 10−4 to 10−2, 10−3 and 10−3 to 10−4 for BSA I, II, III and IV, respectively. Histogram plots are also shown in Fig. 6e–l for all six variants of BSAs. The smaller magnitudes of RMSE verify the accuracy of the designed methodology. In Fig. 6m, TIC magnitudes as stacked bar graph are shown for BSA-III and BSA-IV each noise variance-based scenario of Example 1. These results demonstrate that magnitudes of TIC lie around 10−5 to 10−2. Similarly plots for Examples 2 and 3 are given in Fig. 7a–d, e–l and m in case of MAE, RMSE and TIC values, respectively. The similar trend of results is seen as in case of Example 1.
Further evaluation about the performance of the BSA variants for periodic signals estimation is made using ANOVA test. The results are computed for all three examples and presented in Table 7 for SNR 70 dB. With the consideration of assumption of uniform variances, the null hypothesis of homogeneous variances at the significance level α = 0.05 is accepted, as the respective probability values i.e., p values, attained for absolute errors for Examples 1, 2 and 3 are 0.283, 0.811 and 0.828, respectively. The result of ANOVA established that the expected values show uniformity, and there is no strong evidence against the null hypothesis. Therefore, it is quite evident that all the means are equivalent.
5 Conclusions
Evolutionary computational paradigm through variants of BSA are exploited for effective, viable and reliable solution of parameter estimation of power signal models with various noise level-based scenarios. Comparative study of the designed algorithms for both noise less and noisy environment, i.e., no noise, SNR = 70 db and 30 db, depict the accuracy of all six variants of BSA technique. The study shows that the accuracy level decreases as noise increases for all variants of BSA; despite, all the results are quite precise. Analysis based on performance measures, i.e., normilizing error, AEs, MAD, RMSE and TIC metrics, demonstrated the efficacy of the proposed scheme. While, the complexity analysis in terms of time consumed, iterations executed and functions count show that the results of BSA-III and BSA-IV are relatively higher than the other variants of the BSA optimization technique; however, their relatively better accuracy for the rest of scheme overshadows this aspect. Power signal modeling with increase degrees of freedom slight deteriorates the performance of the proposed BSA in terms of accuracy and complexity.
One may apply the proposed methodology for solving real-world complex power and energy-related optimization problems [48,49,50,51,52]. Recently introduced meta-heuristic techniques such as firefly, particle swarm optimization and cuckoo search algorithm along with their fractional variants can be exploited to improve the accuracy and convergence in power signal estimation problems.
References
Van Cutsem T, Vournas C (2007) Voltage stability of electric power systems. Springer, Berlin
Dugan RC, McGranaghan MF, Beaty HW, Santoso S (1996) Electrical power systems quality, vol 2. Mcgraw-Hill, New York
Phan AT, Wira P, Hermann G (2018) A dedicated state space for power system modeling and frequency and unbalance estimation. Evol Syst 9(1):57–69
Acha E, Madrigal M (2001) Power systems harmonics. Wiley, New York
Xu L, Ding F (2018) Iterative parameter estimation for signal models based on measured data. Circuits Syst Signal Process 37:1–24
Xu L, Xiong W, Alsaedi A, Hayat T (2018) Hierarchical parameter estimation for the frequency response based on the dynamical window data. Int J Control Autom Syst 16(4):1756–1764
Li H, Zhou M, Wu R, Zhang Z, Zheng J (2018) Parameter estimation of air maneuvering target for multi-antenna system via reconstructing time samples and signal. Multidimens Syst Signal Process 29(2):621–641
Cao Y, Liu Z (2010) Signal frequency and parameter estimation for power systems using the hierarchical identification principle. Math Comput Model 52(5–6):854–861
Qian H, Zhao R, Chen T (2007) Interharmonics analysis based on interpolating windowed FFT algorithm. IEEE Trans Power Deliv 22(2):1064–1069
Zhang Q, Liu H, Chen H, Li Q, Zhang Z (2008) A precise and adaptive algorithm for interharmonics measurement based on iterative DFT. IEEE Trans Power Deliv 23(4):1728–1735
Zubair S, Chaudhary NI, Khan ZA, Wang W (2018) Momentum fractional LMS for power signal parameter estimation. Signal Process 142:441–449
Chaudhary NI et al (2017) A new computing approach for power signal modeling using fractional adaptive algorithms. ISA Trans 68:189–202
Chaudhary NI et al (2013) Identification of input nonlinear control autoregressive systems using fractional signal processing approach. Sci World J 2013:467276. https://doi.org/10.1155/2013/467276
Wan L, Ding F (2019) Decomposition-and gradient-based iterative identification algorithms for multivariable systems using the multi-innovation theory. Circuits Syst Signal Process 38:1–21
Huang C, Liu L, Yuen C (2018) Asymptotically optimal estimation algorithm for the sparse signal with arbitrary distributions. IEEE Trans Veh Technol 67(10):10070–10075
Xia H, Ji Y, Xu L, Hayat T (2019) Maximum likelihood-based recursive least-squares algorithm for multivariable systems with colored noises using the decomposition technique. Circuits Syst Signal Process 38:1–19
Shuai Z, Zhang J, Tang L, Teng Z, Wen H (2018) Frequency shifting and filtering algorithm for power system harmonic estimation. IEEE Trans Ind Inform 15:1554–1565
Liu S, Ding F, Xu L, Hayat T (2019) Hierarchical principle-based iterative parameter estimation algorithm for dual-frequency signals. Circuits Syst Signal Process 38:1–18
Hu B, Gharavi H (2018) A fast recursive algorithm for spectrum tracking in power grid systems. IEEE Trans Smart Grid 10:2882–2891
Hu Y, Zhou Q, Yu H, Zhou Z, Ding F (2018) Two-stage generalized projection identification algorithms for stochastic systems. Circuits Syst Signal Process 38:1–17
El Maani R, Radi B, El Hami A (2019) Multiobjective backtracking search algorithm: application to FSI. Struct Multidiscip Optim 59:1–21
Mallick S, Kar R, Mandal D, Ghoshal SP (2016) CMOS analogue amplifier circuits optimisation using hybrid backtracking search algorithm with differential evolution. J Exp Theor Artif Intell 28(4):719–749
Nazri NN, Malik NN, Idoumghar L, Latiff NM, Ali S (2018) Backtracking search optimization for collaborative beamforming in wireless sensor networks. Telkomnika 16(4):1801–1808
Askarzadeh A, dos Santos Coelho L (2014) A backtracking search algorithm combined with Burger’s chaotic map for parameter estimation of PEMFC electrochemical model. Int J Hydrog Energy 39(21):11165–11174
Yang H, Yu J, Qiu Y, Li Q, Chen W (2018) A coordinated optimization method considering time-delay effect of islanded photovoltaic microgrid based on modified backtracking search algorithm. J Renew Sustain Energy 10(2):023503
Zhou J, Zhang C, Peng T, Xu Y (2018) Parameter identification of pump turbine governing system using an improved backtracking search algorithm. Energies 11(7):1668
Yan S, Zhou J, Zheng Y, Li C (2018) An improved hybrid backtracking search algorithm based T–S fuzzy model and its implementation to hydroelectric generating units. Neurocomputing 275:2066–2079
Modiri-Delshad M, Kaboli SHA, Taslimi-Renani E, Rahim NA (2016) Backtracking search algorithm for solving economic dispatch problems with valve-point effects and multiple fuel options. Energy 116:637–649
Hannan MA, Lipu MSH, Hussain A, Saad MH, Ayob A (2018) Neural network approach for estimating state of charge of lithium-ion battery using backtracking search algorithm. IEEE Access 6:10069–10079
Khan WU et al (2018) Backtracking search integrated with sequential quadratic programming for nonlinear active noise control systems. Appl Soft Comput 73:666–683
Agarwal SK, Shah S, Kumar R (2015) Classification of mental tasks from EEG data using backtracking search optimization based neural classifier. Neurocomputing 166:397–403
bin Mohd Zain MZ, Kanesan J, Kendall G, Chuah JH (2018) Optimization of fed-batch fermentation processes using the backtracking search algorithm. Expert Syst Appl 91:286–297
Lin J (2019) Backtracking search based hyper-heuristic for the flexible job-shop scheduling problem with fuzzy processing time. Eng Appl Artif Intell 77:186–196
Bian J, Xing J, Liu J, Li Z, Li H (2016) An adaptive and computationally efficient algorithm for parameters estimation of superimposed exponential signals with observations missing randomly. Digit Signal Process 48:148–162
Li X, Ding F (2013) Signal modeling using the gradient search. Appl Math Lett 26(8):807–813
Mehmood A, Chaudhary NI, Zameer A et al (2020) Novel computing paradigms for parameter estimation in power signal models. Neural Comput Appl 32:6253–6282
Zhou L, Li X, Xu H, Zhu P (2016) Multi-innovation stochastic gradient method for harmonic modelling of power signals. IET Signal Process 10(7):737–742
Pan J, Yang X, Cai H, Mu B (2016) Image noise smoothing using a modified Kalman filter. Neurocomputing 173:1625–1629
Civicioglu P (2013) Backtracking search optimization algorithm for numerical optimization problems. Appl Math Comput 219(15):8121–8144
Chatzipavlis A, Tsekouras GE, Trygonis V, Velegrakis AF, Tsimikas J, Rigos A, Hasiotis T, Salmas C (2019) Modeling beach realignment using a neuro-fuzzy network optimized by a novel backtracking search algorithm. Neural Comput Appl 31(6):1747–1763
Wang H, Hu Z, Sun Y, Su Q, Xia X (2019) A novel modified BSA inspired by species evolution rule and simulated annealing principle for constrained engineering optimization problems. Neural Comput Appl 31(8):4157–4184
Mehmood A et al (2019) Backtracking search optimization heuristics for nonlinear Hammerstein controlled auto regressive auto regressive systems. ISA Trans 91:99–113
Bhattacharjee K (2018) Economic dispatch problems using backtracking search optimization. Int J Energy Optim Eng (IJEOE) 7(2):39–60
Zaman F et al (2019) Backtracking search optimization paradigm for pattern correction of faulty antenna array in wireless mobile communications. Wirel Commun Mob Comput 2019:9046409. https://doi.org/10.1155/2019/9046409
Raja MAZ, Akhtar R, Chaudhary NI, Khan WU, Zhiyu Z, Jamil A, Zaman F (2020) Design of backtracking search optimization paradigm for joint amplitude-angle measurement of sources lying in fraunhofer zone. Measurement 149:106977
Yu K, Liang JJ, Qu BY, Cheng Z, Wang H (2018) Multiple learning backtracking search algorithm for estimating parameters of photovoltaic models. Appl Energy 226:408–422
Mehmood A, Zameer A, Chaudhary NI, Raja MAZ (2019) Backtracking search heuristics for identification of electrical muscle stimulation models using Hammerstein structure. Appl Soft Comput 24:105705
Kayri I, Gencoglu MT (2019) Predicting power production from a photovoltaic panel through artificial neural networks using atmospheric indicators. Neural Comput Appl 31(8):3573–3586
El-Sattar SA, Kamel S, El Sehiemy RA et al (2019) Single- and multi-objective optimal power flow frameworks using Jaya optimization technique. Neural Comput Appl 31:8787–8806. https://doi.org/10.1007/s00521-019-04194-w
Mohamed MA, Diab AAZ, Rezk H et al (2019) A novel adaptive model predictive controller for load frequency control of power systems integrated with DFIG wind turbines. Neural Comput Appl. https://doi.org/10.1007/s00521-019-04205-w
Mishra SP, Dash PK (2019) Short-term prediction of wind power using a hybrid pseudo-inverse Legendre neural network and adaptive firefly algorithm. Neural Comput Appl 31(7):2243–2268
Wang T, He X, Deng T (2019) Neural networks for power management optimal strategy in hybrid microgrid. Neural Comput Appl 31(7):2635–2647
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
All the authors of the manuscript declare that there is no potential conflict of interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Mehmood, A., Shi, P., Raja, M.A.Z. et al. Design of backtracking search heuristics for parameter estimation of power signals. Neural Comput & Applic 33, 1479–1496 (2021). https://doi.org/10.1007/s00521-020-05029-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-020-05029-9