Abstract
This paper presents a new optimal second-order design of the infinite impulse response digital differentiator. This design manifests the \(L_1\)-error fitness function’s optimization using the multi-verse optimization algorithm. The optimizing variables are obtained from the direct wave-form-based transfer function. The acquired magnitude response approximates the ideal differentiator with the mean absolute magnitude error − 45.8842 dB. The designed optimal differentiator has also been compared with the existing designs to manifests its efficacy.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
Digital differentiator (DD) is used to compute the time rate of change of any real-time applied or measured input. Unlike the analog differentiators, digital differentiator implementation is composed of delays, adders, and multipliers in place of inductors, capacitors, and resistors, which provide flexibility in the configuration. The extensive applicability of the digital differentiator designs in image processing, radar signaling, and in different aspects of biomedical engineering makes it a convincing field for researchers and designers [2, 21]. Like other types of filters, digital differentiators can be designed as finite impulse response (FIR) or infinite impulse response (IIR) filters. However, both techniques have their own merits and demerits but, in applications where the linear phase is not required, IIR digital differentiators are preferred over FIR digital differentiators due to their low filter order [16].
Researchers have proposed several low-order differentiator designs based on fractional delays, numerical integration methods, and direct pole-zero optimization, which reasonably approximates the DD’s ideal magnitude response [2,3,4, 8, 9, 12, 22]. Some evolutionary and intelligent algorithms have also been developed to provide the optimum designs by direct coefficient optimization of the generalized transfer function of different orders [5, 11, 13]. These metaheuristic algorithms are applied to the fitness function based on the error difference function formulated using \(L_2\) norm. These optimizations incorporated the associated drawbacks of ripples in the pass-band and high overshoots at discontinuity points. However, recent research shows that \(L_1\) fitness function-based designs provide a flatter response in both pass- and stop-band. Furthermore, integration of different objective functions and hybrid optimization algorithms have been utilized to propose the low-order differentiator design with better approximations [1, 10, 19]. Apart from it, some new implementation techniques have also been developed to provide superior noise behavior and overflow stability which makes the designs computationally efficient [14, 17].
Generally optimizing algorithms are based on the concept of exploration and exploitation. In the first exploration phase, the algorithm performs the extensive search for the possible search space whereas in next exploitation phase, the algorithm emphasizes on local search and convergence towards promising areas obtained in the first phase. As these are two conflicting stages, the algorithm must possess the optimum balance. The algorithm multiverse optimizer (MVO) formulated by Mirjalili et al. in 2016 efficiently balances exploration and exploitation, and provides the highly competitive results during optimization. Due to local optima avoidance, MVO outperforms PSO, GA, GSA and other optimizing algorithms [15].
In this paper, the integrated and comprehensive study of MVO with \(L_1\)-norm is exercised for the design of IIR digital differentiator. First, the direct wave form (DWF)-based generalized transfer function is derived as it provides less coefficient sensitivity and low quantization noise in its implementation [18]. It is then followed by optimization of the \(L_1\)-norm error objective function by utilizing the multiverse optimizer algorithm. The proposed design has also been compared with the existing designs to show its efficacy.
The rest of this paper is prepared as follows: Sect. 2 outlines the proposed digital differentiator’s design. Section 3 manifests the short description of the multi-verse optimization algorithm used in the paper. Section 4 discusses the simulation results of the proposed design and comparison with the existing designs. Section 5 concludes the paper.
2 Problem Formulation and Design of Digital Differentiator
The ideal digital differentiator is defined by
which can be approximated using Nth-order IIR digital system. For second order, the generalized transfer function can be written as:
or
where \(\alpha _1\) = \(B_1+A_1B_0\) and \(\alpha _2\) = \(B_2+A_2B_0\). The system function H(z) has five degrees of freedom, which can be utilized to obtain any IIR-based system design. The proposed approach is first to convert Eq. (3) into its corresponding state-space representation. After that, the similarity transformation is applied to acquire the corresponding direct wave-form representation [17, 18]. Finally, their respective coefficients have been optimized.
The general state-space representation can be written as:
where \(\mathbf{s}[n]\) is the N-dimensional state vector of state variables for the input x[n] and, y[n] is the corresponding output. Hence, to represent Eq. (3) in the state-space form, it must satisfy the relation \(H(z)=\mathbf {D}+\mathbf {C}(z\mathbf {I}-\mathbf {A})^{-1}\mathbf {B}\). Therefore, the corresponding matrices can be calculated as:
To obtain the DWF, the state plane rotation is applied to Eq. (5), which establishes the relation as [7]:
where
Therefore, the obtained state-space matrices for the DWF are as follows:
where
and
Therefore, the corresponding DWF-based transfer function can be written as:
The five coefficients \(\gamma _1, \gamma _2, \eta _1, \eta _2\) and \(B_0\) of the obtained transfer function in Eq. (14) can be optimized to approximate the ideal digital differentiator. The \(L_1\)-norm fitness function provides the flat response, low overshoot, and ripples at the discontinuity points [1]. Therefore, \(L_1\)-norm-based error objective function is utilized to minimize the error between the ideal and the approximated response. It is defined as:
where \(||. ||\) provides norm of function.
3 \(L_1\)-MVO for the Design of Digital Differentiator
The multi-verse optimizer utilized for the optimization is described in this section. The \(L_1\)-norm-based error objective function given in Eq. (15) is minimized and evaluated at each iteration to get the best possible outcome.
MVO Algorithm is a nature-inspired and stochastic population-based algorithm. It is inspired by the theory of multiple parallel universes based on the three key factors: white holes, black holes, and wormholes. White holes play a part in the expansion, created during big-bang or from the universes’ collision. Black holes are the opposite of the white hole and attract everything, even the light, under strong gravitational pull. The wormholes act like time-space tunnels for traveling from one part of the universe to any other or between universes. Besides, each universe shows its inflation rate to result in the expansion. These three concepts are formulated in a mathematical model to evaluate exploration, exploitation, and local re-search. For exploring search spaces, MVO uses black and white hole concepts, and for exploiting the search spaces, it uses wormholes. Each solution and variable is interpreted as a universe and object in the search space, respectively. The inflation rate is proportional to the corresponding fitness function [15, 20].
The algorithm follows the following rules for its successful operation.
-
The higher inflation rate leads to a high probability of white holes and a low probability of having black holes.
-
The objects tend to move from a higher inflation rate to a lower inflation rate through white holes and black holes.
-
The objects may show random movement to get the possible best universe, irrespective of the inflation rate.
The optimization process begins with creating a set of universes randomly. With each iteration, objects move from a higher inflation rate to a lower inflation rate through white holes and black holes. Meanwhile, wormholes teleport objects randomly to get the best universe. The updating process relies on the following equation: [6].
Here, \(x_j\) represents the jth parameter of the best individual universe. \(lb_j\) and \(ub_j\) indicate the lower and upper bounds of jth variable. \(x_{i}^{j}\) represents the jth parameter of ith universe with \(r_2, r_3, r_4\) are random numbers ranges from 0 to 1. TDR and WEP are Traveling Distance Rate and Wormhole Existence. TDR and WEP are defined as:
where a, b, t are the minimum, maximum and current iterations. T represents the maximum number of allowed iterations.
where p indicates the exploitation accuracy [6, 15]. Table 1 enlists all the essential parametric values for the optimization process. The coefficients of lower and upper bound are restricted within the limit of − 0.5 and 1 to maintain the IIR design’s stability.
4 Simulation Analysis and Comparison With the Existing Designs
The optimized values for \(\gamma _1, \gamma _2, \eta _1, \eta _2\) and \(B_0\) are obtained as 0.88678, 0.17933, − 0.00032, − 0.31687 and − 0.67014, respectively. The corresponding transfer function of the proposed digital differentiator is obtained as:
The proposed differentiator’s magnitude response is plotted along with the ideal in Fig. 1. It approximates the ideal differentiator considerably well over the complete Nyquist interval. Figure 2 compares the absolute magnitude error of the proposed \(L_1\)-MVO-based differentiator design with the recently published designs to evaluate its efficacy.
In 2011, the third-order segment-based digital differentiator was proposed by Al-Alaoui [2]. The standard numerical integration techniques followed by the simulated annealing (SA) optimization algorithm provide an excellent approximation to the ideal differentiator. The utilization of genetic algorithm approximation has been done by Jain et al. to propose the design of digital differentiators with considerable improvement [12]. Upadhyay optimized pole-zeros locations to provide the second-order digital differentiator [22]. Furthermore, the designs provided by Aggarwal integrate the \(L_1\)-norm with different optimization techniques and approximate the ideal digital differentiator with low magnitude error [1]. Table 2 enlists the transfer functions of the existing designs of digital differentiators.
It can be seen in Fig. 2 that the proposed DD performs better than the designs mentioned above for the complete Nyquist interval. The proposed \(L_1\)-MVO-based design provides less error than the Upadhyay et al. [22] in the high-frequency range and outranges the design proposed by the Al-Alaoui, Gupta et al. Aggarwal et al. (\(L_1\)-PSO). At the same time, it remains comparable with the design offered by Aggarwal et al. (\(L_1\)-BA). Yet, for the complete Nyquist frequency range, the proposed \(L_1\)-MVO design provides considerable improvement to all the designs taken for comparison. Table 3 gives the statistical comparison, which further confirms that the sum of absolute magnitude error (SAME) and mean absolute magnitude error (MAME) attain by the proposed designs are the least compared to others.
5 Conclusion
This paper has presented the optimum design of the second-order IIR digital differentiator. The design involves optimizing direct wave-form-based coefficients with \(L_1\)-norm-based error objective function after utilizing the multiverse optimizing algorithm. The proposed design gives SAME and MAME as 1.5998 and − 45.8842 dB, respectively, which performs better than the existing IIR differentiator designs. Therefore, the proposed DD design can be used as the alternative to the existing ones.
Data Availability
The data that support the findings of this study are available from the corresponding author on request.
References
A. Aggarwal, T.K. Rawat, D.K. Upadhyay, Optimal design of \(L_1\)-norm based IIR digital differentiators and integrators using the bat algorithm. IET Signal Process. 11(1), 26–35 (2017). https://doi.org/10.1049/iet-spr.2016.0010
M.A. Al-Alaoui, Novel FIR approximations of IIR differentiators with applications to image edge detection, in 18th IEEE International Conference on Electronics, Circuits, and Systems, Beirut (2011), pp. 554–558. https://doi.org/10.1109/ICECS.2011.6122335
M.A. Al-Alaoui, Using fractional delay to control the magnitudes and phases of integrators and differentiators. IET Signal Process. 1(2), 107–119 (2007). https://doi.org/10.1049/iet-spr:20060246
M.A. Al-Alaoui, Class of digital integrators and differentiators. IET Signal Process. 5(2), 251–260 (2011). https://doi.org/10.1049/iet-spr.2010.0107
M.A. Al-Alaoui, M. Baydoun, Novel wide band digital differentiators and integrators using different optimization techniques, in International Symposium on Signals, Circuits and Systems (ISSCS2013) (2013). pp. 1–4. https://doi.org/10.1109/ISSCS.2013.6651225
H. Faris, M.A. Hassonah, A.M. Al-Zoubi, S.M. Mirjalili, I. Aljarah, A multi-verse optimizer approach for feature selection and optimizing SVM parameters based on a robust system architecture. Neural Comput. Appl. 30, 2355–2369 (2018). https://doi.org/10.1007/s00521-016-2818-2
A. Fettweis, Wave digital filters: theory and practice. Proc. IEEE 74, 270–327 (1986). https://doi.org/10.1109/PROC.1986.13458
O.P. Goswami, T.K. Rawat, D.K. Upadhyay, A novel approach for the design of optimum IIR differentiators using fractional interpolation. Circuits Syst. Signal Process. 39, 1688–1698 (2020). https://doi.org/10.1007/s00034-019-01211-0
O.P. Goswami, T.K. Rawat, D.K. Upadhyay, Fractional interpolation and multirate technique based design of optimum IIR integrators and differentiators. Int. J. Electron. 66, 1–15 (2021). https://doi.org/10.1080/00207217.2020.1870730
L.D. Grossmann, Y.C. Eldar, An \(L_1\)-method for the design of linear-phase FIR digital filters. IEEE Trans. Signal Process. 55(11), 5253–5266 (2007). https://doi.org/10.1109/TSP.2007.896088
M. Gupta, B. Relan, R. Yadav, V. Aggarwal, Wideband digital integrators and differentiators designed using particle swarm optimisation. IET Signal Process. 8(6), 668–679 (2014). https://doi.org/10.1049/iet-spr.2013.0011
M. Jain, M. Gupta, N. Jain, Linear phase second order recursive digital integrators and differentiators. Radio Eng. J. 21(2), 712–717 (2012)
M. Kumar, T.K. Rawat, Optimal design of FIR fractional order differentiator using cuckoo search algorithm. Expert Syst. Appl. 42(7), 3433–3449 (2015). https://doi.org/10.1016/j.eswa.2014.12.020
V. Lesnikov, T. Naumovich, A. Chastikov, Number theoretical analysis of the structures of classical IIR digital filters, in 7th Mediterranean Conference on Embedded Computing (MECO), Budva, Montenegro (2018). https://doi.org/10.1109/MECO.2018.8406099
S. Mirjalili, S.M. Mirjalili, A. Hatamlou, Multi-verse optimizer: a nature-inspired algorithm for global optimization. Neural Comput. Appl. 27, 495–513 (2016)
T.K. Rawat, Digital Signal Processing (Oxford University Press, Oxford, 2014)
J.H.F. Ritzerfeld, Noise gain expressions for low noise second-order digital filter structures. IEEE Trans. Circuits Syst. II Express Briefs 52(4), 223–227 (2005). https://doi.org/10.1109/TCSII.2004.842415
J.H.F. Ritzerfeld, The direct wave form digital filter structure: an easy alternative for the direct form, in Proceedings of the 15th ProRISC, Annual Workshop on Circuits, Systems and Signal Processing (ProRISC 2004), Netherlands (2004). pp. 133–137
S.K. Saha, S.P. Ghosal, R. Kar, D. Mandal, Cat swarm optimization algorithm for optimal linear phase FIR filter design. ISA Trans. 56(6), 781–794 (2013)
G.I. Sayed, A. Darwish, A.E. Hassanien, Quantum multiverse optimization algorithm for optimization problems. Neural Comput. Appl. 31, 2763–2780 (2019). https://doi.org/10.1007/s00521-017-3228-9
M.I. Skolnik, Introduction to Radar Systems, 2nd edn. (McGraw & Hill, New York, 1980)
D.K. Upadhyay, Class of recursive wideband digital differentiators and integrators. Radioengineering 21(3), 904–910 (2012)
Author information
Authors and Affiliations
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Goswami, O.P., Rawat, T.K. & Upadhyay, D.K. \(L_1\)-Norm-Based Optimal Design of Digital Differentiator Using Multiverse Optimization. Circuits Syst Signal Process 41, 4707–4715 (2022). https://doi.org/10.1007/s00034-022-02003-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00034-022-02003-9