Abstract
This entry discusses the history and describes the multitude of methods and applications of this important branch of stochastic process theory.
Access provided by Autonomous University of Puebla. Download reference work entry PDF
Similar content being viewed by others
Keywords
- Linear stochastic filtering
- Markov step processes
- Maximum likelihood estimation
- Riccati equation
- Stratonovich-Kushner equation
Estimation is the process of inferring the value of an unknown given quantity of interest from noisy, direct or indirect, observations of such a quantity. Due to its great practical relevance, estimation has a long history and an enormous variety of applications in all fields of engineering and science. A certainly incomplete list of possible application domains of estimation includes the following: statistics (Bard 1974; Ghosh et al. 1997; Koch 1999; Lehmann and Casella 1998; Tsybakov 2009; Wertz 1978), telecommunication systems (Sage and Melsa 1971; Schonhoff and Giordano 2006; Snyder 1968; Van Trees 1971), signal and image processing (Barkat 2005; Biemond et al. 1983; Elliott et al. 2008; Itakura 1971; Kay 1993; Kim and Woods 1998; Levy 2008; Najim 2008; Poor 1994; Tuncer and Friedlander 2009; Wakita 1973; Woods and Radewan 1977), aerospace engineering (McGee and Schmidt 1985), tracking (Bar-Shalom and Fortmann 1988; Bar-Shalom et al. 2001, 2013; Blackman and Popoli 1999; Farina and Studer 1985, 1986), navigation (Dissanayake et al. 2001; Durrant-Whyte and Bailey 2006a,b; Farrell and Barth 1999; Grewal et al. 2001; Mullane et al. 2011; Schmidt 1966; Smith et al. 1986; Thrun et al. 2006), control systems (Anderson and Moore 1979; Athans 1971; Goodwin et al. 2005; Joseph and Tou 1961; Kalman 1960a; Maybeck 1979, 1982; Söderström 1994; Stengel 1994), econometrics (Aoki 1987; Pindyck and Roberts 1974; Zellner 1971), geophysics (e.g., seismic deconvolution) (Bayless and Brigham 1970; Flinn et al. 1967; Mendel 1977, 1983, 1990), oceanography (Evensen 1994a; Ghil and Malanotte-Rizzoli 1991), weather forecasting (Evensen 1994b, 2007; McGarty 1971), environmental engineering (Dochain and Vanrolleghem 2001; Heemink and Segers 2002; Nachazel 1993), demographic systems (Leibungudt et al. 1983), automotive systems (Barbarisi et al. 2006; Stephant et al. 2004), failure detection (Chen and Patton 1999; Mangoubi 1998; Willsky 1976), power systems (Abur and Gómez Espósito 2004; Debs and Larson 1970; Miller and Lewis 1971; Monticelli 1999; Toyoda et al. 1970), nuclear engineering (Robinson 1963; Roman et al. 1971; Sage and Masters 1967; Venerus and Bullock 1970), biomedical engineering (Bekey 1973; Snyder 1970; Stark 1968), pattern recognition (Andrews 1972; Ho and Agrawala 1968; Lainiotis 1972), social networks (Snijders et al. 2012), etc.
Chapter Organization
The rest of the chapter is organized as follows. Section “Historical Overview on Estimation” will provide a historical overview on estimation. The next section will discuss applications of estimation. Connections between estimation and information theories will be explored in the subsequent section. Finally, the section “Conclusions and Future Trends” will conclude the chapter by discussing future trends in estimation. An extensive list of references is also provided.
Historical Overview on Estimation
A possibly incomplete, list of the major achievements on estimation theory and applications is reported in Table 1. The entries of the table, sorted in chronological order, provide for each contribution the name of the inventor (or inventors), the date, and a short description with main bibliographical references.
Probably the first important application of estimation dates back to the beginning of the nineteenth century whenever least-squares estimation (LSE), invented by Gauss in 1795 (Gauss 1995; Legendre 1810), was successfully exploited in astronomy for predicting planet orbits (Gauss 1806). Least-squares estimation follows a deterministic approach by minimizing the sum of squares of residuals defined as differences between observed data and model-predicted estimates. A subsequently introduced statistical approach is maximum likelihood estimation (MLE), popularized by R. A. Fisher between 1912 and 1922 (Fisher 1912, 1922, 1925). MLE consists of finding the estimate of the unknown quantity of interest as the value that maximizes the so-called likelihood function, defined as the conditional probability density function of the observed data given the quantity to be estimated. In intuitive terms, MLE maximizes the agreement of the estimate with the observed data. Whenever the observation noise is assumed Gaussian (Kim and Shevlyakov 2008; Park et al. 2013), MLE coincides with LSE.
While estimation problems had been addressed for several centuries, it was not until the 1940s that a systematic theory of estimation started to be established, mainly relying on the foundations of the modern theory of probability (Kolmogorov 1933). Actually, the roots of probability theory can be traced back to the calculus of combinatorics (the Stomachion puzzle invented by Archimedes (Netz and Noel 2011)) in the third century B.C. and to the gambling theory (work of Cardano, Pascal, de Fermat, Huygens) in the sixteenth–seventeenth centuries.
Differently from the previous work devoted to the estimation of constant parameters, in the period 1940–1960 the attention was mainly shifted toward the estimation of signals. In particular, Wiener in 1940 (Wiener 1949) and Kolmogorov in 1941 (Kolmogorov 1941) formulated and solved the problem of linear minimum mean-square error (MMSE) estimation of continuous-time and, respectively, discrete-time stationary random signals. In the late 1940s and in the 1950s, Wiener-Kolmogorov’s theory was extended and generalized in many directions exploiting both time-domain and frequency-domain approaches. At the beginning of the 1960s Rudolf E. Kálmán made pioneering contributions to estimation by providing the mathematical foundations of the modern theory based on state-variable representations. In particular, Kálmán solved the linear MMSE filtering and prediction problems both in discrete-time (Kalman 1960b) and in continuous-time (Kalman and Bucy 1961); the resulting optimal estimator was named after him, Kalman filter (KF). As a further contribution, Kalman also singled out the key technical conditions, i.e., observability and controllability, for which the resulting optimal estimator turns out to be stable. Kalman’s work went well beyond earlier contributions of A. Kolmogorov, N. Wiener, and their followers (“frequency-domain” approach) by means of a general state-space approach. From the theoretical viewpoint, the KF is an optimal estimator, in a wide sense, of the state of a linear dynamical system from noisy measurements; specifically it is the optimal MMSE estimator in the Gaussian case (e.g., for normally distributed noises and initial state) and the best linear unbiased estimator irrespective of the noise and initial state distributions. From the practical viewpoint, the KF enjoys the desirable properties of being linear and acting recursively, step-by-step, on a noise-contaminated data stream. This allows for cheap real-time implementation on digital computers. Further, the universality of “state-variable representations” allows almost any estimation problem to be included in the KF framework. For these reasons, the KF is, and continues to be, an extremely effective and easy-to-implement tool for a great variety of practical tasks, e.g., to detect signals in noise or to estimate unmeasurable quantities from accessible observables. Due to the generality of the state estimation problem, which actually encompasses parameter and signal estimation as special cases, the literature on estimation since 1960 till today has been mostly concentrated on extensions and generalizations of Kalman’s work in several directions. Considerable efforts, motivated by the ubiquitous presence of nonlinearities in practical estimation problems, have been devoted to nonlinear and/or non-Gaussian filtering, starting from the seminal papers of Stratonovich (1959, 1960) and Kushner (1962, 1967) for continuous-time systems, Ho and Lee (1964) for discrete-time systems, and Jazwinski (1966) for continuous-time systems with discrete-time observations. In these papers, state estimation is cast in a probabilistic (Bayesian) framework as the problem of evolving in time the state conditional probability density given observations (Jazwinski 1970). Work on nonlinear filtering has produced over the years several nonlinear state estimation algorithms, e.g., the extended Kalman filter (EKF) (Schmidt 1966), the unscented Kalman filter (UKF) (Julier and Uhlmann 2004; Julier et al. 1995), the Gaussian-sum filter (Alspach and Sorenson 1972; Sorenson and Alspach 1970, 1971), the sequential Monte Carlo (also called particle) filter (SMCF) (Doucet et al. 2001; Gordon et al. 1993; Ristic et al. 2004), and the ensemble Kalman filter (EnKF) (Evensen 1994a,b, 2007) which have been, and are still now, successfully employed in various application domains. In particular, the SMCF and EnKF are stochastic simulation algorithms taking inspiration from the work in the 1940s on the Monte Carlo method (Metropolis and Ulam 1949) which has recently got renewed interest thanks to the tremendous advances in computing technology. A thorough review on nonlinear filtering can be found, e.g., in Daum (2005) and Crisan and Rozovskii (2011).
Other interesting areas of investigation have concerned smoothing (Bryson and Frazier 1963), robust filtering for systems subject to modeling uncertainties (Poor and Looze 1981), and state estimation for infinite-dimensional (i.e., distributed parameter and/or delay) systems (Balakrishnan and Lions 1967). Further, a lot of attention has been devoted to the implementation of the KF, specifically square-root filtering (Potter and Stern 1963) for improved numerical robustness and fast KF algorithms (Kailath 1973; Morf et al. 1974) for enhancing computational efficiency. Worth of mention is the work over the years on theoretical bounds on the estimation performance originated from the seminal papers of Rao (1945) and Cramér (1946) on the lower bound of the MSE for parameter estimation and subsequently extended in Tichavsky et al. (1998) to nonlinear filtering and in Hernandez et al. (2006) to more realistic estimation problems with possible missed and/or false measurements. An extensive review of this work on Bayesian bounds for estimation, nonlinear filtering, and tracking can be found in van Trees and Bell (2007). A brief review of the earlier (until 1974) state of art in estimation can be found in Lainiotis (1974).
Applications
Astronomy
The problem of making estimates and predictions on the basis of noisy observations originally attracted the attention many centuries ago in the field of astronomy. In particular, the first attempt to provide an optimal estimate, i.e., such that a certain measure of the estimation error be minimized, was due to Galileo Galilei that, in his Dialogue on the Two World Chief Systems (1632) (Galilei 1632), suggested, as a possible criterion for estimating the position of Tycho Brahe’s supernova, the estimate that required the “minimum amendments and smallest corrections” to the data. Later, C. F. Gauss mathematically specified this criterion by introducing in 1795 the least-squares method (Gauss 1806, 1995; Legendre 1810) which was successfully applied in 1801 to predict the location of the asteroid Ceres. This asteroid, originally discovered by the Italian astronomer Giuseppe Piazzi on January 1, 1801, and then lost in the glare of the sun, was in fact recovered 1 year later by the Hungarian astronomer F. X. von Zach exploiting the least-squares predictions of Ceres’ position provided by Gauss.
Statistics
Starting from the work of Fisher in the 1920s (Fisher 1912, 1922, 1925), maximum likelihood estimation has been extensively employed in statistics for estimating the parameters of statistical models (Bard 1974; Ghosh et al. 1997; Koch 1999; Lehmann and Casella 1998; Tsybakov 2009; Wertz 1978).
Telecommunications and Signal/Image Processing
Wiener-Kolmogorov’s theory on signal estimation, developed in the period 1940–1960 and originally conceived by Wiener during the Second World War for predicting aircraft trajectories in order to direct the antiaircraft fire, subsequently originated many applications in telecommunications and signal/image processing (Barkat 2005; Biemond et al. 1983; Elliott et al. 2008; Itakura 1971; Kay 1993; Kim and Woods 1998; Levy 2008; Najim 2008; Poor 1994; Tuncer and Friedlander 2009; Van Trees 1971; Wakita 1973; Woods and Radewan 1977). For instance, Wiener filters have been successfully applied to linear prediction, acoustic echo cancellation, signal restoration, and image/video de-noising. But it was the discovery of the Kalman filter in 1960 that revolutionized estimation by providing an effective and powerful tool for the solution of any, static or dynamic, stationary or adaptive, linear estimation problem. A recently conducted, and probably non-exhaustive, search has detected the presence of over 16,000 patents related to the “Kalman filter,” spreading over all areas of engineering and over a period of more than 50 years. What is astonishing is that even nowadays, more than 50 years after its discovery, one can see the continuous appearance of lots of new patents and scientific papers presenting novel applications and/or novel extensions in many directions (e.g., to nonlinear filtering) of the KF. Since 1992 the number of patents registered every year and related to the KF follows an exponential law.
Space Navigation and Aerospace Applications
The first important application of the Kalman filter was in the NASA (National Aeronautic and Space Administration) space program. As reported in a NASA technical report (McGee and Schmidt 1985), Kalman presented his new ideas while visiting Stanley F. Schmidt at the NASA Ames Research Center in 1960, and this meeting stimulated the use of the KF during the Apollo program (in particular, in the guidance system of Saturn V during Apollo 11 flight to the Moon), and, furthermore, in the NASA Space Shuttle and in Navy submarines and unmanned aerospace vehicles and weapons, such as cruise missiles. Further, to cope with the nonlinearity of the space navigation problem and the small word length of the onboard computer, the extended Kalman filter for nonlinear systems and square-root filter implementations for enhanced numerical robustness have been developed as part of the NASA’s Apollo program. The aerospace field was only the first of a long and continuously expanding list of application domains where the Kalman filter and its nonlinear generalizations have found widespread and beneficial use.
Control Systems and System Identification
The work on Kalman filtering (Kalman 1960b; Kalman and Bucy 1961) had also a significant impact on control system design and implementation. In Kalman (1960a) duality between estimation and control was pointed out, in that for a certain class of control and estimation problems one can solve the control (estimation) problem for a given dynamical system by resorting to a corresponding estimation (control) problem for a suitably defined dual system. In particular, the Kalman filter has been shown to be dual of the linear-quadratic (LQ) regulator, and the two dual techniques constitute the linear-quadratic-Gaussian (LQG) (Joseph and Tou 1961) regulator. The latter consists of an LQ regulator feeding back in a linear way the state estimate provided by a Kalman filter, which can be independently designed in view of the separation principle. The KF as well as LSE and MLE techniques are also widely used in system identification (Ljung 1999; Söderström and Stoica 1989) for both parameter estimation and output prediction purposes.
Tracking
One of the major application areas for estimation is tracking (Bar-Shalom and Fortmann 1988; Bar-Shalom et al. 2001, 2013; Blackman and Popoli 1999; Farina and Studer 1985, 1986), i.e., the task of following the motion of moving objects (e.g., aircrafts, ships, ground vehicles, persons, animals) given noisy measurements of kinematic variables from remote sensors (e.g., radar, sonar, video cameras, wireless sensors, etc.). The development of the Wiener filter in the 1940s was actually motivated by radar tracking of aircraft for automatic control of antiaircraft guns. Such filters began to be used in the 1950s whenever computers were integrated with radar systems, and then in the 1960s more advanced and better performing Kalman filters came into use. Still today it can be said that the Kalman filter and its nonlinear generalizations (e.g., EKF (Schmidt 1966), UKF (Julier and Uhlmann 2004), and particle filter (Gordon et al. 1993)) represent the workhorses of tracking and sensor fusion. Tracking, however, is usually much more complicated than a simple state estimation problem due to the presence of false measurements (clutter) and multiple objects in the surveillance region of interest, as well as for the uncertainty about the origin of measurements. This requires to use, besides filtering algorithms, smart techniques for object detection as well as for association between detected objects and measurements. The problem of joint target tracking and classification has also been formulated as a hybrid state estimation problem and addressed in a number of papers (see, e.g., Smeth and Ristic (2004) and the references therein).
Econometrics
State and parameter estimation have been widely used in econometrics (Aoki 1987) for analyzing and/or predicting financial time series (e.g., stock prices, interest rates, unemployment rates, volatility etc.).
Geophysics
Wiener and Kalman filtering techniques are employed in reflection seismology for estimating the unknown earth reflectivity function given noisy measurements of the seismic wavelet’s echoes recorded by a geophone. This estimation problem, known as seismic deconvolution (Mendel 1977, 1983, 1990), has been successfully exploited, e.g., for oil exploration.
Data Assimilation for Weather Forecasting and Oceanography
Another interesting application of estimation theory is data assimilation (Ghil and Malanotte-Rizzoli 1991) which consists of incorporating noisy observations into a computer simulation model of a real system. Data assimilation has widespread use especially in weather forecasting and oceanography. A large-scale state-space model is typically obtained from the physical system model, expressed in terms of partial differential equations (PDEs), by means of a suitable spatial discretization technique so that data assimilation is cast into a state estimation problem. To deal with the huge dimensionality of the resulting state vector, appropriate filtering techniques with reduced computational load have been suitably developed (Evensen 2007).
Global Navigation Satellite Systems
Global Navigation Satellite Systems (GNSSs), such as GPS put into service in 1993 by the US Department of Defense, provide nowadays a commercially diffused technology exploited by millions of users all over the world for navigation purposes, wherein the Kalman filter plays a key role (Bar-Shalom et al. 2001). In fact, the Kalman filter not only is employed in the core of the GNSS to estimate the trajectories of all the satellites, the drifts and rates of all system clocks, and hundreds of parameters related to atmospheric propagation delay, but also any GNSS receiver uses a nonlinear Kalman filter, e.g., EKF, in order to estimate its own position and velocity along with the bias and drift of its own clock with respect to the GNSS time.
Robotic Navigation (SLAM)
Recursive state estimation is commonly employed in mobile robotics (Thrun et al. 2006) in order to on-line estimate the robot pose, location and velocity, and, sometimes, also the location and features of the surrounding objects in the environment exploiting measurements provided by onboard sensors; the overall joint estimation problem is referred to as SLAM (simultaneous localization and mapping) (Dissanayake et al. 2001; Durrant-Whyte and Bailey 2006a,b; Mullane et al. 2011; Smith et al. 1986; Thrun et al. 2006).
Automotive Systems
Several automotive applications of the Kalman filter, or of its nonlinear variants, are reported in the literature for the estimation of various quantities of interest that cannot be directly measured, e.g., roll angle, sideslip angle, road-tire forces, heading direction, vehicle mass, state of charge of the battery (Barbarisi et al. 2006), etc. In general, one of the major applications of state estimation is the development of virtual sensors, i.e., estimation algorithms for physical variables of interest, that cannot be directly measured for technical and/or economic reasons (Stephant et al. 2004).
Miscellaneous Applications
Other areas where estimation has found numerous applications include electric power systems (Abur and Gómez Espósito 2004; Debs and Larson 1970; Miller and Lewis 1971; Monticelli 1999; Toyoda et al. 1970), nuclear reactors (Robinson 1963; Roman et al. 1971; Sage and Masters 1967; Venerus and Bullock 1970), biomedical engineering (Bekey 1973; Snyder 1970; Stark 1968), pattern recognition (Andrews 1972; Ho and Agrawala 1968; Lainiotis 1972), and many others.
Connection Between Information and Estimation Theories
In this section, the link between two fundamental quantities in information theory and estimation theory, i.e., the mutual information (MI) and respectively the minimum mean-square error (MMSE), is investigated. In particular, a strikingly simple but very general relationship can be established between the MI of the input and the output of an additive Gaussian channel and the MMSE in estimating the input given the output, regardless of the input distribution (Guo et al. 2005). Although this functional relation holds for general settings of the Gaussian channel (e.g., both discrete-time and continuous-time, possibly vector, channels), in order to avoid the heavy mathematical preliminaries needed to treat rigorously the general problem, two simple scalar cases, a static and a (continuous-time) dynamic one, will be discussed just to highlight the main concept.
Static Scalar Case
Consider two scalar real-valued random variables, x and y, related by
where v, the measurement noise, is a standard Gaussian random variable independent of x and σ can be regarded as the gain in the output signal-to-noise ratio (SNR) due to the channel. By considering the MI between x and y as a function of σ, i.e., \(I(\sigma ) = I\left (x,\sqrt{\sigma }x + v\right )\), it can be shown that the following relation holds (Guo et al. 2005):
where \(\hat{x}(\sigma ) = E\left [x\vert \sqrt{\sigma }x + v\right ]\) is the minimum mean-square error estimate of x given y. Figure 1 displays the behavior of both MI, in natural logarithmic units of information (nats), and MMSE versus SNR.
As mentioned in Guo et al. (2005), the above information-estimation relationship (2) has found a number of applications, e.g., in nonlinear filtering, in multiuser detection, in power allocation over parallel Gaussian channels, in the proof of Shannon’s entropy power inequality and its generalizations, as well as in the treatment of the capacity region of several multiuser channels.
Linear Dynamic Continuous-Time Case
While in the static case the MI is assumed to be a function of the SNR, in the dynamic case it is of great interest to investigate the relationship between the MI and the MMSE as a function of time.
Consider the following first-order (scalar) linear Gaussian continuous-time stochastic dynamical system:
where a is a real-valued constant while w t and v t are independent standard Brownian motion processes that represent the process and, respectively, measurement noises. Defining by \(x_{0}^{t}\stackrel{\bigtriangleup }{=}\{x_{s},0 \leq s \leq t\}\) the collection of all states up to time t and analogously \(y_{0}^{t}\stackrel{\bigtriangleup }{=}\left \{y_{s},0 \leq s \leq t\right \}\) for the channel outputs (i.e., measurements) and considering the MI between x0t and y0t as a function of time t, i.e., \(I(t) = I\left (x_{0}^{t},y_{0}^{t}\right )\), it can be shown that (Duncan 1970; Mayer-Wolf and Zakai 1983)
where \(\hat{x}_{t} = E\left [x_{t}\vert y_{0}^{t}\right ]\) is the minimum mean-square error estimate of the state x t given all the channel outputs up to time t, i.e., y0t. Figure 2 depicts the time behavior of both MI and MMSE for several values of σ and a = 1.
Conclusions and Future Trends
Despite the long history of estimation and the huge amount of work on several theoretical and practical aspects of estimation, there is still a lot of research investigation to be done in several directions. Among the many new future trends, networked estimation and quantum estimation (briefly overviewed in the subsequent parts of this section) certainly deserve special attention due to the growing interest on wireless sensor networks and, respectively, quantum computing.
Networked Information Fusion and Estimation
Information or data fusion is about combining, or fusing, information or data from multiple sources to provide knowledge that is not evident from a single source (Bar-Shalom et al. 2013; Farina and Studer 1986). In 1986, an effort to standardize the terminology related to data fusion began and the JDL (Joint Directors of Laboratories) data fusion working group was established. The result of that effort was the conception of a process model for data fusion and a data fusion lexicon (Blasch et al. 2012; Hall and Llinas 1997). Information and data fusion are mainly supported by sensor networks which present the following advantages over a single sensor:
-
Can be deployed over wide regions
-
Provide diverse characteristics/viewing angles of the observed phenomenon
-
Are more robust to failures
-
Gather more data that, once fused, provide a more complete picture of the observed phenomenon
-
Allow better geographical coverage, i.e., wider area and less terrain obstructions.
Sensor network architectures can be centralized, hierarchical (with or without feedback), and distributed (peer-to-peer). Today’s trend for many monitoring and decision-making tasks is to exploit large-scale networks of low-cost and low-energy consumption devices with sensing, communication, and processing capabilities. For scalability issues, such networks should operate in a fully distributed (peer-to-peer) fashion, i.e., with no centralized coordination, so as to achieve in each node a global estimation/decision objective through localized processing only.
The attainment of this goal actually requires several issues to be addressed like:
-
Spatial and temporal sensor alignment
-
Scalable fusion
-
Robustness with respect to data incest (or double counting), i.e., repeated use of the same information
-
Handling data latency (e.g., out-of-sequence measurements/estimates)
-
Communication bandwidth limitations
In particular, to counteract data incest the so-called covariance intersection (Julier and Uhlmann 1997) robust fusion approach has been proposed to guarantee, at the price of some conservatism, consistency of the fused estimate when combining estimates from different nodes with unknown correlations. For scalable fusion, a consensus approach (Olfati-Saber et al. 2007) can be undertaken. This allows to carry out a global (i.e., over the whole network) processing task by iterating local processing steps among neighboring nodes.
Several consensus algorithms have been proposed for distributed parameter (Calafiore and Abrate 2009) or state (Alriksson and Rantzer 2006; Kamgarpour and Tomlin 2007; Olfati-Saber 2007; Stankovic et al. 2009; Xiao et al. 2005) estimation. Recently, Battistelli and Chisci (2014) introduced a generalized consensus on probability densities which opens up the possibility to perform in a fully distributed and scalable way any Bayesian estimation task over a sensor network. As by-products, this approach allowed to derive consensus Kalman filters with guaranteed stability under minimal requirements of system observability and network connectivity (Battistelli et al. 2011, 2012; Battistelli and Chisci 2014), consensus nonlinear filters (Battistelli et al. 2012), and a consensus CPHD filter for distributed multitarget tracking (Battistelli et al. 2013). Despite these interesting preliminary results, networked estimation is still a very active research area with many open problems related to energy efficiency, estimation performance optimality, robustness with respect to delays and/or data losses, etc.
Quantum Estimation
Quantum estimation theory consists of a generalization of the classical estimation theory in terms of quantum mechanics. As a matter of fact, the statistical theory can be seen as a particular case of the more general quantum theory (Helstrom 1969, 1976). Quantum mechanics presents practical applications in several fields of technology (Personick 1971) such as, the use of quantum number generators in place of the classical random number generators. Moreover, manipulating the energy states of the cesium atoms, it is possible to suppress the quantum noise levels and consequently improve the accuracy of atomic clocks. Quantum mechanics can also be exploited to solve optimization problems, giving sometimes optimization algorithms that are faster than conventional ones. For instance, McGeoch and Wang (2013) provided an experimental study of algorithms based on quantum annealing. Interestingly, the results of McGeoch and Wang (2013) have shown that this approach allows to obtain better solutions with respect to those found with conventional software solvers. In quantum mechanics, also the Kalman filter has found its proper form, as the quantum Kalman filter. In Iida et al. (2010) the quantum Kalman filter is applied to an optical cavity composed of mirrors and crystals inside, which interacts with a probe laser. In particular, a form of a quantum stochastic differential equation can be written for such a system so as to design the algorithm that updates the estimates of the system variables on the basis of the measurement outcome of the system.
Bibliography
Abur A, Gómez Espósito A (2004) Power system state estimation – theory and implementation. Marcel Dekker, New York
Aidala VJ, Hammel SE (1983) Utilization of modified polar coordinates for bearings-only tracking. IEEE Trans Autom Control 28(3):283–294
Alamo T, Bravo JM, Camacho EF (2005) Guaranteed state estimation by zonotopes. Automatica 41(6):1035–1043
Alessandri A, Baglietto M, Battistelli G (2005) Receding-horizon estimation for switching discrete-time linear systems. IEEE Trans Autom Control 50(11):1736–1748
Alessandri A, Baglietto M, Battistelli G (2008) Moving-horizon state estimation for nonlinear discrete-time systems: new stability results and approximation schemes. Automatica 44(7):1753–1765
Alriksson P, Rantzer A (2006) Distributed Kalman filtering using weighted averaging. In: Proceedings of the 17th International Symposium on Mathematical Theory of Networks and Systems, Kyoto
Alspach DL, Sorenson HW (1972) Nonlinear Bayesian estimation using Gaussian sum approximations. IEEE Trans Autom Control 17(4):439–448
Anderson BDO, Chirarattananon S (1972) New linear smoothing formulas. IEEE Trans Autom Control 17(1):160–161
Anderson BDO, Moore JB (1979) Optimal filtering. Prentice Hall, Englewood Cliffs
Andrews A (1968) A square root formulation of the Kalman covariance equations. AIAA J 6(6):1165–1166
Andrews HC (1972) Introduction to mathematical techniques in pattern recognition. Wiley, New York
Aoki M (1987) State space modeling of time-series. Springer, Berlin
Athans M (1971) An optimal allocation and guidance laws for linear interception and rendezvous problems. IEEE Trans Aerosp Electron Syst 7(5):843–853
Balakrishnan AV, Lions JL (1967) State estimation for infinite-dimensional systems. J Comput Syst Sci 1(4):391–403
Barbarisi O, Vasca F, Glielmo L (2006) State of charge Kalman filter estimator for automotive batteries. Control Eng Pract 14(3):267–275
Bard Y (1974) Nonlinear parameter estimation. Academic, New York
Barkat M (2005) Signal detection and estimation. Artech House, Boston
Bar-Shalom Y, Fortmann TE (1988) Tracking and data association. Academic, Boston
Bar-Shalom Y, Li X, Kirubarajan T (2001) Estimation with applications to tracking and navigation. Wiley, New York
Bar-Shalom Y, Willett P, Tian X (2013) Tracking and data fusion: a handbook of algorithms. YBS Publishing Storrs, CT
Battistelli G, Chisci L, Morrocchi S, Papi F (2011) An information-theoretic approach to distributed state estimation. In: Proceedings of the 18th IFAC World Congress, Milan, pp 12477–12482
Battistelli G, Chisci L, Mugnai G, Farina A, Graziano A (2012) Consensus-based algorithms for distributed filtering. In: Proceedings of the 51st IEEE Control and Decision Conference, Maui, pp 794–799
Battistelli G, Chisci L (2014) Kullback-Leibler average, consensus on probability densities, and distributed state estimation with guaranteed stability. Automatica 50:707–718
Battistelli G, Chisci L, Fantacci C, Farina A, Graziano A (2013) Consensus CPHD filter for distributed multitarget tracking. IEEE J Sel Topics Signal Process 7(3):508–520
Bayes T (1763) Essay towards solving a problem in the doctrine of chances. Philos Trans R Soc Lond 53:370–418. doi:10.1098/rstl.1763.0053
Bayless JW, Brigham EO (1970) Application of the Kalman filter. Geophysics 35(1):2–23
Bekey GA (1973) Parameter estimation in biological systems: a survey. In: Proceedings of the 3rd IFAC Symposium Identification and System Parameter Estimation, Delft, pp 1123–1130
Benedict TR, Bordner GW (1962) Synthesis of an optimal set of radar track-while-scan smoothing equations. IRE Trans Autom Control 7(4):27–32
Benes VE (1981) Exact finite-dimensional filters for certain diffusions with non linear drift. Stochastics 5(1):65–92
Bertsekas DP, Rhodes IB (1971) Recursive state estimation for a set-membership description of uncertainty. IEEE Trans Autom Control 16(2):117–128
Biemond J, Rieske J, Gerbrands JJ (1983) A fast Kalman filter for images degraded by both blur and noise. IEEE Trans Acoust Speech Signal Process 31(5):1248–1256
Bierman GJ (1974) Sequential square root filtering and smoothing of discrete linear systems. Automatica 10(2):147–158
Bierman GJ (1977) Factorization methods for discrete sequential estimation. Academic, New York
Blackman S, Popoli R (1999) Design and analysis of modern tracking systems. Artech House, Norwood
Blasch EP, Lambert DA, Valin P, Kokar MM, Llinas J, Das S, Chong C, Shahbazian E (2012) High level information fusion (HLIF): survey of models, issues, and grand challenges. IEEE Aerosp Electron Syst Mag 27(9):4–20
Bryson AE, Frazier M (1963) Smoothing for linear and nonlinear systems, TDR 63-119, Aero System Division. Wright-Patterson Air Force Base, Ohio
Calafiore GC, Abrate F (2009) Distributed linear estimation over sensor networks. Int J Control 82(5):868–882
Carravetta F, Germani A, Raimondi M (1996) Polynomial filtering for linear discrete-time non-Gaussian systems. SIAM J Control Optim 34(5):1666–1690
Chen J, Patton RJ (1999) Robust model-based fault diagnosis for dynamic systems. Kluwer, Boston
Chisci L, Zappa G (1992) Square-root Kalman filtering of descriptor systems. Syst Control Lett 19(4):325–334
Chisci L, Garulli A, Zappa G (1996) Recursive state bounding by parallelotopes. Automatica 32(7):1049–1055
Chou KC, Willsky AS, Benveniste A (1994) Multiscale recursive estimation, data fusion, and regularization. IEEE Trans Autom Control 39(3):464–478
Combettes P (1993) The foundations of set-theoretic estimation. Proc IEEE 81(2):182–208
Cramér H (1946) Mathematical methods of statistics. University Press, Princeton
Crisan D, Rozovskii B (eds) (2011) The Oxford handbook of nonlinear filtering. Oxford University Press, Oxford
Dai L (1987) State estimation schemes in singular systems. In: Preprints 10th IFAC World Congress, Munich, vol 9, pp 211–215
Dai L (1989) Filtering and LQG problems for discrete-time stochastic singular systems. IEEE Trans Autom Control 34(10):1105–1108
Darragh J, Looze D (1984) Noncausal minimax linear state estimation for systems with uncertain second-order statistics. IEEE Trans Autom Control 29(6):555–557
Daum FE (1986) Exact finite dimensional nonlinear filters. IEEE Trans Autom Control 31(7):616–622
Daum F (2005) Nonlinear filters: beyond the Kalman filter. IEEE Aerosp Electron Syst Mag 20(8):57–69
Debs AS, Larson RE (1970) A dynamic estimator for tracking the state of a power system. IEEE Trans Power Appar Syst 89(7):1670–1678
Devlin K (2008) The unfinished game: Pascal, Fermat and the seventeenth-century letter that made the world modern. Basic Books, New York. Copyright (C) Keith Devlin
Dissanayake G, Newman P, Clark S, Durrant-Whyte H, Csorba M (2001) A solution to the simultaneous localization and map building (SLAM) problem. IEEE Trans Robot Autom 17(3):229–241
Dochain D, Vanrolleghem P (2001) Dynamical modelling and estimation of wastewater treatment processes. IWA Publishing, London
Doucet A, de Freitas N, Gordon N (eds) (2001) Sequential Monte Carlo methods in practice. Springer, New York
Duncan TE (1970) On the calculation of mutual information. SIAM J Appl Math 19(1):215–220
Durrant-Whyte H, Bailey T (2006a) Simultaneous localization and mapping: Part I. IEEE Robot Autom Mag 13(2):99–108
Durrant-Whyte H, Bailey T (2006b) Simultaneous localization and mapping: Part II. IEEE Robot Autom Mag 13(3):110–117
Elliott RJ, Aggoun L, Moore JB (2008) Hidden Markov models: estimation and control. Springer, New York. (first edition in 1995)
Evensen G (1994a) Inverse methods and data assimilation in nonlinear ocean models. Physica D 77:108–129
Evensen G (1994b) Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J Geophys Res 99(10):143–162
Evensen G (2007) Data assimilation – the ensemble Kalman filter. Springer, Berlin
Falb PL (1967) Infinite-dimensional filtering; the Kalman-Bucy filter in Hilbert space. Inf Control 11(1):102–137
Farina A (1999) Target tracking with bearings-only measurements. Signal Process 78(1):61–78
Farina A, Studer FA (1985) Radar data processing. Volume 1 – introduction and tracking, Editor P. Bowron. Research Studies Press, Letchworth/Wiley, New York (Translated in Russian (Radio I Sviaz, Moscow 1993) and in Chinese. China Defense Publishing House, 1988)
Farina A, Studer FA (1986) Radar data processing. Volume 2 – advanced topics and applications, Editor P. Bowron. Research Studies Press, Letchworth/Wiley, New York (In Chinese, China Defense Publishing House, 1992)
Farrell JA, Barth M (1999) The global positioning system and inertial navigation. McGraw-Hill, New York
Fisher RA (1912) On an absolute criterion for fitting frequency curves. Messenger Math 41(5):155–160
Fisher RA (1922) On the mathematical foundations of theoretical statistics. Philos Trans R Soc Lond Ser A 222:309–368
Fisher RA (1925) Theory of statistical estimation. Math Proc Camb Philos Soc 22(5):700–725
Flinn EA, Robinson EA, Treitel S (1967) Special issue on the MIT geophysical analysis group reports. Geophysics 32:411–525
Frost PA, Kailath T (1971) An innovations approach to least-squares estimation, Part III: nonlinear estimation in white Gaussian noise. IEEE Trans Autom Control 16(3):217–226
Galilei G (1632) Dialogue concerning the two chief world systems (Translated in English by S. Drake (Foreword of A. Einstein), University of California Press, Berkeley, 1953)
Gauss CF (1806) Theoria motus corporum coelestium in sectionibus conicis solem ambientum (Translated in English by C.H. Davis, Reprinted as Theory of motion of the heavenly bodies, Dover, New York, 1963)
Gauss CF (1995) Theoria combinationis observationum erroribus minimis obnoxiae (Translated by G.W. Stewart, Classics in Applied Mathematics), vol 11. SIAM, Philadelphia
Germani A, Manes C, Palumbo P (2005) Polynomial extended Kalman filter. IEEE Trans Autom Control 50(12):2059–2064
Ghil M, Malanotte-Rizzoli P (1991) Data assimilation in meteorology and oceanography. Adv Geophys 33:141–265
Ghosh M, Mukhopadhyay N, Sen PK (1997) Sequential estimation. Wiley, New York
Golub GH (1965) Numerical methods for solving linear least squares problems. Numerische Mathematik 7(3):206–216
Goodwin GC, Seron MM, De Doná JA (2005) Constrained control and estimation. Springer, London
Gordon NJ, Salmond DJ, Smith AFM (1993) Novel approach to nonlinear/non Gaussian Bayesian state estimation. IEE Proc F 140(2):107–113
Grewal MS, Weill LR, Andrews AP (2001) Global positioning systems, inertial navigation and integration. Wiley, New York
Grimble MJ (1988) H ∞ design of optimal linear filters. In: Byrnes C, Martin C, Saeks R (eds) Linear circuits, systems and signal processing: theory and applications. North Holland, Amsterdam, pp 535–540
Guo D, Shamai S, Verdú S (2005) Mutual information and minimum mean-square error in Gaussian channels. IEEE Trans Inf Theory 51(4):1261–1282
Hall DL, Llinas J (1997) An introduction to multisensor data fusion. Proc IEEE 85(1):6–23
Hassibi B, Sayed AH, Kailath T (1999) Indefinite-quadratic estimation and control. SIAM, Philadelphia
Heemink AW, Segers AJ (2002) Modeling and prediction of environmental data in space and time using Kalman filtering. Stoch Environ Res Risk Assess 16: 225–240
Helstrom CW (1969) Quantum detection and estimation theory. J Stat Phys 1(2):231–252
Helstrom CW (1976) Quantum detection and estimation theory. Academic, New York
Hernandez M, Farina A, Ristic B (2006) PCRLB for tracking in cluttered environments: measurement sequence conditioning approach. IEEE Trans Aerosp Electron Syst 42(2):680–704
Ho YC, Agrawala AK (1968) On pattern classification algorithms – introduction and survey. Proc IEEE 56(12):2101–2113
Ho YC, Lee RCK (1964) A Bayesian approach to problems in stochastic estimation and control. IEEE Trans Autom Control 9(4):333–339
Iida S, Ohki F, Yamamoto N (2010) Robust quantum Kalman filtering under the phase uncertainty of the probe-laser. In: IEEE international symposium on computer-aided control system design, Yokohama, pp 749–754
Itakura F (1971) Extraction of feature parameters of speech by statistical methods. In: Proceedings of the 8th Symposium Speech Information Processing, Sendai, pp II-5.1–II-5.12
Jazwinski AH (1966) Filtering for nonlinear dynamical systems. IEEE Trans Autom Control 11(4):765–766
Jazwinski AH (1968) Limited memory optimal filtering. IEEE Trans Autom Control 13(5): 558–563
Jazwinski AH (1970) Stochastic processes and filtering theory. Academic, New York
Joseph DP, Tou TJ (1961) On linear control theory. Trans Am Inst Electr Eng 80(18):193–196
Julier SJ, Uhlmann JK (1997) A non-divergent estimation algorithm in the presence of unknown correlations. In: Proceedings of the 1997 American Control Conference, Albuquerque, vol 4, pp 2369–2373
Julier SJ, Uhlmann JK (2004) Unscented Filtering and Nonlinear Estimation. Proc IEEE 92(3): 401–422
Julier SJ, Uhlmann JK, Durrant-Whyte H (1995) A new approach for filtering nonlinear systems. In: Proceedings of the 1995 American control conference, Seattle, vol 3, pp 1628–1632
Kailath T (1968) An innovations approach to least-squares estimation, Part I: linear filtering in additive white noise. IEEE Trans Autom Control 13(6): 646–655
Kailath T (1970) The innovations approach to detection and estimation theory. Proc IEEE 58(5): 680–695
Kailath T (1973) Some new algorithms for recursive estimation in constant linear systems. IEEE Trans Inf Theory 19(6):750–760
Kailath T, Frost PA (1968) An innovations approach to least-squares estimation, Part II: linear smoothing in additive white noise. IEEE Trans Autom Control 13(6):655–660
Kailath T, Sayed AH, Hassibi B (2000) Linear estimation. Prentice Hall, Upper Saddle River
Kalman RE (1960a) On the general theory of control systems. In: Proceedings of the 1st International Congress of IFAC, Moscow, USSR, vol 1, pp 481–492
Kalman RE (1960b) A new approach to linear filtering and prediction problems. Trans ASME J Basic Eng Ser D 82(1):35–45
Kalman RE, Bucy RS (1961) New results in linear filtering and prediction theory. Trans ASME J Basic Eng Ser D 83(3):95–108
Kamgarpour M, Tomlin C (2007) Convergence properties of a decentralized Kalman filter. In: Proceedings of the 47th IEEE Conference on Decision and Control, New Orleans, pp 5492–5498
Kaminski PG, Bryson AE (1972) Discrete square-root smoothing. In: Proceedings of the AIAA Guidance and Control Conference, paper no. 72–877, Stanford
Kay SM (1993) Fundamentals of statistical signal processing, volume 1: estimation theory. Prentice Hall, Englewood Cliffs
Kim K, Shevlyakov G (2008) Why Gaussianity? IEEE Signal Process Mag 25(2):102–113
Kim J, Woods JW (1998) 3-D Kalman filter for image motion estimation. IEEE Trans Image Process 7(1):42–52
Koch KR (1999) Parameter estimation and hypothesis testing in linear models. Springer, Berlin
Kolmogorov AN (1933) Grundbegriffe der Wahrscheinlichkeitsrechnung (in German) (English translation edited by Nathan Morrison: Foundations of the theory of probability, Chelsea, New York, 1956). Springer, Berlin
Kolmogorov AN (1941) Interpolation and extrapolation of stationary random sequences. Izv Akad Nauk SSSR Ser Mat 5:3–14 (in Russian) (English translation by G. Lindqvist, published in Selected works of A.N. Kolmogorov - Volume II: Probability theory and mathematical statistics, A.N. Shyryaev (Ed.), pp. 272–280, Kluwer, Dordrecht, Netherlands, 1992)
Kushner HJ (1962) On the differential equations satisfied by conditional probability densities of Markov processes with applications. SIAM J Control Ser A 2(1):106–199
Kushner HJ (1967) Dynamical equations for optimal nonlinear filtering. J Differ Equ 3(2):179–190
Kushner HJ (1970) Filtering for linear distributed parameter systems. SIAM J Control 8(3): 346–359
Kwakernaak H (1967) Optimal filtering in linear systems with time delays. IEEE Trans Autom Control 12(2):169–173
Lainiotis DG (1972) Adaptive pattern recognition: a state-variable approach. In: Watanabe S (ed) Frontiers of pattern recognition. Academic, New York
Lainiotis DG (1974) Estimation: a brief survey. Inf Sci 7:191–202
Laplace PS (1814) Essai philosophique sur le probabilités (Translated in English by F.W. Truscott, F.L. Emory, Wiley, New York, 1902)
Legendre AM (1810) Méthode des moindres quarrés, pour trouver le milieu le plus probable entre les résultats de diffèrentes observations. In: Mémoires de la Classe des Sciences Mathématiques et Physiques de l’Institut Impérial de France, pp 149–154. Originally appeared as appendix to the book Nouvelle méthodes pour la détermination des orbites des comètes, 1805
Lehmann EL, Casella G (1998) Theory of point estimation. Springer, New York
Leibungudt BG, Rault A, Gendreau F (1983) Application of Kalman filtering to demographic models. IEEE Trans Autom Control 28(3):427–434
Levy BC (2008) Principles of signal detection and parameter estimation. Springer, New York
Ljung L (1999) System identification: theory for the user. Prentice Hall, Upper Saddle River
Los Alamos Scientific Laboratory (1966) Fermi invention rediscovered at LASL. The Atom, pp 7–11
Luenberger DG (1964) Observing the state of a linear system. IEEE Trans Mil Electron 8(2):74–80
Mahler RPS (1996) A unified foundation for data fusion. In: Sadjadi FA (ed) Selected papers on sensor and data fusion. SPIE MS-124. SPIE Optical Engineering Press, Bellingham, pp 325–345. Reprinted from 7th Joint Service Data Fusion Symposium, pp 154–174, Laurel (1994)
Mahler RPS (2003) Multitarget Bayes filtering via first-order multitarget moments. IEEE Trans Aerosp Electron Syst 39(4):1152–1178
Mahler RPS (2007a) Statistical multisource multitarget information fusion. Artech House, Boston
Mahler RPS (2007b) PHD filters of higher order in target number. IEEE Trans Aerosp Electron Syst 43(4):1523–1543
Mangoubi ES (1998) Robust estimation and failure detection: a concise treatment. Springer, New York
Maybeck PS (1979 and 1982) Stochastic models, estimation and control, vols I, II and III. Academic, New York. 1979 (volume I) and 1982 (volumes II and III)
Mayer-Wolf E, Zakai M (1983) On a formula relating the Shannon information to the Fisher information for the filtering problem. In: Korezlioglu H, Mazziotto G and Szpirglas J (eds) Lecture notes in control and information sciences, vol 61. Springer, New York, pp 164–171
Mayne DQ (1966) A solution of the smoothing problem for linear dynamic systems. Automatica 4(2):73–92
McGarty TP (1971) The estimation of the constituent densities of the upper atmosphere. IEEE Trans Autom Control 16(6):817–823
McGee LA, Schmidt SF (1985) Discovery of the Kalman filter as a practical tool for aerospace and industry, NASA-TM-86847
McGeoch CC, Wang C (2013) Experimental evaluation of an adiabatic quantum system for combinatorial optimization. In: Computing Frontiers 2013 Conference, Ischia, article no. 23. doi:10.1145/2482767.2482797
McGrayne SB (2011) The theory that would not die. How Bayes’ rule cracked the enigma code, hunted down Russian submarines, and emerged triumphant from two centuries of controversies. Yale University Press, New Haven/London
Meditch JS (1967) Orthogonal projection and discrete optimal linear smoothing. SIAM J Control 5(1):74–89
Meditch JS (1971) Least-squares filtering and smoothing for linear distributed parameter systems. Automatica 7(3):315–322
Mendel JM (1977) White noise estimators for seismic data processing in oil exploration. IEEE Trans Autom Control 22(5):694–706
Mendel JM (1983) Optimal seismic deconvolution: an estimation-based approach. Academic, New York
Mendel JM (1990) Maximum likelihood deconvolution – a journey into model-based signal processing. Springer, New York
Metropolis N, Ulam S (1949) The Monte Carlo method. J Am Stat Assoc 44(247):335–341
Milanese M, Belforte G (1982) Estimation theory and uncertainty intervals evaluation in presence of unknown but bounded errors: linear families of models and estimators. IEEE Trans Autom Control 27(2):408–414
Milanese M, Vicino A (1993) Optimal estimation theory for dynamic systems with set-membership uncertainty. Automatica 27(6):427–446
Miller WL, Lewis JB (1971) Dynamic state estimation in power systems. IEEE Trans Autom Control 16(6):841–846
Mlodinow L (2009) The drunkard’s walk: how randomness rules our lives. Pantheon Books, New York. Copyright (C) Leonard Mlodinow
Monticelli A (1999) State estimation in electric power systems: a generalized approach. Kluwer, Dordrecht
Morf M, Kailath T (1975) Square-root algorithms for least-squares estimation. IEEE Trans Autom Control 20(4):487–497
Morf M, Sidhu GS, Kailath T (1974) Some new algorithms for recursive estimation in constant, linear, discrete-time systems. IEEE Trans Autom Control 19(4):315–323
Mullane J, Vo B-N, Adams M, Vo B-T (2011) Random finite sets for robotic mapping and SLAM. Springer, Berlin
Nachazel K (1993) Estimation theory in hydrology and water systems. Elsevier, Amsterdam
Najim M (2008) Modeling, estimation and optimal filtering in signal processing. Wiley, Hoboken. First published in France by Hermes Science/Lavoisier as Modélisation, estimation et filtrage optimal en traitement du signal (2006)
Neal SR (1967) Discussion of parametric relations for the filter predictor. IEEE Trans Autom Control 12(3):315–317
Netz R, Noel W (2011) The Archimedes codex. Phoenix, Philadelphia, PA
Nikoukhah R, Willsky AS, Levy BC (1992) Kalman filtering and Riccati equations for descriptor systems. IEEE Trans Autom Control 37(9):1325–1342
Olfati-Saber R (2007) Distributed Kalman filtering for sensor networks. In: Proceedings of the 46th IEEE Conference on Decision and Control, New Orleans, pp 5492–5498
Olfati-Saber R, Fax JA, Murray R (2007) Consensus and cooperation in networked multi-agent systems. Proc IEEE 95(1):215–233
Painter JH, Kerstetter D, Jowers S (1990) Reconciling steady-state Kalman and α −β filter design. IEEE Trans Aerosp Electron Syst 26(6):986–991
Park S, Serpedin E, Qarage K (2013) Gaussian assumption: the least favorable but the most useful. IEEE Signal Process Mag 30(3):183–186
Personick SD (1971) Application of quantum estimation theory to analog communication over quantum channels. IEEE Trans Inf Theory 17(3):240–246
Pindyck RS, Roberts SM (1974) Optimal policies for monetary control. Ann Econ Soc Meas 3(1): 207–238
Poor HV (1994) An introduction to signal detection and estimation, 2nd edn. Springer, New York. (first edition in 1988)
Poor HV, Looze D (1981) Minimax state estimation for linear stochastic systems with noise uncertainty. IEEE Trans Autom Control 26(4):902–906
Potter JE, Stern RG (1963) Statistical filtering of space navigation measurements. In: Proceedings of the 1963 AIAA Guidance and Control Conference, paper no. 63–333, Cambridge
Ramm AG (2005) Random fields estimation. World Scientific, Hackensack
Rao C (1945) Information and the accuracy attainable in the estimation of statistical parameters. Bull Calcutta Math Soc 37:81–89
Rao CV, Rawlings JB, Lee JH (2001) Constrained linear state estimation – a moving horizon approach. Automatica 37(10):1619–1628
Rao CV, Rawlings JB, Mayne DQ (2003) Constrained state estimation for nonlinear discrete-time systems: stability and moving horizon approximations. IEEE Trans Autom Control 48(2): 246–257
Rauch HE (1963) Solutions to the linear smoothing problem. IEEE Trans Autom Control 8(4): 371–372
Rauch HE, Tung F, Striebel CT (1965) Maximum likelihood estimates of linear dynamic systems. AIAA J 3(8):1445–1450
Reid D (1979) An algorithm for tracking multiple targets. IEEE Trans Autom Control 24(6):843–854
Riccati JF (1722) Animadversiones in aequationes differentiales secundi gradi. Actorum Eruditorum Lipsiae, Supplementa 8:66–73. Observations regarding differential equations of second order, translation of the original Latin into English, by I. Bruce, 2007
Riccati JF (1723) Appendix in animadversiones in aequationes differentiales secundi gradi. Acta Eruditorum Lipsiae
Ristic B (2013) Particle filters for random set models. Springer, New York
Ristic B, Arulampalam S, Gordon N (2004) Beyond the Kalman filter: particle filters for tracking applications. Artech House, Boston
Ristic B, Vo B-T, Vo B-N, Farina A (2013) A tutorial on Bernoulli filters: theory, implementation and applications. IEEE Trans Signal Process 61(13):3406–3430
Robinson EA (1963) Mathematical development of discrete filters for detection of nuclear explosions. J Geophys Res 68(19):5559–5567
Roman WS, Hsu C, Habegger LT (1971) Parameter identification in a nonlinear reactor system. IEEE Trans Nucl Sci 18(1):426–429
Sage AP, Masters GW (1967) Identification and modeling of states and parameters of nuclear reactor systems. IEEE Trans Nucl Sci 14(1):279–285
Sage AP, Melsa JL (1971) Estimation theory with applications to communications and control. McGraw-Hill, New York
Schmidt SF (1966) Application of state-space methods to navigation problems. Adv Control Syst 3:293–340
Schmidt SF (1970) Computational techniques in Kalman filtering, NATO-AGARD-139
Schonhoff TA, Giordano AA (2006) Detection and estimation theory and its applications. Pearson Prentice Hall, Upper Saddle River
Schweppe FC (1968) Recursive state estimation with unknown but bounded errors and system inputs. IEEE Trans Autom Control 13(1):22–28
Segall A (1976) Recursive estimation from discrete-time point processes. IEEE Trans Inf Theory 22(4): 422–431
Servi L, Ho Y (1981) Recursive estimation in the presence of uniformly distributed measurement noise. IEEE Trans Autom Control 26(2):563–565
Simon D (2006) Optimal state estimation – Kalman, H ∞ and nonlinear approaches. Wiley, New York
Simpson HR (1963) Performance measures and optimization condition for a third-order tracker. IRE Trans Autom Control 8(2):182–183
Sklansky J (1957) Optimizing the dynamic parameters of a track-while-scan system. RCA Rev 18:163–185
Smeth P, Ristic B (2004) Kalman filter and joint tracking and classification in TBM framework. In: Proceedings of the 7th international conference on information fusion, Stockholm, pp 46–53
Smith R, Self M, Cheeseman P (1986) Estimating uncertain spatial relationships in robotics. In: Proceedings of the 2nd conference on uncertainty in artificial intelligence, Philadelphia, pp 435–461
Snijders TAB, Koskinen J, Schweinberger M (2012) Maximum likelihood estimation for social network dynamics. Ann Appl Stat 4(2):567–588
Snyder DL (1968) The state-variable approach to continuous estimation with applications to analog communications. MIT, Cambridge
Snyder DL (1970) Estimation of stochastic intensity functions of conditional Poisson processes. Monograph no. 128, Biomedical Computer Laboratory, Washington University, St. Louis
Söderström T (1994) Discrete-time stochastic system – estimation & control. Prentice Hall, New York
Söderström T, Stoica P (1989) System identification. Prentice Hall, New York
Sorenson HW, Alspach DL (1970) Gaussian sum approximations for nonlinear filtering. In: Proceedings of the 1970 IEEE Symposium on Adaptive Processes, Austin, TX pp 19.3.1–19.3.9
Sorenson HW, Alspach DL (1971) Recursive Bayesian estimation using Gaussian sums. Automatica 7(4):465–479
Stankovic SS, Stankovic MS, Stipanovic DM (2009) Consensus based overlapping decentralized estimation with missing observations and communication faults. Automatica 45(6):1397–1406
Stark L (1968) Neurological control systems studies in bioengineering. Plenum Press, New York
Stengel PF (1994) Optimal control and estimation. Dover, New York. Originally published as Stochastic optimal control. Wiley, New York, 1986
Stephant J, Charara A, Meizel D (2004) Virtual sensor: application to vehicle sideslip angle and transversal forces. IEEE Trans Ind Electron 51(2):278–289
Stratonovich RL (1959) On the theory of optimal nonlinear filtering of random functions. Theory Probab Appl 4:223–225
Stratonovich RL (1960) Conditional Markov processes. Theory Probab Appl 5(2):156–178
Taylor JH (1979) The Cramér-Rao estimation error lower bound computation for deterministic nonlinear systems. IEEE Trans Autom Control 24(2): 343–344
Thrun S, Burgard W, Fox D (2006) Probabilistic robotics. MIT, Cambridge
Tichavsky P, Muravchik CH, Nehorai A (1998) Posterior Cramér-Rao bounds for discrete-time nonlinear filtering. IEEE Trans Signal Process 6(5):1386–1396
Toyoda J, Chen MS, Inoue Y (1970) An application of state estimation to short-term load forecasting, Part I: forecasting model and Part II: implementation. IEEE Trans Power Appar Syst 89(7):1678–1682 (Part I) and 1683–1688 (Part II)
Tsybakov AB (2009) Introduction to nonparametric estimation. Springer, New York
Tuncer TE, Friedlander B (2009) Classical and modern direction-of-arrival estimation. Academic, Burlington
Tzafestas SG, Nightingale JM (1968) Optimal filtering, smoothing and prediction in linear distributed-parameter systems. Proc Inst Electr Eng 115(8):1207–1212
Ulam S (1952) Random processes and transformations. In: Proceedings of the International Congress of Mathematicians, Cambridge, vol 2, pp 264–275
Ulam S, Richtmeyer RD, von Neumann J (1947) Statistical methods in neutron diffusion, Los Alamos Scientific Laboratory report LAMS-551
Van Trees H (1971) Detection, estimation and modulation theory – Parts I, II and III. Wiley, New York. Republished in 2013
van Trees HL, Bell KL (2007) Bayesian bounds for parameter estimation and nonlinear filtering/tracking. Wiley, Hoboken/IEEE, Piscataway
Venerus JC, Bullock TE (1970) Estimation of the dynamic reactivity using digital Kalman filtering. Nucl Sci Eng 40:199–205
Verdú S, Poor HV (1984) Minimax linear observers and regulators for stochastic systems with uncertain second-order statistics. IEEE Trans Autom Control 29(6):499–511
Vicino A, Zappa G (1996) Sequential approximation of feasible parameter sets for identification with set membership uncertainty. IEEE Trans Autom Control 41(6):774–785
Vo B-N, Ma WK (1996) The Gaussian mixture probability hypothesis density filter. IEEE Trans Signal Process 54(11):4091–4101
Vo B-T, Vo B-N, Cantoni A (2007) Analytic implementations of the cardinalized probability hypothesis density filter. IEEE Trans Signal Process 55(7):3553–3567
Wakita H (1973) Estimation of the vocal tract shape by inverse optimal filtering. IEEE Trans Audio Electroacoust 21(5):417–427
Wertz W (1978) Statistical density estimation – a survey. Vandenhoeck and Ruprecht, Göttingen
Wiener N (1949) Extrapolation, interpolation and smoothing of stationary time-series. MIT, Cambridge
Willsky AS (1976) A survey of design methods for failure detection in dynamic systems. Automatica 12(6):601–611
Wonham WM (1965) Some applications of stochastic differential equations to optimal nonlinear filtering. SIAM J Control 2(3):347–369
Woods JW, Radewan C (1977) Kalman filtering in two dimensions. IEEE Trans Inf Theory 23(4): 473–482
Xiao L, Boyd S, Lall S (2005) A scheme for robust distributed sensor fusion based on average consensus. In: Proceedings of the 4th International Symposium on Information Processing in Sensor Networks, Los Angeles, pp 63–70
Zachrisson LE (1969) On optimal smoothing of continuous-time Kalman processes. Inf Sci 1(2):143–172
Zellner A (1971) An introduction to Bayesian inference in econometrics. Wiley, New York
Acknowledgements
The authors warmly recognize the contribution of S. Fortunati (University of Pisa, Italy), L. Pallotta (University of Napoli, Italy), and G. Battistelli (University of Firenze, Italy).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer-Verlag London
About this entry
Cite this entry
Chisci, L., Farina, A. (2015). Estimation, Survey on. In: Baillieul, J., Samad, T. (eds) Encyclopedia of Systems and Control. Springer, London. https://doi.org/10.1007/978-1-4471-5058-9_60
Download citation
DOI: https://doi.org/10.1007/978-1-4471-5058-9_60
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-5057-2
Online ISBN: 978-1-4471-5058-9
eBook Packages: EngineeringReference Module Computer Science and Engineering