Rudolf E. Kálmán: Filter

“At present, a nonspecialist might well regard the Wiener-Kolmogorov theory of filtering and prediction [1, 2] as "classical' — in short, a field where the techniques are well established and only minor improvements and generalizations can be expected.
That this is not really so can be seen convincingly from recent results of Shinbrot [3], Stceg [4], Pugachev [5, 6], and Parzen [7]. Using a variety of methods, these investigators have solved some long-stauding problems in nonstationary filtering and prediction theory. We present here a unified account of our own independent researches during the past two years (which overlap with much of the work [3-71 just mentioned), as well as numerous new results. We, too, use time-domain methods, and obtain major improvements and generalizations of the conventional Wiener theory. In particular, our methods apply without modification to multivariate problems.”

Rudolf E. Kálmán

Source: New results in linear filtering and prediction theory (1961), p. 95 Opening paragraphs

Problem , Time , Past

“I have been aware from the outset (end of January 1959, the birthdate of the second paper in the citation) that the deep analysis of something which is now called Kalman filtering were of major importance. But even with this immodesty I did not quite anticipate all the reactions to this work. Up to now there have been some 1000 related publications, at least two Citation Classics, etc. There is something to be explained.
To look for an explanation, let me suggest a historical analogy, at the risk of further immodesty. I am thinking of Newton, and specifically his most spectacular achievement, the law of Gravitation. Newton received very ample "recognition" (as it is called today) for this work. it astounded - really floored - all his contemporaries. But I am quite sure, having studied the matter and having added something to it, that nobody then (1700) really understood what Newton's contribution was. Indeed, it seemed an absolute miracle to his contemporaries that someone, an Englishman, actually a human being, in some magic and un-understandable way, could harness mathematics, an impractical and eternal something, and so use mathematics as to discover with it something fundamental about the universe.”

Rudolf E. Kálmán

Kalman (1986) " Steele Prizes Awarded at the Annual Meeting in San Antonio http://www-history.mcs.st-and.ac.uk/Extras/Kalman_response.html", Notices Amer. Math. Soc. 34 (2) (1987), 228-229.

Law , Way , Mathematics , Understanding

“A nonlinear differential equation of the Riccati type is derived for the covariance matrix of the optimal filtering error. The solution of this 'variance equation' completely specifies the optimal filter for either finite or infinite smoothing intervals and stationary or non-stationary statistics.
The variance equation is closely related to the Hamiltonian (canonical) differential equations of the calculus of variations. Analytic solutions are available in some cases. The significance of the variance equation is illustrated by examples which duplicate, simplify, or extend earlier results in this field.
The duality principle relating stochastic estimation and deterministic control problems plays an important role in the proof of theoretical results. In several examples, the estimation problem and its dual are discussed side-by-side.
Properties of the variance equation are of great interest in the theory of adaptive systems. Some aspects of this are considered briefly.”

Rudolf E. Kálmán

Source: New results in linear filtering and prediction theory (1961), p. 95 Article summary; cited in: " Rudolf E. Kálmán http://www-history.mcs.st-andrews.ac.uk/Biographies/Kalman.html", MacTutor History of Mathematics archive, 2010

Error , Optimism , Problem