Keywords

1 Introduction

James Durbin was born into a non-academic family in Widnes on 30 June 1923. ‘Jim’, as he was universally known except in the most formal circumstances, showed considerable promise at school where he excelled in most subjects, except physics. However, he developed strength in mathematics and it was in that subject that he obtained a scholarship to St. John’s College, Cambridge, which he entered in 1942. This was in the middle of the Second World War when special arrangements were in force for those eligible for war service. Jim completed five terms of residence after which he worked in the Army Operational Research Group until 1945. On the strength of this, he was awarded a ‘wartime’ BA which was subsequently turned into an MA in the usual Cambridge fashion. He then spent a period (1946–1947) working for the British Boot, Shoe and Allied Trades Research Association. On returning to the Department of Applied Economics, Cambridge, in 1948, it was Jim’s intention to take Part II of the Economics Tripos. This would have taken two years but he was advised by his College tutor, an economics lecturer, that his time would be better spent taking the one-year Diploma in Mathematical Statistics. He therefore completed his formal university education in a little under three years which, as he later used to point out, must have been a shorter time than for any of his peers.

Jim joined the newly created Department of Applied Economics (DAE) at Cambridge in 1948. Richard Stone was Director. A good deal of research was done on time series problems with researchers such as Guy Orcutt and Don Cochrane but also with passing visitors, including Hendrik Houthakker, Larry Klein, Michael Farrell and Ted Anderson. In the summer of 1949, a young Australian researcher, Geoffrey Watson, arrived in Cambridge for a year to do some work for his PhD. He and Jim started to discuss the testing of serial correlation in regression residuals. The idea of a bound test came rather quickly and the mathematical details were developed in the following months. This work led to the famous Durbin–Watson test statistic, which had a big impact on applied econometrics because of its role in assessing the fit of an estimated regression equation.

2 LSE

The next step in Jim’s career was determined when, in 1950, Sir Maurice Kendall wrote to Henry Daniels at Cambridge enquiring whether he knew of anyone suitable to fill a post of Assistant Lecturer in Statistics at LSE. With the apparent ease and speed with which such appointments were handled in those days, Jim was duly appointed. Thus began his lifelong association with the School where he rose through the ranks to become Professor in 1961 and from which he retired in 1988. In his interview with Jim, published in Econometric Theory in 1988, the distinguished econometrician Peter Phillips wrote: ‘In 1950, Jim Durbin joined a newly established statistical research unit at LSE and, in retrospect, it is clear that his appointment broke a new dawn for the LSE … Jim Durbin’s research has had an extraordinary impact on the application of statistics’ (Phillips 1988: 125–126).

Jim took his turn as Convenor (LSE’s name for the rotating headship of department in those days) but he firmly held to the traditional LSE view that the professors of a department were collectively responsible and that the Convenor merely acted only with their consent and on their behalf. He had no liking or particular aptitude for administration and he did not fill any of the many managerial offices which often come the way of academics in their employing institutions nor in the many academic societies in which he took a leading part. Jim was a forceful character who was at his best as a leader or advocate of causes which were near to his heart. He often served as Council member or Chairman of committees but never as Secretary or in any other organising capacity. His strength was in advocating a course of action rather than as the patient negotiator and ‘fixer’. He was not in sympathy with many of the trends in university management which had already become apparent before his retirement. He enjoyed the cut and thrust of debate on all manner of subjects, much of which took place in the LSE Senior Common Room. His own position was never left in doubt, but there was no sense of superiority or superciliousness in his forays. He would often hold forth on such things as the declining economic position of university staff as evidenced by their inability to afford various cuts of meat or the skiing holidays which were easily attainable in his younger days.

Unusually, perhaps, for someone who later travelled the world and greatly valued his international connections, Jim’s academic base was firmly fixed in LSE as his domestic life was centred on his home in North London where he and his wife, Anne, brought up their three children. Jim had the physique of a sportsman and one might have envisaged him as a rugby player, but as a young man mountaineering was his interest. After marriage, he decided that this was not a suitable family activity and he turned instead to skiing. But in his late fifties, he climbed Kilimanjaro, the highest mountain in Africa. A few years later and only after three months of preparation that mainly consisted of cycling between his home in Hampstead and his work in Central London, he climbed Mont Blanc to celebrate his 60th birthday. He is alleged to have seen one of the attractions of academic life as the opportunity which it offered for such activities.

When Jim retired from LSE, after nearly thirty-nine years of active service in the Department of Statistics, a special seminar was organised for him on 15 December 1988. He became an Emeritus Professor and from 2007 he was an Honorary Professor of University College London (UCL) and a Fellow in the Centre for Microdata Methods and Practice (CeMMAP). He continued to pursue his research interest in time series and the second edition of his book with Siem Jan Koopman appeared in May 2012, shortly before he died on 23 June at the age of 88.

3 Journals, Societies and Honours

Jim carried out editorial work for a number of statistics journals. He assisted with Biometrika for many years, starting in 1960 as an editorial assistant, then as deputy editor in 1962 and, finally, from 1964 to 1967 as associate editor. He was on the Editorial Committee of the International Statistical Review from 1958 to 1962 and served as an associate editor of the Annals of Statistics from 1973 to 1975 and the Journal of the Royal Statistical Society, Series B, from 1978 to 1981.

He had a strong commitment to the Royal Statistical Society (RSS). He was also active for the Institute of Statisticians (as member of the Council, 1960–1963) before it merged with the RSS. His involvement with the RSS culminated in the award of the Society’s Guy Medal in Gold in 2008 for a lifetime’s achievement in statistics. (He had been awarded the Bronze Medal in 1966 and the Silver Medal in 1976.) This medal, named in honour of Sir William Guy, is ‘awarded to a Fellow of the Society judged to have merited a signal mark of distinction by reason of their innovative contributions to the theory or application of statistics’ (Royal Statistical Society undated). The citation read:

The Guy Medal in Gold is awarded to Professor James Durbin, FBA, for a lifetime of highly influential contributions which have given him outstanding international recognition as a leader in our field, taking particular account of his pioneering work on testing for serial correlation in regression, on estimating equations, on Brownian motion and other processes crossing curved boundaries, on goodness-of-fit tests with estimated parameters and on many aspects of time series analysis especially in areas relevant to econometrics, and also his remarkable service to the wider statistical profession on the international stage (cited in Koopman 2012: 1064).

Within the RSS, Jim held a number of offices, but his main interest and contribution were to the Research Section on whose Committee he served on three occasions before becoming its chairman in 1972–1973. He was a natural choice for President of the Society several years later in 1986–1987.

With his great interest in statistics at the international level, Jim was active in the International Statistical Institute, of which he became President in 1983. From its origins, the Institute had catered mainly for official statisticians, and many mathematical statisticians did not find it their natural home. With the growth of mathematical statistics, there was an obvious need for a focus on this aspect outside the USA. Although the Institute of Mathematical Statistics professed to be international, it was largely seen as an American organisation and could not easily meet the needs of statisticians in other parts of the world. The vacuum was initially filled by a European region of the Institute of Mathematical Statistics; this then became a new section of the International Statistical Institute. Finally, it developed into a fully fledged European Society in 1975 called the Bernoulli Society for Mathematical Statistics and Probability. Jim was Treasurer from 1975 to 1981.

In the course of time, Jim acquired a whole string of fellowships. These included the Institute of Mathematical Statistics (1958), the American Statistical Association (1960), the Econometric Society (1967), the London School of Economics (1993) and, of course, the British Academy (2001). His somewhat belated election to the Academy probably stemmed partly from the fact that it was never entirely clear what kind of statistician he was. Was he a mathematical, economic or social statistician? At various stages of his career, a good case could have been made for any of these designations and indeed it is not clear where Jim, if pressed, would have placed himself. However, by the late 1990s it was recognised that econometricians had a firm place in the Economics Section of the British Academy and, on this basis, Jim was duly elected. In 2001, he was awarded an honorary doctorate from the National University of Tucumán, Argentina.

4 Contributions to Statistics and Econometrics

Jim’s research in statistics and econometrics covered a wide range of topics, including time series analysis, sample survey methodology, goodness-of-fit tests, probability theory, simultaneous equations models and the philosophy of statistics. Many of his papers appeared in top journals, such as Biometrika, Journal of the Royal Statistical Society, Journal of Applied Probability, Econometrica, Journal of the American Statistical Association, Annals of Mathematical Statistics and Annals of Statistics. Although Jim is best known to academic statisticians and econometricians for his theoretical contributions, he was always concerned with the way in which statistical methods could be applied in practice and used to influence policy. His early work on testing for serial correlation was done in response to problems encountered in fitting regression models by members of Richard Stone’s group at the DAE and later work on seasonal adjustment while the effects of the car seat belt law stemmed from his contacts in the civil service. More generally, an underlying theme in much of Jim’s work was the development of statistical methods that would be useful in practice. In reading his papers, one never feels that he is using mathematics just for the sake of it. It is there for a purpose because there is an important problem to be solved. Similarly, his talks and lectures did not dwell on unnecessary detail but rather tried to present the bigger picture and convey an intuitive understanding of what was going on.

As already noted, the Durbin–Watson test (see Durbin and Watson 1950, 1951) was developed at the beginning of Jim’s research career when he was at the DAE. The test is designed to detect first-order serial correlation in regression residuals. If such serial correlation is found, it might be ‘corrected’ by modelling the error as a first-order autoregressive process, a technique that had recently been proposed by Cochrane and Orcutt who were colleagues at the DAE. Alternatively, the equation could be modified in other ways, perhaps by introducing more explanatory variables or changing the functional form. The von Neumann ratio had been developed a few years earlier to test against first-order serial correlation in a time series which, under the null hypothesis, is assumed to be normally distributed and serially uncorrelated. However, when applied to regression residuals its distribution depends on the explanatory variables used. The ingenious idea of Durbin and Watson was to develop a bounds test for which they were able to derive and tabulate the upper and lower limits for the critical values.

After joining LSE, Jim worked on sample survey theory. For example, his 1953 article for the Journal of the Royal Statistical Society (JRSS) (Durbin 1953) develops a general form for the estimation of sampling variances in multistate samples with unequal probabilities. He also collaborated with Alan Stuart, his closest colleague at LSE, in producing papers on experimental surveys and on rank correlations (see Durbin and Stuart 1951, 1954, respectively).

Jim returned to time series testing in 1957 with the publication of an article in Biometrika (Durbin 1957). In it, he adapted the Durbin–Watson test for use in a system of simultaneous equations. Such systems had only recently been introduced into econometrics and estimation by the method of two-stage least squares was not yet in widespread use. Jim’s approach is based on the method of limited information maximum likelihood, which is technically more demanding, and what he did illustrated his capacity for devising a clever solution to a difficult problem. The intuition for Jim’s thinking may well have come from his ability to think in geometric terms, an approach which is now somewhat out of fashion.

The Durbin–Watson test was arguably the first diagnostic statistic to be routinely used by applied economists to assess the adequacy of their regressions. Unfortunately, its success led to it being used for models where the underlying statistical assumptions did not hold. In particular, it began to be quoted for regressions containing a lagged dependent variable. Although Jim’s papers clearly excluded this situation, he felt a responsibility to put matters right and this led to his important 1970 Econometrica article on the h-statistic (Durbin 1970). In order to encourage its use by applied researchers, the h-statistic was presented as a modification of the Durbin–Watson statistic that could be easily calculated from standard computer output. The general principle of this test was later recognised as a Lagrange multiplier procedure.

Durbin–Watson is concerned with first-order serial correlation. One way of testing higher-order serial correlation is based on the cumulative periodogram. The cumulative periodogram, and the desire to get a distribution theory for it, provided the motivation for Jim’s work on boundary crossing problems and the weak convergence of the empirical distribution function (see Durbin 1968, 1971). It further led to the development of a limiting distribution theory of Cramér-von Mises statistics for cases where parameters are estimated. This work was joint mostly with Martin Knott of LSE and appeared as two papers in the JRSS (Durbin and Knott 1972; Durbin et al. 1975). However, Jim was not satisfied with the underlying weak convergence theory. He therefore developed a new theory of weak convergence of stochastic processes and published this material in his 1973 book for the Society for Industrial and Applied Mathematics (SIAM) (Durbin 1973).

Jim’s 1975 paper with Brown and Evans (Brown et al. 1975) proposed another regression diagnostic, this time for detecting structural change in a time series regression. The test statistics are based on cumulating recursive residuals or their squares, and the underlying distributional theory has features in common with that of the cumulative periodogram. They are widely used in econometrics computer packages. The recursive residuals are the standardised one-step-ahead prediction errors obtained by running a regression recursively, with each observation added one at a time. The algorithm for computing the recursive residuals turns out to be a special case of a more general filtering algorithm, known as the Kalman filter. The application and generalisation of the Kalman filter were to play a central role in Jim’s later work with Andrew Harvey and Siem Jan Koopman.

Jim’s paper on errors in variables, published in 1954 in the Review of the International Statistical Institute (Durbin 1954), describes the construction of a test statistic that is a basic version of an exogeneity test in econometrics. A more general test was later developed by Jerry Hausman in a 1978 Econometrica article (Hausman 1978). This test, which is widely used, is now usually referred to as the Durbin–Hausman, or Durbin–Hausman–Wu, test.

In 1963, Jim gave a presentation at the European Meetings of the Econometric Society in Copenhagen that showed how the full information maximum likelihood estimator in a simultaneous system of equations can be interpreted as an instrumental variable estimator. Although Jim did not publish his results at that time—partly because he could not find the assistance in producing a numerical example—it nevertheless had an impact on the econometrics profession. The work was discussed in Edmond Malinvaud’s classic textbook, Statistical Methods of Econometrics (Malinvaud 1966), and in important papers such as Hendry (1976). The Copenhagen paper was published 25 years later in Econometric Theory (Durbin 1988).

The dominant time series paradigm during the 1970s and early 1980s centred on the Box-Jenkins methodology. Jim became convinced in the mid-1980s that the methodology based on structural or unobserved components time series models was the way forward in applied work. He was very supportive of the work being carried out at LSE by one of us (Harvey). This research programme developed a complete methodological framework for unobserved components models, based on state space models and the Kalman filter. When Jim was asked by the UK Department of Transport if he was interested in carrying out a statistical investigation of the newly introduced seat belt law, he jumped at the opportunity to collaborate with Harvey in developing unobserved components models for this purpose. This led to an article in the JRSS describing the new methodology and a report for the Department of Transport. The seat belt law had been initially introduced for a three-year trial period and the report had a strong influence on the decision to make it permanent (see Durbin and Harvey 1985, 1986).

The seat belt project included an analysis of time series of small counts, such as the number of van drivers killed each month. It sparked an interest in Jim to develop methods for the treatment of time series with non-Gaussian features. He started to collaborate with Siem Jan Koopman, who having completed a PhD with Harvey, had moved on to become a Lecturer at LSE. The collaboration led to a series of important publications on nonlinear and non-Gaussian state space models from the mid-1990s onwards. Notable examples include the papers on importance sampling for state space models published in Biometrika in 1997 and the JRSS in 2000 (see Durbin and Koopman 1997; Koopman and Durbin 2000). Following on from this work, Jim was keen to write a book on state space methods with the aim of promoting the unobserved components alternative to the Box-Jenkins methodology and showing how the methods could be extended to deal with nonlinear models. The book was published by Oxford University Press in 2001 (Durbin and Koopman 2001).

Although Jim’s research interests had been sharply focused for most of his career, he latterly developed a broad interest in statistics and, beyond that, into science and philosophy. His reading convinced him that one could not understand the philosophical foundations of mathematics apart from the evolutionary origins of human reasoning. There is no doubt that he would have liked to have pursued these ideas further.