Abstract
In this paper a variational method for registering or mapping like points in medical images is proposed and analyzed. The proposed variational principle penalizes a departure from rigidity and thereby provides a natural generalization of strictly rigid registration techniques used widely in medical contexts. Difficulties with finite displacements are elucidated, and alternative infinitesimal displacements are developed for an optical flow formulation which also permits image interpolation. The variational penalty against non-rigid flows provides sufficient regularization for a well-posed minimization and yet does not rule out irregular registrations corresponding to an object excision. Image similarity is measured by penalizing the variation of intensity along optical flow trajectories. The approach proposed here is also independent of the order in which images are taken. For computations, a lumped finite element Eulerian discretization is used to solve for the optical flow. Also, a Lagrangian integration of the intensity along optical flow trajectories has the advantage of prohibiting diffusion among trajectories which would otherwise blur interpolated images. The subtle aspects of the methods developed are illustrated in terms of simple examples, and the approach is finally applied to the registration of magnetic resonance images.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
R.A. Adams, Sobolev Spaces, Academic Press: New York, 1975.
A. Borzì, K. Ito, and K. Kunisch, “Optimal control formulation for determining optical flow,”SIAM J. Sci. Comp., Vol. 24, No. 3, pp. 818–847, 2002.
P. Charbonnier, L. Blanc-Féraud, G. Aubert, and M. Barlaud, “Deterministic edge-preserving regularization in computed imaging,” IEEE Trans. on Image Processing, Vol. 6, No. 2, 1997.
G.E. Christensen and H. J. Johnson, “Consistent image registration”, IEEE Trans. Med. Imaging. Vol. 20, No. 7, July 2001, pp. 568–582.
P.G. Ciarlet, The finite element method for elliptic problems, North-Holland, Amsterdam, 1978.
P.G. Ciarlet, Mathematical elasticity. Volume I: Three-dimensional elasticity, Vol. 20, Studies in Mathematics and its Applications, North-Holland: Amsterdam, 1988.
P.G. Ciarlet, Mathematical elasticity. volume II: Theory of plates, Vol. 27, Studies inMathematics and its Applications, North-Holland: Amsterdam, 1997.
H.O. Fattorini, Infinite dimensional optimization and control theory, Cambridge University Press, Cambridge, 1999.
B. Fischer and J. Modersitzki, Fast inversion of matrices arising in image processing, NumericalAlgorithms 22, pp. 1–11, 1999.
B. Fischer and J. Modersitzki, “Curvature based image registration,” J. Math. Imaging andVision Vol. 18, pp. 81–85, 2003.
M. Fitzpatrick, D.L.G. Hill, and C.R. Maurer, Jr., Image registration, in Medical ImageProcessing, Chapter 8 of Volume II of the Handbook of Medical Imaging, M. Sonka andJ.M. Fitzpatrick (Eds)., Press SPIE, 2000.
M. Fitzpatrick, J.B. West, and C.R. Maurer, Jr., “Predicting error in rigid-body point-basedregistration”, IEEE Trans. Med. Imaging, Vol. 17, pp. 694–702, 1998.
S. Haker, A. Tannenbaum, and R. Kikinis, Mass preserving mappings and image registration, MICCAI2001, pp. 120– 127.
S. Henn, “Schnelle elastische anpassung in der digitalen bildverarbeitung mit Hilfe vonmehrgitterverfahren,” Diplomarbeit Heinrich-Heine-Universität Düsseldorf, 1997.
W. Hinterberger, “Generierung eines films zwischen zwei bildern mit hilfe des optischen flusses,”Diplomarbeit, Institut für Industriemathematik der Technisch-NaturwissenschaftlichenFakultät der Johannes Kepler Universität Linz, Linz, Sept 1999.
B.K.P. Horn and B.G. Schunck, “Determining optical flow,” Artif. Intell., Vol. 23, pp. 185–203, 1981.
S.L. Keeling and R. Bammer, “A variational approach to magnetic resonance coil sensitivity estimation,” Appl. Math. Comp., Vol. 158, No. 2, pp. 53–82, 2004.
S.L. Keeling and W. Ring, “Medical image registration and interpolation by optical flow withmaximal rigidity,” SFB Report No. 248, Karl-Franzens-University of Graz, Graz, Austria, May, 2003.
M. Lefébure and L.D. Cohen, “Image registration, optical flow and local rigidity,” J. Math. Imaging and Vision, Vol. 14, No. 2, pp. 131–147, March 2001
J.A. Little, D.L.G. Hill, and D.J. Hawkes, “Deformations incorporating rigid structures,” ComputerVision and Image Understanding, Vol. 66, No. 2, pp. 223–232, 1997.
J. Modersitzki, “Habilitation thesis,” Medizinische Universität Lübeck, 2002.
P.J. Olver, Applications of lie groups to differential equations, Springer: New York, 1986.
S. Osher and L.I. Rudin, “Feature-oriented image enhancement using shock filters,” SIAM J. Numer. Anal., Vol. 27, No. 4, pp. 919–940, August 1990.
W. Peckar, C. Schnörr, K. Rohr, and H.S. Stiehl, “Parameter-free elastic deformation approachfor 2d and 3d registration using prescribed displacements,” J. Math. Imaging and Vision, Vol. 10, pp. 143–162, 1999.
D. Rueckert, B. Clarkson, D.L.G. Hill, and D.J. Hawkes, “Non-rigid registration using higher-ordermutual information,” Medical Imaging 2000: Image Processing, K. M. Hanson, ed., Proceedingsof SPIE, Vol. 3979, pp. 438–447, 2000.
D. Rueckert, L.I. Sonoda, C. Hayes, D.L.G. Hill, M.O. Leach, and D.J. Hawkes, “Non-rigidregistration using free-form deformations: Application to breast mr images”, IEEE Trans. Med. Imaging, Vol. 18, No. 8, pp. 712–721, 1999.
M.E. Taylor, Partial differential equations: basic theory, Springer: New York, 1996.
J.-P. Thirion, “Image matching as a diffusion process: An analogy with maxwell’s demons,” Medical Image Analysis, Vol. 2, No. 3, pp. 243–260, 1998.
P.M. Thompson, M.S. Mega, K.L. Narr, E.R. Sowell, R.E. Blanton, and A.W. Toga, “Brain imageanalysis and atlas construction,” Medical Image Processing, Chapter 17 of Volume II of theHandbook of Medical Imaging, M. Sonka and J.M. Fitzpatrick, (Eds)., SPIE Press (July, 2000).
G.M. Troianiello, Elliptic differential equations and obstacle problems, Plenum Press: New York, 1987.
U. Trottenberg, C. Oosterlee, and A. Schüller, Multigrid, Academic Press: San Diego, 2001.
C.R. Vogel and M.E. Oman, Iterative methods for total variation denoising, SIAM Journal onScientific Computing, Vol. 17, pp. 227–238, 1996.
J. Weickert, Anisotropic diffusion in image processing, B. G. Teubner Stuttgart, 1998.
J.B. West, J.M. Fitzpatrick, M.Y. Wang, B.M. Dawant, C.R. Maurer, Jr., R.M. Kessler, R.J. Maciunas, C. Barillot, D. Lemoine, A. Collignon, F. Maes, P. Suetens, D. Vandermeulen, P.A. van den Elsen, S. Napel, T.S. Sumanaweera, B. Harkness, P.F. Hemler, D.L.G. Hill, D.J. Hawkes, C. Studholme, J.B.A. Maintz, M.A. Viergever, G. Malandain, X. Pennec, M.E. Noz, G.Q. Maguire, Jr., M. Pollack, C.A. Pelizzari, R.A. Robb, D. Hanson, and R.P. Woods, “Comparison and evaluation of retrospectiveintermodality brain image registration techniques,” J. Comput. Assist. Tomogr., Vol. 21, pp. 554–566, 1997.
Author information
Authors and Affiliations
Corresponding authors
Additional information
Supported by the Fonds zur Förderung der wissenschaftliche Forschung under SFB 03, “Optimierung und Kontrolle”.
Stephen Keeling was born in 1956 in Louisville, KY, USA. He received the B.S. in Biology and Chemistry from Eastern Kentucky University in 1978, the M.S. in Biomedical Engineering (bioelectric phenomena) from Case Western Reserve University in 1981, and the Ph.D. in Mathematics (numerical analysis for PDEs) from the University of Tennessee in 1986. His postdoctoral research at ICASE and at Vanderbilt University focused on active noise control until 1989. From 1989 until 1998 he worked as Senior and then Principal Scientist in the CFD Group at the Arnold Engineering Development Center specializing in flow control and imaging. From 1998 until 2001 he worked with the mathematics and radiology faculties of the University of Graz as a Research Associate of the Special Research Center on Optimization and Control. Since 2001 he is Assistant Professor at the Institute of Mathematics of the University of Graz. His research interests include early vision problems in medical imaging with emphasis on MRI applications.
Wolfgang Ring was born on November 6, 1965 in Zeltweg, Austria. He received his Masters Degree from the University of Graz in 1991 and his Ph.D. in Mathematics from the Technical University of Graz in 1994. He worked as an Assistant Professor at the Institute of Mathematics at the Technical University of Graz between 1993 and 1996. Since 1997 he is Assistant Professor at the Institute of Mathematics at the University of Graz. His main scientific interests are geometric inverse problems, mathematical imaging and optimal shape design.
Rights and permissions
About this article
Cite this article
Keeling, S.L., Ring, W. Medical Image Registration and Interpolation by Optical Flow with Maximal Rigidity. J Math Imaging Vis 23, 47–65 (2005). https://doi.org/10.1007/s10851-005-4967-2
Issue Date:
DOI: https://doi.org/10.1007/s10851-005-4967-2