Top

International Journal of Computer Vision

Published in:

01-01-2014

Spline-Based Hybrid Image Registration using Landmark and Intensity Information based on Matrix-Valued Non-radial Basis Functions

Authors: Stefan Wörz, Karl Rohr

Published in: International Journal of Computer Vision | Issue 1/2014

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

We introduce a new approach for spline-based elastic image registration using both point landmarks and intensity information. With this approach, both types of information as well as a regularization based on the Navier equation are directly integrated in a single energy minimizing functional. For this functional we have derived an analytic solution, which is based on matrix-valued non-radial basis functions. With our approach the full 3D intensity information is exploited, i.e., all voxels are considered and subsampling using a grid is not required. A special case of our hybrid approach is obtained by disregarding the landmark information, which results in a pure intensity-based elastic registration approach. We have successfully applied our approach to 3D synthetic images, 2D MR images of the human brain, 2D gel electrophoresis images, and 3D CT lung images.

previous article Detecting parametric objects in large scenes by Monte Carlo sampling

next article Sampling Minimal Subsets with Large Spans for Robust Estimation

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Léon Bérard Cancer Center & CREATIS lab, Lyon, France, www.creatis.insa-lyon.fr/rio/popi-model

Arad, N., & Reisfeld, D. (1995). Image warping using few anchor points and radial functions. Computer Graphics Forum, 14(1), 35–46.CrossRef

von Berg, J., Barschdorf, H., Blaffert, T., Kabus, S., Lorenz, C. (2007). Surface based cardiac and respiratory motion extraction for pulmonary structures from multi-phase CT. In Manduca, A., & Hu, X. (Eds.), Proceedings on SPIE Medical Imaging 2007: Physiology, Function, and Structure from Medical Images, SPIE Bellingham, WA/USA, San Diego, CA/USA (vol 6511, pp. 0Y1-11).

Bergvall, E., Hedström, E., Bloch, K., Arheden, H., & Sparr, G. (2008). Spline-based cardiac motion tracking using velocity-encoded magnetic resonance imaging. IEEE Transactions on Medical Imaging, 27(8), 1045–1053.CrossRef

Berth, M., Moser, F., Kolbe, M., & Bernhardt, J. (2007). The state of the art in the analysis of two-dimensional gel electrophoresis images. Applied Microbiology Biotechnology, 76(6), 1223–1243.CrossRef

Bookstein, F. (1989). Principal warps: Thin-plate splines and the decomposition of deformations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11(6), 567–585.CrossRefMATH

Cachier, P., & Ayache, N. (2004). Isotropic energies, filters and splines for vector field regularization. Journal of Mathematical Imaging and Vision, 20(3), 251–265.CrossRefMathSciNet

Cachier, P., Mangin, J.-F., Pennec, X., Rivière, D., Papadopoulos-Orfanos, D., Régis, J., et al. (2001). Multisubject non-rigid registration of brain MRI using intensity and geometric features. In Niessen, W., & Viergever, M. (Eds.), Proceedings on Fourth International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI’01), Utrecht, The Netherlands, Lecture Notes in Computer Science (Vol. 2208, pp. 734–742). Berlin: Springer.

Cao, K., Christensen, G., Ding, K., Reinhardt, J. (2009). Intensity-and-landmark-driven, inverse consistent, B-spline registration and analysis for lung imagery. In Brown, M., de Bruijne, M., van Ginneken, B., Kiraly, A., Kuhnigk, J., Lorenz, C., McClelland, J., Mori, K., Reeves, A., & Reinhardt, J. (Eds.), Proceedings on Second International Workshop on Pulmonary Image Analysis, in conjunction with MICCAI’09, CreateSpace Independent Publishing Platform, London, UK (pp. 137–148).

Cao, K., Ding, K., Christensen, G., & Reinhardt, J. (2010). Tissue volume and vesselness measure preserving nonrigid registration of lung CT images. In Dawant, B., & Haynor, D. (Eds.), Proceedings on SPIE Medical Imaging 2010: Image Processing, SPIE Bellingham, WA/USA, San Diego, CA/USA (Vol. 7623, 09-1–11).

Chou, P., & Pagano, N. (1992). Elasticity—Tensor, dyadic, and engineering approaches. Mineola, NY: Dover Publications, Inc.

Chui, H., & Rangarajan, A. (2003). A new point matching algorithm for non-rigid registration. Computer Vision and Image Understanding, 89(2–3), 114–141.CrossRefMATH

Clatz, O., Delingette, H., Talos, I.-F., Golby, A., Kikinis, R., Jolesz, F., et al. (2005). Robust nonrigid registration to capture brain shift from intraoperative MRI. IEEE Transactions on Medical Imaging, 24(11), 1417–1427.CrossRef

Crum, W., Hartkens, T., & Hill, D. (2004). Non-rigid image registration: theory and practice. British Journal of Radiology, 77(2), 140–153.CrossRef

Davis, M., Khotanzad, A., Flaming, D., & Harms, S. (1997). A physics-based coordinate transformation for 3D image matching. IEEE Transactions on Medical Imaging, 16(3), 317–328.CrossRef

Delhay, B., Clarysse, P., Pera, C., Magnin, I. (2006). A spatio-temporal deformation model for dense motion estimation in periodic cardiac image sequences. In Frangi, A., Delingette, H., & Stegmann, M. (Eds.), Proceedings on Workshop From Statistical Atlases to Personalized Models: Understanding Complex Diseases in Populations and Individuals, in conjunction with MICCAI’06, Copenhagen, Denmark (pp. 87–90).

Dowsey, A., Dunn, M., & Yang, G.-Z. (2003). The role of bioinformatics in two-dimensional gel electrophoresis. Proteomics, 3(8), 1567–1596.CrossRef

Fischer, B., & Modersitzki, J. (2004). Intensity based image registration with a guaranteed one-to-one point match. Methods of Information in Medicine, 43(4), 327–330.

Fornefett, M., Rohr, K., & Stiehl, H. (2001). Radial basis functions with compact support for elastic registration of medical images. Image and Vision Computing, 19(1–2), 87–96.CrossRef

Gee, J., Haynor, D., Reivich, M., & Bajcsy, R. (1994). Finite element approach to warping of brain images. In Loew, M. (Ed.), Proceedings on SPIE Medical Imaging 1994: Medical Imaging, SPIE Bellingham, WA/USA, Newport Beach, CA/USA (Vol. 2167, pp. 327– 337).

Glocker, B., Komodakis, N., Tziritas, G., Navab, N., & Paragios, N. (2008). Dense image registration through MRFs and efficient linear programming. Medical Image Analysis, 12(6), 731–741.CrossRef

Gorbunova, V., Durrleman, S., Lo, P., Pennec, X., de Bruijne, M. (2010). Lung CT registration combining intensity, curves and surfaces. In Niessen, W., & Meijering, E. (Eds.), Proceedings of 7th IEEE International Symposium on Biomedical Imaging: From Nano to Macro (ISBI’10), IEEE Computer Society, Rotterdam, The Netherlands (pp. 340–343).

Hartkens, T., Hill, D., Castellano-Smith, A., Hawkes, D., Maurer, C., Martin, A., et al. (2002). Using points and surfaces to improve voxel-based non-rigid registration. In Dohi, T., & Kikinis, R. (Eds.), Proceedings of Fifth International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI’02), Tokyo, Japan, Lecture Notes in Computer Science (Vol. 2489, pp. 565–572). Berlin: Springer.

Hellier, P., & Barillot, C. (2003). Coupling dense and landmark-based approaches for non rigid registration. IEEE Transactions on Medical Imaging, 22(2), 217–227.CrossRef

Holden, M. (2008). A review of geometric transformations for nonrigid body registration. IEEE Transactions on Medical Imaging, 27(1), 111–128.CrossRef

Hub, M., Kessler, M., & Karger, C. (2010). A stochastic approach to estimate the uncertainty involved in B-Spline image registration. IEEE Transactions on Medical Imaging, 28(11), 1708–1716.CrossRef

Johnson, H., & Christensen, G. (2002). Consistent landmark and intensity-based image registration. IEEE Transactions on Medical Imaging, 21(5), 450–461.CrossRef

Joshi, S., & Miller, M. (2000). Landmark matching via large deformation diffeomorphisms. IEEE Transactions on Image Processing, 9(8), 1357–1370.CrossRefMATHMathSciNet

Kabus, S., von Berg, J., Yamamoto, T., Opfer, R., Keall, P. (2008). Lung ventilation estimation based on 4D-CT imaging. In Brown, M., de Bruijne, M., van Ginneken, B., Kiraly, A., Kuhnigk, J., Lorenz, C., Mori, K., & Reinhardt, J. (Eds.), Proceedings on First International Workshop on Pulmonary Image Analysis, in conjunction with MICCAI’08, New York, NY/USA (pp. 73–82).

Kabus, S., Klinder, T., Murphy, K., van Ginneken, B., Lorenz, C., & Pluim, J. (2009). Evaluation of 4D-CT lung registration. In Yang, G., Hawkes, D., Rueckert, D., Noble, A., & Taylor, C. (Eds.), Proceedings on Twelfth International Conference on Medical Image Computing and puter-Assisted Intervention (MICCAI’09), London, UK, Lecture Notes in Computer Science (Vol. 5761, pp. 747–754). Berlin: Springer.

Kaus, M., Brock, K., Pekar, V., Dawson, L., Nichol, A., & Jaffray, D. (2007). Assessment of a model-based deformable image registration approach for radiation therapy planning. International Journal of Radiation Oncology Biology Physics, 68(2), 572–580.CrossRef

Klein, S., Staring, M., & Pluim, J. (2007). Evaluation of optimization methods for nonrigid medical image registration using mutual information and B-Splines. IEEE Transactions on Image Processing, 16(12), 2879–2890.CrossRefMathSciNet

Kohlrausch, J., Rohr, K., & Stiehl, H. (2005). A new class of elastic body splines for nonrigid registration of medical images. Journal of Mathematical Imaging and Vision, 23(3), 253–280.CrossRefMathSciNet

Kybic, J., & Unser, M. (2003). Fast parametric elastic registration. IEEE Transactions on Image Processing, 12(11), 1427–1442.CrossRef

Lu, H., Cattin, P., Nolte, L.-P., Reyes, M. (2011). Diffusion weighted imaging distortion correction using hybrid multimodal image registration. In Wright, S., Pan, X., & Liebling M. (Eds.), Proceedings on 8th IEEE International Symposium on Biomedical Imaging: From Nano to Macro (ISBI’11), IEEE Computer Society, Chicago, IL/USA (pp. 594–597).

Marquardt, D. (1963). An algorithm for least-squares estimation of nonlinear parameters. Journal of the Society for Industrial and Applied Mathematics, 11(2), 431–441.CrossRefMATHMathSciNet

Marsland, S., & Twining, C. (2004). Constructing diffeomorphic representations for the groupwise analysis of non-rigid registrations of medical images. IEEE Transactions on Medical Imaging, 23(8), 1006–1020.CrossRef

Meyer, C., Boes, J., Kim, B., Bland, P., Zasadny, K., Kison, P., et al. (1997). Demonstration of accuracy and clinical versatility of mutual information for automatic multimodality image fusion using affine and thin-plate spline warped geometric deformations. Medical Image Analysis, 1(3), 195–206.CrossRef

Murphy, K., van Ginneken, B., Klein, S., Staring, M., de Hoop, B., Viergever, M., et al. (2011). Semi-automatic construction of reference standards for evaluation of image registration. Medical Image Analysis, 15(1), 71–84.CrossRef

Osechinskiy, S., & Kruggel, F. (2011). Slice-to-volume nonrigid registration of histological sections to MR images of the human brain. Anatomy Research International, 287860, 17.

Papademetris, X., Jackowski, A., Schultz, R., Staib, L., & Duncan, J. (2004). Integrated intensity and point-feature nonrigid registration. In Barillot, C., Haynor, S., & Hellier, P. (Eds.), Proceedings of Seventh International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI’04), Rennes/Saint-Malo, France, Lecture Notes in Computer Science (Vol. 3216, pp. 763–770). Berlin: Springer.

Paquin, D., Levy, D., & Xing, L. (2007). Hybrid multiscale landmark and deformable image registration. Mathematical Biosciences and Engineering, 4(4), 711–737.CrossRefMATHMathSciNet

Park, H., Bland, P., Brock, K., & Meyer, C. (2004). Adaptive registration using local information measures. Medical Image Analysis, 8(4), 465–473.CrossRef

Pekar, V., Gladilin, E., & Rohr, K. (2006). An adaptive irregular grid approach for 3D deformable image registration. Physics in Medicine and Biology, 51(2), 361–377.CrossRef

Press, W., Flannery, B., Teukolsky, S., & Vetterling, W. (1992). Numerical Recipes in C. Cambridge, UK: Cambridge University Press.MATH

Rogers, M., & Graham, J. (2007). Robust and accurate registration of 2-D electrophoresis gels using point-matching. IEEE Transactions on Image Processing, 16(3), 624–635.CrossRefMathSciNet

Rohde, G., Aldroubi, A., & Dawant, B. (2003). The adaptive bases algorithm for intensity based nonrigid image registration. IEEE Transactions on Medical Imaging, 22(11), 1470–1479.CrossRef

Rohr, K., Stiehl, H., Sprengel, R., Buzug, T., Weese, J., & Kuhn, M. (2001). Landmark-based elastic registration using approximating thin-plate splines. IEEE Transactions on Medical Imaging, 20(6), 526–534.CrossRef

Rohr, K., Cathier, P., & Wörz, S. (2004). Elastic registration of electrophoresis images using intensity information and point landmarks. Pattern Recognition, 37(5), 1035–1048.CrossRefMATH

Rueckert, D., Sonoda, L., Hayes, C., Hill, D., Leach, M., & Hawkes, D. (1999). Non-rigid registration using free-form deformations: Application to breast MR images. IEEE Transactions on Medical Imaging, 18(8), 712–721.CrossRef

Sarrut, D., Boldea, V., Miguet, S., & Ginestet, C. (2006). Simulation of 4D CT images from deformable registration between inhale and exhale breath-hold CT. Medical Physics, 33(3), 605–617.CrossRef

Sato, M., Hassanien, A.-E., & Nakajima, M. (1999). Non-linear registration of medical images using Cauchy-Navier splines transformation. In Hansen, K. (Ed.), Proceedings on SPIE Medical Imaging 1999: Image processing, SPIE Bellingham, WA/USA, San Diego, CA/USA (Vol. 3661, pp. 774–781).

Šerifović-Trbalić, A., Demirović, D., Prljača, N., Szekely, G., & Cattin, P. (2006). Intensity-based elastic registration incorporating anisotropic landmark errors and rotational information. International Journal of CARS, 33(3), 605–617.

Škrinjar, O., Bistoquet, A., Oshinski, J., Sundareswaran, K., Frakes, D., Yoganathan, A. (2009). A divergence-free vector field model for imaging applications. In Karl, W., Rosen, B., & Brooks, D. (Eds.), Proceedings on 6th IEEE International Symposium on Biomedical Imaging: From Nano to Macro (ISBI’09), IEEE Computer Society, Boston, MA/USA (pp. 891–894).

Sorzano, C., Thévenaz, P., & Unser, M. (2005). Elastic registration of biological images using vector-spline regularization. IEEE Transactions on Biomedical Engineering, 52(4), 652–663.CrossRef

Sotiras, A., Ou, Y., Glocker, B., Davatzikos, C., & Paragios, N. (2010). Simultaneous geometric: Iconic registration. In Jiang, T., Navab, N., Pluim, J., & Viergever, M. (Eds.), Proceedings on Thirteenth International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI’10), Beijing, China, Lecture Notes in Computer Science (Vol. 6362, pp. 676–683). Berlin: Springer.

Stewart, C., Lee, Y.-L., & Tsai, C.-L. (2004). An uncertainty-driven hybrid of intensity-based and feature-based registration with application to retinal and lung CT images. In Barillot, C., Haynor, S., & Hellier, P. (Eds.), Proceedings on Seventh International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI’04), Rennes/Saint-Malo, France, Lecture Notes in Computer Science (Vol. 3216, pp. 870–877). Berlin: Springer.

Teng, C.-C., Shapiro, L., Kaler, I. (2006). Head and neck lymph node region delineation using a hybrid image registration method. In Kovac̆ević, J., & Meijering, E. (Eds.), Proceedings on 3rd IEEE International Symposium on Biomedical Imaging: From Nano to Macro (ISBI’06), IEEE Computer Society, Arlington, VA/USA (pp. 462–465).

Thévenaz, P., Ruttimann, U., & Unser, M. (1998). A pyramid approach to subpixel registration based on intensity. IEEE Transactions on Image Processing, 7(1), 27–41.CrossRef

Vandemeulebroucke, J., Sarrut, D., & Clarysse, P. (2007). The POPI-model, a point-validated pixel-based breathing thorax model. In Bissonette J. (Ed.), XVth International Conference on the Use of Computers in Radiation Therapy (ICCR) (Vol. 2, pp. 195–199). Toronto, Canada: Novel Digital Publishing.

Veeser, S., Dunn, M., & Yang, G. (2001). Multiresolution image registration for two-dimensional gel electrophoresis. Proteomics, 1(7), 856–870.CrossRef

Wang, X., & Feng, D. (2004). Automatic hybrid registration for 2-dimensional CT abdominal images. In Zhang, D. (Ed.), Proceedings on Third International Conference on Image and Graphics (ICIG’04), IEEE Computer Society, Hong Kong, China (pp. 208–211).

Wörz, S., Rohr, K. (2008a). Hybrid physics-based elastic image registration using approximating splines. In Reinhardt, J., & Pluim, J. (Eds.), Proceedings on SPIE Medical Imaging 2008: Image Processing, SPIE Bellingham, WA/USA, San Diego, CA/USA (Vol. 6914, pp. 0V1–8).

Wörz, S., & Rohr, K. (2008b). Physics-based elastic registration using non-radial basis functions and including landmark localization uncertainties. Computer Vision and Image Understanding, 111(3), 263–274.

Wörz, S., Winz, M.-L., Rohr, K. (2008). Geometric alignment of 2D gel electrophoresis images using physics-based elastic registration. In Olivo-Marin, J.-C. (Ed.), Proceedings on 5th IEEE Internat. Symposium on Biomedical Imaging: From Nano to Macro (ISBI’08), IEEE Computer Society, Paris, France (pp. 1135–1138).

Wu, G., Yap, P.-T., Kim, M., & Shen, D. (2010). TPS-HAMMER: Improving HAMMER Registration Algorithm by Soft Correspondence Matching and Thin-Plate Splines based Deformation Interpolation. NeuroImage, 49(3), 2225–2233.CrossRef

Yang, J., Williams, J., Sun, Y., Blum, R., & Xu, C. (2011). A robust hybrid method for nonrigid image registration. Pattern Recognition, 44(4), 764–776.CrossRefMATH

Zitova, B., & Flusser, J. (2003). Image registration methods: A survey. Image and Vision Computing, 21(11), 977–1000.CrossRef

Title: Spline-Based Hybrid Image Registration using Landmark and Intensity Information based on Matrix-Valued Non-radial Basis Functions
Authors: Stefan Wörz
Karl Rohr
Publication date: 01-01-2014
Publisher: Springer US
Published in: International Journal of Computer Vision / Issue 1/2014
Print ISSN: 0920-5691
Electronic ISSN: 1573-1405
DOI: https://doi.org/10.1007/s11263-013-0642-z

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Other articles of this Issue 1/2014

Detecting parametric objects in large scenes by Monte Carlo sampling

Appreciation to IJCV Reviewers

Accurate Junction Detection and Characterization in Natural Images

A Comprehensive Survey to Face Hallucination

Erratum to: Learning Vocabularies over a Fine Quantization

Sampling Minimal Subsets with Large Spans for Robust Estimation

Premium Partner