Abstract
We give a methodology-oriented perspective on directional image analysis and rotation-invariant processing. We review the state of the art in the field and make connections with recent mathematical developments in functional analysis and wavelet theory. We unify our perspective within a common framework using operators. The intent is to provide image-processing methods that can be deployed in algorithms that analyze biomedical images with improved rotation invariance and high directional sensitivity. We start our survey with classical methods such as directional-gradient and the structure tensor. Then, we discuss how these methods can be improved with respect to robustness, invariance to geometric transformations (with a particular interest in scaling), and computation cost. To address robustness against noise, we move forward to higher degrees of directional selectivity and discuss Hessian-based detection schemes. To present multiscale approaches, we explain the differences between Fourier filters, directional wavelets, curvelets, and shearlets. To reduce the computational cost, we address the problem of matching directional patterns by proposing steerable filters, where one might perform arbitrary rotations and optimizations without discretizing the orientation. We define the property of steerability and give an introduction to the design of steerable filters. We cover the spectrum from simple steerable filters through pyramid schemes up to steerable wavelets. We also present illustrations on the design of steerable wavelets and their application to pattern recognition.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Software available at http://bigwww.epfl.ch/demo/orientation/.
- 2.
Plugin available at http://fiji.sc/Frangi/.
- 3.
Available at http://eeweb.poly.edu/iselesni/WaveletSoftware/.
- 4.
Available at http://www.curvelet.org/.
- 5.
Available at http://www.shearlab.org/.
- 6.
- 7.
Available at http://www.math.uh.edu/~dlabate/software.html.
- 8.
Available at http://bigwww.epfl.ch/demo/monogenic/.
- 9.
Available at http://www-m6.ma.tum.de/Mamebia/MonogenicWaveletToolbox/.
References
Agam G, Armato S, Wu C (2005) Vessel tree reconstruction in thoracic CT scans with application to nodule detection. IEEE Trans Med Imaging 24(4):486–499
Aguet F, Geissbühler S, Märki I, Lasser T, Unser M (2009) Super-resolution orientation estimation and localization of fluorescent dipoles using 3-D steerable filters. Opt Express 17(8):6829–6848
Antoine JP, Murenzi R, Vandergheynst P (1999) Directional wavelets revisited: Cauchy wavelets and symmetry detection in patterns. Appl Comput Harmon Anal 6(3):314–345
Bernasconi P, Rust D, Hakim D (2005) Advanced automated solar filament detection and characterization code: description, performance, and results. Sol Phys 228(1–2):97–117
Bharath A, Ng J (2005) A steerable complex wavelet construction and its application to image denoising. IEEE Trans Image Process 14(7):948–959
Bigun J (1987) G.H.: Optimal orientation detection of linear symmetry. In: Proceedings of the first IEEE international conference on computer vision, London, pp 433–438
Bigun J, Bigun T, Nilsson K (2004) Recognition by symmetry derivatives and the generalized structure tensor. IEEE Trans Pattern Anal Mach Intell 26(12):1590–1605
Bodmann B, Kutyniok G, Zhuang X (2015) Gabor shearlets. Appl Comput Harmon Anal 38(1):87–114
Candès E, Donoho D (2004) New tight frames of curvelets and optimal representations of objects with piecewise C2 singularities. Commun Pure Appl Math 57(2):219–266
Candès E, Donoho D (2005) Continuous curvelet transform: I. Resolution of the wavefront set. Appl Comput Harmon Anal 19(2):162–197
Canny J (1986) A computational approach to edge detection. IEEE Trans Pattern Anal Mach Intell 8(6):679–698
Chaudhury K, Muñoz Barrutia A, Unser M (2010) Fast space-variant elliptical filtering using box splines. IEEE Trans Image Process 19(9):2290–2306
Chenouard N, Unser M (2012) 3D steerable wavelets in practice. IEEE Trans Image Process 21(11):4522–4533
Dan B, Ma AWK, Hároz EH, Kono J, Pasquali M (2012) Nematic-like alignment in SWNT thin films from aqueous colloidal suspensions. Ind Eng Chem Res 51(30):10232–10237
Daubechies I (1992) Ten lectures on wavelets, vol 61. SIAM, Philadelphia
Daugman J (1985) Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. J Opt Soc Am A 2(7):1160–1169
Daugman J (1988) Complete discrete 2D Gabor transforms by neural networks for image analysis and compression. IEEE Trans Acoust Speech Signal Process 36(7):1169–1179
Depeursinge A, Foncubierta-Rodriguez A, Van De Ville D, Müller H (2014a) Rotation-covariant texture learning using steerable Riesz wavelets. IEEE Trans Image Process 23(2):898–908
Depeursinge A, Kurtz C, Beaulieu C, Napel S, Rubin D (2014b) Predicting visual semantic descriptive terms from radiological image data: preliminary results with liver lesions in CT. IEEE Trans Med Imaging 33(8):1669–1676
Depeursinge A, Yanagawa M, Leung A, Rubin D (2015) Predicting adenocarcinoma recurrence using computational texture models of nodule components in lung ct. Med Phys 42(4):2054–2063
Do M, Vetterli M (2005) The contourlet transform: an efficient directional multiresolution image representation. IEEE Trans Image Process 14(12):2091–2106
Dong Y, Tao D, Li X, Ma J, Pu J (2015) Texture classification and retrieval using shearlets and linear regression. IEEE Trans Med Imaging 45(3):358–369
Dumic E, Grgic S, Grgic M (2014) IQM2: new image quality measure based on steerable pyramid wavelet transform and structural similarity index. Signal Image Video Process 8(6):1159–1168
Duval-Poo M, Odone F, De Vito E (2015) Edges and corners with shearlets. IEEE Trans Image Process 24(11):3768–3780. doi:10.1109/TIP.2015.2451175
Felsberg M, Sommer G (2001) The monogenic signal. IEEE Trans Signal Process 49(12):3136–3144
Fonck E, Feigl G, Fasel J, Sage D, Unser M, Rüfenacht D, Stergiopulos N (2008) Effect of ageing on elastin functionality in human cerebral arteries. In: Proceedings of the ASME 2008 summer bioengineering conference (SBC’08), Marco Island, FL, pp SBC2008–192,727–1/2
Förstner W (1986) A feature based correspondence algorithm for image matching. Int Arch Photogramm Remote Sens 26(3):150–166
Frangi A, Niessen W, Vincken K, Viergever M (1998) Multiscale vessel enhancement filtering. In: Medical image computing and computer-assisted intervention. Lecture notes in computer science, vol 1496. Springer, Berlin, pp 130–137
Franken E, Duits R (2009) Crossing-preserving coherence-enhancing diffusion on invertible orientation scores. Int J Comput Vis 85(3):253–278
Franken E, Duits R, ter Haar Romeny B (2007) Nonlinear diffusion on the 2D Euclidean motion group. In: Scale space and variational methods in computer vision. Springer, Berlin, pp 461–472
Freeman W, Adelson E (1990) Steerable filters for early vision, image analysis, and wavelet decomposition. In: Proceedings of the third international conference on computer vision. IEEE, New York, pp 406–415
Freeman W, Adelson E (1991) The design and use of steerable filters. IEEE Trans Pattern Anal Mach Intell 13(9):891–906
Freeman WT (1992) Steerable filters and local analysis of image structure. PhD thesis, Massachusetts Institute of Technology
Frikel J (2013) Sparse regularization in limited angle tomography. Appl Comput Harmon Anal 34(1):117–141
Gonzalez G, Fleurety F, Fua P (2009) Learning rotational features for filament detection. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition (CVPR’09). IEEE, New York, pp 1582–1589
Grohs P, Kutyniok G (2014) Parabolic molecules. Found Comput Math 14(2):299–337
Guo K, Labate D, Lim WQ (2009) Edge analysis and identification using the continuous shearlet transform. Appl Comput Harmon Anal 27(1):24–46
Hammond D, Vandergheynst P, Gribonval R (2011) Wavelets on graphs via spectral graph theory. Appl Comput Harmon Anal 30(2):129–150
Harris C, Stephens M (1988) A combined corner and edge detector. In: Proceedings of the fourth alvey vision conference, pp 147–151
Häuser S, Heise B, Steidl G (2014) Linearized Riesz transform and quasi-monogenic shearlets. Int J Wavelets Multiresolution Inf Process 12(03):1450027. doi:10.1142/S0219691314500271. http://www.worldscientific.com/doi/abs/10.1142/S0219691314500271
Heise B, Reinhardt M, Schausberger S, Häuser S, Bernstein S, Stifter D (2014) Fourier plane filtering revisited – analogies in optics and mathematics. Sampl Theory Signal Image Process 13(3):231–248
Held S, Storath M, Massopust P, Forster B (2010) Steerable wavelet frames based on the Riesz transform. IEEE Trans Image Process 19(3):653–667
Honnorat N, Vaillant R, Duncan J, Paragios N (2011) Curvilinear structures extraction in cluttered bioimaging data with discrete optimization methods. In: Proceedings of the eighth IEEE international symposium on biomedical imaging: from nano to macro (ISBI’11), IEEE, New York, pp 1353–1357
Hubel D, Wiesel T (1962) Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex. J Physiol 160(1):106–154
Jacob M, Unser M (2004) Design of steerable filters for feature detection using Canny-like criteria. IEEE Trans Pattern Anal Mach Intell 26(8):1007–1019
Jacob M, Blu T, Vaillant C, Maddocks J, Unser M (2006) 3-D shape estimation of DNA molecules from stereo cryo-electron micro-graphs using a projection-steerable snake. IEEE Trans Image Process 15(1):214–227
Jacovitti G, Neri A (2000) Multiresolution circular harmonic decomposition. IEEE Trans Signal Process 48(11):3242–3247
Jacques L, Duval L, Chaux C, Peyré G (2011) A panorama on multiscale geometric representations, intertwining spatial, directional and frequency selectivity. Signal Process 91(12):2699–2730
Jahne B (1997) Digital image processing: concepts, algorithms, and scientific applications, 4th edn. Springer, New York, Secaucus, NJ
Jiuxiang H, Razdan A, Femiani J, Ming C, Wonka P (2007) Road network extraction and intersection detection from aerial images by tracking road footprints. IEEE Trans Geosci Remote Sens 45(12):4144–4157
Karssemeijer N, te Brake G (1996) Detection of stellate distortions in mammograms. IEEE Trans Med Imaging 15(5):611–619
Kingsbury NG (1998) The dual-tree complex wavelet transform: a new technique for shift invariance and directional filters. In: Proceedings of 8th IEEE DSP workshop, Bryce Canyon, August 1998
Köthe U (2003) Edge and junction detection with an improved structure tensor. In: Pattern recognition. Lecture notes in computer science, vol 2781. Springer, Berlin, pp 25–32
Koethe U (2006) Low-level feature detection using the boundary tensor. In: Weickert J, Hagen H (eds) Visualization and processing of tensor fields, mathematics and visualization. Springer, Berlin, Heidelberg, pp 63–79
Kutyniok G (2012) Data separation by sparse representations. In: Compressed sensing: theory and applications. Cambridge University Press, Cambridge
Kutyniok G (2014) Geometric separation by single-pass alternating thresholding. Appl Comput Harmon Anal 36(1):23–50
Kutyniok G, Labate D (2009) Resolution of the wavefront set using continuous shearlets. Trans Am Math Soc 361(5):2719–2754
Kutyniok G, Labate D (2012) Shearlets: multiscale analysis for multivariate data. Birkhauser, Basel
Kutyniok G, Lim WQ, Reisenhofer R (2014) Shearlab 3D: faithful digital shearlet transforms based on compactly supported shearlets. arXiv:14025670
Labate D, Lim W, Kutyniok G, Weiss G (2005) Sparse multidimensional representation using shearlets. In: Proceedings of SPIE. Wavelets XI, San Diego, vol 5914. SPIE, Bellingham, pp 254–262
Lam B, Gao Y, Liew AC (2010) General retinal vessel segmentation using regularization-based multiconcavity modeling. IEEE Trans Med Imaging 29(7):1369–1381
Larkin K (2001) Natural demodulation of two-dimensional fringe patterns. II. stationary phase analysis of the spiral phase quadrature transform. J Opt Soc Am A 18:1871–1881
Larkin K, Bone DJ, Oldfield MA (2001) Natural demodulation of two-dimensional fringe patterns. I. general background of the spiral phase quadrature transform. J Opt Soc Am A 18:1862–1870
Lee T (1996) Image representation using 2D Gabor wavelets. IEEE Trans Pattern Anal Mach Intell 18(10):959–971
Lorenz C, Carlsen IC, Buzug T, Fassnacht C, Weese J (1997) Multi-scale line segmentation with automatic estimation of width, contrast and tangential direction in 2D and 3D medical images. In: Proceedings of the first joint conference computer vision, virtual reality and robotics in medicine and medical robotics and computer-assisted surgery CVRMed - MRCAS’97. Springer, Berlin, pp 233–242
Ma J, Plonka G (2010) The curvelet transform. IEEE Signal Process Mag 27(2):118–133
Mallat S (2008) A wavelet tour of signal processing: the sparse way. Academic Press, New York
Marr D, Hildreth E (1980) Theory of edge detection. Proc R Soc London Ser B 207(1167):187–217
Meijering E (2010) Neuron tracing in perspective. Cytometry A 77(7):693–704
Meijering E, Jacob M, Sarria JC, Steiner P, Hirling H, Unser M (2004) Design and validation of a tool for neurite tracing and analysis in fluorescence microscopy images. Cytometry Part A 58A(2):167–176
Olhede S, Metikas G (2009) The monogenic wavelet transform. IEEE Trans Signal Process 57(9):3426–3441
Olshausen B, Field D (1996) Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381:607–609
Pad P, Uhlmann V, Unser M (2014) VOW: Variance-optimal wavelets for the steerable pyramid. In: IEEE international conference on image processing (ICIP), pp 2973–2977
Patton N, Aslam T, MacGillivray T, Deary I, Dhillon B, Eikelboom R, Yogesan K, Constable I (2006) Retinal image analysis: concepts, applications and potential. Prog Retin Eye Res 25(1):99–127
Perona P (1992) Steerable-scalable kernels for edge detection and junction analysis. Image Vis Comput 10(10):663–672
Portilla J, Simoncelli E (2000) A parametric texture model based on joint statistics of complex wavelet coefficients. Int J Comput Vis 40(1):49–70
Püspöki Z, Unser M (2015) Template-free wavelet-based detection of local symmetries. IEEE Trans Image Process 24(10):3009–3018
Püspöki Z, Vonesch C, Unser M (2013) Detection of symmetric junctions in biological images using 2-D steerable wavelet transforms. In: Proceedings of the tenth IEEE international symposium on biomedical imaging: from nano to macro (ISBI’13), San Francisco, CA, pp 1488–1491
Püspöki Z, Uhlmann V, Vonesch C, Unser M (2016) Design of steerable wavelets to detect multifold junctions. IEEE Trans Image Process 25(2):643–657. http://bigwww.epfl.ch/publications/puespoeki1601.html
Rezakhaniha R, Agianniotis A, Schrauwen J, Griffa A, Sage D, Bouten C, van de Vosse F, Unser M, Stergiopulos N (2012) Experimental investigation of collagen waviness and orientation in the arterial adventitia using confocal laser scanning microscopy. Biomech Model Mechanobiol 11(3–4):461–473
Sandryhaila A, Moura J (2013) Discrete signal processing on graphs. IEEE Trans Signal Process 61(7):1644–1656
Sato Y, Nakajima S, Shiraga N, Atsumi H, Yoshida S, Koller T, Gerig G, Kikinis R (1998) Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images. Med Image Anal 2(2):143–168
Schmitter D, Delgado-Gonzalo R, Krueger G, Unser M (2014) Atlas-free brain segmentation in 3D proton-density-like MRI images. In: Proceedings of the IEEE international symposium on biomedical imaging: from nano to macro (ISBI), pp 629–632
Schuh M, Banda J, Bernasconi P, Angryk R, Martens P (2014) A comparative evaluation of automated solar filament detection. Sol Phys 289(7):2503–2524
Selesnick I, Baraniuk R, Kingsbury N (2005) The dual-tree complex wavelet transform. IEEE Signal Process Mag 22(6):123–151
Semler L, Dettori L (2006) Curvelet-based texture classification of tissues in computed tomography. In: Proceedings of the thirteenth IEEE international conference on image processing (ICIP’06), IEEE, New York, pp 2165–2168
Sherlock B, Monro D, Millard K (1994) Fingerprint enhancement by directional Fourier filtering. In: IEE proceedings on vision, image and signal processing, vol 141, pp 87–94
Shuman D, Narang S, Frossard P, Ortega A, Vandergheynst P (2013) The emerging field of signal processing on graphs: extending high-dimensional data analysis to networks and other irregular domains. IEEE Signal Process Mag 30(3):83–98
Simoncelli E, Farid H (1996) Steerable wedge filters for local orientation analysis. IEEE Trans Image Process 5(9):1377–1382
Simoncelli E, Freeman WT (1995) The steerable pyramid: a flexible architecture for multi-scale derivative computation. In: Proceedings of the second IEEE international conference on image processing (ICIP’95), vol 3. IEEE, New York, pp 444–447
Soulard R, Carre P, Fernandez-Maloigne C (2013) Vector extension of monogenic wavelets for geometric representation of color images. IEEE Trans Image Process 22(3):1070–1083
Starck JL, Candès E, Donoho D (2002) The curvelet transform for image denoising. IEEE Trans Image Process 11(6):670–684
Starck JL, Murtagh F, Candes E, Donoho D (2003) Gray and color image contrast enhancement by the curvelet transform. IEEE Trans Image Process 12(6):706–717
Storath M (2011a) Directional multiscale amplitude and phase decomposition by the monogenic curvelet transform. SIAM J Imaging Sci 4(1):57–78
Storath M (2011b) Separation of edges in X-Ray images by microlocal analysis. Proc Appl Math Mech 11(1):867–868
Storath M, Weinmann A, Unser M (2014) Unsupervised texture segmentation using monogenic curvelets and the Potts model. In: IEEE international conference on image processing (ICIP), pp 4348–4352
Storath M, Demaret L, Massopust P (2015) Signal analysis based on complex wavelet signs. Appl Comput Harmon Anal. doi:http://dx.doi.org/10.1016/j.acha.2015.08.005. http://www.sciencedirect.com/science/article/pii/S1063520315001086
Tupin F, Maitre H, Mangin J-F, Nicolas J-M, Pechersky E (1998) Detection of linear features in SAR images: application to road network extraction. IEEE Trans Geosci Remote Sens 36(2):434–453. doi:10.1109/36.662728
Unser M, Chenouard N (2013) A unifying parametric framework for 2D steerable wavelet transforms. SIAM J Imaging Sci 6(1):102–135
Unser M, Van De Ville D (2010) Wavelet steerability and the higher-order Riesz transform. IEEE Trans Image Process 19(3):636–652
Unser M, Sage D, Van De Ville D (2009) Multiresolution monogenic signal analysis using the Riesz-Laplace wavelet transform. IEEE Trans Image Process 18(11):2402–2418
Vandergheynst P, Gobbers JF (2002) Directional dyadic wavelet transforms: design and algorithms. IEEE Trans Image Process 11(4):363–372
Ward J, Unser M (2014) Harmonic singular integrals and steerable wavelets in \(l_{2}(\\^{d})\). Appl Comput Harmon Anal 36(2):183–197
Ward J, Chaudhury K, Unser M (2013) Decay properties of Riesz transforms and steerable wavelets. SIAM J Imaging Sci 6(2):984–998
Yi S, Labate D, Easley G, Krim H (2009) A shearlet approach to edge analysis and detection. IEEE Trans Image Process 18(5):929–941
Yuan Y, Shih F, Jing J, Wang H, Chae J (2011) Automatic solar filament segmentation and characterization. Sol Phys 272(1):101–117
Acknowledgements
The research leading to these results has received funding from the European Research Council under the European Union’s Seventh Framework Programme (FP7/2007-2013) / ERC grant agreement \(\mbox{ n}^{\circ }\) 267439. The work was also supported by the Hasler Foundation, and the Swiss National Foundation (grant number: 200020-162343).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Püspöki, Z., Storath, M., Sage, D., Unser, M. (2016). Transforms and Operators for Directional Bioimage Analysis: A Survey. In: De Vos, W., Munck, S., Timmermans, JP. (eds) Focus on Bio-Image Informatics. Advances in Anatomy, Embryology and Cell Biology, vol 219. Springer, Cham. https://doi.org/10.1007/978-3-319-28549-8_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-28549-8_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-28547-4
Online ISBN: 978-3-319-28549-8
eBook Packages: MedicineMedicine (R0)