Skip to main content

2015 | OriginalPaper | Buchkapitel

Feature-Preserving Image Restoration from Adaptive Triangular Meshes

verfasst von : Ke Liu, Ming Xu, Zeyun Yu

Erschienen in: Computer Vision - ACCV 2014 Workshops

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The triangulation of images has become an active research area in recent years for its compressive representation and ease of image processing and visualization. However, little work has been done on how to faithfully recover image intensities from a triangulated mesh of an image, a process also known as image restoration or decoding from meshes. The existing methods such as linear interpolation, least-square interpolation, or interpolation based on radial basis functions (RBFs) work to some extent, but often yield blurred features (edges, corners, etc.). The main reason for this problem is due to the isotropically-defined Euclidean distance that is taken into consideration in these methods, without considering the anisotropicity of feature intensities in an image. Moreover, most existing methods use intensities defined at mesh nodes whose intensities are often ambiguously defined on or near image edges (or feature boundaries). In the current paper, a new method of restoring an image from its triangulation representation is proposed, by utilizing anisotropic radial basis functions (ARBFs). This method considers not only the geometrical (Euclidean) distances but also the local feature orientations (anisotropic intensities). Additionally, this method is based on the intensities of mesh faces instead of mesh nodes and thus provides a more robust restoration. The two strategies together guarantee excellent feature-preserving restoration of an image with arbitrary super-resolutions from its triangulation representation, as demonstrated by various experiments provided in the paper.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Adams, M.: An efficient progressive coding method for arbitrarily-sampled image data. IEEE Signal Process. Lett. 15, 629–632 (2008)CrossRef Adams, M.: An efficient progressive coding method for arbitrarily-sampled image data. IEEE Signal Process. Lett. 15, 629–632 (2008)CrossRef
2.
Zurück zum Zitat Adams, M.: Progressive lossy-to-lossless coding of arbitrarily-sampled image data using the modified scattered data coding method. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, Taipei, Taiwan, pp. 1017–1020 (2009) Adams, M.: Progressive lossy-to-lossless coding of arbitrarily-sampled image data using the modified scattered data coding method. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, Taipei, Taiwan, pp. 1017–1020 (2009)
3.
Zurück zum Zitat Adams, M.: A flexible content-adaptive mesh-generation strategy for image representation. IEEE Trans. Image Process. 20, 2414–2427 (2011)CrossRefMathSciNet Adams, M.: A flexible content-adaptive mesh-generation strategy for image representation. IEEE Trans. Image Process. 20, 2414–2427 (2011)CrossRefMathSciNet
4.
Zurück zum Zitat Adams, M.: A highly-effective incremental/decremental Delaunay mesh-generation strategy for image representation. Signal Process. 93, 749–764 (2013)CrossRef Adams, M.: A highly-effective incremental/decremental Delaunay mesh-generation strategy for image representation. Signal Process. 93, 749–764 (2013)CrossRef
5.
Zurück zum Zitat Aizawa, K., Huang, T.: Model-based image coding: advanced video coding techniques for very low bit-rate applications. Proc. IEEE 83, 259–271 (1995)CrossRef Aizawa, K., Huang, T.: Model-based image coding: advanced video coding techniques for very low bit-rate applications. Proc. IEEE 83, 259–271 (1995)CrossRef
6.
Zurück zum Zitat Altunbasak, Y., Tekalp, A.: Closed-form connectivity-preserving solutions for motion compensation using 2-d meshes. IEEE Trans. Image Process. 6(533), 1255–1269 (1997)CrossRef Altunbasak, Y., Tekalp, A.: Closed-form connectivity-preserving solutions for motion compensation using 2-d meshes. IEEE Trans. Image Process. 6(533), 1255–1269 (1997)CrossRef
7.
Zurück zum Zitat Benoit-Cattin, H., Joachimsmann, P., Planat, A., Valette, S., Baskurt, A., Prost, R.: Active mesh texture coding based on warping and DCT. In: IEEE International Conference on Image Processing, Kobe, Japan (1999) Benoit-Cattin, H., Joachimsmann, P., Planat, A., Valette, S., Baskurt, A., Prost, R.: Active mesh texture coding based on warping and DCT. In: IEEE International Conference on Image Processing, Kobe, Japan (1999)
8.
Zurück zum Zitat Brankov, J., Yang, Y., Galatsanos, N.: Image restoration using content-adaptive mesh modeling. In: Proceedings of IEEE International Conference on Image Processing, vol. 2, pp. 997–1000 (2003) Brankov, J., Yang, Y., Galatsanos, N.: Image restoration using content-adaptive mesh modeling. In: Proceedings of IEEE International Conference on Image Processing, vol. 2, pp. 997–1000 (2003)
9.
Zurück zum Zitat Brankov, J., Yang, Y., Wernick, M.: Tomographic image reconstruction based on a content-adaptive mesh model. IEEE Trans. Med. Imaging 23, 202–212 (2004)CrossRef Brankov, J., Yang, Y., Wernick, M.: Tomographic image reconstruction based on a content-adaptive mesh model. IEEE Trans. Med. Imaging 23, 202–212 (2004)CrossRef
10.
Zurück zum Zitat Casciola, G., Lazzaro, D., Montefusco, L., Morigi, S.: Shape preserving surface reconstruction using locally anisotropic RBF interpolants. Comput. Math. Appl. 51, 1185–1198 (2006)CrossRefMATHMathSciNet Casciola, G., Lazzaro, D., Montefusco, L., Morigi, S.: Shape preserving surface reconstruction using locally anisotropic RBF interpolants. Comput. Math. Appl. 51, 1185–1198 (2006)CrossRefMATHMathSciNet
11.
Zurück zum Zitat Casciola, G., Montefusco, L., Morigi, S.: The regularizing properties of anisotropic radial basis functions. Appl. Math. Comput. 190, 1050–1062 (2007)CrossRefMATHMathSciNet Casciola, G., Montefusco, L., Morigi, S.: The regularizing properties of anisotropic radial basis functions. Appl. Math. Comput. 190, 1050–1062 (2007)CrossRefMATHMathSciNet
12.
Zurück zum Zitat Casciola, G., Montefusco, L., Morigi, S.: Edge-driven image interpolation using adaptive anisotropic radial basis functions. J. Math. Imaging Vis. 36, 125–139 (2010)CrossRefMathSciNet Casciola, G., Montefusco, L., Morigi, S.: Edge-driven image interpolation using adaptive anisotropic radial basis functions. J. Math. Imaging Vis. 36, 125–139 (2010)CrossRefMathSciNet
13.
Zurück zum Zitat Chen, J., Paris, S., Wang, J., Matusik, W., Cohen, M., Durand, F.: The video mesh: A data structure for image-based three-dimensional video editing. In: IEEE International Conference on Computational Photography (ICCP), Pittsburgh, PA, USA, pp. 1–8 (2011) Chen, J., Paris, S., Wang, J., Matusik, W., Cohen, M., Durand, F.: The video mesh: A data structure for image-based three-dimensional video editing. In: IEEE International Conference on Computational Photography (ICCP), Pittsburgh, PA, USA, pp. 1–8 (2011)
14.
Zurück zum Zitat Coleman, S., Scotney, B., Herron, M.: Image feature detection on content-based meshes. In: Proceedings of IEEE International Conference on Image Processing, vol. 1, pp. 844–847 (2002) Coleman, S., Scotney, B., Herron, M.: Image feature detection on content-based meshes. In: Proceedings of IEEE International Conference on Image Processing, vol. 1, pp. 844–847 (2002)
15.
Zurück zum Zitat Davoine, F., Antonini, M., Chassery, J., Barlaud, M.: Fractal image compression based on Delaunay triangulation and vector quantization. IEEE Trans. Image Process. 5, 338–346 (1996)CrossRef Davoine, F., Antonini, M., Chassery, J., Barlaud, M.: Fractal image compression based on Delaunay triangulation and vector quantization. IEEE Trans. Image Process. 5, 338–346 (1996)CrossRef
16.
Zurück zum Zitat Delaunay, B.: Sur la sphere vide. Classe des Science Mathematics et Naturelle 7, 793–800 (1934) Delaunay, B.: Sur la sphere vide. Classe des Science Mathematics et Naturelle 7, 793–800 (1934)
17.
Zurück zum Zitat Demaret, L., Robert, G., Laurent, N., Buisson, A.: Scalable image coder mixing DCT and triangular meshes. In: IEEE International Conference on Image Processing, Vancouver, BC, Canada, vol. 3, pp. 849–852 (2000) Demaret, L., Robert, G., Laurent, N., Buisson, A.: Scalable image coder mixing DCT and triangular meshes. In: IEEE International Conference on Image Processing, Vancouver, BC, Canada, vol. 3, pp. 849–852 (2000)
18.
Zurück zum Zitat Divo, E., Kassab, A.: An efficient localized RBF meshless method for fluid flow and conjugate hear transfer. ASME J. Heat Transfer 129, 124–136 (2007)CrossRef Divo, E., Kassab, A.: An efficient localized RBF meshless method for fluid flow and conjugate hear transfer. ASME J. Heat Transfer 129, 124–136 (2007)CrossRef
19.
Zurück zum Zitat Garcia, M., Vintimilla, B.: Acceleration of filtering and enhancement operations through geometric processing of gray-level images. In: IEEE International Conference on Image Processing, Vancouver, BC, Canada, vol. 1, pp. 97–100 (2000) Garcia, M., Vintimilla, B.: Acceleration of filtering and enhancement operations through geometric processing of gray-level images. In: IEEE International Conference on Image Processing, Vancouver, BC, Canada, vol. 1, pp. 97–100 (2000)
20.
Zurück zum Zitat Garland, M., Heckbert, P.: Fast polygonal approximation of terrains and height fields. Technical Report CMU-CS-95-181, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA (1995) Garland, M., Heckbert, P.: Fast polygonal approximation of terrains and height fields. Technical Report CMU-CS-95-181, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA (1995)
21.
Zurück zum Zitat Guo, Y., Liu, F., Shi, J., Zhou, Z., Gleicher, M.: Image retargeting using mesh parametrization. IEEE Trans. Multimedia 11, 856–867 (2009)CrossRef Guo, Y., Liu, F., Shi, J., Zhou, Z., Gleicher, M.: Image retargeting using mesh parametrization. IEEE Trans. Multimedia 11, 856–867 (2009)CrossRef
22.
Zurück zum Zitat Hsu, P., Liu, K., Chen, T.: A low bit-rate video codec based on two-dimensional mesh motion compensation with adaptive interpolation. IEEE Trans. Circuits Syst. Video Technol. 11, 111–117 (2001)CrossRef Hsu, P., Liu, K., Chen, T.: A low bit-rate video codec based on two-dimensional mesh motion compensation with adaptive interpolation. IEEE Trans. Circuits Syst. Video Technol. 11, 111–117 (2001)CrossRef
23.
Zurück zum Zitat Hung, K., Chang, C.: New irregular sampling coding method for transmitting images progressively. In: IEEE Proceedings of Vision, Image and Signal Processing, vol. 150, pp. 44–50 (2003) Hung, K., Chang, C.: New irregular sampling coding method for transmitting images progressively. In: IEEE Proceedings of Vision, Image and Signal Processing, vol. 150, pp. 44–50 (2003)
24.
Zurück zum Zitat Kosec, G., Sarler, B.: Local RBF collocation method for Darcy flow. Comput. Model. Eng. Sci. 25, 197–208 (2008) Kosec, G., Sarler, B.: Local RBF collocation method for Darcy flow. Comput. Model. Eng. Sci. 25, 197–208 (2008)
25.
Zurück zum Zitat Lechat, P., Sanson, H., Labelle, L.: Image approximation by minimization of a geometric distance applied to a 3-D finite elements based model. In: Proceedings of IEEE International Conference on Image Processing, vol. 2, pp. 724–727 (1997) Lechat, P., Sanson, H., Labelle, L.: Image approximation by minimization of a geometric distance applied to a 3-D finite elements based model. In: Proceedings of IEEE International Conference on Image Processing, vol. 2, pp. 724–727 (1997)
26.
Zurück zum Zitat Li, P., Adams, M.: A tuned mesh-generation strategy for image representation based on data-dependent triangulation. IEEE Trans. Image Process. 22, 2004–2018 (2013)CrossRefMathSciNet Li, P., Adams, M.: A tuned mesh-generation strategy for image representation based on data-dependent triangulation. IEEE Trans. Image Process. 22, 2004–2018 (2013)CrossRefMathSciNet
27.
Zurück zum Zitat Marquant, G., Pateux, S., Labit, C.: Mesh and “crack lines”: application to object-based motion estimation and higher scalability. In: IEEE International Conference on Image Processing, Vancouver, BC, Canada, vol. 2, pp. 554–557 (2000) Marquant, G., Pateux, S., Labit, C.: Mesh and “crack lines”: application to object-based motion estimation and higher scalability. In: IEEE International Conference on Image Processing, Vancouver, BC, Canada, vol. 2, pp. 554–557 (2000)
28.
Zurück zum Zitat Nosratinia, A.: New kernels for fast mesh-based motion estimation. IEEE Trans. Circuits Syst. Video Technol. 11, 40–51 (2001)CrossRef Nosratinia, A.: New kernels for fast mesh-based motion estimation. IEEE Trans. Circuits Syst. Video Technol. 11, 40–51 (2001)CrossRef
29.
Zurück zum Zitat Petrou, M., Piroddi, R., Talebpour, A.: Texture recognition from sparsely and irregularly sampled data. Comput. Vis. Image Underst. 102, 95–104 (2006)CrossRef Petrou, M., Piroddi, R., Talebpour, A.: Texture recognition from sparsely and irregularly sampled data. Comput. Vis. Image Underst. 102, 95–104 (2006)CrossRef
30.
Zurück zum Zitat Ramponi, G., Carrato, S.: An adaptive irregular sampling algorithm and its application to image coding. Image Vis. Comput. 19, 451–460 (2001)CrossRef Ramponi, G., Carrato, S.: An adaptive irregular sampling algorithm and its application to image coding. Image Vis. Comput. 19, 451–460 (2001)CrossRef
31.
Zurück zum Zitat Rippa, S.: Adaptive approximation by piecewise linear polynomials on triangulations of subsets of scattered data. SIAM J. Sci. Stat. Comput. 13, 1123–1141 (1992)CrossRefMATHMathSciNet Rippa, S.: Adaptive approximation by piecewise linear polynomials on triangulations of subsets of scattered data. SIAM J. Sci. Stat. Comput. 13, 1123–1141 (1992)CrossRefMATHMathSciNet
32.
Zurück zum Zitat Sarkis, M., Diepold, K.: A fast solution to the approximation of 3-D scattered point data from stereo images using triangular meshes. In: Proceedings of IEEE-RAS International Conference on Humanoid Robots, Pittsburgh, PA, USA, pp. 235–241 (2007) Sarkis, M., Diepold, K.: A fast solution to the approximation of 3-D scattered point data from stereo images using triangular meshes. In: Proceedings of IEEE-RAS International Conference on Humanoid Robots, Pittsburgh, PA, USA, pp. 235–241 (2007)
33.
Zurück zum Zitat Sarler, B., Vertnik, R.: Meshfree explicit local radial basis function collocation method for diffusion problems. Comput. Math. Appl. 51, 1269–1282 (2006)CrossRefMATHMathSciNet Sarler, B., Vertnik, R.: Meshfree explicit local radial basis function collocation method for diffusion problems. Comput. Math. Appl. 51, 1269–1282 (2006)CrossRefMATHMathSciNet
34.
Zurück zum Zitat Singh, A., Terzopoulos, D., Goldgof, D.: Deformable models in medical image analysis. IEEE Computer Society Press (1998) Singh, A., Terzopoulos, D., Goldgof, D.: Deformable models in medical image analysis. IEEE Computer Society Press (1998)
36.
Zurück zum Zitat Su, D., Willis, P.: Demosaicing of color images using pixel level data-dependent triangulation. In: Proceedings of Theory and Practice of Computer Graphics, pp. 16–23 (2003) Su, D., Willis, P.: Demosaicing of color images using pixel level data-dependent triangulation. In: Proceedings of Theory and Practice of Computer Graphics, pp. 16–23 (2003)
37.
Zurück zum Zitat Su, D., Willis, P.: Image interpolation by pixel-level data-dependent triangulation. Comput. Graph. Forum 23, 189–201 (2004)CrossRef Su, D., Willis, P.: Image interpolation by pixel-level data-dependent triangulation. Comput. Graph. Forum 23, 189–201 (2004)CrossRef
38.
Zurück zum Zitat Toklu, C., Tekalp, A., Erdem, A.: Semi-automatic video object segmentation in the presence of occlusion. IEEE Trans. Circuits Syst. Video Technol. 10, 624–629 (2000)CrossRef Toklu, C., Tekalp, A., Erdem, A.: Semi-automatic video object segmentation in the presence of occlusion. IEEE Trans. Circuits Syst. Video Technol. 10, 624–629 (2000)CrossRef
39.
Zurück zum Zitat Tu, X., Adams, M.: Improved mesh models of images through the explicit representation of discontinuities. Can. J. Electr. Comput. Eng. 36, 78–86 (2013)CrossRef Tu, X., Adams, M.: Improved mesh models of images through the explicit representation of discontinuities. Can. J. Electr. Comput. Eng. 36, 78–86 (2013)CrossRef
40.
Zurück zum Zitat Vertnik, R., Sarler, B.: Meshless local radial basis function collocation method for convective-diffusive solid-liquid phase change problems. Int. J. Numer. Meth. Heat Fluid Flow 16, 617–640 (2006)CrossRefMATHMathSciNet Vertnik, R., Sarler, B.: Meshless local radial basis function collocation method for convective-diffusive solid-liquid phase change problems. Int. J. Numer. Meth. Heat Fluid Flow 16, 617–640 (2006)CrossRefMATHMathSciNet
41.
Zurück zum Zitat Vertnik, R., Sarler, B.: Solution of incompressible turbulent flow by a mesh-free method. Comput. Model. Eng. Sci. 44, 65–95 (2009)MathSciNet Vertnik, R., Sarler, B.: Solution of incompressible turbulent flow by a mesh-free method. Comput. Model. Eng. Sci. 44, 65–95 (2009)MathSciNet
42.
Zurück zum Zitat Wang, J., Liu, G.: On the optimal shape parameters of radial basis functions used for 2-d meshless methods. Comput. Methods Appl. Mech. Eng. 191, 2611–2630 (2002)CrossRefMATH Wang, J., Liu, G.: On the optimal shape parameters of radial basis functions used for 2-d meshless methods. Comput. Methods Appl. Mech. Eng. 191, 2611–2630 (2002)CrossRefMATH
43.
Zurück zum Zitat Wang, Y., Lee, O.: Active mesh - a feature seeking and tracking image sequence representation scheme. IEEE Trans. Image Process. 3, 610–624 (1994)CrossRef Wang, Y., Lee, O.: Active mesh - a feature seeking and tracking image sequence representation scheme. IEEE Trans. Image Process. 3, 610–624 (1994)CrossRef
44.
Zurück zum Zitat Wang, Y., Lee, O., Vetro, A.: Use of 2-D deformable mesh structures for video coding, part II-the analysis problem and a region-based coder employing an active mesh representation. IEEE Trans. Circuits Syst. Video Technol. 6, 647–659 (1996)CrossRef Wang, Y., Lee, O., Vetro, A.: Use of 2-D deformable mesh structures for video coding, part II-the analysis problem and a region-based coder employing an active mesh representation. IEEE Trans. Circuits Syst. Video Technol. 6, 647–659 (1996)CrossRef
45.
Zurück zum Zitat Yang, Y., Miles, N., Jovan, G.: A fast approach for accurate content-adaptive mesh generation. IEEE Trans. Image Process. 12, 866–881 (2003)CrossRefMATHMathSciNet Yang, Y., Miles, N., Jovan, G.: A fast approach for accurate content-adaptive mesh generation. IEEE Trans. Image Process. 12, 866–881 (2003)CrossRefMATHMathSciNet
Metadaten
Titel
Feature-Preserving Image Restoration from Adaptive Triangular Meshes
verfasst von
Ke Liu
Ming Xu
Zeyun Yu
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-16631-5_3