Top

Advances in Manufacturing

Published in:

08-02-2021

A two-stage restoration of distorted underwater images using compressive sensing and image registration

Authors: Zhen Zhang, Yu-Gui Tang, Kuo Yang

Published in: Advances in Manufacturing | Issue 2/2021

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Imaging through a time-varying water surface exhibits severe non-rigid geometric distortions and motion blur. Theoretically, although the water surface possesses smoothness and temporal periodicity, random fluctuations are inevitable in an actual video sequence. Meanwhile, considering the distribution of information, the image structure contributes more to the restoration. In this paper, a new two-stage restoration method for distorted underwater video sequences is presented. During the first stage, salient feature points, which are selected through multiple methods, are tracked across the frames, and the motion fields at all pixels are estimated using a compressive sensing solver to remove the periodic distortions. During the second stage, the combination of a guided filter algorithm and an image registration method is applied to remove the structural-information-oriented residual distortions. Finally, the experiment results show that the method outperforms other state-of-the-art approaches in terms of the recovery effect and time.

previous article Towards understanding the microstructure and temperature rule in large strain extrusion machining

next article Experimental and numerical investigation of the abrasive waterjet machining of aluminum-7075-T6 for aerospace applications

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Gilles J, Osher S (2016) Wavelet burst accumulation for turbulence mitigation. J Electron Imaging 25(3):033003CrossRef

Panetta K, Gao C, Agaian S (2015) Human-visual-system-inspired underwater image quality measures. IEEE J Ocean Eng 41(3):541–551CrossRef

Paul N, De Chillaz A, Collette J (2015) On-line restoration for turbulence degraded video in nuclear power plant reactors. Signal Image Video Process 9(3):601–610CrossRef

Turlaev DG, Dolin LS (2013) On observing underwater objects through a wavy water surface: a new algorithm for image correction and laboratory experiment. Izvestiya Atmos Ocean Phys 49(3):339–345CrossRef

Zhang Z, Yang X (2019) Bio-inspired motion planning for reaching movement of a manipulator based on intrinsic tau jerk guidance. Adv Manuf 7:315–325CrossRef

Holohan ML, Dainty JC (1997) Low-order adaptive optics: a possible use in underwater imaging? Opt Laser Technol 29(1):51–55CrossRef

Murase H (1992) Surface shape reconstruction of a nonrigid transparent object using refraction and motion. IEEE Trans Pattern Anal Mach Intell 14:1045–1052CrossRef

Seemakurthy K, Rajagopalan AN (2015) Deskewing of underwater images. IEEE Trans Image Process 24(3):1046–1059MathSciNetCrossRef

Tian Y, Narasimhan SG (2009) Seeing through water: image restoration using model-based tracking. In: Proceedings of the IEEE 12th international conference on computer vision. IEEE, Kyoto, pp 2303–2310

10.

Cox C, Munk W (1956) Slopes of the sea surface deduced from photographs of sun glitter. Bull Scripps Inst Oceanogr 6:401–479

11.

Efros A, Isler V, Shi J et al (2004) Seeing through water. In: Proceedings of conference and workshop on neural information processing systems. Neural Information Processing Systems Foundation, Vancouver, pp 393–400

12.

Donate A, Dahme G, Ribeiro E (2006) Classification of textures distorted by water waves. In: Proceedings of international conference on pattern recognition. IEEE, Hong Kong, pp 421–424

13.

Donate A, Ribeiro E (2006) Improved reconstruction of images distorted by water waves. In: Advances in computer graphics and computer vision. Springer, Berlin, pp 264–277

14.

Wen Z, Lambert A, Fraser D et al (2010) Bispectral analysis and recovery of images distorted by a moving water surface. Appl Opt 49(33):6376–6384CrossRef

15.

Kanaev AV, Ackerman J, Fleet E et al (2009) Imaging through the air-water interface. In: Proceedings of computational optical sensing and imaging. OSA, San Jose, pp 13–15

16.

Kanaev AV, Hou W, Restaino SR et al (2015) Restoration of images degraded by underwater turbulence using structure tensor oriented image quality (STOIQ) metric. Opt Express 23(13):17077–17090CrossRef

17.

Kanaev AV, Hou W, Restaino SR et al (2014) Correction methods for underwater turbulence degraded imaging. In: Proceedings of remote sensing of clouds and the atmosphere XIX; and optics in atmosphereic propagation and adaptive systems XVII. Proc. SPIE, 92421P

18.

Zhang R, He D, Li Y et al (2018) Synthetic imaging through wavy water surface with centroid evolution. Opt Express 26(20):26009–26019CrossRef

19.

Lau CP, Lai YH, Lui LM (2019) Variational models for joint subsampling and reconstruction of turbulence-degraded images. J Sci Comput 78(3):1488–1525MathSciNetCrossRef

20.

Lau CP, Lai YH, Lui LM (2019) Reconstruction of atmospheric turbulence-distorted images via RPCA and quasiconformal maps. Inverse Probl 35(7):074002CrossRef

21.

Oreifej O, Guang S, Pace T et al (2011) A two-stage reconstruction approach for seeing through water. In: Proceedings of IEEE conference on computer vision and pattern recognition. IEEE, Colorado, pp 1153–1160

22.

Halder KK, Paul M, Tahtali M et al (2017) Correction of geometrically distorted underwater images using shift map analysis. J Opt Soc Am A 34(4):666–673CrossRef

23.

Zhang Z, Yang X (2019) Reconstruction of distorted underwater images using robust registration. Opt Express 27(7):9996–10008CrossRef

24.

Li Z, Murez Z, Kriegman D et al (2018) Learning to see through turbulent water. In: Proceedings of 2018 IEEE winter conference on applications of computer vision. IEEE, Lake Tahoe, pp 512–520

25.

Lau CP, Yung CP, Lui LM (2018) Image retargeting via beltrami representation. IEEE Trans Image Process 27(12):5787–5801MathSciNetCrossRef

26.

James JG, Agrawal P, Rajwade A (2019) Restoration of non-rigidly distorted underwater image using a combination of compressive sensing and local polynomial image representations. In: Proceedings of the IEEE international conference on computer vision. IEEE, Seoul, pp 7839–7848

27.

He K, Sun J, Tang X (2012) Guided image filtering. IEEE Trans Pattern Anal Mach Intell 35(6):1397–1409CrossRef

28.

Bay H, Tuytelaars T, Van GL (2006) Surf: speeded up robust features. In: Proceedings of European conference on computer vision. Graz, pp 404–417

29.

Rosten E, Porter R, Drummond T (2008) Faster and better: a machine learning approach to corner detection. IEEE Trans Pattern Anal Mach Intell 32(1):105–119CrossRef

30.

Leutenegger S, Chli M, Siegwart RY (2011) BRISK: Binary robust invariant scalable keypoints. In: Proceedings of international conference on computer vision. IEEE, Barcelona, pp 2548–2555

31.

Nam T, Kim S, Jung D (2019) Hardware implementation of KLT tracker for real-time intruder dectection and tracking using on-board camera. Int J Aeronaut Space Sci 20(1):300–314CrossRef

32.

Nakanishi-Ohno Y, Hukushima K (2018) Data-driven diagnosis for compressed sensing with cross validation. Phys Rev E 98(5):052120CrossRef

33.

Sun T, Tang YG, Zhang Z (2019) Structural information reconstruction of distorted underwater images using image registration. Appl Sci 10(16):5670CrossRef

34.

Rueckert D, Sonoda LI, Hayes C et al (1999) Nonrigid registration using freeform deformations: application to breast MR images. IEEE Trans Med Imaging 18(8):712–721CrossRef

35.

Berdinsky D, Kim TW, Cho D et al (2015) Based of T-meshes and the refinement of hierarchical B-splines. Comput Methods Appl Mech Eng 283:841–855CrossRef

36.

Xue W, Zhang L, Mou XQ et al (2013) Gradient magnitude similarity deviation: a highly efficient perceptual image quality index. IEEE Trans Image Process 23(2):684–695MathSciNetCrossRef

37.

Zhang L, Zhang L, Mou XQ et al (2011) FSIM: a feature similarity index for image quality assessment. IEEE Trans Image Process 20(8):2378–2386MathSciNetCrossRef

Title: A two-stage restoration of distorted underwater images using compressive sensing and image registration
Authors: Zhen Zhang
Yu-Gui Tang
Kuo Yang
Publication date: 08-02-2021
Publisher: Shanghai University
Published in: Advances in Manufacturing / Issue 2/2021
Print ISSN: 2095-3127
Electronic ISSN: 2195-3597
DOI: https://doi.org/10.1007/s40436-020-00340-z

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Other articles of this Issue 2/2021

Multi-verse optimizer based parameters decision with considering tool life in dry hobbing process

Thermal error modeling based on BiLSTM deep learning for CNC machine tool

Precision micro-milling process: state of the art

Experimental and numerical investigation of the abrasive waterjet machining of aluminum-7075-T6 for aerospace applications

Prediction of product roughness, profile, and roundness using machine learning techniques for a hard turning process

Towards understanding the microstructure and temperature rule in large strain extrusion machining

Premium Partners