nach oben

Artificial Intelligence Review

Erschienen in:

04.09.2021

A comprehensive survey of recent trends in deep learning for digital images augmentation

verfasst von: Nour Eldeen Khalifa, Mohamed Loey, Seyedali Mirjalili

Erschienen in: Artificial Intelligence Review | Ausgabe 3/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Deep learning proved its efficiency in many fields of computer science such as computer vision, image classifications, object detection, image segmentation, and more. Deep learning models primarily depend on the availability of huge datasets. Without the existence of many images in datasets, different deep learning models will not be able to learn and produce accurate models. Unfortunately, several fields don't have access to large amounts of evidence, such as medical image processing. For example. The world is suffering from the lack of COVID-19 virus datasets, and there is no benchmark dataset from the beginning of 2020. This pandemic was the main motivation of this survey to deliver and discuss the current image data augmentation techniques which can be used to increase the number of images. In this paper, a survey of data augmentation for digital images in deep learning will be presented. The study begins and with the introduction section, which reflects the importance of data augmentation in general. The classical image data augmentation taxonomy and photometric transformation will be presented in the second section. The third section will illustrate the deep learning image data augmentation. Finally, the fourth section will survey the state of the art of using image data augmentation techniques in the different deep learning research and application.

Vorheriger Artikel An optimized system of GMDH-ANFIS predictive model by ICA for estimating pile bearing capacity

Nächster Artikel Attention-based neural joint source-channel coding of text for point to point and broadcast channel

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Alqahtani H, Kavakli-Thorne M, Kumar G (2019) Applications of generative adversarial networks (GANs): an updated review. Arch Comput Methods Eng. https://doi.org/10.1007/s11831-019-09388-yCrossRef

Bargoti S, Underwood J (2017) “Deep fruit detection in orchards,” in 2017 IEEE International Conference on Robotics and Automation (ICRA), May 2017, pp 3626–3633 https://doi.org/10.1109/ICRA.2017.7989417

Baştanlar Y, Özuysal M (2014) Introduction to machine learning. Methods Mol Biol. https://doi.org/10.1007/978-1-62703-748-8_7CrossRef

Boominathan L, Kruthiventi SSS, and Venkatesh Babu R (2016) CrowdNet: a deep convolutional network for dense crowd counting 2016 https://doi.org/10.1145/2964284.2967300

Boyat AK, Joshi BK (2015) A review paper : noise models in digital image processing. Signal Image Process Int J 6(2):63–75. https://doi.org/10.5121/sipij.2015.6206CrossRef

Cubuk ED, Zoph B, Mane D, Vasudevan V, Le QV (2019) Autoaugment: learning augmentation strategies from data https://doi.org/10.1109/CVPR.2019.00020

Dyk DAV, Meng XL (2001) The art of data augmentation. J Comput Graph Stat. https://doi.org/10.1198/10618600152418584MathSciNetCrossRef

Eitel A, Springenberg JT, Spinello L, Riedmiller M, Burgard W (2015) Multimodal deep learning for robust RGB-D object recognition https://doi.org/10.1109/IROS.2015.7353446

Farfade SS, Saberian M, Li LJ (2015) Multi-view face detection using Deep convolutional neural networks https://doi.org/10.1145/2671188.2749408

Frans K, Ho J, Chen X, Abbeel P, Schulman J (2018) Meta learning shared hierarchies

Frid-Adar M, Diamant I, Klang E, Amitai M, Goldberger J, Greenspan H (2018) GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification. Neurocomputing. https://doi.org/10.1016/j.neucom.2018.09.013CrossRef

Galdran A et al. (2017) Data-driven color augmentation techniques for deep skin image analysis pp 1–4

Gatys L, Ecker A, Bethge M (2016) A neural algorithm of artistic style. J vis. https://doi.org/10.1167/16.12.326CrossRef

Giuffrida MV, Scharr H, Tsaftaris SA (2017) “ARIGAN: synthetic arabidopsis plants using generative adversarial network,” Proceedings - 2017 IEEE International Conference on Computer Vision Workshops, ICCVW 2017, vol 2018-Janua, no. i, pp 2064–2071, 2017, doi: https://doi.org/10.1109/ICCVW.2017.242

Goodfellow IJ et al. (2014) Generative adversarial nets,” in Proceedings of the 27th International Conference on Neural Information Processing Systems - Vol 2, 2014, pp 2672–2680

Guirado E, Tabik S, Rivas ML, Alcaraz-Segura D, Herrera F (2019) Whale counting in satellite and aerial images with deep learning. Sci Rep. https://doi.org/10.1038/s41598-019-50795-9CrossRef

Hayat K (2018) Multimedia super-resolution via deep learning: a survey. Digital Signal Process Rev J. https://doi.org/10.1016/j.dsp.2018.07.005CrossRef

Jing Y, Yang Y, Feng Z, Ye J, Yu Y, Song M (2019) Neural style transfer: a review. IEEE Trans Visual Comput Graphics. https://doi.org/10.1109/tvcg.2019.2921336CrossRef

Johnson J, Alahi A, Fei-Fei L (2016) Perceptual losses for real-time style transfer and super-resolution https://doi.org/10.1007/978-3-319-46475-6_43.

Khalifa N, Loey M, Taha M, Mohamed H (2019a) Deep transfer learning models for medical diabetic retinopathy detection. Acta Informatica Medica 27(5):327. https://doi.org/10.5455/aim.2019.27.327-332CrossRef

Khalifa N, Taha M, Hassanien A, Mohamed H (2019b) Deep Iris: deep learning for gender classification through iris patterns. Acta Informatica Medica 27(2):96. https://doi.org/10.5455/aim.2019.27.96-102CrossRef

Khalifa NEM, Taha MHN, Hassanien AE, Hemedan AA (2019c) Deep bacteria: robust deep learning data augmentation design for limited bacterial colony dataset. Int J Reason-Based Intel Syst. https://doi.org/10.1504/ijris.2019.102610CrossRef

Khalifa NEM, Loey M, Taha MHN (2020b) Insect pests recognition based on deep transfer learning models. J Theor Appl Inf Technol 98(1):60–68

Khalifa NEM, Taha MHN, Hassanien AE (2018) Aquarium family fish species identification system using deep neural networks, in Proceedings of the International Conference on Advanced Intelligent Systems and Informatics 2018 pp. 347–356 https://doi.org/10.1007/978-3-319-99010-1_32

Khalifa NE, Hamed Taha M, Hassanien AE, Selim I (2018) Deep galaxy V2: robust deep convolutional neural networks for galaxy morphology classifications,” in 2018 International Conference on Computing Sciences and Engineering, ICCSE 2018 - Proceedings, Mar 2018, pp 1–6 doi: https://doi.org/10.1109/ICCSE1.2018.8374210

Khalifa NEM, Taha MHN, Hassanien AE, Elghamrawy S (2020) Detection of Coronavirus (COVID-19) associated pneumonia based on generative adversarial networks and a fine-tuned deep transfer learning model using chest X-ray dataset, arXiv, pp 1–15

Khalifa NEM, Taha MHN, Hassanien AE, Selim IM (2017) Deep galaxy: classification of galaxies based on deep convolutional neural networks. arXiv preprint. arXiv:1709.02245

Krizhevsky A, Nair V, Hinton G (2009) CIFAR-10 and CIFAR-100 datasets,” https://www.cs.toronto.edu/~kriz/cifar.html

Krizhevsky A, Sutskever I, Geoffrey HE (2012) Imagenet. Adv Neural Information Process Syst 25 (NIPS2012) https://doi.org/10.1109/5.726791.

Lam EY, Fung GSK (2008) Automatic white balancing in digital photography. Single-Sens Imag Methods Appl Digital Cameras. https://doi.org/10.1201/9781420054538.ch10CrossRef

LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436. https://doi.org/10.1038/nature14539CrossRef

Lemley J, Bazrafkan S, Corcoran P (2017) Smart augmentation learning an optimal data augmentation strategy. IEEE Access. https://doi.org/10.1109/ACCESS.2017.2696121CrossRef

Lim SK, Loo Y, Tran NT, Cheung NM, Roig G, and Elovici Y (2018) DOPING: generative data augmentation for unsupervised anomaly detection with GAN https://doi.org/10.1109/ICDM.2018.00146

Loey M, Manogaran G, Khalifa NEM (2020a) A deep transfer learning model with classical data augmentation and CGAN to detect COVID-19 from chest CT radiography digital images. Neural Comput Appl. https://doi.org/10.1007/s00521-020-05437-xCrossRef

Loey M, Smarandache F, Khalifa NEM (2020a) Within the lack of chest COVID-19 X-ray dataset: a novel detection model based on GAN and deep transfer learning. Symmetry 12(4):651. https://doi.org/10.3390/sym12040651CrossRef

Loey M, Manogaran G, Taha MHN, Khalifa NEM (2020) Fighting against COVID-19: a novel deep learning model based on YOLO-v2 with ResNet-50 for medical face mask detection. Sustain Cities Soc. https://doi.org/10.1016/j.scs.2020.102600CrossRef

Loey M, Naman M, Zayed H (2020b) Deep transfer learning in diagnosing leukemia in blood cells. Computers 9(2):29. https://doi.org/10.3390/computers9020029CrossRef

Loey M, ElSawy A, Afify M (2020c) Deep learning in plant diseases detection for agricultural crops: a survey. Int J Serv Sci Manag Eng Technol 11(2):41–58. https://doi.org/10.4018/IJSSMET.2020040103CrossRef

Loey M, Manogaran G, Taha MHN, Khalifa NEM (2021) A hybrid deep transfer learning model with machine learning methods for face mask detection in the era of the COVID-19 pandemic. Measurement 167:108288. https://doi.org/10.1016/j.measurement.2020.108288CrossRef

Mehdipour Ghazi M, Yanikoglu B, Aptoula E (2017) Plant identification using deep neural networks via optimization of transfer learning parameters. Neurocomputing. https://doi.org/10.1016/j.neucom.2017.01.018CrossRef

Nilsson NJ (1981) Principles of artificial intelligence. IEEE Trans Pattern Anal Mach Intell. https://doi.org/10.1109/TPAMI.1981.4767059CrossRefMATH

Pal NR, Pal SK (1993) A review on image segmentation techniques. Pattern Recogn. https://doi.org/10.1016/0031-3203(93)90135-JCrossRef

Papageorgiou CP, Oren M, Poggio T (1998) General framework for object detection https://doi.org/10.1109/iccv.1998.710772

Pereira S, Pinto A, Alves V, Silva CA (2016) Brain tumor segmentation using convolutional neural networks in MRI images. IEEE Trans Med Imag. https://doi.org/10.1109/TMI.2016.2538465CrossRef

Perez L, Wang J (2017) The effectiveness of data augmentation in image classification using deep learning. arXiv preprint. arXiv:1712.04621

Phillips PJ, Wechsler H, Huang J, Rauss PJ (1998) The FERET database and evaluation procedure for face-recognition algorithms. Image Vis Comput. https://doi.org/10.1016/s0262-8856(97)00070-xCrossRef

Ponce J, Forsyth D (2012) Computer vision: a modern approach https://doi.org/10.1016/j.cbi.2010.05.017

Premaladha J, Ravichandran KS (2016) Novel approaches for diagnosing melanoma skin lesions through supervised and deep learning algorithms. J Med Syst 40(4):96. https://doi.org/10.1007/s10916-016-0460-2CrossRef

Reichenbach SE, Park SK, Alter-Gartenberg R (1990) Optimal small kernels for edge detection https://doi.org/10.1109/icpr.1990.119330

Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation https://doi.org/10.1007/978-3-319-24574-4_28

Shawky OA, Hagag A, El-Dahshan E-SA, Ismail MA (2020) Remote sensing image scene classification using CNN-MLP with data augmentation. Optik 221:165356. https://doi.org/10.1016/j.ijleo.2020.165356CrossRef

Shorten C, Khoshgoftaar TM (2019) A survey on image data augmentation for deep learning. J Big Data. https://doi.org/10.1186/s40537-019-0197-0CrossRef

Sifre L, Mallat S (2013) Rotation, scaling and deformation invariant scattering for texture discrimination https://doi.org/10.1109/CVPR.2013.163

Subramanian J, Simon R (2013) Overfitting in prediction models - is it a problem only in high dimensions? Contemp Clin Trials. https://doi.org/10.1016/j.cct.2013.06.011CrossRef

Thada V, Jaglan V (2013) Comparison of jaccard, dice, cosine similarity coefficient to find best fitness value for web retrieved documents using genetic algorithm Int J Innovations Eng Technol

Uhlich S et al. (2017) Improving music source separation based on deep neural networks through data augmentation and network blending https://doi.org/10.1109/ICASSP.2017.7952158

Vyas A, Yu S, Paik J (2018) Fundamentals of digital image processing. Signals Commun Technol. https://doi.org/10.1007/978-981-10-7272-7_1CrossRef

Winkler S (2013) Color space conversions. Digital Video Qual. https://doi.org/10.1002/9780470024065.app1CrossRef

Yamashkin SA, Yamashkin AA, Zanozin VV, Radovanovic MM, Barmin AN (2020) Improving the efficiency of deep learning methods in remote sensing data analysis: geosystem approach. IEEE Access 8:179516–179529. https://doi.org/10.1109/ACCESS.2020.3028030CrossRef

Yan Y, Zhang Y, Su N (2019) A novel data augmentation method for detection of specific aircraft in remote sensing RGB images. IEEE Access 7:56051–56061. https://doi.org/10.1109/ACCESS.2019.2913191CrossRef

Yi X, Walia E, Babyn P (2019) Generative adversarial network in medical imaging: a review. Med Image Anal. https://doi.org/10.1016/j.media.2019.101552CrossRef

Yu Q, Yang Y, Song YZ, Xiang T, Hospedales T (2015) Sketch-a-net that beats humans https://doi.org/10.5244/c.29.7

Zhang YD et al (2019) Image based fruit category classification by 13-layer deep convolutional neural network and data augmentation. Multimedia Tools Appl. https://doi.org/10.1007/s11042-017-5243-3CrossRef

Zhong Z, Zheng L, Kang G, Li S, Yang Y (2017) Random erasing data augmentation

Zhu X, Liu Y, Li J, Wan T, and Qin Z (2018) Emotion classification with data augmentation using generative adversarial networks https://doi.org/10.1007/978-3-319-93040-4_28

Zoph B, Le QV (2019) Neural architecture search with reinforcement learning. arXiv preprint. arXiv:1611.01578

Titel: A comprehensive survey of recent trends in deep learning for digital images augmentation
verfasst von: Nour Eldeen Khalifa
Mohamed Loey
Seyedali Mirjalili
Publikationsdatum: 04.09.2021
Verlag: Springer Netherlands
Erschienen in: Artificial Intelligence Review / Ausgabe 3/2022
Print ISSN: 0269-2821
Elektronische ISSN: 1573-7462
DOI: https://doi.org/10.1007/s10462-021-10066-4

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Weitere Artikel der Ausgabe 3/2022

An automated essay scoring systems: a systematic literature review

Attention-based neural joint source-channel coding of text for point to point and broadcast channel

Interval valued demand related inventory model under all units discount facility and deterioration via parametric approach

Updating approximations with dynamic objects based on local multigranulation rough sets in ordered information systems

Pupil size variation in primary facial expressions–testing potential biomarker of self-criticism

An absolute magnitude deviation of HRV for the prediction of prediabetes with combined artificial neural network and regression tree methods

Premium Partner