Skip to main content
Erschienen in: Neural Computing and Applications 14/2024

20.02.2024 | Original Article

Robust deep image-watermarking method by a modified Siamese network

verfasst von: Ako Bartani, Fardin Akhlaghian Tab, Alireza Abdollahpouri, Mohsen Ramezani

Erschienen in: Neural Computing and Applications | Ausgabe 14/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The risk of copyrighted data theft has increased with the growth of digital communication and easy access to digital data. Using watermarking methods has always been an active research subject against unauthorized users to protect copyrighted data. Deep watermarking methods were introduced in recent years to face this challenge, however, the robustness of these methods against graphic attacks and generating high-quality marked-images are still one of the important challenges in this issue. Also, exposure of these methods to the risk of intellectual property infringement is another important challenge in this subject. To address the quality degradation challenge of marked-images, we propose a blind deep image-watermarking method inspired by the Siamese network in which the watermark-codes will be embedded in the network’s weights instead of cover-images. Also, a cover-atmosphere is defined for each cover-image which includes the cover-image and its various attacked versions. Favorable robustness is achieved by mapping each cover-atmosphere to its corresponding watermark-code space. Moreover, an independent subspace for non-watermark-images is considered to map into a null-code which makes the method robust against intellectual property infringement attack. The results obtained from the experiment show that the suggested approach outperforms existing methods and can withstand different types of graphical and surrogate model attacks.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Adi Y, Baum C, Cisse M, et al (2018) Turning your weakness into a strength: watermarking deep neural networks by backdooring. In: 27th USENIX security symposium (USENIX Security 18), pp 1615–1631 Adi Y, Baum C, Cisse M, et al (2018) Turning your weakness into a strength: watermarking deep neural networks by backdooring. In: 27th USENIX security symposium (USENIX Security 18), pp 1615–1631
2.
Zurück zum Zitat Ahmadi M, Norouzi A, Karimi N et al (2020) Redmark: framework for residual diffusion watermarking based on deep networks. Expert Syst Appl 146:113157CrossRef Ahmadi M, Norouzi A, Karimi N et al (2020) Redmark: framework for residual diffusion watermarking based on deep networks. Expert Syst Appl 146:113157CrossRef
3.
Zurück zum Zitat Apostolidis KD, Papakostas GA (2022) Digital watermarking as an adversarial attack on medical image analysis with deep learning. J Imaging 8(6):155CrossRef Apostolidis KD, Papakostas GA (2022) Digital watermarking as an adversarial attack on medical image analysis with deep learning. J Imaging 8(6):155CrossRef
4.
Zurück zum Zitat Ba J, Caruana R (2014) Do deep nets really need to be deep?. Adv Neural Inf Process Syst 27 Ba J, Caruana R (2014) Do deep nets really need to be deep?. Adv Neural Inf Process Syst 27
5.
Zurück zum Zitat Cao H, Hu F, Sun Y et al (2022) Robust and reversible color image watermarking based on dft in the spatial domain. Optik 262:169319CrossRef Cao H, Hu F, Sun Y et al (2022) Robust and reversible color image watermarking based on dft in the spatial domain. Optik 262:169319CrossRef
6.
Zurück zum Zitat Chen Y, Li Z, Shi J, et al (2020) Not afraid of the unseen: a siamese network based scheme for unknown traffic discovery. In: 2020 IEEE symposium on computers and communications (ISCC), IEEE, pp 1–7 Chen Y, Li Z, Shi J, et al (2020) Not afraid of the unseen: a siamese network based scheme for unknown traffic discovery. In: 2020 IEEE symposium on computers and communications (ISCC), IEEE, pp 1–7
7.
Zurück zum Zitat Das SN, Panda M (2022) Digital image watermarking techniques using machine learning-a comprehensive survey. Next Gener Internet Things Proc ICNGIoT 2022:455–467 Das SN, Panda M (2022) Digital image watermarking techniques using machine learning-a comprehensive survey. Next Gener Internet Things Proc ICNGIoT 2022:455–467
8.
Zurück zum Zitat Ernawan F, Ariatmanto D (2023) A recent survey on image watermarking using scaling factor techniques for copyright protection. Multimed Tools Appl pp 1–41 Ernawan F, Ariatmanto D (2023) A recent survey on image watermarking using scaling factor techniques for copyright protection. Multimed Tools Appl pp 1–41
9.
Zurück zum Zitat Fan L, Ng KW, Chan CS (2019) Rethinking deep neural network ownership verification: embedding passports to defeat ambiguity attacks. Adv Neural Inf Process Syst 32 Fan L, Ng KW, Chan CS (2019) Rethinking deep neural network ownership verification: embedding passports to defeat ambiguity attacks. Adv Neural Inf Process Syst 32
10.
Zurück zum Zitat Fan L, Ng KW, Chan CS, et al (2021) Deepip: deep neural network intellectual property protection with passports. In: IEEE transactions on pattern analysis and machine intelligence Fan L, Ng KW, Chan CS, et al (2021) Deepip: deep neural network intellectual property protection with passports. In: IEEE transactions on pattern analysis and machine intelligence
11.
Zurück zum Zitat Guo J, Potkonjak M (2018) Watermarking deep neural networks for embedded systems. In: 2018 IEEE/ACM international conference on computer-aided design (ICCAD), IEEE, pp 1–8 Guo J, Potkonjak M (2018) Watermarking deep neural networks for embedded systems. In: 2018 IEEE/ACM international conference on computer-aided design (ICCAD), IEEE, pp 1–8
12.
Zurück zum Zitat Han S, Lv M, Cheng Z (2022) Dual-color blind image watermarking algorithm using the graph-based transform in the stationary wavelet transform domain. Optik 268:169832CrossRef Han S, Lv M, Cheng Z (2022) Dual-color blind image watermarking algorithm using the graph-based transform in the stationary wavelet transform domain. Optik 268:169832CrossRef
13.
Zurück zum Zitat Hatoum MW, Couchot JF, Couturier R et al (2021) Using deep learning for image watermarking attack. Signal Process Image Commun 90:116019CrossRef Hatoum MW, Couchot JF, Couturier R et al (2021) Using deep learning for image watermarking attack. Signal Process Image Commun 90:116019CrossRef
14.
Zurück zum Zitat He K, Zhang X, Ren S, et al (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778 He K, Zhang X, Ren S, et al (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
15.
16.
Zurück zum Zitat Houmansadr A, Kiyavash N, Borisov N (2013) Non-blind watermarking of network flows. IEEE/ACM Trans Netw 22(4):1232–1244CrossRef Houmansadr A, Kiyavash N, Borisov N (2013) Non-blind watermarking of network flows. IEEE/ACM Trans Netw 22(4):1232–1244CrossRef
17.
Zurück zum Zitat Jane O, Elbaşi E et al (2014) Hybrid non-blind watermarking based on dwt and svd. J Appl Res Technol 12(4):750–761CrossRef Jane O, Elbaşi E et al (2014) Hybrid non-blind watermarking based on dwt and svd. J Appl Res Technol 12(4):750–761CrossRef
18.
Zurück zum Zitat Kapre B, Rajurkar A, Guru D (2023) Self-embedding and variable authentication approach for fragile image watermarking using svd and dct. Cognition and recognition: 8th international conference, ICCR 2021, Mandya, India, December 30–31, 2021. Springer, Revised Selected Papers, pp 366–379 Kapre B, Rajurkar A, Guru D (2023) Self-embedding and variable authentication approach for fragile image watermarking using svd and dct. Cognition and recognition: 8th international conference, ICCR 2021, Mandya, India, December 30–31, 2021. Springer, Revised Selected Papers, pp 366–379
20.
Zurück zum Zitat Kurek J, Antoniuk I, Świderski B et al (2020) Application of siamese networks to the recognition of the drill wear state based on images of drilled holes. Sensors 20(23):6978CrossRef Kurek J, Antoniuk I, Świderski B et al (2020) Application of siamese networks to the recognition of the drill wear state based on images of drilled holes. Sensors 20(23):6978CrossRef
21.
Zurück zum Zitat Lakrissi Y, Saaidi A, Essahlaoui A (2018) Novel dynamic color image watermarking based on dwt-svd and the human visual system. Multimed Tools Appl 77(11):13531–13555CrossRef Lakrissi Y, Saaidi A, Essahlaoui A (2018) Novel dynamic color image watermarking based on dwt-svd and the human visual system. Multimed Tools Appl 77(11):13531–13555CrossRef
22.
Zurück zum Zitat Lee JE, Seo YH, Kim DW (2020) Convolutional neural network-based digital image watermarking adaptive to the resolution of image and watermark. Appl Sci 10(19):6854CrossRef Lee JE, Seo YH, Kim DW (2020) Convolutional neural network-based digital image watermarking adaptive to the resolution of image and watermark. Appl Sci 10(19):6854CrossRef
23.
Zurück zum Zitat Lin TY, Maire M, Belongie S, et al (2014) Microsoft coco: Common objects in context. In: European conference on computer vision, Springer, pp 740–755 Lin TY, Maire M, Belongie S, et al (2014) Microsoft coco: Common objects in context. In: European conference on computer vision, Springer, pp 740–755
24.
Zurück zum Zitat Lin WH, Wang YR, Horng SJ et al (2009) A blind watermarking method using maximum wavelet coefficient quantization. Expert Syst Appl 36(9):11509–11516CrossRef Lin WH, Wang YR, Horng SJ et al (2009) A blind watermarking method using maximum wavelet coefficient quantization. Expert Syst Appl 36(9):11509–11516CrossRef
25.
Zurück zum Zitat Luo X, Zhan R, Chang H, et al (2020) Distortion agnostic deep watermarking. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 13548–13557 Luo X, Zhan R, Chang H, et al (2020) Distortion agnostic deep watermarking. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 13548–13557
26.
Zurück zum Zitat Mastorakis S, Zhong X, Huang PC, et al (2021) Dlwiot: deep learning-based watermarking for authorized iot onboarding. In: 2021 IEEE 18th annual consumer communications & networking conference (CCNC), IEEE, pp 1–7 Mastorakis S, Zhong X, Huang PC, et al (2021) Dlwiot: deep learning-based watermarking for authorized iot onboarding. In: 2021 IEEE 18th annual consumer communications & networking conference (CCNC), IEEE, pp 1–7
27.
Zurück zum Zitat Mishra A, Rajpal A, Bala R (2018) Bi-directional extreme learning machine for semi-blind watermarking of compressed images. J Inf Secur Appl 38:71–84 Mishra A, Rajpal A, Bala R (2018) Bi-directional extreme learning machine for semi-blind watermarking of compressed images. J Inf Secur Appl 38:71–84
28.
Zurück zum Zitat Parkhi OM, Vedaldi A, Zisserman A (2015) Deep face recognition. BMVC Parkhi OM, Vedaldi A, Zisserman A (2015) Deep face recognition. BMVC
29.
Zurück zum Zitat Plata M, Syga P (2020) Robust spatial-spread deep neural image watermarking. In: 2020 IEEE 19th international conference on trust, security and privacy in computing and communications (TrustCom), IEEE, pp 62–70 Plata M, Syga P (2020) Robust spatial-spread deep neural image watermarking. In: 2020 IEEE 19th international conference on trust, security and privacy in computing and communications (TrustCom), IEEE, pp 62–70
30.
Zurück zum Zitat PVSSR CM et al (2017) A robust semi-blind watermarking for color images based on multiple decompositions. Multimed Tools Appl 76(24):25623–25656CrossRef PVSSR CM et al (2017) A robust semi-blind watermarking for color images based on multiple decompositions. Multimed Tools Appl 76(24):25623–25656CrossRef
31.
Zurück zum Zitat Ruan H, Song H, Liu B et al (2023) Intellectual property protection for deep semantic segmentation models. Front Comput Sci 17(1):1–9CrossRef Ruan H, Song H, Liu B et al (2023) Intellectual property protection for deep semantic segmentation models. Front Comput Sci 17(1):1–9CrossRef
32.
Zurück zum Zitat Tan J, Hu Y, Shi Z, et al (2022) Deep image watermarking to jpeg compression based on mixed-frequency channel attention. Comput Math Methods Med Tan J, Hu Y, Shi Z, et al (2022) Deep image watermarking to jpeg compression based on mixed-frequency channel attention. Comput Math Methods Med
33.
Zurück zum Zitat Uchida Y, Nagai Y, Sakazawa S, et al (2017) Embedding watermarks into deep neural networks. In: Proceedings of the 2017 ACM on international conference on multimedia retrieval, pp 269–277 Uchida Y, Nagai Y, Sakazawa S, et al (2017) Embedding watermarks into deep neural networks. In: Proceedings of the 2017 ACM on international conference on multimedia retrieval, pp 269–277
34.
Zurück zum Zitat Voloshynovskiy S, Deguillaume F, Pun T (2001) Multibit digital watermarking robust against local nonlinear geometrical distortions. In: Proceedings 2001 international conference on image processing (Cat. No. 01CH37205), IEEE, pp 999–1002 Voloshynovskiy S, Deguillaume F, Pun T (2001) Multibit digital watermarking robust against local nonlinear geometrical distortions. In: Proceedings 2001 international conference on image processing (Cat. No. 01CH37205), IEEE, pp 999–1002
35.
Zurück zum Zitat Wang C, Li S, Liu Y et al (2023) Cross-scale feature fusion-based jnd estimation for robust image watermarking in quaternion dwt domain. Optik 272:170371CrossRef Wang C, Li S, Liu Y et al (2023) Cross-scale feature fusion-based jnd estimation for robust image watermarking in quaternion dwt domain. Optik 272:170371CrossRef
36.
37.
Zurück zum Zitat Wengrowski E, Dana K (2019) Light field messaging with deep photographic steganography. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 1515–1524 Wengrowski E, Dana K (2019) Light field messaging with deep photographic steganography. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 1515–1524
38.
Zurück zum Zitat Wu H, Liu G, Yao Y et al (2020) Watermarking neural networks with watermarked images. IEEE Trans Circuits Syst Video Technol 31(7):2591–2601CrossRef Wu H, Liu G, Yao Y et al (2020) Watermarking neural networks with watermarked images. IEEE Trans Circuits Syst Video Technol 31(7):2591–2601CrossRef
39.
Zurück zum Zitat Xue M, Wang J, Liu W (2021) Dnn intellectual property protection: taxonomy, attacks and evaluations. In: Proceedings of the 2021 on great lakes symposium on VLSI, pp 455–460 Xue M, Wang J, Liu W (2021) Dnn intellectual property protection: taxonomy, attacks and evaluations. In: Proceedings of the 2021 on great lakes symposium on VLSI, pp 455–460
40.
Zurück zum Zitat Xue M, Sun S, Zhang Y, et al (2022) Active intellectual property protection for deep neural networks through stealthy backdoor and users’ identities authentication. Appl Intell pp 1–15 Xue M, Sun S, Zhang Y, et al (2022) Active intellectual property protection for deep neural networks through stealthy backdoor and users’ identities authentication. Appl Intell pp 1–15
41.
Zurück zum Zitat Zhang B, Wu Y, Chen B (2022) Embedding guided end-to-end framework for robust image watermarking. Secur Commun Netw Zhang B, Wu Y, Chen B (2022) Embedding guided end-to-end framework for robust image watermarking. Secur Commun Netw
42.
Zurück zum Zitat Zhang J, Gu Z, Jang J, et al (2018) Protecting intellectual property of deep neural networks with watermarking. In: Proceedings of the 2018 on Asia conference on computer and communications security, pp 159–172 Zhang J, Gu Z, Jang J, et al (2018) Protecting intellectual property of deep neural networks with watermarking. In: Proceedings of the 2018 on Asia conference on computer and communications security, pp 159–172
43.
Zurück zum Zitat Zhang J, Chen D, Liao J et al (2020) Passport-aware normalization for deep model protection. Adv Neural Inf Process Syst 33:22619–22628 Zhang J, Chen D, Liao J et al (2020) Passport-aware normalization for deep model protection. Adv Neural Inf Process Syst 33:22619–22628
44.
Zurück zum Zitat Zhang J, Chen D, Liao J et al (2021) Deep model intellectual property protection via deep watermarking. IEEE Trans Pattern Anal Mach Intell 44:4005–4020 Zhang J, Chen D, Liao J et al (2021) Deep model intellectual property protection via deep watermarking. IEEE Trans Pattern Anal Mach Intell 44:4005–4020
45.
Zurück zum Zitat Zhu J, Kaplan R, Johnson J, et al (2018) Hidden: hiding data with deep networks. In: Proceedings of the European conference on computer vision (ECCV), pp 657–672 Zhu J, Kaplan R, Johnson J, et al (2018) Hidden: hiding data with deep networks. In: Proceedings of the European conference on computer vision (ECCV), pp 657–672
Metadaten
Titel
Robust deep image-watermarking method by a modified Siamese network
verfasst von
Ako Bartani
Fardin Akhlaghian Tab
Alireza Abdollahpouri
Mohsen Ramezani
Publikationsdatum
20.02.2024
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 14/2024
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-024-09496-2

Weitere Artikel der Ausgabe 14/2024

Neural Computing and Applications 14/2024 Zur Ausgabe

Premium Partner