Top

Cognitive Neurodynamics

Published in:

01-10-2022 | Research Article

Memristive competitive hopfield neural network for image segmentation application

Authors: Cong Xu, Meiling Liao, Chunhua Wang, Jingru Sun, Hairong Lin

Published in: Cognitive Neurodynamics | Issue 4/2023

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Image segmentation implementation provides simplified and effective feature information of image. Neural network algorithms have made significant progress in the application of image segmentation task. However, few studies focus on the implementation of hardware circuits with high-efficiency analog calculations and parallel operations for image segmentation problem. In this paper, a memristor-based competitive Hopfield neural network circuit is proposed to deal with the image segmentation problem. In this circuit, the memristive cross array is applied to store synaptic weights and perform matrix operations. The competition module based on the Winner-take-all mechanism is composed of the competition neurons and the competition control circuit, which simplifies the energy function of the Hopfield neural network and realizes the output function. Operational amplifiers and ABM modules are used to integrate operations and process external input information, respectively. Based on these designs, the circuit can automatically implement iteration and update of data. A series of PSPICE simulations are designed to verify the image segmentation capability of this circuit. Comparative experimental results and analysis show that this circuit has effective improvements both in processing speed and segmentation accuracy compared with other methods. Moreover, the proposed circuit shows good robustness to noise and memristive variation.

previous article Stability analysis of fractional order memristor synapse-coupled hopfield neural network with ring structure

next article Three-dimensional memristive Morris–Lecar model with magnetic induction effects and its FPGA implementation

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Süsstrunk S (2012) SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans Pattern Anal Mach Intell 34(11):2274–2282PubMed

Al-Dmour H, Al-Ani A (2018) A clustering fusion technique for MR brain tissue segmentation. Neurocomputing 275:546–559

Arora Anjali, Niranjan Vandana (2017) Low power filter design using memristor, meminductor and memcapacitor. In: 2017 4th IEEE Uttar Pradesh section international conference on electrical, computer and electronics (UPCON), pp 113–117

Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Intell Transp Syst 39(12):2481–2495

Bhattacharyya S, Maulik U, Dutta P (2011) Multilevel image segmentation with adaptive image context based thresholding. Appl Soft Comput 11(1):946–962

Chen LC, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848PubMed

Cheng KS, Lin JS, Mao CW (1996) The application of competitive Hopfield neural network to medical image segmentation. IEEE Trans Med Imag 15(4):560–567

Choi J, Sheu BJ (1993) A high-precision VLSI winner-take-all circuit for self-organizing neural networks. IEEE J Solid State Circuit 28(5):576–584

Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 24(5):603–619

Deng Y, Manjunath BS (2001) Unsupervised segmentation of color-texture regions in images and video. IEEE Trans Pattern Anal Mach Intell 23(8):800–810

Dong G, Xie M (2005) Color clustering and learning for image segmentation based on neural networks. IEEE Trans Neural Netw 16(4):925–936PubMed

Felzenszwalb PF, Huttenlocher DP (2004) Efficient graph-based image segmentation. Int J Comput Vis 59(2):167–181

Fish A, Milrud V, Yadid-Pecht O (2005) High-speed and high-precision current winner-take-all circuit. IEEE Trans Circuits Syst II Exp Briefs 52(3):131–135

Gu Z, Cheng J, Fu H, Zhou K, Hao H, Zhao Y, Zhang T, Gao S, Liu J (2019) CE-Net: context encoder network for 2D medical image segmentation. IEEE Trans Med Imag 38(10):2281–2292

Han X, Xiong X, Duan F (2015) A new method for image segmentation based on BP neural network and gravitational search algorithm enhanced by cat chaotic mapping. Appl Intell 43(4):855–873

Hong Q, Li Y, Wang X (2020) Memristive continuous Hopfield neural network circuit for image restoration. Neural Comput Appl 32(12):8175–8185

Hsu WY (2012) Improved watershed transform for tumor segmentation: application to mammogram image compression. Exp Syst Appl 39(4):3950–3955

Hu SG, Liu Y, Liu Z, Chen TP, Wang JJ, Yu Q, Deng LJ, Yin Y, Hosaka S (2015) Associative memory realized by a reconfigurable memristive Hopfield neural network. Nat Commun 6:7522PubMed

Hu X, Duan S, Chen G, Chen L (2017) Modeling affections with memristor-based associative memory neural networks. Neurocomputing 223:129–137

Ji X, Hu X, Zhou Y, Dong Z, Duan S (2019) Adaptive sparse coding based on memristive neural network with applications. Cogn Neurodyn 13(5):475–488PubMedPubMedCentral

Kanungo T, Mount DM, Netanyahu NS, Piatko CD, Silverman R, Wu AY (2002) An efficient K-means clustering algorithm: analysis and implementation. IEEE Trans Pattern Anal Mach Intell 24(7):881–892

Khan Tariq M, Bailey Donald G, Khan Mohammad AU, Kong Yinan (2020) Real-time iris segmentation and its implementation on FPGA. J Real Time Image Process 17(5):1089–1102

Khan JF, Bhuiyan SM, Adhami RR (2011) Image segmentation and shape analysis for road-sign detection. IEEE Trans Intell Transp Syst 12(1):83–96

Li C, Li Y (2011) Fast and robust image segmentation by small-world neural oscillator networks. Cogn Neurodyn 5(2):209–220PubMedPubMedCentral

Liao M, Wang C, Sun Y, Lin H, Xu C (2022) Memristor-based affective associative memory neural network circuit with emotional gradual processes. Neural Comput Appl 34:13667–13682

Lin H, Wang C, Hong Q, Sun Y (2021) A multi-stable memristor and its application in a neural network. IEEE Trans Circuits Syst II Exp Briefs 67(12):3472–3476

Liu Beiye, Li Hai, Chen Yiran, Li Xin, Huang Tingwen, Wu Qing, Barnell Mark (2014) Reduction and IR-drop compensations techniques for reliable neuromorphic computing systems. In: 2014 IEEE/ACM international conference on computer-aided design (ICCAD), pp 63–70

Liu Beiye, Li Hai, Chen Yiran, Li Xin, Wu Qing, Huang Tingwen (2015) Vortex: Variation-aware training for memristor X-bar. In: 2015 52nd ACM/EDAC/IEEE design automation conference (DAC), pp 1–6

Liu Han, Zhao Yue, Xie Guo (2017) Image segmentation implementation based on FPGA and SVM. In: 2017 3rd International conference on control, automation and robotics (ICCAR), pp 405–409

Liu Ye, Wang Yin, Chang Liang, Zhou Jun (2020) A Fast and Efficient FPGA-based Level Set Hardware Accelerator for Image Segmentation. In: 2020 IEEE international conference on integrated circuits, technologies and applications (ICTA), pp 61–62

Liu X, Zeng Z, Wen S (2016) Implementation of memristive neural network with full-function pavlov associative memory. IEEE Trans Circuits Syst I-Regul Pap 63(9):1454–1463

Liu C, Ji H, Qiu A (2021) Fast vertex-based graph convolutional neural network and its application to brain images. Neurocomputing 434:1–10

Maffezzoni P, Bahr B, Zhang Z, Daniel L (2016) Analysis and design of boolean associative memories made of resonant oscillator arrays. IEEE Trans Circuits Syst I-Regul Pap 63(11):1964–1973

Moeskops P, Viergever MA, Mendrik AM, De Vries LS, Benders MJ, Išgum I (2016) Automatic segmentation of MR brain images with a convolutional neural network. IEEE Trans Med Imag 35(5):1252–1261

Moro-Frias D, Ventura-Arizmendi C, Sanz-Pascual MT, de la Cruz-Blas CA (2015) Current-mode winner-take-all circuit with improved dynamic response. Circuits Syst Signal Process 34(2):625–639

Pajares G, Guijarro M, Ribeiro A (2010) A Hopfield neural network for combining classifiers applied to textured images. Neural Netw 23(1):144–153PubMed

Rahiminejad E, Saberi M, Lotfi R, Taherzadeh-Sani M, Nabki F (2019) A low-voltage high-precision time-domain winner-take-all circuit. IEEE Trans Circuits Syst II Exp Briefs 67(1):4–8

Rahman M, Baishnab K, Talukdar F (2009) A high speed and high resolution VLSI winner-take-all circuit for neural networks and fuzzy systems. In: Proc IEEE Int Symp Signals Circuits Syst, pp 1–4

Reddick WE, Glass JO, Cook EN, Elkin TD, Deaton RJ (1997) Automated segmentation and classification of multispectral magnetic resonance images of brain using artificial neural networks. IEEE Trans Med Imag 16(6):911–918

Ren Z, Zhang Q, Cheng J, Hao F, Gao X (2021) Segment spatial-temporal representation and cooperative learning of convolution neural networks for multimodal-based action recognition. Neurocomputing 433:142–153

Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention, pp 234–241. Springer

Rosenfeld A (1981) The max roberts operator is a hueckel-type edge detector. IEEE Trans Pattern Anal Mach Intell 3(1):101–103PubMed

Sheridan PM, Cai F, Du C, Ma W, Zhang Z, Lu WD (2017) Sparse coding with memristor networks. Nat Nanotechnol 12(8):784PubMed

Shi J, Malik J (2000) Normalized cuts and image segmentation. IEEE Trans Pattern Anal Mach Intell 22(8):888–905

Strukov DB, Snider GS, Stewart DR, Williams RS (2008) The missing memristor found. Nature 453(7191):80–83PubMed

Sun J, Han G, Zeng Z, Wang Y (2020) Memristor-based neural network circuit of full-function pavlov associative memory with time delay and variable learning rate. IEEE Trans Cybern 50(7):2935–2945PubMed

Sun J, Xiao X, Yang Q, Liu P, Wang Y (2021) Memristor-based hopfield network circuit for recognition and sequencing application. AEU Int J Electron Commun 134:153698

Wang Z, Shi X (2020) Electric activities of time-delay memristive neuron disturbed by gaussian white noise. Cogn Neurodyn 14(1):115–124PubMed

Wang Z, Wang X (2017) A novel memristor-based circuit implementation of full-function pavlov associative memory accorded with biological feature. IEEE Trans Circuits Syst I-Regul Pap 65(7):2210–2220

Wang Z, Joshi S, Savel’ev S, Jiang H, Midya R, Lin P, Hu M, Ge N, Strachan JP, Li Z (2016) Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing. Nat Mater 16(1):101–108PubMed

Wang Z, Wang X, Lu Z, Wu W, Zeng Z (2020) The design of memristive circuit for affective multi-associative learning. IEEE Trans Biomed Circuits Syst 14(2):173–185PubMed

Wang L, Zou H (2020) A new emotion model of associative memory neural network based on memristor. Neurocomputing

Wong WK, Yuen C, Fan D, Chan L, Fung E (2009) Stitching defect detection and classification using wavelet transform and BP neural network. Expert Syst Appl 36(2):3845–3856

Wouapi MK, Fotsin BH, Ngouonkadi EBM, Kemwoue FF, Njitacke ZT (2021) Complex bifurcation analysis and synchronization optimal control for Hindmarsh-Rose neuron model under magnetic flow effect. Cogn Neurodyn 15(2):315–347PubMed

Xia Q, Yang JJ (2019) Memristive crossbar arrays for brain-inspired computing. Nat Mater 18(4):309–323PubMed

Xie W, Wang C, Lin H (2021) A fractional-order multistable locally active memristor and its chaotic system with transient transition, state jump. Nonlinear Dyn pp 1–19

Xu C, Wang C, Sun Y, Hong Q, Deng Q, Chen H (2021) Memristor-based neural network circuit with weighted sum simultaneous perturbation training and its applications. Neurocomputing 462:581–590

Xu C, Wang C, Jiang J, Sun J, Lin H (2022) Memristive circuit implementation of context-dependent emotional learning network and its application in multitask. IEEE Trans Comput Aided Des Integr Circuits Syst 41(9):3052–3065

Yang L, Wang C (2021) Emotion model of associative memory possessing variable learning rates with time delay. Neurocomputing 460(14):117–125

Yang X, Cao J, Yu W (2014) Exponential synchronization of memristive Cohen-Grossberg neural networks with mixed delays. Cogn Neurodyn 8(3):239–249PubMedPubMedCentral

Yang J, Wang L, Wang Y, Guo T (2017) A novel memristive hopfield neural network with application in associative memory. Neurocomputing 227:142–148

Yao W, Wang C, Cao J (2019) Hybrid multisynchronization of coupled multistable memristive neural networks with time delays. Neurocomputing 363:281–294

Yao W, Wang C, Sun Y, Zhou C, Lin H (2020) Synchronization of inertial memristive neural networks with time-varying delays via static or dynamic event-triggered control. Neurocomputing 404:367–380

Yao W, Wang C, Sun Y, Zhou C (2022) Robust multimode function synchronization of memristive neural networks with parameter perturbations and time-varying delays. IEEE Trans Syst Man Cybern Syst 52(1):260–274

Yen JC, Chang FJ, Chang S (1995) A new criterion for automatic multilevel thresholding. IEEE Trans Image Process 4(3):370–378PubMed

Zhang Y, Wang X, Li Y, Friedman EG (2016) Memristive model for synaptic circuits. IEEE Trans Circuits Syst II Exp Briefs 64(7):767–771

Zhang Y, Li Y, Wang X, Friedman EG (2017) Synaptic characteristics of Ag/AgInSbTe/Ta-based memristor for pattern recognition applications. IEEE Trans Ind Electron 64(4):1806–1811

Zhang L, Hu X, Zhou Y, Zhou G, Duan S (2021) Memristive deeplab: A hardware friendly deep CNN for semantic segmentation. Neurocomputing 451:181–191

Zhao L, Hong Q, Wang X (2018) Novel designs of spiking neuron circuit and STDP learning circuit based on memristor. Neurocomputing 314:207–214

Zhou C, Wang C, Sun Y, Yao W (2020) Weighted sum synchronization of memristive coupled neural networks. Neurocomputing 403:211–223

Zhou J, Tang Y, Wu J, Yi X (2013) Image segmentation with threshold based on memristors. In: 2013 IEEE 4th international conference on electronics information and emergency communication, pp 41–44. IEEE

Title: Memristive competitive hopfield neural network for image segmentation application
Authors: Cong Xu
Meiling Liao
Chunhua Wang
Jingru Sun
Hairong Lin
Publication date: 01-10-2022
Publisher: Springer Netherlands
Published in: Cognitive Neurodynamics / Issue 4/2023
Print ISSN: 1871-4080
Electronic ISSN: 1871-4099
DOI: https://doi.org/10.1007/s11571-022-09891-2

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 4/2023

Myocardial infarction detection using ITD, DWT and deterministic learning based on ECG signals

Three-dimensional memristive Morris–Lecar model with magnetic induction effects and its FPGA implementation

Differences in functional network between focal onset nonconvulsive status epilepticus and toxic metabolic encephalopathy: application to machine learning models for differential diagnosis

Memristive neural network circuit implementation of associative learning with overshadowing and blocking

Facial expression recognition on partially occluded faces using component based ensemble stacked CNN

A novel noninvasive brain–computer interface by imagining isometric force levels