AEU - International Journal of Electronics and Communications
Regular paperComplex dynamics of a 4D Hopfield neural networks (HNNs) with a nonlinear synaptic weight: Coexistence of multiple attractors and remerging Feigenbaum trees
Introduction
In biology, the human brain is the central organ of the nervous system. It controls most of activities of the body, processing, integrating, and coordinating the information it receives from the sensory organs. The brain dynamics is generally studied based on mathematical equations, usually obtained from artificial neural networks models [1], [2], [3]. Among these neural networks, Hopfield neural networks stand amongst the simplest paradigms. This is why in neurocomputing, Hopfield type neural network has an important use [4]. Since it is relatively simple, it can describe brain dynamics and provide a model for better understanding human activity and memory. In the brain dynamics, the signal generated is called electroencephalograms (EEGs) seems to have uncertain features, but there are some hidden samples in the signals [5]. Moreover, these signals are very sensitive to any changes in the brain’s synaptic weights [6]. In this way, the brain dynamics is related to butterfly effect. It has been presented in the work of Panahi and collaborators [3] that, sometimes the neural activity in the brain can change from chaotic to periodic. The authors have also presented that, the chaotic behavior correspond to the normal state of the brain while the periodic state correspond to the pathological behavior of the brain named epileptic seizure.
In order to have more information on the brain’s dynamics, several works have been carried out on the analyses of HNNs, and results have indicated some complex nonlinear phenomena such as chaos including single scroll and double scroll attractors, transient chaotic behaviors, hyperchaos, hidden attractors, just to name a few [3], [4], [5], [6], [7], [8], [9], [10], [11], [12], [13]. In particular, Bao and collaborators [13], remove the self-connection synaptic weight of the second neuron to simplify the HNNs connection topology presented in [9]. The investigations of Bao highlighted the complex phenomenon of the coexistence of attractors for the same set of synaptic weight matrix. Their results have been validated experimentally. It should be noted that, the phenomenon of the coexistence of attractors observed in HNNs have already been identified by Kengne and collaborators in several classes of nonlinear dynamical systems such as the Chua’s system, Jerk systems, Duffing–Holmes type chaotic oscillators, memristor-based Shinriki's circuit and so on [14], [15], [16], [17], [18], [19], [20], [21]. From these works, up to six disconnected solutions are captured in some Jerk systems as well as the phenomenon of antimonotonicity. It is then, of interest to see if a 4D HNNs with a nonlinear synaptic weight, modelling complex biological system such as brain dynamics is able to experience such type of nonlinear dynamics.
Inspired by these previous works related to the dynamics of the Hopfield neural networks and complex nonlinear dynamical behaviors already found in some systems reported in the literature, we propose in this paper a mathematical model of a Hopfield neural networks obtained by introducing a nonlinear self-synaptic weight connection in the first neuron. The main objective of this paper is to show that the new Hopfield neural networks exhibits richer (e.g. antimonotonicity and coexistence of at least three asymmetric disconnected attractors) dynamics compared to previously published ones. Consequently, it gives an idea on the origin of epileptic fit which can be viewed as coexistence of normal and pathological state of the patient. Thus, the scientific contributions of this work can be summarized in the following lines:
- (a)
To carry out a systematic analysis of the proposed 4D HNNs and explain the chaos mechanism.
- (b)
To define the set of the synaptic weight matrix in which the model experience multiple coexisting attractors, hysteretic dynamics, and parallel bifurcations.
- (c)
To carry out Pspice simulations of the proposed HNNs to support the theoretical predictions.
The remaining parts of this scientific contribution are organized as follows. In Section 2, we propose and describe the novel 4D Hopfield neural network model. Analyses are carried out in terms of equilibria stability and existence of attractors. In Section 3, traditional nonlinear diagnostic tools such as bifurcation diagrams, graphs of Lyapunov exponents, phase portraits, and frequency spectra are exploited to highlight complex phenomena such as the coexistence of bifurcations, the coexistence of multiple asymmetric attractors and antimonotonicity. In Section 4, Pspice simulations are carried out to support our investigations. Finally, some concluding remarks and proposals for future works are given in Section 5.
Section snippets
2.1. Mathematical expression of the proposed model
Hopfield neural networks (HNNs) are one among several artificial neural Networks which are generally used to describe brain dynamics. In such type of neuron, the circuit equation can be described aswhere is a state variable corresponding to the voltage across the capacitor , is a resistor showing the membrane resistance between the inside and outside of the neuron, is the input bias current. The matrix is a synaptic weight matrix showing the
Complex behaviors of the 4D HNNs
The aim of this section is to highlight the rich repertoire of behaviors that can be found in the 4D HNNs with a nonlinear synaptic weight under investigation. The dynamic properties of the model of 4D HNNs (Eq. (3)) were numerically simulated in Turbo Pascal using the fourth order Runge-Kutta method with constant time step size of and synaptic weight are taken in extended precision mode.
Pspice implementation/simulation of the 4D HNNs
An alternative approach for analyzing the theoretical HNNs model depicted in Fig. 1 and describe by Eq. (3) is to build an electronic circuit emulating it. The circuit in Fig. 13 has been designed following the approach based on analog computer using operational amplifiers [4], [12], [13], [14], [15], [16], [17], [18], [19], [20], [21], [27], [28], [29], [30], [36] where the neuron state variables , , and of system (3) are associated with the voltages across the capacitors , ,
Conclusion
By replacing the self-connection synaptic weight of the first neuron with a nonlinear synaptic weight, a novel 4D Hopfield Neural Networks is obtained. The properties of the model including equilibria stability, and dissipation were analyzed. The study has revealed that, the model investigated possesses three equilibrium points among which the origin and two nonzero equilibrium points. Both the origin and nonzero equilibrium points are always unstable for the set of synaptic weight matrix used
Acknowledgements
The authors would like to thank the unanimous reviewers for their comments and suggestions that helped to greatly improve the presentation of the present manuscript.
References (37)
- et al.
Complex dynamics in a simple hopfield-type neural network
- et al.
Structure out of chaos: functional brain network analysis with EEG, MEG, and functional MRI
EurNeuropsychopharmacol
(2013) - et al.
Chaos and transient chaos in simple Hopfield neural networks
Neurocomputing
(2005) - et al.
Some novel double-scroll chaotic attractors in Hopfield networks
Neurocomputing
(2010) - et al.
Hidden chaotic sets in a Hopfield neural system
Chaos, Solitons Fractals
(2017) - et al.
Coexistence of multiple attractors and crisis route to chaos in autonomous third order Duffing–Holmes type chaotic oscillators
Commun Nonlinear Sci Numer Simul
(2016) - et al.
Dynamical analysis and electronic circuit realization of an equilibrium free 3D chaotic system with a large number of coexisting attractors
Optik
(2017) - et al.
Antimonotonicity, chaos and multiple coexisting attractors in a simple hybrid diode-based jerk circuit
Chaos, Solitons Fractals
(2017) - et al.
Determining Lyapunov exponents from time series
Physica D
(1985) - et al.
Dynamic analysis of a unique jerk system with a smoothly adjustable symmetry and nonlinearity: Reversals of period doubling, offset boosting and coexisting bifurcations
Int J Electron Commun (AEÜ)
(2018)
Signing Folifack VR A plethora of coexisting strange attractors in a simple jerk system with hyperbolic tangent nonlinearity
Chaos, Solitons Fractals
Dynamical analysis of a novel autonomous 4-D hyperjerk circuit with hyperbolic sine nonlinearity: Chaos, antimonotonicity and a plethora of coexisting attractors
Chaos, Solitons Fractals
Remerging Feigenbaum trees in dynamical systems
Phys Lett A
Antimonotonicity: inevitable reversals of period-doubling cascades
Phys Lett A
A simple fractional-order chaotic system without equilibrium and its synchronization
Int J Electron Commun (AEÜ)
Modeling the dynamics of human brain activity with recurrent neural networks
Front Comput Neurosci
Modeling of epilepsy based on chaotic artificial neural network
Chaos, Solitons Fractals
Hidden hyperchaotic attractor in a novel simple memristive neural network, optoelectronics and advanced materials rapid communications
Cited by (88)
Cascade tri-neuron hopfield neural network: Dynamical analysis and analog circuit implementation
2024, AEU - International Journal of Electronics and CommunicationsBifurcation, chaos and fixed-time synchronization of memristor cellular neural networks
2023, Chaos, Solitons and FractalsThe effects of symmetry breaking on the dynamics of an inertial neural system with a non-monotonic activation function: Theoretical study, asymmetric multistability and experimental investigation
2022, Physica A: Statistical Mechanics and its Applications