Skip to main content
Erschienen in: Neural Computing and Applications 10/2020

25.09.2019 | Advances in Parallel and Distributed Computing for Neural Computing

Research on an olfactory neural system model and its applications based on deep learning

verfasst von: Jin Zhang, Tiantian Tian, Shengchun Wang, Xiaofei Liu, Xuanyu Shu, Ying Wang

Erschienen in: Neural Computing and Applications | Ausgabe 10/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The idea of constructing the biological neural system model as realistic as possible can not only provide a new artificial neural network (ANN), but also offer an effective object to study biological neural systems. As a very meaningful attempt about the idea, a bionic model of olfactory neural system, KIII model, is introduced in this paper. There are the unique characteristics of KIII model different from those of general ANNs. The KIII model realistically simulates the structure of the real olfactory neural system and the process of odor molecules gradually transformed by the core components of the olfactory system including olfactory receptor, olfactory bulb and olfactory cortex. The neuron model of the KIII model is constructed and optimized based on neurophysiological experimental data and accurately reflects the response of olfactory neurons to odor stimulation. In particular, the noise introduced to KIII model can further improve the performance of the model. In addition, the KIII model is analyzed based on the idea of deep learning. The qualitative analysis shows that there are obvious similarities between the KIII model and the deep learning model. Furthermore, with the epileptic electroencephalograph (EEG) recognition task, two groups of experiments are designed to comprehensively analyze the performance of the KIII model. In the first group of experiments, a typical pattern recognition experiment with feature extraction stage is shown. The features of epileptic EEG were extracted based on Empirical Mode Decomposition (EMD), and the KIII model was used as a classifier. The experimental results show that the KIII model only needs a small number of iterations to memorize different modes and has a high recognition rate, over 91%. In the second group of experiments, a direct recognition experiment without feature extraction stage is shown. The original epileptic EEG signals as KIII model inputs directly were recognized. The experimental results show that there is still an excellent performance in the KIII model, over 96%, and the recognition result is similar to the characteristics of the deep learning model. The theoretical analysis and experimental results prove that KIII model with the idea of deep learning is an excellent bionic model of olfactory neural system and gets a good balance between high bionics and good performance, which is a good reference for related research.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Li ZP, Hopfield J (1989) A model of the olfactory bulb and its oscillatory processing. Biol Cybern 61:379–392MATHCrossRef Li ZP, Hopfield J (1989) A model of the olfactory bulb and its oscillatory processing. Biol Cybern 61:379–392MATHCrossRef
2.
Zurück zum Zitat Li ZP, Hertz J (1998) Odor recognition and segmentation by coupled olfactory bulb and cortical network. Neurocomputing 61(26–27):789–794MATH Li ZP, Hertz J (1998) Odor recognition and segmentation by coupled olfactory bulb and cortical network. Neurocomputing 61(26–27):789–794MATH
3.
Zurück zum Zitat Liljenstrom H (1991) Modeling the dynamics of olfactory cortex using simplified network units and realistic architecture. Int J Neural Syst 2(1–2):1–15CrossRef Liljenstrom H (1991) Modeling the dynamics of olfactory cortex using simplified network units and realistic architecture. Int J Neural Syst 2(1–2):1–15CrossRef
4.
Zurück zum Zitat Liljenstrom H, Wu XB (1995) Noise-enhanced performance in a cortical associative memory model. Int J Neural Syst 6(1):19–29CrossRef Liljenstrom H, Wu XB (1995) Noise-enhanced performance in a cortical associative memory model. Int J Neural Syst 6(1):19–29CrossRef
5.
Zurück zum Zitat Aronsson P, Liljenstrom H (2000) Non-synaptic modulation of cortical network dynamics. Neurocomputing 32–33:285–290CrossRef Aronsson P, Liljenstrom H (2000) Non-synaptic modulation of cortical network dynamics. Neurocomputing 32–33:285–290CrossRef
6.
Zurück zum Zitat Gu Y, Halnes G, Liljenstrom H, Rosen D, Wahlund B, Liang H (2006) Modeling ECT effects by connectivity changes in cortical neural networks. Neurocomputing 69(10–12):1341–1347CrossRef Gu Y, Halnes G, Liljenstrom H, Rosen D, Wahlund B, Liang H (2006) Modeling ECT effects by connectivity changes in cortical neural networks. Neurocomputing 69(10–12):1341–1347CrossRef
7.
Zurück zum Zitat Chang HJ, Freeman WJ, Burke BC (1998) Optimization of olfactory model in software to give 1/f power spectra reveals numerical instabilities in solutions governed by aperiodic (chaotic) attractors. Neural Netw 11(3):449–466CrossRef Chang HJ, Freeman WJ, Burke BC (1998) Optimization of olfactory model in software to give 1/f power spectra reveals numerical instabilities in solutions governed by aperiodic (chaotic) attractors. Neural Netw 11(3):449–466CrossRef
8.
Zurück zum Zitat Liu JW, Liu Y, Luo XL (2014) Research and development on deep learning. Appl Res Comput 31(7):1921–1942 Liu JW, Liu Y, Luo XL (2014) Research and development on deep learning. Appl Res Comput 31(7):1921–1942
9.
Zurück zum Zitat Londhe ND, Kshirsagar GB, Tekchandani H (2018) Deep convolution neural network based speech recognition for Chhattisgarhi. In: 2018 5th international conference on signal processing and integrated networks (SPIN), pp 667–671 Londhe ND, Kshirsagar GB, Tekchandani H (2018) Deep convolution neural network based speech recognition for Chhattisgarhi. In: 2018 5th international conference on signal processing and integrated networks (SPIN), pp 667–671
10.
Zurück zum Zitat Mazumdar M, Sarasvathi V, Kumar A (2017) Object recognition in videos by sequential frame extraction using convolutional neural networks and fully connected neural networks. In: 2017 International conference on energy, communication, data analytics and soft computing (ICECDS), pp 1485–1488 Mazumdar M, Sarasvathi V, Kumar A (2017) Object recognition in videos by sequential frame extraction using convolutional neural networks and fully connected neural networks. In: 2017 International conference on energy, communication, data analytics and soft computing (ICECDS), pp 1485–1488
11.
Zurück zum Zitat Cheng FC, Zhang H, Fan WJ, Harris B (2018) Image recognition technology based on deep learning. Wirel Pers Commun 102:1917–1933CrossRef Cheng FC, Zhang H, Fan WJ, Harris B (2018) Image recognition technology based on deep learning. Wirel Pers Commun 102:1917–1933CrossRef
12.
Zurück zum Zitat Lin YO, Lei H, Li XY et al (2017) Deep learning in NLP: methods and applications. J Univ Electron Sci Technol China 46(6):919MATH Lin YO, Lei H, Li XY et al (2017) Deep learning in NLP: methods and applications. J Univ Electron Sci Technol China 46(6):919MATH
13.
Zurück zum Zitat Zhang J, Li G, Freeman WJ (2008) Algorithm for texture image generation based on a bionic model of olfactory neural networks. J Image Graph 05:977–983 Zhang J, Li G, Freeman WJ (2008) Algorithm for texture image generation based on a bionic model of olfactory neural networks. J Image Graph 05:977–983
14.
Zurück zum Zitat Li G, Zhang J, Freeman WJ (2006) Face recognition using a neural network simulating olfactory systems. Proc Third Int Symp Neural Netw 3972:93–97 Li G, Zhang J, Freeman WJ (2006) Face recognition using a neural network simulating olfactory systems. Proc Third Int Symp Neural Netw 3972:93–97
15.
Zurück zum Zitat Zhang J (2007) Research on bionic model of olfactory nerve system and its application. Zhejiang University, Hangzhou Zhang J (2007) Research on bionic model of olfactory nerve system and its application. Zhejiang University, Hangzhou
16.
Zurück zum Zitat Yao Y, Freeman WJ (1990) Model of biological pattern recognition with spatially chaotic dynamics. Neural Netw 3(2):153–170CrossRef Yao Y, Freeman WJ (1990) Model of biological pattern recognition with spatially chaotic dynamics. Neural Netw 3(2):153–170CrossRef
17.
Zurück zum Zitat Yao Y, Freeman WJ (1989) Pattern recognition in olfactory systems: modeling and simulation. In: International joint conference on neural networks. pp 699–704 Yao Y, Freeman WJ (1989) Pattern recognition in olfactory systems: modeling and simulation. In: International joint conference on neural networks. pp 699–704
18.
Zurück zum Zitat Chang HJ, Freeman WJ, Burke BC (1998) Biologically modeled noise stabilizing neurodynamics for pattern recognition. Int J Bifurc Chaos 08(2):321–345MATHCrossRef Chang HJ, Freeman WJ, Burke BC (1998) Biologically modeled noise stabilizing neurodynamics for pattern recognition. Int J Bifurc Chaos 08(2):321–345MATHCrossRef
19.
Zurück zum Zitat Li X, Li G, Wang L, Freeman WJ (2006) A study on a bionic pattern classifier based on olfactory neural system. Int J Bifurc Chaos 16(8):2425–2434MathSciNetMATHCrossRef Li X, Li G, Wang L, Freeman WJ (2006) A study on a bionic pattern classifier based on olfactory neural system. Int J Bifurc Chaos 16(8):2425–2434MathSciNetMATHCrossRef
20.
Zurück zum Zitat Freeman WJ, Yao Y, Burke B (1988) Central pattern generating and recognizing in olfactory-bulb: a correlation learning rule. Neural Netw 1(4):277–288CrossRef Freeman WJ, Yao Y, Burke B (1988) Central pattern generating and recognizing in olfactory-bulb: a correlation learning rule. Neural Netw 1(4):277–288CrossRef
21.
Zurück zum Zitat Zhang J, Li SD, Li G (2008) KIII model and its application to face recognition. Comput Eng Appl 44(13):245–248 Zhang J, Li SD, Li G (2008) KIII model and its application to face recognition. Comput Eng Appl 44(13):245–248
22.
Zurück zum Zitat Yang X, Fu J, Lou Z et al (2006) Tea classification based on artificial olfaction using bionic olfactory neural network. In: Wang J, Yi z, Zurada JM, Lu BL, Yin H (eds) Advances in neural networks, vol 3972. Springer, Berlin, pp 343–348 Yang X, Fu J, Lou Z et al (2006) Tea classification based on artificial olfaction using bionic olfactory neural network. In: Wang J, Yi z, Zurada JM, Lu BL, Yin H (eds) Advances in neural networks, vol 3972. Springer, Berlin, pp 343–348
23.
Zurück zum Zitat Zhang TL, Dai LS, Wang Y et al (2015) EEG spatiotemporal pattern classification of the stimuli on different fingers. In: Liljenström H (ed) Advances in cognitive neurodynamics (IV). Springer, Dordrecht, pp 147–153CrossRef Zhang TL, Dai LS, Wang Y et al (2015) EEG spatiotemporal pattern classification of the stimuli on different fingers. In: Liljenström H (ed) Advances in cognitive neurodynamics (IV). Springer, Dordrecht, pp 147–153CrossRef
24.
Zurück zum Zitat Vijaykumar P, Sunitha R, Pradhan N et al (2018) Simulation of cortical epileptic discharge using Freeman’s KIII model. In: Hemanth D, Smys S (eds) Computational vision and bio inspired computing, vol 28. Springer, Cham, pp 280–290CrossRef Vijaykumar P, Sunitha R, Pradhan N et al (2018) Simulation of cortical epileptic discharge using Freeman’s KIII model. In: Hemanth D, Smys S (eds) Computational vision and bio inspired computing, vol 28. Springer, Cham, pp 280–290CrossRef
25.
Zurück zum Zitat Garcia Rosa JL, Piazentin DRM (2016) A new cognitive filtering approach based on Freeman K3 Neural Networks. Appl Intell 45(2):363–382CrossRef Garcia Rosa JL, Piazentin DRM (2016) A new cognitive filtering approach based on Freeman K3 Neural Networks. Appl Intell 45(2):363–382CrossRef
26.
Zurück zum Zitat Bengio Y, Delalleau O (2011) On the expressive power of deep architectures. In: International conference on algorithmic learning theory, pp 18–36 Bengio Y, Delalleau O (2011) On the expressive power of deep architectures. In: International conference on algorithmic learning theory, pp 18–36
27.
Zurück zum Zitat Bottou L, Chapelle O, Decoste D et al (2007) Scaling learning algorithms toward AI. MIT Press, London, pp 321–359 Bottou L, Chapelle O, Decoste D et al (2007) Scaling learning algorithms toward AI. MIT Press, London, pp 321–359
28.
Zurück zum Zitat Chen YD, Li KL, Yang WD et al (2019) Performance-aware model for sparse matrix-matrix multiplication on the Sunway TaihuLight supercomputer. IEEE Trans Parallel Distrib Syst 30(4):923–938CrossRef Chen YD, Li KL, Yang WD et al (2019) Performance-aware model for sparse matrix-matrix multiplication on the Sunway TaihuLight supercomputer. IEEE Trans Parallel Distrib Syst 30(4):923–938CrossRef
29.
Zurück zum Zitat Xiao GQ et al (2017) Efficient monochromatic and bichromatic probabilistic reverse top-k query processing for uncertain big data. J Comput Syst Sci 89:92–113MathSciNetMATHCrossRef Xiao GQ et al (2017) Efficient monochromatic and bichromatic probabilistic reverse top-k query processing for uncertain big data. J Comput Syst Sci 89:92–113MathSciNetMATHCrossRef
30.
Zurück zum Zitat Xiao GQ et al (2017) Reporting l most influential objects in uncertain databases based on probabilistic reverse Top-k queries. Inf Sci 405:207–226CrossRef Xiao GQ et al (2017) Reporting l most influential objects in uncertain databases based on probabilistic reverse Top-k queries. Inf Sci 405:207–226CrossRef
31.
Zurück zum Zitat Chen JG et al (2019) A bi-layered parallel training architecture for large-scale convolutional neural networks. IEEE Trans Parallel Distrib Syst 30(5):965–976CrossRef Chen JG et al (2019) A bi-layered parallel training architecture for large-scale convolutional neural networks. IEEE Trans Parallel Distrib Syst 30(5):965–976CrossRef
33.
Zurück zum Zitat Andrzejak RG, Lehnertz K, Mormann F et al (2001) Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: dependence on recording region and brain state. Phys Rev E Stat Nonlinear Soft Matter Phys 64(6):61907CrossRef Andrzejak RG, Lehnertz K, Mormann F et al (2001) Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: dependence on recording region and brain state. Phys Rev E Stat Nonlinear Soft Matter Phys 64(6):61907CrossRef
34.
Zurück zum Zitat Chen SS (2013) Epileptic seizure detection based on Gradient Boosting algorithm. Shandong University, Shandong, pp 33–43 Chen SS (2013) Epileptic seizure detection based on Gradient Boosting algorithm. Shandong University, Shandong, pp 33–43
35.
Zurück zum Zitat Xiao GQ, Wu F, Zhou X, Li KL (2016) Probabilistic top-k range query processing for uncertain databases. J Intell Fuzzy Syst 31(2):1109–1120MATHCrossRef Xiao GQ, Wu F, Zhou X, Li KL (2016) Probabilistic top-k range query processing for uncertain databases. J Intell Fuzzy Syst 31(2):1109–1120MATHCrossRef
36.
Zurück zum Zitat Yuan Q, Zhou W, Liu Y, Wang J (2012) Epileptic seizure detection with linear and nonlinear features. Epilepsy Behav 24(4):415–421CrossRef Yuan Q, Zhou W, Liu Y, Wang J (2012) Epileptic seizure detection with linear and nonlinear features. Epilepsy Behav 24(4):415–421CrossRef
37.
Zurück zum Zitat Li SF, Zhou WD, Yuan Q et al (2013) Feature extraction and recognition of ictal EEG using EMD and SVM. Comput Biol Med 43(7):807–816CrossRef Li SF, Zhou WD, Yuan Q et al (2013) Feature extraction and recognition of ictal EEG using EMD and SVM. Comput Biol Med 43(7):807–816CrossRef
38.
Zurück zum Zitat Ur RN, Xia Y, Mandic DP (2010) Application of multivariate empirical mode decomposition for seizure detection in EEG signals. In: 32nd annual international conference of the IEEE EMBS Buenos Aires, pp 1650–1651 Ur RN, Xia Y, Mandic DP (2010) Application of multivariate empirical mode decomposition for seizure detection in EEG signals. In: 32nd annual international conference of the IEEE EMBS Buenos Aires, pp 1650–1651
39.
Zurück zum Zitat Zhang TH, Fan GH, Sun HY (2008) The detection of weak pulse laser echo signal by the kurtosis based on FPGA. Chin J Sci Instrum 29(4):288–291 Zhang TH, Fan GH, Sun HY (2008) The detection of weak pulse laser echo signal by the kurtosis based on FPGA. Chin J Sci Instrum 29(4):288–291
40.
Zurück zum Zitat Xiong B, Pan Q, Wen SP, Wang XD (2016) Diagnosis method based on the standard deviation and skewness of IDDT. Electron Meas Technol 39(5):163–166 Xiong B, Pan Q, Wen SP, Wang XD (2016) Diagnosis method based on the standard deviation and skewness of IDDT. Electron Meas Technol 39(5):163–166
41.
Zurück zum Zitat Tian B (2013) The rank and test of Kruskal–Wallis and its application. J Tonghua Normal Univ 34(5):13–14 Tian B (2013) The rank and test of Kruskal–Wallis and its application. J Tonghua Normal Univ 34(5):13–14
42.
Zurück zum Zitat Wang CM (2010) Research on feature extraction and automatic detection of epileptic EEG. East China University of Science and Technology, Shanghai, pp 70–84 Wang CM (2010) Research on feature extraction and automatic detection of epileptic EEG. East China University of Science and Technology, Shanghai, pp 70–84
43.
Zurück zum Zitat Lin CF (2016) Chaotic visual cryptosystem using empirical mode decomposition algorithm for clinical EEG signals. J Med Syst 40(3):40–52 Lin CF (2016) Chaotic visual cryptosystem using empirical mode decomposition algorithm for clinical EEG signals. J Med Syst 40(3):40–52
44.
Zurück zum Zitat Zhang J, Wei JH, Liu XF et al (2016) A novel application of empirical mode decomposition (EMD) to feature extraction of epileptic EEG. Int J Simul Syst Sci Technol 17(29):39.1–39.6 Zhang J, Wei JH, Liu XF et al (2016) A novel application of empirical mode decomposition (EMD) to feature extraction of epileptic EEG. Int J Simul Syst Sci Technol 17(29):39.1–39.6
45.
Zurück zum Zitat Guo TX, Ding XQ, Dong XQ et al (2013) New method of preprocessing IR remote sensing spectrum signals based on EMD. Infrared Laser Eng 42(12):3196–3200 Guo TX, Ding XQ, Dong XQ et al (2013) New method of preprocessing IR remote sensing spectrum signals based on EMD. Infrared Laser Eng 42(12):3196–3200
47.
Zurück zum Zitat Chen C et al (2019) Gated residual recurrent graph neural networks for traffic prediction. In: Proceedings of the 33th AAAI conference on artificial intelligence (AAAI 2019), pp 485–492 Chen C et al (2019) Gated residual recurrent graph neural networks for traffic prediction. In: Proceedings of the 33th AAAI conference on artificial intelligence (AAAI 2019), pp 485–492
Metadaten
Titel
Research on an olfactory neural system model and its applications based on deep learning
verfasst von
Jin Zhang
Tiantian Tian
Shengchun Wang
Xiaofei Liu
Xuanyu Shu
Ying Wang
Publikationsdatum
25.09.2019
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 10/2020
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-019-04498-x

Weitere Artikel der Ausgabe 10/2020

Neural Computing and Applications 10/2020 Zur Ausgabe