Skip to main content

2017 | OriginalPaper | Buchkapitel

10. Multiple-Valued Logic and Complex-Valued Neural Networks

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In classical multiple-valued logic its values are encoded by integers. This complicates the use of multiple-valued logic as a basic model, which can be utilized in an artificial neuron, because the values of k-valued logic encoded by integers 0, 1, 2, ..., k are not normalized. To overcome this obstacle, it was suggested to encode the values of k-valued logic by complex numbers located on the unit circle, namely by the kth roots of unity. It is described in the paper how this model of multiple-valued logic over the field of complex numbers was suggested and how it was used to develop a multi-valued neuron (MVN). Then it is considered how a feedforward neural network based on MVN—a multilayer neural network with multi-valued neurons (MLMVN) was designed and its derivative-free learning algorithm based on the error-correction learning rule was presented. Different applications of MLMVN, which outperforms many other machine learning tools in terms of learning speed and generalization capability are also observed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat N. N. Aizenberg, Yu. L. Ivaskiv, and D. A. Pospelov: About one generalization of the threshold function, Doklady Akademii Nauk SSSR (The Reports of the Academy of Sciences of the USSR), vol. 196, No 6, 1971, pp. 1287–1290 (in Russian).MathSciNet N. N. Aizenberg, Yu. L. Ivaskiv, and D. A. Pospelov: About one generalization of the threshold function, Doklady Akademii Nauk SSSR (The Reports of the Academy of Sciences of the USSR), vol. 196, No 6, 1971, pp. 1287–1290 (in Russian).MathSciNet
2.
Zurück zum Zitat N. N. Aizenberg, Yu. L. Ivaskiv, D. A. Pospelov, and G.F. Hudiakov: Multivalued Threshold Functions. Synthesis of Multivalued Threshold Elements, Cybernetics and Systems Analysis, vol. 9, No 1, 1973, pp. 61–77. N. N. Aizenberg, Yu. L. Ivaskiv, D. A. Pospelov, and G.F. Hudiakov: Multivalued Threshold Functions. Synthesis of Multivalued Threshold Elements, Cybernetics and Systems Analysis, vol. 9, No 1, 1973, pp. 61–77.
3.
Zurück zum Zitat N. N. Aizenberg and Yu. L. Ivaskiv: Multiple-Valued Threshold Logic, Naukova Dumka Publisher House, Kiev, 1977 (in Russian). N. N. Aizenberg and Yu. L. Ivaskiv: Multiple-Valued Threshold Logic, Naukova Dumka Publisher House, Kiev, 1977 (in Russian).
4.
Zurück zum Zitat C. Moraga: Complex Spectral Logic, Proceedings of the 8th IEEE International symposium on Multiple-valued Logic, IEEE Computer Society Press, 1978, pp. 149–156. C. Moraga: Complex Spectral Logic, Proceedings of the 8th IEEE International symposium on Multiple-valued Logic, IEEE Computer Society Press, 1978, pp. 149–156.
5.
Zurück zum Zitat C. Moraga: On some Applications of the Chrestenson Functions in Logic Design and Data Processing, Mathematics and Computers in Simulation, vol. 27, Issues 5–6, October 1985, pp. 431–439.MathSciNetCrossRefMATH C. Moraga: On some Applications of the Chrestenson Functions in Logic Design and Data Processing, Mathematics and Computers in Simulation, vol. 27, Issues 5–6, October 1985, pp. 431–439.MathSciNetCrossRefMATH
6.
Zurück zum Zitat N. N. Aizenberg and I. N. Aizenberg: CNN Based on Multi-Valued Neuron as a Model of Associative Memory for Gray-Scale Images, Proceedings of the Second IEEE Int. Workshop on Cellular Neural Networks and their Applications, Technical University Munich, Germany October 1992, pp. 36–41. N. N. Aizenberg and I. N. Aizenberg: CNN Based on Multi-Valued Neuron as a Model of Associative Memory for Gray-Scale Images, Proceedings of the Second IEEE Int. Workshop on Cellular Neural Networks and their Applications, Technical University Munich, Germany October 1992, pp. 36–41.
7.
Zurück zum Zitat I Aizenberg, N Aizenberg, J. Hiltner, C. Moraga and E Meyer Zu Bexten: Cellular neural networks and computational intelligence in medical image processing, Image and Vision Computing, vol. 19, Issue 4, March 2001, pp. 177–183.CrossRef I Aizenberg, N Aizenberg, J. Hiltner, C. Moraga and E Meyer Zu Bexten: Cellular neural networks and computational intelligence in medical image processing, Image and Vision Computing, vol. 19, Issue 4, March 2001, pp. 177–183.CrossRef
8.
Zurück zum Zitat I. Aizenberg and C. Moraga: Multilayer Feedforward Neural Network Based on Multi-Valued Neurons (MLMVN) and a Backpropagation Learning Algorithm, Soft Computing, vol. 11, No 2, January 2007, pp. 169–183.CrossRef I. Aizenberg and C. Moraga: Multilayer Feedforward Neural Network Based on Multi-Valued Neurons (MLMVN) and a Backpropagation Learning Algorithm, Soft Computing, vol. 11, No 2, January 2007, pp. 169–183.CrossRef
9.
Zurück zum Zitat I. Aizenberg, C. Moraga, and D. Paliy: A Feedforward Neural Network based on Multi-Valued Neurons, In Computational Intelligence, Theory and Applications. Advances in Soft Computing, XIV, B. Reusch, Ed., Springer, Berlin, Heidelberg, New York, 2005, pp. 599–612. I. Aizenberg, C. Moraga, and D. Paliy: A Feedforward Neural Network based on Multi-Valued Neurons, In Computational Intelligence, Theory and Applications. Advances in Soft Computing, XIV, B. Reusch, Ed., Springer, Berlin, Heidelberg, New York, 2005, pp. 599–612.
10.
Zurück zum Zitat I. Aizenberg: Complex-valued neural networks with multi-valued neurons, Springer, Hidelberg, 2011.CrossRefMATH I. Aizenberg: Complex-valued neural networks with multi-valued neurons, Springer, Hidelberg, 2011.CrossRefMATH
11.
Zurück zum Zitat W. S. McCulloch and W. Pits: A Logical Calculus of the Ideas Immanent in Nervous Activity, Bull. Math. Biophys., vol. 5, 1943. pp. 115–133.MathSciNetCrossRefMATH W. S. McCulloch and W. Pits: A Logical Calculus of the Ideas Immanent in Nervous Activity, Bull. Math. Biophys., vol. 5, 1943. pp. 115–133.MathSciNetCrossRefMATH
12.
Zurück zum Zitat J. Łukasiewicz: O logice trójwartościowej (in Polish), Ruch filozoficzny No 5, 1920, pp.170–171. English translation: On three-valued logic, in L. Borkowski (ed.), Selected works by Jan Łukasiewicz, North–Holland, Amsterdam, 1970, pp. 87-88. J. Łukasiewicz: O logice trójwartościowej (in Polish), Ruch filozoficzny No 5, 1920, pp.170–171. English translation: On three-valued logic, in L. Borkowski (ed.), Selected works by Jan Łukasiewicz, North–Holland, Amsterdam, 1970, pp. 87-88.
13.
Zurück zum Zitat G. M. Georgiou: The Multivalued and Continuous Perceptrons, Proceedings of 1993 World Congress on Neural Networks, vol. 4 , pp. 679–683. G. M. Georgiou: The Multivalued and Continuous Perceptrons, Proceedings of 1993 World Congress on Neural Networks, vol. 4 , pp. 679–683.
14.
Zurück zum Zitat F. Rosenblatt On the Convergence of Reinforcement Procedures in Simple Perceptron. Report VG 1196-G-4. Cornell Aeronautical Laboratory, Buffalo, NY, 1960. F. Rosenblatt On the Convergence of Reinforcement Procedures in Simple Perceptron. Report VG 1196-G-4. Cornell Aeronautical Laboratory, Buffalo, NY, 1960.
15.
Zurück zum Zitat N. N. Aizenberg, I.N. Aizenberg, and G.A. Krivosheev: Multi-Valued Neurons: Learning, Networks, Application to Image Recognition and Extrapolation of Temporal Serie, Lecture Notes in Computer Science, vol. 930 (J.Mira, F.Sandoval—Eds.), Springer, 1995, pp. 389–395. N. N. Aizenberg, I.N. Aizenberg, and G.A. Krivosheev: Multi-Valued Neurons: Learning, Networks, Application to Image Recognition and Extrapolation of Temporal Serie, Lecture Notes in Computer Science, vol. 930 (J.Mira, F.Sandoval—Eds.), Springer, 1995, pp. 389–395.
16.
Zurück zum Zitat I. Aizenberg: A Periodic Activation Function and a Modified Learning Algorithm for a Multi-Valued Neuron, IEEE Transactions on Neural Networks, vol. 21, No 12, December 2010, pp. 1939–1949.CrossRef I. Aizenberg: A Periodic Activation Function and a Modified Learning Algorithm for a Multi-Valued Neuron, IEEE Transactions on Neural Networks, vol. 21, No 12, December 2010, pp. 1939–1949.CrossRef
17.
Zurück zum Zitat I. Aizenberg: Solving the XOR and Parity n Problems Using a Single Universal Binary Neuron, Soft Computing, vol. 12, No 3, February 2008, pp. 215–222.MathSciNetCrossRefMATH I. Aizenberg: Solving the XOR and Parity n Problems Using a Single Universal Binary Neuron, Soft Computing, vol. 12, No 3, February 2008, pp. 215–222.MathSciNetCrossRefMATH
18.
Zurück zum Zitat I. Aizenberg, M. Caudill, J. Jackson, and S. Alexander: Learning Nonlinearly Separable mod k Addition Problem Using a Single Multi-Valued Neuron With a Periodic Activation Function, Proceedings of the 2010 IEEE World Congress on Computational Intelligence—2010 IEEE International Joint Conference on Neural Networks, Barcelona, Spain, July 18-23, 2010, pp. 2577–2584. I. Aizenberg, M. Caudill, J. Jackson, and S. Alexander: Learning Nonlinearly Separable mod k Addition Problem Using a Single Multi-Valued Neuron With a Periodic Activation Function, Proceedings of the 2010 IEEE World Congress on Computational Intelligence—2010 IEEE International Joint Conference on Neural Networks, Barcelona, Spain, July 18-23, 2010, pp. 2577–2584.
20.
Zurück zum Zitat D. E. Rumelhart, G.E. Hilton, R. J. Williams: Learning Internal Representations by Error Propagation. In: D.E. Rumelhart and J.L. McClelland (eds.): Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1, Chapter 8. MIT Press, Cambridge, Massachusetts, 1986, pp. 318–362. D. E. Rumelhart, G.E. Hilton, R. J. Williams: Learning Internal Representations by Error Propagation. In: D.E. Rumelhart and J.L. McClelland (eds.): Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1, Chapter 8. MIT Press, Cambridge, Massachusetts, 1986, pp. 318–362.
21.
Zurück zum Zitat I. Aizenberg and C. Moraga: The Genetic Code as a Function of Multiple-Valued Logic Over the Field of Complex Numbers and its Learning using Multilayer Neural Network Based on Multi-Valued Neurons, Journal of Multiple-Valued Logic and Soft Computing, No 4-6, November 2007, pp. 605–618.MATH I. Aizenberg and C. Moraga: The Genetic Code as a Function of Multiple-Valued Logic Over the Field of Complex Numbers and its Learning using Multilayer Neural Network Based on Multi-Valued Neurons, Journal of Multiple-Valued Logic and Soft Computing, No 4-6, November 2007, pp. 605–618.MATH
22.
Zurück zum Zitat I. Aizenberg, D. Paliy, J. Zurada, and J. Astola: Blur Identification by Multilayer Neural Network based on Multi-Valued Neurons, IEEE Transactions on Neural Networks, vol. 19, No 5, May 2008, pp. 883–898.CrossRef I. Aizenberg, D. Paliy, J. Zurada, and J. Astola: Blur Identification by Multilayer Neural Network based on Multi-Valued Neurons, IEEE Transactions on Neural Networks, vol. 19, No 5, May 2008, pp. 883–898.CrossRef
23.
Zurück zum Zitat Aizenberg I., Alexander S., and Jackson J.: Recognition of Blurred Images Using Multilayer Neural Network Based on Multi-Valued Neurons, Proceedings of the 41st IEEE International Symposium on Multiple-Valued Logic (ISMVL-2011), to appear in the Proceedings, May 23-35, 2011, IEEE Computer Society Press, pp. 282–287. Aizenberg I., Alexander S., and Jackson J.: Recognition of Blurred Images Using Multilayer Neural Network Based on Multi-Valued Neurons, Proceedings of the 41st IEEE International Symposium on Multiple-Valued Logic (ISMVL-2011), to appear in the Proceedings, May 23-35, 2011, IEEE Computer Society Press, pp. 282–287.
24.
Zurück zum Zitat Manyakov N.V., Aizenberg I., Chumerin N., and Van Hulle M.: Phase-Coded Brain-Computer Interface Based on MLMVN, in: A. Hirose (ed): Complex-Valued Neural Networks: Advances and Applications, Wiley, 2013, pp. 185–208. Manyakov N.V., Aizenberg I., Chumerin N., and Van Hulle M.: Phase-Coded Brain-Computer Interface Based on MLMVN, in: A. Hirose (ed): Complex-Valued Neural Networks: Advances and Applications, Wiley, 2013, pp. 185–208.
25.
Zurück zum Zitat Fink O., Zio E., and Weidmann U.: Predicting time series of railway speed restrictions with time-dependent machine learning techniques, Expert Systems with Applications, vol. 40(15), No 11, 2013, pp. 6033–6040. Fink O., Zio E., and Weidmann U.: Predicting time series of railway speed restrictions with time-dependent machine learning techniques, Expert Systems with Applications, vol. 40(15), No 11, 2013, pp. 6033–6040.
26.
Zurück zum Zitat Aizenberg I., Sheremetov L., Villa-Vargas L., and Martinez-Muñoz J.: Multilayer Neural Network with Multi-Valued Neurons in Time Series Forecasting of Oil Production, Neurcomputing, published “Online first” , December 2015, published in a hard copy Vol. 175, Part B, 29 January 2016, pp. 980–989. Aizenberg I., Sheremetov L., Villa-Vargas L., and Martinez-Muñoz J.: Multilayer Neural Network with Multi-Valued Neurons in Time Series Forecasting of Oil Production, Neurcomputing, published “Online first” , December 2015, published in a hard copy Vol. 175, Part B, 29 January 2016, pp. 980–989.
27.
Zurück zum Zitat I. Aizenberg: MLMVN with Soft Margins Learning, IEEE Transactions on Neural Networks and Learning Systems, vol. 25, No 9, September 2014, pp. 1632–1644.CrossRef I. Aizenberg: MLMVN with Soft Margins Learning, IEEE Transactions on Neural Networks and Learning Systems, vol. 25, No 9, September 2014, pp. 1632–1644.CrossRef
28.
Zurück zum Zitat I. Aizenberg. A. Luchetta, and S. Manetti: A modified Learning Algorithms for the Multilayer Neural Network with Multi-Valued Neurons based on the Complex QR Decomposition, Soft Computing, vol. 16, April 2012, pp. 563–575. I. Aizenberg. A. Luchetta, and S. Manetti: A modified Learning Algorithms for the Multilayer Neural Network with Multi-Valued Neurons based on the Complex QR Decomposition, Soft Computing, vol. 16, April 2012, pp. 563–575.
29.
Zurück zum Zitat I. Aizenberg and E. Aizenberg: Batch LLS-based Learning Algorithm for MLMVN with Soft Margins, Proceedings of the 2014 IEEE Symposium Series of Computational Intelligence (SSCI-2014), December, 2014, pp. 48–55. I. Aizenberg and E. Aizenberg: Batch LLS-based Learning Algorithm for MLMVN with Soft Margins, Proceedings of the 2014 IEEE Symposium Series of Computational Intelligence (SSCI-2014), December, 2014, pp. 48–55.
Metadaten
Titel
Multiple-Valued Logic and Complex-Valued Neural Networks
verfasst von
Igor Aizenberg
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-48317-7_10