Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Fast CNN Pruning via Redundancy-Aware Training Read chapter Read first chapter

2018 | OriginalPaper | Chapter

Joint Application of Group Determination of Parameters and of Training with Noise Addition to Improve the Resilience of the Neural Network Solution of the Inverse Problem in Spectroscopy to Noise in Data

Authors : Igor Isaev, Sergey Burikov, Tatiana Dolenko, Kirill Laptinskiy, Alexey Vervald, Sergey Dolenko

Published in: Artificial Neural Networks and Machine Learning – ICANN 2018

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In most cases, inverse problems are ill-posed or ill-conditioned, which is the reason for high sensitivity of their solution to noise in the input data. Despite the fact that neural networks have the ability to work with noisy data, in the case of inverse problems, this is not enough, because the incorrectness of the problem “outweighs” the ability of the neural network. In previous studies, the authors have shown that separate use of methods of group determination of parameters and of noise addition during training of neural networks can improve the resilience of the solution to noise in the input data. This study is devoted to the investigation of joint application of these methods. The study is performed at the example of an inverse problem in laser Raman spectroscopy - determination of concentrations of ions in a solution of inorganic salts by Raman spectrum of the solution.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Generation of Reference Trajectories for Safe Trajectory Planning
next chapter Generating Natural Answers on Knowledge Bases and Text by Sequence-to-Sequence Learning
Literature
1.
Zhdanov, M.: Inverse Theory and Applications in Geophysics, 2nd edn. Elsevier, Amsterdam (2015)
2.
Yagola, A., Kochikov, I., Kuramshina, G.: Inverse Problems of Vibrational Spectroscopy. De Gruyter, Berlin (1999)CrossRef
3.
Mohammad-Djafari, A. (ed.): Inverse Problems in Vision and 3D Tomography. Wiley, Hoboken (2010)
4.
Zhdanov, M.S.: Geophysical Electromagnetic Theory and Methods. Methods in Geochemistry and Geophysics, vol. 43. Elsevier, Amsterdam (2009)
5.
Spichak, V.V. (ed.): Electromagnetic Sounding of the Earth’s Interior. Methods in Geochemistry and Geophysics, vol. 40. Elsevier, Amsterdam (2006)
6.
Isaev, I., Dolenko, S.: Comparative analysis of residual minimization and artificial neural networks as methods of solving inverse problems: test on model data. In: Samsonovich, A., Klimov, V., Rybina, G. (eds.) Biologically Inspired Cognitive Architectures (BICA) for Young Scientists. Advances in Intelligent Systems and Computing, vol. 449, pp. 289–295. Springer, Cham (2016). https://​doi.​org/​10.​1007/​978-3-319-32554-5_​37CrossRef
7.
Isaev, I., Obornev, E., Obornev, I., Shimelevich, M., Dolenko, S.: Increase of the resistance to noise in data for neural network solution of the inverse problem of magnetotellurics with group determination of parameters. In: Villa, A., Masulli, P., Pons Rivero, A. (eds.) ICANN 2016, LNCS, vol. 9886, pp. 502–509. Springer, Cham (2016). https://​doi.​org/​10.​1007/​978-3-319-44778-0_​59CrossRef
8.
Isaev, I., Vervald, E., Sarmanova, O., Dolenko, S.: Neural network solution of an inverse problem in Raman spectroscopy of multi-component solutions of inorganic salts: group determination as a method to increase noise resilience of the solution. Procedia Comput. Sci. 123, 177–182 (2018)CrossRef
9.
Holmstrom, L., Koistinen, P.: Using additive noise in back-propagation training. IEEE Trans. Neural Netw. 3(1), 24–38 (1992)CrossRef
10.
Matsuoka, K.: Noise injection into inputs in back-propagation learning. IEEE Trans. Syst. Man Cybern. 22(3), 436–440 (1992)CrossRef
11.
Bishop, C.M.: Training with noise is equivalent to Tikhonov regularization. Neural Comput. 7(1), 108–116 (1995)CrossRef
12.
An, G.: The effects of adding noise during back propagation training on a generalization performance. Neural Comput. 8(3), 643–674 (1996)MathSciNetCrossRef
13.
Zur, R.M., Jiang, Y., Pesce, L.L., Drukker, K.: Noise injection for training artificial neural networks: a comparison with weight decay and early stopping. Med. Phys. 36(10), 4810–4818 (2009)CrossRef
14.
Piotrowski, A.P., Napiorkowski, J.J.: A comparison of methods to avoid overfitting in neural networks training in the case of catchment runoff modeling. J. Hydrol. 476, 97–111 (2013)CrossRef
15.
Wang, C., Principe, J.C.: Training neural networks with additive noise in the desired signal. IEEE Trans. Neural Netw. 10(6), 1511–1517 (1999)CrossRef
16.
Yin, S., et al.: Noisy training for deep neural networks in speech recognition. EURASIP J. Audio Speech Music. Process. 2015(2), 1–14 (2015)
17.
Isaev, I.V., Dolenko, S.A.: Training with noise as a method to increase noise resilience of neural network solution of inverse problems. Opt. Mem. Neural Netw. (Inf. Opt.) 25(3), 142–148 (2016)CrossRef
18.
Isaev, I.V., Dolenko, S.A.: Adding noise during training as a method to increase resilience of neural network solution of inverse problems: test on the data of magnetotelluric sounding problem. In: Kryzhanovsky, B., Dunin-Barkowski, W., Redko, V. (eds.) Neuroinformatics 2017. Studies in Computational Intelligence, vol. 736, pp. 9–16. Springer, Cham (2018). https://​doi.​org/​10.​1007/​978-3-319-66604-4_​2CrossRef
19.
Baldwin, S.F., Brown, C.W.: Detection of ionic water pollutants by laser excited Raman spectroscopy. Water Res. 6, 1601–1604 (1972)CrossRef
20.
Rudolph, W.W., Irmer, G.: Raman and infrared spectroscopic investigation on aqueous alkali metal phosphate solutions and density functional theory calculations of phosphate-water clusters. Appl. Spectrosc. 61(12), 274A–292A (2007)CrossRef
21.
Furic, K., Ciglenecki, I., Cosovic, B.: Raman spectroscopic study of sodium chloride water solutions. J. Mol. Struct. 6, 225–234 (2000)CrossRef
22.
Dolenko, T.A., Churina, I.V., Fadeev, V.V., Glushkov, S.M.: Valence band of liquid water Raman scattering: some peculiarities and applications in the diagnostics of water media. J. Raman Spectrosc. 31(8–9), 863–870 (2000)CrossRef
23.
Rull, F., De Saja, J.A.: Effect of electrolyte concentration on the Raman spectra of water in aqueous solutions. J. Raman Spectrosc. 17(2), 167–172 (1986)CrossRef
24.
Gogolinskaia, T.A., Patsaeva, S.V., Fadeev, V.V.: The regularities of change of the 3100–3700 cm−1 band of water Raman scattering in salt aqueous solutions. Dokl. Akad. Nauk SSSR 290(5), 1099–1103 (1986)
Metadata
Title
Joint Application of Group Determination of Parameters and of Training with Noise Addition to Improve the Resilience of the Neural Network Solution of the Inverse Problem in Spectroscopy to Noise in Data
Authors
Igor Isaev
Sergey Burikov
Tatiana Dolenko
Kirill Laptinskiy
Alexey Vervald
Sergey Dolenko
Copyright Year
2018
Book
Artificial Neural Networks and Machine Learning – ICANN 2018

Print ISBN: 978-3-030-01417-9

Electronic ISBN: 978-3-030-01418-6

Copyright Year: 2018

DOI
https://doi.org/10.1007/978-3-030-01418-6_43

Premium Partner

    Image Credits