Skip to main content
Top

2018 | OriginalPaper | Chapter

An Algorithm for Text Prediction Using Neural Networks

Authors : Bindu K. R., Aakash C., Bernett Orlando, Latha Parameswaran

Published in: Computational Vision and Bio Inspired Computing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Neural networks have become increasingly popular for the task of language modeling. Whereas feed-forward networks only exploit a fixed context length to predict the next word of a sequence, conceptually, standard recurrent neural networks can take into account all of the predecessor words. In this paper, an algorithm using machine learning which, when given a dataset of conversations, is able to train itself using Neural Networks which can then be used to get suggestions for replies for any particular input sentence is proposed. Currently, smart suggestions have been implemented in chat applications. Google uses similar techniques to provide smart replies in Email through which the user can reply to a particular email with just a single tap.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Sundermeyer, M., Schlüter, R., Ney, H.: LSTM Neural Networks for Language Modeling. In: Interspeech, pp. 194–197 (2012) Sundermeyer, M., Schlüter, R., Ney, H.: LSTM Neural Networks for Language Modeling. In: Interspeech, pp. 194–197 (2012)
2.
go back to reference Mikolov, T., et al.: Recurrent neural network based language model. In: Interspeech, vol. 2, pp. 1045–1048 (2010) Mikolov, T., et al.: Recurrent neural network based language model. In: Interspeech, vol. 2, pp. 1045–1048 (2010)
3.
go back to reference Anlauf, J.K., Biehl, M.: The adatron: an adaptive perceptron algorithm. EPL (Europhysics Letters) 10(7), 687 (1989)CrossRef Anlauf, J.K., Biehl, M.: The adatron: an adaptive perceptron algorithm. EPL (Europhysics Letters) 10(7), 687 (1989)CrossRef
4.
go back to reference Bindu, K.R., Parameswaran, L., Soumya, K.V.: Performance evaluation of topic modelling algorithms with an application of Q & A dataset. Int. J. Appl. Eng. Res. 10, 23–27 (2015) Bindu, K.R., Parameswaran, L., Soumya, K.V.: Performance evaluation of topic modelling algorithms with an application of Q & A dataset. Int. J. Appl. Eng. Res. 10, 23–27 (2015)
5.
go back to reference Bindu, K.R., Parameswaran, L., Nambiar, S.R., Chandran, J.: Performance evaluation of algorithms for expert finding on an open email dataset. Int. J. Appl. Eng. Res. 10, 71–75 (2015) Bindu, K.R., Parameswaran, L., Nambiar, S.R., Chandran, J.: Performance evaluation of algorithms for expert finding on an open email dataset. Int. J. Appl. Eng. Res. 10, 71–75 (2015)
6.
go back to reference Bebis, G., Georgiopoulos, M.: Feed-forward neural networks. IEEE Potentials 13(4), 27–31(1994) Bebis, G., Georgiopoulos, M.: Feed-forward neural networks. IEEE Potentials 13(4), 27–31(1994)
7.
go back to reference Jarmo, I., Kamarainen, J.K., Lampinen, J.: Differential evolution training algorithm for feed-forward neural networks. Neural Process. Lett. 17(1), 93–105 (2003) Jarmo, I., Kamarainen, J.K., Lampinen, J.: Differential evolution training algorithm for feed-forward neural networks. Neural Process. Lett. 17(1), 93–105 (2003)
8.
go back to reference Baddeley, A.D., Thomson, N., Buchan, M.: Word length and the structure of short-term memory. J. Verbal Learn. Verbal Behavior 14(6), pp. 575–589 (1975) Baddeley, A.D., Thomson, N., Buchan, M.: Word length and the structure of short-term memory. J. Verbal Learn. Verbal Behavior 14(6), pp. 575–589 (1975)  
9.
go back to reference Funahashi, K.-I., Nakamura, Y.: Approximation of dynamical systems by continuous time re current neural networks. Neural Netw. 6(6), 801–806 (1993)CrossRef Funahashi, K.-I., Nakamura, Y.: Approximation of dynamical systems by continuous time re current neural networks. Neural Netw. 6(6), 801–806 (1993)CrossRef
10.
go back to reference Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRef Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRef
11.
go back to reference Jizhou, J., Zhou, M., Yang, D.: Extracting chatbot knowledge from online discussion forums. IJCAI 7, pp. 423–428 (2007) Jizhou, J., Zhou, M., Yang, D.: Extracting chatbot knowledge from online discussion forums. IJCAI 7, pp. 423–428  (2007)  
12.
go back to reference Jiyou, J.: The study of the application of a web-based chatbot system on the teaching of foreign languages. In: Proceedings of SITE, vol. 4, pp. 1201–1207 (2004) Jiyou, J.: The study of the application of a web-based chatbot system on the teaching of foreign languages. In: Proceedings of SITE, vol. 4, pp. 1201–1207 (2004)  
Metadata
Title
An Algorithm for Text Prediction Using Neural Networks
Authors
Bindu K. R.
Aakash C.
Bernett Orlando
Latha Parameswaran
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-71767-8_15