Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Learning Concave-Convex Profiles of Data Transport over Dedicated Connections Read chapter Read first chapter

2019 | OriginalPaper | Chapter

Reinforcement Learning Based Routing Protocols Analysis for Mobile Ad-Hoc Networks

Global Routing Versus Local Routing

Authors : Redha Mili, Salim Chikhi

Published in: Machine Learning for Networking

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Energy consumption and maximize lifetime routing in Mobile Ad hoc Network (MANETs) is one of the most important issues.
In our paper, we compare a global routing approach with a local routing approach both using reinforcement learning to maximize lifetime routing.
We first propose a global routing algorithm based on reinforcement learning algorithm called Q-learning then we compare his results with a local routing algorithm called AODV-SARSA.
Average delivery ratio, End to end delay and Time to Half Energy Depletion are used like metrics to compare both approach.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Towards a Better Compromise Between Shallow and Deep CNN for Binary Classification Problems of Unstructured Data
next chapter Deep Neural Ranking for Crowdsourced Geopolitical Event Forecasting
Literature
1.
Giordano, S.: Mobile Ad Hoc Networks. Handbook of Wireless Networks and Mobile Computing, pp. 325–346 (2002)
2.
Sutton, R.S., Barto, A.G.: Reinforcement Learning, 2nd edn. MIT Press, Cambridge (2014)MATH
3.
Perkins, C., Belding-Royer, E., Das, S.: Ad Hoc On-Demand Distance Vector (AODV) Routing. Network Working Group, July 2003. ftp://ftp.nordu.net/rfc/rfc3561.txt
4.
Watkins, C.J.C.H., Dayan, P.: Q-learning. Mach. Learn. 8, 279–292 (1992)MATH
5.
6.
Vassileva, N., Barcelo-Arroyo, F.: A survey of routing protocols for maximizing the lifetime of ad hoc wireless networks. Int. J. Softw. Eng. Appl. 2(3), 77–79 (2008)
7.
Cho, W., Kim, S.L.: A fully distributed routing algorithm for maximizing life time of a wireless ad hoc network. In: Proceedings of IEEE 4th International Conference on Workshop-Mobile & Wireless Communication Network, pp. 670–674, September 2002
8.
Naruephiphat, W., Usaha, W.: Balancing tradeoffs for energy-efficient routing in MANETs based on reinforcement learning. In: The IEEE 67th Vehicular Technology Conference (2008)
9.
Nurmi, P.: Reinforcement learning for routing in ad-hoc networks. In: Proceedings of the Fifth International Symposium on Modeling and Optimization in Mobile, Ad-Hoc, and Wireless Networks (WiOpt) (2007)
10.
Ravi, G., Kashwan, K.R.: A new routing protocol for energy efficient mobile applications for ad hoc networks. Comput. Electr. Eng. 48, 77–85 (2015)CrossRef
11.
Xu, Y., Heidemann, J., Estrin, D.: Geography informed energy conservation for ad-hoc routing. In: Proceedings of 7th Annual International Conference on Mobile Computing and Networking, pp. 70–84 (2001)
12.
Srinivasan, V., Nuggehalli, P., Chiasserini, C.F., Rao, R.R.: Cooperation in wireless ad hoc networks. In: Proceedings of the 22nd Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM), pp. 808–817. IEEE Computer Society (2003)
13.
Altman, E., Kherani, A.A., Michiardi, P., Molva, R.: Non-cooperative forwarding in ad-hoc networks. In Proceedings of the 15th IEEE International Symposium On Personal, Indoor and Mobile Radio Communications (2004)
14.
Chettibi, S., Chikhi, S.: An adaptive energy-aware routing protocol for MANETs using the SARSA reinforcement learning algorithm. In: IEEE Conference on Evolving and Adaptive Intelligent Systems (EAIS), pp. 84–89 (2012)
15.
Chettibi, S., Chikhi, S.: Adaptive maximum-lifetime routing in mobile ad-hoc networks using temporal difference reinforcement learning. Evol. Syst. 5, 89–108 (2014)CrossRef
16.
Chettibi, S., Chikhi, S.: Dynamic fuzzy (local routing) logic and reinforcement learning for adaptive energy efficient routing in mobile ad-hoc networks. Appl. Soft Comput. 38, 321–328 (2016)CrossRef
17.
Chettibi, S., Chikhi, S.: FEA-OLSR: an adaptive energy aware routing protocol for manets using zero-order sugeno fuzzy system. Int. J. Comput. Sci. Issues (IJCSI) 10(2), 136–141 (2013)
18.
Das, S.K., Tripathi, S.: Intelligent energy-aware efficient routing for MANET. Wirel. Netw. 24(4), 1139–1159 (2018)CrossRef
19.
Sutton, R., Barto, A.: Reinforcement Learning. MIT Press, Cambridge (1998)MATH
20.
Kim, D., Garcia-Luna-Aceves, J.J., Obraczka, K., Cano, J.C., Manzoni, P.: Power-aware routing based on the energy drain rate for mobile ad-hoc networks. In: 11th International Conference on Computer Communications and Networks (2002)
21.
Metadata
Title
Reinforcement Learning Based Routing Protocols Analysis for Mobile Ad-Hoc Networks
Authors
Redha Mili
Salim Chikhi
Copyright Year
2019
Book
Machine Learning for Networking

Print ISBN: 978-3-030-19944-9

Electronic ISBN: 978-3-030-19945-6

Copyright Year: 2019

DOI
https://doi.org/10.1007/978-3-030-19945-6_17

Premium Partner

    Image Credits