Skip to main content

2019 | OriginalPaper | Buchkapitel

Reinforcement Learning Based Routing Protocols Analysis for Mobile Ad-Hoc Networks

Global Routing Versus Local Routing

verfasst von : Redha Mili, Salim Chikhi

Erschienen in: Machine Learning for Networking

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Energy consumption and maximize lifetime routing in Mobile Ad hoc Network (MANETs) is one of the most important issues.
In our paper, we compare a global routing approach with a local routing approach both using reinforcement learning to maximize lifetime routing.
We first propose a global routing algorithm based on reinforcement learning algorithm called Q-learning then we compare his results with a local routing algorithm called AODV-SARSA.
Average delivery ratio, End to end delay and Time to Half Energy Depletion are used like metrics to compare both approach.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Giordano, S.: Mobile Ad Hoc Networks. Handbook of Wireless Networks and Mobile Computing, pp. 325–346 (2002) Giordano, S.: Mobile Ad Hoc Networks. Handbook of Wireless Networks and Mobile Computing, pp. 325–346 (2002)
2.
Zurück zum Zitat Sutton, R.S., Barto, A.G.: Reinforcement Learning, 2nd edn. MIT Press, Cambridge (2014)MATH Sutton, R.S., Barto, A.G.: Reinforcement Learning, 2nd edn. MIT Press, Cambridge (2014)MATH
3.
Zurück zum Zitat Perkins, C., Belding-Royer, E., Das, S.: Ad Hoc On-Demand Distance Vector (AODV) Routing. Network Working Group, July 2003. ftp://ftp.nordu.net/rfc/rfc3561.txt Perkins, C., Belding-Royer, E., Das, S.: Ad Hoc On-Demand Distance Vector (AODV) Routing. Network Working Group, July 2003. ftp://ftp.nordu.net/rfc/rfc3561.txt
4.
Zurück zum Zitat Watkins, C.J.C.H., Dayan, P.: Q-learning. Mach. Learn. 8, 279–292 (1992)MATH Watkins, C.J.C.H., Dayan, P.: Q-learning. Mach. Learn. 8, 279–292 (1992)MATH
6.
Zurück zum Zitat Vassileva, N., Barcelo-Arroyo, F.: A survey of routing protocols for maximizing the lifetime of ad hoc wireless networks. Int. J. Softw. Eng. Appl. 2(3), 77–79 (2008) Vassileva, N., Barcelo-Arroyo, F.: A survey of routing protocols for maximizing the lifetime of ad hoc wireless networks. Int. J. Softw. Eng. Appl. 2(3), 77–79 (2008)
7.
Zurück zum Zitat Cho, W., Kim, S.L.: A fully distributed routing algorithm for maximizing life time of a wireless ad hoc network. In: Proceedings of IEEE 4th International Conference on Workshop-Mobile & Wireless Communication Network, pp. 670–674, September 2002 Cho, W., Kim, S.L.: A fully distributed routing algorithm for maximizing life time of a wireless ad hoc network. In: Proceedings of IEEE 4th International Conference on Workshop-Mobile & Wireless Communication Network, pp. 670–674, September 2002
8.
Zurück zum Zitat Naruephiphat, W., Usaha, W.: Balancing tradeoffs for energy-efficient routing in MANETs based on reinforcement learning. In: The IEEE 67th Vehicular Technology Conference (2008) Naruephiphat, W., Usaha, W.: Balancing tradeoffs for energy-efficient routing in MANETs based on reinforcement learning. In: The IEEE 67th Vehicular Technology Conference (2008)
9.
Zurück zum Zitat Nurmi, P.: Reinforcement learning for routing in ad-hoc networks. In: Proceedings of the Fifth International Symposium on Modeling and Optimization in Mobile, Ad-Hoc, and Wireless Networks (WiOpt) (2007) Nurmi, P.: Reinforcement learning for routing in ad-hoc networks. In: Proceedings of the Fifth International Symposium on Modeling and Optimization in Mobile, Ad-Hoc, and Wireless Networks (WiOpt) (2007)
10.
Zurück zum Zitat Ravi, G., Kashwan, K.R.: A new routing protocol for energy efficient mobile applications for ad hoc networks. Comput. Electr. Eng. 48, 77–85 (2015)CrossRef Ravi, G., Kashwan, K.R.: A new routing protocol for energy efficient mobile applications for ad hoc networks. Comput. Electr. Eng. 48, 77–85 (2015)CrossRef
11.
Zurück zum Zitat Xu, Y., Heidemann, J., Estrin, D.: Geography informed energy conservation for ad-hoc routing. In: Proceedings of 7th Annual International Conference on Mobile Computing and Networking, pp. 70–84 (2001) Xu, Y., Heidemann, J., Estrin, D.: Geography informed energy conservation for ad-hoc routing. In: Proceedings of 7th Annual International Conference on Mobile Computing and Networking, pp. 70–84 (2001)
12.
Zurück zum Zitat Srinivasan, V., Nuggehalli, P., Chiasserini, C.F., Rao, R.R.: Cooperation in wireless ad hoc networks. In: Proceedings of the 22nd Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM), pp. 808–817. IEEE Computer Society (2003) Srinivasan, V., Nuggehalli, P., Chiasserini, C.F., Rao, R.R.: Cooperation in wireless ad hoc networks. In: Proceedings of the 22nd Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM), pp. 808–817. IEEE Computer Society (2003)
13.
Zurück zum Zitat Altman, E., Kherani, A.A., Michiardi, P., Molva, R.: Non-cooperative forwarding in ad-hoc networks. In Proceedings of the 15th IEEE International Symposium On Personal, Indoor and Mobile Radio Communications (2004) Altman, E., Kherani, A.A., Michiardi, P., Molva, R.: Non-cooperative forwarding in ad-hoc networks. In Proceedings of the 15th IEEE International Symposium On Personal, Indoor and Mobile Radio Communications (2004)
14.
Zurück zum Zitat Chettibi, S., Chikhi, S.: An adaptive energy-aware routing protocol for MANETs using the SARSA reinforcement learning algorithm. In: IEEE Conference on Evolving and Adaptive Intelligent Systems (EAIS), pp. 84–89 (2012) Chettibi, S., Chikhi, S.: An adaptive energy-aware routing protocol for MANETs using the SARSA reinforcement learning algorithm. In: IEEE Conference on Evolving and Adaptive Intelligent Systems (EAIS), pp. 84–89 (2012)
15.
Zurück zum Zitat Chettibi, S., Chikhi, S.: Adaptive maximum-lifetime routing in mobile ad-hoc networks using temporal difference reinforcement learning. Evol. Syst. 5, 89–108 (2014)CrossRef Chettibi, S., Chikhi, S.: Adaptive maximum-lifetime routing in mobile ad-hoc networks using temporal difference reinforcement learning. Evol. Syst. 5, 89–108 (2014)CrossRef
16.
Zurück zum Zitat Chettibi, S., Chikhi, S.: Dynamic fuzzy (local routing) logic and reinforcement learning for adaptive energy efficient routing in mobile ad-hoc networks. Appl. Soft Comput. 38, 321–328 (2016)CrossRef Chettibi, S., Chikhi, S.: Dynamic fuzzy (local routing) logic and reinforcement learning for adaptive energy efficient routing in mobile ad-hoc networks. Appl. Soft Comput. 38, 321–328 (2016)CrossRef
17.
Zurück zum Zitat Chettibi, S., Chikhi, S.: FEA-OLSR: an adaptive energy aware routing protocol for manets using zero-order sugeno fuzzy system. Int. J. Comput. Sci. Issues (IJCSI) 10(2), 136–141 (2013) Chettibi, S., Chikhi, S.: FEA-OLSR: an adaptive energy aware routing protocol for manets using zero-order sugeno fuzzy system. Int. J. Comput. Sci. Issues (IJCSI) 10(2), 136–141 (2013)
18.
Zurück zum Zitat Das, S.K., Tripathi, S.: Intelligent energy-aware efficient routing for MANET. Wirel. Netw. 24(4), 1139–1159 (2018)CrossRef Das, S.K., Tripathi, S.: Intelligent energy-aware efficient routing for MANET. Wirel. Netw. 24(4), 1139–1159 (2018)CrossRef
19.
Zurück zum Zitat Sutton, R., Barto, A.: Reinforcement Learning. MIT Press, Cambridge (1998)MATH Sutton, R., Barto, A.: Reinforcement Learning. MIT Press, Cambridge (1998)MATH
20.
Zurück zum Zitat Kim, D., Garcia-Luna-Aceves, J.J., Obraczka, K., Cano, J.C., Manzoni, P.: Power-aware routing based on the energy drain rate for mobile ad-hoc networks. In: 11th International Conference on Computer Communications and Networks (2002) Kim, D., Garcia-Luna-Aceves, J.J., Obraczka, K., Cano, J.C., Manzoni, P.: Power-aware routing based on the energy drain rate for mobile ad-hoc networks. In: 11th International Conference on Computer Communications and Networks (2002)
Metadaten
Titel
Reinforcement Learning Based Routing Protocols Analysis for Mobile Ad-Hoc Networks
verfasst von
Redha Mili
Salim Chikhi
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-19945-6_17

Premium Partner