Skip to main content
Top

2024 | OriginalPaper | Chapter

Improved Markov Decision Process in Wireless Sensor Network for Optimal Energy Consumption

Authors : Gauri Kalnoor, Prakash B. Metre

Published in: Proceedings of Third International Conference on Computing and Communication Networks

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The research looks at the problem of receiving a precise estimate of the sensor node attribute from the Wireless Sensor Network (WSN) in a certain time frame while using as little energy as possible from the sensors. An estimate of an attribute may be obtained by taking readings from wake-up sensors connected to a sink node that has been placed at random. The sink must take relevant measurements within a certain time constraint. As an added bonus, the sink reduces the amount of power needed for sensors to transmit their readings. The predicted energy consumption of WSN sensor nodes is presented in a closed-form formulation in this work. The research establishes a maximum allowable sensor transmission distance. The Markov Decision Process may be used to determine the timing of sensor transmissions over a given time frame (MDP). A strategy for transmitting-sensor programming is also developed in this work. The simulation is conducted in MATLAB environment, where the MDP schedule offers reduced energy consumption, reduced delay, increase packet delivery ratio, reduced false alarm rate, which finds the attribute of the data sent via a sensor node.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Calderone, D., Sastry, S.S.: Markov decision process routing games. In: 2017 ACM/IEEE 8th International Conference on Cyber-Physical Systems (ICCPS), pp. 273–280. IEEE (2017) Calderone, D., Sastry, S.S.: Markov decision process routing games. In: 2017 ACM/IEEE 8th International Conference on Cyber-Physical Systems (ICCPS), pp. 273–280. IEEE (2017)
2.
go back to reference Yu, X., Gao, S., Hu, X., Park, H.: A Markov decision process approach to vacant taxi routing with e-hailing. Transp. Res. Part B: Methodol. 121, 114–134 (2019)CrossRef Yu, X., Gao, S., Hu, X., Park, H.: A Markov decision process approach to vacant taxi routing with e-hailing. Transp. Res. Part B: Methodol. 121, 114–134 (2019)CrossRef
3.
go back to reference Calderone, D., Shankar, S.: Infinite-horizon average-cost Markov decision process routing games. In: 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), pp. 1–6. IEEE (2017) Calderone, D., Shankar, S.: Infinite-horizon average-cost Markov decision process routing games. In: 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), pp. 1–6. IEEE (2017)
4.
go back to reference Raverta, F.D., Demasi, R., Madoery, P.G., Fraire, J.A., Finochietto, J.M., D’Argenio, P.R.: A Markov decision process for routing in space DTNs with uncertain contact plans. In: 2018 6th IEEE International Conference on Wireless for Space and Extreme Environments (WiSEE), pp. 189–194. IEEE (2018) Raverta, F.D., Demasi, R., Madoery, P.G., Fraire, J.A., Finochietto, J.M., D’Argenio, P.R.: A Markov decision process for routing in space DTNs with uncertain contact plans. In: 2018 6th IEEE International Conference on Wireless for Space and Extreme Environments (WiSEE), pp. 189–194. IEEE (2018)
5.
go back to reference Sivaram, M., Porkodi, V., Mohammed, A.S., Manikandan, V.: Retransmission DBTMA protocol with fast retransmission strategy to improve the performance of MANETs. IEEE Access 7, 85098–85109 (2019)CrossRef Sivaram, M., Porkodi, V., Mohammed, A.S., Manikandan, V.: Retransmission DBTMA protocol with fast retransmission strategy to improve the performance of MANETs. IEEE Access 7, 85098–85109 (2019)CrossRef
6.
go back to reference Yuan, P., Wang, Y., Su, M., Yang, Z., Zhang, Q.: Markov decision process-based routing algorithm in hybrid Satellites/UAVs disruption-tolerant sensing networks. IET Commun. 13(10), 1415–1424 (2019)CrossRef Yuan, P., Wang, Y., Su, M., Yang, Z., Zhang, Q.: Markov decision process-based routing algorithm in hybrid Satellites/UAVs disruption-tolerant sensing networks. IET Commun. 13(10), 1415–1424 (2019)CrossRef
7.
go back to reference Hao, J., Jia, X., Han, Z., Yang, B., Peng, D.: Design of opportunistic routing based on Markov decision process. In: 2017 36th Chinese Control Conference (CCC), pp. 8976–8981. IEEE (2017) Hao, J., Jia, X., Han, Z., Yang, B., Peng, D.: Design of opportunistic routing based on Markov decision process. In: 2017 36th Chinese Control Conference (CCC), pp. 8976–8981. IEEE (2017)
8.
go back to reference Sangeetha, S.B., Blessing, N.W., Sneha, J.A.: Improving the training pattern in back-propagation neural networks using holt-winters’ seasonal method and gradient boosting model. In: Applications of Machine Learning, pp. 189–198. Springer, Singapore (2020) Sangeetha, S.B., Blessing, N.W., Sneha, J.A.: Improving the training pattern in back-propagation neural networks using holt-winters’ seasonal method and gradient boosting model. In: Applications of Machine Learning, pp. 189–198. Springer, Singapore (2020)
9.
go back to reference Li, S.H., Yu, Y., Calderone, D., Ratliff, L., Açrkmeşe, B.: Tolling for constraint satisfaction in markov decision process congestion games. In: 2019 American Control Conference (ACC), pp. 1238–1243. IEEE (2019) Li, S.H., Yu, Y., Calderone, D., Ratliff, L., Açrkmeşe, B.: Tolling for constraint satisfaction in markov decision process congestion games. In: 2019 American Control Conference (ACC), pp. 1238–1243. IEEE (2019)
10.
go back to reference Yu, X., Gao, S., Hu, X.: Optimizing vacant Taxis’ routing decisions: model-based and model-free approaches (No. 19–03142) (2019) Yu, X., Gao, S., Hu, X.: Optimizing vacant Taxis’ routing decisions: model-based and model-free approaches (No. 19–03142) (2019)
11.
go back to reference Karthikeyan, T., Praghash, K.: An improved task allocation scheme in serverless computing using gray wolf optimization (GWO) based reinforcement learning (RIL) approach. Wirel. Pers. Commun. 1–19 (2020) Karthikeyan, T., Praghash, K.: An improved task allocation scheme in serverless computing using gray wolf optimization (GWO) based reinforcement learning (RIL) approach. Wirel. Pers. Commun. 1–19 (2020)
12.
go back to reference Yousefi, S., Derakhshan, F., Karimipour, H., Aghdasi, H.S.: An efficient route planning model for mobile agents on the internet of things using Markov decision process. Ad Hoc Netw. 98, 102053 (2020)CrossRef Yousefi, S., Derakhshan, F., Karimipour, H., Aghdasi, H.S.: An efficient route planning model for mobile agents on the internet of things using Markov decision process. Ad Hoc Netw. 98, 102053 (2020)CrossRef
13.
go back to reference Kannan, S., Dhiman, G., Natarajan, Y., Sharma, A., Mohanty, S.N., Soni, M., Gheisari, M.: Ubiquitous vehicular Ad-Hoc network computing using deep neural network with IoT-based bat agents for traffic management. Electron. 10(7), 785 (2021)CrossRef Kannan, S., Dhiman, G., Natarajan, Y., Sharma, A., Mohanty, S.N., Soni, M., Gheisari, M.: Ubiquitous vehicular Ad-Hoc network computing using deep neural network with IoT-based bat agents for traffic management. Electron. 10(7), 785 (2021)CrossRef
14.
go back to reference Yoon, S., Albert, L.A.: A dynamic ambulance routing model with multiple response. Transp. Res. Part E: Logist. Transp. Rev. 133, 101807 (2020)CrossRef Yoon, S., Albert, L.A.: A dynamic ambulance routing model with multiple response. Transp. Res. Part E: Logist. Transp. Rev. 133, 101807 (2020)CrossRef
15.
go back to reference Yuvaraj, N., Srihari, K., Dhiman, G., Somasundaram, K., Sharma, A., Rajeskannan, S., Masud, M.: Nature-inspired-based approach for automated cyberbullying classification on multimedia social networking. Math. Probl. Eng (2021) Yuvaraj, N., Srihari, K., Dhiman, G., Somasundaram, K., Sharma, A., Rajeskannan, S., Masud, M.: Nature-inspired-based approach for automated cyberbullying classification on multimedia social networking. Math. Probl. Eng (2021)
16.
go back to reference Li, X., Kan, H., Hua, X., Wang, W.: Simulation-based electric vehicle sustainable routing with time-dependent stochastic information. Sustain. 12(6), 2464 (2020)CrossRef Li, X., Kan, H., Hua, X., Wang, W.: Simulation-based electric vehicle sustainable routing with time-dependent stochastic information. Sustain. 12(6), 2464 (2020)CrossRef
17.
go back to reference Raja, R.A., Kousik, N.V.: Analyses on artificial intelligence framework to detect crime pattern. In: Intelligent Data Analytics for Terror Threat Prediction: Architectures, Methodologies, Techniques and Applications, pp. 119–132 (2021) Raja, R.A., Kousik, N.V.: Analyses on artificial intelligence framework to detect crime pattern. In: Intelligent Data Analytics for Terror Threat Prediction: Architectures, Methodologies, Techniques and Applications, pp. 119–132 (2021)
18.
go back to reference Rao, Y., Lu, J., Lin, J., Zhou, J.: Runtime network routing for efficient image classification. IEEE Trans. Pattern Anal. Mach. Intell. 41(10), 2291–2304 (2018)CrossRef Rao, Y., Lu, J., Lin, J., Zhou, J.: Runtime network routing for efficient image classification. IEEE Trans. Pattern Anal. Mach. Intell. 41(10), 2291–2304 (2018)CrossRef
Metadata
Title
Improved Markov Decision Process in Wireless Sensor Network for Optimal Energy Consumption
Authors
Gauri Kalnoor
Prakash B. Metre
Copyright Year
2024
Publisher
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-0892-5_21