Skip to main content

2024 | OriginalPaper | Buchkapitel

Improved Markov Decision Process in Wireless Sensor Network for Optimal Energy Consumption

verfasst von : Gauri Kalnoor, Prakash B. Metre

Erschienen in: Proceedings of Third International Conference on Computing and Communication Networks

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The research looks at the problem of receiving a precise estimate of the sensor node attribute from the Wireless Sensor Network (WSN) in a certain time frame while using as little energy as possible from the sensors. An estimate of an attribute may be obtained by taking readings from wake-up sensors connected to a sink node that has been placed at random. The sink must take relevant measurements within a certain time constraint. As an added bonus, the sink reduces the amount of power needed for sensors to transmit their readings. The predicted energy consumption of WSN sensor nodes is presented in a closed-form formulation in this work. The research establishes a maximum allowable sensor transmission distance. The Markov Decision Process may be used to determine the timing of sensor transmissions over a given time frame (MDP). A strategy for transmitting-sensor programming is also developed in this work. The simulation is conducted in MATLAB environment, where the MDP schedule offers reduced energy consumption, reduced delay, increase packet delivery ratio, reduced false alarm rate, which finds the attribute of the data sent via a sensor node.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Calderone, D., Sastry, S.S.: Markov decision process routing games. In: 2017 ACM/IEEE 8th International Conference on Cyber-Physical Systems (ICCPS), pp. 273–280. IEEE (2017) Calderone, D., Sastry, S.S.: Markov decision process routing games. In: 2017 ACM/IEEE 8th International Conference on Cyber-Physical Systems (ICCPS), pp. 273–280. IEEE (2017)
2.
Zurück zum Zitat Yu, X., Gao, S., Hu, X., Park, H.: A Markov decision process approach to vacant taxi routing with e-hailing. Transp. Res. Part B: Methodol. 121, 114–134 (2019)CrossRef Yu, X., Gao, S., Hu, X., Park, H.: A Markov decision process approach to vacant taxi routing with e-hailing. Transp. Res. Part B: Methodol. 121, 114–134 (2019)CrossRef
3.
Zurück zum Zitat Calderone, D., Shankar, S.: Infinite-horizon average-cost Markov decision process routing games. In: 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), pp. 1–6. IEEE (2017) Calderone, D., Shankar, S.: Infinite-horizon average-cost Markov decision process routing games. In: 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), pp. 1–6. IEEE (2017)
4.
Zurück zum Zitat Raverta, F.D., Demasi, R., Madoery, P.G., Fraire, J.A., Finochietto, J.M., D’Argenio, P.R.: A Markov decision process for routing in space DTNs with uncertain contact plans. In: 2018 6th IEEE International Conference on Wireless for Space and Extreme Environments (WiSEE), pp. 189–194. IEEE (2018) Raverta, F.D., Demasi, R., Madoery, P.G., Fraire, J.A., Finochietto, J.M., D’Argenio, P.R.: A Markov decision process for routing in space DTNs with uncertain contact plans. In: 2018 6th IEEE International Conference on Wireless for Space and Extreme Environments (WiSEE), pp. 189–194. IEEE (2018)
5.
Zurück zum Zitat Sivaram, M., Porkodi, V., Mohammed, A.S., Manikandan, V.: Retransmission DBTMA protocol with fast retransmission strategy to improve the performance of MANETs. IEEE Access 7, 85098–85109 (2019)CrossRef Sivaram, M., Porkodi, V., Mohammed, A.S., Manikandan, V.: Retransmission DBTMA protocol with fast retransmission strategy to improve the performance of MANETs. IEEE Access 7, 85098–85109 (2019)CrossRef
6.
Zurück zum Zitat Yuan, P., Wang, Y., Su, M., Yang, Z., Zhang, Q.: Markov decision process-based routing algorithm in hybrid Satellites/UAVs disruption-tolerant sensing networks. IET Commun. 13(10), 1415–1424 (2019)CrossRef Yuan, P., Wang, Y., Su, M., Yang, Z., Zhang, Q.: Markov decision process-based routing algorithm in hybrid Satellites/UAVs disruption-tolerant sensing networks. IET Commun. 13(10), 1415–1424 (2019)CrossRef
7.
Zurück zum Zitat Hao, J., Jia, X., Han, Z., Yang, B., Peng, D.: Design of opportunistic routing based on Markov decision process. In: 2017 36th Chinese Control Conference (CCC), pp. 8976–8981. IEEE (2017) Hao, J., Jia, X., Han, Z., Yang, B., Peng, D.: Design of opportunistic routing based on Markov decision process. In: 2017 36th Chinese Control Conference (CCC), pp. 8976–8981. IEEE (2017)
8.
Zurück zum Zitat Sangeetha, S.B., Blessing, N.W., Sneha, J.A.: Improving the training pattern in back-propagation neural networks using holt-winters’ seasonal method and gradient boosting model. In: Applications of Machine Learning, pp. 189–198. Springer, Singapore (2020) Sangeetha, S.B., Blessing, N.W., Sneha, J.A.: Improving the training pattern in back-propagation neural networks using holt-winters’ seasonal method and gradient boosting model. In: Applications of Machine Learning, pp. 189–198. Springer, Singapore (2020)
9.
Zurück zum Zitat Li, S.H., Yu, Y., Calderone, D., Ratliff, L., Açrkmeşe, B.: Tolling for constraint satisfaction in markov decision process congestion games. In: 2019 American Control Conference (ACC), pp. 1238–1243. IEEE (2019) Li, S.H., Yu, Y., Calderone, D., Ratliff, L., Açrkmeşe, B.: Tolling for constraint satisfaction in markov decision process congestion games. In: 2019 American Control Conference (ACC), pp. 1238–1243. IEEE (2019)
10.
Zurück zum Zitat Yu, X., Gao, S., Hu, X.: Optimizing vacant Taxis’ routing decisions: model-based and model-free approaches (No. 19–03142) (2019) Yu, X., Gao, S., Hu, X.: Optimizing vacant Taxis’ routing decisions: model-based and model-free approaches (No. 19–03142) (2019)
11.
Zurück zum Zitat Karthikeyan, T., Praghash, K.: An improved task allocation scheme in serverless computing using gray wolf optimization (GWO) based reinforcement learning (RIL) approach. Wirel. Pers. Commun. 1–19 (2020) Karthikeyan, T., Praghash, K.: An improved task allocation scheme in serverless computing using gray wolf optimization (GWO) based reinforcement learning (RIL) approach. Wirel. Pers. Commun. 1–19 (2020)
12.
Zurück zum Zitat Yousefi, S., Derakhshan, F., Karimipour, H., Aghdasi, H.S.: An efficient route planning model for mobile agents on the internet of things using Markov decision process. Ad Hoc Netw. 98, 102053 (2020)CrossRef Yousefi, S., Derakhshan, F., Karimipour, H., Aghdasi, H.S.: An efficient route planning model for mobile agents on the internet of things using Markov decision process. Ad Hoc Netw. 98, 102053 (2020)CrossRef
13.
Zurück zum Zitat Kannan, S., Dhiman, G., Natarajan, Y., Sharma, A., Mohanty, S.N., Soni, M., Gheisari, M.: Ubiquitous vehicular Ad-Hoc network computing using deep neural network with IoT-based bat agents for traffic management. Electron. 10(7), 785 (2021)CrossRef Kannan, S., Dhiman, G., Natarajan, Y., Sharma, A., Mohanty, S.N., Soni, M., Gheisari, M.: Ubiquitous vehicular Ad-Hoc network computing using deep neural network with IoT-based bat agents for traffic management. Electron. 10(7), 785 (2021)CrossRef
14.
Zurück zum Zitat Yoon, S., Albert, L.A.: A dynamic ambulance routing model with multiple response. Transp. Res. Part E: Logist. Transp. Rev. 133, 101807 (2020)CrossRef Yoon, S., Albert, L.A.: A dynamic ambulance routing model with multiple response. Transp. Res. Part E: Logist. Transp. Rev. 133, 101807 (2020)CrossRef
15.
Zurück zum Zitat Yuvaraj, N., Srihari, K., Dhiman, G., Somasundaram, K., Sharma, A., Rajeskannan, S., Masud, M.: Nature-inspired-based approach for automated cyberbullying classification on multimedia social networking. Math. Probl. Eng (2021) Yuvaraj, N., Srihari, K., Dhiman, G., Somasundaram, K., Sharma, A., Rajeskannan, S., Masud, M.: Nature-inspired-based approach for automated cyberbullying classification on multimedia social networking. Math. Probl. Eng (2021)
16.
Zurück zum Zitat Li, X., Kan, H., Hua, X., Wang, W.: Simulation-based electric vehicle sustainable routing with time-dependent stochastic information. Sustain. 12(6), 2464 (2020)CrossRef Li, X., Kan, H., Hua, X., Wang, W.: Simulation-based electric vehicle sustainable routing with time-dependent stochastic information. Sustain. 12(6), 2464 (2020)CrossRef
17.
Zurück zum Zitat Raja, R.A., Kousik, N.V.: Analyses on artificial intelligence framework to detect crime pattern. In: Intelligent Data Analytics for Terror Threat Prediction: Architectures, Methodologies, Techniques and Applications, pp. 119–132 (2021) Raja, R.A., Kousik, N.V.: Analyses on artificial intelligence framework to detect crime pattern. In: Intelligent Data Analytics for Terror Threat Prediction: Architectures, Methodologies, Techniques and Applications, pp. 119–132 (2021)
18.
Zurück zum Zitat Rao, Y., Lu, J., Lin, J., Zhou, J.: Runtime network routing for efficient image classification. IEEE Trans. Pattern Anal. Mach. Intell. 41(10), 2291–2304 (2018)CrossRef Rao, Y., Lu, J., Lin, J., Zhou, J.: Runtime network routing for efficient image classification. IEEE Trans. Pattern Anal. Mach. Intell. 41(10), 2291–2304 (2018)CrossRef
Metadaten
Titel
Improved Markov Decision Process in Wireless Sensor Network for Optimal Energy Consumption
verfasst von
Gauri Kalnoor
Prakash B. Metre
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-0892-5_21