Firoj Gazi
Skip Abstract Section
Abstract
High propagation delay, high error probability, floating node mobility, and low data rates are the key challenges for Underwater Wireless Multimedia Sensor Networks (UMWSNs). In this article, we propose RL-MAC, a Reinforcement Learning (RL)–based Medium Access Control (MAC) protocol for multimedia sensing in an Underwater Acoustic Network (UAN) environment. The proposed scheme uses Transmission Opportunity (TXOP) for relay nodes in a multi-hop network for improved efficiency concerning the mobility of the relays and sensor nodes. The access point (AP) and relay nodes calculate traffic demands from the initial contention of the sensor nodes. Our solution uses Q-learning to enhance the contention mechanism at the initial phase of multimedia transmission. Based on the traffic demands, RL-MAC allocates TXOP duration for the uplink multimedia reception. Further, the Structural Similarity Index Measure (SSIM) and compression techniques are used for calculating the image quality at the receiver end and reducing the image at the destination, respectively. We implement a prototype of the proposed scheme over an off-the-shelf, low-cost hardware setup. Moreover, extensive simulation over NS-3 shows a significant packet delivery ratio and throughput compared with the existing state-of-the-art.
- [1] 2011. Quality aware image transmission over underwater multimedia sensor networks. Ad Hoc Networks 9, 7 (2011), 1287–1301.Google Scholar
Digital Library
- [2] . 2016. Performance comparison of sender-based and receiver-based scheduling MAC protocols for underwater sensor networks. In 19th International Conference on Network-Based Information Systems (NBiS’16). IEEE, 99–106.Google ScholarCross Ref
- [3] . 2017. Efficient depth-based scheduling MAC protocols for underwater sensor networks. In 9th International Conference on Ubiquitous and Future Networks (ICUFN’17). IEEE, 827–832.Google Scholar
- [4] . 2019. A comparative performance evaluation of distributed collision-free MAC protocols for underwater sensor networks. In SENSORNETS. 85–93.Google Scholar
- [5] . 2019. Exploiting energy efficient routing protocols for void hole alleviation in IoT enabled underwater WSN. In 15th International Wireless Communications Mobile Computing Conference (IWCMC’19). 1797–1802. Google ScholarCross Ref
- [6] . 2017. Comparison of contention-based MAC protocols for underwater sensor networks. In International Conference on Information Networking (ICOIN’17). IEEE, 518–523.Google ScholarCross Ref
- [7] . 2018. Collision avoidance energy efficient multi-channel MAC protocol for underwater acoustic sensor networks. IEEE Transactions on Mobile Computing 18, 10 (2018), 2298–2314.Google ScholarCross Ref
- [8] . 2020. Deep learning based BER prediction model in underwater IoT networks. Journal of Convergence for Information Technology 10, 6 (2020), 41–48.Google Scholar
- [9] . 2006. Cooperative multihop communication for underwater acoustic networks. In Proceedings of the 1st ACM International Workshop on Underwater Networks. 97–100.Google ScholarDigital Library
- [10] . 2021. Medium access control under space-time coupling in underwater acoustic networks. IEEE Internet of Things Journal (2021), 1–1. Google ScholarCross Ref
- [11] . 2018. DCO-MAC: A hybrid MAC protocol for data collection in underwater acoustic sensor networks. Sensors 18, 7 (2018), 2300.Google ScholarCross Ref
- [12] . 2020. Reinforcement-learning based dynamic transmission range adjustment in medium access control for underwater wireless sensor networks. Electronics 9, 10 (2020), 1727.Google ScholarCross Ref
- [13] . 2013. A hybrid reservation-based MAC protocol for underwater acoustic sensor networks. Ad Hoc Networks 11, 3 (2013), 1178–1192.Google ScholarDigital Library
- [14] . 2012. A multi-hop energy-efficient sleeping MAC protocol based on TDMA scheduling for wireless mesh sensor networks. Journal of Networks 7, 9 (2012), 1355–1361.Google ScholarCross Ref
- [15] . 2020. UnRest: Underwater reliable acoustic communication for multimedia streaming. In IEEE Global Communications Conference (GLOBECOM’20). IEEE, 1–6.Google ScholarCross Ref
- [16] . 2019. MAC protocol for underwater acoustic networks based on deep reinforcement learning. In Proceedings of the International Conference on Underwater Networks & Systems. ACM. Google ScholarDigital Library
- [17] . 2010. The high frequency underwater acoustic channel. In OCEANS. IEEE, 1–3.Google Scholar
- [18] . 2019. Optical-acoustic hybrid network toward real-time video streaming for mobile underwater sensors. Ad Hoc Networks 83 (2019), 1–7.Google ScholarCross Ref
- [19] . 2017. A review and classification of energy efficient MAC protocols for underwater wireless sensor network. Journal of Basic and Applied Sciences 13 (2017), 63–70.Google ScholarCross Ref
- [20] . 2019. RCAR: A reinforcement-learning-based routing protocol for congestion-avoided underwater acoustic sensor networks. IEEE Sensors Journal 19, 22 (2019), 10881–10891.Google ScholarCross Ref
- [21] . 2020. Underwater network management system in Internet of Underwater Things: Open challenges, benefits, and feasible solution. Electronics 9, 7 (2020).Google Scholar
- [22] . 2017. Localization in terrestrial and underwater sensor-based M2M communication networks: Architecture, classification and challenges. International Journal of Communication Systems 30, 4 (2017), e2997.Google ScholarCross Ref
- [23] . 2015. A survey on IEEE 802.11 ah: An enabling networking technology for smart cities. Computer Communications 58 (2015), 53–69.Google ScholarDigital Library
- [24] . 2018. UCMAC: A cooperative MAC protocol for underwater wireless sensor networks. Sensors 18, 6 (2018), 1969.Google ScholarCross Ref
- [25] . 2015. Structural similarity index SSIMplified: Is there really a simpler concept at the heart of image quality measurement?. arXiv preprint arXiv:1503.06680 (2015).Google Scholar
- [26] . 2016. An improved R-MAC based MAC protocol for underwater acoustic networks. In IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC’16). IEEE, 1–6.Google ScholarCross Ref
- [27] . 2015. Aqua-sim next generation: A NS-3 based simulator for underwater sensor networks. In Proceedings of the 10th International Conference on Underwater Networks & Systems. Springer, 1–2.Google ScholarDigital Library
- [28] . 2007. An ultrasonic sensor based low-power acoustic modem for underwater communication in underwater wireless sensor networks. In International Conference on Embedded and Ubiquitous Computing. Springer, 494–504.Google ScholarCross Ref
- [29] . 2018. Performance of the ALOHA-Q MAC protocol for underwater acoustic networks. In International Conference on Computing, Electronics & Communications Engineering (iCCECE’18). IEEE, 189–194.Google ScholarCross Ref
- [30] . 2019. Reinforcement learning based MAC protocol (UW-ALOHA-Q) for underwater acoustic sensor networks. IEEE Access 7 (2019), 165531–165542.Google ScholarCross Ref
- [31] . 2020. Reinforcement learning based MAC protocol (UW-ALOHA-QM) for mobile underwater acoustic sensor networks. IEEE Access (2020), 5906–5919.Google Scholar
- [32] . 2020. ahoi: Inexpensive, low-power communication and localization for underwater sensor networks and \( \mu \)AUVs. ACM Transactions on Sensor Networks 16, 2 (2020), 1–46.Google ScholarDigital Library
- [33] . 2021. A synchronous duty-cycled reservation based MAC protocol for underwater wireless sensor networks. Digital Communications and Networks 7, 3 (2021), 385–398.
DOI: .Google ScholarCross Ref - [34] . 2007. On the relationship between capacity and distance in an underwater acoustic communication channel. ACM SIGMOBILE Mobile Computing and Communications Review 11, 4 (2007), 34–43.Google ScholarDigital Library
- [35] . 1967. Analytic description of the low-frequency attenuation coefficient. The Journal of the Acoustical Society of America 42, 1 (1967), 270–270.Google ScholarCross Ref
- [36] . 2019. A robust energy efficient MAC protocol design for Underwater sensor network. Ph.D. Dissertation. Daffodil International University, Dhaka, Bangladesh.Google Scholar
- [37] . 2018. Design and implementation of state-based MAC protocol for UANs in real testbed. In OCEANS 2018 MTS/IEEE Charleston. IEEE, 1–5.Google Scholar
- [38] . 2004. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing 13, 4 (2004), 600–612.Google ScholarDigital Library
- [39] . 2019. Reinforcement-learning-based relay mobility and power allocation for underwater sensor networks against jamming. IEEE Journal of Oceanic Engineering 45, 3 (2019), 1148–1156.Google ScholarCross Ref
- [40] . 2022. Deep reinforcement learning based MAC protocol for underwater acoustic networks. IEEE Transactions on Mobile Computing 21, 5 (2022), 1625–1638.Google ScholarCross Ref
- [41] . 2020. Deep reinforcement learning based MAC protocol for underwater acoustic networks. IEEE Transactions on Mobile Computing (2020), 1–1. Google ScholarCross Ref
- [42] . 2019. A load-based hybrid MAC protocol for underwater wireless sensor networks. IEEE Access 7 (2019), 104542–104552.Google ScholarCross Ref
- [43] . 2020. AUV-aided energy-efficient data collection in underwater acoustic sensor networks. IEEE Internet of Things Journal 7, 10 (2020), 10010–10022.Google ScholarCross Ref
Index Terms
- Reinforcement Learning-Based MAC Protocol for Underwater Multimedia Sensor Networks
Recommendations
Propagation modeling and MAC-layer performance in EM-based underwater sensor networks
DIVANet '14: Proceedings of the fourth ACM international symposium on Development and analysis of intelligent vehicular networks and applicationsElectromagnetic (EM) waves have been considered as an alternative to acoustic communications in seawater. In this paper, we propose a propagation model for EM channels in seawater and study the MAC-layer performance in EM-based underwater sensor ...
Distributed CDMA-based MAC Protocol for Underwater Sensor Networks
LCN '07: Proceedings of the 32nd IEEE Conference on Local Computer NetworksUnderwater Sensor Networks are typically distributed in nature and the nodes communicate using acoustic waves over a wireless medium. Such networks are characterized by long and variable propagation delays, intermittent connectivity, limited bandwidth ...
An OFDM based MAC protocol for underwater acoustic networks
WUWNet '10: Proceedings of the 5th International Workshop on Underwater NetworksIn this paper, we investigate OFDM based MAC protocols for underwater acoustic networks. Due to the severe multi-path effects of underwater acoustic channels, the guard time between OFDM blocks becomes significant, which greatly degrades the system ...
Comments