Adaptive switching for multimodal underwater acoustic communications based on reinforcement learning
Document Type
Conference Proceeding
Publication Date
3-17-2022
Department
Department of Electrical and Computer Engineering
Abstract
The underwater acoustic (UWA) channel is a complex and stochastic process with large spatial and temporal dynamics. This work studies the adaptation of the communication strategy to the channel dynamics. Specifically, a set of communication strategies are considered, including frequency shift keying (FSK), single-carrier communication, and multicarrier communication. Based on the channel condition, a reinforcement learning (RL) algorithm, the Depth Determined Strategy Gradient (DDPG) method along with a Gumbel-softmax scheme is employed for intelligent and adaptive switching among those communication strategies. The adaptive switching is performed on a transmission block-by-block basis, with the goal of maximizing a long-term system performance. The reward function is defined based on the energy efficiency and the spectral efficiency of the communication strategies. Simulation results reveal that the proposed method outperforms a random selection method in time-varying channels.
Publication Title
WUWNet 2021 - 15th ACM International Conference on Underwater Networks and Systems
ISBN
9781450395625
Recommended Citation
Fan, C.,
&
Wang, Z.
(2022).
Adaptive switching for multimodal underwater acoustic communications based on reinforcement learning.
WUWNet 2021 - 15th ACM International Conference on Underwater Networks and Systems.
http://doi.org/10.1145/3491315.3491354
Retrieved from: https://digitalcommons.mtu.edu/michigantech-p/16661