Skip to main content

2019 | Buch

Deep Reinforcement Learning for Wireless Networks

insite
SUCHEN

Über dieses Buch

This Springerbrief presents a deep reinforcement learning approach to wireless systems to improve system performance. Particularly, deep reinforcement learning approach is used in cache-enabled opportunistic interference alignment wireless networks and mobile social networks. Simulation results with different network parameters are presented to show the effectiveness of the proposed scheme.

There is a phenomenal burst of research activities in artificial intelligence, deep reinforcement learning and wireless systems. Deep reinforcement learning has been successfully used to solve many practical problems. For example, Google DeepMind adopts this method on several artificial intelligent projects with big data (e.g., AlphaGo), and gets quite good results..

Graduate students in electrical and computer engineering, as well as computer science will find this brief useful as a study guide. Researchers, engineers, computer scientists, programmers, and policy makers will also find this brief to be a useful tool.

Inhaltsverzeichnis

Frontmatter
Chapter 1. Introduction to Machine Learning
Abstract
Machine learning is evolved from a collection of powerful techniques in AI areas and has been extensively used in data mining, which allows the system to learn the useful structural patterns and models from training data. Machine learning algorithms can be basically classified into four categories: supervised, unsupervised, semi-supervised and reinforcement learning. In this chapter, widely-used machine learning algorithms are introduced. Each algorithm is briefly explained with some examples.
F. Richard Yu, Ying He
Chapter 2. Reinforcement Learning and Deep Reinforcement Learning
Abstract
In order to better understand state-of-the-art reinforcement learning agent, deep Q-network, a brief review of reinforcement learning and Q-learning are first described. Then recent advances of deep Q-network are presented, and double deep Q-network and dueling deep Q-network that go beyond deep Q-network are also given.
F. Richard Yu, Ying He
Chapter 3. Deep Reinforcement Learning for Interference Alignment Wireless Networks
Abstract
Both caching and interference alignment (IA) are promising techniques for next generation wireless networks. Nevertheless, most existing works on cache-enabled IA wireless networks assume that the channel is invariant, which is unrealistic considering the time-varying nature of practical wireless environments. In this chapter, we consider realistic time-varying channels. Specifically, the channel is formulated as a finite-state Markov channel (FSMC). The complexity of the system is very high when we consider realistic FSMC models. Therefore, in this chapter, we propose a novel deep reinforcement learning approach, which is an advanced reinforcement learning algorithm that uses deep Q network to approximate the Q value-action function. We use Google TensorFlow to implement deep reinforcement learning in this chapter to obtain the optimal IA user selection policy in cache-enabled opportunistic IA wireless networks. Simulation results are presented to show that the performance of cache-enabled opportunistic IA networks in terms of the network’s sum rate and energy efficiency can be significantly improved by using the proposed approach.
F. Richard Yu, Ying He
Chapter 4. Deep Reinforcement Learning for Mobile Social Networks
Abstract
Social networks have continuously been expanding and trying to be innovative. The recent advances of computing, caching, and communication (3C) can have significant impacts on mobile social networks (MSNs). MSNs can leverage these new paradigms to provide a new mechanism for users to share resources (e.g., information, computation-based services). In this chapter, we exploit the intrinsic nature of social networks, i.e., the trust formed through social relationships among users, to enable users to share resources under the framework of 3C. Specifically, we consider the mobile edge computing (MEC), in-network caching and device-to-device (D2D) communications. When considering the trust-based MSNs with MEC, caching and D2D, we apply a novel deep reinforcement learning approach to automatically make a decision for optimally allocating the network resources. The decision is made purely through observing the network’s states, rather than any handcrafted or explicit control rules, which makes it adaptive to variable network conditions. Google TensorFlow is used to implement the proposed deep Q-learning approach. Simulation results with different network parameters are presented to show the effectiveness of the proposed scheme.
F. Richard Yu, Ying He
Metadaten
Titel
Deep Reinforcement Learning for Wireless Networks
verfasst von
F. Richard Yu
Ying He
Copyright-Jahr
2019
Electronic ISBN
978-3-030-10546-4
Print ISBN
978-3-030-10545-7
DOI
https://doi.org/10.1007/978-3-030-10546-4

Neuer Inhalt