Communication Systems

This book presents the intersection of two dynamic fields: Reinforcement Learning (RL) and RIS- Assisted Wireless Communications. With an emphasis on both discrete and continuous problems, it introduces a comprehensive overview of RL techniques and their applications in the evolving world of RIS-assisted wireless communications. Chapter 1 introduces the fundamentals of RL and deep RL (DRL), providing a solid foundation for understanding subsequent chapters. It also presents the Q-learning, deep Q-learning, and deep deterministic policy gradient algorithms. Chapter 2 provides a holistic overview of RIS-assisted systems and details several use cases in wireless communications. Then, Chapters 3 and 4 present various applications of the discrete and continuous DRL to RIS-assisted wireless communications. From maximizing the sum-rate to minimizing, the system resources and maximizing the energy efficiency. These chapters showcase the versatility of the DRL algorithms in tackling a range of challenges. This book concludes with Chapter 5, which introduces the challenges and future directions in this field. It explores the particulars of hyperparameter tuning, problem design, and complexity analysis, while also highlighting the potential of hybrid DRL, multi-agent DRL, and transfer learning techniques for advancing wireless communication systems.

Rapid progress in software, hardware, mobile networks, and the potential of interactive media poses many questions for researchers, manufacturers, and operators of wireless multimedia communication systems.

With the growing complexity of personal mobile communication systems demanding higher data-rates and high levels of integration using low-cost CMOS technology, overall system performance has become more sensitive to RF analog front-end impairments.