Efficient QoS provisioning for adaptive multimedia in mobile communication networks by reinforcement learning

Fei Yu; Vincent W. S. Wong; Victor C.M. Leung

doi:10.1117/12.538812

15 December 2003 Efficient QoS provisioning for adaptive multimedia in mobile communication networks by reinforcement learning

Fei Yu, Vincent W. S. Wong, Victor C.M. Leung

Author Affiliations +

Proceedings Volume 5305, Multimedia Computing and Networking 2004; (2003) https://doi.org/10.1117/12.538812
Event: Electronic Imaging 2004, 2004, San Jose, California, United States

Abstract

The scarcity and large fluctuations of link bandwidth in wireless networks have motivated the development of adaptive multimedia services in mobile communication networks, where it is possible to increase or decrease the bandwidth of individual ongoing flows. This paper studies the issues of quality of service (QoS) provisioning in such systems. In particular, call admission control and bandwidth adaptation are formulated as a constrained Markov decision problem. The rapid growth in the number of states and the difficulty in estimating state transition probabilities in practical systems make it very difficult to employ classical methods to find the optimal policy. We present a novel approach that uses a form of reinforcement learning known as Q-learning to solve QoS provisioning for wireless adaptive multimedia. Q-learning does not require the explicit state transition model to solve the Markov decision problem; therefore more general and realistic assumptions can be applied to the underlying system model for this approach than in previous schemes. Moreover, the proposed scheme can efficiently handle the large state space and action set of the wireless adaptive multimedia QoS provisioning problem. Handoff dropping probability and average allocated bandwidth are considered as QoS constraints in our model and can be guaranteed simultaneously. Simulation results demonstrate the effectiveness of the proposed scheme in adaptive multimedia mobile communication networks.

Citation Download Citation

Fei Yu, Vincent W. S. Wong, and Victor C.M. Leung "Efficient QoS provisioning for adaptive multimedia in mobile communication networks by reinforcement learning", Proc. SPIE 5305, Multimedia Computing and Networking 2004, (15 December 2003); https://doi.org/10.1117/12.538812

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available