TY - GEN
T1 - A QoS aware reinforcement learning algorithm for macro-femto interference in dynamic environments
AU - Stefan, A.L.
AU - Ramkumar, M.
AU - Nielsen, R.H.
AU - Prasad, N.R.
AU - Prasad, R.
PY - 2011
Y1 - 2011
N2 - Network operators are considering femtocell solutions as a mean of reducing costs, offloading their networks and increasing profits but this at the same time gives rise to new technological challenges. The most stringent ones are the resources that the femtocells should be using and the interference between the macro and the femto layers. We propose an unsupervised learning algorithm, namely reinforcement learning as the means of achieving self-organizing capabilities for the femtocells. The proposed algorithm is characterized by femto-QoS awareness, as the actions of the femtocells are directed at avoiding interference on the macro layer but at the same time achieving the QoS requirements of the femtocells. Dealing with OFDMA based systems, different service classes for both the macro and the femto users are envisioned and equal priority is assigned among users. The different QoS requirements allow applying a Markov chain prediction on the number of resources required by a femtocell, enhancing the performance of the algorithm. Finally, the proposed algorithm is tested in a highly dynamic environment in which the allocation of resources to the macro users can change at each time step.
AB - Network operators are considering femtocell solutions as a mean of reducing costs, offloading their networks and increasing profits but this at the same time gives rise to new technological challenges. The most stringent ones are the resources that the femtocells should be using and the interference between the macro and the femto layers. We propose an unsupervised learning algorithm, namely reinforcement learning as the means of achieving self-organizing capabilities for the femtocells. The proposed algorithm is characterized by femto-QoS awareness, as the actions of the femtocells are directed at avoiding interference on the macro layer but at the same time achieving the QoS requirements of the femtocells. Dealing with OFDMA based systems, different service classes for both the macro and the femto users are envisioned and equal priority is assigned among users. The different QoS requirements allow applying a Markov chain prediction on the number of resources required by a femtocell, enhancing the performance of the algorithm. Finally, the proposed algorithm is tested in a highly dynamic environment in which the allocation of resources to the macro users can change at each time step.
UR - http://www.scopus.com/inward/record.url?eid=2-s2.0-84856147949&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/record.url?scp=84856147949&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84856147949&partnerID=8YFLogxK
M3 - Article in proceeding
AN - SCOPUS:84856147949
SN - 978-145770682-0
BT - International Congress on Ultra Modern Telecommunications and Control Systems and Workshops
PB - IEEE Press
ER -