Reinforcement learning for DPM of embedded visual sensor nodes.

Umair Ali Khan; Fareed Ahmed Jokhio; Intesab Hussain Sadhayo

No Detail Found!

Reinforcement learning for DPM of embedded visual sensor nodes.

Author(s)

Umair Ali Khan Department of Computer Systems Engineering, Quaid-e-Awam University of Engineering, Science & Technology, Nawabshah, Pakistan

Fareed Ahmed Jokhio Abo Akademi University, Finland

Intesab Hussain Sadhayo Department of Computer Systems Engineering, Quaid-e-Awam University of Engineering, Science & Technology, Nawabshah, Pakistan

Abstract

This paper proposes a RL (Reinforcement Learning) based DPM (Dynamic Power Management) technique to learn timeout policies during a visual sensor node`s operation which has multiple power/performance states. As opposed to the widely used static timeout policies, our proposed DPM policy which is also referred to as OLTP (Online Learning of Timeout Policies), learns to dynamically change the timeout decisions in the different node states including the non-operational states. The selection of timeout values in different power/performance states of a visual sensing platform is based on the workload estimates derived from a ML-ANN (Multi-Layer Artificial Neural Network) and an objective function given by weighted performance and power parameters. The DPM approach is also able to dynamically adjust the power-performance weights online to satisfy a given constraint of either power consumption or performance. Results show that the proposed learning algorithm explores the power-performance tradeoff with non-stationary workload and outperforms other DPM policies. It also performs the online adjustment of the tradeoff parameters in order to meet a user-specified constraint.

Publication Details

Page(s) 199-214

DOI DOI not available

Published Journal: Mehran University Research Journal of Engineering and Technology, Volume: 33, Issue: 2, Year: 2014

Request the full text from PASTIC

Citations

Downloads

Views