Dynamic Network State Learning Model for Mobility Based WMSN Routing Protocol.

Mydhili K Nair; A. Ajina

Author(s)

Mydhili K Nair Department of Information Science and Engineering, Ramaiah Institute of Technology, Bangalore, India

A. Ajina Department of Computer Science and Engineering, Sir M Visvesvaraya Institute of Technology, Bangalore, India

Abstract

The rising demand of wireless multimedia sensor networks (WMSNs) has motivated academia-industries to develop energy efficient, Quality of Service (QoS) and delay sensitive communication systems to meet major real-world demands like multimedia broadcast, security and surveillance systems, intelligent transport system, etc. Typically, energy efficiency, QoS and delay sensitive transmission are the inevitable requirements of WMSNs. Majority of the existing approaches either use physical layer or system level schemes that individually can't assure optimal transmission decision to meet the demand. The cumulative efficiency of physical layer power control, adaptive modulation and coding and system level dynamic power management (DPM) are found significant to achieve these demands. With this motivation, in this paper a unified model is derived using enhanced reinforcement learning and stochastic optimization method. Exploiting physical as well as system level network state information, our proposed dynamic network state learning model (NSLM) applies stochastic optimization to learn network state-activity that derives an optimal DPM policy and PHY switching scheduling. NSLM applies known as well as unknown network state variables to derive transmission and PHY switching policy, where it considers DPM as constrained Markov decision process (MDP) problem. Here, the use of Hidden Markov Model and Lagrangian relaxation has made NSLM convergence swift that assures delay-sensitive, QoS enriched, and bandwidth and energy efficient transmission for WMSN under uncertain network conditions. Our proposed NSLM DPM model has outperformed traditional Q-Learning based DPM in terms of buffer cost, holding cost, overflow, energy consumption and bandwidth utilization.

Publication Details

Page(s) 266-278

DOI DOI not available

Published Journal: International Journal of Communication Networks and Information Security, Volume: 10, Issue: 2, Year: 2018

Request the full text from PASTIC

References

I. F.Akyildiz,T.Melodia,K. R.Chowdhury,Mar, 2007.A survey onwireless multimedia sensor networks,” Comput. Net 921 -

D.Guinard,V.Trifa,T.Pham,O.Liechti,Jun, 2009.Towards Physical Mashups in the Web of Things,”,in Proc. INSS'09 196 -

P. F.James,C.How,D.Bull,A.Nix,J. Adv. Signal Process.,Mar, 2008.Distortion-based link adaptation for wireless video transmission,” EURASIP, 1 -

M. V.Schaar,D. S.Turaga,Jan, 2007.Cross-layer packetization and retransmission strategies for delay-sensitive wireless multimedia transmission,”,IEEE Trans. Multimedia. 185 -

Y. P.Fallah,P.Nasiopoulos,H.Alnuweiri,Mar, 2008.,Efficient transmission of H.264 video over multirate IEEE 802.11e WLANs,” EURASIP J. Wireless Commun. Net 1 -

T.Melodia,and I. F.Akyildiz,Jun, 2010.Cross-layer QoS-Aware communication for ultra wide band wireless multimedia sensor networks,” IEEE J. Select. Areas Commun. 653 -

L.Shu,M.Hauswirth,L.Wang,Y.Zhang,J. H.Park,Oct, 2009.Cross-layer optimized data gathering in wireless multimedia sensor networks,”,in Proc. CSE'09 961 -

F.Oldewurtel,J.Ansari,P.Mahonen,Aug, 2008.Cross-layer design for distributed source coding in wireless sensor networks,”,in Proc. SENSORCOM' 08 435 -

L.Zhou,X.Wang,W.Tu,B.Geller,April, 2010.Distributed scheduling scheme for video streaming over multi-channel multi-radio multi-hop wireless networks,” IEEE J. Select. Areas Commun. 409 -

S.Li,R.Neelisetti,S.Kulkarni,A.Lim,Feb, 2010.An interference aware routing algorithm for multimedia streaming over wireless sensor networks,” Int. J. Multimedia Appl. 10 -

N.Saxena,A.Roy,J.Shin,Sept, 2008.Dynamic duty cycle and adaptive contention window based QoS-MAC protocol for wireless multimedia sensor networks,” Comput. Net 2532 -

A.Jin,W.Song,P.Ju,D.Zhou,Jun, 2014."Energy-Aware Cooperation Strategy With Uncoordinated Group Relays for DelaySensitive Services,” in Vehicular Technology,IEEE Transactions 2104 -

J.Sen,A.Ukil, 2009."An adaptable and QoS-aware routing protocol for Wireless Sensor Networks," in Wireless Communication, Vehicular Technology,Information Theory and Aerospace & Electronic Systems Technology, 1st International Conference 767 -

A.Ajina, April 2017.Cross Layered Network Condition Aware Mobile Wireless Multimedia Sensor Network Routing Protocol for Mission Critical Communication,International Journal of Communication Networks and Information Security (IJCNIS) 9 48 -56

R. S.Sutton,A. G.Barto, 1998.Reinforcement learning: an introduction, -

N.Mastronarde,Dec, 2011.Fast Reinforcement Learning for Energy-Efficient Wireless Communication,”,in IEEE Transactions on Signal Processing 6262 -

E.Evan-Dar,Y.Mansour,Dec, 2003.Learning rates for Q-learning,” Journal of Machine Learning Research 1 -

M.Triki,A. C.Ammari,Y.Wang,M.Pedram,Jan, 2014.Reinforcement learning algorithms for dynamic power management,” 2014 World Symposium on Computer Applications & Research (WSCAR) 1 -

H.Shen,Y.Tan,J.Lu,Q.Wu,Q.Qiu,Mar, 2013.,” ACM Transactions on Design Automation of Electronic Systems 1 -

V. A.Shiny,V.Nagarajan,April, 2012.Energy Efficient Routing Protocol for Mobile Wireless Sensor Network,” Int,Journal of Computer Applications 1 -

K.Khanke,July, 2015.An Energy Efficient and QoS Aware Routing Protocol for Wireless Sensor Network,International Journal of Advanced Research in Computer and Communication Engineering 1 -

S.Zhuo,Z.Wang,Y.Song,Z.Wang,L.Almeida, June 2013.iQueue-MAC: A Traffic Adaptive duty-cycled MAC Protocol with Dynamic Slot Allocation,Communications and Networking (SECON) 95 -

L.Zhang,Y.Zhang, July 2009."Energy-Efficient Cross-Layer Protocol of Channel-Aware Geographic-Informed Forwarding in Wireless Sensor Networks,",in IEEE Transactions on Vehicular Technology 58 3041 -3052

A.Alhalafi,L.Sboui,R.Naous,B.Shihada, April 2016."gTBS: A green Task-Based Sensing for energy efficient Wireless Sensor Networks,",2016 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) 136 -143

M.Al-Jemeli,F. A.Hussin,BasedMobile Wireless Sensor Networks,Feb, 2015.",in IEEE Sensors Journal 684 4 -

Y.Chen,L.Gao,Y.Xing,W.Yi,Dec, 2015."Cross-Layer Design for Energy-Efficient Reliable Routing in Wireless Sensor Networks," 2015 11th International Conference on Mobile Ad-hoc and Sensor Networks (MSN), Shenzhen, 31 -

A.Shareef,A.Shareef,Y.Zhu,Aug, 2015."Optrix: Energy aware cross layer routing using convex optimization in wireless sensor networks,",2015 IEEE International Conference on Networking, Architecture and Storage (NAS) 141 -

T.Jaradat,D.Benhaddou,M.Balakrishnan,A.AlFuqaha, July 2013."Energy efficient cross-layer routing protocol in Wireless Sensor Networks based on fuzzy logic,",2013 9th International Wireless Communications and Mobile Computing Conference (IWCMC) 177 -

G. S.Brar,S.Rani,V.Chopra,R.Malhotra,H.Song,S. H.Ahmed,Jan, 2016."Energy Efficient Direction-Based PDORP Routing Protocol for WSN," in IEEE Access, 3182 -

A.Tanwer,M.Hussain,P. S.Reel,July, 2010."Energy efficient wireless sensing framework to enhance mobile learning," 2010 International Conf,on Tech. for Education 50 -

WalidOsamy and Ahmed M. Khedr, April 2018.An algorithm for enhancing coverage and network lifetime in cluster-based Wireless Sensor Networks”,International Journal of Communication Networks and Information Security (IJCNIS) 10 1 -9

M.Chen,V. C.Leung,S.Mao,Y.Yuan,Nov, 2007.Directional geographical routing for real-time video communications in wireless sensor networks,” Comput. Commun. 3368 -

H. P.Shiang,M.,Oct, 2009.Var der Schaar, “Distributed resource management in multi-hop cognitive radio networks for delay sensitive transmission,”,IEEE Trans. Veh 941 -

P.Frossard,J. C. De Martin,R.Civanlar, 2008.Media streaming with network diversity,”,Proc. IEEE 96 39 -53

J. B. Othman , and B.,Yahya,Aug, 2010.Energy efficient and QoS based routing protocol for wireless sensor networks,” J. Parallel Distrib. Comput. 849 -

E.Felemban,S.Member,C.Lee, June 2006.Multipath multi-SPEED protocol for QoS guarantee of reliability and timeliness in wireless sensor networks,” IEEE Trans. Mobile Comput. 738 -

Jul, 2005.Medium Access Control (MAC) Quality of Service (QoS) Enhancements, 802 -

H.Kimand,S. G.Min,Nov, 2009.Priority-based QoSMAC protocol for wireless sensor networks,”,in Proc. IEEE IPDPS'09 1 -

S.Ehsan,B.Hamdaoui,Jan, 2012."A Survey on Energy-Efficient Routing Techniques with QoS Assurances for Wireless Multimedia Sensor Networks,",in Communications Surveys & Tutorials 265 -

B.Yahya,J.Ben-Othman,Oct, 2009."An energy efficient and QoS aware multipath routing protocol for wireless sensor networks," in Local Computer Networks,IEEE 34th Conference 93 -

Wang,May, 2012."QoSPMR: QoS-Aware and Priority-Based Multipath Routing Algorithm for WMSNs," in Engineering and Technology (S-CET, 1 -

SyarifahEzdiani Syed Nor Azlan, 2015.“Modelling the Integrated QoS for Wireless Sensor Networks with Heterogeneous Data Traffic,”,Open Journal of Internet Of Things (OJIOT) 1 -

D.Rajan,A.Sabharwal,B.Aazhang,Jan, 2004.Delay-bounded packet scheduling of bursty traffic over wireless channels,” IEEE Trans. on Information Theory 1 -

R.Berry, 2002.Communications over fading channels with delay constraints,”,IEEE Trans. Inf. Theory 1135 -

N.Salodkar,A.Bhorkar,A.Karandikar,V. S.Borkar,Apr, 2008.An on-line learning algorithm for energy efficient delay constrained scheduling over a fading channel,”,IEEE Journal on Selected Areas in Communications 732 -

M. H.Ngo,V.Krishnamurthy,Jan, 2010.Monotonocity of constrained optimal transmission policies in correlated fading channels with ARQ,”,IEEE Trans. on Signal Processing 438 -

Q.Liu,S.Zhou,G. B.Giannakis, 2005.Queuing with adaptive modulation and coding over wireless links: cross-layer analysis and design,”,IEEE Trans. on Wireless Communications 1142 -

D.Krishnaswamy,Dec, 2002.Network-assisted link adaptation with power control and channel reassignment in wireless networks,”,in Proc. 3G Wireless Conf. 165 -

K. B. Song , and S. A.,Mujtaba,Oct, 2003.On the code-diversity performance of bit-interleaved coded OFDM in frequencyselective fading channels,”,in Proc. IEEE Veh. Technol. Conf. 572 -

L.Benini,A.Bogliolo,G. A.Paleologo, June 1999.on computer-aided design of integrated circuits, 813 -

D.Bertsekas,R.Gallager, 1987., -

P.Auer,T.Jaksch,R.Ortner,Nov, 2009.Near-optimal regret bounds for reinforcement learning,” Advances in Neural Information Processing Systems 89 -