A statistical Model for Annotating Videos with Human Actions.

MUG Khan; A Nasir; O Riaz; Y Gotoh; M Amiruddin

Author(s)

MUG Khan Deptt. of Computer Science & Engineering, Al-Khwarizmi Institute of Computer Science, University of Engineering & Technology, Lahore, Pakistan

A Nasir Deptt. of Computer Science & Engineering, Al-Khwarizmi Institute of Computer Science, University of Engineering & Technology, Lahore, Pakistan

O Riaz Deptt. of Computer Science, Islamia University, Bahawalpur, Pakistan

Y Gotoh Department of Computer Science, The University of Sheffield, UK

M Amiruddin Deptt. of Computer Science & Engineering, Al-Khwarizmi Institute of Computer Science, University of Engineering & Technology, Lahore, Pakistan

Abstract

This contribution addresses the approach to recognize single and multiple human actions in video streams. This work introduces a novel action recognition algorithm with normalization enhancements. Initially feature vectors are extracted using 2D SIFT features. Bag of Words model is extended with a new normalization technique on the visual vocabulary to make the dimensions same so that the actions would be easier to read and extract. This normalization technique vastly improves the results from the state of the art methods. HMM based model is developed for training and testing of six basic actions present in the KTH human action dataset. By comparing our work with previously applied models, results display that our approach vastly improves the accuracy of the existing methods of action recognition.

Publication Details

Page(s) 109-123

DOI DOI not available

Published Journal: Pakistan Journal of Statistics, Volume: 32, Issue: 2, Year: 2016

Request the full text from PASTIC

References

Baum , L.E.,,1972,An inequality and associated maximization technique in statistical estimation of probabilistic functions of Markov processes,Inequalities,3,1-8

Al-Ghandi , M.,Khan , M.U.G., Zhang, L.,Gotoh , L.,,2012,Instance search task at TRECVID, NIST,,,-

Agarwal , A.,Triggs , B.,,2006,Recovering 3D human pose from monocular images,IEEE Transactions,28,-

Bay , H.,Tuytelaars , T.,Gool , L.V.,,2006,SURF: Speeded up robust features,In Computer vision-European Conference on Computer Vision,,404-417

Beaudet , P.,,1978,Rotationally invariant image operators,In International Joint Conference on Pattern Recognition,579,583-

Blank , M.,Gorelick , L.,Shechtman , E.,Irani , M.,Basri , R.,,2005,Actions as space-time shapes,Tenth IEEE International Conference on Computer Vision,2,1395-1402

Bobick , A.F.,Davis , J.W.,,2001,The recognition of human movement using temporal templates,IEEE Transaction on Pattern Analysis and Machine Intelligence,23,257-267

Bobick , A.F.,Wilson , A.D.,,1995,Using configuration states for the representation and recognition of gesture,In Proc. Fifth International Conference on Computer Vision,,631-636

Gao , Z.,Chen , M.Y.,Hauptmann , A.G.,Cai , A.,,2010,Comparing evaluation protocols on the KTH dataset,In International conference on human behavior understanding,6219,88-100

Dollar , P.,Rabaud , V.,Cottrell , G.,Belongie , S.,,2005,Behavior recognition via sparse spatio-temporal features,In 2nd Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance,65,72-

Efros , A.A.,Berg , A.C.,Mori , G.,Malik , J.,,2003,Recognizing action at a distance,In Ninth IEEE International Conference on Computer Vision,,726-733

FathiA.,Mori , G.,,2008,Action recognition by learning mid-level motion features,In IEEE Conference on Computer Vision and Pattern Recognition,,1-8

Ferrari , V.,Marin-Jimenez , M.,Zisserman , A.,CVPR,,2008,1-8,In IEEE Conference on Computer Vision,,-

Freund , Y.,Schapire , R.,,1999,A short introduction to boosting,Journal of Japanese Society for Artificial Intelligence,14,771-780

Gorelick , L.,Blank , M.,Shechtman , E.,Irani , M.,Basri , R.,,2007,Actions as space-time shapes,Transactions on Pattern Analysis and Machine Intelligence,29,2247-2253

Rodriguez , M.,Ahmed , J.,Shah , M.,,2008,Action mach: A spatio-temporal maximum average correlation height filter for action recognition,In International Conference on Computer vision and Pattern Recognition.,,-