Vision-based human action recognition has an increasing importance among the computer vision community with applications to visual surveillance, video retrieval, Video Indexing, Robotics and human-computer interaction. This paper presents a survey on human recognition using neural networks and the popular datasets used for it. A detailed survey of learning based approaches for human action representation is presented in this paper which is the core of action recognition. The Experimental Evaluation of various papers are analyzed efficiently with the various performance of recent methods using KTH and UCF sports action dataset are also analyzed.

action recognition, convolution neural network, action representation

[1] D. G. Daniel Schacter, D. Wegner, Psychology, New York: Worth, 2011.
[2] Y. LeCun, L. Bottou, Y. Bengio, P. Haffner, Gradient-based learning applied to document recognition, Proceedings of the IEEE 86 (11), (1998) 2278–2324.
[3] J. K. Aggarwal, M. S. Ryoo, Human activity analysis: A review, ACM Computing Surveys (CSUR) 43 (3) (2011) 16.
[4] J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, L. Fei-Fei, Imagenet: A large-scale hierarchical image database, in: IEEE Conference on Computer Vision and Pattern Recognition,, 2009.
[5] F. Ning, D. Delhomme, Y. LeCun, F. Piano, L. Bottou, P. E. Barbano, Toward automatic phenotyping of developing embryos from videos, IEEE Transactions on Image Processing 14 (9) (2005) 1360–1371.
[6] G. E. Hinton, S. Osindero, Y.-W. Teh, A fast learning algorithm for deep belief nets, Neural computation 18 (7) (2006) 1527–1554.
[7] G. W. Taylor, R. Fergus, Y. LeCun, C. Bregler, Convolutional learning of spatio-temporal features, in: European Conference on Computer Vision, Springer, 2010.
[8] R. Memisevic, G. Hinton, Unsupervised learning of image transformations, in: IEEE Conference on Computer Vision and Pattern Recognition,, 2007.
[9] Y. LeCun, L. Bottou, Y. Bengio, P. Haffner, Gradient-based learning applied to document recognition, Proceedings of the IEEE 86 (11)(1998) 2278–2324.
[10] H.-J. Kim, J. S. Lee, H.-S. Yang, Human action recognition using a modified convolutional neural network, in: Advances in neural information processing systems, Springer, 2007.
[11] J. P. Jones, L. A. Palmer, An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex, Journal of neurophysiology 58 (6) (1987) 1233–1258.

[12] H. Jhuang, T. Serre, L. Wolf, T. Poggio, A biologically inspired system for action recognition, in: IEEE International Conference on Computer Vision,, 2007.
[13] K. Fukushima, Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position, Biological cybernetics 36 (4) (1980) 193–202.
[14] D. Wu, L. Shao, Leveraging hierarchical parametric networks for skeletal joints based action segmentation and recognition, in: IEEE Conference on Computer Vision and Pattern Recognition, 2014.
[15] G. W. Taylor, G. E. Hinton, S. T. Roweis, Modeling human motion using binary latent variables, in: Advances in neural information processing systems, 2006.
[16] L. E. Baum, T. Petrie, Statistical inference for probabilistic functions of finite state Markov chains, The annals of mathematical statistics.
[17] S. Ji, W. Xu, M. Yang, K. Yu, 3D convolutional neural networks for human action recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence 35 (1) (2013) 221–231.
[18] Q. V. Le, W. Y. Zou, S. Y. Yeung, A. Y. Ng, Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis, in: IEEE Conference on Computer Vision and Pattern Recognition, 2011.
[19] M. Baccouche, F. Mamalet, C. Wolf, C. Garcia, A. Baskurt, Sequential deep learning for human action recognition, in: Human Behavior Understanding, Springer, 29–39, 2011.
[20] A. Graves, M. Liwicki, S. Fern´andez, R. Bertolami, H. Bunke, J. Schmidhuber, A novel connectionist system for unconstrained hand-writing recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence 31 (5) (2009) 855–868.
[21] Y. Du, W. Wang, L. Wang, Hierarchical recurrent neural network for skeleton based action recognition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1110–1118, 2015.
[22] A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, L. Fei- Fei, Large-scale video classification with convolutional neural networks, in: IEEE Conference on Computer Vision and Pattern Recognition, 2014.
[23] Allah BuxSargano, Xiaofeng Wang, PlamenAngelov, and ZulfiqarHabib, “Human Action Recognition using Transfer Learning with Deep Representations, IEEE, 2017, pp. 463-469.
[24] Charalampous, K. and A. Gasteratos, On-line deep learning method for action recognition. Pattern Analysis and Applications, 2016.19(2): p. 337-354.
[25] RahmanAhad, M.A., M.N. Islam, and I. Jahan, Action recognition based on binary patterns of action-history and histogram of oriented gradient. Journal on Multimodal User Interfaces, 2016.
[26] Ding, S. and S. Qu. An improved interest point detector for human action recognition.in Control and Decision Conference (CCDC), 2016 Chinese. 2016. IEEE.
[27] V. Veeriah, N. Zhuang, and G.-J. Qi, “Differential recurrent neural networks for action recognition,” in Proceedings of the IEEE International Conference on Computer Vision, 2015, pp. 4041–4049.
[28] Y. Shi, W. Zeng, T. Huang, and Y. Wang, “Learning deep trajectory descriptor for action recognition in videos using deep neural networks,” in 2015 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 2015, pp. 1–6.
[29] Tian, Y., Ruan, Q., An, G., Fu, Y., Action Recognition Using Local Consistent Group Sparse Coding with Spatio-Temporal Structure. in Proceedings of the 2016 ACM on Multimedia Conference. 2016. ACM.
[30] N. Ballas, L. Yao, C. Pal, and A. Courville, “Delving deeper into convolutional networks for learning video representations,” International Conference of Learning Representations, 2016.
[31] Atmosukarto, I., N. Ahuja, and B. Ghanem. Action recognition using discriminative structured trajectory groups. in 2015 IEEE Winter Conference on Applications of Computer Vision. 2015. IEEE.
[32] L. Sun, K. Jia, D.-Y. Yeung, and B. E. Shi, “Human action recognitionusing factorized spatio-temporal convolutional networks,” in Proceedingsof the IEEE International Conference on Computer Vision, 2015,pp. 4597–4605.
[33] L. Wang, Y. Qiao, and X. Tang, “Action recognition with trajectory pooled deep-convolutional descriptors,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 4305–4314.