Algorithm for Human Action Recognition Based on Images and Visual Data Using OpenPose
Human action recognition is a fundamental task in the field of computer vision and has become increasingly important in applications such as human-computer interaction, intelligent surveillance systems, virtual and augmented reality, and smart transportation. With the rapid advancement of deep learning techniques and cutting-edge algorithms, the effectiveness and accuracy of action recognition systems have significantly improved in recent years. In this study, we propose a real-time human action prediction model based on skeletal keypoints extracted from static RGB images using the OpenPose framework. The model processes spatial configurations of human joints to identify and classify actions with high precision. By leveraging Part Affinity Fields (PAFs) and confidence maps, our system successfully estimates human poses and tracks body movements efficiently. Experimental results demonstrate that the proposed approach outperforms several traditional methods, including DeeperCut (58.1%) and Convolutional Pose Machines (CPM) (55.2%), achieving a Percentage of Correct Keypoints (PCK) of 85.2%. This high accuracy indicates the model’s robustness and its potential for real-world applications that require efficient and accurate motion analysis in real-time scenarios. The results highlight the advantages of combining deep learning with skeletal keypoint estimation for advanced and scalable human action recognition systems.
[1] F. M. Noori, B. Wallace, M. Z. Uddin, and J. Torresen, “A Robust Human Activity Recognition Approach Using OpenPose, Motion Features, and Deep Recurrent Neural Network,” in Proceedings, 2022.
[2] Y. Liu, H. Zhang, D. Xu, and K. He, “Graph Transformer Network with Temporal Kernel Attention for Skeleton-Based Action Recognition,” Neurocomputing, 2022.
[3] E. Insafutdinov et al., “DeeperCut: A Deeper, Stronger, and Faster Multi- Person Pose Estimation Model,” in European Conference on Computer Vision (ECCV), 2016.
[4] S.-E. Wei et al., “Convolutional Pose Machines,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
[5] K. He et al., “Mask R-CNN,” in IEEE International Conference on Computer Vision (ICCV), 2017.
[6] Z. Cao et al., “Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
[7] Z. Sun, J. Liu, Q. Ke, H. Rahmani, M. Bennamoun et al., “Human action recognition from various data modalities: A review,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 4, pp. 67–77, 2022.
[8] G. Moon et al., “V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
[9] CMU Perceptual Computing Lab, “OpenPose GitHub Repository,” https://github.com/CMU-Perceptual-Computing-Lab/openpose.
[10] B. Xiao, H. Wu, and Y. Wei, “Simple Baselines for Human Pose Estimation and Tracking,” in European Conference on Computer Vision (ECCV), 2018.
[11] H. Joo et al., “Panoptic Studio: A Massively Multiview System for Social Motion Capture,” in IEEE International Conference on Computer Vision (ICCV), 2015.
[12] J. Liu et al., “NTU RGB+D: A Large-Scale Dataset for 3D Human Activity Analysis,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
[13] A. F. Bobick and J. W. Davis, “The Recognition of Human Movement Using Temporal Templates,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001.
[14] S. Patel et al., “A Review of Wearable Sensors and Systems with Application in Rehabilitation,” Journal of NeuroEngineering and Re- habilitation, 2012.
[15] R. Poppe, “A Survey on Vision-Based Human Action Recognition,” Image and Vision Computing, 2010.
[16] M. Zyda, “From Visual Simulation to Virtual Reality to Games,” IEEE Computer, 2005.
[17] Sadullayeva Sh.A., Fayzullayeva Z.I. Matnlarni semantik tahlil asosida anotatsiyalash// Digital transformation and artificial intelligence, 2(6), Raqamli Transformatsiya va Sun’iy Intellekt ilmiy jurnali, ISSN: 3030-3346, VOLUME 2, ISSUE 6, DECEMBER 2024. 117–122. Retrieved from https://dtai.tsue.uz/index.php/dtai/article/view/v2i624 - 5 %.
[18] Fayzullayeva Z.I., Mengliqulov Sh. Meylikulov Sh. Kobulov M., Education artificial intelligence systems and their use in teaching, AIP Conference Proceedings. – 2024. – Vol. 3244(2024) – P. 030049-1 - 030049-9