Hand Gesture Recognition for Game Control Using Camera-Based Sensors
Abstract
Hand gesture recognition has become an important interaction paradigm in human–computer interaction, particularly for gaming applications that require intuitive and immersive control mechanisms. Conventional input devices, such as keyboards and game controllers, often limit natural interaction and accessibility. Vision-based approaches using camera sensors offer a promising alternative by enabling contactless and intuitive game control. However, achieving accurate and real-time hand gesture recognition using low-cost camera-based sensors remains challenging due to variations in lighting conditions, background complexity, and computational constraints. Motivated by the growing demand for responsive and accessible interaction techniques, this study proposes a camera-based hand gesture recognition system designed for real-time game control. The main contribution of this research lies in the development of an integrated recognition pipeline that combines image preprocessing, feature extraction, gesture classification, and gesture-to-control mapping within a unified framework. The proposed system is implemented using RGB image input from a standard camera and evaluated in an interactive gaming environment. Experimental evaluation demonstrates that the system can accurately recognize predefined hand gestures and translate them into responsive game actions while maintaining real-time performance. The results indicate a favorable balance between recognition accuracy, computational efficiency, and interaction responsiveness, confirming the feasibility of the proposed approach for practical gaming applications. Future work will focus on expanding the gesture set, incorporating adaptive learning mechanisms to accommodate user variability, and enhancing robustness for more complex dynamic gestures and deployment scenarios.
Keywords
Full Text
Downloads
References
[2] Y. Zhang, C. Cao, and J. Cheng, “Real-time hand gesture recognition using deep convolutional neural networks,” IEEE Access, vol. 8, pp. 157690–157703, 2020, doi: 10.1109/ACCESS.2020.3020181.
[3] M. Abavisani, H. Vaezi Joze, and V. M. Patel, “Improving the performance of unimodal dynamic hand-gesture recognition using multimodal training,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 9, pp. 1–14, 2020, doi: 10.1109/TPAMI.2019.2949146.
[4] A. Molchanov, S. Gupta, K. Kim, and J. Kautz, “Hand gesture recognition with 3D convolutional neural networks,” IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 1–7, 2021, doi: 10.1109/CVPRW53098.2021.00062.
[5] J. Cai, Y. Liu, and M. Wang, “Efficient hand gesture recognition using lightweight deep learning models,” Neural Computing and Applications, vol. 34, no. 5, pp. 1–15, 2022, doi: 10.1007/s00521-021-06502-4.
[6] R. Chen, X. Sun, and Z. Li, “Vision-based human–computer interaction using machine learning: A review,” Sensors, vol. 22, no. 11, pp. 1–28, 2022, doi: 10.3390/s22114109.
[7] H. Liu, Z. Wang, and Y. Li, “Real-time dynamic hand gesture recognition using RGB cameras,” Multimedia Tools and Applications, vol. 82, no. 2, pp. 1–20, 2023, doi: 10.1007/s11042-022-13578-9.
[8] P. Kumar and S. Sharma, “Contactless game control using hand gesture recognition,” International Journal of Human–Computer Interaction, vol. 39, no. 4, pp. 1–14, 2023, doi: 10.1080/10447318.2022.2107456.
[9] A. K. Singh, R. Verma, and S. Gupta, “Vision-based interactive gaming using hand gestures,” IEEE Consumer Electronics Magazine, vol. 13, no. 1, pp. 1–9, 2024, doi: 10.1109/MCE.2023.3298452.
[10] L. Wang and Y. Chen, “Low-latency vision-based gesture recognition for real-time applications,” IEEE Transactions on Multimedia, vol. 26, pp. 1–12, 2024, doi: 10.1109/TMM.2023.3332197.
[11] D. Park, J. Lee, and S. Kim, “Robust hand gesture recognition under varying illumination conditions,” Pattern Recognition Letters, vol. 181, pp. 1–8, 2025, doi: 10.1016/j.patrec.2024.11.012.
[12] M. Rahman and T. Hossain, “Camera-based hand gesture recognition for interactive systems: Challenges and future directions,” IEEE Access, vol. 13, pp. 1–18, 2025, doi: 10.1109/ACCESS.2025.3456721.
License
Copyright (c) 2025 ACSIE (International Journal of Application Computer Science and Informatic Engineering)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.