Hand Gesture Recognition for Game Control Using Camera-Based Sensors

https://doi.org/10.33173/acsie.v7i2.291
  • Anak Agung Surya PradhanaOkayama University
  • I Nyoman Darma KotamaOkayama University

Abstract

Hand gesture recognition has become an important interaction paradigm in human–computer interaction, particularly for gaming applications that require intuitive and immersive control mechanisms. Conventional input devices, such as keyboards and game controllers, often limit natural interaction and accessibility. Vision-based approaches using camera sensors offer a promising alternative by enabling contactless and intuitive game control. However, achieving accurate and real-time hand gesture recognition using low-cost camera-based sensors remains challenging due to variations in lighting conditions, background complexity, and computational constraints. Motivated by the growing demand for responsive and accessible interaction techniques, this study proposes a camera-based hand gesture recognition system designed for real-time game control. The main contribution of this research lies in the development of an integrated recognition pipeline that combines image preprocessing, feature extraction, gesture classification, and gesture-to-control mapping within a unified framework. The proposed system is implemented using RGB image input from a standard camera and evaluated in an interactive gaming environment. Experimental evaluation demonstrates that the system can accurately recognize predefined hand gestures and translate them into responsive game actions while maintaining real-time performance. The results indicate a favorable balance between recognition accuracy, computational efficiency, and interaction responsiveness, confirming the feasibility of the proposed approach for practical gaming applications. Future work will focus on expanding the gesture set, incorporating adaptive learning mechanisms to accommodate user variability, and enhancing robustness for more complex dynamic gestures and deployment scenarios.

Keywords

Hand Gesture Recognition; Computer Vision; Camera-Based Sensors; Game Control; Human–Computer Interaction

Full Text

Downloads

Download data is not yet available.

References

[1] S. Rautaray and A. Agrawal, “Vision-based hand gesture recognition for human–computer interaction: A survey,” Artificial Intelligence Review, vol. 54, no. 3, pp. 1–35, 2021, doi: 10.1007/s10462-020-09905-5.
[2] Y. Zhang, C. Cao, and J. Cheng, “Real-time hand gesture recognition using deep convolutional neural networks,” IEEE Access, vol. 8, pp. 157690–157703, 2020, doi: 10.1109/ACCESS.2020.3020181.
[3] M. Abavisani, H. Vaezi Joze, and V. M. Patel, “Improving the performance of unimodal dynamic hand-gesture recognition using multimodal training,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 9, pp. 1–14, 2020, doi: 10.1109/TPAMI.2019.2949146.
[4] A. Molchanov, S. Gupta, K. Kim, and J. Kautz, “Hand gesture recognition with 3D convolutional neural networks,” IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 1–7, 2021, doi: 10.1109/CVPRW53098.2021.00062.
[5] J. Cai, Y. Liu, and M. Wang, “Efficient hand gesture recognition using lightweight deep learning models,” Neural Computing and Applications, vol. 34, no. 5, pp. 1–15, 2022, doi: 10.1007/s00521-021-06502-4.
[6] R. Chen, X. Sun, and Z. Li, “Vision-based human–computer interaction using machine learning: A review,” Sensors, vol. 22, no. 11, pp. 1–28, 2022, doi: 10.3390/s22114109.
[7] H. Liu, Z. Wang, and Y. Li, “Real-time dynamic hand gesture recognition using RGB cameras,” Multimedia Tools and Applications, vol. 82, no. 2, pp. 1–20, 2023, doi: 10.1007/s11042-022-13578-9.
[8] P. Kumar and S. Sharma, “Contactless game control using hand gesture recognition,” International Journal of Human–Computer Interaction, vol. 39, no. 4, pp. 1–14, 2023, doi: 10.1080/10447318.2022.2107456.
[9] A. K. Singh, R. Verma, and S. Gupta, “Vision-based interactive gaming using hand gestures,” IEEE Consumer Electronics Magazine, vol. 13, no. 1, pp. 1–9, 2024, doi: 10.1109/MCE.2023.3298452.
[10] L. Wang and Y. Chen, “Low-latency vision-based gesture recognition for real-time applications,” IEEE Transactions on Multimedia, vol. 26, pp. 1–12, 2024, doi: 10.1109/TMM.2023.3332197.
[11] D. Park, J. Lee, and S. Kim, “Robust hand gesture recognition under varying illumination conditions,” Pattern Recognition Letters, vol. 181, pp. 1–8, 2025, doi: 10.1016/j.patrec.2024.11.012.
[12] M. Rahman and T. Hossain, “Camera-based hand gesture recognition for interactive systems: Challenges and future directions,” IEEE Access, vol. 13, pp. 1–18, 2025, doi: 10.1109/ACCESS.2025.3456721.

License

Copyright (c) 2025 ACSIE (International Journal of Application Computer Science and Informatic Engineering)

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.