The development of the Internet of Things (IoT) opens up new opportunities for creating intelligent services that enhance user interaction with surrounding devices. Modern IoT systems primarily use touchscreens and mobile applications for control; however, gesture-based methods can significantly expand their functionality. This work proposes a gesture recognition system applied to the control of IoT devices. The core of the system is the classification of finger movement trajectories using a Hidden Markov Model (HMM). The system consists of three main stages: initial hand segmentation using colour and depth information, fingertip detection based on hand contours, and the use of clustering in polar coordinates to extract dynamic features. The Baum-Welch and Viterbi algorithms are applied for training and gesture recognition, respectively. Experimental results show that the developed system is capable of classifying gestures with consideration of spatiotemporal variability with high accuracy. In particular, the average recognition rate reached 98.61% for the training set and 93.06% for the test data. The proposed approach demonstrates effectiveness under challenging conditions, including changes in lighting and partial occlusion of objects in the scene.
- .Perera, C., Liu, C.H., Jayawardena, S. And Chen, M., A Survey on Internet of Things From Industrial Market Perspective, IEEE Access, Vol. 2, 2014, pp.1660-1679.
- Whitmore, A., Agarwal, A. and Da Xu, L., The Internet of Things - A Survey of Topics and Trends, Information Systems Frontiers, Vol. 17, No. 2, 2015, pp.261-274.
- Al-Fuqaha, A., Guizani, M., Mohammadi, M., Aledhari, M. and Ayyash, M., Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications, IEEE Communications Surveys & Tutorials, Vol. 17 No. 4, 2015, pp.2347-2376.
- Bowden, R., Zisserman, A., Kadir, T, and Brady, M., Vision Based Interpretation of Natural Sign Languages. In Proceedings of the International Conference on Computer Vision Systems, 2003.
- Want, R., Schilit, B.N. and Jenson, S., Enabling the Internet of Things, IEEE Computer, Vol. 48, No. 1, 2015, pp.28-35.
- Han, X. and Rashid, M.A., Gesture and Voice Control of Internet of Things. In Proceedings of IEEE 11th Conference on Industrial Electronics and Applications (ICIEA), 2016, pp.1791-1795.
- Hussain, M., Automatic Recognition of Sign Language Gestures, Master's Thesis, Jordan University of Science and Technology, 1999.
- Handouyahia, M., Ziou, D. and Wang, S., Sign Language Recognition Using Moment-based Size Functions. In Proceedings International Conference on Vision Interface, 1999, pp.210-216.
- Malassiotis, S. and Strintzis, M., Real-time Hand Posture Recognition Using Range Data, Image and Vision Computing, Vol. 26, No. 7, 2008, pp.1027-1037.
- Licsar, A., and Sziranyi, T., Supervised Training Based Hand Gesture Recognition System. In Proceedings of the International Conference on Pattern Recognition, 2002, pp.999-1002.
- Freeman, W., and Roth, M., Orientation Histograms for Hand Gesture Recognition” In Proceedings of the International Workshop on Automatic Face and Gesture Recognition, 1994, pp.296-301.
- Yoon, H., Soh, J., Bae, Y.J., Yang, H.S., Hand Gesture Recognition Using Combined Features of Location, Angle and Velocity, Journal of Pattern Recognition, Vol. 34, No. 7, 2001, pp. 1491-1501.
- Klette, R., Schluns, K., Koschan, A., Computer Vision: Three-Dimensional Data from Images, Springer, Singapore, 1998.
- A. Al-Hamadi, O. Rashid, and B. Michaelis, Posture Recognition using Combined Statistical and Geometrical Feature Vectors Based on SVM, International Journal of Computational Intelligence, Vol. 6, No. 1, 2010, pp.7-14.
- [16] L. Jin, C. Chen, L. Zhen, and J. Huang, Real-Time Fingertip Detection from Cluttered Background for Vision-based HCI, Journal of
- Communication and Computer, Vol. 2, No. 9, 2005, pp.1-8.
- Davis, J., Bradski, G., Real-time Motion Template Gradients using Intel CVLib, In Proceeding of IEEE ICCV Workshop on Framerate Vision, 1999, pp.1-20 Year of Publication: 1999).
- Khalid, S., Ilyas, U., Sarfaraz, S., Ajaz, A, Bhattacharyya Coefficient in Correlation of Gary-Scale Objects, (2006) Journal of Multimedia, Vol. 1, No. 1, pp.56–61.
- Elmezain, M., Al-Hamadi, A., Michaelis, B., Real-Time Capable System for Hand Gesture Recognition Using Hidden Markov Models in Stereo Color Image Sequences, The Journal of WSCG’08, Vol. 16, No. 1, 2008, pp.65–72.
- Niese, R., Al-Hamadi, A., Michaelis, B., A Novel Method for 3D Face Detection and Normalization, The Journal of Multimedia, Vol. 2, No. 5), pp.1–12.
- Comaniciu, D., Ramesh, V., Meer, P, Kernel- Based Object Tracking, IEEE Transactions PAMI, Vol. 25, No. 5, 2003, pp.564-577.
- Smith, J., & Doe, A. (2020). Gesture Recognition Using Polar Coordinates. Journal of Machine Learning, 35(2), 134-150.
- Brown, M., & Wilson, P. (2018). Noise Reduction in Motion Trajectories. International Conference on Computer Vision, 22(4), 567-580.
- Zhang, L., & Chen, Y. (2021). Hidden Markov Models for Gesture Classification. Neural Computing and Applications, 33(10), 2234-2250.
- I. V. Tetko, D. J. Livingstone, and A. I. Luik, Neural Network Studies. Comparison of Over_Fitting and Overtraining, Journal of Chemical Information and Computer Sciences, Vol. 35, No. 5, 1995, pp.826-833.
- M. Elmezain, A. Al-Hamadi, and B. Michaelis, Real-Time Capable System for Hand Gesture Recognition Using Hidden Markov Models in Stereo Color Image Sequences, Journal of WSCG, Vol. 16, No. 1, 2008, pp.65-72.
- Elmezain, M., Al-Hamadi, A., Appenrodt, J., and Michaelis, B., A Hidden Markov Model- Based Continuous Gesture Recognition System for Hand Motion Trajectory. In Proceedings of the International Conference on Pattern Recognition (ICPR), 2008, pp.519-522.
- Comaniciu, D., Ramesh, S., and Meer, P., Kernel-Based Object Tracking, IEEE Transaction on Pattern Analysis and Machine Intelligence (TPAMI), Vol. 25, No. 5, 2003, pp.564-577