ENHANCING KURDISH SIGN LANGUAGE RECOGNITION THROUGH RANDOM FOREST CLASSIFIER AND NOISE REDUCTION VIA SINGULAR VALUE DECOMPOSITION (SVD)
DOI:
https://doi.org/10.25271/sjuoz.2024.12.2.1263Keywords:
Sign Language, Kurdish Sign Language, Random Forest Algorithm, Real Time Recognition and Singular Value Decomposition.Abstract
Deaf people around the world face difficulty communicating with others. Hence, they use their own language to communicate with each other. This paper introduces a new approach for Kurdish sign language recognition using the random forest classifier algorithm aiming to facilitate communication for deaf communities to communicate with others without relying on human interpreters. On the other side, for further enhancement of the images captured during recognition linear algebra techniques have been used such as singular value decomposition for image compression and Moore–Penrose inverse for blur removal. Kurdish language has 34 alphabets and (10 numeric numbers 10, . . . ,3 ,2 ,1). Additionally, three extra signs have been created and added to the dataset, such as space, backspace, and delete sentences for the purpose of real-time translation. A collection of 800 images has been gathered for each character, out of 800 images, only 80 per character were used due to their similar positions but varied alignment, totalling 3,520 images for the dataset (44 characters 80 images each). Two simulation scenarios were carried out: one with optimal conditions - a white background and adequate lighting, and another with challenges such as complex backgrounds and varied lighting angles. Both achieved high match rates of 96% and 87%, respectively. Further, a classification report analyzed precision, recall, and F1 score metrics.
References
Abdi, H. (2007). Singular value decomposition (SVD) and generalized singular value decomposition. Encyclopedia of measurement and statistics, 907, 912.
Alzohairi, R., Alghonaim, R., Alshehri, W., & Aloqeely, S. (2018). Image based Arabic sign language recognition system. International Journal of Advanced Computer Science and Applications, 9(3).
Aly, S., Osman, B., Aly, W., & Saber, M. (2016). Arabic sign language fingerspelling recognition from depth and intensity images. In 2016 12th International Computer Engineering Conference (ICENCO) (pp. 99-104). IEEE.
Barata, J. C. A., & Hussein, M. S. (2012). The Moore–Penrose pseudoinverse: A tutorial review of the theory. Brazilian Journal of Physics, 42, 146-165.
Cheok, M. J., Omar, Z., & Jaward, M. H. (2019). A review of hand gesture and sign language recognition techniques. International Journal of Machine Learning and Cybernetics, 10, 131-153.
Daniels, S., Suciati, N., & Fathichah, C. (2021, February). Indonesian sign language recognition using yolo method. In IOP Conference Series: Materials Science and Engineering (Vol. 1077, No. 1, p. 012029). IOP Publishing.
Hama Rawf, K. M., Abdulrahman, A. O., & Mohammed, A. A. (2024). Improved Recognition of Kurdish Sign Language Using Modified CNN. Computers, 13(2), 37.
Hashim, A. D., & Alizadeh, F. (2018). Kurdish sign language recognition system. UKH Journal of Science and Engineering, 2(1), 1-6.
Huang, J., Zhou, W., Zhang, Q., Li, H., & Li, W. (2018, April). Video-based sign language recognition without temporal segmentation. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 32, No. 1).
Kamal, Z., & Hassani, H. (2020). Towards Kurdish text to sign translation. In Proceedings of the LREC2020 9th Workshop on the Representation and Processing of Sign Languages: Sign Language Resources in the Service of the Language Community, Technological Challenges and Application Perspectives (pp. 117-122).
KP Nimisha and Agnes Jacob. “A brief review of the recent trends in sign language recognition”. In: 2020 International Conference on Communication and Signal Processing (ICCSP). IEEE. 2020, pp. 186–190.
Leigh, G., & Crowe, K. (2015). Responding to cultural and linguistic diversity among deaf and hard-of-hearing learners. Educating deaf learners: Creating a global evidence base, 69-92.
Liu, Y., Wang, Y., & Zhang, J. (2012). New machine learning algorithm: Random forest. In Information Computing and Applications: Third International Conference, ICICA 2012, Chengde, China, September 14-16, 2012. Proceedings 3 (pp. 246-252). Springer Berlin Heidelberg.
Li, S. Z., Yu, B., Wu, W., Su, S. Z., & Ji, R. R. (2015). Feature learning based on SAE–PCA network for human gesture recognition in RGBD images. Neurocomputing, 151, 565-573.
Lugaresi, C., Tang, J., Nash, H., McClanahan, C., Uboweja, E., Hays, M., ... & Grundmann, M. (2019). Mediapipe: A framework for building perception pipelines. arXiv preprint arXiv:1906.08172.
Mahmood, M. R., & Abdulazeez, A. M. (2019, April). Different model for hand gesture recognition with a novel line feature extraction. In 2019 International Conference on Advanced Science and Engineering (ICOASE) (pp. 52-57). IEEE.
Mayyadah Ramiz Mahmood, Adnan Mohsin Abdulazeez, and Zeynep Orman. “Dynamic hand gesture recognition system for kurdish sign language using two lines of features”. In: 2018 International Conference on Advanced Science and Engineering (ICOASE). IEEE. 2018, pp. 42– 47.
Mirza, S. F., & Al-Talabani, A. K. (2021). Efficient kinect sensor-based kurdish sign language recognition using echo system network. ARO-The Scientific Journal of Koya University, 9(2), 1-9.
Nimisha, K. P., & Jacob, A. (2020, July). A brief review of the recent trends in sign language recognition. In 2020 International Conference on Communication and Signal Processing (ICCSP) (pp. 186-190). IEEE.
Parmar, A., Katariya, R., & Patel, V. (2019). A review on random forest: An ensemble classifier. In International conference on intelligent data communication technologies and internet of things (ICICI) 2018 (pp. 758-763). Springer International Publishing.
Rastgoo, R., Kiani, K., & Escalera, S. (2021). Sign language recognition: A deep survey. Expert Systems with Applications, 164, 113794.
Rawf, K. H., Abdulrahman, A., & Mohammed, A. (2022). Effective Kurdish Sign Language Detection and Classification Using Convolutional Neural Networks.
Salim , B. W. ., & Zeebaree , S. R. M. . (2023). Kurdish Sign Language Recognition Based on Transfer Learning. International Journal of Intelligent Systems and Applications in Engineering, 11(6s), 232–245.
Tang, A., Lu, K., Wang, Y., Huang, J., & Li, H. (2015). A real-time hand posture recognition system using deep neural networks. ACM Transactions on Intelligent Systems and Technology (TIST), 6(2), 1-23.
Taskiran, M., Killioglu, M., & Kahraman, N. (2018). A real-time system for recognition of American sign language by using deep learning. In 2018 41st international conference on telecommunications and signal processing (TSP) (pp. 1-5). IEEE.
United Nations. (April 11, 2024). International Day of Sign Languages. Retrieved from https://www.un.org/en/observances/sign-languages-day
Valli, C., & Lucas, C. (2000). Linguistics of American sign language: An introduction. Gallaudet University Press.
Varshney, P. K., Kumar, G., Kumar, S., Thakur, B., Saini, P., & Mahajan, V. (2023). Real Time Sign Language Recognition.
Xu, Y., & Goodacre, R. (2018). On splitting training and validation set: a comparative study of cross-validation, bootstrap and systematic sampling for estimating the generalization performance of supervised learning. Journal of analysis and testing, 2(3), 249-262.
Youssif, A. A., Aboutabl, A. E., & Ali, H. H. (2011). Arabic sign language (arsl) recognition system using hmm. International Journal of Advanced Computer Science and Applications, 2(11).
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Sara A. Ahmed, Bozhin N. Mahmood, Diar J. Mahmood, Mohammed M. Namq
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License [CC BY-NC-SA 4.0] that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work, with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online.