Abstract

Semaphore is a means of long-distance communication using semaphore flags as tools. This communication method has been used since ancient times to convey information. In Indonesia, semaphore communication is practiced in scouting activities and by mariners to convey specific messages. In these activities, communication using semaphores involves transmitting important information through specific gestures performed by demonstrators. Transmitting messages using semaphore letter codes can be challenging for beginners. With the increasing use of semaphores in specific fields, there is a need for a system that can automatically recognize semaphore letter gestures in real-time. The designed system can be used in learning processes and implementing semaphore letter code in reading devices. This research aims to design a real-time semaphore letter code recognition system using soft computing methods. Digital image processing is chosen for image recognition in the designed system. Image segmentation is employed to obtain the object parts of the image, followed by wavelet as a feature extraction method. Back propagation neural network (BPNN) is used for semaphore gesture classification. 910 image data were used to design the semaphore gesture recognition system. The success rate in sequential recognition is 94% at a distance of 3 meters, 90% at 4 meters, 88% at 5 meters, 86% at 6 meters, and 83% at 7 meters. The test results demonstrate the positive potential of the system for use in learning processes and the implementation of semaphore letter code reading devices.

Keyword

Semaphore code, Digital image processing, Image segmentation, Wavelet extraction, Back propagation neural networks.

Cite this article

Putra LS, Wigyarinto FT, Kusumawardhani E, Gunawan VA.Semaphore letter code recognition system using wavelet method and back propagation neural network. International Journal of Advanced Technology and Engineering Exploration. 2024;11(112):316-331. DOI:10.19101/IJATEE.2023.10102433

Refference

[1]https://prod-cms.scouts.org.uk/media/5508/generic-resources-semaphore-signals.pdf. Accessed 29 February 2024.

[2]Mead HP. The story of the semaphore. The Mariners Mirror. 1935; 21(1):33-55.

[3]Zhao Q, Li Y, Yang N, Yang Y, Zhu M. A convolutional neural network approach for semaphore flag signaling recognition. In international conference on signal and image processing 2016 (pp. 466-70). IEEE.

[4]Putra LS, Sumarno L, Gunawan VA. The recognition of semaphore letter code using Haar wavelet and Euclidean function. In 5th international conference on electrical engineering, computer science and informatics 2018 (pp. 759-63). IEEE.

[5]Rachmad A, Fuad M. Geometry algorithm on skeleton image based semaphore gesture recognition. Journal of Theoretical & Applied Information Technology. 2015; 81(1).

[6]Wang J, Du Z. A method of processing color image watermarking based on the Haar wavelet. Journal of Visual Communication and Image Representation. 2019; 64:102627.

[7]Iwane N. Arm movement recognition for flag signaling with Kinect sensor. In proceedings of international conference on virtual environments human-computer interfaces and measurement systems 2012 (pp. 86-90). IEEE.

[8]Guo T, Zhang T, Lim E, Lopez-benitez M, Ma F, Yu L. A review of wavelet analysis and its applications: challenges and opportunities. IEEE Access. 2022; 10:58869-903.

[9]Takano D, Minamoto T. Feature extraction method for early-stage colorectal cancer using dual-tree complex wavelet packet transform. In international conference on wavelet analysis and pattern recognition 2021 (pp. 1-4). IEEE.

[10]Chak WH, Saito N, Weber D. The scattering transform network with generalized morse wavelets and its application to music genre classification. In international conference on wavelet analysis and pattern recognition 2022 (pp. 25-30). IEEE.

[11]Ma Q, Yue C, Yu M, Song Y, Cui P, Yu Y. Research on fault diagnosis strategy of air-conditioning system based on signal demodulation and BPNN-PCA. International Journal of Refrigeration. 2024; 158:124-34.

[12]Ma H, Xiao J, Chen Z, Tang D, Gao Y, Zhan S, et al. Relationship between helicobacter pylori infection and type 2 diabetes using machine learning BPNN mathematical model under community information management. Results in Physics. 2021; 26:104363.

[13]Sanzogni L, Kerr D. Milk production estimates using feed forward artificial neural networks. Computers and Electronics in Agriculture. 2001; 32(1):21-30.

[14]Meade JAJ, Zeldin BA. Establishing criteria to ensure successful feedforward artificial neural network modelling of mechanical systems. Mathematical and Computer Modelling. 1998; 27(5):61-74.

[15]Reisenhofer R, Bosse S, Kutyniok G, Wiegand T. A Haar wavelet-based perceptual similarity index for image quality assessment. Signal Processing: Image Communication. 2018; 61:33-43.

[16]Tian N, Kuo B, Ren X, Yu M, Zhang R, Huang B, et al. A cloud-based robust semaphore mirroring system for social robots. In 14th international conference on automation science and engineering 2018 (pp. 1351-8). IEEE.

[17]Ren X, Meng Z. Damage identification for timber structure using curvature mode and wavelet transform. Structures. 2024; 60:105798.

[18]Deb S, Rahman S, Rahman S. GA-GWNN: generalized adaptive graph wavelet neural network. Pattern Recognition Letters. 2024; 177:128-34.

[19]Shi Y, Xia XL, Chen X, Sun C. A wavelet analysis method to retrieve thermal conductivity and radiative properties of intense extinction and low conductive medium. International Journal of Heat and Mass Transfer. 2023; 217:124659.

[20]Volvach A, Kurbasova G, Volvach L. Wavelets in the analysis of local time series of the Earths surface air. Heliyon. 2024; 10(1):1-16.

[21]Qiu C, Li H, Qi C, Li B. Enhancing ECG classification with continuous wavelet transform and multi-branch transformer. Heliyon. 2024; 10:1-15.

[22]Zhang Y, Zhao D, He L, Zhang Y, Huang J. Research on prediction model of electric vehicle thermal management system based on particle swarm optimization-back propagation neural network. Thermal Science and Engineering Progress. 2024; 47:102281.

[23]Aswathy AL, Hareendran A, SS VC. COVID-19 diagnosis and severity detection from CT-images using transfer learning and back propagation neural network. Journal of Infection and Public Health. 2021; 14(10):1435-45.

[24]Feng J, Duan T, Bao J, Li Y. An improved back propagation neural network framework and its application in the automatic calibration of storm water management model for an urban river watershed. Science of the Total Environment. 2024; 915:169886.

[25]Xiong Y, Yang H, Li X, Lei H, Lu G. Crashworthy optimization of skeleton-filled FRP tubes based on back propagation neural network. Heliyon. 2023; 9(12):1-15.

[26]Wang C, Zhang G, Yan J. An optimized back propagation neural network on small samples spectral data to predict nitrite in water. Environmental Research. 2024; 247:118199.

[27]Tian Y, Chang Y. Application of the particle swarm optimization algorithm-back propagation neural network algorithm introducing new parameter terms in the application field of industrial design. Results in Engineering. 2024; 21:101728.

[28]Voloshchuk D, Konstantaras AJ, Moshou A, Kasianova N, Skorniakova I, Argyrakis P, et al. Neural network modeling of seismic behaviour of the hellenic arc: strengths and limitations. International Journal of Advanced Technology and Engineering Exploration. 2022; 9(95):1428-47.

[29]Bandi R, Swamy S, Arvind CS. Leaf disease severity classification with explainable artificial intelligence using transformer networks. International Journal of Advanced Technology and Engineering Exploration. 2023; 10(100):278-302.

[30]Khan AR, Uzzaman F, Ahammad I, Prosad R, Zayed-us-salehin KT. Stock market prediction in Bangladesh perspective using artificial neural network. International Journal of Advanced Technology and Engineering Exploration. 2022; 9(95):1397-427.

[31]Pratumgul W, Sa-ngiamvibool W. The prototype of computer-assisted for screening and identifying severity of diabetic retinopathy automatically from color fundus images for mhealth system in Thailand. Procedia Computer Science. 2016; 86:457-60.

[32]Rezaei M, Rezaei M. Foreground-back ground segmentation using k-means clustering algorithm and support vector machine. Journal of Information Systems and Telecommunication. 2023; 1(41):65-74.

[33]Celik T, Tjahjadi T. Automatic image equalization and contrast enhancement using Gaussian mixture modeling. IEEE Transactions on Image Processing. 2011; 21(1):145-56.

[34]Gholami E, Kamel TSR. Diagnosis of gastric cancer via classification of the tongue images using deep convolutional networks. Journal of Information Systems and Telecommunication. 2021; 3(35):191-6.

[35]Sural S, Qian G, Pramanik S. Segmentation and histogram generation using the HSV color space for image retrieval. In proceedings international conference on image processing 2002 (pp. II-II). IEEE.

[36]Hernández-cámara P, Vila-tomás J, Laparra V, Malo J. Neural networks with divisive normalization for image segmentation. Pattern Recognition Letters. 2023; 173:64-71.

[37]Panda J, Meher S. An efficient pre-processing technique using HOLF for 2D image interpolation. In 8th international conference on signal processing and communication 2022 (pp. 283-8). IEEE.

[38]De BB, Galazzo IB, Pasetto L, Storti SF, Koepp M, Barnes A, et al. Pipeline comparison for the pre-processing of resting-state data in epilepsy. In 26th European signal processing conference 2018 (pp. 1137-41). IEEE.

[39]Zhao C, Xia B, Chen W, Guo L, Du J, Wang T. Multi-scale wavelet network algorithm for pediatric echocardiographic segmentation via hierarchical feature guided fusion. Applied Soft Computing. 2021; 107:107386.

[40]Tjandrasa H, Wijayanti A, Suciati N. Optic nerve head segmentation using Hough transform and active contours. TELKOMNIKA (Telecommunication Computing Electronics and Control). 2012; 10(3):531-6.

[41]Sidhu RK, Sachdeva J, Katoch D. Segmentation of retinal blood vessels by a novel hybrid technique-principal component analysis (PCA) and contrast limited adaptive histogram equalization (CLAHE). Microvascular Research. 2023; 148:104477.

[42]Kumar KA, Boda R. A threshold-based brain tumour segmentation from MR images using multi-objective particle swarm optimization. Journal of Information Systems and Telecommunication. 2021; 9(4):218-25.

[43]Joshi G, Kumar R, Chauhan AK. Segmentation and classification of brain tumor images using statistical feature extraction and deep neural networks. International Journal of Advanced Technology and Engineering Exploration. 2021; 8(85):1585-1602.

[44]Heena A, Biradar N, Maroof NM, Vishwanath P. Processing of echocardiographic images using segmentation, feature extraction and classification for detection of heart abnormality. Global Transitions Proceedings. 2022; 3(1):13-9.

[45]Chen W, Wang W, Wang K, Li Z, Li H, Liu S. Lane departure warning systems and lane line detection methods based on image processing and semantic segmentation: a review. Journal of Traffic and Transportation Engineering (English edition). 2020; 7(6):748-74.

[46]Wang XY, Sun WW, Wu ZF, Yang HY, Wang QY. Color image segmentation using PDTDFB domain hidden Markov tree model. Applied Soft Computing. 2015; 29:138-52.

[47]Cao L, Li H, Zhang Y, Zhang L, Xu L. Hierarchical method for cataract grading based on retinal images using improved Haar wavelet. Information Fusion. 2020; 53:196-208.

[48]Torkamani R, Sadeghzadeh RA. Wavelet-based Bayesian algorithm for distributed compressed sensing. Information Systems & Telecommunication. 2019; 7(2):87-95.

[49]Soomro FA, Usman M, Haq RU, Wang W. Thermal and velocity slip effects on MHD mixed convection flow of Williamson nanofluid along a vertical surface: modified Legendre wavelets approach. Physica E: Low-dimensional Systems and Nanostructures. 2018; 104:130-7.

[50]Imtiaz H, Fattah SA. A wavelet-based dominant feature extraction algorithm for palm-print recognition. Digital Signal Processing. 2013; 23(1):244-58.

[51]Chen Y, Hou F, Dong S, Guo L, Xia T, He G. Reliability evaluation of corroded pipeline under combined loadings based on back propagation neural network method. Ocean Engineering. 2022; 262:111910.

[52]Veerabadran V, Raina R, De SVR. Bio-inspired learnable divisive normalization for ANNs. In SVRHM 2021 Workshop 2021 (pp. 1-7). NeurIPS.

[53]Genna S, Simoncini A, Tagliaferri V, Ucciardello N. Optimization of the sandblasting process for a better electrodeposition of copper thin films on aluminum substrate by feedforward neural network. Procedia CIRP. 2017; 62:435-9.

[54]Liu B, Mohandes M, Nuha H, Deriche M, Fekri F, Mcclellan JH. A multitone model-based seismic data compression. IEEE Transactions on Systems, Man, and Cybernetics: Systems. 2021; 52(2):1030-40.

[55]Gunawan VA, Putra LS, Imansyah F, Kusumawardhani E. Identification of coronary heart disease through iris using gray level co-occurrence matrix and support vector machine classification. International Journal of Advanced Computer Science and Applications. 2022; 13(1):639-48.