Gait-based gender spoofing detection using depth images
Muhammad Shazmil bin Mohd Sabilan and Azim Zaliha Abd Aziz
Abstract
Gender transformation, particularly transgender transitions, has become a significant challenge in biometric security systems, as it complicates the identification of an individual's original gender based on their birth sex. This issue is especially prevalent in gait-based gender identification systems, which can be spoofed by individuals who have undergone gender transformation. To address this challenge, this study proposes a novel gait-based gender spoofing detection method using depth images. Given the absence of publicly available gait-spoofing datasets, a new dataset called spoofing gait dataset (SpooGa) was developed for this research. The SpooGa dataset contains depth images capturing individuals' walking styles, tailored specifically to the study's requirements. The proposed method comprises three main stages: pre-processing, feature extraction, and classification. During the pre-processing stage, the dataset is standardized to ensure uniformity in data dimensions. Feature extraction involves normalizing the depth images using gait energy images (GEI), which are then divided into three parts: the upper body, body, and lower body. This study focuses on the body and lower body parts, which are mapped onto a principal component analysis (PCA) plane to reveal distinctive cyclical patterns indicating changes in viewpoint. Features are subsequently extracted using the leg, toe, hand (LETH) formula. For classification, three independent methods are employed: linear support vector machine (linear SVM), fine decision tree, and weighted k-nearest neighbor (weighted KNN) classifier. The feature dataset is divided into training (70%) and testing (30%) subsets. The performance of the proposed method is evaluated based on its ability to correctly identify the original gender of individual’s post-disguise. The experimental results demonstrate the effectiveness of the proposed method, achieving an accuracy of 92.30% with the linear SVM, 96.15% with the weighted KNN, and 92.30% with the fine decision tree classifiers. These findings indicate the potential of the proposed approach to enhance biometric security against gender spoofing attacks.
Keyword
Gait energy images, Gender transformation, Biometric security, Gait-based identification, Gender spoofing detection, Depth images, SpooGa dataset.
Cite this article
Sabilan MS, Aziz AZ.Gait-based gender spoofing detection using depth images. International Journal of Advanced Technology and Engineering Exploration. 2024;11(119):1406-1417. DOI:10.19101/IJATEE.2024.111100247
Refference
[1]Ng CB, Tay YH, Goi BM. Recognizing human gender in computer vision: a survey. In 12th pacific rim international conference on artificial Intelligence, Kuching, Malaysia, 2012 (pp. 335-46). Springer Berlin Heidelberg.
[2]Bouzouina Y, Hamami L. Multimodal biometric: iris and face recognition based on feature selection of iris with GA and scores level fusion with SVM. In 2nd international conference on bio-engineering for smart technologies (BioSMART) 2017 (pp. 1-7). IEEE.
[3]Hajri S, Kallel F, Hamida AB. Contrast enhancement and feature extraction algorithms of finger knucle print image for personal recognition. In 4th international conference on advanced technologies for signal and image processing 2018 (pp. 1-4). IEEE.
[4]Johansson G. Visual motion perception. Scientific American off prints, Freeman. 1975.
[5]Cai L, Zeng H, Zhu J, Cao J, Hou J, Cai C. Multi-view joint learning network for pedestrian gender classification. In international symposium on intelligent signal processing and communication systems 2017 (pp. 23-7). IEEE.
[6]Yu S, Tan T, Huang K, Jia K, Wu X. A study on gait-based gender classification. IEEE Transactions on Image Processing. 2009; 18(8):1905-10.
[7]Jones IIIRJ, Reilly TM, Cox MZ, Cole BM. Gender makes a difference: investigating consumer purchasing behavior and attitudes toward corporate social responsibility policies. Corporate Social Responsibility and Environmental Management. 2017; 24(2):133-44.
[8]Ramey A, Salichs MA. Morphological gender recognition by a social robot and privacy concerns: late breaking reports. In proceedings of the international conference on human-robot interaction 2014 (pp. 272-3). ACM.
[9]Iqtait M, Mohamad FS, Mamat M. Feature extraction for face recognition via active shape model (ASM) and active appearance model (AAM). In IOP conference series: materials science and engineering 2018 (pp. 1-8). IOP Publishing.
[10]Reimann H, Ramadan R, Fettrow T, Hafer JF, Geyer H, Jeka JJ. Interactions between different age-related factors affecting balance control in walking. Frontiers in Sports and Active Living. 2020; 2:1-19.
[11]Han J, Bhanu B. Statistical feature fusion for gait-based human recognition. In proceedings of the computer society conference on computer vision and pattern recognition 2004. IEEE.
[12]Wang J, She M, Nahavandi S, Kouzani A. A review of vision-based gait recognition methods for human identification. In international conference on digital image computing: techniques and applications 2010 (pp. 320-7). IEEE.
[13]Ahmed MH, Sabir AT. Human gender classification based on gait features using kinect sensor. In 3rd international conference on cybernetics 2017 (pp. 1-5). IEEE.
[14]Liu W, Zhang C, Ma H, Li S. Learning efficient spatial-temporal gait features with deep learning for human identification. Neuroinformatics. 2018; 16:457-71.
[15]Han J, Bhanu B. Individual recognition using gait energy image. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2005; 28(2):316-22.
[16]Gupta SK, Sultaniya GM, Chattopadhyay P. An efficient descriptor for gait recognition using spatio-temporal cues. In emerging technology in modelling and graphics: proceedings of IEM graph 2020 (pp. 85-97). Springer Singapore.
[17]Liu T, Sun B, Chi M, Zeng X. Gender recognition using dynamic gait energy image. In 2nd information technology, networking, electronic and automation control conference 2017 (pp. 1078-81). IEEE.
[18]Lu H, Plataniotis KN, Venetsanopoulos AN. MPCA: multilinear principal component analysis of tensor objects. IEEE Transactions on Neural Networks. 2008; 19(1):18-39.
[19]Nanaa K, Rizon M, Abd RMN, Ibrahim Y, Abd AAZ. Detecting mango fruits by using randomized hough transform and backpropagation neural network. In 18th international conference on information visualisation 2014 (pp. 388-91). IEEE.
[20]Hongye X, Zhuoya H. Gait recognition based on gait energy image and linear discriminant analysis. In international conference on signal processing, communications and computing 2015 (pp. 1-4). IEEE.
[21]Xu C, Makihara Y, Ogi G, Li X, Yagi Y, Lu J. The OU-ISIR gait database comprising the large population dataset with age and performance evaluation of age estimation. IPSJ Transactions on Computer Vision and Applications. 2017; 9:1-4.
[22]Wong PL, Abas ZA. An analysis of human silhouettes with normalised silhouettes images and shape fourier descriptors. International Journal of Human and Technology Interaction. 2017; 1(1):31-6.
[23]Jain A, Kanhangad V. Gender classification in smartphones using gait information. Expert Systems with Applications. 2018; 93:257-66.
[24]Chiu HJ, Li TH, Kuo PH. Breast cancer–detection system using PCA, multilayer perceptron, transfer learning, and support vector machine. IEEE Access. 2020; 8:204309-24.
[25]Mokhairi M, Engku FHSA. Comparison of image classification techniques using CALTECH 101 dataset. Journal of Theoretical and Applied Information Technology. 2015; 71(1):79-86.
[26]Chen H, Lareau C, Andreani T, Vinyard ME, Garcia SP, Clement K, et al. Assessment of computational methods for the analysis of single-cell ATAC-seq data. Genome Biology. 2019; 20:1-25.
[27]Hassan OM, Abdulazeez AM, Tiryaki VM. Gait-based human gender classification using lifting 5/3 wavelet and principal component analysis. In international conference on advanced science and engineering 2018 (pp. 173-8). IEEE.
[28]Kumar G, Singh UP, Jain S. An adaptive particle swarm optimization-based hybrid long short-term memory model for stock price time series forecasting. Soft Computing. 2022; 26(22):12115-35.
[29]He Y, Zhang J, Shan H, Wang L. Multi-task GANs for view-specific feature learning in gait recognition. IEEE Transactions on Information Forensics and Security. 2018; 14(1):102-13.
[30]Singh B, Patel S, Vijayvargiya A, Kumar R. Analyzing the impact of activation functions on the performance of the data-driven gait model. Results in Engineering. 2023; 18:101029.
[31]Jun K, Lee K, Lee S, Lee H, Kim MS. Hybrid deep neural network framework combining skeleton and gait features for pathological gait recognition. Bioengineering. 2023; 10(10):1-20.
[32]Mogan JN, Lee CP, Lim KM, Ali M, Alqahtani A. Gait-CNN-ViT: multi-model gait recognition with convolutional neural networks and vision transformer. Sensors. 2023; 23(8):1-15.
[33]Andersson V, Araujo R. Person identification using anthropometric and gait data from kinect sensor. In proceedings of the AAAI conference on artificial intelligence 2015 (pp. 425-31). AAAI.
[34]Camalan S, Sengul G, Misra S, Maskeliūnas R, Damaševičius R. Gender detection using 3d anthropometric measurements by kinect. Metrology and Measurement Systems. 2018; 25(2):253-67.