Computer Vision-Based Gait Recognition on the Edge: A Survey on Feature Representations, Models, and Architectures

1. Introduction

In an era marked by the proliferation of smart devices and video surveillance systems, biometrics has emerged as a crucial field for secure and convenient identity verification. Among various biometric modalities, computer vision-based gait recognition (CVGR), which analyses an individual’s unique walking pattern, provides a non-invasive and potentially unobtrusive identification method [1]. However, traditional CVGR systems, often reliant on centralised cloud-based architectures, face challenges in terms of latency, bandwidth consumption, and privacy concerns. The emergence of edge computing, which brings computation and data storage closer to the source, presents a compelling paradigm shift. CVGR systems deployed on the edge unlock diverse opportunities, from reducing latency in biometric authentication to enabling real-time fall detection and rehabilitation monitoring, and even opening new avenues for human-computer interaction.

Gait data can be gathered using various wearable sensors, including accelerometers, gyroscopes, and goniometers [2]. In contrast, CVGR systems primarily rely on 2D or 3D imaging sensors to capture gait data from long distances, even without the subject’s active participation [1]. CVGR systems offer several advantages: they are non-invasive, robust to impersonation, function well over long distances, do not need high-quality cameras, and can be combined with other sensing modalities [3]. Additionally, as shown in Figure 1, recent years have witnessed a shift in gait pattern recognition, moving away from traditional approaches towards modern techniques based on deep learning (DL). Not only does this enable higher accuracy in gait identification, but also allows the deployment of CVGR in more challenging and varied environments.

Despite advancements, challenges such as varying view angles, intra-class variations, body segment localisation, and occlusions persist in CVGR systems. Researchers have recently addressed some of these challenges by increasing the complexity of the architectures [4,5,6,7]. However, such complexity comes at the expense of high computational costs and resource requirements, hindering on-site deployment due to high resource demands. Fortunately, ongoing advancements in hardware and software for embedded systems are leading to smaller, more powerful computers (e.g., Jetson Nano Orin, Jetson Xavier NX, Khadas VIM4, and Google Coral Edge TPU), enabling the embedding of DL models, even in resource-constrained settings. This trend positions edge computing as a promising solution for deploying DL-based gait recognition in applications like intelligent, real-time surveillance and healthcare monitoring.

Several comprehensive reviews have been conducted on CVGR systems, focusing on DL [8], appearance-based gait recognition [9], and energy image-based gait recognition [10]. However, to the best of the authors’ knowledge, no comprehensive review has specifically addressed the intersection between gait recognition systems based on computer vision and edge computing. This gap in the literature highlights the value of the present work. Therefore, we conduct a thorough survey of CVGR systems, with a focus on 2D imaging-based gait recognition due to its suitability for low-resource end devices and widespread use in video surveillance systems. The survey examines the benefits, applications, and opportunities associated with deploying CVGR on edge devices. It also explores the obstacles to such deployment, considering factors such as computational efficiency, real-time performance, and data security.

The structure of this survey is illustrated in Figure 2. Firstly, Section 2 presents a summary of the review process and inclusion/exclusion criteria. Then, Section 3 details common sensors and methods for acquiring gait data. Following this, Section 4 explores various techniques for representing and processing gait features in CVGR systems. We then delve into different dimensionality reduction techniques aimed at achieving computational efficiency. Section 6 provides a detailed overview of both traditional and modern models for gait feature classification. Next, Section 7 examines various edge computing architectures, while Section 8 presents techniques to accelerate machine learning inference. The convergence of gait recognition and edge computing is discussed in Section 9. Finally, the paper concludes by discussing and summarising our findings in Section 10 and Section 11.

2. Survey Methodology

The present section elucidates the methodology used to review recent publications on computer vision-based gait recognition (CVGR) systems suitable for edge computing.

2.1. Research Questions

The investigation was oriented by the following research questions (RQs):

• RQ1: What are the primary sensors for gait data acquisition utilised in CVGR systems?
• RQ2: What are the known gait feature extraction, reduction, and representation approaches and their associated challenges in CVGR systems?
• RQ3: Which gait feature classification framework outperforms others, and what techniques can be used to mitigate the challenges associated with these frameworks?
• RQ4: What are the architecture options, challenges, and good practices when it comes to deploying CVGR systems on the edge?
• RQ5: What are the current limitations of CVGR systems based on edge computing, and what are the potential areas for future improvement?

2.2. Search Strategy and Inclusion/Exclusion Criteria

This review begins by establishing a foundation in both CVGR systems and edge computing-based inference architectures. It then explores the intersection of these fields, identifying key research gaps. To achieve this, we conducted a literature review of papers published between January 2000 and November 2024. While we prioritised recent literature, we also included seminal works to provide a comprehensive theoretical context on traditional gait recognition approaches for Section 4 and Section 5.

The literature review encompassed a manual search of relevant publications in key databases, including SCOPUS, Mendeley, Science Direct, Springer Link, IEEE Xplore, and ACM Digital Libraries. We employed a targeted keyword-based approach for each section of the review. For instance, when identifying articles on data acquisition methods for gait recognition (Section 3), we combined keywords such as “depth sensing” AND “gait recognition.” Similarly, for our examination of gait recognition on the edge (Section 9), we used search strings like “gait recognition” AND (“edge computing” OR “edge AI”) or “gait recognition” AND “deployment.” This strategy was applied consistently throughout the review, along with a temporal filter to limit the search to relevant publications. To ensure the quality and relevance of the literature review, we applied the following filtering criteria:

• Included only articles published in English.
• Prioritised peer-reviewed papers based on relevance to the CVGR and edge computing fields, excluding those with weaker or less pertinent contributions.
• Prioritised papers indexed in Scopus that explored the use of CVGR systems in biometric applications, where low latency is crucial.
• Prioritised papers presenting novel methodologies for CVGR systems on the edge.
• Excluded papers lacking sufficient experimental results or methodological details.
• While focused primarily on CVGR, we also included studies on gait recognition using other sensor modalities for comparative analysis.
• Included selectively papers published before 2020, focusing on those that introduced original ideas or made significant advancements in gait recognition.

3. Data Acquisition Methods for Gait Recognition

Gait recognition systems have traditionally relied on two primary data collection methods: 2D imaging and sensor-based approaches, the latter often employing Internet of Things (IoT) infrastructure or wearable devices. However, researchers are increasingly exploring alternative methods, such as depth sensing and 3D scene reconstruction [8]. This section explores both traditional and emerging gait data acquisition methods.

3.1. Sensor-Based Methods

Various sensors have been explored for gait recognition. For instance, floor sensors are commonly employed to register the pressure exerted by walking individuals, converting this data into signals [11,12]. These signals are then processed to either distinguish unique gait characteristics among individuals or identify gait anomalies. However, the high cost of deploying floor sensors often necessitates controlled indoor environments. Similarly, wearable sensors, such as accelerometers, gyroscopes, goniometers, and electromyography, have also been applied to gait analysis [2]. These sensors, connected wirelessly or with wires to embedded devices, smartphones, or other wearables, capture dynamic parameters of the human body for gait analysis [2]. For instance, researchers in [13] recently explored edge computing for gait recognition using gyroscope data. They deployed a 4-layer CNN on an Arduino Nano 33 BLE, a smartphone, and a Brainchip Akida processor, achieving real-time person identification. Despite this progress, this review does not discuss works developed with this sensing modality because they require subject cooperation.

3.2. 2D Imaging-Based Methods

CVGR systems based on 2D imaging utilise 2D image or video data of human gait sequences, typically captured by a digital camera, and analyse this data using 2D image or video processing techniques. This sensing modality has been widely researched, leading to the creation of several well-established datasets for development and performance evaluation, some of the most representative of which are listed in Table 1. The choice of specific image processing techniques after data acquisition is significantly influenced by the design of the target CVGR system. Common processing methods include:

• Noise reduction to minimise the impact of noise or artifacts in the video data.
• Background subtraction and silhouette extraction to isolate the moving human subject (foreground) from the static background.
• Gait cycle detection and normalisation to identify and standardise the repetitive pattern of gait cycles.

The present review primarily focuses on this sensing approach due to the advantages of processing imaging data on resource-constrained devices, including faster computation and the ability to utilise low-cost, standard cameras. Additionally, it is worth noting that video surveillance systems, which are more widely used nowadays, use mainly 2D cameras. Therefore, this enables the easy integration of CVGR systems into current video surveillance systems, embedded systems and mobile devices.

3.3. 3D Scene Reconstruction-Based Methods

While 2D image sensors are the foundation of computer vision systems, other sensors can also play an important role, particularly in 3D scene reconstruction. For instance, technologies such as depth sensing, 3D lasers, and stereo vision aim to capture the complete 3D structure of real-world objects and have recently shown promising results for gait recognition. However, their current high computational demands and associated costs limit their widespread deployment in edge computing-based architectures.

3.3.1. Depth Sensing

CVGR systems have leveraged depth cameras (e.g., Microsoft Kinect, Zed, and Intel RealSense) due to their ability to provide gait information based on a skeleton model [26,27,28,29]. This approach, also known as model-based gait recognition, utilises both RGB images and depth maps to identify joint points in the human body. It then models the anatomical components to derive a unique gait signature [30]. Because they are less sensitive to lighting variations and occlusion issues, depth cameras provide a more consistent input for gait recognition. However, several studies have found this approach to be computationally expensive, particularly due to the need for high-resolution images for accurate joint point identification, which limits its implementation in real-time detection tasks, particularly in uncontrolled scenarios [31]. Despite these limitations, recent progress suggests promising potential for future applications of depth sensing in CVGR systems at the edge.

3.3.2. 3D Lasers

Recent investigations have explored 3D and 4D data acquisition to represent the human body’s surface during walking or other movements. This data can be obtained using various technologies, including 3D lasers, radar signals [5], Light Detection and Ranging (LiDAR) technologies [32], among others. These approaches aim to obtain point clouds, which are sets of data points in 3D space, each with X, Y, and Z coordinates, that provide fine-grained geometric features of a person’s body. Furthermore, 4D point clouds extend 3D point clouds by incorporating time as the fourth dimension, allowing for the capture of both spatial and temporal aspects of the person’s gait [33]. Consequently, this enables the capture of dynamic walking patterns over a period, facilitating a more detailed analysis of temporal variations in movement.

Among the aforementioned sensors, LiDAR has emerged as a popular choice due to its reliability in capturing gait information even in challenging situations like low light or occlusions. Recent LiDAR-based models have demonstrated compelling results compared to 2D imaging. One example is LidarGait, proposed by Shen et al. [32], which converts sparse point clouds from LiDAR data into depth maps, enabling the capture of the 3D shape of a person’s gait. To address the scarcity of LiDAR gait data, the authors created SUSTech1K, a dataset comprising 25,239 gait sequences from 1,050 subjects, covering various factors like visibility, viewing angles, occlusions, clothing, carrying conditions, and scene variations. Challenges for 3D laser-based gait recognition include occlusions, variations in clothing, changes in viewpoint, and the high cost of data acquisition devices, all of which represent important areas for future research [8].

3.3.3. Stereo Vision

Stereo vision enables the reconstruction of 3D scenes through triangulation. Specifically, it uses two or more cameras to capture images of the same scene from slightly different viewpoints, enabling the perception of depth maps with gait information. For example, in the medical field, researchers in [34] have applied stereo vision to automate the analysis of screening tests—namely, the Timed Up and Go (TUG) and Performance Oriented Mobility Assessment (POMA) tests—administered to elderly individuals. Their aim was to fuse 2D gait data with depth information to identify abnormalities that may indicate health risks or mental health decline, achieving compelling results in real daycare facilities. For gait recognition as a biometric tool, authors in [35] proposed a stereo-vision pipeline that extracts 3D contours from a person’s silhouette in a video sequence, calculates a “stereo gait feature” (SGF) from these contours, reduces dimensionality using PCA, and then classifies gait patterns using neural networks.

While powerful for 3D perception, stereo vision is not ideal for CVGR systems. This is mainly because it demands significant computational resources for real-time 3D scene reconstruction, a major drawback for systems with limited processing power, such as those deployed in real-world settings [36]. Furthermore, accurate calibration of the stereo camera setup is also critical. Without it, depth information becomes unreliable, leading to significant errors in depth estimation and impacting gait recognition accuracy. In contrast, surveillance cameras (RGB and grayscale) are increasingly common due to their low cost and easy installation. They are now prevalent in urban areas, businesses, and public spaces, with growing use in rural areas, private homes, and even natural environments [37]. Therefore, the present article focuses on 2D imaging-based data acquisition.

4. Feature Representations for Computer Vision-Based Gait Recognition

Extracting features from 2D imaging data is crucial in CVGR systems. This step creates feature representations that capture the unique qualities of a person’s walk. As shown in Figure 3, feature extraction methods fall into two main categories: deep learning (DL) based and handcrafted. DL-based methods automatically extract features from raw gait data (e.g., images, video frames, or silhouettes) using DL models, such as convolutional neural networks (CNNs), recurrent neural networks (RNNs), or long short-term memory networks (LSTMs). These models can be trained end-to-end, integrating feature extraction and gait classification into a single optimised process. However, it is worth noting that DL models are also used to process and classify handcrafted features. Section 6.2 provides a more detailed exploration of DL-based feature extraction and common DL models, including their strengths and weaknesses for gait recognition.

In contrast to DL, handcrafted features are manually designed based on researchers’ domain expertise and understanding of distinctive gait characteristics. These features capture the unique structure, motion, and dynamics of an individual’s walking pattern. Handcrafted features can be categorised into two groups: model-based and model-free. Model-based approaches focus on extracting skeletal information and joint positions to capture the localised movement patterns of each body part [8]. Conversely, model-free methods (also known as appearance-based methods) directly extract features (primarily silhouettes) from a sequence of gait cycles [1]. Table 2 compares handcrafted-based and DL-based feature representations. Additionally, Figure 4 illustrates a common CVGR system, including two potential modalities for feature extraction: model-based and model-free. The following sections will provide a more detailed exploration of these modalities.

4.1. Model-Based Representations

Model-based gait recognition requires constructing a mathematical model that represents the human body and its movements during walking. This model can range from a simple stick figure to a complex biomechanical model incorporating muscle activations and joint constraints [8,9]. Other model-based approaches utilise specialised sensors (e.g., Kinect [26] and others mentioned in Section 3.3), or pre-trained models (e.g., OpenPose [38], MediaPipe [39]) to create skeleton-like representations. By extracting spatial and temporal information from human body joints, this approach can distinguish one person’s gait from another. Consequently, they have gained significant attention in recent years for their ability to handle current CVGR challenges such as viewpoint variations, occlusions, and changes in clothing. Table 3 illustrates this rise in investigations of model-based approaches by comparing three important methods in this area.

4.1.1. Pose Estimation

One prominent model-based technique is pose estimation, which involves detecting human joint positions in 2D or 3D space. This is achieved by using 2D or 3D pose estimation models that detect key joints (e.g., hips, knees, and ankles) in each frame of a video sequence, forming a structured representation of human motion. To improve robustness, recent works employ pose normalisation techniques (e.g., center- and scale-normalisation) that align body joints in a consistent frame of reference, reducing variability caused by camera angles and distances [43]. The following is a sample formulation of pose estimation.

Let the human body pose at time step t be represented by a set of joints $P_t=\{{\mathbf{p}}_1^t,{\mathbf{p}}_2^t,\cdots ,{\mathbf{p}}_J^t\}$, where ${\mathbf{p}}_j^t\in {\mathbb{R}}^2$ or ${\mathbb{R}}^3$ represents the 2D or 3D coordinates of the j-th joint at time t, and J is the total number of joints. For a sequence of poses across time, the full set of poses is given by $\mathcal{P}=\{P_1,P_2,\cdots ,P_T\}$, where T is the total number of frames in the sequence. Thus, we can define the joint coordinate representation, where each each joint ${\mathbf{p}}_j^t$ at frame t is represented by its coordinates, depending on whether it is 3D or 2D pose estimation, as shown in Equation (1).

$${\mathbf{p}}_j^t=\left[\begin{array}{c}{x}_j^t\\ y_j^t\\ z_j^t\end{array}\right]\mathrm{or}{\mathbf{p}}_j^t=\left[\begin{array}{c}{x}_j^t\\ y_j^t\end{array}\right]$$

(1)

For model-based gait recognition, pose estimation models extract features from the set of joint coordinates. Typically, a feature extraction can be formulated as a function f applied to the sequence of joint positions, as defined in Equation (2), where $\mathbf{F}\in {\mathbb{R}}^d$ is a d-dimensional feature vector representing the gait. An important step in this methodology is normalisation, which aims to remove variations due to camera angles or distance. This is achieved as shown in Equation (3), where ${\mathbf{p}}_{\mathrm{center}}^t$ is the centre of the body (e.g., the hip joint), and ${\mathbf{p}}_{\mathrm{height}}^t$ is the height of the person, used for scaling.

$$\mathbf{F}=f\left(\mathcal{P}\right)=f\left(\{P_1,P_2,\cdots ,P_T\}\right)$$

(2)

$${\mathbf{p}}_j^{t,\mathrm{norm}}={\displaystyle \frac{{\mathbf{p}}_j^t-{\mathbf{p}}_{\mathrm{center}}^t}{\parallel {\mathbf{p}}_{\mathrm{height}}^t\parallel }}$$

(3)

Recent works on pose estimation-based gait recognition have achieved compelling results. For instance, the 3D skeleton-based PoseGait model, proposed by Lia et al. in 2020 [31], uses CNNs to extract multi-dimensional gait features from body joint trajectories. More recently, in 2023, Fu et al. introduced the novel framework GPGait [7] to address pose-based models’ main limitation: their inability to generalise across different scenarios. GPGait utilises two types of gait feature representations: Human-Oriented Transformation (HOT) and Human-Oriented Descriptors (HOD). HOT aligns human pose data from various camera viewpoints into a unified, stable representation, while HOD comprises multi-branch feature extraction modules that generate discriminative, domain-invariant features from this unified pose. Finally, to classify features, the authors employed a Part-Aware Graph Convolutional Network (PAGCN), which efficiently implements graph partition and constructs local-global relationships through mask operations on the adjacency matrix.

4.1.2. Skeleton Maps

Recent progress in skeleton maps for model-based gait recognition has focused on improving the precision and compactness of gait representations derived from human joint coordinates. Figure 4 illustrates an example of skeleton maps, which are used in SkeletonGait [43]. The authors of SkeletonGait generated heatmaps from joint coordinates, aiming to eliminate gait-unrelated information (e.g., walking trajectory, filming angle) through data normalisation techniques. This includes centre- and scale-normalisation to filter out irrelevant information like walking trajectory and camera distance, ensuring a cleaner representation of gait features. In summary, this approach further refines skeleton maps by leveraging only essential gait-related details, improving accuracy on challenging outdoor datasets like OUMVL [44] and GREW [16].

The representation of skeleton maps can be formulated as follows: Let the human skeleton at frame t be represented as a skeleton map $S_t$. This map consists of a set of joint positions $S_t=\{{\mathbf{s}}_1^t,{\mathbf{s}}_2^t,\dots ,{\mathbf{s}}_J^t\}$, where ${\mathbf{s}}_j^t\in {\mathbb{R}}^2\mathrm{or}{\mathbb{R}}^3$ denotes the position of the j-th joint at frame t. The joint feature vector can then be defined as a collection ${\mathbf{s}}_j^t$ augmented with additional features such as velocity, $v_j^t$, and angles, ${\theta }_j^t$, at joint j at time t, as denoted next:

$${\mathbf{h}}_j^t=\left[\begin{array}{c}{x}_j^t\\ y_j^t\\ z_j^t\\ v_j^t\\ {\theta }_j^t\end{array}\right]$$

(4)

Using joint feature vectors, we can construct the feature matrix for the skeleton map at frame t, as shown in Equation (5), where d is the dimension of the joint feature vector. This matrix effectively captures the spatial and temporal characteristics of the human dynamics.

$${\mathbf{H}}^t=\left[\begin{array}{c}{\mathbf{h}}_1^t\\ {\mathbf{h}}_2^t\\ ⋮\\ {\mathbf{h}}_J^t\end{array}\right]\in {\mathbb{R}}^{J\times d}$$

(5)

4.1.3. Graph-Based Models

Graph-based models for model-based gait recognition have seen significant advancements in recent years, primarily leveraging Graph Convolutional Networks (GCNs) to better capture spatial and temporal dependencies in human motion. For instance, in 2023, GaitGraph [40] and its successor, GaitGraph2 [41], treat human joints as nodes and their connections (limbs) as edges, processing this data to capture both local and global spatial relationships. This approach enables the capture of both local movements (e.g., individual limb movements) and global motion patterns (e.g., full-body gait dynamics), crucial for distinguishing gaits across individuals. These models have demonstrated improved robustness across various datasets and under different environmental conditions, particularly in handling occlusion, different viewing angles, and variations in walking surfaces.

The mathematical representation of a graph-based model for gait recognition can be formulated as follows. A human skeleton at frame t can be represented as a graph $G_t=(V,E)$, where $V=\{v_1,v_2,\cdots ,v_J\}$ is the set of J joints (nodes), and $E\subseteq V\times V$ is the set of edges representing the physical connections between joints (limbs). Each node $v_j$ at frame t is associated with a feature vector ${\mathbf{h}}_j^t\in {\mathbb{R}}^d$, representing the position (e.g., 2D or 3D coordinates) and possibly other information such as velocity or joint angles:

$${\mathbf{h}}_j^t=\left[\begin{array}{c}{x}_j^t\\ y_j^t\\ z_j^t\end{array}\right](\mathrm{for}3\mathrm{D}\mathrm{pose}).$$

(6)

Thus, the feature matrix for the entire skeleton at frame t is:

$${\mathbf{H}}^t=\left[\begin{array}{c}{\mathbf{h}}_1^t\\ {\mathbf{h}}_2^t\\ ⋮\\ {\mathbf{h}}_J^t\end{array}\right]\in {\mathbb{R}}^{J\times d}$$

(7)

The connections between joints (limbs) are captured by the adjacency matrix $\mathbf{A}\in {\mathbb{R}}^{J\times J}$, where:

$${\mathbf{A}}_{ij}=\left\{\begin{array}{cc}1\hfill & \mathrm{if}\mathrm{there}\mathrm{is}\mathrm{an}\mathrm{edge}\mathrm{between}\mathrm{joints}{v}_i\mathrm{and}{v}_j,\hfill \\ 0\hfill & \mathrm{otherwise}.\hfill \end{array}\right.$$

(8)

4.2. Model-Free-Based Representations

Model-free representation methods for gait recognition, also known as appearance-based gait recognition, extract features directly from gait data, without relying on explicit models of the human body or specific anatomical configurations. This direct extraction makes them practical for 2D gait data and particularly well-suited for edge computing due to their efficiency in online processing pipelines. However, it is important to highlight the decreasing trend in research on these types of representations due to the rise of model-based methods and deep learning.

4.2.1. Motion Energy Images and Motion History Images

Human motion analysis has long been an area of interest for computer vision researchers. Bobick and Davis [45] proposed two of the initial feature representations: the Motion-Energy Image (MEI) and the Motion-History Image (MHI). An MEI is a binary image that highlights where motion has occurred within a certain time window, with pixels taking a value of 1 to indicate motion, and 0 to indicate no motion. Equation (9) defines this, where $D(x,y,t)$ represents a binary image sequence indicating regions of motion, with x and y as the spatial coordinates for frame t, and $\tau$ as the temporal extent of the motion.

$$E_{\tau }(x,y,t)=\bigcup _{i=0}^{\tau -1}D(x,y,t-i)$$

(9)

Conversely, the MHI aims to produce a scalar-valued image where more recently moving pixels appear brighter. Equation (10) defines MHI, where $H_{tau}$ is a function representing the temporal history of motion at a specific pixel. Inspired by MHI, Lam and Lee proposed a derived gait representation called the Motion Silhouettes Image (MSI) [46]. In their proposal, they replaced $\tau$ with 255, and made MSI simpler and easier to implement, maintaining most of the functionality of the MHI.

$$H_{\tau }(x,y,t)=\left\{\begin{array}{cc}\tau \hfill & \mathrm{if}D(x,y,t)=1\hfill \\ max(0,H_{\tau }(x,y,t-1)-1)\hfill & \mathrm{otherwise}\hfill \end{array}\right.$$

(10)

4.2.2. Gait Energy Images and Gait History Images

Gait Energy Images (GEI) are 2D representations of a person’s gait over time, capturing their movement into a single composite image [47]. They are often created by averaging or accumulating a series of aligned silhouettes, motion images (such as MSIs), or depth images. As shown in Figure 4, a GEI provides a holistic view of an individual’s walking style, capturing key characteristics like stride length, arm swing, and body posture within a single image, while preserving all temporal information. Equation (11) shows the formulation of a GEI, where $B_t(x,y)$ represents a binary gait silhouette image at frame t, and n is the total number of frames within the cycle. While the GEI captures both dynamic (movement-related) and static (shape-related) features from the gait sequence, it lacks the ability to characterise the specific timing of foreground activity at each pixel. To address this, an improved temporal feature representation method called the Gait History Image (GHI) was proposed by Liu and Zheng [48]. The GHI is designed to represent not only static and dynamic characteristics but also the spatial and temporal variations within a gait cycle. Equation (12) defines this, where $S(x,y)$ represents static pixels, calculated by taking the intersection of all motion detection images $D(x,y,t)$ from time 1 to $\tau$.

$$G(x,y)={\displaystyle \frac{1}{n}}\sum _{t=1}^n{B}_t(x,y)$$

(11)

$$E_{GHI}(x,y)=\left\{\begin{array}{cc}\tau \hfill & \mathrm{if}S(x,y)=1\hfill \\ \sum _{t=1}^{t}D(x,y,t)·(t-1)\hfill & \mathrm{otherwise}\hfill \end{array}\right.$$

(12)

Both GHI and GEI are widely used methods in modern gait recognition workflows. However, their improvement remains an active area of research. For example, Zebhi et al. [49] proposed combining GHI with their new descriptors named Time-sliced Averaged Gradient Boundary Magnitude (TAGBM) to abstract spatial and temporal information from videos into templates for human activity recognition. Similarly, Wang et al. [50] recently presented DyGait, a CVGR system that improves traditional GEIs. They introduced a Dynamic Augmentation Module (DAM) that enhances the traditional GEI approach by focusing on the dynamic aspects of human gait. While traditional GEI primarily captures static body parts, like the torso, the DyGait method augments this by emphasising the dynamic movements of limbs, allowing for more robust gait recognition, especially in challenging conditions like changes in clothing or when individuals are carrying items.

4.2.3. Gait Entropy Images

Unlike GEIs, Gait Entropy Images (GEnI) focus on the dynamic elements of gait by encoding the randomness of pixel values within the silhouette over a complete gait cycle [51]. GEnI are constructed by calculating the Shannon entropy (defined in Equation (13)) for each pixel over a complete gait cycle. This means that pixels with high values in the GEnI correspond to body parts with high movement variability, such as the arms and legs.

$$H(x,y)=-\sum _{k=1}^{k_n}{p}_k(x,y){log}_2{p}_k(x,y)$$

(13)

In the previous equation, $p_k(x,y)$ is the probability that the pixel at the coordinates $x,y$ takes on the $k^{th}$ value. For binary images, there are only two possible intensity values, so $k_n=2$. Therefore, the gait entropy image $G(x,y)$ can be calculated in function of a scaled and discretised $H(x,y)$, obtained as follows:

$$G(x,y)={\displaystyle \frac{\left(H(x,y)-H_{min}\right)\times 255}{H_{max}-H_{min}}}$$

(14)

where $H_{min}$ represents the minimum value of $H(x,y)$, and $H_{max}$ represents the maximum value. The resulting frame will highlight the dynamic areas of the human body with higher intensity values, while static parts will have lower intensity values.

4.2.4. Gait Flow Image

Gait Flow Image (GFI) aims to capture the dynamic motion information in a gait sequence by utilising optical flow [55]. Optical flow algorithms estimate the apparent motion of pixels between consecutive frames in a video sequence. For gait movement patterns, this provides a compelling means to capture the subtle dynamics of human movement, such as the swinging of limbs, the shifting of body weight, and the overall rhythm of walking. A GFI is constructed by first extracting silhouettes of the walking person from a sequence of images and then calculating the optical flow between consecutive frames in the silhouette sequence. The primary formula involved in calculating optical flow is the Optical Flow Constraint, defined as follows:

$$I_{x}u+I_{y}v+I_t=0$$

(15)

In this equation, $I_x$ represents the spatial derivative of the image intensity in the x-direction (horizontal), $I_y$ represents the spatial derivative of the image intensity in the y-direction (vertical), $I_t$ represents temporal derivative of the image intensity (change in intensity over time). Furthermore, u and v represent the horizontal and vertical component of the optical flow vector, respectively.

Optical flow qualities were recently explored by Ye et al. [56], who implemented Gait Optical Flow Image (GOFI) - a subtype of GFI where the optical flow information is directly encoded into the image from RGB frames - to add the instantaneous motion direction and intensity to original gait silhouettes. They then implemented a neural network called the Gait Optical Flow Network (GOFN), which allows for a more detailed and robust analysis of gait patterns. Despite its qualities, optical flow requires high-computational power to process resolution videos or for real-time applications, which can limit the scalability and efficiency of gait recognition systems, particularly on resource-constrained devices [8].

4.2.5. Other Model-Free Representation Methods

This section summarises other noteworthy mode-free gait representations. Additionally, Table 4 compares all the feature representations introduced in this section.

• To address the issue of poor image segmentation in gait recognition frameworks, Chen et al. [60] proposed the Frame Difference Energy Image (FDEI) representation. This is a robust representation designed to mitigate the impact of incomplete silhouettes.
• Wang et al. [57] proposed the Chrono-Gait Image (CGI), which encodes the temporal information by assigning different colours to the silhouettes based on their position in the gait cycle, generating a single CGI with richer information.
• To tackle the issue of variations in clothing and carried objects during walking, Zhang et al. [58] proposed the Active Energy Image (AEI) representation. This approach focuses on the dynamic body parts, discarding the static ones, by calculating the difference between consecutive silhouettes in a gait sequence.
• He et al. [53] proposed the Period Energy Image (PEI), a multichannel gait template designed as a generalisation of GEI. It aims to enrich spatial and temporal information in cross-view gait recognition, maintaining more of this information compared to other templates.
• The frame-by-frame Gait Energy Image (ff-GEI) presented in [52] effectively expresses available gait data, relaxes the gait cycle segmentation constraints imposed by existing algorithms, and is better suited to the requirements of DL models.

5. Gait Representation Dimensionality Reduction

Dimensionality reduction (DR) techniques play a vital role in gait recognition by eliminating redundant or irrelevant features from gait representations. This minimisation process offers several benefits: it reduces computational costs, filters out noise, and improves the accuracy of subject recognition [3]. While DL encoders are now commonly used for DR nowadays, the resulting feature representations for gait sequences can still be quite high-dimensional. To address this, DR methods can reduce the number of features, making subsequent classification or recognition tasks more manageable [63]. This is particularly important because processing high-dimensional features can be computationally demanding, especially for real-time applications or resource-constrained devices. Therefore, DR helps alleviate this burden, enabling efficient edge computing.

5.1. Linear Techniques

One of the most commonly used DR techniques in gait recognition is Principal Component Analysis (PCA) [64,65]. PCA aims to identify the optimal projection that maximises the variance of the information, effectively reducing the dimensionality of feature vectors. This technique compresses large data representations into smaller feature sets that still retain the crucial information of the original representation [66]. For instance, in the framework proposed by Gupta et al. [67], a Boundary Energy Image (BEI) served as the feature representation. PCA was then applied for DR before using a Linear Discriminant Analysis (LDA) algorithm for gait classification.

Regarding LDA, its main goal is to find a new set of axes (linear combinations of the original features) that maximise the separation between different classes while minimising the variance within each class. This transformed space, with fewer dimensions, makes it easier to classify new data points. LDA has been applied in numerous CVGR frameworks. For example, Guo et al. [68] implemented LDA to the feature data reduction alongside a Gabor Filter for feature extraction from GEIs and used an Extreme Learning Machine algorithm for recognition and classification. Additionally, Wang et al. [69] introduced a generalised LDA based on the Euclidean norm (ELDA) to address the challenge of indistinguishability resulting from overlapping data in LDA, and employed multi-class SVMs for gait classification. Furthermore, in [70], the authors presented a DR framework based on LDA and PCA in conjunction with a GEI representation and a Cyclic Recognition Code (CRC) classification scheme for video-based gait recognition.

5.2. Non-Linear Techniques

Non-linear techniques for gait representation DR, such as Isomap [71], Locally Linear Embedding (LLE) [72], and Laplacian Eigenmaps [73], operate under the assumption that gait data exists on a low-dimensional manifold embedded in a high-dimensional space. These techniques aim to preserve the local and global structure of gait data while reducing its dimensionality. Moving on, t-distributed Stochastic Neighbor Embedding (t-SNE) is another valuable DR technique, commonly used for visualising high-dimensional data. By focusing on preserving local relationships between data points, it is useful for exploratory data analysis and identifying clusters in gait recognition tasks. For example, Che and Kong [74] investigated how t-SNE can be applied to GEI images of walking subjects after the images underwent Discrete Wavelet Decomposition (DWT) to reduce their dimensionality. Their results demonstrated that this proposed feature extraction method effectively reduces computational complexity and preserves image information, leading to improved precision metrics when using an SVM model.

Although non-linear techniques have shown promise in gait recognition, they are less frequently used in state-of-the-art DR for gait representation compared to linear techniques. This is primarily because most non-linear techniques can be computationally more expensive than linear methods, especially when dealing with large datasets. Moreover, this high computational cost can significantly limit their implementation on embedded devices. However, manifold learning techniques may still offer advantages when data exhibits strong non-linear relationships or when interpretability is crucial [75].

5.3. Other Dimensionality Reduction Methods for Gait Recognition

The Discrete Cosine Transform (DCT) is a widely used technique for DR in image-based gait recognition. It retains crucial gait features, such as body posture and limb movement, by utilising a limited set of low-frequency DCT coefficients. Prior research has demonstrated the effectiveness of DCT in reducing image dimensionality before classification tasks, where a significant number of DCT coefficients can be discarded, substantially decreasing the search space dimensionality [76]. In the context of gait recognition, Fan et al. [77] proposed an approach for DR that combines DCT and LDA. This method effectively leverages the frequency-domain information of the GEI representation to achieve higher recognition rates than other reviewed methods. In another study by Chhatrala et al. [78], the authors have combined the Gabor function and DCT to extract features from gait representations, resulting in the extraction of highly discriminative components that led to high recognition accuracy.

The combination of two or more DR methods for gait recognition is also prevalent in the literature. Similarly to Che et al. [74], who combined t-SNE with DWT, Shivani and Singh [79] proposed a method for reducing redundant data and extracting features by combining DWT and DCT prior to classification. This approach effectively extracts critical features from gait images and video frames. Furthermore, Wen and Wang [80] introduced a gait recognition technique using sparse linear subspace to reduce the dimensionality of ff-GEIs generated from primary gait features. This approach was tested on two well-known gait datasets and demonstrated good performance.

6. Classification of Gait Feature Representations

The final stage in gait recognition involves classifying the previously extracted and reduced gait feature representations. This section reviews the various classifiers commonly employed in this process.

6.1. Traditional Models

6.1.1. Distance-Based Classification

Euclidean distance, Manhattan distance, or cosine similarity (defined in Equations (16), (17), and (18), respectively) are simple and widely used methods for classifying gait features in CVGR systems [81,82,83]. They help to compare and match gait representations by calculating the distance between them. Another popular machine learning-based approach that leverages metrics is the k-Nearest Neighbours (k-NN) algorithm. This classifies a new gait sample based on the majority class among its `k’nearest neighbours in the feature space. Neighbouring samples are defined using metrics such as Euclidean distance, Manhattan distance, or cosine similarity. Several studies have successfully employed k-NN in gait recognition. For example, Pratama et al. [84] combined a k-NN classifier with GEI, Gabor wavelets, and PCA. Additionally, Premalatha and Chandramani [85] utilised k-NN classification along with GEI partitioning and region selection.

$$d\left(p,q\right)=\sqrt{\sum _{i=1}^n{\left(q_i-p_i\right)}^2}$$

(16)

$$d(p,q)=\sum _{i=1}^n|q_i-p_i|$$

(17)

$$\cos (p,q)={\displaystyle \frac{p·q}{\parallel p\parallel \parallel q\parallel }}$$

(18)

6.1.2. Machine Learning

Traditional machine learning (ML) techniques for CVGR systems encompass a diverse set of models, among which k-NN and Support Vector Machines (SVMs) have been two particularly popular choices for classification. About the latter, SVMs, when applied to gait recognition, aim to map gait representations to a high-dimensional feature space where they can be effectively categorised [86]. Several notable contributions using SVMs for CVGR can be highlighted. For instance, Wattanapanich et al. [64] proposed a view-invariant gait recognition framework that utilised a One-Against-All SVM classifier. This framework sought to achieve robustness and address the challenges posed by unknown camera view angles and appearance changes. Their results demonstrated the framework’s robustness under varying camera view angles. In another study, Wang et al. [87] presented a gait recognition algorithm employing a multi-class SVM. This algorithm leveraged Gabor wavelets for gait feature extraction and Two-directional Two-dimensional PCA ((2D) ² PCA) for dimensionality reduction.

Moreover, Hidden Markov Models (HMMs) are prominent in gait analysis due to their ability to model the sequential and temporal dynamics of gait data, capturing variations in the gait cycle over time [88]. These traditional methods, including LDA [67,89], Bayesian Classifiers [90,91], often perform well with model-free features and have laid the groundwork for the DL techniques that now dominate the field. In contrast, model-based features often involve more complex data, such as joint angles, bone lengths, or motion parameters. This can lead to higher dimensionality, potentially making it harder for traditional models discriminate effectively [92].

6.2. Deep Learning

Deep Learning (DL), a subfield of ML, utilises artificial neural networks (ANNs) to learn complex patterns from data. ANNs with multiple layers, also known as deep neural networks (DNNs), have proven effective in tackling CVGR limitations such as intra-class variations (e.g., subjects wearing different clothes) [93] and cross-view [94]. CVGR pipelines based on DL can be categorised into two groups: end-to-end and hybrid. In end-to-end systems, the encoder component of DL models extracts subtle gait features, while the DNN deciphers previously elusive complex patterns. Figure 5 illustrates this, showing that a DL model can be fed with raw video data, frames containing silhouettes or skeletons modelling the human body of a walking subject. While the gait sequence of a single person can be obtained using object detectors, segmentation algorithms, or model-based approaches (marked with brains in Figure 5), the end-to-end approach focuses on training a single model to handle the entire gait recognition task.

In contrast to end-to-end systems, hybrid pipelines might also include handcrafted feature extraction and dimensionality reduction modules (detailed in Section 4 and Section 5, respectively). Figure 4 shows how these tasks fit into the traditional gait recognition pipeline, with brain symbols marking tasks suitable to be performed by individual DL models. Furthermore, hybrid pipelines can incorporate object detection and tracking algorithms to first recognise multiple subjects. The following sections explore representative DL models used frequently in CVGR systems.

6.2.1. Convolutional Neural Networks

Convolutional Neural Networks (CNNs) are a specialised type of DNN designed primarily for processing and analysing visual imagery. Inspired by the visual cortex in humans, CNNs employ 2D convolutional operations to extract features, progressing from coarse-grained to fine-grained details. These extracted features are then passed to a neural network module for final inference. Notably, 3D convolutional layers can also be used to extract gait features from sequential imagery, such as GEI sequences [96] or 3D volumes representing body parts [97].

A key advantage of CNNs is their ability to recognise patterns irrespective of where they appear in an image [98]. This characteristic made them particularly valuable for both model-free [54,62] and model-based [99] approaches. As illustrated in Figure 1, CNNs are amongst the most frequently used models for CVGR systems. The following section presents some compelling works applying CNNs to gait recognition:

• In 2022, Ambika et al. [100] proposed an approach based on a CNN-MLP (Multilayer Perceptron) for gait classification, aiming to be robust to subjects’ velocity variations and appearance covariates such as carrying a backpack.
• Researchers in [97] (2021) and [101] (2023) proposed CNN-based methods to split vertically the gait sequence into multiple parts and extract sequential, hierarchical gait features using 3D convolutional layers. Both methods achieved state-of-the-art results, demonstrating the effectiveness of CNNs for gait feature extraction.
• Further CNN-based gait recognition approaches were proposed in [54,99,102,103].

6.2.2. Autoencoders

An autoencoder is a type of ANN that consists of an encoder and a decoder, with the primary goal of reconstructing its input as accurately as possible using the decoder module [104]. Both encoder and decoder modules can have convolutional or deconvolutional layers to better process visual imagery, and the bottleneck layer (middle layer) typically serves as a dimensionality-reduced representation. Autoencoders have been utilised in model-free pipelines to address appearance change issues like varying view angles [105] and for completing missing parts in GEI representations [106]. On the other hand, recent compelling investigations for model-based methods include:

• In 2023, Guo et al. [107] introduced a physics-augmented autoencoder (PAA) that integrates a physics-based decoder. By incorporating physics, the learned 3D skeleton representations become more compact, and physically plausible.
• In the same year, Li et al. [108] proposed a novel gait recognition method that leverages the Koopman operator theory and invertible autoencoders to improve interpretability and reduce the computational cost of gait recognition by learning a low-dimensional, physically meaningful representation of gait dynamics that captures the complex kinematic features of gait cycles.

6.2.3. Generative Adversarial Networks

Similarly to autoencoders, Generative Adversarial Networks (GANs) are a powerful DL approach capable of producing new data that closely resembles the training data. In the context of gait recognition, various GAN approaches have been adopted to address view variations or appearance changes. For example:

• Yu et al. [109] proposed a GAN to tackle gait recognition limitations related to appearance changes by generating realistic-looking gait images. The results demonstrated excellent performance on large datasets, where a canonical side-view gait image was generated without needing prior knowledge of the subject’s view angle, or clothing.
• To further research the challenge of view variations in gait recognition, Zhang et al. [110] proposed the View Transformation GAN (VT-GAN). This model translates gaits between any two views using an identity preserver module to prevent the loss of personal identity information during transformations.

6.2.4. Capsule Neural Networks

Capsule networks, or CapsNets, are a type of DNN designed to address some limitations of traditional CNNs, particularly in understanding hierarchical relationships and spatial information within images [111]. Capsules, the fundamental building blocks of CapsNets, are groups of neurons that encapsulate information about specific features or entities in the input data. Specifically, each capsule in a CapsNet comprises a set of neurons whose outputs represent different attributes of a single feature. CapsNets have been successfully used in gait recognition to mitigate performance drops when dealing with various walking conditions or multiple viewing angles. For example, Sepas-Moghaddam et al. [112] addressed the gait recognition covariate problem by proposing a DNN for learning to transfer multiscale partial gait representations. This network employs CapsNets to learn deeper part-whole relationships and assign more weight to highly relevant features, while eliminating spurious dimensions. The proposed model consists of a partial feature extraction stage for gait maps, a BGRU layer, a capsule attention module, and a final layer with a softmax activation function for classification. The model demonstrated impressive rank-1 recognition results, achieving mean accuracy values of 95.7% for normal walking, 90.7% for carrying a bag, and 72.4% for varying clothing conditions. Other works, such as [113,114,115] have also incorporated capsule modules into their gait recognition approaches.

6.2.5. Recurrent Neural Networks

Recurrent Neural Networks (RNNs), an extension of DNNs well-suited for processing sequential data, offer another approach to gait recognition classification [116]. These models, along with Long Short-Term Memory (LSTM) models – a type of RNN adept at learning order dependency in sequence prediction – have been widely used for gait recognition by leveraging their inherent ability to capture temporal dependencies [99]. Although RNNs and LSTMs seem like a natural fit for gait recognition due to their ability to handle sequences, they have largely been overshadowed by CNNs, primarily because of their computational cost and limitations in capturing spatial details [8,117]. This is particularly relevant for resource-constrained environments or applications demanding real-time performance, where RNNs/LSTMs might not be the most practical choice [118,119]. Nevertheless, they can still be valuable when capturing temporal dynamics is paramount, especially when combined with CNNs. Some remarkable works include:

• Wang and Yan [52], who combined LSTM with convolutional layers (namely ConvLSTM) and trained the resulting model using ff-GEIs. Their method outperformed several state-of-the-art methods in multi-view angle gait recognition.
• To address the challenge of occlusions in gait recognition, Sepas-Moghaddam et al. [120] proposed a method for learning invariant convolutional gait energy maps with an attention-based recurrent model. Their network structure utilised partial representations by decomposing learned gait representations into convolutional energy maps. A recurrent learning module composed of bidirectional gated recurrent units (BGRU) was then used to exploit relationships between these partial spatiotemporal representations, coupled with an attention mechanism to focus on crucial information.

6.2.6. Graph Neural Networks

Graph Neural Networks (GNNs) are a class of DL models designed to process data that can be represented as graphs. As explained in Section 4.1.3, gait features (e.g., skeleton maps) can also be represented as graphs, making it possible to combine them with GNNs for efficient gait recognition. Unlike traditional ANNs, which typically operate on structured data (like grids or sequences), GNNs can naturally handle non-Euclidean data by aggregating and passing information between neighbouring nodes. This allows GNNs to capture complex relational structures and dependencies within the gait feature data [40]. Crucially, GNNs have been shown to be capable of running on edge devices with appropriate optimisation techniques listed in Section 8 [121].

Graph Convolutional Networks, a subtype of GNNs, are designed to process graph data by applying convolutions. In gait recognition, GCNs can capture the complex relationships between joints in a gait sequence. Both GNNs and GCNs have recently shown great promise by modelling the structural and temporal dependencies of human body joints and keypoints for gait recognition. For example, Guo et al. [122] proposed a notable work in this field that uses a Spatial-Temporal Graph Convolutional Network (ST-GCN) to capture both spatial joint relationships and temporal walking dynamics. These and other aforementioned GNN-based approaches, such as [7,41], have successfully leveraged the inherent structural and dynamic properties of human gait, leading to state-of-the-art results on benchmark datasets like CASIA-B [23] and OU-MVLP [44].

Recently, GNNs have also obtained meaningful results with 3D and 4D point clouds. For example, Ma et al. [123], proposed the Dynamic Aggregation Network (DANet), a network based on the Dynamic Graph CNN (DGCNN) [124]. DANet operates on dynamic graph structures and uses edge convolution to learn both the local and global structure of the point cloud, which is crucial for gait recognition from dynamic 3D data. Specifically, DANet dynamically learns local and global motion patterns from gait sequences, enhancing the model’s ability to focus on key regions within the gait data and achieving compelling results on datasets such as Gait3D [5].

6.2.7. Transformers and Attention Mechanisms

Transformer networks excel at capturing long-range dependencies in sequential data and are effective at processing gait in its different forms, where temporal variations are key [125]. Furthermore, attention mechanisms enable transformers to focus on specific parts of complex inputs, thereby increasing their performance. Some compelling works in this field include the following:

• To enhance discrimination between different classes of gait features, Wang and Yan [126] (2021) presented a self-attention-based gait classification model that combines non-local and regionalised features. This combination helps identify relevant non-local features, which are then refined by a two-channel network.
• Jia et al. [127] (2021) proposed a CNN Joint Attention Mechanism (CJAM) for identifying the most crucial pixels in a gait sequence. Their workflow uses a CNN to extract feature vectors from the initial gait frames and feeds them into an attention model comprising encoder and decoder layers, followed by linear operations for information transformation and a softmax function for classification. Twelve experiments demonstrated that this attention model outperforms others in terms of reducing errors, with the CJAM model achieving accuracy improvements of 8.44%, 2.94%, and 1.45% over 3D-CNN, CNN-LSTM, and a simple CNN, respectively.
• Mogan et al. [128] (2022) converted GEI representations into 2D flattened patches and passed them into a Vision Transformer model consisting of an embedding layer (with patch embedding applied to the sequence of patches), a transformer encoder for achieving a final representation, and a multi-layer perceptron that performs the classification based on the first token of the sequence. Experiments on small and large datasets demonstrated the scalability of the Vision Transformer model, showcasing its robustness against noisy and incomplete silhouettes and its remarkable subject identification capability regardless of the different covariates. In 2023, the same team proposed assembling a similar Transformer model with two other architectures: a DenseNet-201 and a VGG-16 [129]. The experimental results showed substantial improvement using the CASIA-B [23] and the OU-ISIR [18] datasets.
• Li et al. [125] (2023) proposed TransGait, a novel gait recognition framework that utilises a transformer to effectively fuse silhouette and pose information, leveraging the strengths of both feature representations.
• Researchers have also recently leveraged self-attention [128] and spatial-temporal attention [130] to improve the discriminative capacities of CVGR systems.

In summary, the CVGR field is actively exploring novel models to enhance performance in challenging real-world scenarios. However, model complexity can hinder deployment on low-resource devices, often necessitating cloud-based infrastructure. For instance, although deploying transformers on embedded devices is possible [131], they can be quite resource-intensive, demanding substantial memory for parameters and intermediate computations. Similarly, the complex computations of other aforementioned DL models often require significant processing power. Table 5 further illustrates this by comparing the suitability of different DL models for edge computing.

7. Edge-Oriented Inference Architectures

Edge computing is rapidly evolving and gaining traction across industries. Advancements in hardware, software, and AI algorithms are making intelligent devices increasingly powerful, allowing for the deployment of more sophisticated AI applications directly at the edge. This trend, also known as Edge AI, is expected to continue, leading to wider adoption of intelligent systems in the years to come [139]. Within this context, three main strategies for edge computing deployment can be observed in the current literature: Edge server-based, End device-based, and a hybrid approach combining Edge server + End devices or Edge server + Cloud server (refer to Figure 6 for a visual representation). As shown in Figure 7, these approaches are not independent of each other and can be combined simultaneously to enable more feasible real-time computation in CVGR systems. In this figure, an edge computing development card (a small, specialised computer designed to bring AI and other processing capabilities directly to the edge) and a USB AI accelerator (a small device that plugs into the USB port of a computer or other system to provide dedicated hardware for accelerating inference) would perform different tasks necessary for the CVGR pipeline. The following sections will describe these strategies in detail.

7.1. Edge Server-Based

Unlike cloud-based servers, edge servers are located at the “edge” of a network, close to where data is collected. They vary in form factor, ranging from powerful rack-mounted servers to high-capability desktop computers. In this model, end devices collect data and transmit it directly to an edge server, which processes the input and send the results back. The inference pipeline on the edge server may include one or more steps for pre-processing, recognising, and post-processing visual data, and the server must be able to handle visual data from multiple end devices simultaneously. However, a primary drawback of this model is its reliance on network bandwidth; processing cannot occur without a local area network. Galanopoulos et al. [140] provide an example of this approach, where mobile devices were programmed to collect video data and send it to an edge server for real-time processing and analytics.

7.2. End Device-Based

End device-based deployment refers to a system architecture where the entire processing pipeline, from data capture to inference, runs directly on the end device. This approach significantly enhances user privacy and reduces latency, which are crucial factors for CVGR systems. However, end devices often have limited processing power and memory. Although CVGR systems can execute on laptops or desktops with powerful GPUs, implementing them on less expensive hardware is possible. Edge computing development cards and USB AI acceleration devices with GPU, TPU, and/or VPU chips (detailed in Table 6 and Table 7, respectively) offer a low-cost solution for deploying CVGR as an embedded system. Additionally, compression tools (e.g., TensorFlow Lite, TensorRT, OpenVINO, and ONNX) and model optimisation techniques (e.g., knowledge distillation, model design, and quantisation) can be applied for enhanced deployment. Section 8 further discusses optimisation strategies based on these techniques.

DL-based systems deployed directly on end devices have found applications in diverse fields, ranging from medical devices that use infrared lighting to locate veins [141] and indoor systems for potential airborne disease infection monitoring [142], to unmanned surface vehicles for aquatic weed removal [143]. In the realm of CVGR systems, a significant contribution was made by Tiñini et al. [133], who proposed one of the first fully embedded CVGR systems. The authors used a Jetson Nano Development Card equipped with an OAK-D camera. Their approach leveraged a pre-trained person detection model, MobileNetv2, deployed on the OAK-D device, with subsequent representation extraction using a U-Net and inference performed on the Jetson Nano with a CNN. Their proposed system achieved an impressive inference time of 35.8 milliseconds per gait representation recognition.

7.3. Edge Server + End Devices

When deploying the entire CVGR pipeline on an end device is impractical due to limited memory and energy resources, partitioning a computer vision pipeline or model is possible. This involves keeping some parts on an edge server and deploying others on end devices. Factors like network latency, memory footprint, and energy consumption can help determine the optimal number of model splits and the execution location of each part. However, the final deployment strategy should ideally be based on experimentation, empirical criteria, and actual performance evaluation. Neurosurgeon, a scheduling strategy presented in [144], offers a compelling proposal to automate the decisions of where to split a model and how to deploy its portions. Another example of this hybrid approach is found in [145], where armed robbery detection is achieved by combining YOLO-based weapon detectors on end devices with a CNN deployed on an edge server. The edge server then sends notifications to homeowners only if anomalies are confirmed by both the end devices and itself, thus reducing the false positive rate.

7.4. Edge Server + Cloud Server

Also known as edge-cloud, this approach aims to balance computing tasks between cloud servers and edge servers when the latter’s capabilities are insufficient. This is particularly valuable now that every data instance is crucial and can contribute to the generalisation of DL models. For example, an edge server can collect and process individual samples sent from end devices, with this data being synchronised with a cloud server once the edge server reaches its memory capacity. This hybrid approach can address the limitations of traditional cloud-based approaches for video analysis, which often suffer from prohibitive bandwidth consumption and high response latency. For example, Han et al. [146] proposed ECCVideo, an edge-cloud collaborative video analysis system that focuses on low-latency applications by efficiently utilising resources at both the edge and in the cloud. This approach has proven successful in scenarios where the capabilities of edge servers alone are not sufficient.

8. Model Optimisation for Edge Computing

The core principle of edge computing is to enable end devices to process the information they gather and respond accordingly, with minimal delay. However, some state-of-the-art applications utilise complex and computationally expensive DL models. Therefore, model optimisation is essential for deploying these architectures fully on edge devices, rather than offloading computation to an external server. Several metrics are essential for evaluating the performance, efficiency, and real-time capabilities of gait recognition models on edge devices. For instance:

• Latency: This measures the time taken to process and recognise gait patterns, crucial for real-time applications.
• Energy consumption: This quantifies power usage, highlighting sustainability and device longevity, particularly for battery-powered systems.
• Model accuracy: This, including metrics like precision, recall, and F1-score (detailed in [142]), evaluates the effectiveness of gait recognition under constrained conditions.
• Model size: This refers to the storage footprint of the model.
• Throughput: This is the number of frames per second processed, also known as FPS.

Different techniques have been proposed to optimise deployment on edge devices. This section will cover the following optimisation methods: model design, pruning, quantisation, and knowledge distillation. For a more in-depth exploration of inference acceleration methods for edge computing, see [147] and [148].

8.1. Model Design or Selection

In edge computing, researchers often prioritise designing DNN models with fewer parameters. The goal is to minimise memory usage and execution delays while maintaining high accuracy. This is particularly important when designing DNN models for devices with limited computational capacity, such as edge devices [147]. Iandola et al. [149] proposed SqueezeNet to offer advantages like reduced communication across devices during training, less bandwidth consumption during model export, and the feasibility of deployment on embedded hardware, all while preserving the accuracy of AlexNet-level networks. The authors compressed SqueezeNet to less than 0.5 Megabytes (MB), resulting in a network with 50 times fewer parameters than AlexNet. Similarly, Fang et al. [150] proposed Tinier-YOLO to minimise model size and improve both detection accuracy and real-time performance. Tinier-YOLO resulted in a model size of 8.9 MB, four times smaller than Tiny-YOLOv3. It achieved a mean Average Precision of 65.7% and reached 25 FPS real-time performance on a Jetson TX1.

8.2. Pruning

The pruning technique involves setting redundant or less important neuron parameters to zero without significantly impacting the accuracy of the results [151]. This strategy is widely used in DL model optimisation to reduce memory size and computational complexity. Recently, Yu et al. [152] proposed EasiEdge, a global pruning method to compress and accelerate DNNs for efficient edge computing. By adopting an Alternating Direction Method of Multipliers (ADMM) to decouple the pruning problem into a performance-improving problem and a global pruning sub-problem, their method achieved remarkable results. When pruning 80% of filters in VGG-16, the accuracy dropped by only 0.22%, and the GPU latency on a Jetson TX2 decreased to 0.19ms. Furthermore, Woo et al. [153] presented “zero-keep filter pruning” for creating energy-efficient DNNs. This strategy replaces small values with zero and prunes the filter with the least number of zeros, thus maximising the number of zero elements in filters. Increasing the number of zero elements is expected to reduce the significant power/energy consumption associated with multiplication calculations through the use of a zero-skip multiplier.

8.3. Quantisation

Fundamentally, quantisation is the process of approximating continuous data, whether a single value or a series, using a set of integers. In the context of edge computing, parameter quantisation converts existing floating-point DNN parameters to lower-bit values. This eliminates expensive floating-point operations, thereby reducing the model’s computational weight and cost [147]. In this context, Zebin et al. [154] presented in 2019 a CNN model for classifying five activities of daily living. Their model used raw accelerometer and gyroscope data from a wearable sensor as input. Through model optimisation, they quantised weights per channel and activations per layer to 8-bit accuracy after training. This resulted in a CNN architecture with classification accuracy within 2% of floating-point networks. Notably, weight quantisation was responsible for nearly all of the size and runtime reductions in the improved model. Later, in 2021, Wardana et al. [137] used four distinct post-quantisation approaches provided by the TensorFlow Lite framework to develop an efficient model for edge devices: dynamic range quantisation, float16 quantisation, integer quantisation with float, and complete integer quantisation. Among these, full-integer quantisation yielded the lowest execution time, with latencies of 2.19 seconds and 4.73 seconds for Raspberry Pi 4B and Raspberry Pi 3B+, respectively.

8.4. Knowledge Distillation

Knowledge distillation is a technique where a smaller, simpler model (the “student”) is trained to mimic the behaviour of a larger, more complex model (the “teacher”) [155]. The objective is for the student model to approximate the function learned by the teacher model, enabling powerful models to be deployed on resource-constrained devices where running the full-sized teacher model would be impractical. Moreover, smaller models are faster and require less memory, making them suitable for real-time applications. Common distillation strategies include Logits Distillation (the student learns to mimic the output probabilities of the teacher), Feature Distillation (the student learns to mimic intermediate layer activations of the teacher), and Relationship Distillation (the student learns to mimic the relationships between different neurons or layers inside the teacher). Recently, Li et al. [4] proposed applying knowledge distillation to CVGR systems, introducting Multi-teacher Joint Knowledge Distillation (MJKD) to address challenges in cross-view gait recognition. Specifically, MJKD uses multiple teacher models to train a lightweight student model, improving its ability to extract gait features and recognise individuals. Experiments on the CASIA-B dataset [23] demonstrated MJKD’s effectiveness, achieving 98.24% accuracy while reducing model complexity and computational cost.

9. Gait Recognition on the Edge

Gait recognition systems based on edge computing are a relatively new field, with few academic works addressing this combination (shown in Table 8). In contrast, multiple companies now offer gait recognition commercially, centred on a cloud-server architecture [156,157]. In the realm of CVGR systems, Tinini et al. [133] proposed a pioneering advance combining edge computing and model-free gait recognition, laying the groundwork for developing more robust and scalable real-time CVGR systems. Nevertheless, to consider a real-life application of this technology and achieve beneficial applications for society, much work remains to be done regarding the correct classification rate, different viewing angles, and robustness against intra-class and environment variations.

In 2022, Ruiz-Barroso et al. [158] conducted a comprehensive evaluation of hardware and software optimisations for deploying gait recognition models on embedded systems. They analysed the energy consumption and performance of three distinct models on two popular embedded platforms: the NVIDIA Jetson Nano 4 GB and the NVIDIA Jetson Xavier AGX. The study found that targeted hardware and software optimisations (specifically, pruning and quantisation techniques) significantly enhanced execution time, achieving a 4.2x speedup compared to the baseline models. Moreover, these optimisations resulted in a substantial improvement in energy consumption, with the deployed models consuming up to 5.4 times less energy.

Recently, in 2023, Ma and Liu [33] introduced a new method for gait recognition using millimeter-wave radar. Specifically, they proposed a spatial-temporal network that processes 4D radar point cloud videos to capture the motion dynamics of walking people. The network employs PointNet to extract spatial features from each frame, and then models the spatial-temporal information using a Transformer layer. Experimental results demonstrate that the proposed network outperforms similar methods based on 4D radar reconstruction. Importantly, its ability to function under low-resource setups opens the door for real-time surveillance systems using 4D gait representations.

Deploying a CVGR system in real-world edge environments presents several significant challenges, which can be broadly categorised into three areas: variations in gait, environmental challenges, and security challenges. In the following sections, we will describe each of these challenge groups and discuss potential solutions proposed in the literature. Our goal is to simplify the decision-making process for those seeking to bring this biometric technology into real-world applications.

9.1. Variations in Gait

Changes in clothing, footwear, carrying objects, walking speed and emotional state can alter a person’s gait pattern, making consistent recognition challenging. For example, a heavy coat or backpack can obscure the body’s silhouette and impact limb movement [1]. To address these challenges, researchers are exploring various strategies, such as:

• Developing robust feature extraction techniques and improving feature representations, such as utilising partitioned gait energy images [85] or adopting DL architectures [100], to reduce sensitivity to such variations.
• Employing view transformation models to normalise gait patterns across different perspectives [102].
• Creating synthetic gait data with controlled covariate gait variations [109,161].
• Implementing federated learning [162] - a distributed approach to data collection, model training and weight sharing - for multi-view gait recognition.

Similarly, variations in viewpoint pose a common challenge for CVGR systems deployed on edge devices. Since these devices can be installed at different heights or with varying camera angles, even minor changes in setup can lead to perspective distortions that hinder consistent comparison of gait features. Notable works addressing this issue include studies on gait recognition under view-invariant scenarios [114], and the use of GANs for covariate-aware gait synthesis [161].

9.2. Environmental Challenges

Environmental variations between laboratory and real-world settings can encompass a wide range of challenges that significantly impact the performance of CVGR systems. For instance, basic changes, such as walking surfaces (e.g., uneven terrain, stairs), can make it difficult to extract reliable gait features. Furthermore, different lighting and shadows are common issues for CVGR systems under real-world conditions. In such cases, applying a Gamma Filter, Contrast Stretching, or other image processing techniques can enhance the input image. Another frequent problem is the presence of occlussions (including people walking behind objects). To develop robust CVGR systems, gait recognition under occlusion scenarios has been developed for several years. For example, researchers in [163] recently proposed the combination of a VGG-16 model to detect occlusions and an LSTM model to reconstruct occluded frames in the sequence. In 2023, Xu et al. [6] introduced a technique for aligning silhouettes, which involves flexibly estimating the spatial extent of elements causing occlusion.

Moreover, real-world deployments often involve cameras with limited resolution, frame rate, or placement, leading to noisy and incomplete gait data. Addressing these real-world complexities requires developing robust algorithms and acquiring diverse training data that reflects such variability, as proposed in [109,161,164]. These advancements aim to improve the adaptability and robustness of gait recognition systems in real-world setups and under varying conditions.

9.3. Security Challenges

As emerging biometric technologies continue to gain widespread adoption, so too do the methods employed to breach their security. Automated biometrics, often utilised in access control and surveillance applications, are not immune to these challenges. Consequently, a more profound security analysis is imperative for the secure deployment of gait recognition systems at the edge. The following subsections explore three of the most frequent approaches to breaking CVGR systems and their potential countermeasures.

9.3.1. Person Physical Impersonation

From the early 2010s, despite initial promising results, silhouette-based gait recognition systems raised concerns within the scientific community regarding their effectiveness as a biometric method. This prompted several investigations to test their vulnerabilities by having subjects mimic the walk style or clothing of others. For example, in 2012, Hadid et al. [165] published the first analysis on the spoofing susceptibility of such systems. They focused on experimenting with clothing and shape impersonation for two gait recognition systems, UOULU and USOU. These systems were originally designed to extract and process 2D and 3D visual data of walkers from a fixed viewpoint in a tunnel. The researchers then had 22 subjects walk through the same tunnel with similar clothes and body shapes, subsequently calculating the similarity between the recognised gaits. They concluded that while silhouette-based recognition systems were indeed susceptible to spoofing, they were not as easily compromised as face or fingerprint recognition systems.

In 2015, Hadid et al. [166] proposed countermeasures to avoid physical spoofing. Their main countermeasure divides each silhouette within a frame sequence into multiple horizontal portions and computes Local Binary Patterns from Three Orthogonal Planes (LBP-TOP) for each portion. These portions are then combined into a single histogram vector, which is compared to determine if the portions belong to the same person.

9.3.2. Spoofing via Synthetic Data Generation

Recent advancements in DL-based synthetic data generation techniques, particularly autoencoders and GANs, have enabled the automated creation of fake human data such as face images, voice audio, and motion videos. In this context, Jia et al. [167] explored a spoofing method to compromise gait recognition systems. They proposed a GAN-based approach to render target videos on a given scene image from walking sequences. The focus was on generating realistic synthetic videos with good visual effects while also transmitting sufficient information to deceive gait recognition systems. Their experiments with GaitSet [93] and a CNN-Gait-based approach validated the method’s effectiveness. Similarly, Hirose et al. [168] proposed a method to transform gait genuine clones (GGCs) from actual walking people into gait silhouette clones (GSCs) using a multiple autoencoder approach. To address potential security concerns, they also presented a supervised learning method to discriminate between genuine and synthetically generated gait silhouettes.

9.3.3. Silhouette Poisoning for Misclasification

Similar to other DL-based biometric systems, gait recognition is also vulnerable to adversarial attacks. These attacks involve adding noise, in the form of patches or pixels, to a gait video, causing the DL models to misclassify the sample. For example, in a CVGR-based entrance security system compromised by such noise, the model might mistakenly recognise an unknown person as someone authorised to enter. To address this, Maqsood et al. [169] recently presented an approach to locate strategic sections in GEIs for adding imperceptible noise using Grey Wolf Optimisation [170]. Their findings revealed that high-frequency textures are the most effective locations for such noise.

To enhance privacy in gait recognition, researchers in [171] proposed a privacy-preserving approach to anonymise human gait in videos by deforming silhouettes. They demonstrated that publicly available videos of people walking could be used to identify them without their knowledge and proposed deforming extracted gait silhouettes and replacing the original visual information in the videos with the modified ones. This resulted in a significant reduction in recognition accuracy from 100% to 1.57%, highlighting the approach’s potential to enhance privacy for individuals, albeit at the cost of model accuracy.

10. Discussion and Future Work

10.1. Trends and Challenges in Computer Vision-Based Gait Recognition Systems

Advances in CVGR systems are showing promising results, increasing the trustworthiness of this biometric technology. Moreover, the widespread use of closed-circuit television (CCTV) and low-cost cameras presents significant potential for integrating CVGR systems to enhance surveillance in public and private settings. However, the pursuit of higher precision has led to increasingly complex and resource-intensive models, often requiring deployment in high-performance computing environments. This limits the technology’s accessibility in scenarios with unstable internet connections or limited server capacity. Edge computing architectures offer a promising solution by distributing inference capabilities, thus addressing this limitations. As discussed in Section 8, several studies have demonstrated the effectiveness of edge computing architectures, highlighting opportunities to apply these to CVGR systems.

In terms of models, distance-based gait sequence classifiers remain the most straightforward and resource-efficient approach. However, machine learning becomes crucial when generalisation is critical for a CVGR project. Figure 1(a) and Figure 1(b) show a trend towards employing DL models in CVGR systems, with CNNs, RNN, LSTM, GAN, CapsNets, and Transformers being the most frequent. Despite remarkable advancements in DL-based CVGR systems, their real-world application in uncontrolled environments remains challenging, although recent works and datasets, such as [14] and [16], demonstrate promising results. For example, recent results obtained by DL models with challenging gait sequence variations, such as GPGait [7] and SkeletonGait [43], highlight opportunities for model-based approaches. On top of that, novel gait recognition technologies such as depth sensing, stereo vision, 3d laser scene reconstruction, pose estimation, optical flow, and graph-based models hold promising research threads for future investigations.

Newer technologies have yet to overcome challenges such as variations in illumination. Changes in lighting due to time of day, weather, and shadows can distort silhouette- or appearance-based features, affecting gait extraction. Another challenge is occlusions, where objects, other people, or the environment obscure body parts, leading to incomplete gait data. Viewpoint variation is also critical. Unlike controlled indoor setups with consistent camera angles, outdoor environments often involve dynamic viewpoints, making it difficult to match gait features across different perspectives when implementing CVGR systems [7].

10.2. Edge Computing for CVGR Systems

Given the computational complexity of gait data acquisition, representation, dimensionality reduction, and recognition, deploying a DL-based workflow on a single device can be demanding. However, a distributed edge computing approach offers a solution by enabling task distribution across multiple devices. As detailed in Section 7, several architectures for distributing inference are currently used in academia and industry. These architectures are applicable to CVGR systems and can be further researched for optimisation when implementing CVGR systems coupled with new sensing modalities (3D laser, stereo vision) or feature representations (skeleton maps, point clouds, graph-based models), which still require high-capacity servers. Nevertheless, the data- and resource-intensive nature of DL necessitates larger datasets and more complex pipelines, making it challenging to embed these pipelines in resource-constrained environments.

This article revealed several promising technologies for developing CVGR systems suitable for edge devices. For example, 2D imaging currently offers advantages over 3D scene reconstruction technologies (depth sensing, stereo vision, 3D lasers). Most model-free gait feature representations discussed in Section 4.2 are advantageous for deployment in edge computing architectures, while the growing precision of model-based approaches holds promising opportunities for future investigations. Furthermore, the nature of graph-based models shows promise for embedding in low-resource devices; however, they currently require further optimisation methods (detailed in Section 8). Finally, dimensionality reduction techniques remain relevant due to the high dimensionality of gait data, especially when using multi-modal and multi-camera approaches for gait recognition.

Additionally, the increasing availability of powerful Edge AI development kits (detailed in Table 6), such as the NVIDIA cards, Google Coral Dev Board, Qualcomm Snapdragon AI Development Kit, and Khadas VIM, is opening opportunities to embed more complex pipelines at the edge. These development cards can be supported by USB AI modules designed to execute individual computer vision models. These modules, including the OAK-D, Hailo-8, and Coral USB Accelerator (among others detailed in Table 7), can perform tasks such as person detection, silhouette semantic segmentation, or body keypoint extraction to optimise the CVGR pipeline. Many of these devices enable parallel computing through dedicated chips (GPUs, VPUs, TPUs) and are suitable for model compression and optimisation using tools such as NVIDIA TensorRT, Intel OpenVINO, TensorFlow Lite. Table 8 showcases examples of CVGR systems designed for resource-constrained devices, highlighting a growing research trend in combining CVGR and edge computing. This trend is further supported by the multiple successful cases of computer vision systems combined with edge computing, as shown in Table 5.

10.3. Applications of CVGR Systems on the Edge

Beyond security applications, edge-based CVGR systems hold significant potential for healthcare, sports, and human-computer interaction. In healthcare, this approach could improve rehabilitation monitoring for neurological disorders (e.g., Parkinson’s disease), moving beyond traditional offline analysis to provide real-time feedback. For instance, authors in [34] and [172] implemented offline CVGR systems to assess patients and identify abnormalities that may indicate health risks or mental health decline. Yet, by analysing subtle gait changes in real-time, edge devices can further enhance these assessments, supporting personalised rehabilitation plans and enabling continuous monitoring for at-risk individuals without relying on expensive centralised infrastructure. Another promising application of edge-based CVGR is in fall prediction [173]. While most CVGR-based fall detection systems have primarily focused on offline analysis, on-device computing can enable continuous surveillance for fall prevention of people who require special care.

In sports, a CVGR system can easily gather and process precise movement data, offering insights about an athlete’s biomechanics (e.g., stride length, stride frequency, and gait phase) to refine athletic technique and detect movement disorders early on. Moreover, CVGR systems deployed on the edge can offer unique advantages for gait anomaly identification: continuous analysis, long-distance capture, simultaneous monitoring of multiple athletes, non-invasiveness, and resistance to imitation. A related approach was researched by Freire et al. [174], who applied machine learning to analyse gait patterns inside a gaming robot, providing real-time feedback for improving athletic performance and assisting individuals with mobility challenges. Their findings, supported by a CVGR system deployed on the edge, can ease creating adaptive and precise sports training systems, optimising biomechanics continuously, and enabling effective rehabilitation processes.

Finally, applications for human-computer interaction include personalised interfaces and emotion recognition. For the first group, CVGR systems can recognise individuals to personalise the environment, enhancing the user experience in home automation. Related research by Chi et al. [175] explored user-centred robotics by deploying gait recognition into service robots for human-following tasks in dynamic, challenging environments. For emotion recognition, studies integrating 2D CNNs with pose estimation enabled real-time gait-based emotion inference, fostering advancements in assistive technologies [176].

11. Conclusions

Gait recognition is achieving increasingly robust results every year thanks to advances in deep learning architectures. However, most recent approaches still rely on sending video of gait sequences to a central server for processing, which necessitates an internet connection and can be costly. In contrast, edge computing proposes collecting and processing data closer to the source on local devices, offering faster response times and enabling real-time monitoring. This trend, coupled with the availability of powerful mini-computers, makes it possible to run advanced computer vision-based gait recognition (CVGR) systems directly on edge devices where the gait data is captured.

This paper reviews different edge computing architectures for CVGR, discusses their design, deployment, and explores the challenges and future possibilities of integrating these technologies. The paper emphasises methods suitable for low-resource devices and identifies areas where further research is needed. Significantly, the review highlights a research gap: the limited exploration of combining CVGR and edge computing. This integration has the potential to substantially improve gait recognition implementations, making them more accurate and suitable for real-world applications, including continuous identification of individuals and patient health monitoring.

Future CVGR systems should explore modular frameworks that leverage edge computing. Distributing gait recognition tasks across multiple edge devices can significantly improve inference speed while maintaining accuracy and enhancing system robustness by capturing gait data from diverse viewpoints. This approach also provides a foundation for improved multi-modal or multi-view frameworks, where different end devices or sensors capture data of the same subject for subsequent recognition, offering immense potential for advancing gait recognition with improved accuracy and scalability.