Simplified Machine Learning Model as an Intelligent Support for Safe Urban Cycling

1. Introduction

1.1. Urban Mobility

There is no doubt that population growth is consistent and in Mexico during the last 25 to 30 years, this growth combined with very poor urban planning has caused a problem of vehicle congestion in the nation’s large cities. This situation causes the daily transfer from one point to another and on the outskirts of these large urban cities to take between one and three hours on an average trip, when these trips could normally be made with a duration of between thirty minutes and one hour.

Faced with these circumstances, sustainable mobility became a highly relevant issue for planning urban mobility systems, since it is a model that promotes the use of different means of transport that are friendly to the environment, inclusive and accessible [1]. In this research we are mainly considering three means of mobility that, due to their nature and hierarchy in mobility [2], are considered sustainable: walking, urban cycling and public transport, including this last hierarchy are considered common public transport in Mexico such as the metro, metrobus, light rail, commuter train, trolleybus and cable car. There are multiple benefits that this type of mobility contributes to the environment by not having large amounts of gas emissions, by not having energy waste and even contributing to reducing the carbon dioxide footprint in the atmosphere. With respect to social benefits, since these are collective and individual means of transportation, they significantly promote inclusion and are viable options for making long-distance journeys at a reduced cost.

Within these three means of mobility mentioned above, it is worth highlighting urban cycling, since it is a transportation choice that lightens the load on vehicles in road congestion. It is an ecological option because it promotes the significant reduction of harmful gases such as CO², it is an accessible means of transportation, easy to use and that, at the same time, contributes to improving both emotional and physical health. However, this alternative requires more attention from the authorities in charge of planning mobility in large cities, since the exclusive lanes are insufficient, the public access systems are limited and high cost for a sector of the population there are not enough spaces to park bicycles or store them, there is also an inequality of spaces to travel and urban cyclists are not given priority in terms of road safety.

1.2. Road Safety for Cyclists

Pedestrians and cyclists head the mobility hierarchy (see Figure 1), which classifies modes of transportation according to the vulnerability they present, as well as both negative and positive peculiarities that they cause as a means of transportation. It is worth mentioning that the negative peculiarities include the possible risks that a certain modality represents for users in other hierarchies.

To promote the use of bicycles, it is necessary to guarantee safety conditions through a focus on preventing road events that cause deaths and injuries. According to the philosophy of the Vision Zero road safety concept [3], which is based on the simple fact that we are all human beings and therefore make mistakes. This is why there is a need to generate systems that support the cyclist during their road trajectory, thereby reducing the possibility that these errors end in injuries and deaths. Institutions such as the World Health Organization (WHO) point out that in the event of a transport accident, the population of cyclists and pedestrians is more vulnerable and their safety is strategic in a global culture that needs to intensify sustainable travel [4].

In Mexico as in other countries we face a great public health challenge as a result of injuries generated by poor road safety. Statistically, it has been reported that traffic injuries are the leading cause of death among children between the ages of 4 and 14 years. Among the highest percentage of deaths are young people between 15 and 30 years old (32.2%), followed by the group between 30 and 44 years old (25.5%) [5], which has a strong impact on the economy and emotional stability of families, as well as society as a whole.

1.3. Intelligent Urban Cycling

Although it is true that the bicycle is in the subconscious of citizens as a pleasant element, associated with a livable city, a majority of citizens would use it when traveling if there were a safe and coherent infrastructure and pleasant environments. In this sense, technology can currently be used as a cyclist’s assistant, which will allow them to travel in a safer way during the trip.

Currently, the aim is to effectively incorporate urban cycling into the transportation networks within the so-called smart cities and promote more modern, clean and safe modes of transportation. This requires establishing an individual mobility model that, through the collection and analysis of various types of data, generate as a result the information that integrates smart mobility [6,7,8].

Correspondingly, the organization of this paper is arranged based on the following sequence:

• Section 2 is prepared to outline the intuitive information presented by the problem and the main research method adopted to identify the dominant characteristics and advantages of Simplified Machine Learning in achieving unexpected collision risk identification tasks crucial for training and testing procedures for maximize the effectiveness of model classification.
• Section 3 it is structured to generally explain the methodology used, the essential description of the proposed solution that includes the architecture of the proposed cognitive model as well as its main parts.
• Section 4 describes the experimental stage used to observe the performance of the model with different datasets and provides comparative tables and graphs that illustrate its performance when using different feature extractors as well as in each of the sample ranges that were used (One-Shot and Five-Shot ).
• Section 5 provides discussion of notable results related to the evaluation of the proposed model, its generalization capacity and its comparison against other state-of-the-art methods, as well as other particular aspects of its operation and performance.
• Section 6 expresses the main research conclusions.

Totally, the paper’s contribution is reflected in the following points:

• Reduce time, effort and costs related to the number of examples or training samples used in conventional Deep Learning (DL) and Machine Learning (ML) models.,
• This proposal, based on cutting-edge technology, is presented as a novel support option for cyclists, allowing them to travel more safely during trips within urban areas.,
• Contribution to the area of machine learning with a model that proposes using fewer examples or samples of information for training and being able to resemble the natural learning of human beings.

2. Simplified Machine Learning

2.1. The Challenge of Machine Learning

Increasing safety in urban cycling and its incorporation as a smarter and safer means of transportation towards future smart cities suggests a technologically supported solution to assist the urban cyclist. Intuitively, the problem shows that there is information available and other information that is not. The Table 1 summarizes these two aspects to consider to model a possible solution.

Also intuitively, Figure 2 presents in a general way, the characteristics that a suggested machine learning model should have to be applied to the problem of this research.

The information and intuitive characteristics of the problem to be solved suggest that the proposed solution can be oriented towards the area of artificial intelligence and specifically within the field of machine learning, because to assist the cyclist in identifying the risk of a collision, it must have an accelerated learning process also using previously learned information. Recently, machine learning has been very successful in various tasks, specifically in image and speech classification, pattern recognition or improved searches for information on the web. However, it is also known that these models usually require a large amount of data and training time to have a reliable learning process.

Therefore, the purpose of this research is that based on the approach and description of the problem, a technological solution is proposed that supports the urban cyclist in reducing the risk of collision by focusing on automatic detection within a dynamic environment, so the Research question is defined as follows: Can a machine learning model be used, based on some examples, to learn the concept of unexpected collision risk and detect it in real time?

2.2. Related Work

Reviewing possible technological proposals for solutions to this problem, there are preventive approaches that rely on unsupervised machine learning to explore the circumstances associated with urban cycling safety, such as those exposed by Zhao, H. et al [9], in where large amounts of publicly available data, such as satellite images, neighborhood and city maps, are used to collect information from the environment of cyclist accidents and use machine learning methods, such as Generative Adversarial Networks (GAN) to learn from these data sets and explore the factors associated with cyclist crashes. In this same sense, it is known that work has been carried out in this regard in Spain, such as the one presented by Galán R. et al [10], where the variables that are causes of accidents in bicycle users are studied, with the aim of reducing the number of accidents and thus increase the number of people who use it as a means of transportation with greater safety.

However, in the time in which this research has been carried out, no evidence has been found that a technological proposal that involves a means of transport such as the bicycle and supports the reduction of accidents in this sense has been contemplated. Nor has specific evidence been found of a geospatial analysis of accidents in urban cycling to be able to make a comparison of methodology and results.

It is known that recently machine learning has been very successful in various tasks, such as pattern classification and searching for massive information on the web, as well as image and speech recognition. However, these machine learning models often require, as training input, a large amount of example data to learn. Likewise, the technology known as Deep Learning (DL) [11,12] is booming and has been playing an important role in the advancement of machine learning. However, it also requires large amounts of data.

In addition to this, the large size of the data tends to lead to slow learning, this is mainly due to the parametric aspect of the deep learning algorithm, in which, due to the operating characteristics, the training examples must be learned in parts and gradually. Now, it has been mentioned that one of the characteristics of the Simplified Machine Learning model is that it must be able to learn from very few examples, therefore deep learning would not apply for this purpose. On the other hand, the model should be more similar to the way humans learn, that is, generalize knowledge from a few examples.

2.3. Contrastive Learning

Intuitively we can say that contrastive learning mimics the way humans learn about the world around them. According to many specialists, children learn new concepts more easily, for example by looking at a picture of an owl and trying to find a similar one among a set of images of various animals. In this case, the child has to compare each of the animals by identifying their characteristics, compare them with those of the owl in the original image and then conclude that the image represents a similar animal.

From what was described above, it turns out that it is easier for a person without prior knowledge, like a child, to learn new things by contrasting between similar and different things instead of learning to recognize them one by one. Initially, the child may not be able to identify an owl as such, but after a while the child learns to distinguish common characteristics among owls, such as the shape of their head, their posture, their wings, and the shape of their body.

Within machine learning (ML), contrastive learning is a machine learning paradigm in which unlabeled data is juxtaposed against each other to teach a model which are similar and which are different. That is, as the name suggests, the samples are contrasted against each other and those belonging to the same distribution are pushed towards each other in the same compact Euclidean space. On the contrary, those that belong to different distributions move away from each other [13].

Contrastive learning is a technique that improves the performance of computer vision tasks because it has shown promising results over deep learning, thus gaining importance in the field, by using the principle of contrasting samples with each other to learn the attributes that are common between data classes and the attributes that differentiate one data class from another.

In recent years, there has been a resurgence in the field of contrastive learning which has led to important advances in self-supervised learning [14,15,16,17,18]. The common idea in these works is the following: join an anchor sample and a "positive" sample in the representative space (embedding space) and separate the anchor from many "negative" samples. Since there are no labels available, a positive pair often consists of an increase in sample data, and negative pairs consist of the anchor and samples chosen at random from the small set of images. These concepts are shown by comparing them graphically in Figure 3. Likewise, in [15,16], certain connections are described that exist between contrastive loss and the maximization of similar information when evaluating it between different data samples.

2.4. Approach Overview and Contributions

Contrastive learning as mentioned in Khosla, P. et.al [13] mimics the way humans learn and aims to learn low-dimensional representations of data by contrasting between similar and dissimilar samples. Therefore, humans can learn new things with a small set of examples. When a person is presented with new examples, they are able to understand new concepts quickly and will then recognize variations of those concepts in the future. Just like that, a child can learn to recognize a cat from a single image. However, currently a machine learning system needs many examples to learn the characteristics of a cat and recognize them in the future or in other examples.

We can observe that in standard associative learning, i.e., an animal must repeatedly experience a series of associations between a stimulus and a consequence before it completely learns a particular stimulus. Therefore, learning is inevitably incremental. However, animals sometimes conclude or infer results that they have never even observed before and from which they need to learn quickly to survive. In such cases, animals can learn from a single exposure to the stimulus, in this situation but making an analogy towards machine learning, this is what we have defined as Simplified Machine Learning [19] and that generally It is known in the literature as one-time learning.[20].

Compared to computers, it is a hallmark of human intelligence to be able to learn quickly, whether it is recognizing objects from a few examples or quickly learning new skills after a few minutes of experience. Today it is claimed that artificial intelligence systems should be able to do the same, learn and adapt quickly from a few examples and continue to adapt as these systems are exposed to more and more available data. This type of learning with characteristics of speed and flexibility is a challenge, since the system must integrate its prior knowledge with a small amount of new information, efficiently avoiding overfitting to new data. Likewise, this previous experience and the new data will depend on the task at all times (see Figure 4).

Our solution proposal in terms of being able to support an urban cyclist to ride safely in urban environments is to specify and design the model that can perceive and perform machine learning with few training examples, which assists in risk detection. of collision and thus be able to alert the cyclist of the possible danger.

The main justification behind this Simplified Machine Learning will then be to able to train a cognitive model with one or very few examples, as well as being able to generalize unknown categories without extensive retraining and thus being able to better adapt as a solution to the problem posed in this research.

So far, no concrete evidence of specific work related to the problem has been found, so it is considered that this research is the first attempt to define a machine learning model that allows detecting and evaluating the risk of unexpected collisions in urban cycling.

Some of the work done during our research and presented in this article was inspired by what was developed in [21], which showed how similarity using Euclidean distance ($L1$) was superior to similarity using cosine distance presented in [22]. Therefore, it was assumed that adding a combined affinity layer will improve the classification accuracy. With this approach, we proposed to implement this combined affinity layer in our Siamese artificial neural network for One-Shot learning. This is a major contribution to what we have called Simplified Machine Learning, by developing a new type of affinity layer (bi-layer) for deep affinity neural networks, which is the basis of our Siamese Artificial Neural Network.

3. Materials and Methods

Below in this section, a brief general description of the methodology used is presented, the substantial description of the proposed solution that includes the explanation of the architecture of the proposed cognitive model as well as its essential parts such as the Affinity Layers and the Layer Combined Affinity.

3.1. Methodolgy

For the development of this research, the mixed methodology or mixed research route, proposed by Hernández-Sampieri and Mendoza [23] was used as a basis with some variations required for the present work. The main reason for using this mixed methodology is that it does not replace quantitative research or qualitative research, but rather uses the strengths of both types of inquiry, combining them and tries to minimize their potential weaknesses. Likewise, we consider that it harmonizes or is more suited to the problem statement.

Our methodology integrates quantitative and qualitative approaches, and is constituted by the following general stages (see Figure 5):

• Research problem statement;
• Design and development of the solution proposal;
• Data collection and analysis;
• Preliminary Results.

3.2. Cognitive Model Architecture

The metric learning [24], that is, learning with a distance measure or Similarity learning is a method that performs mapping in the feature space through feature transformation to subsequently form groups within the feature space. Metric learning based methods are widely used to facial recognition and person identification. Metric learning learns the similarity of two images through the distance between them, where similar targets move closer in distance and different targets move further away from each other. Therefore, metric learning requires certain key characteristics of the learning objectives, that is, individualized characteristics of each object.

By distinguishing different objects, the appearance characteristics of similar objects are very similar, these characteristics belong to the common characteristics between almost identical objects. Distinctive characteristics such as shape, color, texture and size are used to distinguish the different characteristics of two or more objects. Metric learning distinguishes different identities by learning key distinguishing features.

The most commonly used methods for measuring efficiency or loss within metric learning include binary cross-entropy loss, contrastive loss, triple loss, and quaternion loss.

As background, contrastive loss was introduced in 2006 by Hadsell, Chopra and LeCun [25] , and is generally described as a learning loss metric function that calculates the Euclidean distance or cosine similarity between pairs of vectors. Assigns a loss value based on a predefined margin threshold. If the distance between two vectors is less than the margin threshold, the loss value is equal to zero. If the distance is greater than the margin threshold, the loss value increases and is greater than zero. Contrast loss plays a crucial role in maintaining the similarity and correlation of latent representations across different information modalities. This ensures that similar cases are represented by similar vectors and different instances are represented by different vectors.

In a simple way, the loss in metric learning can be exemplified as follows: having two input images $x_1$ and $x_2$, extracting their respective characteristic vectors $f_{x1}$, $f_{x2}$, the Euclidean distance can characterize the similarity, that is, the closeness between two objects through the distance in Euclidean space, defined in the Equation 1 (adapted from [25]) as:

$$D_{x_1,x_2}={∥\overrightarrow{f_{x_1}}-\overrightarrow{f_{x_2}}∥}_2$$

(1)

Formally, a contrastive loss function is used to learn the parameters W of a parameterized function $G_W$, such that matching neighboring objects move together and non-neighbors move away. The prior knowledge will then be used to identify the neighbors in each case for a training data. As exemplified by Hadsell et al. [25] is an energy-based model that given the neighborhood relations, these are used to learn the mapping function. In this context, given a family of functions G (such as a CNN), parameterized by W (weights of a CNN), the objective will then be to find values of W that map a set of high-dimensional input values by means of a comparator, for example the Euclidean distance to perform "semantic similarity" of the entries in the input space, providing a set of neighborhood relations.

Contrastive loss is mainly used to train so-called Siamese neural networks, introduced in the early 1990s by Bromley et al. [26]. The Siamese network is a "connected neural network", and its network structure is shown in Figure 6.

Algorithm 1: Training of generic Siamese neural network.

Require:  S - Training dataset, f - CNN, $z_{ij}$- binary label $(z_{ij}\in 0,1)$, $\mathbf{w}$ - Shared weights, $\eta$ - Learning rate Ensure:  $\mathcal{L}({\mathbf{x}}_{\mathrm{i}},{\mathbf{x}}_{\mathrm{j}},{\mathrm{z}}_{\mathrm{ij}})$ 1: for$S\leftarrow \left\{\left({\mathbf{x}}_i,{\mathbf{x}}_j,z_{ij}\right),\left(i,j\right)\in K\right\}$do 2:    $h_i\leftarrow f\left(x_i\right)$Feature vector of $x_i$ 3:    $h_j\leftarrow f\left(x_j\right)$Feature vector of $x_j$ 4:    $d_{h_i,h_j}\leftarrow {∥h_i-h_j∥}^2$ Euclidian distance 5:    Contrastive Loss function $\mathcal{L}({\mathbf{x}}_{\mathrm{i}},{\mathbf{x}}_{\mathrm{j}},{\mathrm{z}}_{\mathrm{ij}})$ (Equation 3) 6:    Total error function to be minimized $\mathcal{L}\left(w\right)$ (Equation 2) 7:    Optimize and update weights ${\mathbf{w}}_{n+1}\leftarrow {\mathbf{w}}_n-\eta ▽f\left({\mathbf{w}}_n\right)$ 8: end for

Here we see that the network has a "connected body" through sharing the set of weights, that is, the weights of the two neural networks are the same. The Siamese network is mainly used to measure the similarity between two inputs, which can be generated from a CNN or an LSTM [27]. For example, when two images are input, the two inputs are fed into two neural networks, these two neural networks map the inputs to the new representation space separately, allowing the input to be represented as a value within the new space. The similarity or dissimilarity between both inputs is evaluated by calculating the loss value itself.

Let’s say that each pair of training images intrinsically has a binary label Y assigned to this pair. If $Y=0$, $x_1$ and $x_2$ are considered similar; otherwise if $Y=1$. Then the contrastive loss function in its general form can be defined as:

$$\mathcal{L}(\mathrm{W})=\sum _{\mathrm{i}=1}^{\mathrm{p}}\mathrm{L}(\mathrm{W},{(\mathrm{Y},{\overrightarrow{\mathrm{X}}}_1,{\overrightarrow{\mathrm{X}}}_2)}^{\mathrm{i}})$$

(2)

$$L(W,{(Y,{\overrightarrow{X}}_1,{\overrightarrow{X}}_2)}^i)=(1-Y)L_S(D^i)+Y{L}_D(D^i)$$

(3)

where ${\overrightarrow{X}}_1$ and ${\overrightarrow{X}}_2$ are a pair of input vectors shown to the system, in our case, they are the feature vectors of the input images, ${(Y,{\overrightarrow{X}}_1,{\overrightarrow{X}}_2)}^i)$ is the $i-th$ labeled pair of samples, $L_S$ is the partial loss function for a pair of similar points, $L_D$ is the partial loss function for a pair of different points and D to shorten the Euclidean distance notation $D_{X_1,X_2}$. Finally P is the number of training pairs. Both the function $L_S$ and the function $L_D$ must be designed such that by minimizing L with respect to W results in low values of D for similar pairs and high values for D in different pairs.

Specifying then, the exact loss function will be the Equation 4:

$$L_c(W,{(Y,{\overrightarrow{X}}_1,{\overrightarrow{X}}_2)}^i)=(1-Y){\displaystyle \frac{1}{2}}{(D)}^2+Y{\displaystyle \frac{1}{2}}{\left\{max(0,m-D)\right\}}^2$$

(4)

where $m>0$ is a margin. The margin defines a radius around $G_W\left(X\right)$, which is a set threshold. It can be known from the contrastive loss that the loss function can be used both to express the coincidence of pairs of samples and to train the model with the extracted features effectively. With all this, through the continuous reduction of the loss value, the distance between pairs of similar samples is continuously reduced, while the distance between pairs of dissimilar samples is continuously increased.

The general description of the architecture of the proposed Siamese cognitive model is presented in Figure 7. We established as a basis for our Siamese network model an approach similar to the one shown in [27], but adjusting the Convolutional Neural Networks (CNNs) to generate 1024 features instead of 4096, they will also share the same parameters since they are copies of the same CNN. The neural network architecture that learns image embeddings and attribute vectors in the same vector space (embedding space) was used in the implementation of the feature extractor, in this way the distances between affinity features can be calculated. The two input images $(x_i,x_j)$ feed the CNNs, where the two fixed-length feature vectors, $f\left(x_i\right)$ and $f\left(x_j\right)$ are obtained. Since both feature extraction networks are the same, $f\left(x_i\right)\simeq f\left(x_j\right)$ if the two images are affine and $f\left(x_i\right)\ne f\left(x_j\right)$ otherwise.

As main feature extractors, the standard CNNs in the state of the art (ResNet-18 [28] and EfficientNet-B0 [29]) were used, which helped to accelerate the training time of the proposed model when generating fewer parameters on the network. Subsequently, these results will feed the affinity layers as detailed in the following section.

3.3. Affinity Layer Overview

In the design and specification of the affinity layer, these are calculated using for $A_1$ the Euclidean distance, shown in Equation 5 and for $A_2$ the Manhattan distance, as seen in Equation 6, where u and v are the feature vectors. We adapt for the proposed model, a perspective shown in [27,30] to integrate as the layers in an artificial learning neural network. In this way, a one-to-one operation is performed on each element of the feature vectors and to finally generate a new one.

$${\delta }_e(u,v)=\sqrt{\sum _{i=1}^n{\left(u_i-v_i\right)}^2}$$

(5)

$${\delta }_m(u,v)=\sum _{i=1}^n\left|u_i-v_i\right|$$

(6)

3.4. Combined Affinity Layer Overview

The basis of our Siamese artificial neural network is the so-called combined affinity layer C that unifies the feature vectors of the Euclidean ($A_1$) and Manhattan ($A_2$) layers to form a single one that will evaluate similarity or dissimilarity of the input images.

The combined affinity layer $A_{max}$ works as follows, we take the element-wise maxima of the two affinity layers ($A_1$ and $A_2$). Assuming that $A=\left(A_{ik}\right)$ is the affinity layer, for $1\le i\le m$ and $1\le k\le n$, where m is the total number of affinity layers , and n is the size (number of rows) of each affinity layer, then the corresponding maximum of elements in each row of the two layers are taken to form a layer of size n, which is defined by Equation 7.

$$A_{max\left(k\right)}=max\left(A_{ik}\right),1\le i\le m$$

(7)

In the design and implementation of the combined layers, the 1024 output of the CNNs was conditioned with a ReLU activation function, a kernel regularizer to prevent overfitting, and a bias initializer. The regularizer works with a mean of 0, while the bias initializer had a mean of 0.5 and a standard deviation of 0.01. Having two inputs to compare each of the model’s feature extractors produces a vector of 1024 features. Those outputs then become the inputs for the two separate layers to calculate the corresponding affinities. The layer $A_1$ (Euclidean distance, $L1$) and the layer $A_2$ (Manhattan distance, $L2$). In each of these affinity layers an output of 1024 features is produced. Subsequently, it is passed through the Maximum Affinity Layer $A_{max\left(k\right)}$, which finds the maximum number of elements of the two layers and generates a maximum vector of 1024 features. As a last step, a sigmoid activation function is applied on a layer with a filter, which will produce a value between 0 and 1, which establishes the probability of affinity between the input images.

3.5. Dataset Overview

In the area of One-Shot learning, much of the research evaluating models for image categorization commonly uses the MiniImageNet [22] and CIFAR-100 [31] datasets. For this reason, we used both data sets in the experimental phase, which allowed us to compare them with other state-of-the-art methods that have also used them. Furthermore, we also added the CUB-200-2011 (Caltech-UCSD Birds-200-2011) dataset [32] which has recently been the dataset for comparing Few-Shot Learning tasks, as well as being the most used dataset for fine-grained visual categorization tasks. We also incorporated the DroNet dataset [33] to establish a comparison with a proposed autonomous drone driving approach for obstacle avoidance and make our evaluation and comparison more comprehensive.

As a common practice in the area of machine learning, each dataset was divided into three subsets for One-Shot learning: the training set ($T_s$), the validation set ($V_s$) and the search/query set ($Q_s$). $T_s$ is a disjoint set of the sets $Q_s$ and $V_s$, but $V_s$ and $Q_s$ belong to the same category or class. Suppose there are a number i of categories in the training set, a number j of categories in the validation set, and a number k of categories in the search set. The set of category labels in $T_s$, $V_s$, and $Q_s$ would then be $C_i$;$C_j$ and $C_k$, respectively.

Therefore, the label pairs for the images in the training set would be set by Equation 8.

$$T_s=\left\{\left(x_i,x_j\right),A\left(x_i,x_j\right)\right\}\forall i,j=1..n$$

(8)

For which $(x_i,x_j)$ are the image pairs in the training set and $A(x_i,x_j)$ will be the affinity score of the image pair. Therefore, if $x_i$ and $x_j$ are equal, then the score will have a value of 1 and otherwise it will have a value of 0. It is set to n as the number of training samples or examples.

Continuing with the label specification, Equation 9 names the image label pairs in the validation set.

$$V_s=\left\{\left(x_k,x_l\right),A\left(x_k,x_l\right)\right\}\forall k,l=1..m$$

(9)

For which $(x_k,x_l)$ are the image pairs in the validation set and $A(x_k,x_l)$ is the affinity score of the image pair. Therefore, if $x_k$ and $x_l$ are equal, then the score will take a value of 1 and otherwise it will have a value of 0. m is the number of samples or examples for validation.

Finally, the images that form the query set are specified in Equation 10:

$$Q_s=\left\{x_k\right\}\forall k=1..n$$

(10)

For which $x_k$ are image samples from categories in the validation set. The final objective sought in this learning is to classify samples in the search/query set given some examples in the validation set meeting the following restrictions: $C_i\notin C_j$; $T_s\cap V_s=\varnothing$; $T_s\cap Q_s=\varnothing$ and $Q_s\in V_s$. Therefore, the categories in the training versus validation set are disjoint, but those classes in the validation and query set are intersecting sets.

The segmentation of the data sets used for the experimental phase of this study are briefly presented below:

• The MiniImageNet dataset as stated in Vinyals et al. [22] contains 100 classes chosen randomly from the original ImageNet dataset and each of those classes is itself composed of 600 images. The data set was divided following what was presented in [30,34,35,36], into 64, 16 and 20 training, validation and test classes, respectively. The main reason for using this data set is due to its complexity and its repeated use to test many other One-Shot learning tasks.
• The CIFAR-100 dataset as stated in [31] contains 100 classes with 600 images each. The data set was divided as suggested in [22,34,35,37] into 64, 16 and 20 training, validation and test classes, respectively. This division is in line with other research that evaluated one-shot learning models with this dataset.
• The CUB-200–2011 dataset defined in [32], as previously mentioned, is a fine-grained dataset consisting of 200 classes and $11,788$ images. A split was applied to the dataset similar to the one proposed in [34] of 100, 50, and 50 classes for training, validation, and testing, respectively, which in turn is in line with the splits also established in [14,21,22,35,37,38,39].
• The DroNet dataset as described in Loquercio et al. [33], contains 32,000 images distributed in 137 classes for a diverse set of obstacles. The data set was divided into 88, 22 and 27 training, validation and testing classes, using a data set division similar to that proposed in [22,34,35,37].

4. Results

4.1. Experimental Setup

In our experimental phase, two CNN networks were used: EfficientNet-B0 and ResNet-18. These two neural networks were chosen mainly for their characteristics as feature extractors, generalized use in other One-Shot learning models and to be able to compare our results against those in the state of the art. For our model, the ResNet-18 implementation was similar to the one shown in [28], except that the input image size was set to 100 x 100. On the other hand, the EfficientNet-B0 network implementation is similar to the one presented by [29], except also that the input image size was also set to 100 x 100. The outputs are then passed through the proposed combined affinity layer with a sigmoid activation to determine similarity or dissimilarity.

In the experimental design, the number of epochs was established as 200, as well as the size of the processing block was defined as 18. For the training part of the Siamese network, the contrastive loss function (Equation 4) was used as an objective function. Likewise, an Adam Optimiser was also used with an initial learning rate set to 0.0005.

A comparison was made with the current reference models in the literature, which are based on the cosine, Manhattan and Euclidean similarity layers, with the combined affinity layers proposed for the four datasets MiniImageNet, CIFAR-100, CUB-200–2011 and DroNET detailed in previous section. The evaluation was specifically performed on the accuracy of five random example images in 1-Shot mode and five random example images in 5-Shot mode. The above described is exemplified below in Figure 8

The following section presents a comparison of our experimental results in a descriptive and detailed manner, using representative tables and figures.

4.2. Comparison of the Model Against Reference Data

Once the experimental phase has been carried out, the results obtained with each of the data sets used to evaluate the behavior, performance and efficiency of the model are presented below. Likewise, a comparison is made of the model developed in this research against the various models present in the state of the art to also observe its performance and efficiency.

The main objective of the present research focused on developing a biologically inspired computational model, which would allow simplified machine learning using few examples to detect a possible risk of unexpected collision and thereby assist the cyclist in driving within an urban environment. Therefore, the model was specifically evaluated in the accuracy in the identification of perceived information (images) using the single example mode (1-Shot) and for the five-example mode (5-Shot), likewise a comparison with the data sets, using the two feature extractors indicated.

Table 2 and Table 3 shows the average accuracy with 95% confidence when performing image classification using the four data sets, the affinity methods separately, and the proposed SML model ($A_{max}$ layer). Training was performed using the MiniImageNet dataset and the ResNet-18 and EfficientNet-b0 CNNs as feature extractors.

The results show that for all datasets and feature extractor networks our SML model outperformed one-shot mode learning methods (1-shot classification accuracy) using separate similarity layers $A_1$ (Euclidean), $A_2$ (Manhattan). Therefore, our SML model using both the ResNet-18 and EfficientNet-B0 feature extractors had the best performance in all cases.

As can be seen in Figure 9, the proposed SML model for the MiniImageNet dataset, with ResNet-18 feature extractor, in 5-Shot mode, performs better by $16.85\%$ compared to the best result which is similarity layer A1. On the other hand, in the 1-Shot mode, the model performs only $6.55\%$ better compared to the best result for this mode which is the similarity layer A1.

Next for the CIFAR-100 dataset dataset as shown in Figure 9, the SML model with the same feature extractor ResNet-18, in 5-Shot mode, performs better by $17.04\%$ compared to the best result which is the similarity layer A1. Likewise, in the 1-Shot mode, the model performs better only by $4.41\%$ compared to the best result for this mode which is the similarity layer A2.

Continuing with the analysis, as shown in Figure 9, the proposed SML model using CUB-200–2011 dataset, with ResNet-18 feature extractor in 5-Shot mode, performs better by $8.33\%$ compared to the best result which is similarity layer A1. Now in the 1-Shot mode, the model performs only $4.31\%$ better compared to the best result for this mode which is the similarity layer A2.

Finally, as seen in Figure 9, for the DroNet dataset the SML model with a similar feature extractor (ResNet-18), in 5-Shot mode, performs better by $21.46\%$ compared to the best result which is the similarity layer A1, being the best performance within the four datasets used for the 5-Shot mode. Similarly, in the 1-Shot mode, the model performs better by $7.64\%$ compared to the best result for this mode which is also the similarity layer A1, this being also the best performance within the four datasets used for 1-Shot mode.

Figure 10 summarizes the previous results comparatively, as well as the behavior of the four datasets using the ResNet-18 convolutional network as a feature extractor, as well as the affinity layers ($A_1$, $A_2$ and $A_{max}$, used in the comparative.

Continuing with the analysis of the results, it can be seen in Figure 11 that the proposed SML model for the MiniImageNet dataset, the SML model with the EfficientNet-b0 as a feature extractor, in 5-Shot mode performs best way with $15.95\%$ compared to the best result which is the similarity layer A1 . Likewise, in the 1-Shot mode, the model performs better by $4.30\%$ compared to the best result for this mode, which is the similarity layer A1. It should be noted that this is the best performance among the four data sets used in 1-Shot mode.

Now, for the CIFAR-100 dataset as shown in Figure 11 the SML model with the same EfficientNet-b0 feature extractor, in the 5-Shot mode it performs better by $10.23\%$ compared to the best result which is the A1 similarity layer. On the other hand, in the 1-Shot mode, the model performs only $3.57\%$ better compared to the best result for this mode which is the similarity layer A1.

Continuing with the analysis, as shown in Figure 11, the proposed SML model using CUB-200–2011 dataset, with EfficientNet-b0 feature extractor in 5-Shot mode, performs better by $5.03\%$ compared to the best result which is similarity layer A1. Instead in the 1-Shot mode, the model performs only $1.03\%$ better compared to the best result for this mode which is the similarity layer A1.

Finally, as seen in Figure 11, for the DroNet dataset, the SML model with EfficientNet-b0 as a feature extractor, in 5-Shot mode, performs best way by $16.94\%$ compared to the best result which is the similarity layer A1, being the best performance within the three data sets used for the 5-Shot mode. Besides in the 1-Shot mode, the model performs better by $3.81\%$ compared to the best result for this mode which is also the similarity layer A1.

Figure 12 summarizes the previous results comparatively, as well as the behavior of the four datasets using the EfficientNet-B0 convolutional network as a feature extractor, as well as the affinity layers ($A_1$, $A_2$ and $A_{max}$, used in the comparative.

As a summary on the performance of the SML model, evaluating both feature extractors and the datasets in each of the similarity layers, we can state that the model has the best average accuracy with the ResNet-18 feature extractor for the DroNet dataset both in the 1-Shot mode and for the 5-Shot mode, achieving the best percentages of $21.46\%$ and $7.64\%$ respectively.

4.3. Performance and Generalization in the State-of-the-Art

When classifying new data with state-of-the-art reference models, the accuracy tends to decrease due to the change in data distribution as they could demonstrate in Li et al. [30], where all the data have the same statistical distribution even if they come from different classified groups. Our Siamese network, being the basis of the SML model, used the ResNet-18 and EfficientNet-B0 networks as feature extractors, was trained with the MiniImagenet data set and was also validated with the CIFAR-100, CUB-200–2011 and DroNet data sets. For the state-of-the-art models used in the comparison, very similar networks and datasets and CNNs were used, thus allowing the results to be evaluated using their classification accuracies in the two modes, 1-Shot and 5-Shot, with a $95\%$ trusted. Below on the Table 4, Table 5, Table 6 and Table 7 we present the results about what we have described.

The results presented in the Table 4, Table 5, Table 6 and Table 7 allow us to observe the comparison of accuracy in the average classification, which includes the models selected in the state of the art and the proposed SML model. Models using very similar feature extractors and datasets were explored and considered, allowing us to evaluate our SML model results with classification accuracy in both modes (1-Shot and 5-Shot) at $95\%$ trustworthy. Training for the SML model was performed with the MiniImageNet dataset and the ResNet-18 and EfficientNet-B0 CNNs as feature extractors.

Graphically in Figure 13 it can be seen that the proposed SML model for the MiniImageNet dataset in 1-Shot mode and as an EfficientNet-B0 feature extractor, performs better than all models except RENet, which was better by $1.04\%$. Similarly in performance for the 5-Shot mode (Figure 13), the model RENet was also $1.06\%$ better than the SML model. Therefore, RENet was the model that presented the best result for both modes (1-Shot and 5-Shot) of the comparative models using the MiniImageNet dataset.

Similarly, in Figure 14b,b it can be observed that for the CUB-200-2011 dataset, the SML model in both modes (1-Shot and 5-Shot) did not have an average precision as close to the RENet model, since the latter was better by $6.93\%$ and $7.92\%$ for the 1-Shot and 5-Shot modes respectively.

Continuing with the results obtained, Figure 15a,b show us how the SML model using the CIFAR-100 dataset and when compared with the state-of-the-art models, surpassed the Dual Trinet model on average in accuracy by $12.24\%$ in 1-Shot mode and by $3.43\%$ in 5-Shot mode to the model, whose results had been the best as observed in Table 6.

Finally, for the DroNet dataset, as can be seen in Figure 16, the SML model using the 1-Shot mode outperforms the Dual Trinet model by only $0.91\%$, the latter being the model that presented the best average accuracy of the analyzed models for that particular mode. Similarly, the Dual Trinet model for the 5-Shot mode was outperformed by our SML model in average accuracy but only by $0.40\%$ as seen in Figure 16.

The above results allow us to conclude that our SML model compared to the state-of-the-art models, using two of the data sets (CIFAR-100 and DroNet), has a better performance and generalization in the 1-Shot and 5-Shot mode using both the ResNet-18 and EfficientNet-B0 feature extractors. However, for the MiniImageNet and CUB-200-2011 data sets, results close to the RENet model were obtained, which was the one that obtained the best results in terms of average accuracy.

5. Discussion

As shown in this previous section, in the experiments carried out with the described data sets and the CNN networks, the proposed Siamese network model was able to perform better in the One-Shot and 5-Shot learning methods. Because the ResNet-18 CNN learns from residuals and as shown in [34], it is a practical feature extractor for one-shot learning tasks. It could also be seen that its demonstrated classification accuracy was very close to EfficientNet-B0 and was consistent with the CNNs that have been used for comparison.

It can also be observed that when classifying new data with the experimental models, the accuracy within the classification decreases and this is due to the change in the distribution of the data present in the dataset. Although the data used in One-Shot learning comes from disjoint classes, they all present and come from the same data distribution. Likewise, based on the work presented in [30], we present that the accuracy demonstrated in the classification of our model using the CNNs ResNet-18 CNN and EfficientNet-B0, which have been trained with the MiniImagenet dataset and validated with the CIFAR-100 and DroNet data sets, and the classification accuracy is presented in Table 6 and Table 7 with 95% confidence.

Our experimental phase with the datasets and CNNs networks resulted in our proposed model performing better in classification accuracy than other 1-Shot learning methods that use the cosine function as a similarity layer. As shown in particular, our Siamese network model when using the ResNet-18 feature extractor had better performance than when using EfficientNet-B0 for the MiniImageNet dataset. Architectures with fewer parameters were used, similar to those used in [34] and [22]. It should be noted that the performance of our model is due to the fused affinity layer (bi-layer) that was developed and it is also emphasized that the careful combination of the affinity layers allowed us to have a significant improvement in the classification accuracy in 1-Shot and 5-Shot learning tasks.

6. Conclusions

Feature detection, accuracy, and learning speed represent three of the most important problems in the field of machine learning systems. These systems, in many real-world scenarios, will operate in unstructured environments and will therefore require architectures that can adapt to variations and perturbations in those environments.

The Siamese artificial neural network model that is proposed as a solution to automatically recognize a possible collision risk for a cyclist within the urban environment is basically based on two layers of affinity, resembling human contrastive learning, to perform the Few-Shot learning task. The results generated experimentally demonstrate that the proposed model performs better and above the baseline set by almost all models in the state of the art using the aforementioned data sets.

It was also observed that our Siamese artificial neural network model produces results whose consistency is compared to other feature extraction networks, but using a smaller size in the example data set for training. One of the main results has been to demonstrate that the proposed SML model works in a comparable manner and in some cases above the baseline established by the Siamese network models in the state of the art, using similar data sets as well as specific data for the problem at hand. This allows us to infer that the technological tool developed in this research can be considered as an applicable partial solution.

Finally we can mention that this is a work in progress whose usefulness can be extended to various fields of application and whose components can be improved as the research advances, such as feature extractors with better performance, faster and greater precision.