The results of the validation are presented below.
3.1. Experimental Validation of the Proposed System
To verify system functionality, specific tests were carried out on each of its main subsystems that support the prototype’s functionality: positioning (GPS), communication (LTE/GSM), storage (MicroSD), and energy/ignition state (voltage detection). Results are organized by subsystem, including measured parameters, observed behavior, and the corresponding technical interpretation.
3.1.1. Validation of the Global Positioning Module (GPS)
GPS module validation aimed to verify three essential aspects for prototype operation: (i) the ability to acquire a satellite signal in an adequate time (Fix), (ii) the accuracy of the calculated distance traveled via coordinate-based odometry, and (iii) the consistency of accumulated error when compared to the vehicle odometer, used as the operational field reference.
Signal Acquisition Time (Fix).
In the static cold-start test, the GPS module achieved valid satellite fix in an average time of 45 seconds. This result is considered adequate for an embedded system operating with consumer-grade GNSS signals, especially considering that in real scenarios, the initial Fix is often affected by environmental conditions (partial obstruction, satellite availability, and signal quality). The recorded time allows the system to be operational within a reasonable interval from vehicle start-up, enabling the initiation of distance counting and maintenance logic without prolonged delays.
Accuracy of Accumulated Distance Measurement.
The prototype’s odometry is based on the accumulation of distances between successive points calculated from GNSS coordinates. To reduce the impact of “urban noise” and avoid accumulation of micro-displacements when the vehicle is stationary (e.g., at traffic lights), firmware logical filtering was applied. Distance calculation was optimized using the native function of the TinyGPS++ library (distanceBetween), replacing complex manual calculations. Additionally, firmware logic was applied to discard displacements at speeds below 3.0 km/h or distances less than 5 meters between readings. This approach reduces the risk of “phantom sums” in stop-and-go environments.
The following code as shown in Listing 1 excerpt illustrates how the algorithm calculates real distance and dynamically updates maintenance counters:
GPS vs. Vehicle Odometer Comparison.
The dynamic test consisted of a controlled long-distance trip, using the vehicle’s digital odometer as a practical reference. After completing a standard route of 160.0 km (odometer), the prototype recorded 164.0 km as accumulated distance. In relative terms, this difference represents an error of approximately
, evidencing a positive deviation (overestimation). The relationship between both measurements is expressed by Equations (
1) and (
2):
Error Margin Analysis and Systematic Tendency.
The 2.5% error is considered satisfactory for a GNSS system without differential correction (e.g., without RTK or advanced SBAS), particularly in urban conditions where signal can degrade due to obstructions, building reflections, and variations in horizontal precision. The observed positive tendency is interpreted as resulting from accumulated residual micro-variations in the signal during stops, which can introduce small phantom distances that add to the total, even with filtering applied.
In practical terms, this slight overestimation does not represent an operational risk. On the contrary, it introduces a conservative margin: by slightly overestimating distance, alerts will tend to be triggered ahead of the real mileage, reducing the risk of the user exceeding the critical oil change or component replacement interval. Consequently, the GPS module meets the prototype’s primary requirement: delivering a consistent and sufficiently precise measurement to trigger mileage-based maintenance thresholds.
3.1.2. Validation of the LTE/GSM Communication Module
The communication subsystem validation aimed to guarantee the prototype’s ability to operate on the current telecommunications infrastructure, prioritizing fast connectivity, link stability, and low latency in alert delivery. Unlike traditional 2G solutions, the module used (A7670SA) allows LTE network operation, which improves performance in environments where 2G coverage is limited or obsolete.
SMS Alert Transmission Latency.
System latency was evaluated through 20 consecutive alert transmissions under standard coverage conditions. Statistical analysis reveals a mean of 4.13 seconds and a standard deviation of 0.63 seconds. As summarized in
Table 1, the maximum recorded value was 5.00 seconds (see detailed log in
Table A4. These results validate compliance with the design requirement (
s), aligning with delivery times reported in the literature for low-cost SMS-based telemetry systems [
23,
24].
To quantify the operational effectiveness of the notification system, a confusion matrix was constructed based on 20 test events (). A “Positive Case” was defined as the condition in which the vehicle effectively reaches the programmed mileage threshold and the system must generate an SMS alert. Results were classified as:
True Positive (TP): The system detected the threshold and correctly sent the SMS.
False Positive (FP): The system sent an alert without the threshold having been reached (false alarm).
False Negative (FN): The system reached the threshold but did not send the alert (detection failure).
True Negative (TN): The maintenance time had not arrived, and the system correctly sent no alert.
From these values, key performance indicators were calculated: Precision (Eq.
3) and Recall/Sensitivity (Eq.
4):
The 100% precision and recall results mathematically validate the reliability of the decision algorithm and the A7670SA communication module, surpassing the success criterion established for critical notification management ().
Figure 2 shows the SMS alert message as received on the vehicle owner’s mobile device, confirming the end-to-end communication chain from the prototype to the user.
3.1.3. Validation of the Data Storage System
The storage module (MicroSD) fulfills a critical function: ensuring information persistence upon power loss and enabling the historical logging of mileage, events, and alerts. Its validation focused on correct hardware initialization, write integrity, and the ability to recover state after abrupt power interruptions.
The storage system was redesigned to fulfill a dual critical function: hosting a static database (DATA.CSV) with the profiles and specific maintenance schedules for various vehicle models, and persisting the user’s dynamic configuration in a local file (CONFIG.TXT). The latter stores the owner’s contact number, selected vehicle, total odometer, and real-time counters for up to 6 independent maintenance intervals.
As shown in the code excerpts (see Listing 2), the system manages structured reading and writing of these parameters. This routine is fundamental for recovering exact information after power cuts or restarts, preventing loss of service history.
System State Recovery.
After restoring power, the system executed the recovery routine from a state file, successfully restoring the last stored mileage. This behavior confirms that the prototype maintains operational continuity and avoids “zero restarts” that would affect monitoring validity. The storage subsystem thus demonstrates robustness for vehicular scenarios, where power-off and power-on events are a normal part of daily operation.
3.1.4. Validation of the Energy and Virtual Ignition System
The power system was validated with two objectives: (i) to ensure that the electronics operate under stable conditions against typical automotive electrical system variations, and (ii) to verify the effectiveness of the voltage-based “virtual ignition” algorithm, avoiding the need for physical connection to the ACC wire and enabling direct connection to the battery terminals (
Figure A4).
Power Supply Stability.
During tests, the voltage regulator maintained a stable 5 V output for inputs up to 14.5 V, a range consistent with automotive operation when the alternator is under load. This result indicates that the regulation stage is adequate for protecting the microcontroller and associated modules against fluctuations in the vehicle’s electrical system.
Engine State Detection by Voltage.
The virtual ignition algorithm correctly discriminated engine states by reading battery voltage using a conversion factor adjusted to 5.7. Clearly differentiated ranges were established to avoid erratic states:
This logic is implemented as a virtual ignition strategy, as shown in Listing 3.
3.2. Field Test Results on Real Routes
To evaluate system performance under real operating conditions, field tests were conducted based on the repetition of representative trajectories (illustrated in
Figure A3) for the most frequent driving scenarios: dense urban environment, mixed peripheral road, and long-distance routes. In each case, the distance traveled calculated by the prototype was directly compared against the vehicle’s odometer reading, considered the operational reference. The obtained results are presented below.
3.2.1. Results on Dense Urban Route
Urban route tests were performed in an environment characterized by heavy traffic, multiple traffic lights, and frequent stops—conditions representing the most demanding scenario for satellite positioning systems due to the urban canyon effect and signal drift in stop-and-go situations.
Route A was defined within the urban center of Guayaquil, characterized by high vehicle flow and frequent traffic lights. The route begins in the south of Guayaquil, departing from the Cangrejo Fútbol sportsbar, and advances northward along Avenida Quito, crossing a large part of the city to the center, where an intermediate stop is made at Picantería “El Sargento Mayor.” For the return, the route descends southward again, first taking Lorenzo de Garaycoa street, then turning onto Vicente Trujillo street, and finally onto Av. Domingo Comin to conclude near the Guayas riverbank, specifically at the Caraguay Market Metrovía stop, as illustrated in
Figure 3.
The average percentage error was 6.45% (overestimation). This deviation is the highest of the three scenarios and is attributed to the “multipath” effect or signal reflection off tall buildings in the city center. This phenomenon introduces “noise” into GPS coordinates, adding phantom extra meters while the vehicle moves slowly or is stopped at traffic lights, generating a count higher than the real distance.
Table 2.
Results: Route A (Dense Urban — 11.0 km).
Table 2.
Results: Route A (Dense Urban — 11.0 km).
| Repetition |
Real Distance (Odometer) |
Prototype Distance |
Deviation (km) |
Error (%) |
| Test A-1 |
11.00 km |
11.67 km |
+0.67 km |
6.09% |
| Test A-2 |
11.00 km |
11.76 km |
+0.76 km |
6.91% |
| Test A-3 |
11.00 km |
11.69 km |
+0.69 km |
6.27% |
| Test A-4 |
11.00 km |
11.73 km |
+0.73 km |
6.64% |
| Test A-5 |
11.00 km |
11.70 km |
+0.70 km |
6.36% |
| AVERAGE |
11.00 km |
11.71 km |
+0.71 km |
6.45% |
3.2.2. Results on Mixed Peripheral Route
The mixed peripheral route corresponds to an intermediate scenario, characterized by moderate speeds (40–60 km/h), fewer stops, and continuous-flow sections. This environment enables evaluation of system behavior when the GPS operates with greater stability and less urban interference.
Route B begins in the southern part of the city, at Persianas Ecuador, and heads northward through Guayaquil primarily via the Vía Perimetral. The route continues to the reference point at Maximetales S.A. Norte, located in the northern sector of the city. From this point, the route returns following the same road axis back to the origin, completing a total round trip of 41 km south–north–south, as shown in
Figure 4.
Results show an average error of 2.08%. The significant reduction in error compared to the urban route (6.45%) confirms that, as building density decreases and average speed increases, the system improves its precision, while maintaining a slight positive tendency.
Table 3.
Results: Route B (Mixed Peripheral — 41.0 km).
Table 3.
Results: Route B (Mixed Peripheral — 41.0 km).
| Repetition |
Real Distance (Odometer) |
Prototype Distance |
Deviation (km) |
Error (%) |
| Test B-1 |
41.00 km |
41.87 km |
+0.87 km |
2.12% |
| Test B-2 |
41.00 km |
41.82 km |
+0.82 km |
2.00% |
| Test B-3 |
41.00 km |
41.86 km |
+0.86 km |
2.10% |
| Test B-4 |
41.00 km |
41.88 km |
+0.88 km |
2.15% |
| Test B-5 |
41.00 km |
41.84 km |
+0.84 km |
2.05% |
| AVERAGE |
41.00 km |
41.85 km |
+0.85 km |
2.08% |
3.2.3. Results on Interurban Routes
Tests in the interurban scenario were carried out on a controlled 32 km route, designed to evaluate behavior at constant cruising speed. The obtained results (
Table 4) show an average deviation of
km, representing a mean error of 3.40%.
Unlike the peripheral route (where the error was lower, 2.08%), in this scenario the sustained constant speed appears to have influenced the systematic accumulation of positive micro-positioning errors. This confirms a consistent tendency of the module to slightly overestimate distances on continuous routes without stops, aligning with the expected positive bias.
Route C begins on the Vía a la Costa highway, at the Delportal supermarket, continues along this main artery to the Chongón entrance (the return point), and finishes at the same starting location, forming a round trip of 32 km, as shown in
Figure 5.
The low dispersion observed confirms that the error does not grow in an uncontrolled manner with increasing distance, but maintains stable proportionality relative to the total traveled. This behavior is indicative of a systematic and predictable drift, characteristic of commercial-grade GNSS systems without differential correction.
From an operational standpoint, this consistency is especially relevant as it allows anticipation of system behavior on extensive routes and validates its use for mileage-based preventive maintenance management.
3.3. Statistical Analysis of Results
3.3.1. Analysis of Accumulated Percentage Error
The consolidation of results reveals a clear pattern: the system overestimates distance in all scenarios. The mean error was 6.45% in urban, 2.08% in peripheral, and 3.40% in interurban routes. The global mean error of the system stands at 3.98%. This consistency in overestimation (Positive Bias) is fundamental for reliability, as it indicates that the error is not random but systematic and predictable.
3.3.2. Comparison Between Satellite and Mechanical Odometry
The discrepancy observed between the odometry calculated by the prototype and the vehicle odometer reading responds to inherent differences between both measurement methods. While the satellite system calculates distance by summing geodetic segments between discrete positions, the mechanical odometer is based on tire rotation, being sensitive to physical factors such as inflation pressure and wear.
In this context, a systematic positive error close to 2.5% falls within acceptable margins for consumer-grade GNSS instrumentation. From a maintenance engineering perspective, this behavior is even favorable, as it introduces a quantifiable operational safety margin: projecting the mean error over a typical 5,000 km maintenance cycle, the system will generate the alert at approximately 4,875 real km, anticipating the intervention and reducing to zero the risk of exceeding the critical component operation limit.
3.3.3. Statistical Validation of Mean Differences
To determine whether the observed difference between the prototype measurement and the vehicle odometer is statistically significant, an inferential analysis was conducted using Minitab software, applied independently for the three test scenarios (Urban, Peripheral, and Interurban routes).
First, the normality assumption was verified using the Shapiro-Wilk test. In all three evaluated scenarios,
p-values
were obtained, indicating that the data follow a normal distribution. Confirming that the data distribution is parametric, the Student’s
t-test was applied. The corresponding normal probability charts are presented in (
Figure A6–
Figure A8).
A paired t-test was applied to compare the means of the distance calculated by the prototype against the odometer reference distance. The analysis was performed under the following hypotheses, with a 95% confidence level ():
Analysis results yielded
for all three evaluated routes (see
Figure A9–
Figure A11)). Since the
p-value is less than the significance level (
), the null hypothesis is rejected in all cases.
Rejection of the null hypothesis (
) confirms that statistically significant differences exist between the measurements. However, this result should not be interpreted as random error, but as the confirmation of systematic behavior: the prototype consistently tends to measure a slightly greater distance than the odometer. This finding statistically validates the trend observed in the samples from all three scenarios (
Table 2,
Table 3 and
Table 4), confirming that the 3.98% average error is attributable to the Positive Bias inherent to GNSS technology and not to chance, which guarantees an operational safety margin for maintenance.
3.4. Discussion of Results and Experimental Conclusions
The comprehensive evaluation of the proposed system, based on unit and field tests conducted, allows analysis not only of the quantitative performance of each subsystem, but also of the overall reliability of the prototype as a support tool for preventive vehicle maintenance management. The results obtained evidence coherent, stable, and technically consistent behavior, adequate for application in light vehicles under real operating conditions.
3.4.1. Consistency and System Reliability
One of the most relevant findings of the study is the measurement system’s consistency, observed across different route typologies and operating conditions. The filtering algorithm implemented in the GPS module, designed to mitigate urban noise and avoid accumulation of micro-displacements when the vehicle is stationary, demonstrated stable performance in demanding scenarios such as dense urban traffic. Despite the presence of frequent stops and signal obstructions, the system maintained a bounded and predictable error, confirming the stability of the filtering algorithm against external perturbations.
Repetition of trajectories under similar conditions allowed verification of measurement repeatability, evidenced by the low dispersion of percentage error between consecutive tests. In particular, in long-distance routes, error variation remained within a narrow range, indicating that the observed deviation is not the product of random fluctuations but of systematic behavior inherent to the satellite measurement method. This characteristic is essential for preventive maintenance applications, where system predictability is a key factor for reliable decision-making.
Taken together, these results validate that the system is not only functional but also reliable over time, preserving its performance under different traffic conditions, speeds, and environments, meeting the technical criteria defined in the methodological phase.
3.4.2. System Operational Safety Margin
Analysis of the impact of the measurement error on maintenance cycles allows evaluation of the system from an operational and reliability engineering perspective. The observed systematic positive error, with a mean value close to 2.5%, implies that the system tends to slightly overestimate the distance traveled. Projecting this behavior over a typical 5,000 km maintenance cycle, the alert would be generated at approximately 4,875 real km, introducing an anticipation margin of approximately 125 km.
This behavior adheres to the “fail-safe” design principle, widely applied in critical systems, where safety is prioritized over absolute precision. In the context of vehicular maintenance, it is preferable for the system to anticipate the need for intervention before the component reaches its critical operating limit, rather than delaying the alert and increasing the risk of excessive wear or mechanical failure.
From this perspective, the observed operational safety margin does not represent a limitation of the system, but a functional advantage, as it protects engine and component integrity regardless of driving style or road conditions. Experimental results consequently confirm that the proposed system fulfills its fundamental objective: optimizing preventive maintenance management through timely, reliable, and safety-oriented alerts.