Now that SpectraMelt is producing accurate compressed samples, the next step is to show how it can be leveraged to improve A2I designs. One way to do this is to produce a new CS recovery method within the simulator that exceeds current, state-of-the practice, traditional iterative CS recovery methods in terms of speed and recovery accuracy. Machine Learning (ML) is a signal processing technique that has exploded in popularity in recent years. The most successful ML technique has been the Artificial Neural Network (ANN) originally developed by psychologist Frank Rosenblatt in 1958 [
16]. While ANNs have been applied to virtually every problem space thanks to the rise of Large Language Models (LLMs), only recently have they been applied to A2I. In 2023, a team from the University of Electronic Science and Technology of China used LLMs to try and classify the compressed output of the NYFR against a group of Radar signal types [
17].
The ANN chosen for implementation within SpectraMelt to decompress NYFR outputs is called the Multilayer Perceptron (MLP). A MLP is a simple feedforward network that maps fixed-size inputs to outputs, while a LLM is built on the transformer architecture with self-attention, enabling it to capture long-range dependencies and contextual relationships in variable-length sequences. The architecture of the MLP implemented here is modeled after a more advanced architecture inspired by sparse Bayesian learning (SBL) called Learned-SBL [
18]. This new network contains an input layer, one hidden layers, and one output layer. Each layer is fully connected with the previous layer. The input layer contains the same number of inputs as the number of samples captured at the simulated output of the NYFR. The hidden and output layer perceptrons all contain the same number outputs as the uncompressed input signal. A toy example with four nodes per layer is shown in
Figure 7
Typical activation functions such as the Rectified Linear Unit (ReLU) are applied to perceptron outputs when the network is performing classification tasks, constraining the value between zero and one. Because the network uses unsupervised training, the output from an MLP layer cannot be constrained this way, leading to the activation function
given by
This means that the output from each layer is just a linear combination of the inputs from the previous layer.
Another consideration is the type of Loss Function used to train the network during back-propagation. Initially, a mean absolute error (MAE) loss function was selected as it calculates the average of the absolute differences between predictions and true values. This seemed in line with the traditional CS principle from eq.
2 where the recovery problem is relaxed to a convex
-minimization problem by setting
. In reality, this spred the error for the training over every output node, resulting in no signal recovery, only output noise. A custom root mean squared error (RMSE) function
given by:
was created for the network to get the desired results.
3.1. Dataset Creation
With a working MLP implementation in place, it was time to create datasets from the NYFR digital twin. These datasets would serve three purposes:
Training data for the new MLP
Signals used for recovery to assess MLP performance verse other CS recovery algorithms
Assess the impact of varying NYFR LO parameters on data recovery
The datasets were created as an extension of the simulator settings found here [
14], with
1MHz,
400Hz,
100Hz,
100Hz,
50Hz,
-2s, and
2s. This sets the number of positive Nyquist Zones
.
Each input dataset was generated from a list of all the possible integer input frequencies that can exsist within the wide-band filter range. In this case, the possible frequencies where , , …, , giving the total number of possible frequencies . Every is comprised of input signals with tones drawn from and taken n at a time with resulting in a total of four sets containing 79800 signals per set. The individual tones within each input signal had random amplitudes between 0.5 and 1 taken from a uniform random variable. The input signals created in these initial datasets are idealized to show functionality of SpectraMelt and quickly compare implemented recovery algorithms. This means that no noise is added to them and signal tones are expressed as linear measures of magnitudes instead of the typical dB.
Recovery algorithms for the NYFR are directly influenced by how the LO parameters are tuned, since these parameters govern the modulation index and resulting frequency zone definitions. Specifically, the modulation index
M uniquely determines the mapping of signals into frequency zones, but it is only valid under the condition that the clock modulation
remains narrowband. This requires the maximum rate of change of
, given by
to be much smaller than
. In practice, this translates to at least two orders of magnitude separation between the modulation deviation
and the local oscillator frequency
. Furthermore, the system is typically constrained such that
, tightly linking the oscillator design to the sampling process and imposing additional structure on the recovery algorithms.
Selection of specific LO parameters within the current literature relies on Monte Carlo simulations to select appropriate values within the constraints given above [
10]. This search was done by first developing some qualitative analysis about LO parameter selection and then using recovery results from a single CS recovery algorithm. Understanding how to select appropriate LO parameters also requires understanding how the LO signal modulation affects the shape of the modulated pulse train
in both time and frequency domains using the analysis performed here [
14]. The modulation frequency
must be tuned to match the size of the zones created by the NYFR with some integer multiple of the width of the LO frequency domain lobes. The matching of lobe widths will reduce mutual coherence between zones, increasing recovery accuracy.
Beyond the analysis and constraints to the LO parameters just described, there is currently no prescription on which specific values to select for
and
given
and
, meaning that some Monte Carlo simulations are still required. On top of that, there has been little analysis to determine if these values are specific only to one selected CS recovery algorithm. SpectraMelt help address these issues by generating
datasets for the NYFR with varying LO parameters of the digital twin. For the system parameters used to create each
, the following list of LO parameters was used to create 16 unique
datasets:
,
,
,
,
. These LO parameters were also used to create CS recovery dictionaries needed for reconstruction based on
Figure 3.
3.2. Compressed Data Recovery
Improvements to
based on comparisons between the actual output of the NYFR Digital Twin
and the approximation given by
was discussed here [
14]. However, this approach is flawed. What is really needed is adjustments based on the initial guess
where
is the pseudoinverse of the NYFR recovery dictionary. Graphical examination of
applied to Digital Twin outputs shows that orientation mismatches are corrected using the pseudoinverse. The magnitude discrepancies are also corrected within iterative CS algorithms by normalizing the ouput
. To correct for magnitude mismatches within the MLP training data and improve reconstruction speed,
is created by pre-multiplying the measurement matrix with a magnitude correction factor to give
. This correction factor was determined by trial and error. An example signal is shown in
Figure 8.
There is a need to systematically compare the performance of this new MLP network against the previous state-of-the-art iterative CS recovery methods. Orthogonal Matching Pursuit (OMP), Spectral Projected Gradient for L1 minimization (SPGL-1), and Iterative Hard Thresholding (IHT) were added to SpectraMelt as the state-of-the-practice methods because of their relative successes in CS recovery. The OMP algorithm used for reconstruction was modified from the original algorithm within the Scikit-Learn Python library to allow for complex valued dictionaries. A custom complex version of IHT was also created based on [
19]. SPGL-1 reconstruction was implemented using the SPGL1 Python library found in the PyPi repository.
The input and output datasets from the previous section have been recovered using four separate CS recovery algorithms incorporated into SpectraMelt: IHT, OMP, SPGL1, and the newly trained MLP network. Several assumptions about the recovery results should be mentioned before discussing the recovery results. One is that the IHT algorithm was given the correct number of unknown tones a priori. This was done for baseline results, as IHT is the oldest of the four algorithms. No other algorithm had this knowledge. Secondly, an individual MLP network was trained per signal set, for a total of four networks. These networks only recovered signals with the corresponding number of tones per signal. This was done because the training of the same MLP on different datasets caused catastrophic forgetting, a well-known limitation of MLPs when trained on tasks sequentially.
For each recovery set, several metrics were used to assess the quality of the recovered signals. In order for a signal tone to be considered recovered, it must first exactly match one of the input tone frequencies. If the magnitude exceeds half of the original tone’s magnitude, then the signal tone is marked as recovered. If any recovered signal also exceeds this threshold but does not match an input tone frequency, it is considered a spur. The average magnitude error of the recovered signals is considered along with the average magnitude of the spurs. The recovery accuracy is found by dividing the number of recovered signals by the total number of input signals. The spur rate divides the total number of spurs by the total number of input signals. An example of signal recovery from each recovery method in SpectraMelt is shown in
Figure 9
One of the broad questions that this work is trying to answer is “What are the specific NYFR LO settings that maximize reconstruction?” From the results obtained by the three iterative algorithms, no effect on signal recovery was seen by varying LO parameters. However, there were variations seen from the MLP recovery results which seemed to favor
. No accompanying variations were seen by different
values with the previous frequency across all datasets. It should be noted that the standard deviation in recovery accuracy between different datasets and LO parameters never exceeded 0.009 from the MLP recovery results. These results together seem to suggest that there is no preferable LO parameter setting as long as the previously stated constraints are held. This matches the previous analysis done showing that
and
jointly constrain the system’s dynamic reconstruction range, balancing signal recovery, zone identification, pulse resolution, and phase-noise limitations [
10].
Table 1 shows the compiled results from the NYFR digital twin simulations using the datasets described in the previous two sections. All reported values are averages over 100 recovered signals. This table shows a clear distinction between the IHT and OMP algorithms. The a priori knowledge given to the IHT improved the average spur rate produce by the algorithm. It did not, however, improve the reconstruction accuracy, as this is the main measure of a selected CS algorithms performance. This shows that the OMP is a better CS algorithm for the NYFR than the IHT. There is also a clear distinction between the two older algorithms, IHT and OMP, versus the newer two, SPGL1 and MLP, in terms of recovery accuracy. Of final note, the MLP networks recovery accuracy is on average about double that from SPGL1, 63.8% vs 38.3%, while almost completely eliminating spurs.