Based on the Bayesian decision theory and Neyman-Pearson criteria, as well as with the minimum required false detection, pFA, the statistical detector is not allowed to exceed the preset value of pFA. In other words, at pFA = 10–3 maximum 1 false threshold detection is allowed from 1000 CUTs investigated.
2.1. Statistical Threshold Calculation
The calculation of the statistical threshold
τ uses statistical characteristics of the additive mixture of the signal and background noise. This comprises the mean
μK and the standard deviation
σK. Both characteristics are calculated from the fixed number of
K cells from the left and the right sub-windows. This can be called
K-sized population sampling around the CUT. By default, a symmetric
K-size window is chosen due to the typical symmetric Gaussian shape of the reflected FBG power spectra peaks [
8,
9,
10,
11]. The size of
K depends on properties of FBGs, including the FBG bandwidth
BFBG, sensing interrogator resolution
δsens, and the effects of attenuation. In the following example, let assume
BFBG = 0.8 nm and
δsens = 0.008 nm. Thus, the above-threshold power can be approximated from
M discrete wavelength steps as
M ≅
BFBG /
δsens = 100. As a rule, it is recommended to keep
K ≅
M.
First, the calculated threshold τ has to contain the noise function fSMF describing attenuation approximation of the single-mode fiber (SMF-28). Second, an instrumental error function εinstr should be included. The εinstr is a sum of all instrumentation errors, and includes fluctuations in the wavelength discretization, quantization, deviations or offsets due to internal or external environmental changes. Generally, both functions are long-term stabilized, assuming stable operating conditions of the optical fiber and the FBG sensing interrogator.
Next, the calculation of τ has to include the required pFA (for example, pFA = ×10–3 … ×10–6). The smaller the pFA, the higher values of τ can be achieved. However, the threshold values should range from the minimum value slightly above the background noise energy Emin up to the maximum expected value of the additive mixture Emax (the FBG power spectra peak value with a background noise). Due to the above, the pFA is parameterized in the range from Emin to Emax. For large sampling populations, a full parametrization is required typically, and is equal to 1. However, for decreasing K-size, the pFA is parameterized with lower weights. The condition K < M allows for the adequate weakening of the pFA parametrization.
Finally, the calculated threshold τ has to include the additive mixture (N0 + ES)k obtained in the given kth CUT. This value should be weighted by both the mean μK and the standard deviation σK. Both are obtained from the K-size population sampling within the sliding window. If the K-size is reduced, the accuracy deteriorates and the parametrization of the (N0 + ES)k value is weakened accordingly. On the contrary, the increased standard deviation increases the contribution of the additive mixture in the calculation of τ.
To conclude, the parameterized
pFA and (
N0 +
ES)
k, will affect the fast dynamic adaptation of the threshold
τ. The calculation of the threshold
τ is given by the Eq. 1:
where
G is the number of guard cells in the neighborhood of the CUT that do not participate in the threshold calculation. In general, the more guard cells, the smaller the weight of the parameterized
pFA.
2.2. Experimental Demonstration and Results
The non-linear attenuation of the used optical fiber (G.652. D SMF) and the creation of the approximate broadband
fSMF attenuation function is described in [
21]. In the experimental demonstration, various optical fiber lengths are considered, representing the range of attenuation between – 1 ... – 45 dB. Several FBG optical sensors with a bandwidth of
BFBG ≅ 0.8 nm and maximum attenuation of – 20 dB at the resonant wavelength
λFBG are connected to optical fiber.
The digitized additive mixture of the signal and background noise (in the spectral domain) are continuously processed in the predefined wavelength sliding window of different
K sizes. This sliding window systematically shifts and
μK,
σK and
τ are dynamically calculated (Eq. 1) for each of the
CUTk, see
Figure 3. The
G neighboring guard cells are excluded from
μK,
σK and
τ computing.
In next subsections 2.2.1 and 2.2.2, different threshold values τ will be determined and investigated for different values of pFA for a different FBG power spectra peaks and the presence of the background noise.
The interrogator processes discrete power values for each discrete wavelength in the presence of the quantization noise. To compare different effects of instrumental distortion, a commercial interrogator and a table-top analyzer with a different wavelength resolution are used in experimental investigations.
2.2.1. Experimental Investigation of Two-Sided Small Population Sampling Using Interrogator
The commercial interrogator Sylex S-line S-400 [
22] was used in this study, having the wavelength resolution of
δsens = 0.08 nm. Because of slightly changing
BFBG under the influence of fluctuating noise, the sampling with
M = 9 ... 13 discrete values and
BFBG ≅ 0.8 nm was selected. Four FBG sensors (A, B, C and D) were deployed within the C-band. The experimental results for various detection thresholds are shown in
Figure 4. In addition, interfering spectra with ten times narrower FBG bandwidths (I to X) were implemented to demonstrate the advantage of dynamic thresholds adaptation. The variety of detection conditions due to partial overlap of FBG power spectra, their varying density distribution were investigated. Results are shown in
Figure 4.
Due to a rapidly rising or descending σK at FBG power spectra peaks edges, the dynamic threshold “shakes”, especially when K = 8. In this case, the method is not appropriate for denoising threshold detection. However, the results for K = 10 or K = 12 indicate already adapted threshold τ to the additive mixture of signals and fluctuated background noise (see Eq. 1). Despite “shaky” thresholds can be also seen here, they are ~ 0.5 to 1.5 dB respectively above the background noise, and therefore the statistical detection of FBG power spectra peaks levels become more reliable. A further increase in K over M result in “shakeless” and increased τ values, thus yielding a safer detection of FBG power spectra. Therefore, the recommended setting is K ≅ M.
2.2.2. Experimental Investigation of Two-Sided Small Population Sampling Using Table-Top Analyzer
The analyzer AQ6370C [
23] is used to process the transmitted power spectra with oversampled wavelength resolution of
δsens = 0.0035 nm. Here, the sampling is done with discrete values of
M = 90 ... 120 and
BFBG ≅ 0.8 nm. Within the C-band, four FBG sensors (A, B, C and D) in the C-band are used. The results of various detection thresholds scenarios are shown in
Figure 5. Here, the attenuation of the optical fiber was assumed – 35 dB with the highly fluctuated background noise (
σK N0 ≅ 4.3 dB) and input power with of
SNRin ≅ 8.5 dB. Despite of these unfavorable conditions, detectability and adaptability of
τ are improved, compared to the previous case study.
As in the previous case study described in section 2.2.1, thresholds τ are also “shaky” for the same reasons. However, for M = 90 ... 120 and K = 8 ... 60, results obtained are significantly better despite those unfavorable detection conditions. Surprisingly, even for K = 12 or K = 16, the threshold detection results are acceptable and are comparable to the previous results in section 2.2.1 for K ≅ M.
In
Figure 5 can be noted a sudden / significant drop in the threshold values
τ in the close proximity of the FBG power spectra peaks. The deeper the drop of threshold values (especially when
K is much less than
M), the higher is the difference which is helping to improve the SNR. This value differences are illustrated in
Figure 6.
In
Figure 6 (a),
pFA ≈ 10
—3 and
K = 10, a random low level false detection occurred for power levels below 1.2 dB. This effect was well suppressed for
K = 12 and the detected FBG power level spectra doubled approaching 7 dB. When
K = 16 … 32, FBG power spectra peaks levels are reliable detected without false detection.
When
pFA ≈ 10
—4 (case
Figure 6 (b)), all thresholds rise to their higher level. As a consequence, no false detections was observed for
K = 12 and. Only a few false detections occurred for
K = 10. Similarly,
K = 16 … 32 allowed to maintain reliable detection of the FBG power spectra peaks levels without false detections. However, the highest level of
K = 60 (the strictest threshold) causes the FBG detection loss.
2.3. Threshold Behavior Analysis and Discussion
In this subsection, a mathematical analysis of the threshold calculation is presented and implications for the detection of the FBG power spectra peaks are derived.
Let us first analyze the parameterization of the 3rd component of Eq 1. We assume a typical FBG power attenuation ranging in interval (
Emax …
Emin) = 20 dB and a typical maximum value of
pFA ≤ 10
– 3. As a result, the 3rd component in Eq. 1 ranges from – 1.45 to – 2.8 dB for the population sampling
K = 4 ... 60, and assuming 1 guard cell adjacent to the CUT in each of sub-windows:
If K = 60, the 3rd component parametrization is equal to – 2.8 and will cause reduced threshold τ. On the contrary, for K = 4, the 3rd component parametrization is equal to –1.45 and will cause an increased τ, see Eq. 1. This property can be used to set the value of τ which will be used later.
Next the 4th component in Eq.1 will be analyzed in the presence of background noise only ((
N0 +
ES)
k =
N0k). Here,
K value affects the threshold calculation through changes of statistical characteristics of
μK and
σK as follows:
Finally, the total contribution of the 4th component to the threshold calculation of Eq. 1 without the occurrence of FBG power spectra peak is:
From the above it can be shown that approximately 3-fold increase in contribution of the 4th component (from 0.002253 in case of K = 60 to 0.006747 in case of K = 30, respectively) can be achieved, thus contributing to the threshold level increases.
Let’s now analyze the μK-parameterization of (N0 + ES)k in Eq. 1 when the approximately Gaussian shaped FBG power spectra peak overlaps with the sliding window. Using the example from section 2.2.1, and using K = M/2 ≅ 60, the mean values keep increasing from the lowest to the highest values just in 30 wavelength steps. At the 60th step, where CUTk contains the FBG power spectra peak maxima, the two-sided sampling reaches the value μK=60 ≅ 2 ∙ 0.25 ∙ (Emax … Emin) above the N0 noise level. When the sliding window touches the falling edge of the FBG power spectra peak and starts to leave it, the mean value μK starts decreasing. However, for M/2 ≅ 60 and K = 30, the behavior of the mean values will remain mostly unchanged. To be noted, for the 60th step the shorter the sliding window, the higher mean value μK. When K=10, μK=10 ≅ 0.707 ∙ (Emax … Emin).
Now we analyze the
σK-parameterization of (
N0 +
ES)
k in Eq. 1 when the approximately Gaussian shaped FBG power spectra peak overlaps with the sliding window. This is shown in
Figure 7 (b). For
K =
M/2 ≅ 60, the standard deviation values achieve the highest values in ~ 30th and ~ 90th step. Here, the square root multiplier in Eq. 4 achieves the widest span of input values. It is worth noting that the
σK-parametrization on the leading and falling edges can reach similar effects as the
μK-parametrization. This depends on the steepness of edges. When the sampling window slides from 30th to 90th step, the
σK value drops. For
M ≅ 60 and
K = 30, the behavior of the standard deviation values will be similar to the case of
K =
M/2 ≅ 60. To be noted, the longer the sliding window, the larger is the standard deviation
σK. This is the origin of threshold adaptability.
Finally, a comparison of the magnitudes
μK and
σK in
Figure 7 points out the impossibility of meeting the empirical three-sigma rule (known also as the 68-95-99.7 rule) which is used to verify the normality of population sampling. In spite of this, the use of two-sided small population sampling is reliable for successful statistical threshold detection. This was illustrated by results in
Figure 4,
Figure 5 and
Figure 6.