Signals, Volume 5, Issue 3 (September 2024) – 14 articles

In brain–computer interface motor imagery (BCI-MI) systems, convolutional neural networks (CNNs) have traditionally dominated as the deep learning method of choice, demonstrating significant advancements in state-of-the-art studies. Recently, Transformer models with attention mechanisms have emerged as a sophisticated technique, enhancing the capture of long-term dependencies and intricate feature relationships in BCI-MI. This research investigates the performance of EEG-TCNet and EEG-Conformer models, which are trained and validated using various hyperparameters and bandpass filters during preprocessing to assess improvements in model accuracy. Additionally, this study introduces EEG-TCNTransformer, a novel model that integrates the convolutional architecture of EEG-TCNet with a series of self-attention blocks employing a multi-head structure. EEG-TCNTransformer achieves an accuracy of 83.41% without the application of bandpass filtering. Full article

EEG-based biometrics represent a relatively recent research field that aims to recognize individuals based on their recorded brain activity using electroencephalography (EEG). Among the numerous features that have been proposed, connectivity-based approaches represent one of the more promising methods tested so far. In this paper, using the phase lag index (PLI) and the phase locking value (PLV) methods, we investigate how the performance of a connectivity-based EEG biometric system varies with respect to different time windows (using epochs of different lengths ranging from 0.5 s to 12 s with a step of 0.5 s) to understand if it is possible to define the optimal duration of the EEG signal required to extract those distinctive features. All the analyses were performed on two freely available EEG datasets, including 109 and 23 subjects, respectively. Overall, as expected, the results have shown a pronounced effect of the time window length on the biometric performance measured in terms of EER (equal error rate) and AUC (area under the curve), with an evident increase in the biometric performance as the time window increases. Furthermore, our initial findings strongly suggest that enlarging the window size beyond a specific maximum threshold fails to enhance the performance of biometric systems. In conclusions, we want to highlight that EEG connectivity has the potential to represent an optimal candidate as an EEG fingerprint and that, in this context, it is essential to establish an adequate time window capable of capturing subject-specific features. Furthermore, we speculate that the poor performance obtained with short time windows mainly depends on the difficulty of correctly estimating the connectivity metrics from very small EEG epochs (shorter than 8 s). Full article

Due to the escalating network throughput and security risks, the exploration of intrusion detection systems (IDSs) has garnered significant attention within the computer science field. The majority of modern IDSs are constructed using deep learning techniques. Nevertheless, these IDSs still have shortcomings where most datasets used for IDS lies in their high imbalance, where the volume of samples representing normal traffic significantly outweighs those representing attack traffic. This imbalance issue restricts the performance of deep learning classifiers for minority classes, as it can bias the classifier in favor of the majority class. To address this challenge, many solutions are proposed in the literature. TDCGAN is an innovative Generative Adversarial Network (GAN) based on a model-driven approach used to address imbalanced data in the IDS dataset. This paper investigates the performance of TDCGAN by employing it to balance data across four benchmark IDS datasets which are CIC-IDS2017, CSE-CIC-IDS2018, KDD-cup 99, and BOT-IOT. Next, four machine learning methods are employed to classify the data, both on the imbalanced dataset and on the balanced dataset. A comparison is then conducted between the results obtained from each to identify the impact of having an imbalanced dataset on classification accuracy. The results demonstrated a notable enhancement in the classification accuracy for each classifier after the implementation of the TDCGAN model for data balancing. Full article

Deep learning models, particularly transformer architectures, have revolutionized various computer vision tasks, including image classification. However, their performance under different types and levels of noise remains a crucial area of investigation. In this study, we explore the noise sensitivity of prominent transformer models trained on the ImageNet dataset. We systematically evaluate 22 transformer variants, ranging from state-of-the-art large-scale models to compact versions tailored for mobile applications, under five common types of image distortions. Our findings reveal diverse sensitivities across different transformer architectures, with notable variations in performance observed under additive Gaussian noise, multiplicative Gaussian noise, Gaussian blur, salt-and-pepper noise, and JPEG compression. Interestingly, we observe a consistent robustness of transformer models to JPEG compression, with top-5 accuracies exhibiting higher resilience to noise compared to top-1 accuracies. Furthermore, our analysis highlights the vulnerability of mobile-oriented transformer variants to various noise types, underscoring the importance of noise robustness considerations in model design and deployment for real-world applications. These insights contribute to a deeper understanding of transformer model behavior under noisy conditions and have implications for improving the robustness and reliability of deep learning systems in practical scenarios. Full article

Rainfall information with high spatial and temporal resolution are essential in various fields. Heavy rainfall in a short period can cause problems and disasters that result in loss of life and damage to property. Conversely, the absence of rain for an extended period can also have negative social and economic impacts. Data accuracy, wide spatial coverage, and high temporal resolution are challenges in obtaining rainfall information in Indonesia. This article presents information on data sources and methods for measuring rainfall and reviews the latest research regarding statistical algorithms and machine learning to estimate rainfall in Indonesia. Rainfall information in Indonesia was obtained from several sources. Firstly, the method of direct rainfall measurement conducted with both manual and automatic rain gauges was reviewed; however, this data source provided minimal results, with uneven spatial density. Secondly, the application of remote sensing estimation using both radar and weather satellites was reviewed. The estimated rainfall results obtained using remote sensing showed more comprehensive spatial coverage and higher temporal resolution. Finally, we reviewed rainfall products obtained from model calculations, using both statistical and machine learning by integrating measurement and remote sensing data. The results of the review demonstrated that rainfall estimation products applied in remote sensing using machine learning models have the potential to produce more accurate spatial and temporal data. However, the validation of rainfall data from direct measurements is required first. This research’s contribution can provide practitioners and researchers in Indonesia and the surrounding region with information on problems, challenges, and recommendations for optimizing rainfall measurement products using appropriate adaptive technology. Full article

The goal of this study is to explore the effectiveness of applying multi-objective particle swarm optimization (MOPSO) algorithms in the design of infinite impulse response (IIR) filters. Given the widespread application of IIR filters in digital signal processing, the precision of their design plays a significant role in the system’s performance. Traditional design methods often encounter the problem of local optima, which limits further enhancement of the filter’s performance. This research proposes a method based on multi-objective particle swarm optimization algorithms, aiming not just to find the local optima but to identify the optimal global design parameters for the filters. The design methodology section will provide a detailed introduction to the application of multi-objective particle swarm optimization algorithms in the IIR filter design process, including particle initialization, velocity and position updates, and the definition of objective functions. Through multiple experiments using Butterworth and Chebyshev Type I filters as prototypes, as well as examining the differences in the performance among these filters in low-pass, high-pass, and band-pass configurations, this study compares their efficiencies. The minimum mean square error (MMSE) of this study reached 1.83, the mean error (ME) reached 2.34, and the standard deviation (SD) reached 0.03, which is better than the references. In summary, this research demonstrates that multi-objective particle swarm optimization algorithms are an effective and practical approach in the design of IIR filters. Full article

Swallowing is a complex neuromuscular activity regulated by the autonomic central nervous system, and impairment can lead to dysphagia, which is difficulty in swallowing. This research presents a novel approach that utilizes wireless, wearable technology for the continuous mechano-acoustic tracking of respiratory activities and swallowing. To address the challenge of accurately tracking swallowing amidst potential confounding activities or significant body movements, we employ two accelerometers. These accelerometers help distinguish between genuine swallowing events and other activities. By monitoring movements and vibrations through the skin surface, the developed device enables non-intrusive monitoring of swallowing dynamics and respiratory patterns. Our focus is on the development of both the wireless skin-interfaced device and an advanced algorithm capable of detecting swallowing dynamics in conjunction with respiratory phases. The device and algorithm demonstrate robustness in detecting respiratory patterns and swallowing instances, even in scenarios where users exhibit periodic movements due to disease or daily activities. Furthermore, peak detection using an adaptive threshold automatically adjusts to an individual’s signal strength, facilitating the detection of swallowing signals without the need for individual adjustments. This innovation has significant potential for enhancing patient training and rehabilitation programs aimed at addressing dysphagia and related respiratory issues. Full article

In this project, the electroencephalogram (EEG) channel(s) is used to better characterize post-traumatic stress disorder (PTSD). For this aim, we applied boosting methods along with a combination of k-means and Support Vector Machine (SVM) models to find the diagnostic channels of PTSD cases and healthy subjects. We grouped 32 channels and 12 subjects (6 PTSD and 6 healthy controls) using k-means. Channels of the brain are grouped by the k-means clustering method to find the most similar part of the brain. This approach uses SVM by performing classification based on cluster classes are been mapped to EEG channels. This mapping uses information across all samples without the bias of using the outcome variable. The linear SVM found weights that distinguished channels within each subject for each cluster to compare the PTSD cases and healthy controls’ channel weights. It was found that the significant SVM weights of F4, F8, and Pz were smaller in subjects with PTSD than in healthy subjects. This new method can be used as a tool to better understand the relationship between EEG signals and diagnosis. Full article

Acute psychological stress (APS) is a complex and multifactorial phenomenon that affects metabolism, necessitating real-time detection and interventions to mitigate its effects on glycemia in people with type 1 diabetes. This study investigates the detection of APS using physiological variables measured by the Empatica E4 wristband and employs explainable machine learning to evaluate the importance of the physiological signals. The extreme gradient boosting model is developed for classification of APS and non-stress (NS) with weighted training, achieving an overall accuracy of 99.93%. The Shapley additive explanations (SHAP) technique is employed to interpret the global importance of the physiological signals, determining the order of importance for the variables from most to least as galvanic skin response (GSR), heart rate (HR), skin temperature (ST), and motion sensors (accelerometer readings). The increase in GSR and HR are positively correlated with the occurrence of APS as indicated by high positive SHAP values. The SHAP technique is also used to explain the local signal importance for particular instances of misclassified samples. The detection of APS can inform multivariable automated insulin delivery systems to intervene to counteract the APS-induced glycemic excursions in people with type 1 diabetes. Full article

The development of robust circuit structures remains a pivotal milestone in electronic device research. This article proposes an integrated hardware–software system designed for the acquisition, processing, and analysis of surface electromyographic (sEMG) signals. The system analyzes sEMG signals to understand muscle function and neuromuscular control, employing convolutional neural networks (CNNs) for pattern recognition. The electrical signals analyzed on healthy and unhealthy subjects are acquired using a meticulously developed integrated circuit system featuring biopotential acquisition electrodes. The signals captured in the database are extracted, classified, and interpreted by the application of CNNs with the aim of identifying patterns indicative of neuromuscular problems. By leveraging advanced learning techniques, the proposed method addresses the non-stationary nature of sEMG recordings and mitigates cross-talk effects commonly observed in electrical interference patterns captured by surface sensors. The integration of an AI algorithm with the signal acquisition device enhances the qualitative outcomes by eliminating redundant information. CNNs reveals their effectiveness in accurately deciphering complex data patterns from sEMG signals, identifying subjects with neuromuscular problems with high precision. This paper contributes to the landscape of biomedical research, advocating for the integration of advanced computational techniques to unravel complex physiological phenomena and enhance the utility of sEMG signal analysis. Full article

A basic tenet of linear invariant systems is that they are sufficiently described by either the impulse response function or the frequency transfer function. This implies that we can always obtain one from the other. However, when the transfer function contains uncanceled poles, the impulse function cannot be obtained by the standard inverse Fourier transform method. Specifically, when the input consists of a uniform train of pulses and the output sequence has a finite duration, the transfer function contains multiple poles on the unit cycle. We show how the impulse function can be obtained from the frequency transfer function for such marginally stable systems. We discuss three interesting discrete Fourier transform pairs that are used in demonstrating the equivalence of the impulse response and transfer functions for such systems. The Fourier transform pairs can be used to yield various trigonometric sums involving $\frac{\mathrm{s}\mathrm{i}\mathrm{n}\left(\pi k/N\right)}{\mathrm{s}\mathrm{i}\mathrm{n}\left(\pi Lk/N\right)}$, where k is the integer summing variable and N is a multiple of integer L. Full article

This paper addresses the problem of noncooperative spectrum sensing in very low signal-to-noise ratio (SNR) conditions. In our approach, detecting an unoccupied bandwidth consists of detecting the presence or absence of a communication signal on this bandwidth. Digital communication signals may contain hidden periodicities, so we use Recurrence Quantification Analysis (RQA) to reveal the hidden periodicities. RQA is very sensitive and offers reliable estimation of the phase space dimension m or the time delay $\tau$. In view of the limitations of the algorithms proposed in the literature, we have proposed a new algorithm to simultaneously estimate the optimal values of m and $\tau$. The new proposed optimal values allow the state reconstruction of the observed signal and then the estimation of the distance matrix. This distance matrix has particular properties that we have exploited to propose a Recurrence-Analysis-based Detector (RAD). The RAD can detect a communication signal in a very low SNR condition. Using Receiver Operating Characteristic curves, our experimental results corroborate the robustness of our proposed algorithm compared with classic widely used algorithms. Full article

Toeplitz matrix–vector products are used in many digital signal processing applications. Direct methods for calculating such products require $N^2$ multiplications and $N(N-1)$ additions, where N denotes the order of the Toeplitz matrix. In the case of large matrices, this operation becomes especially time intensive. However, matrix–vector products with small-order Toeplitz matrices are of particular interest because small matrices often serve as kernels in modern digital signal processing algorithms. Perhaps reducing the number of arithmetic operations when calculating matrix–vector products in the case of small Toeplitz matrices gives less effect than of large ones, but this problem exists, and it needs to be solved. The traditional way to calculate such products is to use the fast Fourier transform algorithm. However, in the case of small-order matrices, it is advisable to use direct factorization of Toeplitz matrices, which leads to a reduction in arithmetic complexity. In this paper, we propose a set of reduced-complexity algorithms for calculating matrix–vector products with Toeplitz matrices of order $N=3,4,5,6,7,8,9$. The main emphasis will be on reducing multiplicative complexity since multiplication in most cases is more time-consuming than addition. This paper also provides assessments of the implementation of the developed algorithms on FPGAs. Full article