AI and Data-Driven Advancements in Industry 4.0

Abstract submission deadline

closed (30 June 2024)

Manuscript submission deadline

closed (30 September 2024)

Viewed by

128615

Topic Information

Dear Colleagues,

Our society is filled with various modalities of data: pictures, words, voices, videos, remote-sensing images, and more. Data-driven artificial intelligence brings the promise of deriving meaning from all of that data to us and has opened extraordinary theoretic and application-based opportunities. In recent years, abundant theories and algorithms are proposed, trusted, and utilized to finance, security, healthcare, education, sustainability, neuroscience, sports, et al. Motivated by these discoveries, substantial AI-based techniques are applied in various domains, such as medical image analysis, virtual reality, human-computer interaction, remote-sensing representations, et al.

This topic aims to gather and showcase the most recent advances in the areas of next-generation artificial intelligence and Industry 4.0 applications. Our interest is in the whole spectrum of big data and artificial intelligence research in diversified domains, including sophisticated framework design, training strategy, optimization, trusted and robust, and the corresponding applications. Topic contents include (but are not limited to):

• computer vision, natural language processing, reinforcement learning
• multi-modal learning, object recognition, detection, segmentation, and tracking
• graph neural network, knowledge graph, recommendation system
• pattern recognition and intelligent system
• blockchain theory or application
• artificial intelligence security, data security and privacy
• trusted data sharing, digital intellectual property protection
• bioinformatics, medical image analysis and processing
• remote sensing image interpretation
• virtual reality, robotics, medical artificial intelligence

Dr. Teng Huang
Prof. Dr. Qiong Wang
Dr. Yan Pang
Topic Editors

Keywords

Participating Journals

Journal Name	Impact Factor	CiteScore	Launched Year	First Decision (median)	APC
Remote Sensing remotesensing	4.2	8.3	2009	23.9 Days	CHF 2700
Cancers cancers	4.5	8.0	2009	17.4 Days	CHF 2900
Mathematics mathematics	2.3	4.0	2013	18.3 Days	CHF 2600
Sensors sensors	3.4	7.3	2001	18.6 Days	CHF 2600
Electronics electronics	2.6	5.3	2012	16.4 Days	CHF 2400

MDPI Topics is cooperating with Preprints.org and has built a direct connection between MDPI journals and Preprints.org. Authors are encouraged to enjoy the benefits by posting a preprint at Preprints.org prior to publication:

1. Immediately share your ideas ahead of publication and establish your research priority;
2. Protect your idea from being stolen with this time-stamped preprint article;
3. Enhance the exposure and impact of your research;
4. Receive feedback from your peers in advance;
5. Have it indexed in Web of Science (Preprint Citation Index), Google Scholar, Crossref, SHARE, PrePubMed, Scilit and Europe PMC.

Related Topic

Published Papers (65 papers)

Order results

Content type Publication Date

Result details

Normal Extended Compact

Journals

All Remote Sensing Cancers Mathematics Sensors Electronics

Show export options expand_more Show export options expand_less

Select all

Export citation of selected articles as:

Plain Text BibTeX BibTeX (without abstracts) Endnote Endnote (without abstracts) Tab-delimited RIS

Error

Oops... you haven't selected anything for export.

Ok

clear

17 pages, 11721 KiB  

Open AccessArticle

Machine Learning-Based Prediction of Well Logs Guided by Rock Physics and Its Interpretation

by Ji Zhang, Guiping Liu, Zhen Wei, Shengge Li, Yeheya Zayier and Yuanfeng Cheng

Sensors 2025, 25(3), 836; https://doi.org/10.3390/s25030836 - 30 Jan 2025

Viewed by 595

Abstract

The refinement of acquired well logs has traditionally relied on predefined rock physics models, albeit with their inherent limitations and assumptions. As an alternative, effective yet less explicit machine learning (ML) techniques have emerged. The integration of these two methodologies presents a promising [...] Read more.

The refinement of acquired well logs has traditionally relied on predefined rock physics models, albeit with their inherent limitations and assumptions. As an alternative, effective yet less explicit machine learning (ML) techniques have emerged. The integration of these two methodologies presents a promising new avenue. In our study, we used four ML algorithms: Random Forests (RF), Gradient Boosting Decision Trees (GBDT), Multilayer Perceptrons (MLP), and Linear Regression (LR), to predict porosity and clay volume fraction from well logs. Throughout the entire workflow, from feature engineering to outcome interpretation, our predictions are guided by rock physics principles, particularly the Gardner relations and the Larionov relations. Remarkably, while the predictions themselves are satisfactory, SHapley Additive exPlanations (SHAP) analysis uncovers consistent patterns across the four algorithms, irrespective of their distinct underlying structures. By juxtaposing the SHAP explanations with rock physics concepts, we discover that all four algorithms align closely with rock physics principles, adhering to its cause–effect relationships. Nonetheless, even after intentionally excluding crucial controlling input features that would inherently compromise prediction accuracy, all four ML algorithms and the SHAP analysis continue to operate, albeit in a manner that seems irrational and starkly contradicts the fundamental principles of rock physics. This integration strategy facilitates a transition from solely mathematical explanations to a more philosophical interpretation of ML-based predictions, effectively dismantling the traditional black box nature of these ML models. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Graphical abstract

18 pages, 1624 KiB  

Open AccessArticle

Beyond Information Distortion: Imaging Variable-Length Time Series Data for Classification

by Hyeonsu Lee and Dongmin Shin

Sensors 2025, 25(3), 621; https://doi.org/10.3390/s25030621 - 21 Jan 2025

Viewed by 440

Abstract

Time series data are prevalent in diverse fields such as manufacturing and sensor-based human activity recognition. In real-world applications, these data are often collected with variable sample lengths, which can pose challenges for classification models that typically require fixed-length inputs. Existing approaches either [...] Read more.

Time series data are prevalent in diverse fields such as manufacturing and sensor-based human activity recognition. In real-world applications, these data are often collected with variable sample lengths, which can pose challenges for classification models that typically require fixed-length inputs. Existing approaches either employ models designed to handle variable input sizes or standardize sample lengths before applying models; however, we contend that these approaches may compromise data integrity and ultimately reduce model performance. To address this issue, we propose Time series Into Pixels (TIP), an intuitive yet strong method that maps each time series data point into a pixel in 2D representation, where the vertical axis represents time steps and the horizontal axis captures the value at each timestamp. To evaluate our representation without relying on a powerful vision model as a backbone, we employ a straightforward LeNet-like 2D CNN model. Through extensive evaluations against 10 baseline models across 11 real-world benchmarks, TIP achieves 2–5% higher accuracy and 10–25% higher macro average precision. We also demonstrate that TIP performs comparably on complex multivariate data, with ablation studies underscoring the potential hazard of length normalization techniques in variable-length scenarios. We believe this method provides a significant advancement for handling variable-length time series data in real-world applications. The code is publicly available. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

22 pages, 1948 KiB  

Open AccessArticle

Intelligent Sensor Software for Robust and Energy-Sustainable Decision-Making in Welding of Steel Reinforcement for Concrete

by Javier Ferreiro-Cabello, Francisco Javier Martinez-de-Pison, Esteban Fraile-Garcia, Alpha Pernia-Espinoza and Jose Divasón

Sensors 2025, 25(1), 28; https://doi.org/10.3390/s25010028 - 24 Dec 2024

Viewed by 436

Abstract

In today’s industrial landscape, optimizing energy consumption, reducing production times, and maintaining quality standards are critical challenges, particularly in energy-intensive processes like resistance spot welding (RSW). This study introduces an intelligent decision support system designed to optimize the RSW process for steel reinforcement [...] Read more.

In today’s industrial landscape, optimizing energy consumption, reducing production times, and maintaining quality standards are critical challenges, particularly in energy-intensive processes like resistance spot welding (RSW). This study introduces an intelligent decision support system designed to optimize the RSW process for steel reinforcement bars. By creating robust machine learning models trained on limited datasets, the system generates interactive heat maps that provide real-time guidance to production engineers or intelligent systems, enabling dynamic adaptation to changing conditions and external factors such as fluctuating energy costs. These heat maps serve as a flexible and intuitive tool for identifying robust operational points that balance quality, energy efficiency, and productivity. The proposed methodology advances decision-making in welding processes by combining robust predictive modeling with innovative visualization techniques, offering a versatile solution for multiobjective optimization in real-world industrial applications. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

29 pages, 1251 KiB  

Open AccessArticle

Exploring Kink Solitons in the Context of Klein–Gordon Equations via the Extended Direct Algebraic Method

by Saleh Alshammari, Othman Abdullah Almatroud, Mohammad Alshammari, Hamzeh Zureigat and M. Mossa Al-Sawalha

Mathematics 2024, 12(21), 3433; https://doi.org/10.3390/math12213433 - 2 Nov 2024

Viewed by 982

Abstract

This work employs the Extended Direct Algebraic Method (EDAM) to solve quadratic and cubic nonlinear Klein–Gordon Equations (KGEs), which are standard models in particle and quantum physics that describe the dynamics of scaler particles with spin zero in the framework of Einstein’s theory [...] Read more.

This work employs the Extended Direct Algebraic Method (EDAM) to solve quadratic and cubic nonlinear Klein–Gordon Equations (KGEs), which are standard models in particle and quantum physics that describe the dynamics of scaler particles with spin zero in the framework of Einstein’s theory of relativity. By applying variables-based wave transformations, the targeted KGEs are converted into Nonlinear Ordinary Differential Equations (NODEs). The resultant NODEs are subsequently reduced to a set of nonlinear algebraic equations through the assumption of series-based solutions for them. New families of soliton solutions are obtained in the form of hyperbolic, trigonometric, exponential and rational functions when these systems are solved using Maple. A few soliton solutions are considered for certain values of the given parameters with the help of contour and 3D plots, which indicate that the solitons exist in the form of dark kink, hump kink, lump-like kink, bright kink and cuspon kink solitons. These soliton solutions are relevant to actual physics, for instance, in the context of particle physics and theories of quantum fields. These solutions are useful also for the enhancement of our understanding of the basic particle interactions and wave dynamics at all levels of physics, including but not limited to cosmology, compact matter physics and nonlinear optics. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

17 pages, 919 KiB  

Open AccessArticle

Exploring the Diversity of Kink Solitons in (3+1)-Dimensional Wazwaz–Benjamin–Bona–Mahony Equation

by Musawa Yahya Almusawa and Hassan Almusawa

Mathematics 2024, 12(21), 3340; https://doi.org/10.3390/math12213340 - 24 Oct 2024

Viewed by 620

Abstract

The Wazwaz–Benjamin–Bona–Mahony (WBBM) equation is a well-known regularized long-wave model that examines the propagation kinematics of water waves. The current work employs an effective approach, called the Riccati Modified Extended Simple Equation Method (RMESEM), to effectively and precisely derive the propagating soliton solutions [...] Read more.

The Wazwaz–Benjamin–Bona–Mahony (WBBM) equation is a well-known regularized long-wave model that examines the propagation kinematics of water waves. The current work employs an effective approach, called the Riccati Modified Extended Simple Equation Method (RMESEM), to effectively and precisely derive the propagating soliton solutions to the (3+1)-dimensional WBBM equation. By using this upgraded approach, we are able to find a greater diversity of families of propagating soliton solutions for the WBBM model in the form of exponential, rational, hyperbolic, periodic, and rational hyperbolic functions. To further graphically represent the propagating behavior of acquired solitons, we additionally provide 3D, 2D, and contour graphics which clearly demonstrate the presence of kink solitons, including solitary kink, anti-kink, twinning kink, bright kink, bifurcated kink, lump-like kink, and other multiple kinks in the realm of WBBM. Furthermore, by producing new and precise propagating soliton solutions, our RMESEM demonstrates its significance in revealing important details about the model behavior and provides indications regarding possible applications in the field of water waves. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

18 pages, 8388 KiB  

Open AccessArticle

Event Stream Denoising Method Based on Spatio-Temporal Density and Time Sequence Analysis

by Haiyan Jiang, Xiaoshuang Wang, Wei Tang, Qinghui Song, Qingjun Song and Wenchao Hao

Sensors 2024, 24(20), 6527; https://doi.org/10.3390/s24206527 - 10 Oct 2024

Cited by 1 | Viewed by 889

Abstract

An event camera is a neuromimetic sensor inspired by the human retinal imaging principle, which has the advantages of high dynamic range, high temporal resolution, and low power consumption. Due to the interference of hardware and software and other factors, the event stream [...] Read more.

An event camera is a neuromimetic sensor inspired by the human retinal imaging principle, which has the advantages of high dynamic range, high temporal resolution, and low power consumption. Due to the interference of hardware and software and other factors, the event stream output from the event camera usually contains a large amount of noise, and traditional denoising algorithms cannot be applied to the event stream. To better deal with different kinds of noise and enhance the robustness of the denoising algorithm, based on the spatio-temporal distribution characteristics of effective events and noise, an event stream noise reduction and visualization algorithm is proposed. The event stream enters fine filtering after filtering the BA noise based on spatio-temporal density. The fine filtering performs time sequence analysis on the event pixels and the neighboring pixels to filter out hot noise. The proposed visualization algorithm adaptively overlaps the events of the previous frame according to the event density difference to obtain clear and coherent event frames. We conducted denoising and visualization experiments on real scenes and public datasets, respectively, and the experiments show that our algorithm is effective in filtering noise and obtaining clear and coherent event frames under different event stream densities and noise backgrounds. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

18 pages, 871 KiB  

Open AccessArticle

Advancing AI-Driven Linguistic Analysis: Developing and Annotating Comprehensive Arabic Dialect Corpora for Gulf Countries and Saudi Arabia

by Nouf Al-Shenaifi, Aqil M. Azmi and Manar Hosny

Mathematics 2024, 12(19), 3120; https://doi.org/10.3390/math12193120 - 5 Oct 2024

Viewed by 1579

Abstract

This study harnesses the linguistic diversity of Arabic dialects to create two expansive corpora from X (formerly Twitter). The Gulf Arabic Corpus (GAC-6) includes around 1.7 million tweets from six Gulf countries—Saudi Arabia, UAE, Qatar, Oman, Kuwait, and Bahrain—capturing a wide range of [...] Read more.

This study harnesses the linguistic diversity of Arabic dialects to create two expansive corpora from X (formerly Twitter). The Gulf Arabic Corpus (GAC-6) includes around 1.7 million tweets from six Gulf countries—Saudi Arabia, UAE, Qatar, Oman, Kuwait, and Bahrain—capturing a wide range of linguistic variations. The Saudi Dialect Corpus (SDC-5) comprises 790,000 tweets, offering in-depth insights into five major regional dialects of Saudi Arabia: Hijazi, Najdi, Southern, Northern, and Eastern, reflecting the complex linguistic landscape of the region. Both corpora are thoroughly annotated with dialect-specific seed words and geolocation data, achieving high levels of accuracy, as indicated by Cohen’s Kappa scores of 0.78 for GAC-6 and 0.90 for SDC-5. The annotation process leverages AI-driven techniques, including machine learning algorithms for automated dialect recognition and feature extraction, to enhance the granularity and precision of the data. These resources significantly contribute to the field of Arabic dialectology and facilitate the development of AI algorithms for linguistic data analysis, enhancing AI system design and efficiency. The data provided by this research are crucial for advancing AI methodologies, supporting diverse applications in the realm of next-generation AI technologies. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

19 pages, 1112 KiB  

Open AccessArticle

Semi-Supervised Interior Decoration Style Classification with Contrastive Mutual Learning

by Lichun Guo, Hao Zeng, Xun Shi, Qing Xu, Jinhui Shi, Kui Bai, Shuang Liang and Wenlong Hang

Mathematics 2024, 12(19), 2980; https://doi.org/10.3390/math12192980 - 25 Sep 2024

Viewed by 744

Abstract

Precisely identifying interior decoration styles holds substantial significance in directing interior decoration practices. Nevertheless, constructing accurate models for the automatic classification of interior decoration styles remains challenging due to the scarcity of expert annotations. To address this problem, we propose a novel pseudo-label-guided [...] Read more.

Precisely identifying interior decoration styles holds substantial significance in directing interior decoration practices. Nevertheless, constructing accurate models for the automatic classification of interior decoration styles remains challenging due to the scarcity of expert annotations. To address this problem, we propose a novel pseudo-label-guided contrastive mutual learning framework (PCML) for semi-supervised interior decoration style classification by harnessing large amounts of unlabeled data. Specifically, PCML introduces two distinct subnetworks and selectively utilizes the diversified pseudo-labels generated by each for mutual supervision, thereby mitigating the issue of confirmation bias. For labeled images, the inconsistent pseudo-labels generated by the two subnetworks are employed to identify images that are prone to misclassification. We then devise an inconsistency-aware relearning (ICR) regularization model to perform a review training process. For unlabeled images, we introduce a class-aware contrastive learning (CCL) regularization to learn their discriminative feature representations using the corresponding pseudo-labels. Since the use of distinct subnetworks reduces the risk of both models producing identical erroneous pseudo-labels, CCL can reduce the possibility of noise data sampling to enhance the effectiveness of contrastive learning. The performance of PCML is evaluated on five interior decoration style image datasets. For the average AUC, accuracy, sensitivity, specificity, precision, and F1 scores, PCML obtains improvements of 1.67%, 1.72%, 3.65%, 1.0%, 4.61%, and 4.66% in comparison with the state-of-the-art method, demonstrating the superiority of our method. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

15 pages, 4160 KiB  

Open AccessArticle

A Domain Generation Diagnosis Framework for Unseen Conditions Based on Adaptive Feature Fusion and Augmentation

by Tong Zhang, Haowen Chen, Xianqun Mao, Xin Zhu and Lefei Xu

Mathematics 2024, 12(18), 2865; https://doi.org/10.3390/math12182865 - 14 Sep 2024

Viewed by 973

Abstract

Emerging deep learning-based fault diagnosis methods have advanced in the current industrial scenarios of various working conditions. However, the prerequisite of obtaining target data in advance limits the application of these models to practical engineering scenarios. To address the challenge of fault diagnosis [...] Read more.

Emerging deep learning-based fault diagnosis methods have advanced in the current industrial scenarios of various working conditions. However, the prerequisite of obtaining target data in advance limits the application of these models to practical engineering scenarios. To address the challenge of fault diagnosis under unseen working conditions, a domain generation framework for unseen conditions fault diagnosis is proposed, which consists of an Adaptive Feature Fusion Domain Generation Network (AFFN) and a Mix-up Augmentation Method (MAM) for both the data and domain spaces. AFFN is utilized to fuse domain-invariant and domain-specific representations to improve the model’s generalization performance. MAM enhances the model’s exploration ability for unseen domain boundaries. The diagnostic framework with AFFN and MAM can effectively learn more discriminative features from multiple source domains to perform different generalization tasks for unseen working loads and machines. The feasibility of the proposed unseen conditions diagnostic framework is validated on the SDUST and PU datasets and achieved peak diagnostic accuracies of 94.15% and 93.27%, respectively. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

19 pages, 8280 KiB  

Open AccessArticle

Estimating Three-Dimensional Resistivity Distribution with Magnetotelluric Data and a Deep Learning Algorithm

by Xiaojun Liu, James A. Craven, Victoria Tschirhart and Stephen E. Grasby

Remote Sens. 2024, 16(18), 3400; https://doi.org/10.3390/rs16183400 - 13 Sep 2024

Cited by 1 | Viewed by 1209

Abstract

In this study, we describe a deep learning (DL)-based workflow for the three-dimensional (3D) geophysical inversion of magnetotelluric (MT) data. We derived a mathematical connection between a 3D resistivity model and the surface-observed electric/magnetic field response by using a fully connected neural network [...] Read more.

In this study, we describe a deep learning (DL)-based workflow for the three-dimensional (3D) geophysical inversion of magnetotelluric (MT) data. We derived a mathematical connection between a 3D resistivity model and the surface-observed electric/magnetic field response by using a fully connected neural network framework (U-Net). Limited by computer hardware functionality, the resistivity models were generated by using a random walk technique to enlarge the generalization coverage of the neural network model, and 15,000 paired datasets were utilized to train and validate it. Grid search was used to select the optimal configuration parameters. With the optimal model framework from the parameter tuning phase, the metrics showed stable convergence during model training/validation. In the test period, the trained model was applied to predict the resistivity distribution by using both the simulated synthetic and the real MT data from the Mount Meager area, British Columbia. The reliability of the model prediction was verified with noised input data from the synthetic model. The calculated results can be used to reconstruct the position and shape trends of bodies with anomalous resistivity, which verifies the stability and performance of the DL-based 3D inversion algorithm and showcases its potential practical applications. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

22 pages, 7434 KiB  

Open AccessArticle

AI-Based Prediction of Ultrasonic Vibration-Assisted Milling Performance

by Mohamed S. El-Asfoury, Mohamed Baraya, Eman El Shrief, Khaled Abdelgawad, Mahmoud Sultan and Ahmed Abass

Sensors 2024, 24(17), 5509; https://doi.org/10.3390/s24175509 - 26 Aug 2024

Viewed by 1364

Abstract

The current study aims to evaluate the performance of the ultrasonic vibration-assisted milling (USVAM) process when machining two different materials with high deviations in mechanical properties, specifically 7075 aluminium alloy and Ti-6Al-4V titanium alloy. Additionally, this study seeks to develop an AI-based model [...] Read more.

The current study aims to evaluate the performance of the ultrasonic vibration-assisted milling (USVAM) process when machining two different materials with high deviations in mechanical properties, specifically 7075 aluminium alloy and Ti-6Al-4V titanium alloy. Additionally, this study seeks to develop an AI-based model to predict the process performance based on experimental data for the different workpiece characteristics. In this regard, an ultrasonic vibratory setup was designed to provide vibration oscillations at 28 kHz frequency and 8 µm amplitude in the cutting feed direction for the two characterised materials of 7075 aluminium alloy (150 BHN) and Ti-6Al-4V titanium alloy (350 BHN) workpieces. A series of slotting experiments were conducted using both conventional milling (CM) and USVAM techniques. The axial cutting force and machined slot surface roughness were evaluated for each method. Subsequently, Support Vector Regression (SVR) and artificial neural network (ANN) models were built, tested and compared. AI-based models were developed to analyse the experimental results and predict the process performance for both workpieces. The experiments demonstrated a significant reduction in cutting force by up to 30% and an improvement in surface roughness by approximately four times when using USVAM compared to CM for both materials. Validated by the experimental findings, the ANN model accurately and better predicted the performance metrics with RMSE = 0.11 µm and 0.12 N for Al surface roughness and cutting force. Regarding Ti, surface roughness and cutting force were predicted with RMSE of 0.12 µm and 0.14 N, respectively. The results indicate that USVAM significantly enhances milling performance in terms of a reduced cutting force and improved surface roughness for both 7075 aluminium alloy and Ti-6Al-4V titanium alloy. The ANN model proved to be an effective tool for predicting the outcomes of the USVAM process, offering valuable insights for optimising milling operations across different materials. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

16 pages, 5334 KiB  

Open AccessArticle

An Auditory Convolutional Neural Network for Underwater Acoustic Target Timbre Feature Extraction and Recognition

by Junshuai Ni, Fang Ji, Shaoqing Lu and Weijia Feng

Remote Sens. 2024, 16(16), 3074; https://doi.org/10.3390/rs16163074 - 21 Aug 2024

Cited by 1 | Viewed by 991

Abstract

In order to extract the line-spectrum features of underwater acoustic targets in complex environments, an auditory convolutional neural network (ACNN) with the ability of frequency component perception, timbre perception and critical information perception is proposed in this paper inspired by the human auditory [...] Read more.

In order to extract the line-spectrum features of underwater acoustic targets in complex environments, an auditory convolutional neural network (ACNN) with the ability of frequency component perception, timbre perception and critical information perception is proposed in this paper inspired by the human auditory perception mechanism. This model first uses a gammatone filter bank that mimics the cochlear basilar membrane excitation response to decompose the input time-domain signal into a number of sub-bands, which guides the network to perceive the line-spectrum frequency information of the underwater acoustic target. A sequence of convolution layers is then used to filter out interfering noise and enhance the line-spectrum components of each sub-band by simulating the process of calculating the energy distribution features, after which the improved channel attention module is connected to select line spectra that are more critical for recognition, and in this module, a new global pooling method is proposed and applied in order to better extract the intrinsic properties. Finally, the sub-band information is fused using a combination layer and a single-channel convolution layer to generate a vector with the same dimensions as the input signal at the output layer. A decision module with a Softmax classifier is added behind the auditory neural network and used to recognize the five classes of vessel targets in the ShipsEar dataset, achieving a recognition accuracy of 99.8%, which is improved by 2.7% compared to the last proposed DRACNN method, and there are different degrees of improvement over the other eight compared methods. The visualization results show that the model can significantly suppress the interfering noise intensity and selectively enhance the radiated noise line-spectrum energy of underwater acoustic targets. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

17 pages, 10565 KiB  

Open AccessArticle

Detection of Scratch Defects on Metal Surfaces Based on MSDD-UNet

by Yan Liu, Yunbai Qin, Zhonglan Lin, Haiying Xia and Cong Wang

Electronics 2024, 13(16), 3241; https://doi.org/10.3390/electronics13163241 - 15 Aug 2024

Viewed by 1553

Abstract

In this work, we enhanced the U-shaped network and proposed a method for detecting scratches on metal surfaces based on the Metal Surface Defect Detection U-Net (MSDD-UNet). Initially, we integrated a downsampling approach using a Space-To-Depth module and a lightweight channel attention module [...] Read more.

In this work, we enhanced the U-shaped network and proposed a method for detecting scratches on metal surfaces based on the Metal Surface Defect Detection U-Net (MSDD-UNet). Initially, we integrated a downsampling approach using a Space-To-Depth module and a lightweight channel attention module to address the loss of contextual information in feature maps that results from multiple convolution and pooling operations. Building on this, we developed an improved attention module that utilizes image frequency decomposition and cross-channel self-attention mechanisms, as well as the strengths of convolutional encoders and self-attention blocks. Additionally, this attention module was integrated into the skip connections between the encoder and decoder. The purpose was to capture dense contextual information, highlight small and fine target areas, and assist in localizing micro and fine scratch defects. In response to the severe foreground–background class imbalance in scratch images, a hybrid loss function combining focal loss and $D_{ice}$ loss was put forward to train the model for precise scratch segmentation. Finally, experiments were conducted on two surface defect datasets. The results reveal that our proposed method is more advantageous than other state-of-the-art scratch segmentation methods. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

25 pages, 4785 KiB  

Open AccessArticle

Task-Importance-Oriented Task Selection and Allocation Scheme for Mobile Crowdsensing

by Sha Chang, Yahui Wu, Su Deng, Wubin Ma and Haohao Zhou

Mathematics 2024, 12(16), 2471; https://doi.org/10.3390/math12162471 - 10 Aug 2024

Viewed by 710

Abstract

In Mobile Crowdsensing (MCS), sensing tasks have different impacts and contributions to the whole system or specific targets, so the importance of the tasks is different. Since resources for performing tasks are usually limited, prioritizing the allocation of resources to more important tasks [...] Read more.

In Mobile Crowdsensing (MCS), sensing tasks have different impacts and contributions to the whole system or specific targets, so the importance of the tasks is different. Since resources for performing tasks are usually limited, prioritizing the allocation of resources to more important tasks can ensure that key data or information can be collected promptly and accurately, thus improving overall efficiency and performance. Therefore, it is very important to consider the importance of tasks in the task selection and allocation of MCS. In this paper, a task queue is established, the importance of tasks, the ability of participants to perform tasks, and the stability of the task queue are considered, and a novel task selection and allocation scheme (TSAS) in the MCS system is designed. This scheme introduces the Lyapunov optimization method, which can be used to dynamically keep the task queue stable, balance the execution ability of participants and the system load, and perform more important tasks in different system states, even when the participants are limited. In addition, the Double Deep Q-Network (DDQN) method is introduced to improve on the traditional solution of the Lyapunov optimization problem, so this scheme has a certain predictive ability and foresight on the impact of future system states. This paper also proposes action-masking and iterative training methods for the MCS system, which can accelerate the training process of the neural network in the DDQN and improve the training effect. Experiments show that the TSAS based on the Lyapunov optimization method and DDQN performs better than other algorithms, considering the long-term stability of the queue, the number and importance of tasks to be executed, and the congestion degree of tasks. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

12 pages, 3573 KiB  

Open AccessArticle

Research on Automated Modeling Technology of Sluice Gate Project Based on BIM Technology

by Jiedeerbieke Madiniyeti, Qiujing Zhou, Huijun Qi, Yang Chao and Yu Zhang

Sensors 2024, 24(16), 5114; https://doi.org/10.3390/s24165114 - 7 Aug 2024

Viewed by 1049

Abstract

In order to improve the efficiency and accuracy of the modeling and design work of the sluice gate project, this paper proposes an automatic generation template of the sluice gate project with customized semantics and project layout scheme, aiming at realizing the rapid [...] Read more.

In order to improve the efficiency and accuracy of the modeling and design work of the sluice gate project, this paper proposes an automatic generation template of the sluice gate project with customized semantics and project layout scheme, aiming at realizing the rapid assembling of all kinds of components of the sluice gate project. In the construction process, this paper first starts from basic parametric modeling and proposes constraints as the basis of modeling. Subsequently, a template library framework is developed based on the constraints to ensure that the generated templates have a high degree of standardization and consistency. Finally, an efficient and flexible template library is successfully constructed by using the customized classes and functions of Revit API, which provides powerful technical support for the modeling and design work of sluice gate engineering. This achievement helps to promote the informationization and intelligent development of the water conservancy engineering industry, and its versatility and scalability also make it have a wide range of application prospects in other water conservancy engineering fields. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

15 pages, 1875 KiB  

Open AccessArticle

Multi-Scale Feature and Multi-Channel Selection toward Parkinson’s Disease Diagnosis with EEG

by Haoyu Wu, Jun Qi, Erick Purwanto, Xiaohui Zhu, Po Yang and Jianjun Chen

Sensors 2024, 24(14), 4634; https://doi.org/10.3390/s24144634 - 17 Jul 2024

Cited by 5 | Viewed by 1304

Abstract

Objective: Motivated by Health Care 4.0, this study aims to reducing the dimensionality of traditional EEG features based on manual extracted features, including statistical features in the time and frequency domains. Methods: A total of 22 multi-scale features were extracted from the UNM [...] Read more.

Objective: Motivated by Health Care 4.0, this study aims to reducing the dimensionality of traditional EEG features based on manual extracted features, including statistical features in the time and frequency domains. Methods: A total of 22 multi-scale features were extracted from the UNM and Iowa datasets using a 4th order Butterworth filter and wavelet packet transform. Based on single-channel validation, 29 channels with the highest R2 scores were selected from a pool of 59 common channels. The proposed channel selection scheme was validated on the UNM dataset and tested on the Iowa dataset to compare its generalizability against models trained without channel selection. Results: The experimental results demonstrate that the proposed model achieves an optimal classification accuracy of 100%. Additionally, the generalization capability of the channel selection method is validated through out-of-sample testing based on the Iowa dataset Conclusions: Using single-channel validation, we proposed a channel selection scheme based on traditional statistical features, resulting in a selection of 29 channels. This scheme significantly reduced the dimensionality of EEG feature vectors related to Parkinson’s disease by 50%. Remarkably, this approach demonstrated considerable classification performance on both the UNM and Iowa datasets. For the closed-eye state, the highest classification accuracy achieved was 100%, while for the open-eye state, the highest accuracy reached 93.75%. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

19 pages, 2096 KiB  

Open AccessArticle

Prediction of NOx Emissions in Thermal Power Plants Using a Dynamic Soft Sensor Based on Random Forest and Just-in-Time Learning Methods

by Kaixun He and Haixiao Ding

Sensors 2024, 24(14), 4442; https://doi.org/10.3390/s24144442 - 9 Jul 2024

Cited by 1 | Viewed by 1126

Abstract

Combustion optimization is an effective way to improve the efficiency of thermal power generation and reduce carbon and NOx emissions. Real-time and precise NOx emission prediction is the basis for combustion optimization control of thermal power plants. To construct an accurate NOx concentration [...] Read more.

Combustion optimization is an effective way to improve the efficiency of thermal power generation and reduce carbon and NOx emissions. Real-time and precise NOx emission prediction is the basis for combustion optimization control of thermal power plants. To construct an accurate NOx concentration prediction model, a novel just-in-time learning (JITL) method based on random forest (RF) is proposed in the present work. With this method, first, an improved permutation importance algorithm is proposed to extract important variables. In addition, a similarity index that incorporates temporal and spatial measures is defined to select a local training set representative of the process data. Moreover, considering the influence of model parameters on prediction performance under different working conditions, a process monitoring method based on a moving window (MW) is used to monitor the change in working conditions and guide online updating. The experimental results show that the proposed method has excellent prediction accuracy, with a coefficient of determination of 0.9319, a root-mean-square error of 3.6960 mg/m³, and an average absolute error of 2.7718 mg/m³ on the test set, making it superior to other traditional methods. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

21 pages, 6590 KiB  

Open AccessArticle

A New Strategy: Remaining Useful Life Prediction of Wind Power Bearings Based on Deep Learning under Data Missing Conditions

by Xuejun Li, Xu Lei, Lingli Jiang, Tongguang Yang and Zhenyu Ge

Mathematics 2024, 12(13), 2119; https://doi.org/10.3390/math12132119 - 5 Jul 2024

Cited by 3 | Viewed by 1212

Abstract

With its formidable nonlinear mapping capabilities, deep learning has been widely applied in bearing remaining useful life (RUL) prediction. Given that equipment in actual work is subject to numerous disturbances, the collected data tends to exhibit random missing values. Furthermore, due to the [...] Read more.

With its formidable nonlinear mapping capabilities, deep learning has been widely applied in bearing remaining useful life (RUL) prediction. Given that equipment in actual work is subject to numerous disturbances, the collected data tends to exhibit random missing values. Furthermore, due to the dynamic nature of wind turbine environments, LSTM models relying on manually set parameters exhibit certain limitations. Considering these factors can lead to issues with the accuracy of predictive models when forecasting the remaining useful life (RUL) of wind turbine bearings. In light of this issue, a novel strategy for predicting the remaining life of wind turbine bearings under data scarcity conditions is proposed. Firstly, the average similarity (AS) is introduced to reconstruct the discriminator of the Generative Adversarial Imputation Nets (GAIN), and the adversarial process between the generative module and the discriminant is strengthened. Based on this, the dung beetle algorithm (DBO) is used to optimize multiple parameters of the long-term and short-term memory network (LSTM), and the complete data after filling is used as the input data of the optimized LSTM to realize the prediction of the remaining life of the wind power bearing. The effectiveness of the proposed method is verified by the full-life data test of bearings. The results show that, under the condition of missing data, the new strategy of AS-GAIN-LSTM is used to predict the RUL of wind turbine bearings, which has a more stable prediction performance. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

22 pages, 8526 KiB  

Open AccessArticle

A Novel Model for Instance Segmentation and Quantification of Bridge Surface Cracks—The YOLOv8-AFPN-MPD-IoU

by Chenqin Xiong, Tarek Zayed, Xingyu Jiang, Ghasan Alfalah and Eslam Mohammed Abelkader

Sensors 2024, 24(13), 4288; https://doi.org/10.3390/s24134288 - 1 Jul 2024

Cited by 1 | Viewed by 2068

Abstract

Surface cracks are alluded to as one of the early signs of potential damage to infrastructures. In the same vein, their detection is an imperative task to preserve the structural health and safety of bridges. Human-based visual inspection is acknowledged as the most [...] Read more.

Surface cracks are alluded to as one of the early signs of potential damage to infrastructures. In the same vein, their detection is an imperative task to preserve the structural health and safety of bridges. Human-based visual inspection is acknowledged as the most prevalent means of assessing infrastructures’ performance conditions. Nonetheless, it is unreliable, tedious, hazardous, and labor-intensive. This state of affairs calls for the development of a novel YOLOv8-AFPN-MPD-IoU model for instance segmentation and quantification of bridge surface cracks. Firstly, YOLOv8s-Seg is selected as the backbone network to carry out instance segmentation. In addition, an asymptotic feature pyramid network (AFPN) is incorporated to ameliorate feature fusion and overall performance. Thirdly, the minimum point distance (MPD) is introduced as a loss function as a way to better explore the geometric features of surface cracks. Finally, the middle aisle transformation is amalgamated with Euclidean distance to compute the length and width of segmented cracks. Analytical comparisons reveal that this developed deep learning network surpasses several contemporary models, including YOLOv8n, YOLOv8s, YOLOv8m, YOLOv8l, and Mask-RCNN. The YOLOv8s + AFPN + MPDIoU model attains a precision rate of 90.7%, a recall of 70.4%, an F1-score of 79.27%, mAP50 of 75.3%, and mAP75 of 74.80%. In contrast to alternative models, our proposed approach exhibits enhancements across performance metrics, with the F1-score, mAP50, and mAP75 increasing by a minimum of 0.46%, 1.3%, and 1.4%, respectively. The margin of error in the measurement model calculations is maintained at or below 5%. Therefore, the developed model can serve as a useful tool for the accurate characterization and quantification of different types of bridge surface cracks. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

16 pages, 4707 KiB  

Open AccessArticle

Advanced Monitoring of Manufacturing Process through Video Analytics

by Nisar Hakam, Khaled Benfriha, Vincent Meyrueis and Cyril Liotard

Sensors 2024, 24(13), 4239; https://doi.org/10.3390/s24134239 - 29 Jun 2024

Viewed by 1618

Abstract

The digitization of production systems has revolutionized industrial monitoring. Analyzing real-time bottom-up data enables the dynamic monitoring of industrial processes. Data are collected in various types, like video frames and time signals. This article focuses on leveraging images from a vision system to [...] Read more.

The digitization of production systems has revolutionized industrial monitoring. Analyzing real-time bottom-up data enables the dynamic monitoring of industrial processes. Data are collected in various types, like video frames and time signals. This article focuses on leveraging images from a vision system to monitor the manufacturing process on a computer numerical control (CNC) lathe machine. We propose a method for designing and integrating these video modules on the edge of a production line. This approach detects the presence of raw parts, measures process parameters, assesses tool status, and checks roughness in real time using image processing techniques. The efficiency is evaluated by checking the deployment, the accuracy, the responsiveness, and the limitations. Finally, a perspective is offered to use the metadata off the edge in a more complex artificial-intelligence (AI) method for predictive maintenance. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

14 pages, 2333 KiB  

Open AccessArticle

An Improved YOLOv7-Based Model for Real-Time Meter Reading with PConv and Attention Mechanisms

by Xiancheng Peng, Yangzhuo Chen, Xiaowen Cai and Jun Liu

Sensors 2024, 24(11), 3549; https://doi.org/10.3390/s24113549 - 31 May 2024

Viewed by 1102

Abstract

With the increasing complexity of the grid meter dial, precise feature extraction is becoming more and more difficult. Many automatic recognition solutions have been proposed for grid meter readings. However, traditional inspection methods cannot guarantee detection accuracy in complex environments. So, deep-learning methods [...] Read more.

With the increasing complexity of the grid meter dial, precise feature extraction is becoming more and more difficult. Many automatic recognition solutions have been proposed for grid meter readings. However, traditional inspection methods cannot guarantee detection accuracy in complex environments. So, deep-learning methods are combined with grid meter recognition. Existing recognition systems that utilize segmentation models exhibit very high computation. It is challenging to ensure high real-time performance in edge computing devices. Therefore, an improved meter recognition model based on YOLOv7 is proposed in this paper. Partial convolution (PConv) is introduced into YOLOv7 to create a lighter network. Different PConv introduction locations on the base module have been used in order to find the optimal approach for reducing the parameters and floating point of operations (FLOPs). Meanwhile, the dynamic head (DyHead) module is utilized to enhance the attention mechanism for the YOLOv7 model. It can improve the detection accuracy of striped objects. As a result, this paper achieves ${\mathrm{mAP}}_{50}^{val}$ of 97.87% and ${\mathrm{mAP}}_{50:90}^{val}$ of 62.4% with only 5.37 M parameters. The improved model’s inference speed can reach 108 frames per second (FPS). It enables detection accuracy that can reach $\pm 0.1$ degrees in the grid meter. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Graphical abstract

24 pages, 2063 KiB  

Open AccessArticle

Automatic Design of Energy-Efficient Dispatching Rules for Multi-Objective Dynamic Flexible Job Shop Scheduling Based on Dual Feature Weight Sets

by Binzi Xu, Kai Xu, Baolin Fei, Dengchao Huang, Liang Tao and Yan Wang

Mathematics 2024, 12(10), 1463; https://doi.org/10.3390/math12101463 - 9 May 2024

Viewed by 1049

Abstract

Considering the requirements of the actual production scheduling process, the utilization of the genetic programming hyper-heuristic (GPHH) approach to automatically design dispatching rules (DRs) has recently emerged as a popular optimization approach. However, the decision objects and decision environments for routing and sequencing [...] Read more.

Considering the requirements of the actual production scheduling process, the utilization of the genetic programming hyper-heuristic (GPHH) approach to automatically design dispatching rules (DRs) has recently emerged as a popular optimization approach. However, the decision objects and decision environments for routing and sequencing decisions are different in the dynamic flexible job shop scheduling problem (DFJSSP), leading to different required feature information. Traditional algorithms that allow these two types of scheduling decisions to share one common feature set are not conducive to the further optimization of the evolved DRs, but instead introduce redundant and unnecessary search attempts for algorithm optimization. To address this, some related studies have focused on customizing the feature sets for both routing and sequencing decisions through feature selection when solving single-objective problems. While being effective in reducing the search space, the selected feature sets also diminish the diversity of the obtained DRs, ultimately impacting the optimization performance. Consequently, this paper proposes an improved GPHH with dual feature weight sets for the multi-objective energy-efficient DFJSSP, which includes two novel feature weight measures and one novel hybrid population adjustment strategy. Instead of selecting suitable features, the proposed algorithm assigns appropriate weights to the features based on their multi-objective contribution, which could provide directional guidance to the GPHH while ensuring the search space. Experimental results demonstrate that, compared to existing studies, the proposed algorithm can significantly enhance the optimization performance and interpretability of energy-efficient DRs. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

19 pages, 17762 KiB  

Open AccessArticle

Elimination of Irregular Boundaries and Seams for UAV Image Stitching with a Diffusion Model

by Jun Chen, Yongxi Luo, Jie Wang, Honghua Tang, Yixian Tang and Jianhui Li

Remote Sens. 2024, 16(9), 1483; https://doi.org/10.3390/rs16091483 - 23 Apr 2024

Cited by 4 | Viewed by 1375

Abstract

Unmanned aerial vehicle (UAV) image stitching refers to the process of combining multiple UAV images into a single large-format, wide-field image, and the stitched image often contains large irregular boundaries and multiple stitching seams. Usually, irregular boundaries are addressed using grid-constrained methods, while [...] Read more.

Unmanned aerial vehicle (UAV) image stitching refers to the process of combining multiple UAV images into a single large-format, wide-field image, and the stitched image often contains large irregular boundaries and multiple stitching seams. Usually, irregular boundaries are addressed using grid-constrained methods, while seams are optimized through the design of energy functions and penalty terms applied to the pixels at the seams. The above-mentioned two solutions can only address one of the two issues individually and are often limited to pairwise stitching of images. To the best of our knowledge, there is no unified approach that can handle both seams and irregular boundaries in the context of multi-image stitching for UAV images. Considering that addressing irregular boundaries involves completing missing information for regularization and that mitigating seams involves generating images near the stitching seams, both of these challenges can be viewed as instances of a mask-based image completion problem. This paper proposes a UAV image stitching method based on a diffusion model. This method uniformly designs masks for irregular boundaries and stitching seams, and the unconditional score function of the diffusion model is then utilized to reverse the process. Additional manifold gradient constraints are applied to restore masked images, eliminating both irregular boundaries and stitching seams and resulting in higher perceptual quality. The restoration maintains high consistency in texture and semantics. This method not only simultaneously addresses irregular boundaries and stitching seams but also is unaffected by factors such as the number of stitched images, the shape of irregular boundaries, and the distribution of stitching seams, demonstrating its robustness. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

22 pages, 5272 KiB  

Open AccessArticle

Improving Graph Convolutional Network with Learnable Edge Weights and Edge-Node Co-Embedding for Graph Anomaly Detection

by Xiao Tan, Jianfeng Yang, Zhengang Zhao, Jinsheng Xiao and Chengwang Li

Sensors 2024, 24(8), 2591; https://doi.org/10.3390/s24082591 - 18 Apr 2024

Viewed by 1928

Abstract

The era of Industry 4.0 is gradually transforming our society into a data-driven one, which can help us uncover valuable information from accumulated data, thereby improving the level of social governance. The detection of anomalies, is crucial for maintaining societal trust and fairness, [...] Read more.

The era of Industry 4.0 is gradually transforming our society into a data-driven one, which can help us uncover valuable information from accumulated data, thereby improving the level of social governance. The detection of anomalies, is crucial for maintaining societal trust and fairness, yet it poses significant challenges due to the ubiquity of anomalies and the difficulty in identifying them accurately. This paper aims to enhance the performance of the current Graph Convolutional Network (GCN)-based Graph Anomaly Detection (GAD) algorithm on datasets with extremely low proportions of anomalous labels. This goal is achieved through modifying the GCN network structure and conducting feature extraction, thus fully utilizing three types of information in the graph: node label information, node feature information, and edge information. Firstly, we theoretically demonstrate the relationship between label propagation and feature convolution, indicating that the Label Propagation Algorithm (LPA) can serve as a regularization penalty term for GCN, aiding in training and enabling learnable edge weights, providing a basis for incorporating node label information into GCN networks. Secondly, we introduce a method to aggregate node and edge features, thereby incorporating edge information into GCN networks. Finally, we design different GCN trainable weights for node features and co-embedding features. This design allows different features to be projected into different spaces, greatly enhancing model expressiveness. Experimental results on the DGraph dataset demonstrate superior AUC performance compared to baseline models, highlighting the feasibility and efficacy of the proposed approach in addressing GAD tasks in the scene with extremely low proportions of anomalous data. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

16 pages, 3119 KiB  

Open AccessArticle

Method for Identification of Aberrations in Operational Data of Maritime Vessels and Sources Investigation

by Jie Cai, Marie Lützen, Adeline Crystal John, Jakob Buus Petersen and Niels Gorm Maly Rytter

Sensors 2024, 24(7), 2146; https://doi.org/10.3390/s24072146 - 27 Mar 2024

Viewed by 1157

Abstract

Sensing data from vessel operations are of great importance in reflecting operational performance and facilitating proper decision-making. In this paper, statistical analyses of vessel operational data are first conducted to compare manual noon reports and autolog data from sensors. Then, new indicators to [...] Read more.

Sensing data from vessel operations are of great importance in reflecting operational performance and facilitating proper decision-making. In this paper, statistical analyses of vessel operational data are first conducted to compare manual noon reports and autolog data from sensors. Then, new indicators to identify data aberrations are proposed, which are the errors between the reported values from operational data and the expected values of different parameters based on baseline models and relevant sailing conditions. A method to detect aberrations based on the new indicators in terms of the reported power is then investigated, as there are two independent measured power values. In this method, a sliding window that moves forward along time is implemented, and the coefficient of variation (CV) is calculated for comparison. Case studies are carried out to detect aberrations in autolog and noon data from a commercial vessel using the new indicator. An analysis to explore the source of the deviation is also conducted, aiming to find the most reliable value in operations. The method is shown to be effective for practical use in detecting aberrations, having been initially tested on both autolog and noon report from four different commercial vessels in 14 vessel years. Approximately one triggered period per vessel per year with a conclusive deviation source is diagnosed by the proposed method. The investigation of this research will facilitate a better evaluation of operational performance, which is beneficial to both the vessel operators and crew. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

17 pages, 614 KiB  

Open AccessArticle

BiVi-GAN: Bivariate Vibration GAN

by HoeJun Jeong, SeongYeon Jeung, HyunJun Lee and JangWoo Kwon

Sensors 2024, 24(6), 1765; https://doi.org/10.3390/s24061765 - 8 Mar 2024

Cited by 2 | Viewed by 1576

Abstract

In the domain of prognosis and health management (PHM) for rotating machinery, the criticality of ensuring equipment reliability cannot be overstated. With developments in artificial intelligence (AI) and deep learning, there have been numerous attempts to use those methodologies in PHM. However, there [...] Read more.

In the domain of prognosis and health management (PHM) for rotating machinery, the criticality of ensuring equipment reliability cannot be overstated. With developments in artificial intelligence (AI) and deep learning, there have been numerous attempts to use those methodologies in PHM. However, there are challenges to applying them in practice because they require huge amounts of data. This study explores a novel approach to augment vibration data—a primary component in traditional PHM methodologies—using a specialized generative model. Recognizing the limitations of deep learning models, which often fail to capture the intrinsic physical characteristics vital for vibration analysis, we introduce the bivariate vibration generative adversarial networks (BiVi-GAN) model. BiVi-GAN incorporates elements of a physics-informed neural network (PINN), emphasizing the specific vibration characteristics of rotating machinery. We integrate two types of physical information into our model: order analysis and cross-wavelet transform, which are crucial for dissecting the vibration characteristics of such machinery. Experimental findings show the effectiveness of our proposed model. With the incorporation of physics information (PI) input and PI loss, the BiVi-GAN showed a 70% performance improvement in terms of JS divergence compared with the baseline biwavelet-GAN model. This study maintains the potential and efficacy of complementary domain-specific insights with data-driven AI models for more robust and accurate outcomes in PHM. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

24 pages, 2231 KiB  

Open AccessReview

Machine Learning Meets Cancer

by Elena V. Varlamova, Maria A. Butakova, Vlada V. Semyonova, Sergey A. Soldatov, Artem V. Poltavskiy, Oleg I. Kit and Alexander V. Soldatov

Cancers 2024, 16(6), 1100; https://doi.org/10.3390/cancers16061100 - 8 Mar 2024

Cited by 10 | Viewed by 4510

Abstract

The role of machine learning (a part of artificial intelligence—AI) in the diagnosis and treatment of various types of oncology is steadily increasing. It is expected that the use of AI in oncology will speed up both diagnostic and treatment planning processes. This [...] Read more.

The role of machine learning (a part of artificial intelligence—AI) in the diagnosis and treatment of various types of oncology is steadily increasing. It is expected that the use of AI in oncology will speed up both diagnostic and treatment planning processes. This review describes recent applications of machine learning in oncology, including medical image analysis, treatment planning, patient survival prognosis, and the synthesis of drugs at the point of care. The fast and reliable analysis of medical images is of great importance in the case of fast-flowing forms of cancer. The introduction of ML for the analysis of constantly growing volumes of big data makes it possible to improve the quality of prescribed treatment and patient care. Thus, ML is expected to become an essential technology for medical specialists. The ML model has already improved prognostic prediction for patients compared to traditional staging algorithms. The direct synthesis of the necessary medical substances (small molecule mixtures) at the point of care could also seriously benefit from the application of ML. We further review the main trends in the use of artificial intelligence-based technologies in modern oncology. This review demonstrates the future prospects of using ML tools to make progress in cancer research, as well as in other areas of medicine. Despite growing interest in the use of modern computer technologies in medical practice, a number of unresolved ethical and legal problems remain. In this review, we also discuss the most relevant issues among them. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

18 pages, 5205 KiB  

Open AccessArticle

Experimental Analyses and Predictive Modelling of Ultrasonic Welding Parameters for Enhancing Smart Textile Fabrication

by Mohamed Baraya, Mohamed S. El-Asfoury, Omnia O. Fadel and Ahmed Abass

Sensors 2024, 24(5), 1488; https://doi.org/10.3390/s24051488 - 25 Feb 2024

Cited by 3 | Viewed by 1683

Abstract

This study aims to illustrate the design, fabrication, and optimisation of an ultrasonic welding (UW) machine to join copper wires with non-woven PVC textiles as smart textiles. The study explicitly evaluates UW parameters’ impact on heat generation, joint strength, and electrical properties, with [...] Read more.

This study aims to illustrate the design, fabrication, and optimisation of an ultrasonic welding (UW) machine to join copper wires with non-woven PVC textiles as smart textiles. The study explicitly evaluates UW parameters’ impact on heat generation, joint strength, and electrical properties, with a comprehensive understanding of the process dynamics and developing a predictive model applicable to smart textiles. The methodological approach involved designing and manufacturing an ultrasonic piezoelectric transducer using ABAQUS finite element analyses (FEA) software and constructing a UW machine for the current purpose. The full factorial design (FFD) approach was employed in experiments to systematically assess the influence of welding time, welding pressure, and copper wire diameter on the produced joints. Experimental data were meticulously collected, and a backpropagation neural network (BPNN) model was constructed based on the analysis of these results. The results of the experimental investigation provided valuable insights into the UW process, elucidating the intricate relationship between welding parameters and heat generation, joint strength, and post-welding electrical properties of the copper wires. This dataset served as the basis for developing a neural network model, showcasing a high level of accuracy in predicting welding outcomes compared to the FFD model. The neural network model provides a valuable tool for controlling and optimising the UW process in the realm of smart textile production. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

25 pages, 12632 KiB  

Open AccessArticle

Convolutional Neural Networks for Raw Signal Classification in CNC Turning Process Monitoring

by Emmanuel Stathatos, Evangelos Tzimas, Panorios Benardos and George-Christopher Vosniakos

Sensors 2024, 24(5), 1390; https://doi.org/10.3390/s24051390 - 21 Feb 2024

Cited by 3 | Viewed by 1524

Abstract

This study addresses the need for advanced machine learning-based process monitoring in smart manufacturing. A methodology is developed for near-real-time part quality prediction based on process-related data obtained from a CNC turning center. Instead of the manual feature extraction methods typically employed in [...] Read more.

This study addresses the need for advanced machine learning-based process monitoring in smart manufacturing. A methodology is developed for near-real-time part quality prediction based on process-related data obtained from a CNC turning center. Instead of the manual feature extraction methods typically employed in signal processing, a novel one-dimensional convolutional architecture allows the trained model to autonomously extract pertinent features directly from the raw signals. Several signal channels are utilized, including vibrations, motor speeds, and motor torques. Three quality indicators—average roughness, peak-to-valley roughness, and diameter deviation—are monitored using a single model, resulting in a compact and efficient classifier. Training data are obtained via a small number of experiments designed to induce variability in the quality metrics by varying feed, cutting speed, and depth of cut. A sliding window technique augments the dataset and allows the model to seamlessly operate over the entire process. This is further facilitated by the model’s ability to distinguish between cutting and non-cutting phases. The base model is evaluated via k-fold cross validation and achieves average F1 scores above 0.97 for all outputs. Consistent performance is exhibited by additional instances trained under various combinations of design parameters, validating the robustness of the proposed methodology. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

18 pages, 11545 KiB  

Open AccessArticle

Synthetic Training Data in AI-Driven Quality Inspection: The Significance of Camera, Lighting, and Noise Parameters

by Dominik Schraml and Gunther Notni

Sensors 2024, 24(2), 649; https://doi.org/10.3390/s24020649 - 19 Jan 2024

Cited by 1 | Viewed by 1490

Abstract

Industrial-quality inspections, particularly those leveraging AI, require significant amounts of training data. In fields like injection molding, producing a multitude of defective parts for such data poses environmental and financial challenges. Synthetic training data emerge as a potential solution to address these concerns. [...] Read more.

Industrial-quality inspections, particularly those leveraging AI, require significant amounts of training data. In fields like injection molding, producing a multitude of defective parts for such data poses environmental and financial challenges. Synthetic training data emerge as a potential solution to address these concerns. Although the creation of realistic synthetic 2D images from 3D models of injection-molded parts involves numerous rendering parameters, the current literature on the generation and application of synthetic data in industrial-quality inspection scarcely addresses the impact of these parameters on AI efficacy. In this study, we delve into some of these key parameters, such as camera position, lighting, and computational noise, to gauge their effect on AI performance. By utilizing Blender software, we procedurally introduced the “flash” defect on a 3D model sourced from a CAD file of an injection-molded part. Subsequently, with Blender’s Cycles rendering engine, we produced datasets for each parameter variation. These datasets were then used to train a pre-trained EfficientNet-V2 for the binary classification of the “flash” defect. Our results indicate that while noise is less critical, using a range of noise levels in training can benefit model adaptability and efficiency. Variability in camera positioning and lighting conditions was found to be more significant, enhancing model performance even when real-world conditions mirror the controlled synthetic environment. These findings suggest that incorporating diverse lighting and camera dynamics is beneficial for AI applications, regardless of the consistency in real-world operational settings. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

17 pages, 3449 KiB  

Open AccessArticle

Exploiting Cross-Scale Attention Transformer and Progressive Edge Refinement for Retinal Vessel Segmentation

by Yunyi Yuan, Yingkui Zhang, Lei Zhu, Li Cai and Yinling Qian

Mathematics 2024, 12(2), 264; https://doi.org/10.3390/math12020264 - 13 Jan 2024

Cited by 2 | Viewed by 1414

Abstract

Accurate retinal vessel segmentation is a crucial step in the clinical diagnosis and treatment of fundus diseases. Although many efforts have been presented to address the task, the segmentation performance in challenging regions (e.g., collateral vessels) is still not satisfactory, due to their [...] Read more.

Accurate retinal vessel segmentation is a crucial step in the clinical diagnosis and treatment of fundus diseases. Although many efforts have been presented to address the task, the segmentation performance in challenging regions (e.g., collateral vessels) is still not satisfactory, due to their thin morphology or the low contrast between foreground and background. In this work, we observe that an intrinsic appearance exists in the retinal image: among the dendritic vessels there are generous similar structures, e.g., the main and collateral vessels are all curvilinear, but they have noticeable scale differences. Based on this observation, we propose a novel cross-scale attention transformer (CAT) to encourage the segmentation effects in challenging regions. Specifically, CAT consumes features with different scales to produce their shared attention matrix, and then fully integrates the beneficial information between them. Such new attention architecture could explore the multi-scale idea more efficiently, thus realizing mutual learning of similar structures. In addition, a progressive edge refinement module (ERM) is designed to refine the edges of foreground and background in the segmentation results. Through the idea of edge decoupling, ERM could suppress the background feature near the blood vessels while enhancing the foreground feature, so as to segment vessels accurately. We conduct extensive experiments and discussions on DRIVE and CHASE_DB1 datasets to verify the proposed framework. Experimental results show that our method has great advantages in the Se metric, which are 0.88–7.26% and 0.81–7.11% higher than the state-of-the-art methods on DRIVE and CHASE_DB1, respectively. In addition, the proposed method also outperforms other methods with 0.17–2.06% in terms of the Dice metric on DRIVE. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

24 pages, 778 KiB  

Open AccessArticle

Semi-Supervised Learning-Enhanced Fingerprint Indoor Positioning by Exploiting an Adapted Mean Teacher Model

by Peng Chen, Yingzhi Liu, Wei Li, Jingyi Wang, Jianxiu Wang, Bei Yang and Gang Feng

Electronics 2024, 13(2), 298; https://doi.org/10.3390/electronics13020298 - 9 Jan 2024

Viewed by 1568

Abstract

Location awareness is crucial for numerous emerging wireless indoor applications. Deep learning algorithms have demonstrated the potential for achieving the required level of positioning accuracy in indoor environments. However, obtaining abundant labels for data-driven machine learning is costly in practical situations. As an [...] Read more.

Location awareness is crucial for numerous emerging wireless indoor applications. Deep learning algorithms have demonstrated the potential for achieving the required level of positioning accuracy in indoor environments. However, obtaining abundant labels for data-driven machine learning is costly in practical situations. As an effective solution to alleviating the insufficiency of labeled data for deep learning-based indoor positioning, deep semi-supervised learning (DSSL) can be employed to lessen the dependency on labeled data by exploiting potential patterns in unlabeled samples. In this paper, we propose an Adapted Mean Teacher (AMT) model within the DSSL paradigm for indoor fingerprint positioning by using a channel impulse response. To enhance the generalization of the trained model, we design an efficient implicit augmentation scheme for the training process in the AMT model. Furthermore, we develop a tailored residual network to efficiently extract location characteristics in the AMT framework. We conduct extensive simulation experiments for indoor scenarios with heavy non-line-of-sight conditions based on open datasets to demonstrate the effectiveness of our proposed AMT model. Numerical results indicate that the AMT model outperforms several consistency regularization methods and the pseudo-label method in terms of positioning accuracy and lower positioning latency, achieving a mean error of 90cm when using a small number of labels. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

21 pages, 4735 KiB  

Open AccessArticle

Accurate Robot Arm Attitude Estimation Based on Multi-View Images and Super-Resolution Keypoint Detection Networks

by Ling Zhou, Ruilin Wang and Liyan Zhang

Sensors 2024, 24(1), 305; https://doi.org/10.3390/s24010305 - 4 Jan 2024

Viewed by 2004

Abstract

Robot arm monitoring is often required in intelligent industrial scenarios. A two-stage method for robot arm attitude estimation based on multi-view images is proposed. In the first stage, a super-resolution keypoint detection network (SRKDNet) is proposed. The SRKDNet incorporates a subpixel convolution module [...] Read more.

Robot arm monitoring is often required in intelligent industrial scenarios. A two-stage method for robot arm attitude estimation based on multi-view images is proposed. In the first stage, a super-resolution keypoint detection network (SRKDNet) is proposed. The SRKDNet incorporates a subpixel convolution module in the backbone neural network, which can output high-resolution heatmaps for keypoint detection without significantly increasing the computational resource consumption. Efficient virtual and real sampling and SRKDNet training methods are put forward. The SRKDNet is trained with generated virtual data and fine-tuned with real sample data. This method decreases the time and manpower consumed in collecting data in real scenarios and achieves a better generalization effect on real data. A coarse-to-fine dual-SRKDNet detection mechanism is proposed and verified. Full-view and close-up dual SRKDNets are executed to first detect the keypoints and then refine the results. The keypoint detection accuracy, [email protected], for the real robot arm reaches up to 96.07%. In the second stage, an equation system, involving the camera imaging model, the robot arm kinematic model and keypoints with different confidence values, is established to solve the unknown rotation angles of the joints. The proposed confidence-based keypoint screening scheme makes full use of the information redundancy of multi-view images to ensure attitude estimation accuracy. Experiments on a real UR10 robot arm under three views demonstrate that the average estimation error of the joint angles is 0.53 degrees, which is superior to that achieved with the comparison methods. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

17 pages, 18878 KiB  

Open AccessArticle

Enhancing Surveillance Systems: Integration of Object, Behavior, and Space Information in Captions for Advanced Risk Assessment

by Minseong Jeon, Jaepil Ko and Kyungjoo Cheoi

Sensors 2024, 24(1), 292; https://doi.org/10.3390/s24010292 - 3 Jan 2024

Viewed by 2185

Abstract

This paper presents a novel approach to risk assessment by incorporating image captioning as a fundamental component to enhance the effectiveness of surveillance systems. The proposed surveillance system utilizes image captioning to generate descriptive captions that portray the relationship between objects, actions, and [...] Read more.

This paper presents a novel approach to risk assessment by incorporating image captioning as a fundamental component to enhance the effectiveness of surveillance systems. The proposed surveillance system utilizes image captioning to generate descriptive captions that portray the relationship between objects, actions, and space elements within the observed scene. Subsequently, it evaluates the risk level based on the content of these captions. After defining the risk levels to be detected in the surveillance system, we constructed a dataset consisting of [Image-Caption-Danger Score]. Our dataset offers caption data presented in a unique sentence format, departing from conventional caption styles. This unique format enables a comprehensive interpretation of surveillance scenes by considering various elements, such as objects, actions, and spatial context. We fine-tuned the BLIP-2 model using our dataset to generate captions, and captions were then interpreted with BERT to evaluate the risk level of each scene, categorizing them into stages ranging from 1 to 7. Multiple experiments provided empirical support for the effectiveness of the proposed system, demonstrating significant accuracy rates of 92.3%, 89.8%, and 94.3% for three distinct risk levels: safety, hazard, and danger, respectively. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

11 pages, 443 KiB  

Open AccessArticle

Dual-Safety Knowledge Graph Completion for Process Industry

by Lingzhi Wang, Haotian Li, Wei Wang, Guodong Xin and Yuliang Wei

Electronics 2024, 13(1), 214; https://doi.org/10.3390/electronics13010214 - 3 Jan 2024

Viewed by 1727

Abstract

With the rise of Industry 4.0, control systems have taken on increasing importance in industrial processes, and ensuring their security has become a pressing issue. While recent research has focused on cybersecurity threats, the security risks inherent to industrial processes themselves have been [...] Read more.

With the rise of Industry 4.0, control systems have taken on increasing importance in industrial processes, and ensuring their security has become a pressing issue. While recent research has focused on cybersecurity threats, the security risks inherent to industrial processes themselves have been overlooked. Additionally, existing tools cannot simultaneously analyze both cyber vulnerabilities and processes anomaly in industrial settings. This paper aims to address these issues through two main contributions. First, we develop a knowledge graph to integrate information on security risks across cybersecurity and industrial processes, providing a foundation for comprehensively assessing threats. Second, we apply the link prediction task to the knowledge graph, introducing an embedding-based approach to unveil previously undiscovered knowledge. Our experiments demonstrate that the proposed method exhibits comparable performance on link prediction and is capable of mining valuable and diverse potential risks in industrial processes. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

21 pages, 555 KiB  

Open AccessArticle

TrustDFL: A Blockchain-Based Verifiable and Trusty Decentralized Federated Learning Framework

by Jinsheng Yang, Wenfeng Zhang, Zhaohui Guo and Zhen Gao

Electronics 2024, 13(1), 86; https://doi.org/10.3390/electronics13010086 - 24 Dec 2023

Cited by 2 | Viewed by 2114

Abstract

Federated learning is a privacy-preserving machine learning framework where multiple data owners collaborate to train a global model under the orchestra of a central server. The local training results from trainers should be submitted to the central server for model aggregation and update. [...] Read more.

Federated learning is a privacy-preserving machine learning framework where multiple data owners collaborate to train a global model under the orchestra of a central server. The local training results from trainers should be submitted to the central server for model aggregation and update. Busy central server and malicious trainers can introduce the issues of a single point of failure and model poisoning attacks. To address the above issues, the trusty decentralized federated learning (called TrustDFL) framework has been proposed in this paper based on the zero-knowledge proof scheme, blockchain, and smart contracts, which provides enhanced security and higher efficiency for model aggregation. Specifically, Groth 16 is applied to generate the proof for the local model training, including the forward and backward propagation processes. The proofs are attached as the payloads to the transactions, which are broadcast into the blockchain network and executed by the miners. With the support of smart contracts, the contributions of the trainers could be verified automatically under the economic incentive, where the blockchain records all exchanged data as the trust anchor in multi-party scenarios. In addition, IPFS (InterPlanetary File System) is introduced to alleviate the storage and communication overhead brought by local and global models. The theoretical analysis and estimation results show that the TrustDFL efficiently avoids model poisoning attacks without leaking the local secrets, ensuring the global model’s accuracy to be trained. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

23 pages, 4996 KiB  

Open AccessArticle

A Binocular Vision-Based Crack Detection and Measurement Method Incorporating Semantic Segmentation

by Zhicheng Zhang, Zhijing Shen, Jintong Liu, Jiangpeng Shu and He Zhang

Sensors 2024, 24(1), 3; https://doi.org/10.3390/s24010003 - 19 Dec 2023

Cited by 4 | Viewed by 2324

Abstract

The morphological characteristics of a crack serve as crucial indicators for rating the condition of the concrete bridge components. Previous studies have predominantly employed deep learning techniques for pixel-level crack detection, while occasionally incorporating monocular devices to quantify the crack dimensions. However, the [...] Read more.

The morphological characteristics of a crack serve as crucial indicators for rating the condition of the concrete bridge components. Previous studies have predominantly employed deep learning techniques for pixel-level crack detection, while occasionally incorporating monocular devices to quantify the crack dimensions. However, the practical implementation of such methods with the assistance of robots or unmanned aerial vehicles (UAVs) is severely hindered due to their restrictions in frontal image acquisition at known distances. To explore a non-contact inspection approach with enhanced flexibility, efficiency and accuracy, a binocular stereo vision-based method incorporating full convolutional network (FCN) is proposed for detecting and measuring cracks. Firstly, our FCN leverages the benefits of the encoder–decoder architecture to enable precise crack segmentation while simultaneously emphasizing edge details at a rate of approximately four pictures per second in a database that is dominated by complex background cracks. The training results demonstrate a precision of 83.85%, a recall of 85.74% and an F1 score of 84.14%. Secondly, the utilization of binocular stereo vision improves the shooting flexibility and streamlines the image acquisition process. Furthermore, the introduction of a central projection scheme achieves reliable three-dimensional (3D) reconstruction of the crack morphology, effectively avoiding mismatches between the two views and providing more comprehensive dimensional depiction for cracks. An experimental test is also conducted on cracked concrete specimens, where the relative measurement error in crack width ranges from −3.9% to 36.0%, indicating the practical feasibility of our proposed method. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

attachment

Supplementary material:
Supplementary File 1 (ZIP, 849 KiB)

11 pages, 2026 KiB  

Open AccessArticle

Identifying Lymph Nodes and Their Statuses from Pretreatment Computer Tomography Images of Patients with Head and Neck Cancer Using a Clinical-Data-Driven Deep Learning Algorithm

by Sheng-Yao Huang, Wen-Lin Hsu, Dai-Wei Liu, Edzer L. Wu, Yu-Shao Peng, Zhe-Ting Liao and Ren-Jun Hsu

Cancers 2023, 15(24), 5890; https://doi.org/10.3390/cancers15245890 - 18 Dec 2023

Cited by 2 | Viewed by 1521

Abstract

Background: Head and neck cancer is highly prevalent in Taiwan. Its treatment mainly relies on clinical staging, usually diagnosed from images. A major part of the diagnosis is whether lymph nodes are involved in the tumor. We present an algorithm for analyzing clinical [...] Read more.

Background: Head and neck cancer is highly prevalent in Taiwan. Its treatment mainly relies on clinical staging, usually diagnosed from images. A major part of the diagnosis is whether lymph nodes are involved in the tumor. We present an algorithm for analyzing clinical images that integrates a deep learning model with image processing and attempt to analyze the features it uses to classify lymph nodes. Methods: We retrospectively collected pretreatment computed tomography images and surgery pathological reports for 271 patients diagnosed with, and subsequently treated for, naïve oral cavity, oropharynx, hypopharynx, and larynx cancer between 2008 and 2018. We chose a 3D UNet model trained for semantic segmentation, which was evaluated for inference in a test dataset of 29 patients. Results: We annotated 2527 lymph nodes. The detection rate of all lymph nodes was 80%, and Dice score was 0.71. The model has a better detection rate at larger lymph nodes. For those identified lymph nodes, we found a trend where the shorter the short axis, the more negative the lymph nodes. This is consistent with clinical observations. Conclusions: The model showed a convincible lymph node detection on clinical images. We will evaluate and further improve the model in collaboration with clinical physicians. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

16 pages, 9688 KiB  

Open AccessArticle

Deep Network-Assisted Quality Inspection of Laser Welding on Power Battery

by Dong Wang, Yongjia Zheng, Wei Dai, Ding Tang and Yinghong Peng

Sensors 2023, 23(21), 8894; https://doi.org/10.3390/s23218894 - 1 Nov 2023

Cited by 3 | Viewed by 1795

Abstract

Reliable quality control of laser welding on power batteries is an important issue due to random interference in the production process. In this paper, a quality inspection framework based on a two-branch network and conventional image processing is proposed to predict welding quality [...] Read more.

Reliable quality control of laser welding on power batteries is an important issue due to random interference in the production process. In this paper, a quality inspection framework based on a two-branch network and conventional image processing is proposed to predict welding quality while outputting corresponding parameter information. The two-branch network consists of a segmentation network and a classification network, which alleviates the problem of large training sample size requirements for deep learning by sharing feature representations among two related tasks. Moreover, coordinate attention is introduced into feature learning modules of the network to effectively capture the subtle features of defective welds. Finally, a post-processing method based on the Hough transform is used to extract the information of the segmented weld region. Extensive experiments demonstrate that the proposed model can achieve a significant classification performance on the dataset collected on an actual production line. This study provides a valuable reference for an intelligent quality inspection system in the power battery manufacturing industry. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

13 pages, 3992 KiB  

Open AccessArticle

Prediction of Radiation Treatment Response for Locally Advanced Rectal Cancer via a Longitudinal Trend Analysis Framework on Cone-Beam CT

by Zirong Li, Ann C. Raldow, Joanne B. Weidhaas, Qichao Zhou and X. Sharon Qi

Cancers 2023, 15(21), 5142; https://doi.org/10.3390/cancers15215142 - 25 Oct 2023

Cited by 1 | Viewed by 1662

Abstract

Locally advanced rectal cancer (LARC) presents a significant challenge in terms of treatment management, particularly with regards to identifying patients who are likely to respond to radiation therapy (RT) at an individualized level. Patients respond to the same radiation treatment course differently due [...] Read more.

Locally advanced rectal cancer (LARC) presents a significant challenge in terms of treatment management, particularly with regards to identifying patients who are likely to respond to radiation therapy (RT) at an individualized level. Patients respond to the same radiation treatment course differently due to inter- and intra-patient variability in radiosensitivity. In-room volumetric cone-beam computed tomography (CBCT) is widely used to ensure proper alignment, but also allows us to assess tumor response during the treatment course. In this work, we proposed a longitudinal radiomic trend (LRT) framework for accurate and robust treatment response assessment using daily CBCT scans for early detection of patient response. The LRT framework consists of four modules: (1) Automated registration and evaluation of CBCT scans to planning CT; (2) Feature extraction and normalization; (3) Longitudinal trending analyses; and (4) Feature reduction and model creation. The effectiveness of the framework was validated via leave-one-out cross-validation (LOOCV), using a total of 840 CBCT scans for a retrospective cohort of LARC patients. The trending model demonstrates significant differences between the responder vs. non-responder groups with an Area Under the Curve (AUC) of 0.98, which allows for systematic monitoring and early prediction of patient response during the RT treatment course for potential adaptive management. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

21 pages, 1036 KiB  

Open AccessArticle

Local Differential Privacy Based Membership-Privacy-Preserving Federated Learning for Deep-Learning-Driven Remote Sensing

by Zheng Zhang, Xindi Ma and Jianfeng Ma

Remote Sens. 2023, 15(20), 5050; https://doi.org/10.3390/rs15205050 - 20 Oct 2023

Cited by 3 | Viewed by 1806

Abstract

With the development of deep learning, image recognition based on deep learning is now widely used in remote sensing. As we know, the effectiveness of deep learning models significantly benefits from the size and quality of the dataset. However, remote sensing data are [...] Read more.

With the development of deep learning, image recognition based on deep learning is now widely used in remote sensing. As we know, the effectiveness of deep learning models significantly benefits from the size and quality of the dataset. However, remote sensing data are often distributed in different parts. They cannot be shared directly for privacy and security reasons, and this has motivated some scholars to apply federated learning (FL) to remote sensing. However, research has found that federated learning is usually vulnerable to white-box membership inference attacks (MIAs), which aim to infer whether a piece of data was participating in model training. In remote sensing, the MIA can lead to the disclosure of sensitive information about the model trainers, such as their location and type, as well as time information about the remote sensing equipment. To solve this issue, we consider embedding local differential privacy (LDP) into FL and propose LDP-Fed. LDP-Fed performs local differential privacy perturbation after properly pruning the uploaded parameters, preventing the central server from obtaining the original local models from the participants. To achieve a trade-off between privacy and model performance, LDP-Fed adds different noise levels to the parameters for various layers of the local models. This paper conducted comprehensive experiments to evaluate the framework’s effectiveness on two remote sensing image datasets and two machine learning benchmark datasets. The results demonstrate that remote sensing image classification models are susceptible to MIAs, and our framework can successfully defend against white-box MIA while achieving an excellent global model. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Graphical abstract

26 pages, 8654 KiB  

Open AccessArticle

HFCC-Net: A Dual-Branch Hybrid Framework of CNN and CapsNet for Land-Use Scene Classification

by Ningbo Guo, Mingyong Jiang, Lijing Gao, Kaitao Li, Fengjie Zheng, Xiangning Chen and Mingdong Wang

Remote Sens. 2023, 15(20), 5044; https://doi.org/10.3390/rs15205044 - 20 Oct 2023

Cited by 4 | Viewed by 1824

Abstract

Land-use scene classification (LUSC) is a key technique in the field of remote sensing imagery (RSI) interpretation. A convolutional neural network (CNN) is widely used for its ability to autonomously and efficiently extract deep semantic feature maps (DSFMs) from large-scale RSI data. However, [...] Read more.

Land-use scene classification (LUSC) is a key technique in the field of remote sensing imagery (RSI) interpretation. A convolutional neural network (CNN) is widely used for its ability to autonomously and efficiently extract deep semantic feature maps (DSFMs) from large-scale RSI data. However, CNNs cannot accurately extract the rich spatial structure information of RSI, and the key information of RSI is easily lost due to many pooling layers, so it is difficult to ensure the information integrity of the spatial structure feature maps (SSFMs) and DSFMs of RSI with CNNs only for LUSC, which can easily affect the classification performance. To fully utilize the SSFMs and make up for the insufficiency of CNN in capturing the relationship information between the land-use objects of RSI, while reducing the loss of important information, we propose an effective dual-branch hybrid framework, HFCC-Net, for the LUSC task. The CNN in the upper branch extracts multi-scale DSFMs of the same scene using transfer learning techniques; the graph routing-based CapsNet in the lower branch is used to obtain SSFMs from DSFMs in different scales, and element-by-element summation achieves enhanced representations of SSFMs; a newly designed function is used to fuse the top-level DSFMs with SSFMs to generate discriminant feature maps (DFMs); and, finally, the DFMs are fed into classifier. We conducted sufficient experiments using HFCC-Net on four public datasets. The results show that our method has better classification performance compared to some existing CNN-based state-of-the-art methods. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

attachment

Supplementary material:
Supplementary File 1 (ZIP, 601 KiB)

13 pages, 1754 KiB  

Open AccessArticle

A Study on Survival Analysis Methods Using Neural Network to Prevent Cancers

by Chul-Young Bae, Bo-Seon Kim, Sun-Ha Jee, Jong-Hoon Lee and Ngoc-Dung Nguyen

Cancers 2023, 15(19), 4757; https://doi.org/10.3390/cancers15194757 - 27 Sep 2023

Cited by 3 | Viewed by 2030

Abstract

Background: Cancer is one of the main global health threats. Early personalized prediction of cancer incidence is crucial for the population at risk. This study introduces a novel cancer prediction model based on modern recurrent survival deep learning algorithms. Methods: The study includes [...] Read more.

Background: Cancer is one of the main global health threats. Early personalized prediction of cancer incidence is crucial for the population at risk. This study introduces a novel cancer prediction model based on modern recurrent survival deep learning algorithms. Methods: The study includes 160,407 participants from the blood-based cohort of the Korea Cancer Prevention Research-II Biobank, which has been ongoing since 2004. Data linkages were designed to ensure anonymity, and data collection was carried out through nationwide medical examinations. Predictive performance on ten cancer sites, evaluated using the concordance index (c-index), was compared among nDeep and its multitask variation, Cox proportional hazard (PH) regression, DeepSurv, and DeepHit. Results: Our models consistently achieved a c-index of over 0.8 for all ten cancers, with a peak of 0.8922 for lung cancer. They outperformed Cox PH regression and other survival deep neural networks. Conclusion: This study presents a survival deep learning model that demonstrates the highest predictive performance on censored health dataset, to the best of our knowledge. In the future, we plan to investigate the causal relationship between explanatory variables and cancer to reduce cancer incidence and mortality. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

20 pages, 2193 KiB  

Open AccessArticle

Long-Time Coherent Integration for Marine Targets Based on Segmented Compensation

by Zhenfang Zhao, Yisong Zhang, Wenguang Wang, Ben Liu and Wei Wu

Remote Sens. 2023, 15(18), 4530; https://doi.org/10.3390/rs15184530 - 14 Sep 2023

Cited by 1 | Viewed by 1514

Abstract

Long-time coherent integration is an effective method for dim target detection from heavy sea clutter. To detect dim targets, a novel long-time coherent integration method based on segmented compensation is proposed in this paper. The method models the complex motion of a marine [...] Read more.

Long-time coherent integration is an effective method for dim target detection from heavy sea clutter. To detect dim targets, a novel long-time coherent integration method based on segmented compensation is proposed in this paper. The method models the complex motion of a marine target as the combination of multi-stage uniformly accelerated motions. According to the difference of energy distribution in Doppler frequency domain, this method can suppress sea clutter and detect the regions of interest (ROIs). Using time–frequency domain energy analysis, the potential target can be extracted. After estimating the parameters and segmentation, for the potential targets, the phase compensation factor can be used to eliminate the Doppler frequency modulation caused by the complex motion. Finally, for the compensated signal, long-time coherent integration is performed to realize the target detection and discrimination under low signal-to-clutter ratio. To verify the effectiveness of the proposed method, we apply simulation data and measured CSIR data in the experiments. The results show that the proposed method can integrate the energy of target more effectively than MTD and RFrFT, and the novel method has better detection performance for complex moving targets under low signal-to-clutter ratio situation. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Graphical abstract

14 pages, 2321 KiB  

Open AccessArticle

PSBF: p-adic Integer Scalable Bloom Filter

by Wenlong Yi, Chuang Wang, Qiliang Xie, Yingding Zhao and Jing Jia

Sensors 2023, 23(18), 7775; https://doi.org/10.3390/s23187775 - 9 Sep 2023

Cited by 1 | Viewed by 1522

Abstract

Given the challenges associated with the dynamic expansion of the conventional bloom filter’s capacity, the prevalence of false positives, and the subpar access performance, this study employs the algebraic and topological characteristics of p-adic integers to introduce an innovative approach for dynamically expanding [...] Read more.

Given the challenges associated with the dynamic expansion of the conventional bloom filter’s capacity, the prevalence of false positives, and the subpar access performance, this study employs the algebraic and topological characteristics of p-adic integers to introduce an innovative approach for dynamically expanding the p-adic Integer Scalable Bloom Filter (PSBF). The proposed method involves converting the target element into an integer using a string hash function, followed by the conversion of said integer into a p-adic integer through algebraic properties. This process automatically establishes the topological tree access structure of the PSBF. The experiment involved a comparison of access performance among the standard bloom filter, dynamic bloom filter, and scalable bloom filter. The findings indicate that the PSBF offers advantages such as avoidance of a linear storage structure, enhanced efficiency in element insertion and query, improved storage space utilization, and reduced likelihood of false positives. Consequently, the PSBF presents a novel approach to the dynamic extensibility of bloom filters. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

31 pages, 660 KiB  

Open AccessFeature PaperArticle

Machine Learning-Based Model Predictive Control of Two-Time-Scale Systems

by Aisha Alnajdi, Fahim Abdullah, Atharva Suryavanshi and Panagiotis D. Christofides

Mathematics 2023, 11(18), 3827; https://doi.org/10.3390/math11183827 - 6 Sep 2023

Cited by 2 | Viewed by 1790

Abstract

In this study, we present a general form of nonlinear two-time-scale systems, where singular perturbation analysis is used to separate the dynamics of the slow and fast subsystems. Machine learning techniques are utilized to approximate the dynamics of both subsystems. Specifically, a recurrent [...] Read more.

In this study, we present a general form of nonlinear two-time-scale systems, where singular perturbation analysis is used to separate the dynamics of the slow and fast subsystems. Machine learning techniques are utilized to approximate the dynamics of both subsystems. Specifically, a recurrent neural network (RNN) and a feedforward neural network (FNN) are used to predict the slow and fast state vectors, respectively. Moreover, we investigate the generalization error bounds for these machine learning models approximating the dynamics of two-time-scale systems. Next, under the assumption that the fast states are asymptotically stable, our focus shifts toward designing a Lyapunov-based model predictive control (LMPC) scheme that exclusively employs the RNN to predict the dynamics of the slow states. Additionally, we derive sufficient conditions to guarantee the closed-loop stability of the system under the sample-and-hold implementation of the controller. A nonlinear chemical process example is used to demonstrate the theory. In particular, two RNN models are constructed: one to model the full two-time-scale system and the other to predict solely the slow state vector. Both models are integrated within the LMPC scheme, and we compare their closed-loop performance while assessing the computational time required to execute the LMPC optimization problem. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

23 pages, 3444 KiB  

Open AccessArticle

AI-Enabled Vibrotactile Feedback-Based Condition Monitoring Framework for Outdoor Mobile Robots

by Sathian Pookkuttath, Raihan Enjikalayil Abdulkader, Mohan Rajesh Elara and Prabakaran Veerajagadheswar

Mathematics 2023, 11(18), 3804; https://doi.org/10.3390/math11183804 - 5 Sep 2023

Cited by 1 | Viewed by 1561

Abstract

An automated Condition Monitoring (CM) and real-time controlling framework is essential for outdoor mobile robots to ensure the robot’s health and operational safety. This work presents a novel Artificial Intelligence (AI)-enabled CM and vibrotactile haptic-feedback-based real-time control framework suitable for deploying mobile robots [...] Read more.

An automated Condition Monitoring (CM) and real-time controlling framework is essential for outdoor mobile robots to ensure the robot’s health and operational safety. This work presents a novel Artificial Intelligence (AI)-enabled CM and vibrotactile haptic-feedback-based real-time control framework suitable for deploying mobile robots in dynamic outdoor environments. It encompasses two sections: developing a 1D Convolutional Neural Network (1D CNN) model for predicting system degradation and terrain flaws threshold classes and a vibrotactile haptic feedback system design enabling a remote operator to control the robot as per predicted class feedback in real-time. As vibration is an indicator of failure, we identified and separated system- and terrain-induced vibration threshold levels suitable for CM of outdoor robots into nine classes, namely Safe, moderately safe system-generated, and moderately safe terrain-induced affected by left, right, and both wheels, as well as severe classes such as unsafe system-generated and unsafe terrain-induced affected by left, right, and both wheels. The vibration-indicated data for each class are modelled based on two sensor data: an Inertial Measurement Unit (IMU) sensor for the change in linear and angular motion and a current sensor for the change in current consumption at each wheel motor. A wearable novel vibrotactile haptic feedback device architecture is presented with left and right vibration modules configured with unique haptic feedback patterns corresponding to each abnormal vibration threshold class. The proposed haptic-feedback-based CM framework and real-time remote controlling are validated with three field case studies using an in-house-developed outdoor robot, resulting in a threshold class prediction accuracy of 91.1% and an effectiveness that, by minimising the traversal through undesired terrain features, is four times better than the usual practice. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

25 pages, 41037 KiB  

Open AccessArticle

Single Object Tracking in Satellite Videos Based on Feature Enhancement and Multi-Level Matching Strategy

by Jianwei Yang, Zongxu Pan, Yuhan Liu, Ben Niu and Bin Lei

Remote Sens. 2023, 15(17), 4351; https://doi.org/10.3390/rs15174351 - 4 Sep 2023

Cited by 7 | Viewed by 2396

Abstract

Despite significant advancements in remote sensing object tracking (RSOT) in recent years, achieving accurate and continuous tracking of tiny-sized targets remains a challenging task due to similar object interference and other related issues. In this paper, from the perspective of feature enhancement and [...] Read more.

Despite significant advancements in remote sensing object tracking (RSOT) in recent years, achieving accurate and continuous tracking of tiny-sized targets remains a challenging task due to similar object interference and other related issues. In this paper, from the perspective of feature enhancement and a better feature matching strategy, we present a tracker SiamTM specifically designed for RSOT, which is mainly based on a new target information enhancement (TIE) module and a multi-level matching strategy. First, we propose a TIE module to address the challenge of tiny object sizes in satellite videos. The proposed TIE module goes along two spatial directions to capture orientation and position-aware information, respectively, while capturing inter-channel information at the global 2D image level. The TIE module enables the network to extract discriminative features of the targets more effectively from satellite images. Furthermore, we introduce a multi-level matching (MM) module that is better suited for satellite video targets. The MM module firstly embeds the target feature map after ROI Align into each position of the search region feature map to obtain a preliminary response map. Subsequently, the preliminary response map and the template region feature map are subjected to the Depth-wise Cross Correlation operation to get a more refined response map. Through this coarse-to-fine approach, the tracker obtains a response map with a more accurate position, which lays a good foundation for the prediction operation of the subsequent sub-networks. We conducted extensive experiments on two large satellite video single-object tracking datasets: SatSOT and SV248S. Without bells and whistles, the proposed tracker SiamTM achieved competitive results on both datasets while running at real-time speed. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

21 pages, 1447 KiB  

Open AccessArticle

AI-Enabled Condition Monitoring Framework for Indoor Mobile Cleaning Robots

by Sathian Pookkuttath, Prabakaran Veerajagadheswar and Mohan Rajesh Elara

Mathematics 2023, 11(17), 3682; https://doi.org/10.3390/math11173682 - 26 Aug 2023

Viewed by 1597

Abstract

Autonomous mobile cleaning robots are ubiquitous today and have a vast market need. Current studies are mainly focused on autonomous cleaning performances, and there exists a research gap on monitoring the robot’s health and safety. Vibration is a key indicator of system deterioration [...] Read more.

Autonomous mobile cleaning robots are ubiquitous today and have a vast market need. Current studies are mainly focused on autonomous cleaning performances, and there exists a research gap on monitoring the robot’s health and safety. Vibration is a key indicator of system deterioration or external factors causing accelerated degradation or threats. Hence, this work proposes an artificial intelligence (AI)-enabled automated condition monitoring (CM) framework using two heterogeneous sensor datasets to predict the sources of anomalous vibration in mobile robots with high accuracy. This allows triggering proper maintenance or corrective actions based on the condition of the robot’s health or workspace, easing condition-based maintenance (CbM). Anomalous vibration sources are classified as induced by uneven Terrain, Collision with obstacles, loose Assembly, and unbalanced Structure, which causes accelerated system deterioration or potential hazards. Here, an unexplored heterogeneous sensor dataset using inertial measurement unit (IMU) and current sensors is proposed for effective recognition across different vibration classes, resulting in higher-accuracy prediction. A simple-structured 1D convolutional neural network (1D CNN) is developed for training and real-time prediction. A 2D CbM map is generated by fusing the predicted classes in real time on an occupancy grid map of the workspace to monitor the conditions of the robot and workspace remotely. The evaluation test results of the proposed method show that the usage of heterogeneous sensors performs significantly more accurately (98.4%) than previous studies, which used IMU (92.2%) and camera (93.8%) sensors individually. Also, this model is comparatively fast, fit for the environment, and ideal for real-time applications in mobile robots based on field trial validations, enhancing mobile robots’ productivity and operational safety. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

22 pages, 1778 KiB  

Open AccessArticle

AI-Enabled Condition Monitoring Framework for Outdoor Mobile Robots Using 3D LiDAR Sensor

by Sathian Pookkuttath, Povendhan Arthanaripalayam Palanisamy and Mohan Rajesh Elara

Mathematics 2023, 11(16), 3594; https://doi.org/10.3390/math11163594 - 19 Aug 2023

Cited by 1 | Viewed by 1517

Abstract

An automated condition monitoring (CM) framework is essential for outdoor mobile robots to trigger prompt maintenance and corrective actions based on the level of system deterioration and outdoor uneven terrain feature states. Vibration indicates system failures and terrain abnormalities in mobile robots; hence, [...] Read more.

An automated condition monitoring (CM) framework is essential for outdoor mobile robots to trigger prompt maintenance and corrective actions based on the level of system deterioration and outdoor uneven terrain feature states. Vibration indicates system failures and terrain abnormalities in mobile robots; hence, five vibration threshold classes for CM in outdoor mobile robots were identified, considering both vibration source system deterioration and uneven terrain. This study proposes a novel CM approach for outdoor mobile robots using a 3D LiDAR, employed here instead of its usual use as a navigation sensor, by developing an algorithm to extract the vibration-indicated data based on the point cloud, assuring low computational costs without losing vibration characteristics. The algorithm computes cuboids for two prominent clusters in every point cloud frame and sets motion points at the corners and centroid of the cuboid. The three-dimensional vector displacement of these points over consecutive point cloud frames, which corresponds to the vibration-affected clusters, are compiled as vibration indication data for each threshold class. A simply structured 1D Convolutional Neural Network (1D CNN)-based vibration threshold prediction model is proposed for fast, accurate, and real-time application. Finally, a threshold class mapping framework is developed which fuses the predicted threshold classes on the 3D occupancy map of the workspace, generating a 3D CbM map in real time, fostering a Condition-based Maintenance (CbM) strategy. The offline evaluation test results show an average accuracy of vibration threshold classes of 89.6% and consistent accuracy during real-time field case studies of 89%. The test outcomes validate that the proposed 3D-LiDAR-based CM framework is suitable for outdoor mobile robots, assuring the robot’s health and operational safety. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

21 pages, 584 KiB  

Open AccessArticle

Smart Contract Vulnerability Detection Based on Deep Learning and Multimodal Decision Fusion

by Weichu Deng, Huanchun Wei, Teng Huang, Cong Cao, Yun Peng and Xuan Hu

Sensors 2023, 23(16), 7246; https://doi.org/10.3390/s23167246 - 18 Aug 2023

Cited by 9 | Viewed by 6124

Abstract

With the rapid development and widespread application of blockchain technology in recent years, smart contracts running on blockchains often face security vulnerability problems, resulting in significant economic losses. Unlike traditional programs, smart contracts cannot be modified once deployed, and vulnerabilities cannot be remedied. [...] Read more.

With the rapid development and widespread application of blockchain technology in recent years, smart contracts running on blockchains often face security vulnerability problems, resulting in significant economic losses. Unlike traditional programs, smart contracts cannot be modified once deployed, and vulnerabilities cannot be remedied. Therefore, the vulnerability detection of smart contracts has become a research focus. Most existing vulnerability detection methods are based on rules defined by experts, which are inefficient and have poor scalability. Although there have been studies using machine learning methods to extract contract features for vulnerability detection, the features considered are singular, and it is impossible to fully utilize smart contract information. In order to overcome the limitations of existing methods, this paper proposes a smart contract vulnerability detection method based on deep learning and multimodal decision fusion. This method also considers the code semantics and control structure information of smart contracts. It integrates the source code, operation code, and control-flow modes through the multimodal decision fusion method. The deep learning method extracts five features used to represent contracts and achieves high accuracy and recall rates. The experimental results show that the detection accuracy of our method for arithmetic vulnerability, re-entrant vulnerability, transaction order dependence, and Ethernet locking vulnerability can reach 91.6%, 90.9%, 94.8%, and 89.5%, respectively, and the detected AUC values can reach 0.834, 0.852, 0.886, and 0.825, respectively. This shows that our method has a good vulnerability detection effect. Furthermore, ablation experiments show that the multimodal decision fusion method contributes significantly to the fusion of different modalities. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

22 pages, 3027 KiB  

Open AccessArticle

Skeleton-Based Human Action Recognition Based on Single Path One-Shot Neural Architecture Search

by Yujian Jiang, Saisai Yu, Tianhao Wang, Zhaoneng Sun and Shuang Wang

Electronics 2023, 12(14), 3156; https://doi.org/10.3390/electronics12143156 - 20 Jul 2023

Cited by 3 | Viewed by 1538

Abstract

Skeleton-based human action recognition based on Neural Architecture Search (NAS.) adopts a one-shot NAS strategy. It improves the speed of evaluating candidate models in the search space through weight sharing, which has attracted significant attention. However, directly applying the one-shot NAS method for [...] Read more.

Skeleton-based human action recognition based on Neural Architecture Search (NAS.) adopts a one-shot NAS strategy. It improves the speed of evaluating candidate models in the search space through weight sharing, which has attracted significant attention. However, directly applying the one-shot NAS method for skeleton recognition requires training a super-net with a large search space that traverses various combinations of model parameters, which often leads to overly large network models and high computational costs. In addition, when training this super-net, the one-shot NAS needs to traverse the entire search space of the complete skeleton recognition task. Furthermore, the traditional method does not consider the optimization of the search strategy. As a result, a significant amount of search time is required to obtain a better skeleton recognition network model. A more efficient weighting model, a NAS skeleton recognition model based on the Single Path One-shot (SNAS-GCN) strategy, is proposed to address the above challenges. First, to reduce the model search space, a simplified four-category search space is introduced to replace the mainstream multi-category search space. Second, to improve the model search efficiency, a single-path one-shot approach is introduced, through which the model randomly samples one architecture at each step of the search training optimization. Finally, an adaptive Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is proposed to obtain a candidate structure of the perfect model automatically. With these three steps, the entire network architecture of the recognition model (and its weights) is fully and equally trained significantly. The search and training costs will be greatly reduced. The search-out model is trained by the NTU-RGB + D and Kinetics datasets to evaluate the performance of the proposed model’s search strategy. The experimental results show that the search time of the proposed method in this paper is 0.3 times longer than that of the state-of-the-art method. Meanwhile, the recognition accuracy is roughly comparable compared to that of the SOTA NAS-GCN method. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

15 pages, 8825 KiB  

Open AccessArticle

LPO-YOLOv5s: A Lightweight Pouring Robot Object Detection Algorithm

by Kanghui Zhao, Biaoxiong Xie, Xingang Miao and Jianqiang Xia

Sensors 2023, 23(14), 6399; https://doi.org/10.3390/s23146399 - 14 Jul 2023

Cited by 4 | Viewed by 1895

Abstract

The casting process involves pouring molten metal into a mold cavity. Currently, traditional object detection algorithms exhibit a low accuracy and are rarely used. An object detection model based on deep learning requires a large amount of memory and poses challenges in the [...] Read more.

The casting process involves pouring molten metal into a mold cavity. Currently, traditional object detection algorithms exhibit a low accuracy and are rarely used. An object detection model based on deep learning requires a large amount of memory and poses challenges in the deployment and resource allocation for resource limited pouring robots. To address the accurate identification and localization of pouring holes with limited resources, this paper designs a lightweight pouring robot hole detection algorithm named LPO-YOLOv5s, based on YOLOv5s. First, the MobileNetv3 network is introduced as a feature extraction network, to reduce model complexity and the number of parameters. Second, a depthwise separable information fusion module (DSIFM) is designed, and a lightweight operator called CARAFE is employed for feature upsampling, to enhance the feature extraction capability of the network. Finally, a dynamic head (DyHead) is adopted during the network prediction stage, to improve the detection performance. Extensive experiments were conducted on a pouring hole dataset, to evaluate the proposed method. Compared to YOLOv5s, our LPO-YOLOv5s algorithm reduces the parameter size by 45% and decreases computational costs by 55%, while sacrificing only 0.1% of mean average precision (mAP). The model size is only 7.74 MB, fulfilling the deployment requirements for pouring robots. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

17 pages, 6228 KiB  

Open AccessArticle

YOLO-Xray: A Bubble Defect Detection Algorithm for Chip X-ray Images Based on Improved YOLOv5

by Jie Wang, Bin Lin, Gaomin Li, Yuezheng Zhou, Lijun Zhong, Xuan Li and Xiaohu Zhang

Electronics 2023, 12(14), 3060; https://doi.org/10.3390/electronics12143060 - 13 Jul 2023

Cited by 9 | Viewed by 3394

Abstract

In the manufacturing of chips, the accurate and effective detection of internal bubble defects of chips is essential to maintain product reliability. In general, the inspection is performed manually by viewing X-ray images, which is time-consuming and less reliable. To solve the above [...] Read more.

In the manufacturing of chips, the accurate and effective detection of internal bubble defects of chips is essential to maintain product reliability. In general, the inspection is performed manually by viewing X-ray images, which is time-consuming and less reliable. To solve the above problems, an improved bubble defect detection model YOLO-Xray based on the YOLOv5 algorithm for chip X-ray images is proposed. First, the chip X-ray images are preprocessed by image segmentation to construct the chip X-ray defect dataset, namely, CXray. Then, in the input stage, the K-means++ algorithm is used to re-cluster the CXray dataset to generate the anchors suitable for our dataset. In the backbone network, a micro-scale detection head is added to improve the capabilities for small defect detection. In the neck network, the bi-direction feature fusion idea of BiFPN is used to construct a new feature fusion network based on the improved backbone to fuse the semantic features of different layers. In addition, the Quality Focal Loss function is used to replace the cross-entropy loss function to solve the imbalance of positive and negative samples. The experimental results show that the mean average precision (mAP) of the YOLO-Xray algorithm on the CXray dataset reaches 93.5%, which is 5.1% higher than the original YOLOv5. Meanwhile, the YOLO-Xray algorithm achieves state-of-the-art detection accuracy and speed compared with other mainstream object detection models. This shows the proposed YOLO-Xray algorithm can provide technical support for bubble defect detection in chip X-ray images. The CXray dataset is also open and available at CXray. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

16 pages, 3432 KiB  

Open AccessArticle

Accurate Nonlinearity and Temperature Compensation Method for Piezoresistive Pressure Sensors Based on Data Generation

by Mingxuan Zou, Ye Xu, Jianxiang Jin, Min Chu and Wenjun Huang

Sensors 2023, 23(13), 6167; https://doi.org/10.3390/s23136167 - 5 Jul 2023

Cited by 9 | Viewed by 2992

Abstract

Piezoresistive pressure sensors exhibit inherent nonlinearity and sensitivity to ambient temperature, requiring multidimensional compensation to achieve accurate measurements. However, recent studies on software compensation mainly focused on developing advanced and intricate algorithms while neglecting the importance of calibration data and the limitation of [...] Read more.

Piezoresistive pressure sensors exhibit inherent nonlinearity and sensitivity to ambient temperature, requiring multidimensional compensation to achieve accurate measurements. However, recent studies on software compensation mainly focused on developing advanced and intricate algorithms while neglecting the importance of calibration data and the limitation of computing resources. This paper aims to present a novel compensation method which generates more data by learning the calibration process of pressure sensors and uses a larger dataset instead of more complex models to improve the compensation effect. This method is performed by the proposed aquila optimizer optimized mixed polynomial kernel extreme learning machine (AO-MPKELM) algorithm. We conducted a detailed calibration experiment to assess the quality of the generated data and evaluate the performance of the proposed method through ablation analysis. The results demonstrate a high level of consistency between the generated and real data, with a maximum voltage deviation of only 0.71 millivolts. When using a bilinear interpolation algorithm for compensation, extra generated data can help reduce measurement errors by 78.95%, ultimately achieving 0.03% full-scale (FS) accuracy. These findings prove the proposed method is valid for high-accuracy measurements and has superior engineering applicability. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

15 pages, 1593 KiB  

Open AccessReview

Recent Advances in Deep Learning and Medical Imaging for Head and Neck Cancer Treatment: MRI, CT, and PET Scans

by Mathew Illimoottil and Daniel Ginat

Cancers 2023, 15(13), 3267; https://doi.org/10.3390/cancers15133267 - 21 Jun 2023

Cited by 21 | Viewed by 6642

Abstract

Deep learning techniques have been developed for analyzing head and neck cancer imaging. This review covers deep learning applications in cancer imaging, emphasizing tumor detection, segmentation, classification, and response prediction. In particular, advanced deep learning techniques, such as convolutional autoencoders, generative adversarial networks [...] Read more.

Deep learning techniques have been developed for analyzing head and neck cancer imaging. This review covers deep learning applications in cancer imaging, emphasizing tumor detection, segmentation, classification, and response prediction. In particular, advanced deep learning techniques, such as convolutional autoencoders, generative adversarial networks (GANs), and transformer models, as well as the limitations of traditional imaging and the complementary roles of deep learning and traditional techniques in cancer management are discussed. Integration of radiomics, radiogenomics, and deep learning enables predictive models that aid in clinical decision-making. Challenges include standardization, algorithm interpretability, and clinical validation. Key gaps and controversies involve model generalizability across different imaging modalities and tumor types and the role of human expertise in the AI era. This review seeks to encourage advancements in deep learning applications for head and neck cancer management, ultimately enhancing patient care and outcomes. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

32 pages, 3977 KiB  

Open AccessArticle

A Snapshot-Stacked Ensemble and Optimization Approach for Vehicle Breakdown Prediction

by Reza Khoshkangini, Mohsen Tajgardan, Jens Lundström, Mahdi Rabbani and Daniel Tegnered

Sensors 2023, 23(12), 5621; https://doi.org/10.3390/s23125621 - 15 Jun 2023

Cited by 2 | Viewed by 2316

Abstract

Predicting breakdowns is becoming one of the main goals for vehicle manufacturers so as to better allocate resources, and to reduce costs and safety issues. At the core of the utilization of vehicle sensors is the fact that early detection of anomalies facilitates [...] Read more.

Predicting breakdowns is becoming one of the main goals for vehicle manufacturers so as to better allocate resources, and to reduce costs and safety issues. At the core of the utilization of vehicle sensors is the fact that early detection of anomalies facilitates the prediction of potential breakdown issues, which, if otherwise undetected, could lead to breakdowns and warranty claims. However, the making of such predictions is too complex a challenge to solve using simple predictive models. The strength of heuristic optimization techniques in solving np-hard problems, and the recent success of ensemble approaches to various modeling problems, motivated us to investigate a hybrid optimization- and ensemble-based approach to tackle the complex task. In this study, we propose a snapshot-stacked ensemble deep neural network (SSED) approach to predict vehicle claims (in this study, we refer to a claim as being a breakdown or a fault) by considering vehicle operational life records. The approach includes three main modules: Data pre-processing, Dimensionality Reduction, and Ensemble Learning. The first module is developed to run a set of practices to integrate various sources of data, extract hidden information and segment the data into different time windows. In the second module, the most informative measurements to represent vehicle usage are selected through an adapted heuristic optimization approach. Finally, in the last module, the ensemble machine learning approach utilizes the selected measurements to map the vehicle usage to the breakdowns for the prediction. The proposed approach integrates, and uses, the following two sources of data, collected from thousands of heavy-duty trucks: Logged Vehicle Data (LVD) and Warranty Claim Data (WCD). The experimental results confirm the proposed system’s effectiveness in predicting vehicle breakdowns. By adapting the optimization and snapshot-stacked ensemble deep networks, we demonstrate how sensor data, in the form of vehicle usage history, contributes to claim predictions. The experimental evaluation of the system on other application domains also indicated the generality of the proposed approach. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

35 pages, 1490 KiB  

Open AccessReview

Machine Learning Techniques for Developing Remotely Monitored Central Nervous System Biomarkers Using Wearable Sensors: A Narrative Literature Review

by Ahnjili ZhuParris, Annika A. de Goede, Iris E. Yocarini, Wessel Kraaij, Geert Jan Groeneveld and Robert Jan Doll

Sensors 2023, 23(11), 5243; https://doi.org/10.3390/s23115243 - 31 May 2023

Cited by 6 | Viewed by 3339

Abstract

Background: Central nervous system (CNS) disorders benefit from ongoing monitoring to assess disease progression and treatment efficacy. Mobile health (mHealth) technologies offer a means for the remote and continuous symptom monitoring of patients. Machine Learning (ML) techniques can process and engineer mHealth data [...] Read more.

Background: Central nervous system (CNS) disorders benefit from ongoing monitoring to assess disease progression and treatment efficacy. Mobile health (mHealth) technologies offer a means for the remote and continuous symptom monitoring of patients. Machine Learning (ML) techniques can process and engineer mHealth data into a precise and multidimensional biomarker of disease activity. Objective: This narrative literature review aims to provide an overview of the current landscape of biomarker development using mHealth technologies and ML. Additionally, it proposes recommendations to ensure the accuracy, reliability, and interpretability of these biomarkers. Methods: This review extracted relevant publications from databases such as PubMed, IEEE, and CTTI. The ML methods employed across the selected publications were then extracted, aggregated, and reviewed. Results: This review synthesized and presented the diverse approaches of 66 publications that address creating mHealth-based biomarkers using ML. The reviewed publications provide a foundation for effective biomarker development and offer recommendations for creating representative, reproducible, and interpretable biomarkers for future clinical trials. Conclusion: mHealth-based and ML-derived biomarkers have great potential for the remote monitoring of CNS disorders. However, further research and standardization of study designs are needed to advance this field. With continued innovation, mHealth-based biomarkers hold promise for improving the monitoring of CNS disorders. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

15 pages, 1556 KiB  

Open AccessArticle

SVR-Net: A Sparse Voxelized Recurrent Network for Robust Monocular SLAM with Direct TSDF Mapping

by Rongling Lang, Ya Fan and Qing Chang

Sensors 2023, 23(8), 3942; https://doi.org/10.3390/s23083942 - 13 Apr 2023

Cited by 5 | Viewed by 2235

Abstract

Simultaneous localization and mapping (SLAM) plays a fundamental role in downstream tasks including navigation and planning. However, monocular visual SLAM faces challenges in robust pose estimation and map construction. This study proposes a monocular SLAM system based on a sparse voxelized recurrent network, [...] Read more.

Simultaneous localization and mapping (SLAM) plays a fundamental role in downstream tasks including navigation and planning. However, monocular visual SLAM faces challenges in robust pose estimation and map construction. This study proposes a monocular SLAM system based on a sparse voxelized recurrent network, SVR-Net. It extracts voxel features from a pair of frames for correlation and recursively matches them to estimate pose and dense map. The sparse voxelized structure is designed to reduce memory occupation of voxel features. Meanwhile, gated recurrent units are incorporated to iteratively search for optimal matches on correlation maps, thereby enhancing the robustness of the system. Additionally, Gauss–Newton updates are embedded in iterations to impose geometrical constraints, which ensure accurate pose estimation. After end-to-end training on ScanNet, SVR-Net is evaluated on TUM-RGBD and successfully estimates poses on all nine scenes, while traditional ORB-SLAM fails on most of them. Furthermore, absolute trajectory error (ATE) results demonstrate that the tracking accuracy is comparable to that of DeepV2D. Unlike most previous monocular SLAM systems, SVR-Net directly estimates dense TSDF maps suitable for downstream tasks with high efficiency of data exploitation. This study contributes to the development of robust monocular visual SLAM systems and direct TSDF mapping. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

22 pages, 9290 KiB  

Open AccessArticle

Cloud Based Fault Diagnosis by Convolutional Neural Network as Time–Frequency RGB Image Recognition of Industrial Machine Vibration with Internet of Things Connectivity

by Dominik Łuczak, Stefan Brock and Krzysztof Siembab

Sensors 2023, 23(7), 3755; https://doi.org/10.3390/s23073755 - 5 Apr 2023

Cited by 14 | Viewed by 3467

Abstract

The human-centric and resilient European industry called Industry 5.0 requires a long lifetime of machines to reduce electronic waste. The appropriate way to handle this problem is to apply a diagnostic system capable of remotely detecting, isolating, and identifying faults. The authors present [...] Read more.

The human-centric and resilient European industry called Industry 5.0 requires a long lifetime of machines to reduce electronic waste. The appropriate way to handle this problem is to apply a diagnostic system capable of remotely detecting, isolating, and identifying faults. The authors present usage of HTTP/1.1 protocol for batch processing as a fault diagnosis server. Data are sent by microcontroller HTTP client in JSON format to the diagnosis server. Moreover, the MQTT protocol was used for stream (micro batch) processing from microcontroller client to two fault diagnosis clients. The first fault diagnosis MQTT client uses only frequency data for evaluation. The authors’ enhancement to standard fast Fourier transform (FFT) was their usage of sliding discrete Fourier transform (rSDFT, mSDFT, gSDFT, and oSDFT) which allows recursively updating the spectrum based on a new sample in the time domain and previous results in the frequency domain. This approach allows to reduce the computational cost. The second approach of the MQTT client for fault diagnosis uses short-time Fourier transform (STFT) to transform IMU 6 DOF sensor data into six spectrograms that are combined into an RGB image. All three-axis accelerometer and three-axis gyroscope data are used to obtain a time-frequency RGB image. The diagnosis of the machine is performed by a trained convolutional neural network suitable for RGB image recognition. Prediction result is returned as a JSON object with predicted state and probability of each state. For HTTP, the fault diagnosis result is sent in response, and for MQTT, it is send to prediction topic. Both protocols and both proposed approaches are suitable for fault diagnosis based on the mechanical vibration of the rotary machine and were tested in demonstration. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

14 pages, 1744 KiB  

Open AccessArticle

Cluster Validity Index for Uncertain Data Based on a Probabilistic Distance Measure in Feature Space

by Changwan Ko, Jaeseung Baek, Behnam Tavakkol and Young-Seon Jeong

Sensors 2023, 23(7), 3708; https://doi.org/10.3390/s23073708 - 3 Apr 2023

Cited by 3 | Viewed by 2025

Abstract

Cluster validity indices (CVIs) for evaluating the result of the optimal number of clusters are critical measures in clustering problems. Most CVIs are designed for typical data-type objects called certain data objects. Certain data objects only have a singular value and include no [...] Read more.

Cluster validity indices (CVIs) for evaluating the result of the optimal number of clusters are critical measures in clustering problems. Most CVIs are designed for typical data-type objects called certain data objects. Certain data objects only have a singular value and include no uncertainty, so they are assumed to be information-abundant in the real world. In this study, new CVIs for uncertain data, based on kernel probabilistic distance measures to calculate the distance between two distributions in feature space, are proposed for uncertain clusters with arbitrary shapes, sub-clusters, and noise in objects. By transforming original uncertain data into kernel spaces, the proposed CVI accurately measures the compactness and separability of a cluster for arbitrary cluster shapes and is robust to noise and outliers in a cluster. The proposed CVI was evaluated for diverse types of simulated and real-life uncertain objects, confirming that the proposed validity indexes in feature space outperform the pre-existing ones in the original space. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

16 pages, 7452 KiB  

Open AccessArticle

Industrial Transfer Learning for Multivariate Time Series Segmentation: A Case Study on Hydraulic Pump Testing Cycles

by Stefan Gaugel and Manfred Reichert

Sensors 2023, 23(7), 3636; https://doi.org/10.3390/s23073636 - 31 Mar 2023

Cited by 6 | Viewed by 2526

Abstract

Industrial data scarcity is one of the largest factors holding back the widespread use of machine learning in manufacturing. To overcome this problem, the concept of transfer learning was developed and has received much attention in recent industrial research. This paper focuses on [...] Read more.

Industrial data scarcity is one of the largest factors holding back the widespread use of machine learning in manufacturing. To overcome this problem, the concept of transfer learning was developed and has received much attention in recent industrial research. This paper focuses on the problem of time series segmentation and presents the first in-depth research on transfer learning for deep learning-based time series segmentation on the industrial use case of end-of-line pump testing. In particular, we investigate whether the performance of deep learning models can be increased by pretraining the network with data from other domains. Three different scenarios are analyzed: source and target data being closely related, source and target data being distantly related, and source and target data being non-related. The results demonstrate that transfer learning can enhance the performance of time series segmentation models with respect to accuracy and training speed. The benefit can be most clearly seen in scenarios where source and training data are closely related and the number of target training data samples is lowest. However, in the scenario of non-related datasets, cases of negative transfer learning were observed as well. Thus, the research emphasizes the potential, but also the challenges, of industrial transfer learning. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

18 pages, 592 KiB  

Open AccessArticle

Feature Interaction-Based Reinforcement Learning for Tabular Anomaly Detection

by Yaoxun Liu, Liangli Ma, Muyuan Wang and Siyuan Zhang

Electronics 2023, 12(6), 1313; https://doi.org/10.3390/electronics12061313 - 9 Mar 2023

Cited by 1 | Viewed by 2139

Abstract

Deep learning-based anomaly detection (DAD) has been a hot topic of research in various domains. Despite being the most common data type, DAD for tabular data remains under-explored. Due to the scarcity of anomalies in real-world scenarios, deep semi-supervised learning methods have come [...] Read more.

Deep learning-based anomaly detection (DAD) has been a hot topic of research in various domains. Despite being the most common data type, DAD for tabular data remains under-explored. Due to the scarcity of anomalies in real-world scenarios, deep semi-supervised learning methods have come to dominate, which build deep learning models and leverage a limited number of labeled anomalies and large-scale unlabeled data to improve their detection capabilities. However, existing works share two drawbacks. (1) Most of them simply treat the unlabeled samples as normal ones, ignoring the problem of label contamination, which is very common in real-world datasets. (2) Only very few works have designed models specifically for tabular data instead of migrating models from other domains to tabular data. Both of them will limit the model’s performance. In this work, we propose a feature interaction-based reinforcement learning for tabular anomaly detection, FIRTAD. FIRTAD incorporates a feature interaction module into a deep reinforcement learning framework; the former can model tabular data by learning a relationship among features, while the latter can effectively exploit available information and fully explore suspicious anomalies from the unlabeled samples. Extensive experiments on three datasets not only demonstrate its superiority over the state-of-art methods but also confirm its robustness to anomaly rarity, label contamination and unknown anomalies. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

17 pages, 3074 KiB  

Open AccessArticle

Cost-Sensitive YOLOv5 for Detecting Surface Defects of Industrial Products

by Ben Liu, Feng Gao and Yan Li

Sensors 2023, 23(5), 2610; https://doi.org/10.3390/s23052610 - 27 Feb 2023

Cited by 5 | Viewed by 2770

Abstract

Owing to the remarkable development of deep learning algorithms, defect detection techniques based on deep neural networks have been extensively applied in industrial production. Most existing surface defect detection models assign equal costs to the classification errors among different defect categories but do [...] Read more.

Owing to the remarkable development of deep learning algorithms, defect detection techniques based on deep neural networks have been extensively applied in industrial production. Most existing surface defect detection models assign equal costs to the classification errors among different defect categories but do not strictly distinguish them. However, various errors can generate a great discrepancy in decision risk or classification costs and then produce a cost-sensitive issue that is crucial to the manufacturing process. To address this engineering challenge, we propose a novel supervised classification cost-sensitive learning method (SCCS) and apply it to improve YOLOv5 as CS-YOLOv5, where the classification loss function of object detection was reconstructed according to a new cost-sensitive learning criterion explained by a label–cost vector selection method. In this way, the classification risk information from a cost matrix is directly introduced into the detection model and fully exploited in training. As a result, the developed approach can make low-risk classification decisions for defect detection. It is applicable for direct cost-sensitive learning based on a cost matrix to implement detection tasks. Using two datasets of a painting surface and a hot-rolled steel strip surface, our CS-YOLOv5 model outperforms the original version with respect to cost under different positive classes, coefficients, and weight ratios, but also maintains effective detection performance measured by mAP and F1 scores. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

24 pages, 3593 KiB  

Open AccessArticle

An Optimization Method of Production-Distribution in Multi-Value-Chain

by Shihao Wang, Jianxiong Zhang, Xuefeng Ding, Dasha Hu, Baojian Wang, Bing Guo, Jun Tang, Ke Du, Chao Tang and Yuming Jiang

Sensors 2023, 23(4), 2242; https://doi.org/10.3390/s23042242 - 16 Feb 2023

Cited by 1 | Viewed by 2127

Abstract

Value chain collaboration management is an effective means for enterprises to reduce costs and increase efficiency to enhance competitiveness. Vertical and horizontal collaboration have received much attention, but the current collaboration model combining the two is weak in terms of task assignment and [...] Read more.

Value chain collaboration management is an effective means for enterprises to reduce costs and increase efficiency to enhance competitiveness. Vertical and horizontal collaboration have received much attention, but the current collaboration model combining the two is weak in terms of task assignment and node collaboration constraints in the whole production-distribution process. Therefore, in the enterprise dynamic alliance, this paper models the MVC (multi-value-chain) collaboration process for the optimization needs of the MVC collaboration network in production-distribution and other aspects. Then a MVC collaboration network optimization model is constructed with the lowest total production-distribution cost as the optimization objective and with the delivery cycle and task quantity as the constraints. For the high-dimensional characteristics of the decision space in the multi-task, multi-production end, multi-distribution end, and multi-level inventory production-distribution scenario, a genetic algorithm is used to solve the MVC collaboration network optimization model and solve the problem of difficult collaboration of MVC collaboration network nodes by adjusting the constraints among genes. In view of the multi-level characteristics of the production-distribution scenario, two chromosome coding methods are proposed: staged coding and integrated coding. Moreover, an algorithm ERGA (enhanced roulette genetic algorithm) is proposed with enhanced elite retention based on a SGA (simple genetic algorithm). The comparative experiment results of SGA, SEGA (strengthen elitist genetic algorithm), ERGA, and the analysis of the population evolution process show that ERGA is superior to SGA and SEGA in terms of time cost and optimization results through the reasonable combination of coding methods and selection operators. Furthermore, ERGA has higher generality and can be adapted to solve MVC collaboration network optimization models in different production-distribution environments. Full article

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)

►▼ Show Figures

Figure 1

Show export options expand_more Show export options expand_less

Select all

Export citation of selected articles as:

Plain Text BibTeX BibTeX (without abstracts) Endnote Endnote (without abstracts) Tab-delimited RIS

 

Error

Oops... you haven't selected anything for export.

Ok

clear

Displaying articles 1-65