sensors-logo

Journal Browser

Journal Browser

Artificial Intelligence for Smart Manufacturing: Methods and Applications

A special issue of Sensors (ISSN 1424-8220). This special issue belongs to the section "Intelligent Sensors".

Deadline for manuscript submissions: closed (30 June 2021) | Viewed by 102322

Special Issue Editor


E-Mail Website
Guest Editor
Department of Automation and Industrial Informatics, ENSAIT & GEMTEX, University of Lille, 2 allée Louise et Victor Champier, 59056 Roubaix, France
Interests: Internet of Things; web sites; clothing; computer network security; condition monitoring; data analysis; data description; data mining; industrial control; learning (artificial intelligence); natural language processing; production engineering computing; support vector machines; telecommunication computing; text analysis; wireless sensor networks
Special Issues, Collections and Topics in MDPI journals

Special Issue Information

Dear Colleagues,

Thanks to the rapid development and applications of advanced technologies, we are experiencing the fourth industrial revolution, or Industry 4.0, which is a revolution towards smart manufacturing. The wide use of cyberphysical systems and the Internet of Things has led to the era of big data in industrial manufacturing. Artificial intelligence emerges as a powerful analytics tool to process and analyze big data. These advanced technologies result in the introduction of a new concept in Industry 4.0: smart manufacturing. The aim of this Special Issue is to highlight innovative developments with respect to the current challenges and opportunities for the applications of artificial intelligence in smart manufacturing. Topics include but are not limited to the following: real-time monitoring with machine learning and deep learning; artificial intelligence for predictive maintenance; artificial intelligence for smarter cybersecurity; production scheduling with reinforcement learning; artificial intelligence and robotics in smart manufacturing; IoT-enabled smart manufacturing; digital twin-driven smart manufacturing. 

Dr. Kim Phuc Tran
Guest Editor

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Sensors is an international peer-reviewed open access semimonthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • artificial intelligence
  • smart manufacturing
  • production scheduling
  • IoT, digital twin
  • cybersecurity
  • predictive maintenance

Benefits of Publishing in a Special Issue

  • Ease of navigation: Grouping papers by topic helps scholars navigate broad scope journals more efficiently.
  • Greater discoverability: Special Issues support the reach and impact of scientific research. Articles in Special Issues are more discoverable and cited more frequently.
  • Expansion of research network: Special Issues facilitate connections among authors, fostering scientific collaborations.
  • External promotion: Articles in Special Issues are often promoted through the journal's social media, increasing their visibility.
  • e-Book format: Special Issues with more than 10 articles can be published as dedicated e-books, ensuring wide and rapid dissemination.

Further information on MDPI's Special Issue polices can be found here.

Published Papers (20 papers)

Order results
Result details
Select all
Export citation of selected articles as:

Editorial

Jump to: Research, Other

3 pages, 166 KiB  
Editorial
Artificial Intelligence for Smart Manufacturing: Methods and Applications
by Kim Phuc Tran
Sensors 2021, 21(16), 5584; https://doi.org/10.3390/s21165584 - 19 Aug 2021
Cited by 13 | Viewed by 5706
Abstract
The term Industry 4.0 has become increasingly pervasive in the context of industrial manufacturing and it has been considered the fourth industrial revolution (Henning [1]) [...] Full article

Research

Jump to: Editorial, Other

20 pages, 1382 KiB  
Article
Deep Convolutional Clustering-Based Time Series Anomaly Detection
by Gavneet Singh Chadha, Intekhab Islam, Andreas Schwung and Steven X. Ding
Sensors 2021, 21(16), 5488; https://doi.org/10.3390/s21165488 - 15 Aug 2021
Cited by 25 | Viewed by 6268
Abstract
This paper presents a novel approach for anomaly detection in industrial processes. The system solely relies on unlabeled data and employs a 1D-convolutional neural network-based deep autoencoder architecture. As a core novelty, we split the autoencoder latent space in discriminative and reconstructive latent [...] Read more.
This paper presents a novel approach for anomaly detection in industrial processes. The system solely relies on unlabeled data and employs a 1D-convolutional neural network-based deep autoencoder architecture. As a core novelty, we split the autoencoder latent space in discriminative and reconstructive latent features and introduce an auxiliary loss based on k-means clustering for the discriminatory latent variables. We employ a Top-K clustering objective for separating the latent space, selecting the most discriminative features from the latent space. We use the approach to the benchmark Tennessee Eastman data set to prove its applicability. We provide different ablation studies and analyze the method concerning various downstream tasks, including anomaly detection, binary and multi-class classification. The obtained results show the potential of the approach to improve downstream tasks compared to standard autoencoder architectures. Full article
Show Figures

Figure 1

22 pages, 10704 KiB  
Article
Estimation of Tool Wear and Surface Roughness Development Using Deep Learning and Sensors Fusion
by Pao-Ming Huang and Ching-Hung Lee
Sensors 2021, 21(16), 5338; https://doi.org/10.3390/s21165338 - 7 Aug 2021
Cited by 35 | Viewed by 4838
Abstract
This paper proposes an estimation approach for tool wear and surface roughness using deep learning and sensor fusion. The one-dimensional convolutional neural network (1D-CNN) is utilized as the estimation model with X- and Y-coordinate vibration signals and sound signal fusion using sensor influence [...] Read more.
This paper proposes an estimation approach for tool wear and surface roughness using deep learning and sensor fusion. The one-dimensional convolutional neural network (1D-CNN) is utilized as the estimation model with X- and Y-coordinate vibration signals and sound signal fusion using sensor influence analysis. First, machining experiments with computer numerical control (CNC) parameters are designed using a uniform experimental design (UED) method to guarantee the variety of collected data. The vibration, sound, and spindle current signals are collected and labeled according to the machining parameters. To speed up the degree of tool wear, an accelerated experiment is designed, and the corresponding tool wear and surface roughness are measured. An influential sensor selection analysis is proposed to preserve the estimation accuracy and to minimize the number of sensors. After sensor selection analysis, the sensor signals with better estimation capability are selected and combined using the sensor fusion method. The proposed estimation system combined with sensor selection analysis performs well in terms of accuracy and computational effort. Finally, the proposed approach is applied for on-line monitoring of tool wear with an alarm, which demonstrates the effectiveness of our approach. Full article
Show Figures

Figure 1

19 pages, 3477 KiB  
Article
Product Inspection Methodology via Deep Learning: An Overview
by Tae-Hyun Kim, Hye-Rin Kim and Yeong-Jun Cho
Sensors 2021, 21(15), 5039; https://doi.org/10.3390/s21155039 - 25 Jul 2021
Cited by 14 | Viewed by 4301
Abstract
In this study, we present a framework for product quality inspection based on deep learning techniques. First, we categorize several deep learning models that can be applied to product inspection systems. In addition, we explain the steps for building a deep-learning-based inspection system [...] Read more.
In this study, we present a framework for product quality inspection based on deep learning techniques. First, we categorize several deep learning models that can be applied to product inspection systems. In addition, we explain the steps for building a deep-learning-based inspection system in detail. Second, we address connection schemes that efficiently link deep learning models to product inspection systems. Finally, we propose an effective method that can maintain and enhance a product inspection system according to improvement goals of the existing product inspection systems. The proposed system is observed to possess good system maintenance and stability owing to the proposed methods. All the proposed methods are integrated into a unified framework and we provide detailed explanations of each proposed method. In order to verify the effectiveness of the proposed system, we compare and analyze the performance of the methods in various test scenarios. We expect that our study will provide useful guidelines to readers who desire to implement deep-learning-based systems for product inspection. Full article
Show Figures

Graphical abstract

18 pages, 6979 KiB  
Article
Use of Long Short-Term Memory for Remaining Useful Life and Degradation Assessment Prediction of Dental Air Turbine Handpiece in Milling Process
by Yi-Cheng Huang and Yu-Hsien Chen
Sensors 2021, 21(15), 4978; https://doi.org/10.3390/s21154978 - 22 Jul 2021
Cited by 3 | Viewed by 2317
Abstract
The complexity of the internal components of dental air turbine handpieces has been increasing over time. To make operations reliable and ensure patients’ safety, this study established long short-term memory (LSTM) prediction models with the functions of learning, storing, and transmitting memory for [...] Read more.
The complexity of the internal components of dental air turbine handpieces has been increasing over time. To make operations reliable and ensure patients’ safety, this study established long short-term memory (LSTM) prediction models with the functions of learning, storing, and transmitting memory for monitoring the health and degradation of dental air turbine handpieces. A handpiece was used to cut a glass porcelain block back and forth. An accelerometer was used to obtain vibration signals during the free running of the handpiece to identify the characteristic frequency of these vibrations in the frequency domain. This information was used to establish a health index (HI) for developing prediction models. The many-to-one and many-to-many LSTM frameworks were used for machine learning to establish prediction models for the HI and degradation trajectory. The results indicate that, in terms of HI predicted for the testing dataset, the mean square error of the many-to-one LSTM framework was lower than that that of a logistic regression model, which did not have a memory framework. Nevertheless, high accuracies were achieved with both of the two aforementioned approaches. In general, the degradation trajectory prediction model could accurately predict the degradation trend of the dental handpiece; thus, this model can be a useful tool for predicting the degradation trajectory of real dental handpieces in the future. Full article
Show Figures

Figure 1

13 pages, 3051 KiB  
Article
Printed Circuit Board Defect Detection Using Deep Learning via A Skip-Connected Convolutional Autoencoder
by Jungsuk Kim, Jungbeom Ko, Hojong Choi and Hyunchul Kim
Sensors 2021, 21(15), 4968; https://doi.org/10.3390/s21154968 - 21 Jul 2021
Cited by 103 | Viewed by 15706
Abstract
As technology evolves, more components are integrated into printed circuit boards (PCBs) and the PCB layout increases. Because small defects on signal trace can cause significant damage to the system, PCB surface inspection is one of the most important quality control processes. Owing [...] Read more.
As technology evolves, more components are integrated into printed circuit boards (PCBs) and the PCB layout increases. Because small defects on signal trace can cause significant damage to the system, PCB surface inspection is one of the most important quality control processes. Owing to the limitations of manual inspection, significant efforts have been made to automate the inspection by utilizing high resolution CCD or CMOS sensors. Despite the advanced sensor technology, setting the pass/fail criteria based on small failure samples has always been challenging in traditional machine vision approaches. To overcome these problems, we propose an advanced PCB inspection system based on a skip-connected convolutional autoencoder. The deep autoencoder model was trained to decode the original non-defect images from the defect images. The decoded images were then compared with the input image to identify the defect location. To overcome the small and imbalanced dataset in the early manufacturing stage, we applied appropriate image augmentation to improve the model training performance. The experimental results reveal that a simple unsupervised autoencoder model delivers promising performance, with a detection rate of up to 98% and a false pass rate below 1.7% for the test data, containing 3900 defect and non-defect images. Full article
Show Figures

Figure 1

23 pages, 9174 KiB  
Article
Towards Semantic Integration of Machine Vision Systems to Aid Manufacturing Event Understanding
by Kaishu Xia, Clint Saidy, Max Kirkpatrick, Noble Anumbe, Amit Sheth and Ramy Harik
Sensors 2021, 21(13), 4276; https://doi.org/10.3390/s21134276 - 22 Jun 2021
Cited by 15 | Viewed by 4897
Abstract
A manufacturing paradigm shift from conventional control pyramids to decentralized, service-oriented, and cyber-physical systems (CPSs) is taking place in today’s 4th industrial revolution. Generally accepted roles and implementation recipes of cyber systems are expected to be standardized in the future of manufacturing industry. [...] Read more.
A manufacturing paradigm shift from conventional control pyramids to decentralized, service-oriented, and cyber-physical systems (CPSs) is taking place in today’s 4th industrial revolution. Generally accepted roles and implementation recipes of cyber systems are expected to be standardized in the future of manufacturing industry. The authors intend to develop a novel CPS-enabled control architecture that accommodates: (1) intelligent information systems involving domain knowledge, empirical model, and simulation; (2) fast and secured industrial communication networks; (3) cognitive automation by rapid signal analytics and machine learning (ML) based feature extraction; (4) interoperability between machine and human. Semantic integration of process indicators is fundamental to the success of such implementation. This work proposes an automated semantic integration of data-intensive process signals that is deployable to industrial signal-based control loops. The proposed system rapidly infers manufacturing events from image-based data feeds, and hence triggers process control signals. Two image inference approaches are implemented: cloud-based ML model query and edge-end object shape detection. Depending on use cases and task requirements, these two approaches can be designated with different event detection tasks to provide a comprehensive system self-awareness. Coupled with conventional industrial sensor signals, machine vision system can rapidly understand manufacturing scenes, and feed extracted semantic information to a manufacturing ontology developed by either expert or ML-enabled cyber systems. Moreover, extracted signals are interpreted by Programmable Logical Controllers (PLCs) and field devices for cognitive automation towards fully autonomous industrial systems. Full article
Show Figures

Figure 1

28 pages, 1381 KiB  
Article
Development of an Intelligent Data-Driven System to Recommend Personalized Fashion Design Solutions
by Shukla Sharma, Ludovic Koehl, Pascal Bruniaux, Xianyi Zeng and Zhujun Wang
Sensors 2021, 21(12), 4239; https://doi.org/10.3390/s21124239 - 21 Jun 2021
Cited by 30 | Viewed by 5427
Abstract
In the context of fashion/textile innovations towards Industry 4.0, a variety of digital technologies, such as 3D garment CAD, have been proposed to automate, optimize design and manufacturing processes in the organizations of involved enterprises and supply chains as well as services such [...] Read more.
In the context of fashion/textile innovations towards Industry 4.0, a variety of digital technologies, such as 3D garment CAD, have been proposed to automate, optimize design and manufacturing processes in the organizations of involved enterprises and supply chains as well as services such as marketing and sales. However, the current digital solutions rarely deal with key elements used in the fashion industry, including professional knowledge, as well as fashion and functional requirements of the customer and their relations with product technical parameters. Especially, product design plays an essential role in the whole fashion supply chain and should be paid more attention to in the process of digitalization and intelligentization of fashion companies. In this context, we originally developed an interactive fashion and garment design system by systematically integrating a number of data-driven services of garment design recommendation, 3D virtual garment fitting visualization, design knowledge base, and design parameters adjustment. This system enables close interactions between the designer, consumer, and manufacturer around the virtual product corresponding to each design solution. In this way, the complexity of the product design process can drastically be reduced by directly integrating the consumer’s perception and professional designer’s knowledge into the garment computer-aided design (CAD) environment. Furthermore, for a specific consumer profile, the related computations (design solution recommendation and design parameters adjustment) are performed by using a number of intelligent algorithms (BIRCH, adaptive Random Forest algorithms, and association mining) and matching with a formalized design knowledge base. The proposed interactive design system has been implemented and then exposed through the REST API, for designing garments meeting the consumer’s personalized fashion requirements by repeatedly running the cycle of design recommendation—virtual garment fitting—online evaluation of designer and consumer—design parameters adjustment—design knowledge base creation, and updating. The effectiveness of the proposed system has been validated through a business case of personalized men’s shirt design. Full article
Show Figures

Figure 1

20 pages, 1782 KiB  
Article
Intelligent Decision-Making of Scheduling for Dynamic Permutation Flowshop via Deep Reinforcement Learning
by Shengluo Yang, Zhigang Xu and Junyi Wang
Sensors 2021, 21(3), 1019; https://doi.org/10.3390/s21031019 - 2 Feb 2021
Cited by 41 | Viewed by 5654
Abstract
Dynamic scheduling problems have been receiving increasing attention in recent years due to their practical implications. To realize real-time and the intelligent decision-making of dynamic scheduling, we studied dynamic permutation flowshop scheduling problem (PFSP) with new job arrival using deep reinforcement learning (DRL). [...] Read more.
Dynamic scheduling problems have been receiving increasing attention in recent years due to their practical implications. To realize real-time and the intelligent decision-making of dynamic scheduling, we studied dynamic permutation flowshop scheduling problem (PFSP) with new job arrival using deep reinforcement learning (DRL). A system architecture for solving dynamic PFSP using DRL is proposed, and the mathematical model to minimize total tardiness cost is established. Additionally, the intelligent scheduling system based on DRL is modeled, with state features, actions, and reward designed. Moreover, the advantage actor-critic (A2C) algorithm is adapted to train the scheduling agent. The learning curve indicates that the scheduling agent learned to generate better solutions efficiently during training. Extensive experiments are carried out to compare the A2C-based scheduling agent with every single action, other DRL algorithms, and meta-heuristics. The results show the well performance of the A2C-based scheduling agent considering solution quality, CPU times, and generalization. Notably, the trained agent generates a scheduling action only in 2.16 ms on average, which is almost instantaneous and can be used for real-time scheduling. Our work can help to build a self-learning, real-time optimizing, and intelligent decision-making scheduling system. Full article
Show Figures

Figure 1

17 pages, 1154 KiB  
Article
Real-Time Monitoring for Hydraulic States Based on Convolutional Bidirectional LSTM with Attention Mechanism
by Kyutae Kim and Jongpil Jeong
Sensors 2020, 20(24), 7099; https://doi.org/10.3390/s20247099 - 11 Dec 2020
Cited by 17 | Viewed by 3350
Abstract
By monitoring a hydraulic system using artificial intelligence, we can detect anomalous data in a manufacturing workshop. In addition, by analyzing the anomalous data, we can diagnose faults and prevent failures. However, artificial intelligence, especially deep learning, needs to learn much data, and [...] Read more.
By monitoring a hydraulic system using artificial intelligence, we can detect anomalous data in a manufacturing workshop. In addition, by analyzing the anomalous data, we can diagnose faults and prevent failures. However, artificial intelligence, especially deep learning, needs to learn much data, and it is often difficult to get enough data at the real manufacturing site. In this paper, we apply augmentation to increase the amount of data. In addition, we propose real-time monitoring based on a deep-learning model that uses convergence of a convolutional neural network (CNN), a bidirectional long short-term memory network (BiLSTM), and an attention mechanism. CNN extracts features from input data, and BiLSTM learns feature information. The learned information is then fed to the sigmoid classifier to find out if it is normal or abnormal. Experimental results show that the proposed model works better than other deep-learning models, such as CNN or long short-term memory (LSTM). Full article
Show Figures

Figure 1

16 pages, 6131 KiB  
Article
VODCA: Verification of Diagnosis Using CAM-Based Approach for Explainable Process Monitoring
by Cheolhwan Oh and Jongpil Jeong
Sensors 2020, 20(23), 6858; https://doi.org/10.3390/s20236858 - 30 Nov 2020
Cited by 13 | Viewed by 3027
Abstract
Process monitoring at industrial sites contributes to system stability by detecting and diagnosing unexpected changes in a system. Today, as the infrastructure of industrial sites is advancing because of the development of communication technology, vast amounts of data are generated, and the importance [...] Read more.
Process monitoring at industrial sites contributes to system stability by detecting and diagnosing unexpected changes in a system. Today, as the infrastructure of industrial sites is advancing because of the development of communication technology, vast amounts of data are generated, and the importance of a way to effectively monitor such data in order to diagnose a system is increasing daily. Because a method based on a deep neural network can effectively extract information from a large amount of data, methods have been proposed to monitor processes using such networks to detect system faults and abnormalities. Neural-network-based process monitoring is effective in detecting faults, but has difficulty in diagnosing because of the limitations of the black-box model. Therefore, in this paper we propose a process-monitoring framework that can detect and diagnose faults. The proposed method uses a class activation map that results from diagnosis of faults and abnormalities, and verifies the diagnosis by post-processing the class activation map. This improves the detection of faults and abnormalities and generates a class activation map that provides a more verified diagnosis to the end user. In order to evaluate the performance of the proposed method, we did a simulation using publicly available industrial motor datasets. In addition, after establishing a system that can apply the proposed method to actual manufacturing companies that produce sapphire nozzles, we carried out a case study on whether fault detection and diagnosis were possible. Full article
Show Figures

Figure 1

32 pages, 790 KiB  
Article
A Modified Genetic Algorithm with Local Search Strategies and Multi-Crossover Operator for Job Shop Scheduling Problem
by Monique Simplicio Viana, Orides Morandin Junior and Rodrigo Colnago Contreras
Sensors 2020, 20(18), 5440; https://doi.org/10.3390/s20185440 - 22 Sep 2020
Cited by 43 | Viewed by 5609
Abstract
It is not uncommon for today’s problems to fall within the scope of the well-known class of NP-Hard problems. These problems generally do not have an analytical solution, and it is necessary to use meta-heuristics to solve them. The Job Shop Scheduling Problem [...] Read more.
It is not uncommon for today’s problems to fall within the scope of the well-known class of NP-Hard problems. These problems generally do not have an analytical solution, and it is necessary to use meta-heuristics to solve them. The Job Shop Scheduling Problem (JSSP) is one of these problems, and for its solution, techniques based on Genetic Algorithm (GA) form the most common approach used in the literature. However, GAs are easily compromised by premature convergence and can be trapped in a local optima. To address these issues, researchers have been developing new methodologies based on local search schemes and improvements to standard mutation and crossover operators. In this work, we propose a new GA within this line of research. In detail, we generalize the concept of a massive local search operator; we improved the use of a local search strategy in the traditional mutation operator; and we developed a new multi-crossover operator. In this way, all operators of the proposed algorithm have local search functionality beyond their original inspirations and characteristics. Our method is evaluated in three different case studies, comprising 58 instances of literature, which prove the effectiveness of our approach compared to traditional JSSP solution methods. Full article
Show Figures

Figure 1

12 pages, 394 KiB  
Article
Artificial Intelligence-Driven Oncology Clinical Decision Support System for Multidisciplinary Teams
by Kyounga Lee and Seon Heui Lee
Sensors 2020, 20(17), 4693; https://doi.org/10.3390/s20174693 - 20 Aug 2020
Cited by 15 | Viewed by 3459
Abstract
Watson for Oncology (WfO) is a clinical decision support system driven by artificial intelligence. In Korea, WfO is used by multidisciplinary teams (MDTs) caring for cancer patients. This study aimed to investigate the effect of WfO use on hospital satisfaction and perception among [...] Read more.
Watson for Oncology (WfO) is a clinical decision support system driven by artificial intelligence. In Korea, WfO is used by multidisciplinary teams (MDTs) caring for cancer patients. This study aimed to investigate the effect of WfO use on hospital satisfaction and perception among patients cared for by MDTs. This was a descriptive study that used a written survey to gather information from cancer patients at a hospital in Korea. The rate of positive change in patient perception after treatment was 86.8% in the MDT-WfO group and 71.2% in the MDT group. In terms of easily understandable explanations, the MDT-WfO (9.53 points) group reported higher satisfaction than the MDT group (9.24 points). Younger patients in the MDT-WfO group showed high levels of satisfaction and reliability of treatment. When WfO was used, the probability of positive change in patient perception of the hospital was 2.53 times higher than when WfO was not used. With a one-point increase in overall satisfaction, the probability of positive change in patient perception of the hospital increased 1.97 times. Therefore, if WfO is used appropriately in the medical field, it may enhance patient satisfaction and change patient perception positively. Full article
Show Figures

Figure 1

23 pages, 11147 KiB  
Article
Multilabel Image Classification Based Fresh Concrete Mix Proportion Monitoring Using Improved Convolutional Neural Network
by Han Yang, Shuang-Jian Jiao and Feng-De Yin
Sensors 2020, 20(16), 4638; https://doi.org/10.3390/s20164638 - 18 Aug 2020
Cited by 8 | Viewed by 3085
Abstract
Proper and accurate mix proportion is deemed to be crucial for the concrete in service to implement its structural functions in a specific environment and structure. Neither existing testing methods nor previous studies have, to date, addressed the problem of real-time and full-scale [...] Read more.
Proper and accurate mix proportion is deemed to be crucial for the concrete in service to implement its structural functions in a specific environment and structure. Neither existing testing methods nor previous studies have, to date, addressed the problem of real-time and full-scale monitoring of fresh concrete mix proportion during manufacturing. Green manufacturing and safety construction are hindered by such defects. In this study, a state-of-the-art method based on improved convolutional neural network multilabel image classification is presented for mix proportion monitoring. Elaborately planned, uniformly distributed, widely covered and high-quality images of concrete mixtures were collected as dataset during experiments. Four convolutional neural networks were improved or fine-tuned based on two solutions for multilabel image classification problems, since original networks are tailored for single-label multiclassification tasks, but mix proportions are determined by multiple parameters. Various metrices for effectiveness evaluation of training and testing all indicated that four improved network models showed outstanding learning and generalization ability during training and testing. The best-performing one was embedded into executable application and equipped with hardware facilities to establish fresh concrete mix proportion monitoring system. Such system was deployed to terminals and united with mechanical and weighing sensors to establish integrated intelligent sensing system. Fresh concrete mix proportion real-time and full-scale monitoring and inaccurate mix proportion sensing and warning could be achieved simply by taking pictures and feeding pictures into such sensing system instead of conducting experiments in laboratory after specimen retention. Full article
Show Figures

Figure 1

28 pages, 3422 KiB  
Article
Recognition of the Driving Style in Vehicle Drivers
by Jorge Cordero, Jose Aguilar, Kristell Aguilar, Danilo Chávez and Eduard Puerto
Sensors 2020, 20(9), 2597; https://doi.org/10.3390/s20092597 - 2 May 2020
Cited by 27 | Viewed by 5090
Abstract
This paper presents three different approaches to recognize driving style based on a hierarchical-model. Specifically, it proposes a hierarchical model for the recognition of the driving style for advanced driver-assistance systems (ADAS) for vehicles. This hierarchical model for the recognition of the style [...] Read more.
This paper presents three different approaches to recognize driving style based on a hierarchical-model. Specifically, it proposes a hierarchical model for the recognition of the driving style for advanced driver-assistance systems (ADAS) for vehicles. This hierarchical model for the recognition of the style of the car driving considers three aspects: the driver emotions, the driver state, and finally, the driving style itself. In this way, the proposed hierarchical pattern is composed of three levels of descriptors/features, one to recognize the emotional states, another to recognize the driver state, and the last one to recognize the driving style. Each level has a set of descriptors, which can be sensed in a real context. Finally, the paper presents three driving style recognition algorithms based on different paradigms. One is based on fuzzy logic, another is based on chronicles (a temporal logic paradigm), and the last is based on an algorithm that uses the idea of the recognition process of the neocortex, called Ar2p (Algoritmo Recursivo de Reconocimiento de Patrones, for its acronym in Spanish). In the paper, these approaches are compared using real datasets, using different metrics of interest in the context of the Internet of the Things, in order to determine their capabilities of reasoning, adaptation, and the communication of information. In general, the initial results are encouraging, specifically in the cases of chronicles and Ar2p, which give the best results. Full article
Show Figures

Figure 1

16 pages, 478 KiB  
Article
Implicit Stochastic Gradient Descent Method for Cross-Domain Recommendation System
by Nam D. Vo, Minsung Hong and Jason J. Jung
Sensors 2020, 20(9), 2510; https://doi.org/10.3390/s20092510 - 29 Apr 2020
Cited by 14 | Viewed by 3753
Abstract
The previous recommendation system applied the matrix factorization collaborative filtering (MFCF) technique to only single domains. Due to data sparsity, this approach has a limitation in overcoming the cold-start problem. Thus, in this study, we focus on discovering latent features from domains to [...] Read more.
The previous recommendation system applied the matrix factorization collaborative filtering (MFCF) technique to only single domains. Due to data sparsity, this approach has a limitation in overcoming the cold-start problem. Thus, in this study, we focus on discovering latent features from domains to understand the relationships between domains (called domain coherence). This approach uses potential knowledge of the source domain to improve the quality of the target domain recommendation. In this paper, we consider applying MFCF to multiple domains. Mainly, by adopting the implicit stochastic gradient descent algorithm to optimize the objective function for prediction, multiple matrices from different domains are consolidated inside the cross-domain recommendation system (CDRS). Additionally, we design a conceptual framework for CDRS, which applies to different industrial scenarios for recommenders across domains. Moreover, an experiment is devised to validate the proposed method. By using a real-world dataset gathered from Amazon Food and MovieLens, experimental results show that the proposed method improves 15.2% and 19.7% in terms of computation time and MSE over other methods on a utility matrix. Notably, a much lower convergence value of the loss function has been obtained from the experiment. Furthermore, a critical analysis of the obtained results shows that there is a dynamic balance between prediction accuracy and computational complexity. Full article
Show Figures

Figure 1

18 pages, 13116 KiB  
Article
A New Model for Predicting Rate of Penetration Using an Artificial Neural Network
by Salaheldin Elkatatny, Ahmed Al-AbdulJabbar and Khaled Abdelgawad
Sensors 2020, 20(7), 2058; https://doi.org/10.3390/s20072058 - 6 Apr 2020
Cited by 20 | Viewed by 4479
Abstract
The drilling rate of penetration (ROP) is defined as the speed of drilling through rock under the bit. ROP is affected by different interconnected factors, which makes it very difficult to infer the mutual effect of each individual parameter. A robust ROP is [...] Read more.
The drilling rate of penetration (ROP) is defined as the speed of drilling through rock under the bit. ROP is affected by different interconnected factors, which makes it very difficult to infer the mutual effect of each individual parameter. A robust ROP is required to understand the complexity of the drilling process. Therefore, an artificial neural network (ANN) is used to predict ROP and capture the effect of the changes in the drilling parameters. Field data (4525 points) from three vertical onshore wells drilled in the same formation using the same conventional bottom hole assembly were used to train, test, and validate the ANN model. Data from Well A (1528 points) were utilized to train and test the model with a 70/30 data ratio. Data from Well B and Well C were used to test the model. An empirical equation was derived based on the weights and biases of the optimized ANN model and compared with four ROP models using the data set of Well C. The developed ANN model accurately predicted the ROP with a correlation coefficient (R) of 0.94 and an average absolute percentage error (AAPE) of 8.6%. The developed ANN model outperformed four existing models with the lowest AAPE and highest R value. Full article
Show Figures

Figure 1

21 pages, 10430 KiB  
Article
Real-Time Prediction of Rheological Properties of Invert Emulsion Mud Using Adaptive Neuro-Fuzzy Inference System
by Ahmed Alsabaa, Hany Gamal, Salaheldin Elkatatny and Abdulazeez Abdulraheem
Sensors 2020, 20(6), 1669; https://doi.org/10.3390/s20061669 - 17 Mar 2020
Cited by 52 | Viewed by 4698
Abstract
Tracking the rheological properties of the drilling fluid is a key factor for the success of the drilling operation. The main objective of this paper is to relate the most frequent mud measurements (every 15 to 20 min) as mud weight (MWT) and [...] Read more.
Tracking the rheological properties of the drilling fluid is a key factor for the success of the drilling operation. The main objective of this paper is to relate the most frequent mud measurements (every 15 to 20 min) as mud weight (MWT) and Marsh funnel viscosity (MFV) to the less frequent mud rheological measurements (twice a day) as plastic viscosity (PV), yield point (YP), behavior index (n), and apparent viscosity (AV) for fully automating the process of retrieving rheological properties. The adaptive neuro-fuzzy inference system (ANFIS) was used to develop new models to determine the mud rheological properties using real field measurements of 741 data points. The data were collected from 99 different wells during drilling operations of 12 ¼ inches section. The ANFIS clustering technique was optimized by using training to a testing ratio of 80% to 20% as 591 data points for training and 150 points, cluster radius value of 0.1, and 200 epochs. The results of the prediction models showed a correlation coefficient (R) that exceeded 0.9 between the actual and predicted values with an average absolute percentage error (AAPE) below 5.7% for the training and testing data sets. ANFIS models will help to track in real-time the rheological properties for invert emulsion mud that allows better control for the drilling operation problems. Full article
Show Figures

Figure 1

22 pages, 14106 KiB  
Article
Cutting Pose Prediction from Point Clouds
by Mark P. Philipsen and Thomas B. Moeslund
Sensors 2020, 20(6), 1563; https://doi.org/10.3390/s20061563 - 11 Mar 2020
Cited by 5 | Viewed by 3686
Abstract
The challenge of getting machines to understand and interact with natural objects is encountered in important areas such as medicine, agriculture, and, in our case, slaughterhouse automation. Recent breakthroughs have enabled the application of Deep Neural Networks (DNN) directly to point clouds, an [...] Read more.
The challenge of getting machines to understand and interact with natural objects is encountered in important areas such as medicine, agriculture, and, in our case, slaughterhouse automation. Recent breakthroughs have enabled the application of Deep Neural Networks (DNN) directly to point clouds, an efficient and natural representation of 3D objects. The potential of these methods has mostly been demonstrated for classification and segmentation tasks involving rigid man-made objects. We present a method, based on the successful PointNet architecture, for learning to regress correct tool placement from human demonstrations, using virtual reality. Our method is applied to a challenging slaughterhouse cutting task, which requires an understanding of the local geometry including the shape, size, and orientation. We propose an intermediate five-Degree of Freedom (DoF) cutting plane representation, a point and a normal vector, which eases the demonstration and learning process. A live experiment is conducted in order to unveil issues and begin to understand the required accuracy. Eleven cuts are rated by an expert, with 8 / 11 being rated as acceptable. The error on the test set is subsequently reduced through the addition of more training data and improvements to the DNN. The result is a reduction in the average translation from 1.5 cm to 0.8 cm and the orientation error from 4.59° to 4.48°. The method’s generalization capacity is assessed on a similar task from the slaughterhouse and on the very different public LINEMOD dataset for object pose estimation across view points. In both cases, the method shows promising results. Code, datasets, and other materials are available in Supplementary Materials. Full article
Show Figures

Figure 1

Other

Jump to: Editorial, Research

13 pages, 2082 KiB  
Letter
Online Color Classification System of Solid Wood Flooring Based on Characteristic Features
by Zilong Zhuang, Ying Liu, Fenglong Ding and Zhengguang Wang
Sensors 2021, 21(2), 336; https://doi.org/10.3390/s21020336 - 6 Jan 2021
Cited by 25 | Viewed by 3435
Abstract
Solid wood flooring has good esthetic properties and is an excellent material for interior decoration. To meet the artistic effects of specific interior decoration requirements, the color of solid wood flooring needs to be coordinated. Thus, the color of the produced solid wood [...] Read more.
Solid wood flooring has good esthetic properties and is an excellent material for interior decoration. To meet the artistic effects of specific interior decoration requirements, the color of solid wood flooring needs to be coordinated. Thus, the color of the produced solid wood flooring needs to be sorted to meet the individual needs of customers. In this work, machine vision, deep learning methods, and ensemble learning methods are introduced to reduce the cost of manual sorting and improve production efficiency. The color CCD camera was used to collect 108 solid wood floors of three color grades provided by the company and obtained 108 18,000 × 2048 pixel wood images. A total of 432 images were obtained after data expansion. Deep learning methods, such as VGG16, DenseNet121, and XGBoost, were compared. After using XGBoost to filter the features, the accuracy of solid wood flooring color classification was 97.22%, the training model time was 5.27 s, the average test time for each picture was 51 ms, and a good result was achieved. Full article
Show Figures

Figure 1

Back to TopTop