sensors-logo

Journal Browser

Journal Browser

Editor’s Choice Articles

Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals from around the world. Editors select a small number of articles recently published in the journal that they believe will be particularly interesting to readers, or important in the respective research area. The aim is to provide a snapshot of some of the most exciting work published in the various research areas of the journal.

Order results
Result details
Results per page
Select all
Export citation of selected articles as:
15 pages, 7710 KiB  
Article
A GNSS/INS/LiDAR Integration Scheme for UAV-Based Navigation in GNSS-Challenging Environments
by Ahmed Elamin, Nader Abdelaziz and Ahmed El-Rabbany
Sensors 2022, 22(24), 9908; https://doi.org/10.3390/s22249908 - 16 Dec 2022
Cited by 21 | Viewed by 4699
Abstract
Unmanned aerial vehicle (UAV) navigation has recently been the focus of many studies. The most challenging aspect of UAV navigation is maintaining accurate and reliable pose estimation. In outdoor environments, global navigation satellite systems (GNSS) are typically used for UAV localization. However, relying [...] Read more.
Unmanned aerial vehicle (UAV) navigation has recently been the focus of many studies. The most challenging aspect of UAV navigation is maintaining accurate and reliable pose estimation. In outdoor environments, global navigation satellite systems (GNSS) are typically used for UAV localization. However, relying solely on GNSS might pose safety risks in the event of receiver malfunction or antenna installation error. In this research, an unmanned aerial system (UAS) employing the Applanix APX15 GNSS/IMU board, a Velodyne Puck LiDAR sensor, and a Sony a7R II high-resolution camera was used to collect data for the purpose of developing a multi-sensor integration system. Unfortunately, due to a malfunctioning GNSS antenna, there were numerous prolonged GNSS signal outages. As a result, the GNSS/INS processing failed after obtaining an error that exceeded 25 km. To resolve this issue and to recover the precise trajectory of the UAV, a GNSS/INS/LiDAR integrated navigation system was developed. The LiDAR data were first processed using the optimized LOAM SLAM algorithm, which yielded the position and orientation estimates. Pix4D Mapper software was then used to process the camera images in the presence of ground control points (GCPs), which resulted in the precise camera positions and orientations that served as ground truth. All sensor data were timestamped by GPS, and all datasets were sampled at 10 Hz to match those of the LiDAR scans. Two case studies were considered, namely complete GNSS outage and assistance from GNSS PPP solution. In comparison to the complete GNSS outage, the results for the second case study were significantly improved. The improvement is described in terms of RMSE reductions of approximately 51% and 78% for the horizontal and vertical directions, respectively. Additionally, the RMSE of the roll and yaw angles was reduced by 13% and 30%, respectively. However, the RMSE of the pitch angle was increased by about 13%. Full article
(This article belongs to the Section Navigation and Positioning)
Show Figures

Figure 1

27 pages, 1105 KiB  
Review
A Survey on Deep-Learning-Based LiDAR 3D Object Detection for Autonomous Driving
by Simegnew Yihunie Alaba and John E. Ball
Sensors 2022, 22(24), 9577; https://doi.org/10.3390/s22249577 - 7 Dec 2022
Cited by 54 | Viewed by 19733
Abstract
LiDAR is a commonly used sensor for autonomous driving to make accurate, robust, and fast decision-making when driving. The sensor is used in the perception system, especially object detection, to understand the driving environment. Although 2D object detection has succeeded during the deep-learning [...] Read more.
LiDAR is a commonly used sensor for autonomous driving to make accurate, robust, and fast decision-making when driving. The sensor is used in the perception system, especially object detection, to understand the driving environment. Although 2D object detection has succeeded during the deep-learning era, the lack of depth information limits understanding of the driving environment and object location. Three-dimensional sensors, such as LiDAR, give 3D information about the surrounding environment, which is essential for a 3D perception system. Despite the attention of the computer vision community to 3D object detection due to multiple applications in robotics and autonomous driving, there are challenges, such as scale change, sparsity, uneven distribution of LiDAR data, and occlusions. Different representations of LiDAR data and methods to minimize the effect of the sparsity of LiDAR data have been proposed. This survey presents the LiDAR-based 3D object detection and feature-extraction techniques for LiDAR data. The 3D coordinate systems differ in camera and LiDAR-based datasets and methods. Therefore, the commonly used 3D coordinate systems are summarized. Then, state-of-the-art LiDAR-based 3D object-detection methods are reviewed with a selected comparison among methods. Full article
(This article belongs to the Special Issue Intelligent Point Cloud Processing, Sensing and Understanding)
Show Figures

Figure 1

25 pages, 3483 KiB  
Article
A Wildfire Smoke Detection System Using Unmanned Aerial Vehicle Images Based on the Optimized YOLOv5
by Mukhriddin Mukhiddinov, Akmalbek Bobomirzaevich Abdusalomov and Jinsoo Cho
Sensors 2022, 22(23), 9384; https://doi.org/10.3390/s22239384 - 1 Dec 2022
Cited by 54 | Viewed by 7657
Abstract
Wildfire is one of the most significant dangers and the most serious natural catastrophe, endangering forest resources, animal life, and the human economy. Recent years have witnessed a rise in wildfire incidents. The two main factors are persistent human interference with the natural [...] Read more.
Wildfire is one of the most significant dangers and the most serious natural catastrophe, endangering forest resources, animal life, and the human economy. Recent years have witnessed a rise in wildfire incidents. The two main factors are persistent human interference with the natural environment and global warming. Early detection of fire ignition from initial smoke can help firefighters react to such blazes before they become difficult to handle. Previous deep-learning approaches for wildfire smoke detection have been hampered by small or untrustworthy datasets, making it challenging to extrapolate the performances to real-world scenarios. In this study, we propose an early wildfire smoke detection system using unmanned aerial vehicle (UAV) images based on an improved YOLOv5. First, we curated a 6000-wildfire image dataset using existing UAV images. Second, we optimized the anchor box clustering using the K-mean++ technique to reduce classification errors. Then, we improved the network’s backbone using a spatial pyramid pooling fast-plus layer to concentrate small-sized wildfire smoke regions. Third, a bidirectional feature pyramid network was applied to obtain a more accessible and faster multi-scale feature fusion. Finally, network pruning and transfer learning approaches were implemented to refine the network architecture and detection speed, and correctly identify small-scale wildfire smoke areas. The experimental results proved that the proposed method achieved an average precision of 73.6% and outperformed other one- and two-stage object detectors on a custom image dataset. Full article
Show Figures

Figure 1

25 pages, 4396 KiB  
Review
Object Detection Based on Roadside LiDAR for Cooperative Driving Automation: A Review
by Pengpeng Sun, Chenghao Sun, Runmin Wang and Xiangmo Zhao
Sensors 2022, 22(23), 9316; https://doi.org/10.3390/s22239316 - 30 Nov 2022
Cited by 16 | Viewed by 5798
Abstract
Light Detection and Ranging (LiDAR) technology has the advantages of high detection accuracy, a wide range of perception, and not being affected by light. The 3D LiDAR is placed at the commanding height of the traffic scene, the overall situation can be grasped [...] Read more.
Light Detection and Ranging (LiDAR) technology has the advantages of high detection accuracy, a wide range of perception, and not being affected by light. The 3D LiDAR is placed at the commanding height of the traffic scene, the overall situation can be grasped from the perspective of top view, and the trajectory of each object in the traffic scene can be accurately perceived in real time, and then the object information can be distributed to the surrounding vehicles or other roadside LiDAR through advanced wireless communication equipment, which can significantly improve the local perception ability of an autonomous vehicle. This paper first describes the characteristics of roadside LiDAR and the challenges of object detection and then reviews in detail the current methods of object detection based on a single roadside LiDAR and multi-LiDAR cooperatives. Then, some studies for roadside LiDAR perception in adverse weather and datasets released in recent years are introduced. Finally, some current open challenges and future works for roadside LiDAR perception are discussed. To the best of our knowledge, this is the first work to systematically study roadside LiDAR perception methods and datasets. It has an important guiding role in further promoting the research of roadside LiDAR perception for practical applications. Full article
(This article belongs to the Special Issue Advances in Sensing, Imaging and Computing for Autonomous Driving)
Show Figures

Figure 1

29 pages, 9493 KiB  
Review
Visual SLAM: What Are the Current Trends and What to Expect?
by Ali Tourani, Hriday Bavle, Jose Luis Sanchez-Lopez and Holger Voos
Sensors 2022, 22(23), 9297; https://doi.org/10.3390/s22239297 - 29 Nov 2022
Cited by 48 | Viewed by 19813
Abstract
In recent years, Simultaneous Localization and Mapping (SLAM) systems have shown significant performance, accuracy, and efficiency gain. In this regard, Visual Simultaneous Localization and Mapping (VSLAM) methods refer to the SLAM approaches that employ cameras for pose estimation and map reconstruction and are [...] Read more.
In recent years, Simultaneous Localization and Mapping (SLAM) systems have shown significant performance, accuracy, and efficiency gain. In this regard, Visual Simultaneous Localization and Mapping (VSLAM) methods refer to the SLAM approaches that employ cameras for pose estimation and map reconstruction and are preferred over Light Detection And Ranging (LiDAR)-based methods due to their lighter weight, lower acquisition costs, and richer environment representation. Hence, several VSLAM approaches have evolved using different camera types (e.g., monocular or stereo), and have been tested on various datasets (e.g., Technische Universität München (TUM) RGB-D or European Robotics Challenge (EuRoC)) and in different conditions (i.e., indoors and outdoors), and employ multiple methodologies to have a better understanding of their surroundings. The mentioned variations have made this topic popular for researchers and have resulted in various methods. In this regard, the primary intent of this paper is to assimilate the wide range of works in VSLAM and present their recent advances, along with discussing the existing challenges and trends. This survey is worthwhile to give a big picture of the current focuses in robotics and VSLAM fields based on the concentrated resolutions and objectives of the state-of-the-art. This paper provides an in-depth literature survey of fifty impactful articles published in the VSLAMs domain. The mentioned manuscripts have been classified by different characteristics, including the novelty domain, objectives, employed algorithms, and semantic level. The paper also discusses the current trends and contemporary directions of VSLAM techniques that may help researchers investigate them. Full article
(This article belongs to the Special Issue Aerial Robotics: Navigation and Path Planning)
Show Figures

Figure 1

31 pages, 12390 KiB  
Article
Three-Stage Pavement Crack Localization and Segmentation Algorithm Based on Digital Image Processing and Deep Learning Techniques
by Zhen Yang, Changshuang Ni, Lin Li, Wenting Luo and Yong Qin
Sensors 2022, 22(21), 8459; https://doi.org/10.3390/s22218459 - 3 Nov 2022
Cited by 24 | Viewed by 3419
Abstract
The image of expressway asphalt pavement crack disease obtained by a three-dimensional line scan laser is easily affected by external factors such as uneven illumination distribution, environmental noise, occlusion shadow, and foreign bodies on the pavement. To locate and extract cracks accurately and [...] Read more.
The image of expressway asphalt pavement crack disease obtained by a three-dimensional line scan laser is easily affected by external factors such as uneven illumination distribution, environmental noise, occlusion shadow, and foreign bodies on the pavement. To locate and extract cracks accurately and efficiently, this article proposes a three-stage asphalt pavement crack location and segmentation method based on traditional digital image processing technology and deep learning methods. In the first stage of this method, the guided filtering and Retinex methods are used to preprocess the asphalt pavement crack image. The processed image removes redundant noise information and improves the brightness. At the information entropy level, it is 63% higher than the unpreprocessed image. In the second stage, the newly proposed YOLO-SAMT target detection model is used to locate the crack diseases in asphalt pavement. The model is 5.42 percentage points higher than the original YOLOv7 model on [email protected], which enhances the recognition and location ability of crack diseases and reduces the calculation amount for the extraction of crack contour in the next stage. In the third stage, the improved k-means clustering algorithm is used to extract cracks. Compared with the traditional k-means clustering algorithm, this method improves the accuracy by 7.34 percentage points, the true rate by 6.57 percentage points, and the false positive rate by 18.32 percentage points to better extract the crack contour. To sum up, the method proposed in this article improves the quality of the pavement disease image, enhances the ability to identify and locate cracks, reduces the amount of calculation, improves the accuracy of crack contour extraction, and provides a new solution for highway crack inspection. Full article
(This article belongs to the Special Issue Image/Signal Processing and Machine Vision in Sensing Applications)
Show Figures

Figure 1

18 pages, 24884 KiB  
Article
Class-Aware Fish Species Recognition Using Deep Learning for an Imbalanced Dataset
by Simegnew Yihunie Alaba, M M Nabi, Chiranjibi Shah, Jack Prior, Matthew D. Campbell, Farron Wallace, John E. Ball and Robert Moorhead
Sensors 2022, 22(21), 8268; https://doi.org/10.3390/s22218268 - 28 Oct 2022
Cited by 39 | Viewed by 5159
Abstract
Fish species recognition is crucial to identifying the abundance of fish species in a specific area, controlling production management, and monitoring the ecosystem, especially identifying the endangered species, which makes accurate fish species recognition essential. In this work, the fish species recognition problem [...] Read more.
Fish species recognition is crucial to identifying the abundance of fish species in a specific area, controlling production management, and monitoring the ecosystem, especially identifying the endangered species, which makes accurate fish species recognition essential. In this work, the fish species recognition problem is formulated as an object detection model to handle multiple fish in a single image, which is challenging to classify using a simple classification network. The proposed model consists of MobileNetv3-large and VGG16 backbone networks and an SSD detection head. Moreover, a class-aware loss function is proposed to solve the class imbalance problem of our dataset. The class-aware loss takes the number of instances in each species into account and gives more weight to those species with a smaller number of instances. This loss function can be applied to any classification or object detection task with an imbalanced dataset. The experimental result on the large-scale reef fish dataset, SEAMAPD21, shows that the class-aware loss improves the model over the original loss by up to 79.7%. The experimental result on the Pascal VOC dataset also shows the model outperforms the original SSD object detection model. Full article
(This article belongs to the Section Sensing and Imaging)
Show Figures

Figure 1

20 pages, 7843 KiB  
Article
A Force-Feedback Methodology for Teleoperated Suturing Task in Robotic-Assisted Minimally Invasive Surgery
by Armin Ehrampoosh, Bijan Shirinzadeh, Joshua Pinskier, Julian Smith, Randall Moshinsky and Yongmin Zhong
Sensors 2022, 22(20), 7829; https://doi.org/10.3390/s22207829 - 14 Oct 2022
Cited by 16 | Viewed by 3838
Abstract
With robotic-assisted minimally invasive surgery (RAMIS), patients and surgeons benefit from a reduced incision size and dexterous instruments. However, current robotic surgery platforms lack haptic feedback, which is an essential element of safe operation. Moreover, teleportation control challenges make complex surgical tasks like [...] Read more.
With robotic-assisted minimally invasive surgery (RAMIS), patients and surgeons benefit from a reduced incision size and dexterous instruments. However, current robotic surgery platforms lack haptic feedback, which is an essential element of safe operation. Moreover, teleportation control challenges make complex surgical tasks like suturing more time-consuming than those that use manual tools. This paper presents a new force-sensing instrument that semi-automates the suturing task and facilitates teleoperated robotic manipulation. In order to generate the ideal needle insertion trajectory and pass the needle through its curvature, the end-effector mechanism has a rotating degree of freedom. Impedance control was used to provide sensory information about needle–tissue interaction forces to the operator using an indirect force estimation approach based on data-based models. The operator’s motion commands were then regulated using a hyperplanar virtual fixture (VF) designed to maintain the desired distance between the end-effector and tissue surface while avoiding unwanted contact. To construct the geometry of the VF, an optoelectronic sensor-based approach was developed. Based on the experimental investigation of the hyperplane VF methodology, improved needle–tissue interaction force, manipulation accuracy, and task completion times were demonstrated. Finally, experimental validation of the trained force estimation models and the perceived interaction forces by the user was conducted using online data, demonstrating the potential of the developed approach in improving task performance. Full article
(This article belongs to the Special Issue Robotics and Haptics: Haptic Feedback for Medical Robots)
Show Figures

Figure 1

31 pages, 5249 KiB  
Review
A Review of Recent Advances in Vital Signals Monitoring of Sports and Health via Flexible Wearable Sensors
by Wenbin Sun, Zilong Guo, Zhiqiang Yang, Yizhou Wu, Weixia Lan, Yingjie Liao, Xian Wu and Yuanyuan Liu
Sensors 2022, 22(20), 7784; https://doi.org/10.3390/s22207784 - 13 Oct 2022
Cited by 45 | Viewed by 8409
Abstract
In recent years, vital signals monitoring in sports and health have been considered the research focus in the field of wearable sensing technologies. Typical signals include bioelectrical signals, biophysical signals, and biochemical signals, which have applications in the fields of athletic training, medical [...] Read more.
In recent years, vital signals monitoring in sports and health have been considered the research focus in the field of wearable sensing technologies. Typical signals include bioelectrical signals, biophysical signals, and biochemical signals, which have applications in the fields of athletic training, medical diagnosis and prevention, and rehabilitation. In particular, since the COVID-19 pandemic, there has been a dramatic increase in real-time interest in personal health. This has created an urgent need for flexible, wearable, portable, and real-time monitoring sensors to remotely monitor these signals in response to health management. To this end, the paper reviews recent advances in flexible wearable sensors for monitoring vital signals in sports and health. More precisely, emerging wearable devices and systems for health and exercise-related vital signals (e.g., ECG, EEG, EMG, inertia, body movements, heart rate, blood, sweat, and interstitial fluid) are reviewed first. Then, the paper creatively presents multidimensional and multimodal wearable sensors and systems. The paper also summarizes the current challenges and limitations and future directions of wearable sensors for vital typical signal detection. Through the review, the paper finds that these signals can be effectively monitored and used for health management (e.g., disease prediction) thanks to advanced manufacturing, flexible electronics, IoT, and artificial intelligence algorithms; however, wearable sensors and systems with multidimensional and multimodal are more compliant. Full article
(This article belongs to the Section Wearables)
Show Figures

Figure 1

38 pages, 1958 KiB  
Article
E-Prevention: Advanced Support System for Monitoring and Relapse Prevention in Patients with Psychotic Disorders Analyzing Long-Term Multimodal Data from Wearables and Video Captures
by Athanasia Zlatintsi, Panagiotis P. Filntisis, Christos Garoufis, Niki Efthymiou, Petros Maragos, Andreas Menychtas, Ilias Maglogiannis, Panayiotis Tsanakas, Thomas Sounapoglou, Emmanouil Kalisperakis, Thomas Karantinos, Marina Lazaridi, Vasiliki Garyfalli, Asimakis Mantas, Leonidas Mantonakis and Nikolaos Smyrnis
Sensors 2022, 22(19), 7544; https://doi.org/10.3390/s22197544 - 5 Oct 2022
Cited by 22 | Viewed by 3865
Abstract
Wearable technologies and digital phenotyping foster unique opportunities for designing novel intelligent electronic services that can address various well-being issues in patients with mental disorders (i.e., schizophrenia and bipolar disorder), thus having the potential to revolutionize psychiatry and its clinical practice. In this [...] Read more.
Wearable technologies and digital phenotyping foster unique opportunities for designing novel intelligent electronic services that can address various well-being issues in patients with mental disorders (i.e., schizophrenia and bipolar disorder), thus having the potential to revolutionize psychiatry and its clinical practice. In this paper, we present e-Prevention, an innovative integrated system for medical support that facilitates effective monitoring and relapse prevention in patients with mental disorders. The technologies offered through e-Prevention include: (i) long-term continuous recording of biometric and behavioral indices through a smartwatch; (ii) video recordings of patients while being interviewed by a clinician, using a tablet; (iii) automatic and systematic storage of these data in a dedicated Cloud server and; (iv) the ability of relapse detection and prediction. This paper focuses on the description of the e-Prevention system and the methodologies developed for the identification of feature representations that correlate with and can predict psychopathology and relapses in patients with mental disorders. Specifically, we tackle the problem of relapse detection and prediction using Machine and Deep Learning techniques on all collected data. The results are promising, indicating that such predictions could be made and leading eventually to the prediction of psychopathology and the prevention of relapses. Full article
(This article belongs to the Special Issue AI for Biomedical Sensing and Imaging)
Show Figures

Figure 1

25 pages, 4775 KiB  
Review
Optical Fiber Sensors and Sensing Networks: Overview of the Main Principles and Applications
by Cristiano Pendão and Ivo Silva
Sensors 2022, 22(19), 7554; https://doi.org/10.3390/s22197554 - 5 Oct 2022
Cited by 78 | Viewed by 13360
Abstract
Optical fiber sensors present several advantages in relation to other types of sensors. These advantages are essentially related to the optical fiber properties, i.e., small, lightweight, resistant to high temperatures and pressure, electromagnetically passive, among others. Sensing is achieved by exploring the properties [...] Read more.
Optical fiber sensors present several advantages in relation to other types of sensors. These advantages are essentially related to the optical fiber properties, i.e., small, lightweight, resistant to high temperatures and pressure, electromagnetically passive, among others. Sensing is achieved by exploring the properties of light to obtain measurements of parameters, such as temperature, strain, or angular velocity. In addition, optical fiber sensors can be used to form an Optical Fiber Sensing Network (OFSN) allowing manufacturers to create versatile monitoring solutions with several applications, e.g., periodic monitoring along extensive distances (kilometers), in extreme or hazardous environments, inside structures and engines, in clothes, and for health monitoring and assistance. Most of the literature available on this subject focuses on a specific field of optical sensing applications and details their principles of operation. This paper presents a more broad overview, providing the reader with a literature review that describes the main principles of optical sensing and highlights the versatility, advantages, and different real-world applications of optical sensing. Moreover, it includes an overview and discussion of a less common architecture, where optical sensing and Wireless Sensor Networks (WSNs) are integrated to harness the benefits of both worlds. Full article
(This article belongs to the Special Issue Optical Fiber Technology and Sensors)
Show Figures

Figure 1

16 pages, 1176 KiB  
Review
From Identification to Sensing: RFID Is One of the Key Technologies in the IoT Field
by Yvan Duroc
Sensors 2022, 22(19), 7523; https://doi.org/10.3390/s22197523 - 4 Oct 2022
Cited by 22 | Viewed by 6410
Abstract
RFID (radio frequency identification) technology appeared nearly 70 years ago. Deployed more widely only from the early 2000s, it is now booming and its development is still accelerating. As its name indicates, its original function was the identification (of objects, animals, people) and [...] Read more.
RFID (radio frequency identification) technology appeared nearly 70 years ago. Deployed more widely only from the early 2000s, it is now booming and its development is still accelerating. As its name indicates, its original function was the identification (of objects, animals, people) and its applications were then essentially aimed at traceability, access control and logistics. If this type of use is still relevant today with more and more new application contexts and more and more efficient RFID tags, RFID has also evolved by integrating new capabilities. These new tags, known as augmented tags, include an information capture function. With the explosion of connected objects and the emergence of the Internet of Things (IoT), this old technology that is RFID still has a promising future and will probably be more and more present in our private and professional environments in all fields: logistics, industry, agriculture, building, health and even space. Full article
(This article belongs to the Special Issue RFID-Based Sensors)
Show Figures

Figure 1

24 pages, 11672 KiB  
Article
The Use of Soil Moisture and Pore-Water Pressure Sensors for the Interpretation of Landslide Behavior in Small-Scale Physical Models
by Josip Peranić, Nina Čeh and Željko Arbanas
Sensors 2022, 22(19), 7337; https://doi.org/10.3390/s22197337 - 27 Sep 2022
Cited by 17 | Viewed by 4393
Abstract
This paper presents some of the results and experiences in monitoring the hydraulic response of downscaled slope models under simulated rainfall in 1 g. The downscaled slope model platform was developed as part of a four-year research project, “Physical modeling of landslide remediation [...] Read more.
This paper presents some of the results and experiences in monitoring the hydraulic response of downscaled slope models under simulated rainfall in 1 g. The downscaled slope model platform was developed as part of a four-year research project, “Physical modeling of landslide remediation constructions’ behavior under static and seismic actions”, and its main components are briefly described with the particular focus on the sensor network that allows monitoring changes in soil moisture and pore-water pressure (pwp). The technical characteristics of the sensors and the measurement methods used to provide the metrics are described in detail. Some data on the hydraulic and mechanical responses obtained from the conducted tests on slope models built from different soil types under different test conditions are presented and interpreted in the context of rainfall-induced landslides. The results show that the sensor network used is suitable for monitoring changes in the soil moisture and pwp in the model, both in terms of the transient rainfall infiltration through partially saturated soil and in terms of the rise in the water table and pwp build-up under fully saturated conditions. It is shown how simultaneous monitoring of soil moisture and pwp can be used to reconstruct stress paths that the monitored points undergo during different test phases. Finally, some peculiarities related to hydraulic hysteresis and surface erosion that were observed in some of tests are discussed, as well as possible difficulties in achieving and maintaining the targeted initial moisture distribution in slope models. Full article
Show Figures

Figure 1

13 pages, 3261 KiB  
Article
The Development of a Digital Twin Framework for an Industrial Robotic Drilling Process
by Ahmad Farhadi, Stephen K. H. Lee, Eoin P. Hinchy, Noel P. O’Dowd and Conor T. McCarthy
Sensors 2022, 22(19), 7232; https://doi.org/10.3390/s22197232 - 23 Sep 2022
Cited by 22 | Viewed by 4539
Abstract
A digital twin is a digital representation of a physical entity that is updated in real-time by transfer of data between physical and digital (virtual) entities. In this manuscript we aim to introduce a digital twin framework for robotic drilling. Initially, a generic [...] Read more.
A digital twin is a digital representation of a physical entity that is updated in real-time by transfer of data between physical and digital (virtual) entities. In this manuscript we aim to introduce a digital twin framework for robotic drilling. Initially, a generic reference model is proposed to highlight elements of the digital twin relevant to robotic drilling. Then, a precise reference digital twin architecture model is developed, based on available standards and technologies. Finally, real-time visualisation of drilling process parameters is demonstrated as an initial step towards implementing a digital twin of a robotic drilling process. Full article
(This article belongs to the Special Issue Digital Twins, Sensing Technologies and Automation in Industry 4.0)
Show Figures

Figure 1

49 pages, 19636 KiB  
Review
Sensing with Femtosecond Laser Filamentation
by Pengfei Qi, Wenqi Qian, Lanjun Guo, Jiayun Xue, Nan Zhang, Yuezheng Wang, Zhi Zhang, Zeliang Zhang, Lie Lin, Changlin Sun, Liguo Zhu and Weiwei Liu
Sensors 2022, 22(18), 7076; https://doi.org/10.3390/s22187076 - 19 Sep 2022
Cited by 26 | Viewed by 7322
Abstract
Femtosecond laser filamentation is a unique nonlinear optical phenomenon when high-power ultrafast laser propagation in all transparent optical media. During filamentation in the atmosphere, the ultrastrong field of 1013–1014 W/cm2 with a large distance ranging from meter to kilometers [...] Read more.
Femtosecond laser filamentation is a unique nonlinear optical phenomenon when high-power ultrafast laser propagation in all transparent optical media. During filamentation in the atmosphere, the ultrastrong field of 1013–1014 W/cm2 with a large distance ranging from meter to kilometers can effectively ionize, break, and excite the molecules and fragments, resulting in characteristic fingerprint emissions, which provide a great opportunity for investigating strong-field molecules interaction in complicated environments, especially remote sensing. Additionally, the ultrastrong intensity inside the filament can damage almost all the detectors and ignite various intricate higher order nonlinear optical effects. These extreme physical conditions and complicated phenomena make the sensing and controlling of filamentation challenging. This paper mainly focuses on recent research advances in sensing with femtosecond laser filamentation, including fundamental physics, sensing and manipulating methods, typical filament-based sensing techniques and application scenarios, opportunities, and challenges toward the filament-based remote sensing under different complicated conditions. Full article
(This article belongs to the Special Issue Sensing with Femtosecond Laser Filamentation)
Show Figures

Figure 1

17 pages, 6644 KiB  
Article
Dynamic Path Planning for Forklift AGV Based on Smoothing A* and Improved DWA Hybrid Algorithm
by Bin Wu, Xiaonan Chi, Congcong Zhao, Wei Zhang, Yi Lu and Di Jiang
Sensors 2022, 22(18), 7079; https://doi.org/10.3390/s22187079 - 19 Sep 2022
Cited by 51 | Viewed by 4867
Abstract
FAGV is a kind of heavy equipment in the storage environment. Its path needs to be simple and smooth and should be able to avoid sudden obstacles in the process of driving. According to the environmental characteristics of intelligent storage and the task [...] Read more.
FAGV is a kind of heavy equipment in the storage environment. Its path needs to be simple and smooth and should be able to avoid sudden obstacles in the process of driving. According to the environmental characteristics of intelligent storage and the task requirements of FAGV, this paper proposed a hybrid dynamic path planning algorithm for FAGV based on improved A* and improved DWA. The improved A* algorithm can plan the global optimal path more suitable for FAGV. The improved evaluation function of DWA can ensure that the local path of FAGV is closer to the global path. DWA combines the rolling window method for local path planning to avoid sudden unknown static and dynamic obstacles. In addition, this paper verifies the effectiveness of the algorithm through simulation. The simulation results show that the algorithm can avoid obstacles dynamically without being far away from the global optimal path. Full article
(This article belongs to the Special Issue Automated Guided Vehicle Integrated with Collaborative Robot)
Show Figures

Figure 1

16 pages, 1661 KiB  
Article
WCNN3D: Wavelet Convolutional Neural Network-Based 3D Object Detection for Autonomous Driving
by Simegnew Yihunie Alaba and John E. Ball
Sensors 2022, 22(18), 7010; https://doi.org/10.3390/s22187010 - 16 Sep 2022
Cited by 27 | Viewed by 3876
Abstract
Three-dimensional object detection is crucial for autonomous driving to understand the driving environment. Since the pooling operation causes information loss in the standard CNN, we designed a wavelet-multiresolution-analysis-based 3D object detection network without a pooling operation. Additionally, instead of using a single filter [...] Read more.
Three-dimensional object detection is crucial for autonomous driving to understand the driving environment. Since the pooling operation causes information loss in the standard CNN, we designed a wavelet-multiresolution-analysis-based 3D object detection network without a pooling operation. Additionally, instead of using a single filter like the standard convolution, we used the lower-frequency and higher-frequency coefficients as a filter. These filters capture more relevant parts than a single filter, enlarging the receptive field. The model comprises a discrete wavelet transform (DWT) and an inverse wavelet transform (IWT) with skip connections to encourage feature reuse for contrasting and expanding layers. The IWT enriches the feature representation by fully recovering the lost details during the downsampling operation. Element-wise summation was used for the skip connections to decrease the computational burden. We trained the model for the Haar and Daubechies (Db4) wavelets. The two-level wavelet decomposition result shows that we can build a lightweight model without losing significant performance. The experimental results on KITTI’s BEV and 3D evaluation benchmark show that our model outperforms the PointPillars-based model by up to 14% while reducing the number of trainable parameters. Full article
(This article belongs to the Section Sensing and Imaging)
Show Figures

Figure 1

26 pages, 7233 KiB  
Article
Cloud Data-Driven Intelligent Monitoring System for Interactive Smart Farming
by Kristina Dineva and Tatiana Atanasova
Sensors 2022, 22(17), 6566; https://doi.org/10.3390/s22176566 - 31 Aug 2022
Cited by 25 | Viewed by 4812
Abstract
Smart farms, as a part of high-tech agriculture, collect a huge amount of data from IoT devices about the conditions of animals, plants, and the environment. These data are most often stored locally and are not used in intelligent monitoring systems to provide [...] Read more.
Smart farms, as a part of high-tech agriculture, collect a huge amount of data from IoT devices about the conditions of animals, plants, and the environment. These data are most often stored locally and are not used in intelligent monitoring systems to provide opportunities for extracting meaningful knowledge for the farmers. This often leads to a sense of missed transparency, fairness, and accountability, and a lack of motivation for the majority of farmers to invest in sensor-based intelligent systems to support and improve the technological development of their farm and the decision-making process. In this paper, a data-driven intelligent monitoring system in a cloud environment is proposed. The designed architecture enables a comprehensive solution for interaction between data extraction from IoT devices, preprocessing, storage, feature engineering, modelling, and visualization. Streaming data from IoT devices to interactive live reports along with built machine learning (ML) models are included. As a result of the proposed intelligent monitoring system, the collected data and ML modelling outcomes are visualized using a powerful dynamic dashboard. The dashboard allows users to monitor various parameters across the farm and provides an accessible way to view trends, deviations, and patterns in the data. ML models are trained on the collected data and are updated periodically. The data-driven visualization enables farmers to examine, organize, and represent collected farm’s data with the goal of better serving their needs. Performance and durability tests of the system are provided. The proposed solution is a technological bridge with which farmers can easily, affordably, and understandably monitor and track the progress of their farms with easy integration into an existing IoT system. Full article
(This article belongs to the Special Issue Ubiquitous Sensing and Intelligent Systems)
Show Figures

Figure 1

23 pages, 3928 KiB  
Review
The Research Progress of Vision-Based Artificial Intelligence in Smart Pig Farming
by Shunli Wang, Honghua Jiang, Yongliang Qiao, Shuzhen Jiang, Huaiqin Lin and Qian Sun
Sensors 2022, 22(17), 6541; https://doi.org/10.3390/s22176541 - 30 Aug 2022
Cited by 32 | Viewed by 11401
Abstract
Pork accounts for an important proportion of livestock products. For pig farming, a lot of manpower, material resources and time are required to monitor pig health and welfare. As the number of pigs in farming increases, the continued use of traditional monitoring methods [...] Read more.
Pork accounts for an important proportion of livestock products. For pig farming, a lot of manpower, material resources and time are required to monitor pig health and welfare. As the number of pigs in farming increases, the continued use of traditional monitoring methods may cause stress and harm to pigs and farmers and affect pig health and welfare as well as farming economic output. In addition, the application of artificial intelligence has become a core part of smart pig farming. The precision pig farming system uses sensors such as cameras and radio frequency identification to monitor biometric information such as pig sound and pig behavior in real-time and convert them into key indicators of pig health and welfare. By analyzing the key indicators, problems in pig health and welfare can be detected early, and timely intervention and treatment can be provided, which helps to improve the production and economic efficiency of pig farming. This paper studies more than 150 papers on precision pig farming and summarizes and evaluates the application of artificial intelligence technologies to pig detection, tracking, behavior recognition and sound recognition. Finally, we summarize and discuss the opportunities and challenges of precision pig farming. Full article
Show Figures

Figure 1

18 pages, 25002 KiB  
Article
Visual Servoing Approach to Autonomous UAV Landing on a Moving Vehicle
by Azarakhsh Keipour, Guilherme A. S. Pereira, Rogerio Bonatti, Rohit Garg, Puru Rastogi, Geetesh Dubey and Sebastian Scherer
Sensors 2022, 22(17), 6549; https://doi.org/10.3390/s22176549 - 30 Aug 2022
Cited by 30 | Viewed by 3948
Abstract
Many aerial robotic applications require the ability to land on moving platforms, such as delivery trucks and marine research boats. We present a method to autonomously land an Unmanned Aerial Vehicle on a moving vehicle. A visual servoing controller approaches the ground vehicle [...] Read more.
Many aerial robotic applications require the ability to land on moving platforms, such as delivery trucks and marine research boats. We present a method to autonomously land an Unmanned Aerial Vehicle on a moving vehicle. A visual servoing controller approaches the ground vehicle using velocity commands calculated directly in image space. The control laws generate velocity commands in all three dimensions, eliminating the need for a separate height controller. The method has shown the ability to approach and land on the moving deck in simulation, indoor and outdoor environments, and compared to the other available methods, it has provided the fastest landing approach. Unlike many existing methods for landing on fast-moving platforms, this method does not rely on additional external setups, such as RTK, motion capture system, ground station, offboard processing, or communication with the vehicle, and it requires only the minimal set of hardware and localization sensors. The videos and source codes are also provided. Full article
(This article belongs to the Special Issue Advanced Sensors Technologies Applied in Mobile Robot)
Show Figures

Figure 1

31 pages, 5515 KiB  
Article
UAV and IoT-Based Systems for the Monitoring of Industrial Facilities Using Digital Twins: Methodology, Reliability Models, and Application
by Yun Sun, Herman Fesenko, Vyacheslav Kharchenko, Luo Zhong, Ihor Kliushnikov, Oleg Illiashenko, Olga Morozova and Anatoliy Sachenko
Sensors 2022, 22(17), 6444; https://doi.org/10.3390/s22176444 - 26 Aug 2022
Cited by 23 | Viewed by 3526
Abstract
This paper suggests a methodology (conception and principles) for building two-mode monitoring systems (SMs) for industrial facilities and their adjacent territories based on the application of unmanned aerial vehicle (UAV), Internet of Things (IoT), and digital twin (DT) technologies, and a set of [...] Read more.
This paper suggests a methodology (conception and principles) for building two-mode monitoring systems (SMs) for industrial facilities and their adjacent territories based on the application of unmanned aerial vehicle (UAV), Internet of Things (IoT), and digital twin (DT) technologies, and a set of SM reliability models considering the parameters of the channels and components. The concept of building a reliable and resilient SM is proposed. For this purpose, the von Neumann paradigm for the synthesis of reliable systems from unreliable components is developed. For complex SMs of industrial facilities, the concept covers the application of various types of redundancy (structural, version, time, and space) for basic components—sensors, means of communication, processing, and presentation—in the form of DTs for decision support systems. The research results include: the methodology for the building and general structures of UAV-, IoT-, and DT-based SMs in industrial facilities as multi-level systems; reliability models for SMs considering the applied technologies and operation modes (normal and emergency); and industrial cases of SMs for manufacture and nuclear power plants. The results obtained are the basis for further development of the theory and for practical applications of SMs in industrial facilities within the framework of the implementation and improvement of Industry 4.0 principles. Full article
Show Figures

Figure 1

26 pages, 6443 KiB  
Article
Enhanced Communications on Satellite-Based IoT Systems to Support Maritime Transportation Services
by Victor Monzon Baeza, Flor Ortiz, Samuel Herrero Garcia and Eva Lagunas
Sensors 2022, 22(17), 6450; https://doi.org/10.3390/s22176450 - 26 Aug 2022
Cited by 12 | Viewed by 3885
Abstract
Maritime transport has become important due to its ability to internationally unite all continents. In turn, during the last two years, we have observed that the increase of consumer goods has resulted in global shipping deadlocks. In addition, the future goes through the [...] Read more.
Maritime transport has become important due to its ability to internationally unite all continents. In turn, during the last two years, we have observed that the increase of consumer goods has resulted in global shipping deadlocks. In addition, the future goes through the role of ports and efficiency in maritime transport to decarbonize its impact on the environment. In order to improve the economy and people’s lives, in this work, we propose to enhance services offered in maritime logistics. To do this, a communications system is designed on the deck of ships to transmit data through a constellation of satellites using interconnected smart devices based on IoT. Among the services, we highlight the monitoring and tracking of refrigerated containers, the transmission of geolocation data from Global Positioning System (GPS), and security through the Automatic Identification System (AIS). This information will be used for a fleet of ships to make better decisions and help guarantee the status of the cargo and maritime safety on the routes. The system design, network dimensioning, and a communications protocol for decision-making will be presented. Full article
(This article belongs to the Special Issue Satellite Based IoT Networks for Emerging Applications)
Show Figures

Figure 1

17 pages, 1768 KiB  
Article
A Validation of Six Wearable Devices for Estimating Sleep, Heart Rate and Heart Rate Variability in Healthy Adults
by Dean J. Miller, Charli Sargent and Gregory D. Roach
Sensors 2022, 22(16), 6317; https://doi.org/10.3390/s22166317 - 22 Aug 2022
Cited by 86 | Viewed by 35670
Abstract
The primary aim of this study was to examine the validity of six commonly used wearable devices, i.e., Apple Watch S6, Garmin Forerunner 245 Music, Polar Vantage V, Oura Ring Generation 2, WHOOP 3.0 and Somfit, for assessing sleep. The secondary aim was [...] Read more.
The primary aim of this study was to examine the validity of six commonly used wearable devices, i.e., Apple Watch S6, Garmin Forerunner 245 Music, Polar Vantage V, Oura Ring Generation 2, WHOOP 3.0 and Somfit, for assessing sleep. The secondary aim was to examine the validity of the six devices for assessing heart rate and heart rate variability during, or just prior to, night-time sleep. Fifty-three adults (26 F, 27 M, aged 25.4 ± 5.9 years) spent a single night in a sleep laboratory with 9 h in bed (23:00–08:00 h). Participants were fitted with all six wearable devices—and with polysomnography and electrocardiography for gold-standard assessment of sleep and heart rate, respectively. Compared with polysomnography, agreement (and Cohen’s kappa) for two-state categorisation of sleep periods (as sleep or wake) was 88% (κ = 0.30) for Apple Watch; 89% (κ = 0.35) for Garmin; 87% (κ = 0.44) for Polar; 89% (κ = 0.51) for Oura; 86% (κ = 0.44) for WHOOP and 87% (κ = 0.48) for Somfit. Compared with polysomnography, agreement (and Cohen’s kappa) for multi-state categorisation of sleep periods (as a specific sleep stage or wake) was 53% (κ = 0.20) for Apple Watch; 50% (κ = 0.25) for Garmin; 51% (κ = 0.28) for Polar; 61% (κ = 0.43) for Oura; 60% (κ = 0.44) for WHOOP and 65% (κ = 0.52) for Somfit. Analyses regarding the two-state categorisation of sleep indicate that all six devices are valid for the field-based assessment of the timing and duration of sleep. However, analyses regarding the multi-state categorisation of sleep indicate that all six devices require improvement for the assessment of specific sleep stages. As the use of wearable devices that are valid for the assessment of sleep increases in the general community, so too does the potential to answer research questions that were previously impractical or impossible to address—in some way, we could consider that the whole world is becoming a sleep laboratory. Full article
Show Figures

Figure 1

15 pages, 1451 KiB  
Article
Miniterm, a Novel Virtual Sensor for Predictive Maintenance for the Industry 4.0 Era
by Eduardo Garcia, Nicolás Montés, Javier Llopis and Antonio Lacasa
Sensors 2022, 22(16), 6222; https://doi.org/10.3390/s22166222 - 19 Aug 2022
Cited by 17 | Viewed by 2857
Abstract
This article introduces a novel virtual sensor for predictive maintenance called mini-term. A mini-term can be defined as the time it takes for a part of the machine to do its job. Being a technical sub-cycle time, its function has been linked to [...] Read more.
This article introduces a novel virtual sensor for predictive maintenance called mini-term. A mini-term can be defined as the time it takes for a part of the machine to do its job. Being a technical sub-cycle time, its function has been linked to production. However, when a machine or component gets deteriorated, the mini-term also suffers deterioration, allowing it to be a multifunctional indicator for the prediction of machine failures as well as measurement of production. Currently, in Industry 4.0, one of the handicaps is Big Data and Data Analysis. However, in the case of predictive maintenance, the need to install sensors in the machines means that when the proposed scientific solutions reach the industry, they cannot be carried out massively due to the high cost this entails. The advantage introduced by the mini-term is that it can be implemented in an easy and simple way in pre-installed systems since you only need to program a timer in the PLC or PC that controls the line/machine in the production line, allowing, according to the authors’ knowledge, to build industrial Big Data on predictive maintenance for the first time, which is called Miniterm 4.0. This article shows evidence of the important improvements generated by the use of Miniterm 4.0 in a factory. At the end of the paper we show the evolution of TAV (Technical availability), Mean Time To Repair (MTTR), EM (Number of Work order (Emergency Orders/line Stop)) and OM (Labour hours in EM) showing a very important improvement as the number of mini-terms was increased and the Miniterm 4.0 system became more reliable. In particular, TAV is increased by 15%, OM is reduced in 5000 orders, MTTR is reduced in 2 h and there are produced 3000 orders less than when mini-terms did not exist. At the end of the article we discuss the benefits and limitations of the mini-terms and we show the conclusions and future works. Full article
(This article belongs to the Special Issue Machine Health Monitoring and Fault Diagnosis Techniques)
Show Figures

Figure 1

13 pages, 4936 KiB  
Article
Research on the Time Drift Stability of Differential Inductive Displacement Sensors with Frequency Output
by Xiaolong Lu, Guiyun Tian, Zongwen Wang, Wentao Li, Dehua Yang, Haoran Li, You Wang, Jijun Ni and Yong Zhang
Sensors 2022, 22(16), 6234; https://doi.org/10.3390/s22166234 - 19 Aug 2022
Cited by 22 | Viewed by 2707
Abstract
An edge displacement sensor is one of the key technologies for building large segmented mirror astronomical optical telescopes. A digital interface is one novel approach for sensor technologies, digital transformation and the Internet of Things (IoT) in particular. Frequency output sensors and inductance-to-digital [...] Read more.
An edge displacement sensor is one of the key technologies for building large segmented mirror astronomical optical telescopes. A digital interface is one novel approach for sensor technologies, digital transformation and the Internet of Things (IoT) in particular. Frequency output sensors and inductance-to-digital converter (LDC) demonstrated significant advantages in comparison with conventional sensors with analog-to-digital converter (ADC) interfaces. In order for the differential inductive frequency output displacement (DIFOD) sensor to meet the high-stability requirements of segmented mirror astronomical telescopes, it is important to understand the factors for time drift of the sensor. This paper focuses on the investigation of key factors of sensor structure and material, signal conditioning and interface, and fixtures for time drift to permanently installed applications. First, the measurement principle and probe structural characteristics of the sensor are analyzed. Then, two kinds of signal conditioning and digitalization methods using resonance circuits and LDC chips are implemented and compared. Finally, the time drift stability experiments are performed on the sensors with different signal conditioning methods and fixtures under controlled temperature. Experimental results show that the magnetic shield ring effectively improves the sensitivity and quality factor of the sensors, the time drift stability of the sensor using the signal conditioning based on resonance circuits is better than that of the sensors using LDC chips, and the root mean square (RMS) of the sensor time drift meets the requirement of 0.01 μm/24 h. This study will help further development of high-stability of frequency output sensors and IoT-based systems for scaled-up applications in the future. Full article
(This article belongs to the Section Electronic Sensors)
Show Figures

Figure 1

19 pages, 5370 KiB  
Article
SWIPT-Pairing Mechanism for Channel-Aware Cooperative H-NOMA in 6G Terahertz Communications
by Haider W. Oleiwi and Hamed Al-Raweshidy
Sensors 2022, 22(16), 6200; https://doi.org/10.3390/s22166200 - 18 Aug 2022
Cited by 18 | Viewed by 1993
Abstract
The constraints of 5G communication systems compel further improvements to be compatible with 6G candidate technologies, especially to cope with the limited wavelengths of blockage-sensitive terahertz (THz) frequencies. In this paper integrating cooperative simultaneous wireless information and power transfer (SWIPT) and hybrid-non-orthogonal multiple [...] Read more.
The constraints of 5G communication systems compel further improvements to be compatible with 6G candidate technologies, especially to cope with the limited wavelengths of blockage-sensitive terahertz (THz) frequencies. In this paper integrating cooperative simultaneous wireless information and power transfer (SWIPT) and hybrid-non-orthogonal multiple access (H-NOMA) using THz frequency bands are suggested. We investigated and developed an optimal SWIPT-pairing mechanism for the multilateral proposed system that represents a considerable enhancement in energy/spectral efficiencies while improving the significant system specifications. Given the system performance investigation and the gains achieved, in this paper, wireless communication systems were optimized and upgraded, making use of promising technologies including H-NOMA and THz communications. This process aimed to alleviate the THz transmission challenges and improve wireless connectivity, resource availability, processing, robustness, capacity, user-fairness, and overall performance of communication networks. It thoroughly optimized the best H-NOMA pairing scheme for cell users. The conducted results showed how the proposed technique managed to improve energy and spectral efficiencies compared to the related work by more than 75%, in addition to the dynamism of the introduced mechanism. This system reduces the transceivers’ hardware and computational complexity while improving reliability and transmission rates, without the need for complex technologies, e.g., multi-input multi-output or reflecting services. Full article
(This article belongs to the Special Issue 6G Wireless Communication Systems)
Show Figures

Figure 1

22 pages, 1311 KiB  
Article
Cycling through 360° Virtual Reality Tourism for Senior Citizens: Empirical Analysis of an Assistive Technology
by Cláudia Pedro Ortet, Ana Isabel Veloso and Liliana Vale Costa
Sensors 2022, 22(16), 6169; https://doi.org/10.3390/s22166169 - 17 Aug 2022
Cited by 20 | Viewed by 4296
Abstract
In recent years, there has been a renewed interest in using virtual reality (VR) to (re)create different scenarios and environments with interactive and immersive experiences. Although VR has been popular in the tourism sector to reconfigure tourists’ relationships with places and overcome mobility [...] Read more.
In recent years, there has been a renewed interest in using virtual reality (VR) to (re)create different scenarios and environments with interactive and immersive experiences. Although VR has been popular in the tourism sector to reconfigure tourists’ relationships with places and overcome mobility restrictions, its usage in senior cyclotourism has been understudied. VR is suggested to positively impact tourism promotion, cycling simulation, and active and healthy ageing due to physical and mental rehabilitation. The purpose of this study is to assess the senior citizens’ perceived experience and attitudes toward a designed 360° VR cyclotouristic experiment, using a head-mounted display (HMD) setting within a laboratory context. A total of 76 participants aged between 50 and 97 years old were involved in convergent parallel mixed-method research, and data were collected using a questionnaire based on the technology acceptance model, as well as the researchers’ field notes. Findings suggest that 360° VR with HMD can be an effective assistive technology to foster senior cyclotourism by promoting tourism sites, simulating the cycling pedaling effect, and improving senior citizens’ general wellbeing and independence with physical and mental rehabilitation. Full article
(This article belongs to the Special Issue Wearable Assistive Devices for Disabled and Older People)
Show Figures

Figure 1

11 pages, 2525 KiB  
Article
Tunable Diode Laser Absorption Spectroscopy Based Temperature Measurement with a Single Diode Laser Near 1.4 μm
by Xiaonan Liu and Yufei Ma
Sensors 2022, 22(16), 6095; https://doi.org/10.3390/s22166095 - 15 Aug 2022
Cited by 68 | Viewed by 4661
Abstract
The rapidly changing and wide dynamic range of combustion temperature in scramjet engines presents a major challenge to existing test techniques. Tunable diode laser absorption spectroscopy (TDLAS) based temperature measurement has the advantages of high sensitivity, fast response, and compact structure. In this [...] Read more.
The rapidly changing and wide dynamic range of combustion temperature in scramjet engines presents a major challenge to existing test techniques. Tunable diode laser absorption spectroscopy (TDLAS) based temperature measurement has the advantages of high sensitivity, fast response, and compact structure. In this invited paper, a temperature measurement method based on the TDLAS technique with a single diode laser was demonstrated. A continuous-wave (CW), distributed feedback (DFB) diode laser with an emission wavelength near 1.4 μm was used for temperature measurement, which could cover two water vapor (H2O) absorption lines located at 7153.749 cm−1 and 7154.354 cm−1 simultaneously. The output wavelength of the diode laser was calibrated according to the two absorption peaks in the time domain. Using this strategy, the TDLAS system has the advantageous of immunization to laser wavelength shift, simple system structure, reduced cost, and increased system robustness. The line intensity of the two target absorption lines under room temperature was about one-thousandth of that under high temperature, which avoided the measuring error caused by H2O in the environment. The system was tested on a McKenna flat flame burner and a scramjet model engine, respectively. It was found that, compared to the results measured by CARS technique and theoretical calculation, this TDLAS system had less than 4% temperature error when the McKenna flat flame burner was used. When a scramjet model engine was adopted, the measured results showed that such TDLAS system had an excellent dynamic range and fast response. The TDLAS system reported here could be used in real engine in the future. Full article
(This article belongs to the Special Issue State-of-the-Art Optical Sensors Technology in China)
Show Figures

Figure 1

20 pages, 11596 KiB  
Article
Electroactive Biofilms of Activated Sludge Microorganisms on a Nanostructured Surface as the Basis for a Highly Sensitive Biochemical Oxygen Demand Biosensor
by Saniyat Kurbanalieva, Vyacheslav Arlyapov, Anna Kharkova, Roman Perchikov, Olga Kamanina, Pavel Melnikov, Nadezhda Popova, Andrey Machulin, Sergey Tarasov, Evgeniya Saverina, Anatoly Vereshchagin and Anatoly Reshetilov
Sensors 2022, 22(16), 6049; https://doi.org/10.3390/s22166049 - 12 Aug 2022
Cited by 16 | Viewed by 3221
Abstract
The possibility of the developing a biochemical oxygen demand (BOD) biosensor based on electroactive biofilms of activated sludge grown on the surface of a graphite-paste electrode modified with carbon nanotubes was studied. A complex of microscopic methods controlled biofilm formation: optical microscopy with [...] Read more.
The possibility of the developing a biochemical oxygen demand (BOD) biosensor based on electroactive biofilms of activated sludge grown on the surface of a graphite-paste electrode modified with carbon nanotubes was studied. A complex of microscopic methods controlled biofilm formation: optical microscopy with phase contrast, scanning electron microscopy, and laser confocal microscopy. The features of charge transfer in the obtained electroactive biofilms were studied using the methods of cyclic voltammetry and electrochemical impedance spectroscopy. The rate constant of the interaction of microorganisms with the extracellular electron carrier (0.79 ± 0.03 dm3(g s)−1) and the heterogeneous rate constant of electron transfer (0.34 ± 0.02 cm s−1) were determined using the cyclic voltammetry method. These results revealed that the modification of the carbon nanotubes’ (CNT) electrode surface makes it possible to create electroactive biofilms. An analysis of the metrological and analytical characteristics of the created biosensors showed that the lower limit of the biosensor based on an electroactive biofilm of activated sludge is 0.41 mgO2/dm3, which makes it possible to analyze almost any water sample. Analysis of 12 surface water samples showed a high correlation (R2 = 0.99) with the results of the standard method for determining biochemical oxygen demand. Full article
(This article belongs to the Special Issue Feature Papers in Biosensors Section 2022)
Show Figures

Figure 1

30 pages, 39772 KiB  
Article
Development of an Energy Efficient and Cost Effective Autonomous Vehicle Research Platform
by Nicholas E. Brown, Johan F. Rojas, Nicholas A. Goberville, Hamzeh Alzubi, Qusay AlRousan, Chieh (Ross) Wang, Shean Huff, Jackeline Rios-Torres, Ali Riza Ekti, Tim J. LaClair, Richard Meyer and Zachary D. Asher
Sensors 2022, 22(16), 5999; https://doi.org/10.3390/s22165999 - 11 Aug 2022
Cited by 21 | Viewed by 6433
Abstract
Commercialization of autonomous vehicle technology is a major goal of the automotive industry, thus research in this space is rapidly expanding across the world. However, despite this high level of research activity, literature detailing a straightforward and cost-effective approach to the development of [...] Read more.
Commercialization of autonomous vehicle technology is a major goal of the automotive industry, thus research in this space is rapidly expanding across the world. However, despite this high level of research activity, literature detailing a straightforward and cost-effective approach to the development of an AV research platform is sparse. To address this need, we present the methodology and results regarding the AV instrumentation and controls of a 2019 Kia Niro which was developed for a local AV pilot program. This platform includes a drive-by-wire actuation kit, Aptiv electronically scanning radar, stereo camera, MobilEye computer vision system, LiDAR, inertial measurement unit, two global positioning system receivers to provide heading information, and an in-vehicle computer for driving environment perception and path planning. Robotic Operating System software is used as the system middleware between the instruments and the autonomous application algorithms. After selection, installation, and integration of these components, our results show successful utilization of all sensors, drive-by-wire functionality, a total additional power* consumption of 242.8 Watts (*Typical), and an overall cost of $118,189 USD, which is a significant saving compared to other commercially available systems with similar functionality. This vehicle continues to serve as our primary AV research and development platform. Full article
(This article belongs to the Section Vehicular Sensing)
Show Figures

Figure 1

22 pages, 3222 KiB  
Review
Concurrent fNIRS and EEG for Brain Function Investigation: A Systematic, Methodology-Focused Review
by Rihui Li, Dalin Yang, Feng Fang, Keum-Shik Hong, Allan L. Reiss and Yingchun Zhang
Sensors 2022, 22(15), 5865; https://doi.org/10.3390/s22155865 - 5 Aug 2022
Cited by 73 | Viewed by 12839
Abstract
Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) stand as state-of-the-art techniques for non-invasive functional neuroimaging. On a unimodal basis, EEG has poor spatial resolution while presenting high temporal resolution. In contrast, fNIRS offers better spatial resolution, though it is constrained by its poor [...] Read more.
Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) stand as state-of-the-art techniques for non-invasive functional neuroimaging. On a unimodal basis, EEG has poor spatial resolution while presenting high temporal resolution. In contrast, fNIRS offers better spatial resolution, though it is constrained by its poor temporal resolution. One important merit shared by the EEG and fNIRS is that both modalities have favorable portability and could be integrated into a compatible experimental setup, providing a compelling ground for the development of a multimodal fNIRS–EEG integration analysis approach. Despite a growing number of studies using concurrent fNIRS-EEG designs reported in recent years, the methodological reference of past studies remains unclear. To fill this knowledge gap, this review critically summarizes the status of analysis methods currently used in concurrent fNIRS–EEG studies, providing an up-to-date overview and guideline for future projects to conduct concurrent fNIRS–EEG studies. A literature search was conducted using PubMed and Web of Science through 31 August 2021. After screening and qualification assessment, 92 studies involving concurrent fNIRS–EEG data recordings and analyses were included in the final methodological review. Specifically, three methodological categories of concurrent fNIRS–EEG data analyses, including EEG-informed fNIRS analyses, fNIRS-informed EEG analyses, and parallel fNIRS–EEG analyses, were identified and explained with detailed description. Finally, we highlighted current challenges and potential directions in concurrent fNIRS–EEG data analyses in future research. Full article
(This article belongs to the Special Issue Signal Processing for Brain–Computer Interfaces)
Show Figures

Figure 1

33 pages, 19332 KiB  
Article
Smart Strawberry Farming Using Edge Computing and IoT
by Mateus Cruz, Samuel Mafra, Eduardo Teixeira and Felipe Figueiredo
Sensors 2022, 22(15), 5866; https://doi.org/10.3390/s22155866 - 5 Aug 2022
Cited by 32 | Viewed by 7080
Abstract
Strawberries are sensitive fruits that are afflicted by various pests and diseases. Therefore, there is an intense use of agrochemicals and pesticides during production. Due to their sensitivity, temperatures or humidity at extreme levels can cause various damages to the plantation and to [...] Read more.
Strawberries are sensitive fruits that are afflicted by various pests and diseases. Therefore, there is an intense use of agrochemicals and pesticides during production. Due to their sensitivity, temperatures or humidity at extreme levels can cause various damages to the plantation and to the quality of the fruit. To mitigate the problem, this study developed an edge technology capable of handling the collection, analysis, prediction, and detection of heterogeneous data in strawberry farming. The proposed IoT platform integrates various monitoring services into one common platform for digital farming. The system connects and manages Internet of Things (IoT) devices to analyze environmental and crop information. In addition, a computer vision model using Yolo v5 architecture searches for seven of the most common strawberry diseases in real time. This model supports efficient disease detection with 92% accuracy. Moreover, the system supports LoRa communication for transmitting data between the nodes at long distances. In addition, the IoT platform integrates machine learning capabilities for capturing outliers in collected data, ensuring reliable information for the user. All these technologies are unified to mitigate the disease problem and the environmental damage on the plantation. The proposed system is verified through implementation and tested on a strawberry farm, where the capabilities were analyzed and assessed. Full article
Show Figures

Figure 1

31 pages, 3241 KiB  
Review
Key Challenges and Emerging Technologies in Industrial IoT Architectures: A Review
by Akseer Ali Mirani, Gustavo Velasco-Hernandez, Anshul Awasthi and Joseph Walsh
Sensors 2022, 22(15), 5836; https://doi.org/10.3390/s22155836 - 4 Aug 2022
Cited by 42 | Viewed by 10824
Abstract
The Industrial Internet of Things (IIoT) is bringing evolution with remote monitoring, intelligent analytics, and control of industrial processes. However, as the industrial world is currently in its initial stage of adopting full-stack development solutions with IIoT, there is a need to address [...] Read more.
The Industrial Internet of Things (IIoT) is bringing evolution with remote monitoring, intelligent analytics, and control of industrial processes. However, as the industrial world is currently in its initial stage of adopting full-stack development solutions with IIoT, there is a need to address the arising challenges. In this regard, researchers have proposed IIoT architectures based on different architectural layers and emerging technologies for the end-to-end integration of IIoT systems. In this paper, we review and compare three widely accepted IIoT reference architectures and present a state-of-the-art review of conceptual and experimental IIoT architectures from the literature. We identified scalability, interoperability, security, privacy, reliability, and low latency as the main IIoT architectural requirements and detailed how the current architectures address these challenges by using emerging technologies such as edge/fog computing, blockchain, SDN, 5G, Machine Learning, and Wireless Sensor Networks (WSN). Finally, we discuss the relation between the current challenges and emergent technologies and present some opportunities and directions for future research work. Full article
Show Figures

Figure 1

38 pages, 3939 KiB  
Review
Precordial Vibrations: A Review of Wearable Systems, Signal Processing Techniques, and Main Applications
by Francesca Santucci, Daniela Lo Presti, Carlo Massaroni, Emiliano Schena and Roberto Setola
Sensors 2022, 22(15), 5805; https://doi.org/10.3390/s22155805 - 3 Aug 2022
Cited by 16 | Viewed by 4338
Abstract
Recently, the ever-growing interest in the continuous monitoring of heart function in out-of-laboratory settings for an early diagnosis of cardiovascular diseases has led to the investigation of innovative methods for cardiac monitoring. Among others, wearables recording seismic waves induced on the chest surface [...] Read more.
Recently, the ever-growing interest in the continuous monitoring of heart function in out-of-laboratory settings for an early diagnosis of cardiovascular diseases has led to the investigation of innovative methods for cardiac monitoring. Among others, wearables recording seismic waves induced on the chest surface by the mechanical activity of the heart are becoming popular. For what concerns wearable-based methods, cardiac vibrations can be recorded from the thorax in the form of acceleration, angular velocity, and/or displacement by means of accelerometers, gyroscopes, and fiber optic sensors, respectively. The present paper reviews the currently available wearables for measuring precordial vibrations. The focus is on sensor technology and signal processing techniques for the extraction of the parameters of interest. Lastly, the explored application scenarios and experimental protocols with the relative influencing factors are discussed for each technique. The goal is to delve into these three fundamental aspects (i.e., wearable system, signal processing, and application scenario), which are mutually interrelated, to give a holistic view of the whole process, beyond the sensor aspect alone. The reader can gain a more complete picture of this context without disregarding any of these 3 aspects. Full article
(This article belongs to the Special Issue Feature Papers in Wearables 2022)
Show Figures

Figure 1

33 pages, 17395 KiB  
Article
Intelligent Smart Marine Autonomous Surface Ship Decision System Based on Improved PPO Algorithm
by Wei Guan, Zhewen Cui and Xianku Zhang
Sensors 2022, 22(15), 5732; https://doi.org/10.3390/s22155732 - 31 Jul 2022
Cited by 15 | Viewed by 3588
Abstract
With the development of artificial intelligence technology, the behavior decision-making of an intelligent smart marine autonomous surface ship (SMASS) has become particularly important. This research proposed local path planning and a behavior decision-making approach based on improved Proximal Policy Optimization (PPO), which could [...] Read more.
With the development of artificial intelligence technology, the behavior decision-making of an intelligent smart marine autonomous surface ship (SMASS) has become particularly important. This research proposed local path planning and a behavior decision-making approach based on improved Proximal Policy Optimization (PPO), which could drive an unmanned SMASS to the target without requiring any human experiences. In addition, a generalized advantage estimation was added to the loss function of the PPO algorithm, which allowed baselines in PPO algorithms to be self-adjusted. At first, the SMASS was modeled with the Nomoto model in a simulation waterway. Then, distances, obstacles, and prohibited areas were regularized as rewards or punishments, which were used to judge the performance and manipulation decisions of the vessel Subsequently, improved PPO was introduced to learn the action–reward model, and the neural network model after training was used to manipulate the SMASS’s movement. To achieve higher reward values, the SMASS could find an appropriate path or navigation strategy by itself. After a sufficient number of rounds of training, a convincing path and manipulation strategies would likely be produced. Compared with the proposed approach of the existing methods, this approach is more effective in self-learning and continuous optimization and thus closer to human manipulation. Full article
(This article belongs to the Special Issue Mobile Robots: Navigation, Control and Sensing)
Show Figures

Figure 1

17 pages, 576 KiB  
Article
Transfer-Learning-Based Intrusion Detection Framework in IoT Networks
by Eva Rodríguez, Pol Valls, Beatriz Otero, Juan José Costa, Javier Verdú, Manuel Alejandro Pajuelo and Ramon Canal
Sensors 2022, 22(15), 5621; https://doi.org/10.3390/s22155621 - 27 Jul 2022
Cited by 38 | Viewed by 4903
Abstract
Cyberattacks in the Internet of Things (IoT) are growing exponentially, especially zero-day attacks mostly driven by security weaknesses on IoT networks. Traditional intrusion detection systems (IDSs) adopted machine learning (ML), especially deep Learning (DL), to improve the detection of cyberattacks. DL-based IDSs require [...] Read more.
Cyberattacks in the Internet of Things (IoT) are growing exponentially, especially zero-day attacks mostly driven by security weaknesses on IoT networks. Traditional intrusion detection systems (IDSs) adopted machine learning (ML), especially deep Learning (DL), to improve the detection of cyberattacks. DL-based IDSs require balanced datasets with large amounts of labeled data; however, there is a lack of such large collections in IoT networks. This paper proposes an efficient intrusion detection framework based on transfer learning (TL), knowledge transfer, and model refinement, for the effective detection of zero-day attacks. The framework is tailored to 5G IoT scenarios with unbalanced and scarce labeled datasets. The TL model is based on convolutional neural networks (CNNs). The framework was evaluated to detect a wide range of zero-day attacks. To this end, three specialized datasets were created. Experimental results show that the proposed TL-based framework achieves high accuracy and low false prediction rate (FPR). The proposed solution has better detection rates for the different families of known and zero-day attacks than any previous DL-based IDS. These results demonstrate that TL is effective in the detection of cyberattacks in IoT environments. Full article
(This article belongs to the Special Issue Security, Privacy, and Trust Management in IoT)
Show Figures

Figure 1

15 pages, 3202 KiB  
Article
Virtual Reality for Shoulder Rehabilitation: Accuracy Evaluation of Oculus Quest 2
by Arianna Carnevale, Ilaria Mannocchi, Mohamed Saifeddine Hadj Sassi, Marco Carli, Giovanna De Luca, Umile Giuseppe Longo, Vincenzo Denaro and Emiliano Schena
Sensors 2022, 22(15), 5511; https://doi.org/10.3390/s22155511 - 23 Jul 2022
Cited by 43 | Viewed by 7152
Abstract
Virtual reality (VR) systems are becoming increasingly attractive as joint kinematics monitoring systems during rehabilitation. This study aimed to evaluate the accuracy of the Oculus Quest 2 in measuring translational and rotational displacements. As the Oculus Quest 2 was chosen for future applications [...] Read more.
Virtual reality (VR) systems are becoming increasingly attractive as joint kinematics monitoring systems during rehabilitation. This study aimed to evaluate the accuracy of the Oculus Quest 2 in measuring translational and rotational displacements. As the Oculus Quest 2 was chosen for future applications in shoulder rehabilitation, the translation range (minimum: ~200 mm, maximum: ~700 mm) corresponded to the forearm length of the 5th percentile female and the upper limb length of the 95th percentile male. The controller was moved on two structures designed to allow different translational displacements and rotations in the range 0–180°, to cover the range of motion of the upper limb. The controller measures were compared with those of a Qualisys optical capture system. The results showed a mean absolute error of 13.52 ± 6.57 mm at a distance of 500 mm from the head-mounted display along the x-direction. The maximum mean absolute error for rotational displacements was found to be 1.11 ± 0.37° for a rotation of 40° around the z-axis. Oculus Quest 2 is a promising VR tool for monitoring shoulder kinematics during rehabilitation. The inside-out movement tracking makes Oculus Quest 2 a viable alternative to traditional motion analysis systems. Full article
(This article belongs to the Special Issue Wearable and Unobtrusive Technologies for Healthcare Monitoring)
Show Figures

Figure 1

23 pages, 3338 KiB  
Article
Design, Implementation and Experimental Investigation of a Pedestrian Street Crossing Assistance System Based on Visible Light Communications
by Alin-Mihai Căilean, Cătălin Beguni, Sebastian-Andrei Avătămăniței, Mihai Dimian and Valentin Popa
Sensors 2022, 22(15), 5481; https://doi.org/10.3390/s22155481 - 22 Jul 2022
Cited by 16 | Viewed by 4762
Abstract
In urban areas, pedestrians are the road users category that is the most exposed to road accident fatalities. In this context, the present article proposes a totally new architecture, which aims to increase the safety of pedestrians on the crosswalk. The first component [...] Read more.
In urban areas, pedestrians are the road users category that is the most exposed to road accident fatalities. In this context, the present article proposes a totally new architecture, which aims to increase the safety of pedestrians on the crosswalk. The first component of the design is a pedestrian detection system, which identifies the user’s presence in the region of the crosswalk and determines the future street crossing action possibility or the presence of a pedestrian engaged in street crossing. The second component of the system is the visible light communications part, which is used to transmit this information toward the approaching vehicles. The proposed architecture has been implemented at a regular scale and experimentally evaluated in outdoor conditions. The experimental results showed a 100% overall pedestrian detection rate. On the other hand, the VLC system showed a communication distance between 5 and 40 m when using a standard LED light crosswalk sign as a VLC emitter, while maintaining a bit error ratio between 10−7 and 10−5. These results demonstrate the fact that the VLC technology is now able to be used in real applications, making the transition from a high potential technology to a confirmed technology. As far as we know, this is the first article presenting such a pedestrian street crossing assistance system. Full article
(This article belongs to the Special Issue Automotive Visible Light Communications (AutoVLC))
Show Figures

Figure 1

16 pages, 4102 KiB  
Article
What Can We Learn from Depth Camera Sensor Noise?
by Azmi Haider and Hagit Hel-Or
Sensors 2022, 22(14), 5448; https://doi.org/10.3390/s22145448 - 21 Jul 2022
Cited by 18 | Viewed by 12148
Abstract
Although camera and sensor noise are often disregarded, assumed negligible or dealt with in the context of denoising, in this paper we show that significant information can actually be deduced from camera noise about the captured scene and the objects within it. Specifically, [...] Read more.
Although camera and sensor noise are often disregarded, assumed negligible or dealt with in the context of denoising, in this paper we show that significant information can actually be deduced from camera noise about the captured scene and the objects within it. Specifically, we deal with depth cameras and their noise patterns. We show that from sensor noise alone, the object’s depth and location in the scene can be deduced. Sensor noise can indicate the source camera type, and within a camera type the specific device used to acquire the images. Furthermore, we show that noise distribution on surfaces provides information about the light direction within the scene as well as allows to distinguish between real and masked faces. Finally, we show that the size of depth shadows (missing depth data) is a function of the object’s distance from the background, its distance from the camera and the object’s size. Hence, can be used to authenticate objects location in the scene. This paper provides tools and insights into what can be learned from depth camera sensor noise. Full article
(This article belongs to the Section Sensing and Imaging)
Show Figures

Figure 1

17 pages, 8338 KiB  
Article
Non-Destructive Testing Using Eddy Current Sensors for Defect Detection in Additively Manufactured Titanium and Stainless-Steel Parts
by Heba E. Farag, Ehsan Toyserkani and Mir Behrad Khamesee
Sensors 2022, 22(14), 5440; https://doi.org/10.3390/s22145440 - 21 Jul 2022
Cited by 35 | Viewed by 7234
Abstract
In this study, different eddy-current based probe designs (absolute and commercial reflection) are used to detect artificial defects with different sizes and at different depths in parts composed of stainless-steel (316) and titanium (TI-64) made by Laser Additive Manufacturing (LAM). The measured defect [...] Read more.
In this study, different eddy-current based probe designs (absolute and commercial reflection) are used to detect artificial defects with different sizes and at different depths in parts composed of stainless-steel (316) and titanium (TI-64) made by Laser Additive Manufacturing (LAM). The measured defect signal value using the probes is in the range of (20–200) millivolts. Both probes can detect subsurface defects on stainless-steel samples with average surface roughness of 11.6 µm and titanium samples with average surface roughness of 8.7 µm. It is found the signal reading can be improved by adding a coating layer made of thin paper to the bottom of the probes. The layer will decrease the surface roughness effect and smooth out the detected defect signal from any ripples. The smallest subsurface artificial defect size detected by both probes is an artificially made notch with 0.07 mm width and 25 mm length. In addition, both probes detected subsurface artificial blind holes in the range of 0.17 mm–0.3 mm radius. Results show that the absolute probe is more suitable to detect cracks and incomplete fusion holes, whereas the reflection probe is more suitable to detect small diameter blind holes. The setup can be used for defect detection during the additive manufacturing process once the melt pool is solidified. Full article
(This article belongs to the Special Issue Integrated Circuits and Technologies for Real-Time Sensing)
Show Figures

Figure 1

21 pages, 15242 KiB  
Review
Machine Learning for Intelligent-Reflecting-Surface-Based Wireless Communication towards 6G: A Review
by Mohammad Abrar Shakil Sejan, Md Habibur Rahman, Beom-Sik Shin, Ji-Hye Oh, Young-Hwan You and Hyoung-Kyu Song
Sensors 2022, 22(14), 5405; https://doi.org/10.3390/s22145405 - 20 Jul 2022
Cited by 51 | Viewed by 8776
Abstract
An intelligent reflecting surface (IRS) is a programmable device that can be used to control electromagnetic waves propagation by changing the electric and magnetic properties of its surface. Therefore, IRS is considered a smart technology for the sixth generation (6G) of communication networks. [...] Read more.
An intelligent reflecting surface (IRS) is a programmable device that can be used to control electromagnetic waves propagation by changing the electric and magnetic properties of its surface. Therefore, IRS is considered a smart technology for the sixth generation (6G) of communication networks. In addition, machine learning (ML) techniques are now widely adopted in wireless communication as the computation power of devices has increased. As it is an emerging topic, we provide a comprehensive overview of the state-of-the-art on ML, especially on deep learning (DL)-based IRS-enhanced communication. We focus on their operating principles, channel estimation (CE), and the applications of machine learning to IRS-enhanced wireless networks. In addition, we systematically survey existing designs for IRS-enhanced wireless networks. Furthermore, we identify major issues and research opportunities associated with the integration of IRS and other emerging technologies for applications to next-generation wireless communication. Full article
(This article belongs to the Special Issue Intelligent Reflecting Surfaces for 5G Communication and Beyond)
Show Figures

Figure 1

13 pages, 54802 KiB  
Article
Using Deep Learning with Thermal Imaging for Human Detection in Heavy Smoke Scenarios
by Pei-Fen Tsai, Chia-Hung Liao and Shyan-Ming Yuan
Sensors 2022, 22(14), 5351; https://doi.org/10.3390/s22145351 - 18 Jul 2022
Cited by 21 | Viewed by 9617
Abstract
In this study, we propose using a thermal imaging camera (TIC) with a deep learning model as an intelligent human detection approach during emergency evacuations in a low-visibility smoky fire scenarios. We use low-wavelength infrared (LWIR) images taken by a TIC qualified with [...] Read more.
In this study, we propose using a thermal imaging camera (TIC) with a deep learning model as an intelligent human detection approach during emergency evacuations in a low-visibility smoky fire scenarios. We use low-wavelength infrared (LWIR) images taken by a TIC qualified with the National Fire Protection Association (NFPA) 1801 standards as input to the YOLOv4 model for real-time object detection. The model trained with a single Nvidia GeForce 2070 can achieve >95% precision for the location of people in a low-visibility smoky scenario with 30.1 frames per second (FPS). This real-time result can be reported to control centers as useful information to help provide timely rescue and provide protection to firefighters before entering dangerous smoky fire situations. Full article
(This article belongs to the Special Issue Sensing with Infrared and Terahertz Technologies)
Show Figures

Figure 1

17 pages, 3482 KiB  
Article
Development of Wireless Sensor Network for Environment Monitoring and Its Implementation Using SSAIL Technology
by Shathya Duobiene, Karolis Ratautas, Romualdas Trusovas, Paulius Ragulis, Gediminas Šlekas, Rimantas Simniškis and Gediminas Račiukaitis
Sensors 2022, 22(14), 5343; https://doi.org/10.3390/s22145343 - 18 Jul 2022
Cited by 24 | Viewed by 6819
Abstract
The Internet of Things (IoT) technology and its applications are turning real-world things into smart objects, integrating everything under a common infrastructure to manage performance through a software application and offering upgrades with integrated web servers in a timely manner. Quality of life, [...] Read more.
The Internet of Things (IoT) technology and its applications are turning real-world things into smart objects, integrating everything under a common infrastructure to manage performance through a software application and offering upgrades with integrated web servers in a timely manner. Quality of life, the green economy, and pollution management in society require comprehensive environmental monitoring systems with easy-to-use features and maintenance. This research suggests implementing a wireless sensor network with embedded sensor nodes manufactured using the Selective Surface Activation Induced by Laser technology. Such technology allows the integration of electrical circuits with free-form plastic sensor housing. In this work, a low-cost asynchronous web server for monitoring temperature and humidity sensors connected to the ESP32 Wi-Fi module has been developed. Data from sensor nodes across the facility are collected and displayed in real-time charts on a web server. Multiple web clients on the same network can access the sensor data. The energy to the sensor nodes could be powered by harvesting energy from surrounding sources of electromagnetic radiation. This automated and self-powered system monitors environmental and climatic factors, helps with timely action, and benefits sensor design by allowing antenna and rf-circuit formation on various plastics, even on the body of the device itself. It also provides greater flexibility in hardware modification and rapid large-scale deployment. Full article
(This article belongs to the Special Issue Use Wireless Sensor Networks for Environmental Applications)
Show Figures

Figure 1

24 pages, 2427 KiB  
Review
Monocular Depth Estimation Using Deep Learning: A Review
by Armin Masoumian, Hatem A. Rashwan, Julián Cristiano, M. Salman Asif and Domenec Puig
Sensors 2022, 22(14), 5353; https://doi.org/10.3390/s22145353 - 18 Jul 2022
Cited by 61 | Viewed by 20623
Abstract
In current decades, significant advancements in robotics engineering and autonomous vehicles have improved the requirement for precise depth measurements. Depth estimation (DE) is a traditional task in computer vision that can be appropriately predicted by applying numerous procedures. This task is vital in [...] Read more.
In current decades, significant advancements in robotics engineering and autonomous vehicles have improved the requirement for precise depth measurements. Depth estimation (DE) is a traditional task in computer vision that can be appropriately predicted by applying numerous procedures. This task is vital in disparate applications such as augmented reality and target tracking. Conventional monocular DE (MDE) procedures are based on depth cues for depth prediction. Various deep learning techniques have demonstrated their potential applications in managing and supporting the traditional ill-posed problem. The principal purpose of this paper is to represent a state-of-the-art review of the current developments in MDE based on deep learning techniques. For this goal, this paper tries to highlight the critical points of the state-of-the-art works on MDE from disparate aspects. These aspects include input data shapes and training manners such as supervised, semi-supervised, and unsupervised learning approaches in combination with applying different datasets and evaluation indicators. At last, limitations regarding the accuracy of the DL-based MDE models, computational time requirements, real-time inference, transferability, input images shape and domain adaptation, and generalization are discussed to open new directions for future research. Full article
(This article belongs to the Section Intelligent Sensors)
Show Figures

Figure 1

15 pages, 6915 KiB  
Article
A Compact Dual Band MIMO Dielectric Resonator Antenna with Improved Performance for mm-Wave Applications
by Meshari D. Alanazi and Salam K. Khamas
Sensors 2022, 22(13), 5056; https://doi.org/10.3390/s22135056 - 5 Jul 2022
Cited by 29 | Viewed by 3329
Abstract
A compact multiple-input-multiple-output (MIMO) dielectric resonator antenna (DRA) that is suitable for internet of things (IoT) sensor networks is proposed with reduced coupling between elements. Two rectangular-shaped DRAs have been placed on the opposite sides of a Rogers substrate and each is fed [...] Read more.
A compact multiple-input-multiple-output (MIMO) dielectric resonator antenna (DRA) that is suitable for internet of things (IoT) sensor networks is proposed with reduced coupling between elements. Two rectangular-shaped DRAs have been placed on the opposite sides of a Rogers substrate and each is fed using a coplanar waveguide (CPW) feed with slots etched in a dedicated metal ground plane that is located under the DRA. Moreover, locating the elements at the opposite sides of the substrate has improved the isolation by 27 dB without the need to incorporate additional complex structures, which has reduced the overall antenna size. Furthermore, a dual band operation is achieved since each antenna resonates at two frequencies: 28 GHz and 38 GHz with respective impedance matching bandwidths of 18% and 13%. As a result, the corresponding data rates are also increased independently. In addition to the advantages of improved isolation, compact size and dual band operation, the proposed configuration offers a diversity gain (DG), envelope correlation coefficient (ECC) and channel capacity loss (CCL) of 9.98 dB, 0.007, 0.06 bits/s/Hz over the desired bands, respectively. A prototype has been built with good agreement between simulated and measured results. Full article
(This article belongs to the Special Issue Antenna Technologies for Millimeter and Terahertz Sensing)
Show Figures

Figure 1

22 pages, 49989 KiB  
Article
Enhanced Perception for Autonomous Driving Using Semantic and Geometric Data Fusion
by Horatiu Florea, Andra Petrovai, Ion Giosan, Florin Oniga, Robert Varga and Sergiu Nedevschi
Sensors 2022, 22(13), 5061; https://doi.org/10.3390/s22135061 - 5 Jul 2022
Cited by 16 | Viewed by 4916
Abstract
Environment perception remains one of the key tasks in autonomous driving for which solutions have yet to reach maturity. Multi-modal approaches benefit from the complementary physical properties specific to each sensor technology used, boosting overall performance. The added complexity brought on by data [...] Read more.
Environment perception remains one of the key tasks in autonomous driving for which solutions have yet to reach maturity. Multi-modal approaches benefit from the complementary physical properties specific to each sensor technology used, boosting overall performance. The added complexity brought on by data fusion processes is not trivial to solve, with design decisions heavily influencing the balance between quality and latency of the results. In this paper we present our novel real-time, 360 enhanced perception component based on low-level fusion between geometry provided by the LiDAR-based 3D point clouds and semantic scene information obtained from multiple RGB cameras, of multiple types. This multi-modal, multi-sensor scheme enables better range coverage, improved detection and classification quality with increased robustness. Semantic, instance and panoptic segmentations of 2D data are computed using efficient deep-learning-based algorithms, while 3D point clouds are segmented using a fast, traditional voxel-based solution. Finally, the fusion obtained through point-to-image projection yields a semantically enhanced 3D point cloud that allows enhanced perception through 3D detection refinement and 3D object classification. The planning and control systems of the vehicle receives the individual sensors’ perception together with the enhanced one, as well as the semantically enhanced 3D points. The developed perception solutions are successfully integrated onto an autonomous vehicle software stack, as part of the UP-Drive project. Full article
(This article belongs to the Special Issue Robust Multimodal Sensing for Automated Driving Systems)
Show Figures

Figure 1

16 pages, 17730 KiB  
Communication
A System for Autonomous Seaweed Farm Inspection with an Underwater Robot
by Ivan Stenius, John Folkesson, Sriharsha Bhat, Christopher Iliffe Sprague, Li Ling, Özer Özkahraman, Nils Bore, Zheng Cong, Josefine Severholt, Carl Ljung, Anna Arnwald, Ignacio Torroba, Fredrik Gröndahl and Jean-Baptiste Thomas
Sensors 2022, 22(13), 5064; https://doi.org/10.3390/s22135064 - 5 Jul 2022
Cited by 14 | Viewed by 6131
Abstract
This paper outlines challenges and opportunities in operating underwater robots (so-called AUVs) on a seaweed farm. The need is driven by an emerging aquaculture industry on the Swedish west coast where large-scale seaweed farms are being developed. In this paper, the operational challenges [...] Read more.
This paper outlines challenges and opportunities in operating underwater robots (so-called AUVs) on a seaweed farm. The need is driven by an emerging aquaculture industry on the Swedish west coast where large-scale seaweed farms are being developed. In this paper, the operational challenges are described and key technologies in using autonomous systems as a core part of the operation are developed and demonstrated. The paper presents a system and methods for operating an AUV in the seaweed farm, including initial localization of the farm based on a prior estimate and dead-reckoning navigation, and the subsequent scanning of the entire farm. Critical data from sidescan sonars for algorithm development are collected from real environments at a test site in the ocean, and the results are demonstrated in a simulated seaweed farm setup. Full article
(This article belongs to the Special Issue Underwater Robotics in 2022-2023)
Show Figures

Figure 1

16 pages, 2339 KiB  
Review
Single-Molecule Surface-Enhanced Raman Spectroscopy
by Yuxuan Qiu, Cuifang Kuang, Xu Liu and Longhua Tang
Sensors 2022, 22(13), 4889; https://doi.org/10.3390/s22134889 - 29 Jun 2022
Cited by 43 | Viewed by 7106
Abstract
Single-molecule surface-enhanced Raman spectroscopy (SM-SERS) has the potential to detect single molecules in a non-invasive, label-free manner with high-throughput. SM-SERS can detect chemical information of single molecules without statistical averaging and has wide application in chemical analysis, nanoelectronics, biochemical sensing, etc. Recently, a [...] Read more.
Single-molecule surface-enhanced Raman spectroscopy (SM-SERS) has the potential to detect single molecules in a non-invasive, label-free manner with high-throughput. SM-SERS can detect chemical information of single molecules without statistical averaging and has wide application in chemical analysis, nanoelectronics, biochemical sensing, etc. Recently, a series of unprecedented advances have been realized in science and application by SM-SERS, which has attracted the interest of various fields. In this review, we first elucidate the key concepts of SM-SERS, including enhancement factor (EF), spectral fluctuation, and experimental evidence of single-molecule events. Next, we systematically discuss advanced implementations of SM-SERS, including substrates with ultra-high EF and reproducibility, strategies to improve the probability of molecules being localized in hotspots, and nonmetallic and hybrid substrates. Then, several examples for the application of SM-SERS are proposed, including catalysis, nanoelectronics, and sensing. Finally, we summarize the challenges and future of SM-SERS. We hope this literature review will inspire the interest of researchers in more fields. Full article
(This article belongs to the Special Issue Molecular Opto-Electronic Sensing Devices and Techniques)
Show Figures

Figure 1

27 pages, 3842 KiB  
Article
Experimental Performance Analysis of a Scalable Distributed Hyperledger Fabric for a Large-Scale IoT Testbed
by Houshyar Honar Pajooh, Mohammad A. Rashid, Fakhrul Alam and Serge Demidenko
Sensors 2022, 22(13), 4868; https://doi.org/10.3390/s22134868 - 28 Jun 2022
Cited by 22 | Viewed by 4113
Abstract
Blockchain technology, with its decentralization characteristics, immutability, and traceability, is well-suited for facilitating secure storage, sharing, and management of data in decentralized Internet of Things (IoT) applications. Despite the increasing development of blockchain platforms, there is still no comprehensive approach for adopting blockchain [...] Read more.
Blockchain technology, with its decentralization characteristics, immutability, and traceability, is well-suited for facilitating secure storage, sharing, and management of data in decentralized Internet of Things (IoT) applications. Despite the increasing development of blockchain platforms, there is still no comprehensive approach for adopting blockchain technology in IoT systems. This is due to the blockchain’s limited capability to process substantial transaction requests from a massive number of IoT devices. Hyperledger Fabric (HLF) is a popular open-source permissioned blockchain platform hosted by the Linux Foundation. This article reports a comprehensive empirical study that measures HLF’s performance and identifies potential performance bottlenecks to better meet the requirements of blockchain-based IoT applications. The study considers the implementation of HLF on distributed large-scale IoT systems. First, a model for monitoring the performance of the HLF platform is presented. It addresses the overhead challenges while delivering more details on system performance and better scalability. Then, the proposed framework is implemented to evaluate the impact of varying network workloads on the performance of the blockchain platform in a large-scale distributed environment. In particular, the performance of the HLF is evaluated in terms of throughput, latency, network size, scalability, and the number of peers serviceable by the platform. The obtained experimental results indicate that the proposed framework can provide detailed real-time performance evaluation of blockchain systems for large-scale IoT applications. Full article
(This article belongs to the Section Internet of Things)
Show Figures

Figure 1

29 pages, 3929 KiB  
Review
Electrochemical (Bio)Sensors Based on Covalent Organic Frameworks (COFs)
by Emiliano Martínez-Periñán, Marcos Martínez-Fernández, José L. Segura and Encarnación Lorenzo
Sensors 2022, 22(13), 4758; https://doi.org/10.3390/s22134758 - 23 Jun 2022
Cited by 34 | Viewed by 5641
Abstract
Covalent organic frameworks (COFs) are defined as crystalline organic polymers with programmable topological architectures using properly predesigned building blocks precursors. Since the development of the first COF in 2005, many works are emerging using this kind of material for different applications, such as [...] Read more.
Covalent organic frameworks (COFs) are defined as crystalline organic polymers with programmable topological architectures using properly predesigned building blocks precursors. Since the development of the first COF in 2005, many works are emerging using this kind of material for different applications, such as the development of electrochemical sensors and biosensors. COF shows superb characteristics, such as tuneable pore size and structure, permanent porosity, high surface area, thermal stability, and low density. Apart from these special properties, COF’s electrochemical behaviour can be modulated using electroactive building blocks. Furthermore, the great variety of functional groups that can be inserted in their structures makes them interesting materials to be conjugated with biological recognition elements, such as antibodies, enzymes, DNA probe, aptamer, etc. Moreover, the possibility of linking them with other special nanomaterials opens a wide range of possibilities to develop new electrochemical sensors and biosensors. Full article
(This article belongs to the Special Issue Game Changer Nanomaterials: A New Concept for Biosensing Applications)
Show Figures

Figure 1

Back to TopTop