Electronics

Research

20 pages, 2787 KiB

Open AccessArticle

Performance Investigations of VSLAM and Google Street View Integration in Outdoor Location-Based Augmented Reality under Various Lighting Conditions

by Komang Candra Brata, Nobuo Funabiki, Prismahardi Aji Riyantoko, Yohanes Yohanie Fridelin Panduman and Mustika Mentari

Electronics 2024, 13(15), 2930; https://doi.org/10.3390/electronics13152930 - 24 Jul 2024

Viewed by 1304

Abstract

The growing demand for Location-based Augmented Reality (LAR) experiences has driven the integration of Visual Simultaneous Localization And Mapping (VSLAM) with Google Street View (GSV) to enhance the accuracy. However, the impact of the ambient light intensity on the accuracy and reliability is [...] Read more.

The growing demand for Location-based Augmented Reality (LAR) experiences has driven the integration of Visual Simultaneous Localization And Mapping (VSLAM) with Google Street View (GSV) to enhance the accuracy. However, the impact of the ambient light intensity on the accuracy and reliability is underexplored, posing significant challenges in outdoor LAR implementations. This paper investigates the impact of light conditions on the accuracy and reliability of the VSLAM/GSV integration approach in outdoor LAR implementations. This study fills a gap in the current literature and offers valuable insights into vision-based approach implementation under different light conditions. Extensive experiments were conducted at five Point of Interest (POI) locations under various light conditions with a total of 100 datasets. Descriptive statistic methods were employed to analyze the data and assess the performance variation. Additionally, the Analysis of Variance (ANOVA) analysis was utilized to assess the impact of different light conditions on the accuracy metric and horizontal tracking time, determining whether there are significant differences in performance across varying levels of light intensity. The experimental results revealed that a significant correlation (p <

0.05

) exists between the ambient light intensity and the accuracy of the VSLAM/GSV integration approach. Through the confidence interval estimation, the minimum illuminance

434 lx

is needed to provide a feasible and consistent accuracy. Variations in visual references, such as wet surfaces in the rainy season, also impact the horizontal tracking time and accuracy. Full article

(This article belongs to the Special Issue Perception and Interaction in Mixed, Augmented, and Virtual Reality)

► Show Figures

Figure 1

21 pages, 1721 KiB

Open AccessArticle

Unravelling Virtual Realities—Gamers’ Perceptions of the Metaverse

by Mónica Cruz and Abílio Oliveira

Electronics 2024, 13(13), 2491; https://doi.org/10.3390/electronics13132491 - 25 Jun 2024

Cited by 2 | Viewed by 1381

Abstract

In a rapidly evolving digital landscape, the Metaverse emerges as a transformative force, integrating augmented reality, virtual reality, and the internet, to redefine online interactions. This collective virtual shared space promises to revolutionise global collaboration, communication, and information engagement. Our study consisted of [...] Read more.

In a rapidly evolving digital landscape, the Metaverse emerges as a transformative force, integrating augmented reality, virtual reality, and the internet, to redefine online interactions. This collective virtual shared space promises to revolutionise global collaboration, communication, and information engagement. Our study consisted of the application, through an online form builder, of a questionnaire to Portuguese adult gamers, analysing the results with descriptive statistics. Our research question was the following: how is the Metaverse perceived and represented by gamers? In this context, we trace four objectives: (1) verify the representations of the Metaverse; (2) verify the representations of immersion; (3) verify the representations of the multiverse; and (4) verify the importance of these concepts in daily reality. Our findings explored the Metaverse, immersion, and multiverse concepts, uncovering gamers’ perceptions with emphasis on animation, gaming, and virtual worlds as foundational elements. The Metaverse arises as an evolving force that bridges emotional experiences, offering limitless possibilities for experimentation and exploration. Full article

(This article belongs to the Special Issue Perception and Interaction in Mixed, Augmented, and Virtual Reality)

► Show Figures

Figure 1

20 pages, 2121 KiB

Open AccessArticle

Where Are We Now?—Exploring the Metaverse Representations to Find Digital Twins

by Mónica Cruz and Abílio Oliveira

Electronics 2024, 13(10), 1984; https://doi.org/10.3390/electronics13101984 - 19 May 2024

Cited by 1 | Viewed by 1018

Abstract

The Metaverse promises to change our lives and how we usually interact with the world. However, it can only evolve with technological development and entertainment engagement advances. To investigate more leads regarding this concept, we have a main search question: How are the [...] Read more.

The Metaverse promises to change our lives and how we usually interact with the world. However, it can only evolve with technological development and entertainment engagement advances. To investigate more leads regarding this concept, we have a main search question: How are the Metaverse, gaming, and digital twins represented in Academia? To answer it, we need to verify and determine how the Metaverse is defined, how gaming, as an entertainment industry, is represented, and how Digital Twins are defined by scientific knowledge. It will also be important to analyze how these concepts are intercorrelated. Here, we present a documental study—meta-analysis—of the most relevant indexed scientific papers published in the last ten years, according to predefined inclusion and exclusion criteria. Leximancer software will help us determine the main concepts and themes extracted from these articles—namely from the Keywords, Abstracts, Methodologies, and Conclusions sections. This study allows us to understand how these concepts are perceived, contribute to a scientific discussion, and give suggestions for future research and new leads on approaching these concepts. Full article

(This article belongs to the Special Issue Perception and Interaction in Mixed, Augmented, and Virtual Reality)

► Show Figures

Figure 1

25 pages, 4974 KiB

Open AccessEditor’s ChoiceArticle

Augmented Reality in Industry 4.0 Assistance and Training Areas: A Systematic Literature Review and Bibliometric Analysis

by Ginés Morales Méndez and Francisco del Cerro Velázquez

Electronics 2024, 13(6), 1147; https://doi.org/10.3390/electronics13061147 - 21 Mar 2024

Cited by 3 | Viewed by 2331

Abstract

Augmented reality (AR) technology is making a strong appearance on the industrial landscape, driven by significant advances in technological tools and developments. Its application in areas such as training and assistance has attracted the attention of the research community, which sees AR as [...] Read more.

Augmented reality (AR) technology is making a strong appearance on the industrial landscape, driven by significant advances in technological tools and developments. Its application in areas such as training and assistance has attracted the attention of the research community, which sees AR as an opportunity to provide operators with a more visual, immersive and interactive environment. This article deals with an analysis of the integration of AR in the context of the fourth industrial revolution, commonly referred to as Industry 4.0. Starting with a systematic review, 60 relevant studies were identified from the Scopus and Web of Science databases. These findings were used to build bibliometric networks, providing a broad perspective on AR applications in training and assistance in the context of Industry 4.0. The article presents the current landscape, existing challenges and future directions of AR research applied to industrial training and assistance based on a systematic literature review and citation network analysis. The findings highlight a growing trend in AR research, with a particular focus on addressing and overcoming the challenges associated with its implementation in complex industrial environments. Full article

(This article belongs to the Special Issue Perception and Interaction in Mixed, Augmented, and Virtual Reality)

► Show Figures

Figure 1

14 pages, 9088 KiB

Open AccessFeature PaperArticle

A Framework Integrating Augmented Reality and Wearable Sensors for the Autonomous Execution of Rehabilitation Exercises

by Jacopo Rizzi, Andrea D’Antona, Antonino Proto, Giovanni Piva, Nicola Lamberti, Marcello Bonfè and Saverio Farsoni

Electronics 2023, 12(24), 4958; https://doi.org/10.3390/electronics12244958 - 10 Dec 2023

Viewed by 1457

Abstract

Despite the resolution of pathology at admission, many hospitalized patients are discharged in a worse functional state, particularly in terms of walking capabilities, due to hospitalization inactivity. Early interventions to maintain the functional state through exercise such as passive mobilization, executed during hospitalization, [...] Read more.

Despite the resolution of pathology at admission, many hospitalized patients are discharged in a worse functional state, particularly in terms of walking capabilities, due to hospitalization inactivity. Early interventions to maintain the functional state through exercise such as passive mobilization, executed during hospitalization, have been proven to be effective in preventing physical and cognitive decline. Unfortunately, many patients can be excluded from such treatments due to the high number of people hospitalized and the limited availability of healthcare personnel. This paper presents a framework that allows the patient to autonomously perform the exercises without the assistance of qualified personnel. Such a framework exploits the advantages of an Augmented Reality (AR) device in which the patient can visualize real-time instructions on the exercises and directions on their execution. The monitoring of the patient’s movements during exercise is accomplished by means of dedicated wearable sensors fixed to the patient’s limb. The system was tested in preliminary experiments on healthy people. Full article

(This article belongs to the Special Issue Perception and Interaction in Mixed, Augmented, and Virtual Reality)

► Show Figures

Figure 1

16 pages, 8887 KiB

Open AccessArticle

Enhancing Wayfinding Experience in Low-Vision Individuals through a Tailored Mobile Guidance Interface

by Taewoo Jo, Dohyeon Yeo and SeungJun Kim

Electronics 2023, 12(22), 4561; https://doi.org/10.3390/electronics12224561 - 7 Nov 2023

Cited by 1 | Viewed by 1468

Abstract

Individuals with low vision (LV) face daily wayfinding challenges, struggling with route establishment, direction recognition, and obstacle avoidance. Mobile navigation, though commonly relied upon, often clashes with LV visual conditions, particularly central scotomas from diseases like age-related macular degeneration (AMD), hindering the relay [...] Read more.

Individuals with low vision (LV) face daily wayfinding challenges, struggling with route establishment, direction recognition, and obstacle avoidance. Mobile navigation, though commonly relied upon, often clashes with LV visual conditions, particularly central scotomas from diseases like age-related macular degeneration (AMD), hindering the relay of crucial wayfinding information. Addressing this, we introduced a novel guidance interface post-literature review. In a VR-based user study involving 25 participants simulating LV experience, our map guidance interface enabled quicker navigation, improving system usability and presence. The resulting performance paralleled that of normal-vision individuals. This study demonstrated that modifying familiar navigation interfaces effectively addresses visual impairment conflicts, enhancing outdoor navigation for individuals with LV. The modifications extend benefits, enabling comparable wayfinding ease to individuals with normal vision. Full article

(This article belongs to the Special Issue Perception and Interaction in Mixed, Augmented, and Virtual Reality)

► Show Figures

Figure 1

12 pages, 4255 KiB

Open AccessArticle

Exploring the Perception of the Effect of Three-Dimensional Interaction Feedback Types on Immersive Virtual Reality Education

by Kwang-Seong Shin, Chungyeon Cho, Ji Hyun Ryu and Dongsik Jo

Electronics 2023, 12(21), 4414; https://doi.org/10.3390/electronics12214414 - 26 Oct 2023

Cited by 1 | Viewed by 1628

Abstract

Immersive virtual reality (VR) systems are becoming widely used for education with three-dimensional (3D) information. Specifically, three-dimensional spaces to create virtual environments can help increase students’ learning interest and ability with spatial interaction. Also, with the use of multimodal interaction, VR systems can [...] Read more.

Immersive virtual reality (VR) systems are becoming widely used for education with three-dimensional (3D) information. Specifically, three-dimensional spaces to create virtual environments can help increase students’ learning interest and ability with spatial interaction. Also, with the use of multimodal interaction, VR systems can provide highly effective ways to solve problems through natural experiences. Additionally, immersive environments can bring together people in remote locations, which has been increasingly applied in education applications with the use of technology to simulate real situations. However, effective interaction methods that improve the learning ability of people participating in educational activities in 3D immersive environments are yet to be well defined. In this study, we investigated the effect of the interaction feedback types on the perception of students participating in VR environments. We conducted the experiment on three types of interaction responses, and our study was designed as a virtual chemistry class. Our experimental study showed that the interaction feedback type of a deformable object had a greater educational effect than other types of visual or audio feedback, and our results are expected to provide guidelines on how to create effective immersive education content and interaction methods. Full article

(This article belongs to the Special Issue Perception and Interaction in Mixed, Augmented, and Virtual Reality)

► Show Figures

Figure 1

22 pages, 17347 KiB

Open AccessArticle

How Do Background and Remote User Representations Affect Social Telepresence in Remote Collaboration?: A Study with Portal Display, a Head Pose-Responsive Video Teleconferencing System

by Seongjun Kang, Gwangbin Kim, Kyung-Taek Lee and SeungJun Kim

Electronics 2023, 12(20), 4339; https://doi.org/10.3390/electronics12204339 - 19 Oct 2023

Viewed by 1384

Abstract

This study presents Portal Display, a screen-based telepresence system that mediates the interaction between two distinct spaces, each using a single display system. The system synchronizes the users’ viewpoint with their head position and orientation to provide stereoscopic vision through this single monitor. [...] Read more.

This study presents Portal Display, a screen-based telepresence system that mediates the interaction between two distinct spaces, each using a single display system. The system synchronizes the users’ viewpoint with their head position and orientation to provide stereoscopic vision through this single monitor. This research evaluates the impact of graphically rendered and video-streamed backgrounds and remote user representations on social telepresence, usability, and concentration during conversations and collaborative tasks. Our results indicate that the type of background has a negligible impact on these metrics. However, point cloud streaming of remote users significantly improves social telepresence, usability, and concentration compared with graphical avatars. This study implies that Portal Display can operate more efficiently by substituting the background with graphical rendering and focusing on higher-resolution 3D point cloud streaming for narrower regions for remote user representations. This configuration may be especially advantageous for applications where the remote user’s background is not essential to the task, potentially enhancing social telepresence. Full article

(This article belongs to the Special Issue Perception and Interaction in Mixed, Augmented, and Virtual Reality)

► Show Figures

Figure 1

12 pages, 7248 KiB

Open AccessEditor’s ChoiceArticle

Optimal Camera Placement to Generate 3D Reconstruction of a Mixed-Reality Human in Real Environments

by Juhwan Kim and Dongsik Jo

Electronics 2023, 12(20), 4244; https://doi.org/10.3390/electronics12204244 - 13 Oct 2023

Viewed by 2714

Abstract

Virtual reality and augmented reality are increasingly used for immersive engagement by utilizing information from real environments. In particular, three-dimensional model data, which is the basis for creating virtual places, can be manually developed using commercial modeling toolkits, but with the advancement of [...] Read more.

Virtual reality and augmented reality are increasingly used for immersive engagement by utilizing information from real environments. In particular, three-dimensional model data, which is the basis for creating virtual places, can be manually developed using commercial modeling toolkits, but with the advancement of sensing technology, computer vision technology can also be used to create virtual environments. Specifically, a 3D reconstruction approach can generate a single 3D model from image information obtained from various scenes in real environments using several cameras (multi-cameras). The goal is to generate a 3D model with excellent precision. However, the rules for choosing the optimal number of cameras and settings to capture information from in real environments (e.g., actual people) employing several cameras in unconventional positions are lacking. In this study, we propose an optimal camera placement strategy for acquiring high-quality 3D data using an irregular camera placement, essential for organizing image information while acquiring human data in a three-dimensional real space, using multiple irregular cameras in real environments. Our results show that installation costs can be lowered by arranging a minimum number of multi-camera cameras in an arbitrary space, and automated virtual human manufacturing with high accuracy can be conducted using optimal irregular camera location. Full article

(This article belongs to the Special Issue Perception and Interaction in Mixed, Augmented, and Virtual Reality)

► Show Figures

Figure 1

17 pages, 3067 KiB

Open AccessArticle

Virtual Reality Interface Evaluation for Earthwork Teleoperation

by Léa Saunier, Nicolas Hoffmann, Marius Preda and Catalin Fetita

Electronics 2023, 12(19), 4151; https://doi.org/10.3390/electronics12194151 - 6 Oct 2023

Cited by 4 | Viewed by 1175

Abstract

Automation and robotics are destined to play a critical role in the Industry 4.0 revolution, as illustrated by the emergence of autonomous machinery in earthwork operations. Despite rapid progress, autonomous agents will always require human supervision to instruct their mission and to guaranty [...] Read more.

Automation and robotics are destined to play a critical role in the Industry 4.0 revolution, as illustrated by the emergence of autonomous machinery in earthwork operations. Despite rapid progress, autonomous agents will always require human supervision to instruct their mission and to guaranty safety when unexpected problems arise. Traditional human supervision requires an operator to physically enter each machine at risk and manually take control. This approach is time-consuming and requires highly qualified personnel capable of operating various machines. This process can be hastened and simplified by means of teleoperated supervision, which itself requires the appropriate interface. In this paper we evaluate a virtual reality (VR)-based interface using hybrid interactions and an immersive digital-twin compared to a real-life control. We compare these interfaces through control tasks performed by expert and non-expert operators, analyzing time and precision, as well as user feedback. The preliminary results show that the VR interface brings equivalent and satisfactory performances for experts and improves the efficiency of apprentices. Therefore, not only does everyone performs well in the virtual environment, but also the training time can be shortened significantly as non-experts can perform similarly under the same conditions. Full article

(This article belongs to the Special Issue Perception and Interaction in Mixed, Augmented, and Virtual Reality)

► Show Figures

Figure 1

13 pages, 7370 KiB

Open AccessArticle

Recognition of Human Mental Stress Using Machine Learning: A Case Study on Refugees

by Dorota Kamińska

Electronics 2023, 12(16), 3468; https://doi.org/10.3390/electronics12163468 - 16 Aug 2023

Cited by 3 | Viewed by 1975

Abstract

This paper introduces a study on stress recognition utilizing mobile EEG and GSR sensors. The research involved collecting samples from a group of 55 refugees who participated in Virtual Reality stress-reduction sessions. The timing of the study coincided with an influx of refugees, [...] Read more.

This paper introduces a study on stress recognition utilizing mobile EEG and GSR sensors. The research involved collecting samples from a group of 55 refugees who participated in Virtual Reality stress-reduction sessions. The timing of the study coincided with an influx of refugees, prompting the development of software specifically designed to alleviate acute stress among them. The paper focuses on presenting an EEG/GSR signals pipeline for classifying stress levels, emphasizing selecting the most informative features. The classification process employed popular machine learning methods, yielding results of 86.7% for two-stress-level classification and 82.3% and 67.7% for the three- and five-level classifications, respectively. Most importantly, the positive impact of the system has been proven by subjective assessment in alignment with objective features analysis. Such a system has not yet reached the level of autonomy, but it can be a valuable support tool for mental health professionals. Full article

(This article belongs to the Special Issue Perception and Interaction in Mixed, Augmented, and Virtual Reality)

► Show Figures

Figure 1

19 pages, 4197 KiB

Open AccessArticle

Consumer Subjective Impressions in Virtual Reality Environments: The Role of the Visualization Technique in Product Evaluation

by Almudena Palacios-Ibáñez, Francisco Felip-Miralles, Julia Galán, Carlos García-García and Manuel Contero

Electronics 2023, 12(14), 3051; https://doi.org/10.3390/electronics12143051 - 12 Jul 2023

Cited by 5 | Viewed by 1195

Abstract

The availability and affordability of consumer virtual reality (VR) devices have fueled their adoption during the product design process. High fidelity virtual prototypes can be created more quickly and are more cost-effective than using traditional methods, but certain product features are still difficult [...] Read more.

The availability and affordability of consumer virtual reality (VR) devices have fueled their adoption during the product design process. High fidelity virtual prototypes can be created more quickly and are more cost-effective than using traditional methods, but certain product features are still difficult to evaluate, resulting in perceptual differences when a product is assessed using different visualization techniques. In this paper, we report two case studies in which a group of participants evaluated different designs of a product typology (i.e., a watering can) as presented in VR, VR with passive haptics (VRPH) and in a real setting (R) for the first case study, and VR and R for the second case study. The semantic differential technique was used for product evaluation, and an inferential statistical method using aligned rank transform (ART) proceedings was applied to determine perceptual differences between groups. Our results showed that product characteristics assessed by touch are the most susceptible to being affected by the environment, while the user background can have an effect in some product features. Full article

(This article belongs to the Special Issue Perception and Interaction in Mixed, Augmented, and Virtual Reality)

► Show Figures

Figure 1

Review

Jump to: Research, Other

32 pages, 16646 KiB

Open AccessReview

Augmented Reality: Current and New Trends in Education

by Dorota Kamińska, Grzegorz Zwoliński, Anna Laska-Leśniewicz, Rui Raposo, Mário Vairinhos, Elisabeth Pereira, Frane Urem, Martina Ljubić Hinić, Rain Eric Haamer and Gholamreza Anbarjafari

Electronics 2023, 12(16), 3531; https://doi.org/10.3390/electronics12163531 - 21 Aug 2023

Cited by 18 | Viewed by 13520

Abstract

The educational landscape is an environment prone to change due to the volatile and ever-changing nature of the digital society in which we all live. Although the world moves at different speeds and any generalization is bound to have some exceptions, there is [...] Read more.

The educational landscape is an environment prone to change due to the volatile and ever-changing nature of the digital society in which we all live. Although the world moves at different speeds and any generalization is bound to have some exceptions, there is evidence from research conducted in different places and contexts that educational methods are becoming increasingly digitized and driven by technological innovation. Among the technological trends fueled in many cases by the COVID-19 pandemic and the need to stay at home but online, augmented reality solutions received an additional boost as a valid and versatile educational technology worth exploring and eventually integrating into several teaching methods already in use. Although the technology still faces problems related to affordability, accessibility, and the technical skills required of users, some ongoing projects have already provided evidence that using augmented reality solutions as teaching and learning tools can improve teacher and student learning outcomes by increasing engagement and interactivity. The same issues arose when personal computers, tablets, and smartphones were first discussed as valuable tools for education and have now found their way into most classrooms. This paper reviews some of the key concepts related to augmented reality, as well as some current trends, benefits, and concerns related to its integration into educational contexts in areas such as life sciences, engineering, and health. The work conducted and presented in this paper provides an interesting insight into a technology that has given rise to global phenomena such as Pokémon Go, and continues to improve in terms of portability, usability, and overall user experience. Throughout the paper and in the conclusion section, we discuss the relevance of using the best features of augmented reality and how they can contribute to positive educational outcomes. Full article

(This article belongs to the Special Issue Perception and Interaction in Mixed, Augmented, and Virtual Reality)

► Show Figures

Figure 1

Other

Jump to: Research, Review

19 pages, 734 KiB

Open AccessSystematic Review

Addressing Body Image Disturbance through Metaverse-Related Technologies: A Systematic Review

by Moises Perez, Adriana Pineda-Rafols, Maria Pilar Egea-Romero, Maria Gonzalez-Moreno and Esther Rincon

Electronics 2023, 12(22), 4580; https://doi.org/10.3390/electronics12224580 - 9 Nov 2023

Viewed by 1840

Abstract

There is an increasing awareness about body image disturbance and eating disorders which calls for a multidisciplinary approach. The usefulness of new technologies for improving body image distortion has been addressed in the scientific literature, but has not included current strategies such as [...] Read more.

There is an increasing awareness about body image disturbance and eating disorders which calls for a multidisciplinary approach. The usefulness of new technologies for improving body image distortion has been addressed in the scientific literature, but has not included current strategies such as Metaverse-related technologies. Seemingly, this is the first systematic review which focuses on the efficacy of Metaverse-related technologies in reducing body image disturbance related to eating disorders like Anorexia nervosa and Bulimia nervosa. The main objective of this study was to review the scientific studies published in the last decade to answer the following three questions: (1) Are Metaverse-related technologies useful in mitigating body image disturbance in patients diagnosed with Anorexia nervosa and Bulimia nervosa? (2) What are the advantages and disadvantages? (3) Are the patients satisfied after using this kind of technology? The results obtained were that 80% of the included studies found metaverse-related technologies useful for the improvement in body image disturbance, in addition to various advantages, such as a decrease in eating disorder symptomatology. Whereas patient satisfaction was only evaluated in 20% of the included studies, with the majority of patients evaluating the use of metaverse-related technologies positively. We will conduct a systematic review of the peer-reviewed literature from EBSCO Discovery Service, and Web of Science (WOS), following the PRISMA statements. Only Journal articles published from 2013 to the present, written in the English language, will be reviewed. The findings are expected to offer valuable insights for the development of novel approaches for the improvement in body image disturbance in healthcare settings. Full article

(This article belongs to the Special Issue Perception and Interaction in Mixed, Augmented, and Virtual Reality)

► Show Figures

Figure 1

Journal Menu

Journal Browser

Perception and Interaction in Mixed, Augmented, and Virtual Reality

Share This Special Issue

Special Issue Editors

Special Issue Information

Keywords

Benefits of Publishing in a Special Issue

Published Papers (14 papers)

Research

Review

Other

Further Information

Guidelines

MDPI Initiatives

Follow MDPI