Next Article in Journal
Artificial Interpretation: An Investigation into the Feasibility of Archaeologically Focused Seismic Interpretation via Machine Learning
Previous Article in Journal
An Unknown 18th-Century Flemish Dyers Manuscript from Antwerp (1778–1802)
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

User Experience of Virtual Heritage Tours with 360° Photos: A Study of the Chapel of Dolores in Icod de los Vinos

by
Cecile Meier
1,*,
Jose Luis Saorín
2,
Silvia Díaz Parrilla
3,
Alejandro Bonnet de León
1 and
Dámari Melián Díaz
2
1
Department of Fine Arts, University of La Laguna, 38320 La Laguna, Spain
2
Department of Techniques and Projects in Engineering and Architecture, University of La Laguna, 38206 La Laguna, Spain
3
Department of Conservation and Restoration of Cultural Heritage, University of La Laguna, 38320 La Laguna, Spain
*
Author to whom correspondence should be addressed.
Heritage 2024, 7(5), 2477-2490; https://doi.org/10.3390/heritage7050118
Submission received: 5 April 2024 / Revised: 2 May 2024 / Accepted: 9 May 2024 / Published: 10 May 2024

Abstract

:
Virtual tours with 360 photos present a quick, easy and accessible way to create immersive experiences. The visualization on diverse devices provides a user experience that can be different. A virtual tour with 360 photos of the Chapel of Dolores (Tenerife) has been created. Access is limited to specific days, so the creation of a virtual tour allows you to visit it at any time; in addition, a pilot test has been carried out with students of the degree of restoration and conservation of cultural heritage in order to measure the user experience of the virtual tour, depending on the device used. The participants took a virtual tour of the Dolores Chapel, first with a cell phone and then with the virtual reality headset, and then completed a user experience questionnaire. The results obtained comparing both visualization technologies are detailed, highlighting the fact that when using the virtual reality headset no better results are obtained on the immersion subscale; in addition, the visualization on a smartphone is more comfortable and obtains better results for consequences such as dizziness and vertigo. Therefore, it may be an interesting strategy to have simple versions that work quickly on cell phones.

1. Introduction

For this work, we created a virtual tour with 360 photos of the Chapel of Nuestra Señora de los Dolores, also known as Capilla de la Huerta, located in the municipality of Icod de los Vinos, on the island of Tenerife (Spain). This property is annexed to the dependencies of the former Convento Franciscano del Espíritu Santo, being considered part of the convent complex, which has had the denomination of an Asset of Cultural Interest, in the category of Monument since 2013 [1].
It was the family of Hurtado de Mendoza who promoted the construction of the chapel in the late eighteenth century at the request of Captain Hurtado de Mendoza, who wanted to dedicate it to the Virgin of Dolores. The chapel was finished in 1770, although it underwent modifications until 1774 [2]. Focusing on its interior, the temple has a single nave, rectangular floor plan and a roof of pair and knuckle, with suspenders that present an ornamentation of crosses and stars, being one of the few structures of these characteristics that are preserved on the archipelago (Figure 1).
Occupying the front of the chapel is the main altarpiece, which belongs to the second half of the 18th century and is catalogued as a Rococo–Chinesque altarpiece [3]. It can be said that this altarpiece is registrable, which means it is allowed to be transited through several accesses which at the time were created for functional reasons (extraction and placement of niches and images, modification of the altar table, etc.) and this has allowed the identification and analysis of its construction system, of architectural box or sheet, which is hidden behind the facade of the altarpiece [4].
The interest aroused by this altarpiece has led to different technical studies and interventions on it [5]. The last of these works took place in 2021, within the framework of the Final Degree Project in Conservation and Restoration of Cultural Property, where the study and conservation–restoration of the central niche of the main altarpiece was carried out [6].
Although the chapel is still open for worship, its access is limited to specific days of the month and festivities, so the creation of a virtual tour provides the possibility of being able to visit it at any time. This chapel, as described above, is of historical–artistic interest and justifies its dissemination, encouraged by the good state of preservation in which it is found and the amount of documentation available thanks to the studies and interventions carried out. In short, this project aims to enhance the value of the Chapel of Dolores, also revealing rooms and spaces which, even on the days it is open, are not accessible to the public.
In any case, virtual reality, to be effective as an element of communication in the dissemination of heritage, must be accepted by the user. This means that the user of this technology must feel comfortable with the interface used and perceive that the scenario he or she visualizes is valid. Although virtual environments are considered a powerful tool for learning and communication [7,8], some authors have started to study the user experience (UX), i.e., the overall perception a person has when interacting with a product, in this case a virtual tour. This includes all aspects of the interaction, such as usability, accessibility, aesthetics, usefulness and satisfaction experienced by the user [9,10].
In this sense, one of the ways to evaluate user experience are surveys with specialized questionnaires. The first user experience questionnaire (UEQ) was created in 2005 [11] and consisted of eighty questions and six scales (Attractiveness, Perspicuity, Efficiency, Dependability, Stimulation and Novelty). This questionnaire allows for an efficient quantitative measurement of a product’s characteristics. The questionnaire is available in multiple languages and was validated several times [12,13]. User experience questionnaires can be used to test new versions of a product, compare one product to another, and validate a new product to see if it is good enough for the user, as well as to determine where improvements need to be made [14].
Research on virtual tours has been conducted, for example at Princess Norah University in Saudi Arabia. The results revealed that the virtual tour lacked interest and adequate visualization options. Improvements in the graphic design were needed to make it more visible, as images of campus buildings and features requested by users were missing [15]. In another research study, forty virtual museum tours were analyzed, and the study found a noticeable difference with user experience. With the results obtained, they offer specific recommendations to improve the creation of 360-degree virtual tours, making them more accessible and user-friendly [16]. Li and Huang [17] analyzed a virtual tour of the Palace Museum, concluding that, although virtual reality does not replace the real experience, it can enhance the understanding of artifacts and allows for a better understanding of their stories. In another study they compare the navigation of a virtual tour on the one hand with a mouse and on the other hand a navigation based on hand gestures with a user experience questionnaire. The study concludes that although the mouse is easier and faster to use, the gesture navigation gave better results for Interest/Enjoyment [18]. In other studies they compare the user experience of different virtual environments made on the one hand with 360 photos and on the other hand 3D modeling [19].
The aim of this work is to know the user experience provided by this virtual tour when visualized by different technologies in order to determine the validity as an element of dissemination of this historical–artistic space and to make a comparison of user perception when using different visualization technologies. The main research hypothesis is that the use of virtual reality headsets significantly improves the immersion in the virtual tour compared to the visualization on mobile devices. As a secondary hypothesis, we consider that the virtual tour is an effective tool for the dissemination and learning of cultural heritage, regardless of the technology used.
To carry out this research, a pilot test was conducted with students into the degree of restoration and conservation of cultural property. The participants took a virtual tour of the Chapel of Dolores, first with a smartphone and then with a virtual reality headset (a Cardboard type), and then completed a user experience questionnaire. Specifically, the students were given the “Questionnaire on User Experience in Immersive Virtual Environments (QUXiVE)”, which follows the ISO 9241-210 standard [20] and is composed of nine subscales: presence, engagement, immersion, flow, usability, emotion, skill, judgment, experience consequence and technology adoption. An assessment of the virtual tour as a tool for learning is also conducted. This paper details the results obtained by comparing both visualization technologies, highlighting the fact that when using virtual reality headset, results obtained in the immersion subscale are similar to those with the smartphone, but worse results are obtained in usability and consequences such as nausea and vertigo.

2. Background

A virtual tour is a recreation of an entirely virtual environment in which you can move freely and interact using a digital device. Virtual tours can be a copy of a reality or a fictitious space and even a mixture of both [21], where the user can walk through or examine the place. To create these tours there are a variety of programs and applications, on the one hand advanced, expensive technologies that require specialized knowledge for their use, and on the other hand simple and free technologies available to anyone [22].
One type of technology that makes it possible to create a virtual tour is 3D modeling using CAD (Computer Aided Design) tools [23]. With these programs it is possible to model, texture, illuminate and animate any scene or element. They are commonly used in video games and other entertainment media; however, they require a large investment of time. In these cases, the environments can be faithful copies of reality or invented scenarios, as well as mixed. In order to turn these 3D models into virtual tours, video game engines such as Unity or Unreal Engine, among others, are usually used. A first-person controller (FPC), i.e., an element that moves through the space, is usually incorporated to traverse these environments, thus allowing the entire environment to be visited [24]. In addition, video game engines allow for the addition of all kinds of interactivity; however, it takes time to achieve realistic scenarios.
In order to create virtual tours that are an exact copy of reality, technologies other than 3D modeling can be used. For example, two suitable technologies for this process would be photogrammetry and 3D scanning of the environment [25]. Photogrammetry uses multiple photographic images taken from different angles to perform a three-dimensional reconstruction of the space. Three-dimensional scanners, on the other hand, allow for obtaining point clouds (x, y, z) of the existing space. Both techniques can be combined to optimize the workflow and improve the appearance of the 3D models. The use of 3D scanners and/or photogrammetry in complex environments such as the Chapel of Dolores requires knowledge of advanced software to be able to process, visualize or edit the tours. Despite this, these technologies are frequently used in the industry [26]. These tours are usually exact copies of reality and in some cases they are referred to as digital twin, since this represents with maximum possible detail the real environment in a virtual model [27].
However, there is another technology for virtual tours, based on 360 photos, which also captures the environment in a completely realistic way, but it is much simpler and faster to create, manipulate and visualize. To perform this type of tour, it is necessary to use a 360 camera. Such cameras record or take spherical 360-degree photographs. Although there are cameras aimed at professional sectors that require a very high resolution, there are also models aimed at the general public that are small, easy to handle and affordable. To create the virtual tour from the 360 photos, it is necessary to use specific software such as Matterport, Cloudpano, 3DVista, etc., which allows for the linking of each of the photos, to be able to move through the tour [22]. Virtual tours made with 360 cameras do not allow a completely free movement of the user as happens with other technologies. In this case, the movement is performed as teleportation between one scene and the next. Normally, these type of virtual tours are also conceived as digital twins, since they are faithful to reality.
Once the virtual tour has been created, the form and technology to be used for its visualization must be taken into account. The types of visualizations of a virtual tour are classified into three levels of immersion (low immersion, semi-immersive and high immersion). Virtual tours on screens and controlled by a mouse or touch screen are considered as low immersion [28]. Virtual reality booths (CAVEs) with projections on the floor and walls are considered semi-immersive, and finally, virtual reality headsets are considered fully immersive [29,30]. On the other hand, virtual tours can be generated as an installable application on devices (computers, phones, virtual reality headsets, etc.) or as a web link that allows for the viewing the tour from the browser of our device.
In general, tours created with CAD programs and video game engines usually require a high level of processing, so they can only be viewed on a computer or video game console. Likewise, point clouds or elements created with scanners require a device with high processing capacity to be displayed. Virtual tours made with 360 photographs usually require little processing and therefore are habitually accessible [22].
Due to the ease of creation and visualization of virtual tours created with 360 cameras, they are used in many areas, ss for example to disseminate tourist attractions such as Puerto Bajaña in the Buena Fe canton [31]. In another case, the Teotihuacán Valley is shown in its antiquity and today in order to offer new experiences for tourists, as well as to raise awareness about the value of and care for the conservation of heritage [32]. Another use is the design and implementation of virtual tours for university campuses, so that the navigation limitations of the map application can be replaced by the application of virtual tours [33]. Likewise, in the real estate market, 360 virtual tours have become the most relevant marketing strategy to sell the property [34]. The 360 virtual tours are implemented in hotels as a digital differentiation tool in the local hotel industry. These tours would allow customers to explore the facilities remotely, improving visibility and user experience, increasing bookings, customer satisfaction and long-term profitability [35]. In addition, virtual tours are used for marketing purposes, achieving user engagement through a multisensory virtual tour of the actual production site [36]. In other research, virtual tours are developed for places associated with famous personalities (e.g., the birthplace of an artist), presenting current photos of the place together with historical recreations using computer media, allowing visitors to travel back in time during the virtual tour [37]. A project was also carried out to raise students’ awareness of environmental culture, through an interactive tour with 360 technology through ecosystems such as moorlands and Andean forests [38]. Another study investigates how the use of 360-degree virtual tours of mountains can motivate audiences to take real hikes in the mountains [39].
As mentioned above, virtual reality, in order to be effective as a communication element in the dissemination of heritage, must be accepted by the user. In other fields (architecture, engineering, landscaping, etc.) the measurement of user experience in virtual environments is very common [40,41,42]. This implies that the user experience of virtual content created for cultural heritage should be studied [43]. For example, Škola et al. [44] measure presence, engagement, and immersion in virtual reality with 360-video for cultural heritage. Verhulst et al. compare different types of virtual and augmented reality technologies around cultural heritage, with a result of high enjoyment for all devices, and similar cognitive and emotional engagement levels, although with the presence higher in one of the devices [45]. Other studies compare a large number of virtual heritage resources, visible on screen, and review different ways to evaluate the performance of such applications with surveys of workload, usability, flow, and potential VR symptoms. They conclude that there is a need to access materials in easily accessible formats and with great detail. Low-resolution textures and rough 3D models can deteriorate immersion, user experience and overall application quality [46]. In other cases, they study accessibility enhancement and intangible heritage preservation, and also compare desktop media and virtual reality. The conclusions show that the virtual reality experience did not affect the effort expectancy for the desktop application, but the same experience significantly influenced the performance expectancy construct [47].
One of the uses of virtual tours created with 360 photos is the dissemination and enhancement of the historical and cultural heritage of cities. Many local entities, which have a limited budget, choose virtual tours based on 360 photos for their dissemination tasks. For example, the tourist office of Alicante has tours of some of its monuments and historic buildings, such as the castle of Santa Barbara [48] or the Cathedral of Santiago de Compostela [49]. Other cultural institutions, such as museums or exhibition halls also use this type of virtual tour to disseminate their exhibitions [50]. It is interesting to note that in the field of heritage, chapels or hermitages in small towns do not usually use this type of technology.

3. Materials and Methods

In this work, we have made a virtual tour based on 360 photos of the Chapel of Dolores in Icod de los Vinos in Tenerife. It is a chapel in a small town, which does not have many resources for the dissemination of its heritage. A 360 camera was used, specifically the Insta 360 X3 model of Arashi Vision Inc. located in Shenzhen, China (cost approximately EUR 500). Subsequently, a pilot test was carried out with students studying the degree of conservation and restoration of cultural heritage, to measure the user experience of the virtual tour. An evaluation of the virtual tour as a learning tool was also carried out.
A total of 27 spheric photographs were taken with the Insta 360 X3 camera. Both the exterior, i.e., the entrance door, and the visitable interior were photographed, as well as parts that are not normally visited due to their poor condition (Figure 2a). Due to the great height of the central nave and the altarpiece, photos were taken at a height of 5 m, allowing a close-up view of the details of the ceiling and the altarpiece. An extendable monopod was used for the high-altitude photos to avoid the use of drones inside the chapel (Figure 2b). Since the altarpiece is accessible on foot, we entered into the interior to capture 360 images that are very difficult to access and that allow a much more complete visualization.
The photographs are then entered into the online program Cloudpano to generate the virtual tour (Figure 3). The main task is to organize the photographs and to create the link points between one scene and the next. These links then allow the user to move within the virtual tour. The virtual tour can be accessed at the following URL: https://capilladoloresvr.cultimerse.com (accessed on 3 April 2024).

3.1. Participants

The pilot test was carried out with 18 students of the fourth year course, Conservation and Restoration of Altarpieces, of the degree of conservation and restoration of cultural goods of the University of La Laguna (Tenerife, Spain). The participants were selected on the basis of their accessibility and willingness to participate, i.e., an ad hoc sampling.

3.2. Measurement Tool

The tool used to determine the user experience in a virtual environment is the Questionnaire on User Experience in Immersive Virtual Environments (QUXiVE) [51]. According to ISO 9241-210 [20], User Experience (UX) is defined as “User perceptions and responses resulting from the use of a system or service”. This questionnaire has been developed using a selection of components from different existing standardized tests to measure each of the ten subscales of the test. It is the only questionnaire that assesses 10 subscales of virtual environments: presence, engagement, immersion, fluency, usability, skill, emotion, experience consequence, judgment, and technology adoption of virtual tours distributed in 82 questions. The authors indicate that it should be adapted to each practical case. For this case, 27 questions have been selected from 9 of the 10 subscales of the original questionnaire. Each of the questions can be answered on a Likert scale from 1 to 10, where one is completely disagree and ten is completely agree.
In the QUXiVE (Questionnaire on User Experience in Immersive Virtual Environments) questionnaire used in this work, and the subscales are defined as follows.
  • Presence: the sense of being there, of the user in the virtual environment.
  • Engagement: the energy in action, the connection between a person and their activity in a behavioral, emotional and cognitive form.
  • Immersion: the illusion that the virtual environment technology replaces the user’s sensory stimuli by the virtual sensory stimuli.
  • Flow: defined as “a pleasant psychological state of sense of control, fun and joy”.
  • Skill: the knowledge the user gains in mastering his activity in the virtual environment.
  • Emotion: defined as the feelings (of joy, pleasure, satisfaction, frustration, disappointment, anxiety…) of the user in the VE.
  • Usability: the ease of learning (learnability and memorizing) and the ease of
  • Using (efficiency, effectiveness and satisfaction) the VE.
  • Judgement: defined as the overall judgement of the experience in the virtual environment.
  • Experience consequence: defined as the symptoms (e.g., the “simulator sickness”, stress, dizziness, headache…) the user can experience.
  • Technology adoption: defined as the actions and decisions taken by the user for a future use of, or intention to use, the VE.
Of the 82 total questions that make up the questionnaire, the following 27 have been selected as shown in Table 1:
An additional statement was used to assess the extent to which these types of virtual environments can serve as a learning tool. The statement is as follows: I believe that this type of VR environment serves to disseminate and learn practical content.

3.3. Pilot Test

The participants first visualized the virtual tour on their cell phone (Figure 4). An expert in conservation, restoration and architecture who has carried out numerous studies on the Chapel of Dolores guided them, simulating a real visit. The tour lasted approximately twenty minutes and they received an explanation of the chapel and its significant elements. Once the tour was over, the participants filled out the user experience questionnaire.
The second part of the pilot test consisted of performing the virtual tour again, using Woxter Neo Vr1 Cardboard virtual reality headsets (Figure 5a), which allow the visualization of stereoscopic images (Figure 5b). Navigation within this type of device works as follows: if you fix your gaze for a few seconds on a point in the image where there is a link to change scenes, it automatically advances to the next location. Therefore, these headsets do not need any external controller.
When using the headsets it is important to create a safety space around the user or to have a swivel chair, as it is necessary to move and turn the head 360 degrees to be able to perform the virtual tour (Figure 6). Finally, the participants filled out a new user experience questionnaire.

4. Results

The results obtained and the media and standard deviation for each of the questions on the questionnaire can be seen in Table 2.
In the additional question on learning, a score of 9.44 (1.10) was obtained for the route taken on the cell phone and 9.06 (1.63) for the route viewed in the virtual reality headsets.
The results obtained, grouped by the subscales of the questionnaire used, are listed in Table 3.

5. Conclusions

Once the research has been carried out, we can affirm that it is possible to create virtual tours with a high level of detail and a high level of user acceptance through low-cost technologies. This methodology would allow local entities, with a limited budget, to disseminate their heritage through the use of virtual tours, accessible from any device. The need to access materials in easily accessible formats and high detail is recommended by H. Cecotti [46]. The Cloudpano program has been selected to create virtual tours; it has been one of the best rated applications by Nieva García [22], who analyzes several programs to create virtual tours. Our development also confirms the study by Rahaman et al., which demonstrates visualizations of virtual tours without the requirement for expensive virtual reality headsets [52].
Regarding immersion, the results indicate that the main research hypothesis is not fulfilled, i.e., that the use of virtual reality headsets significantly improves immersion in the virtual tour compared to visualization on mobile devices. The results obtained in the corresponding subscale (immersion) are very similar (8.25/10 smartphone and 8.53/10 in VR headsets). Despite the fact that smartphone screens are considered low-immersion devices and VR headsets are considered high-immersion devices [28,30], similar results were obtained. Ideally, immersion also includes a simulation of the acoustic, haptic, smell, taste, and motion senses. However, immersion in user experience is defined as the illusion that the virtual environment technology replaces the user’s sensory stimuli by the virtual sensory stimuli. Therefore, in the virtual tours presented in this article made with 360 photos and without any other haptic device, there is only the visual sensation of immersion. Our conclusion is that in our case study without any haptic device and only visual immersion, it is not necessary to have virtual reality headsets for visualization.
On the other hand, the secondary hypothesis, that the virtual tour is an effective tool for the dissemination and learning of cultural heritage, regardless of the technology used, is considered valid. The participants rated the virtual tour very positively as a tool for learning and dissemination of heritage (9.44/10 for mobile devices and 9.06/10 for virtual reality glasses). No major differences are observed between the use of screens or headsets for learning objectives. Therefore, it may be an interesting strategy to have simple versions that work quickly on the smartphones of potential users.
Additionally, we can see that the virtual tour created with 360 photos generates a user experience in both viewing alternatives that is very positive. We can highlight the fact that on the subscale of presence, commitment and adoption of technologies, the valuation is higher than 9 out of 10. Therefore, we can conclude that the virtual tour will be very well accepted by potential users. On the other hand, fluency, emotion and judgment also obtain very positive values, but close to 8 out of 10. No notable differences are observed in these subscales in the comparison between cell phones and virtual reality headsets.
It should be noted that virtual tours can have negative consequences, such as dizziness or vertigo, described by other studies like [28,44]. In our study, it was found that when participants use virtual reality headsets, the consequence subscale increases significantly (4.02 out of 10 vs. 1.02 out of 10). Due to the use of stereoscopic images, it is difficult to improve the negative sensations of dizziness because the user floats above the scene. In other virtual reality headsets, environments such as cabins, visible paths, or the user’s hands and body parts can be visualized, thus mitigating some of the negative effects [53].
Interestingly, the usability of the two devices is significantly different. For the specific question about the comfort of the device used, the participants rated cell phones with 9.17/10 compared to 6.83/10 for virtual reality headsets. This indicates that virtual reality headsets would be necessary only for very specific cases. As a future study, we propose the analysis of scenarios where the use of virtual reality headsets is necessary, compared to other types of visualizations. In addition, we propose to extend this research with a larger and more diverse number of participants, in order to obtain more conclusive results.

Author Contributions

Conceptualization, C.M. and J.L.S.; methodology, C.M. and S.D.P.; software, J.L.S. and D.M.D.; validation, S.D.P., J.L.S. and C.M.; formal analysis, J.L.S.; investigation, C.M. and A.B.d.L.; resources, A.B.d.L.; data curation, J.L.S. and D.M.D.; writing—original draft preparation, C.M. and S.D.P.; writing—review and editing, J.L.S. and D.M.D.; visualization, A.B.d.L.; supervision, C.M.; project administration, C.M.; funding acquisition, C.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the project “Virtual tours for the dissemination of cultural heritage: analysis of the user experience and knowledge transfer” (reference: 2023/2310) framed in the convocatoria de proyectos dirigidos por noveles investigadores, acción para la iniciación de la actividad investigadora que se enmarca en el plan de incentivación de la actividad investigadora de la Universidad de la Laguna 2023. It is also part of the project “Digital resources for the dissemination of cultural heritage and for the production of educational materials, through virtual spaces and augmented reality” corresponding to the Convocatoria de los Proyectos de Innovación y Transferencia Educativa para el curso académico 2023–2024.

Data Availability Statement

The original data presented in the study are openly available at https://bit.ly/3UQCB6U (accessed on 8 May 2024).

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. BOC. Denominación del Bien de Interés Cultural a Favor del Exconvento de San Francisco; Cabildo de Tenerife: Santa Cruz de Tenerife, Spain, 2013. [Google Scholar]
  2. de la Peña, D.M. El Convento del Espíritu Santo de Icod; Ayuntamiento de Icod de los Vinos: Santa Cruz de Tenerife, Spain, 1998. [Google Scholar]
  3. Rodríguez, A.T. El Retablo Barroco en Canrias; Excmo. Cabildo Insular de Gran Canaria: Las Palmas de Gran Canaria, Spain, 1977. [Google Scholar]
  4. Díaz, S.; Tudela, M. Sistemas constructivo y estructural de los retablos en la isla de Tenerife a través de documentación digital del Patrimonio (HBIM). In Proceedings of the XV Congreso Internacional de Rehabilitación del Patrimonio Arquitectónico y Edificación, Granada, Spain, 8–10 September 2021. [Google Scholar]
  5. Díaz, S.; Sánchez, A.; de la Torre, J. An approach to HBIM methodology applied to the conservation of altarpieces: Two case studies in the Canary Islands. Conserv. Património 2023, 42, 81–97. [Google Scholar] [CrossRef]
  6. Peña, G.D.C.C.; González, R.B.A.; González, A.D. Conservación y Restauración de la Hornacina Central del Retablo Mayor de la Capilla de los Dolores, Icod de los Vinos; Universidad de La Laguna: San Cristóbal de La Laguna, Spain, 2021. [Google Scholar]
  7. Dede, C. Immersive interfaces for engagement and learning. Science 2009, 323, 66–69. [Google Scholar] [CrossRef] [PubMed]
  8. Mikropoulos, T.A.; Natsis, A. Educational virtual environments: A ten-year review of empirical research (1999–2009). Comput. Educ. 2011, 56, 769–780. [Google Scholar] [CrossRef]
  9. Ramírez-Acosta, K. User experience and user interface: Important parameters for an effective design. Tecnol. Marcha 2017, 30, 49–54. [Google Scholar] [CrossRef]
  10. Shikhri, R.; Lanir, J.; Poretski, L. Evaluation Framework for Improving 360 Virtual Tours User Experience. In Proceedings of the ACM WSDM WebTour, Jerusalem, Israel, 12 March 2021; Available online: https://ceur-ws.org/Vol-2855/main_short_4.pdf (accessed on 30 March 2024).
  11. Schrepp, M. All you need to know to apply the UEQ successfully in your project. In de User Experience Questionnaire Handbook; Usability.de: Berlin, Germany, 2015; pp. 50–52. [Google Scholar]
  12. Laugwitz, B.; Held, T.; Schrepp, M. Construction and Evaluation of a User Experience Questionnaire. In Proceedings of the HCI and Usability for Education and Work: 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, Graz, Austria, 20–21 November 2008. [Google Scholar] [CrossRef]
  13. Schrepp, M.; Hinderks, A.; Thomaschewski, J. Applying the User Experience Questionnaire (UEQ) in Different Evaluation Scenarios. In Proceedings of the Design, User Experience, and Usability. Theories, Methods, and Tools for Designing the User Experience: Third International Conference, DUXU, Crete, Greece, 22–27 June 2014; Available online: https://link.springer.com/chapter/10.1007/978-3-319-07668-3_37 (accessed on 25 February 2024).
  14. Schrepp, M.; Hinderks, A.; Thomaschewski, J. Design and Evaluation of a Short Version of the User Experience Questionnaire (UEQ-S). Int. J. Interact. Multimed. Artif. Intell. 2017, 4, 103–108. [Google Scholar] [CrossRef]
  15. Alenazi, M.; Demir, F. Understanding virtual reality tours: A user experience study with the princess Norah University. Int. J. Curr. Res. Life Sci. 2019, 8, 3248–3253. [Google Scholar]
  16. Shikhri, R.; Poretski, L.; Lanir, J. Analyzing Behavior and User Experience in Online Museum Virtual Tours. arXiv 2023, arXiv:2310.11176. [Google Scholar] [CrossRef]
  17. Li, W.; Huang, X. The Interactive Design and User Experience of Virtual Museums: Case Study of the Virtual Palace Museum. In Cross-Cultural Design, Proceedings of the Applications in Learning, Arts, Cultural Heritage, Creative Industries, and Virtual Reality, Virtual, 26 June–1 July 2022; Springer: Berlin/Heidelberg, Germany, 2022; Available online: https://link.springer.com/chapter/10.1007/978-3-031-06047-2_29 (accessed on 17 January 2024).
  18. Manghisi, V.M.; Uva, A.E.; Fiorentino, M.; Gattullo, M.; Bocaccio, A.; Monno, G. Enhancing user engagement through the user centric design of a mid-air gesture-based interface for the navigation of virtual-tours in cultural heritage expositions. J. Cult. Herit. 2018, 32, 186–197. [Google Scholar] [CrossRef]
  19. Carbonell-Carrera, C.; Saorín, J.L. Virtual tours using 360° Photos and 3D models. In Proceedings of the 15th International Conference on Education and New Learning Technologies, Palma, Mallorca, Spain, 3–5 July 2023. [Google Scholar] [CrossRef]
  20. UNE Normalización Española, UNE-EN ISO 9241-210, Madrid: Asociación Española de Normalización. 2019. Available online: https://www.en.une.org/encuentra-tu-norma/busca-tu-norma/norma?c=N0062677 (accessed on 9 May 2024).
  21. Riera, A.S.; Pàmies, C.; Navarro, I. Recorrido virtual mixto para la difusión del patrimonio descontextualizado: La sillería del coro de la Catedral de Oviedo. In Proceedings of the REHABEND 2022 Euro-American Congress on Construction Pathology, Rehabilitation Technology and Heritage Management, Santander, Gijon, Spain, 13–16 September 2022; Available online: http://hdl.handle.net/2117/385127 (accessed on 10 January 2024).
  22. García, O.N.; González, P.L.; Pimentel, J.A. Comparativa de características de software para la creación de recorridos virtuales 360 en Web. Rev. Investig. Tecnol. Inf. 2022, 9, 109–117. [Google Scholar] [CrossRef]
  23. Janovský, M.; Tobiáš, P.; Cehák, V.; Janovský, M.; Tobiáš, P.; Cehák, V. 3D Visualisation of the Historic Pre-Dam Vltava River Valley—Procedural and CAD Modelling, Online Publishing and Virtual Reality. ISPRS Int. J. Geo-Inf. 2022, 11, 376. [Google Scholar] [CrossRef]
  24. Meier, C.; Berriel, I.S.; Nava, F.P. Creation of a Virtual Museum for the Dissemination of 3D Models of Historical Clothing. Sustainability 2021, 13, 12581. [Google Scholar] [CrossRef]
  25. Rüther, H. 3D scanning the ‘New Jerusalem’ and other ancient monuments. Quest 2020, 14, 18–20. [Google Scholar]
  26. Romero-Guerrero, J.A.; Arenas-Islas, D.; Reta, C.; Bautista-Orduña, G.E.; Juárez-Sosa, I.; Suarez-Luna, J.M. Evaluación de formatos de exportación e importación de nubes de puntos para su uso en motores gráficos de realidad virtual. Pädi Boletín Científico Cienc. Básicas Ing. ICBI 2022, 11, 11–19. [Google Scholar] [CrossRef]
  27. Lucchi, E. Digital twins for the automation of the heritage construction sector. Autom. Constr. 2023, 156, 105073. [Google Scholar] [CrossRef]
  28. Martirosov, S.; Bureš, M.; Zítka, T. Cyber sickness in low-immersive, semi-immersive, and fully immersive virtual reality. Virtual Real. 2021, 26, 15–32. [Google Scholar] [CrossRef] [PubMed]
  29. Di Natale, F.; Repetto, C.; Riva, G.; Villani, D. Immersive virtual reality in K-12 and higher education: A 10-year systematic review of empirical research. Br. J. Educ. Technol. 2020, 51, 2006–2033. [Google Scholar] [CrossRef]
  30. Kaplan-Rakowski, R.; Gruber, A. Low-immersion versus high-immersion virtual reality: Definitions; classification, and examples with a foreign language focus. In Proceedings of the Innovation in Language Learning 2019, Florence, Italy, 14–15 November 2019. [Google Scholar]
  31. Briones, T.L.B. Elaboración de un Recorrido Virtual Interactivo 360° Grados del Atractivo Turístico Puerto Bajaña del Cantón Buena Fe Provincia de Los Ríos; Universidad Técnica Estatal de Quevedo: Quevedo, Ecuador, 2020; Available online: https://repositorio.uteq.edu.ec/items/16c27550-2adc-4799-8f19-7b2708f864e5/full (accessed on 8 May 2024).
  32. Almaraz, B.; Chico, L.S.; Martínez, E.C.D.; Rodríguez, A.Y.M.; Escobar, A.P.G. Estudio de factibilidad para el desarrollo de paseos virtuales. caso de aplicación: Valle de Teotihuacán. Pist. Educ. 2023, 44, 144. [Google Scholar]
  33. Suryanto, T.L.M.; Wibowo, N.C. Developing and Evaluating a Jejakatua Virtual Campus Tour Prototype Using Auto-stitching Technique. J. Phys. Conf. Ser. 2019, 1569, 022055. [Google Scholar] [CrossRef]
  34. Sulaiman, M.Z. Matterport: Virtual Tour as A New Marketing Approach in Real Estate Business During Pandemic COVID-19. In Proceedings of the International Conference of Innovation in Media and Visual Design (IMDES 2020), Tangerang, Indonesia, 10–11 November 2020. [Google Scholar] [CrossRef]
  35. Pánchez, F.V.; Fernández, P.V. Tour virtual 360° en el Hotel emperador de la ciudad de Ambato, como estrategia de diferenciación digital a nivel local. 593 Digit. Publ. CEIT 2023, 8, 499–511. [Google Scholar] [CrossRef]
  36. Peruzzini, M.; Cavallaro, S.; Grandi, F.; Martinelli, E.; De Canio, F. Exploring how to use virtual tours to create an interactive customer remote experience. J. Ind. Inf. Integr. 2023, 35, 100509. [Google Scholar] [CrossRef]
  37. Nemtinov, V.; Borisenko, A.; Nemtinova, Y.; Tryufilkin, S.; Morozov, V. Development of virtual tours of memorable places associated with the residency and activities of famous personalities. In Proceedings of the International Multidisciplinary Scientific GeoConference: SGEM, Albena, Bulgaria, 18–24 August 2020. [Google Scholar] [CrossRef]
  38. Vega, R.G.A. Recorrido inmersivo. In Experiencias de Innovación Educativa—Tomo 4; Institución Universitaria Politécnico Grancolombiano: Medellin, Colombia, 2020; Volume 1, pp. 169–187. [Google Scholar] [CrossRef]
  39. Wu, X.; Lai, I.K.W. The use of 360-degree virtual tours to promote mountain walking tourism: Stimulus–organism–response model. Inf. Technol. Tour. 2022, 24, 85–107. [Google Scholar] [CrossRef]
  40. Saorin, J.; Carbonell-Carrera, C.; Jaeger, A.; Díaz, D. Landscape Design Outdoor–Indoor VR Environments User Experience. Land 2023, 12, 376. [Google Scholar] [CrossRef]
  41. Carbonell-Carrera, C.; Saorin, J.; Díaz, D.M. User VR Experience and Motivation Study in an Immersive 3D Geovisualization Environment Using a Game Engine for Landscape Design Teaching. Land 2021, 10, 492. [Google Scholar] [CrossRef]
  42. Chang, Y.L.; Hou, H.T.; Pan, C.Y.; Sung, Y.T.; Chang, K.E. Apply an Augmented Reality in a Mobile Guidance to Increase Sense of Place for Heritage Places. J. Educ. Technol. Soc. 2015, 18, 166–178. [Google Scholar]
  43. Konstantakis, M.; Caridakis, G. Adding Culture to UX: UX Research Methodologies and Applications. J. Comput. Cult. Herit. 2020, 13, 1–17. [Google Scholar] [CrossRef]
  44. Škola, F.; Rizvić, S.; Cozza, M.; Barbieri, L.; Bruno, F.; Skarlatos, D.; Liarokapis, F. Virtual Reality with 360-Video Storytelling in Cultural Heritage: Study of Presence, Engagement, and Immersion. Sensors 2020, 20, 5851. [Google Scholar] [CrossRef]
  45. Verhulst, I.; Woods, A.; Whittaker, L.; Bennett, J.; Dalton, P. Do VR and AR versions of an immersive cultural experience engender different user experiences? Comput. Hum. Behav. 2021, 125, 106951. [Google Scholar] [CrossRef]
  46. Cecotti, H. Cultural Heritage in Fully Immersive Virtual Reality. Virtual Worlds 2022, 1, 82–102. [Google Scholar] [CrossRef]
  47. Selmanović, E.; Rizvic, S.; Harvey, C.; Boskovic, D.; Hulusic, V.; Chahin, M.; Sljivo, S. Improving Accessibility to Intangible Cultural Heritage Preservation Using Virtual Reality. J. Comput. Cult. Herit. 2020, 13, 13. [Google Scholar] [CrossRef]
  48. Alicanteturismo Alicante: Castillo de Santa Bárbara. Available online: https://alicanteturismo.com/castillo-de-santa-barbara/ (accessed on 20 March 2024).
  49. Fotopanorama. Fotopanorama. Available online: https://www.fotopanorama.com/tour-virtual-catedral-de-santiago/ (accessed on 20 March 2024).
  50. TEA. TEA Tenerife Espacio de las Artes. Available online: https://teatenerife.es/panorama-oscar-dominguez/ (accessed on 20 March 2024).
  51. Tcha-Tokey, K.; Christmann, O.; Loup-Escande, E.; Richir, S. Proposition and Validation of a Questionnaire to Measure the User Experience in Immersive Virtual Environments. Int. J. Virtual Real. Année 2016, 16, 33–48. Available online: https://hal.science/hal-01404497 (accessed on 8 May 2024).
  52. Rahaman, H.; Champion, E.; McMeekin, D. Outside Inn: Exploring the Heritage of a Historic Hotel through 360-Panoramas. Heritage 2023, 6, 4380–4410. [Google Scholar] [CrossRef]
  53. Luks, R.; Liarokapis, F. Investigating motion sickness techniques for immersive virtual environments. In Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments, Rhodes, Greece, 5–7 June 2019. [Google Scholar] [CrossRef]
Figure 1. Interior of a single nave. In the background, the main altarpiece that presides over the chapel.
Figure 1. Interior of a single nave. In the background, the main altarpiece that presides over the chapel.
Heritage 07 00118 g001
Figure 2. (a) Parts not passable due to their poor condition; (b) photo from 5 m above the ground.
Figure 2. (a) Parts not passable due to their poor condition; (b) photo from 5 m above the ground.
Heritage 07 00118 g002
Figure 3. Detail of the Cloudpano program used for the virtual tour.
Figure 3. Detail of the Cloudpano program used for the virtual tour.
Heritage 07 00118 g003
Figure 4. Visualization of the virtual tour on a smartphone.
Figure 4. Visualization of the virtual tour on a smartphone.
Heritage 07 00118 g004
Figure 5. (a) Visualization of the virtual tour on a smartphone using the Woxter Neo Vr1 virtual reality headset; (b) visualization in stereoscopic mode for viewing in virtual reality headsets.
Figure 5. (a) Visualization of the virtual tour on a smartphone using the Woxter Neo Vr1 virtual reality headset; (b) visualization in stereoscopic mode for viewing in virtual reality headsets.
Heritage 07 00118 g005
Figure 6. Students during the virtual tour session using virtual reality headsets.
Figure 6. Students during the virtual tour session using virtual reality headsets.
Heritage 07 00118 g006
Table 1. Questions of the user experience questionnaire.
Table 1. Questions of the user experience questionnaire.
SubscaleQuestion
Presence1I was able to actively survey the virtual environment using vision.
2My interactions with the virtual environment seemed natural.
3I could examine objects from multiple viewpoints.
4The devices (gamepad or keyboard) which controlled my movement in the virtual environment seemed natural.
Engagement5The visual aspects of the virtual environment involved me.
6The sense of moving around inside the virtual environment was compelling.
Immersion7I felt stimulated by the virtual environment.
8I become so involved in the virtual environment that I was not aware of things happening around me.
9I become so involved in the virtual environment that it was as if I was inside the game rather than manipulating a gamepad and watching a screen.
10I become so involved in the virtual environment that I lost all track of time.
Flow11At each step, I knew what to do.
12Time seemed to flow differently than usual.
13I felt I was experiencing an exciting moment.
Usability14I thought the interaction devices were easy to use.
15I found the interaction devices very cumbersome to use.
Emotion16I enjoyed being in this virtual environment
17I found my mind wandering while I was in the virtual environment.
18I enjoyed dealing with the interaction devices.
Judgement19Personally, I would say the virtual environment is practical.
20Personally, I would say the virtual environment is clear (not confusing).
21I found this virtual environment amateurish (1) professional (10).
22I found that this virtual environment is ugly (1) beautiful (10).
Experience Consequence23I suffered from fatigue during my interaction with the virtual environment.
24I suffered from dizziness with eyes open during my interaction with the virtual environment.
25I suffered from nausea during my interaction with the virtual environment.
Technology adoption26The interaction devices would make work more interesting.
27I would like to work with the interaction devices.
Table 2. Results obtained from the Questionnaire on User Experience in Immersive Virtual Environments (QUXiVE).
Table 2. Results obtained from the Questionnaire on User Experience in Immersive Virtual Environments (QUXiVE).
SubscaleStatement360 Smartphone (Des. Vest.)360 VR Cardboard (Des. Vest.)
Presence1I was able to actively survey the virtual environment using vision.9.98 (0.32)9.56 (0.78)
2My interactions with the virtual environment seemed natural.8.94 (0.87)8.89 (1.32)
3I could examine objects from multiple viewpoints.9.56 (0.7)9.50 (0.71)
4The devices (gamepad or keyboard) which controlled my movement in the virtual environment seemed natural.9.28 (0.83)9.06 (1.21)
Engagement5The visual aspects of the virtual environment involved me.9.67 (0.49)9.17 (1.10)
6The sense of moving around inside the virtual environment was
compelling.
9.56 (0.70)8.56 (1.50)
Immersion7I felt stimulated by the virtual environment.9.28 (0.75)8.72 (1.45)
8I become so involved in the virtual environment that I was not aware of things happening around me.7.89 (1.45)8.67 (1.46)
9I become so involved in the virtual environment that it was as if I was inside the game rather than manipulating a gamepad and watching a screen.8.39 (1.91)8.56 (1.72)
10I become so involved in the virtual environment that I lost all track of time.7.44 (1.79)8.17 (1.82)
Flow11At each step, I knew what to do.9.00 (1.41)8.78 (1.83)
12Time seemed to flow differently than usual.8.00 (1.68)7.78 (1.99)
13I felt I was experiencing an exciting moment.8.61 (1.50)8.72 (1.36)
Usability14I thought the interaction devices were easy to use.9.61 (0.70)8.83 (1.63)
15I found the interaction devices very cumbersome to use.9.17 (2.07)6.83 (3.31)
Emotion16I enjoyed being in this virtual environment9.00 (1.03)8.22 (3.37)
17I found my mind wandering while I was in the virtual environment.5.06 (2.69)6.56 (2.85)
18I enjoyed dealing with the interaction devices.9.22 (1.73)8.78 (2.18)
Judgement19Personally, I would say the virtual environment is practical.9.44 (0.86)8.94 (2.15)
20Personally, I would say the virtual environment is clear (not confusing).9.50 (0.79)8.83 (2.15)
21I found this virtual environment amateurish (1) professional (10).7.50 (3.19)7.67 (3.05)
22I found that this virtual environment is ugly (1) beautiful (10).7.33 (3.27)7.24 (3.44)
Experience Consequence23I suffered from fatigue during my interaction with the virtual environment.1.56 (1.69)4.56 (3.18)
24I suffered from dizziness with eyes open during my interaction with the virtual environment.1.17 (0.51)4.28 (3.37)
25I suffered from nausea during my interaction with the virtual environment.1.17 (0.51)3.22 (3.08)
Technology adoption26The interaction devices would make work more interesting.9.17 (1.20)9.33 (0.84)
27I would like to work with the interaction devices.9.17 (1.15)9.00 (1.71)
Table 3. Results grouped into subscales of the Questionnaire on User Experience in Immersive Virtual Environments (QUXiVE).
Table 3. Results grouped into subscales of the Questionnaire on User Experience in Immersive Virtual Environments (QUXiVE).
SubscaleFotos 360 (Smartphone)Fotos 360 (VR Headset)
Presence9.42 (0.68)9.25 (1.01)
Engagement9.61 (0.59)8.86 (1.30)
Immersion8.25 (1.48)8.53 (1.61)
Flow8.61 (1.50)8.72 (1.36)
Usability9.39 (1.38)7.83 (2.47)
Emotion7.76 (1.82)7.85 (2.47)
Judgement8.09 (2.44)7.95 (2.88)
Experience Consequence1.30 (9.91)4.02 (3.21)
Technology adoption9.17 (1.18)9.17 (1.28)
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Meier, C.; Saorín, J.L.; Díaz Parrilla, S.; Bonnet de León, A.; Melián Díaz, D. User Experience of Virtual Heritage Tours with 360° Photos: A Study of the Chapel of Dolores in Icod de los Vinos. Heritage 2024, 7, 2477-2490. https://doi.org/10.3390/heritage7050118

AMA Style

Meier C, Saorín JL, Díaz Parrilla S, Bonnet de León A, Melián Díaz D. User Experience of Virtual Heritage Tours with 360° Photos: A Study of the Chapel of Dolores in Icod de los Vinos. Heritage. 2024; 7(5):2477-2490. https://doi.org/10.3390/heritage7050118

Chicago/Turabian Style

Meier, Cecile, Jose Luis Saorín, Silvia Díaz Parrilla, Alejandro Bonnet de León, and Dámari Melián Díaz. 2024. "User Experience of Virtual Heritage Tours with 360° Photos: A Study of the Chapel of Dolores in Icod de los Vinos" Heritage 7, no. 5: 2477-2490. https://doi.org/10.3390/heritage7050118

APA Style

Meier, C., Saorín, J. L., Díaz Parrilla, S., Bonnet de León, A., & Melián Díaz, D. (2024). User Experience of Virtual Heritage Tours with 360° Photos: A Study of the Chapel of Dolores in Icod de los Vinos. Heritage, 7(5), 2477-2490. https://doi.org/10.3390/heritage7050118

Article Metrics

Back to TopTop