Reconstructive Archaeology: In Situ Visualisation of Previously Excavated Finds and Features through an Ongoing Mixed Reality Process
Abstract
:Featured Application
Abstract
1. Introduction
2. Materials and Methods
- A database software component that extracts the relevant information from the excavation database (DB) to standardise it and produce external data compatible with the platforms.
- A mesh-creator software component that automatically creates 3D models (meshes) by relying on the above-mentioned normalised data that reflects the positional characteristics of artefacts, landmarks, sediment samples and geological layers encountered during archaeological work.
- A locator software component that receives such virtual models and combines them with real-world features to position them while respecting the volumetric profile of the physical context.
- A visualiser software component that interactively shows the combined environment in real-time and provides display and analytical facilities to interact with it.
- The DB component in a DB management layer that uses the C# language enclosed in the Microsoft™ Visual Studio for Mac framework (v. 7.5 build 1254 integrated development environment (IDE));
- The mesh-creator component in a 3D modeller layer that utilises a script in the Python environment (v. 3.5.3 integrated script interpreter) in Blender (v. 2.82);
- Both the locator and visualiser components in a software development kit (SDK) layer that employs, on the one hand, Xcode (v. 11.4 11E146) and Swift (v. 4.2) for programming, and, on the other, an operating system (iOS 13) for its execution on the iPad.
2.1. DB Management Layer
- (a)
- Identification (ID). One univocal code unambiguously identifies each archaeological find. It serves as a primary key in the database and corresponds to the same ID, which determines the related 3D model in a tridimensional repository. Therefore, such an ID permits the association of database information with the 3D model’s repository data and vice versa.
- (b)
- Position (3D coordinate point(s)). A local tridimensional reference system (x, y and z) related to a specific spot-mark within Les Cottés describes the position of each point (3D coordinate).
- (c)
- The number of recorded point(s). The implementation also defines three types of archaeological finds based on the number of points measured on-site: punctual (one point), bipunctual (two points) and multipunctual (more than two points). In the front row, the punctual type corresponds to an artefact for which the overall dimensions are longer than a minimum size (e.g., 2 cm), and whose centroid represents the 3D coordinate. Likewise, the bipunctual type coincides with elongated objects (one axis is twice longer), whose edges are the coordinate points. In the end, the multipunctual type represents composite objects, which own several 3D points that can be linked to describe a volumetric shape.
- (d)
- Stratigraphic unit (US) of provenance. Archaeologists extract artefacts from stratigraphic units that arrange the sequence of sedimentary depositions into different ranges of chronology and are commonly associated with a distinct cultural tradition (e.g., archaeological industry).
- (e)
- Material. The production material(s) (e.g., flint, generic rock, bone) can also categorise the find.
2.2. 3D Modeller Layer
2.3. Software Development Kit (SDK) Layer
3. Results
- (i)
- It produced a spatial 3D database containing tridimensional models (DAE) that chronologically and stratigraphically describe the entire excavation by representing every single archaeologically unearthed element and associating such virtual evidence into groups utilising specific shapes and textures. It is worth mentioning that this standard 3D model repository can be employed by 3D graphic tools on a desktop environment.
- (ii)
- It built a mixed reality computational application that works with the previous 3D models to interactively position and visualise them in situ through a mobile device.
4. Discussion
4.1. Limitations
- (i)
- Memory. More than 35,000 artefacts and features were excavated and recorded during the Les Cottés excavation project [24]. Therefore, the current technological representation of such a vast quantity of elements would hinder the memory capacity of the mobile device. Consequently, it is noteworthy to emphasise that the script should reduce the number of faces and clean up some edges to render the 3D model of the artefact as simple as possible. Moreover, a further enhancement could be achieved by separating the 3D model’s data loading and the scene instancing. Finally, a progressive rendering approach should also improve the performance of the application.
- (ii)
- Precision on the positioning. A further aspect deals with the manual positioning of the 3D model clusters by utilising georeferenced graphical markers as anchors. It is important to mention that such a technique has to intrinsically operate a detection of the contour of the structure (plane) on which the virtual object needs to lie by using tracking methods supplied by ARKit v. 2.0. Nevertheless, the anchoring process faces several repositioning problems due to mainly two factors:
- A loss of precision in the sensor device (inertial measurement unit (IMU)).
- A deterioration of alignment accuracy due to a reduction of light detection.
Such anomalies render the position of the 3D cluster unstable and can create a flickering effect that may complicate the interactive examination by the archaeologist in situ.At this point, it is useful to highlight that by employing the manual placement, the in situ positional precision of the 3D cluster depends on both the visual accuracy of the operator and the number of anchors utilised. We estimate, from our mensuration, that it may vary up to several centimetres (±5 cm), even if an exhaustive statistical analysis of uncertainty and error measurements has not been accomplished due to the inaccessibility of the site at the time of this writing. Hence, such examinations remain outstanding and should still be completed.Instead, the employment of a nonelectronic marker-based positioning, namely graphical pattern signs, could bring the profiles into line with higher precision (estimated to ±1 cm). However, in this case, the excavation must provide different permanent markers as anchors on its contour.Finally, it is significant to remark that the desktop environment permits the photogrammetry skeleton and the entire 3D excavation cluster models to fit together with high precision for analytical and positional purposes (same scale and references). - (iii)
- Blurry visualisation. In particular scenarios, some 3D models show a blurry contour on the image. Such unclear result derives from the rendering methodology applied by ARKit v. 2.0 on the format of the model (DAE) since the same visualisation in Blender does not raise this problem.
- (iv)
- Extension of the site. Every archaeological site can implement the procedures applied for the Les Cottés cave. However, in the case of extensive excavations, the process should subdivide these broad areas into smaller spots, simulating a continuity among the different subsites and simultaneously dealing with each one by employing distinct anchoring references.
4.2. Future Research
- (i)
- Portability of the mixed reality application. Xcode can install the current mixed reality applications onto other Apple™ devices (i.e., iPhone, MacBook) without accomplishing any further technical action. Therefore, such implementational versatility could increase the number of users interested in this MR methodology. Furthermore, Blender provides the possibility to export 3D models that reside in memory into diverse formats, not only DAE, without any additional step. Such flexibility permits employing the same 3D models by other software development kits. Similarly, multiple operating systems (i.e., Windows™ and Android™) can carry out comparable versions of the current MR application simply by applying slight variations in the code. Hence, such technological portability enables users to operate other types of innovative appliances, allowing stereographic rendering (e.g., smart-glasses by Windows™, i.e., Hololens). Nevertheless, these devices can be very costly to a final user. From this perspective, our primary intention was to render the application accessible to a vast public by downloading it to everyday appliances like tablets (iPad) or smartphones (iPhone).
- (ii)
- Positioning. The excavation could integrate a network of electronic marker-based devices, namely beacon Bluetooth/Wi-Fi gadgets, to strengthen the accuracy in placing the 3D cluster on the profile. From this perspective, any archaeological site, regardless of its extension, could apply such aligning techniques, rendering the present study easily transferable to other types of contexts.
- (iii)
- Additional valuable information in the original database. It could be valuable to integrate the original excavation database with Supplementary Data such as photographs, analyses, graphics or even digital scans accomplished on the evidence. The MR application could smoothly retrieve such details, improving the information provided to the archaeologist after any given query.
- (iv)
- Creation of tridimensional distribution maps about a particular group of artefacts. Similarly, it might be useful to include information about significant features concerning each artefact in the excavation database. Such attributes can indicate if the archaeological find seems to be connected to other artefacts (refit) depending on whether it presents evidence of heating or retouch or shows indications of being recycled. With such physical characteristics, the entire process could create 3D distributional clusters by pinpointing the 3D models involved in those allocations. It is worth noting that previous research has, in the case of burnt evidence [30] or artefact refits [31], bidimensionally emphasised such representations. However, the 3D distributions improve the level of comprehension inside the context, providing a filtered panorama about what the archaeologist volumetrically requires to identify over the excavation’s lifetime.
- (v)
- Generation of tridimensional plaster representing stratigraphic levels. Three-dimensional (3D) meshes of stratigraphic levels (layers), in the manner of tridimensional plasters, are remarkably convenient to visualise the context in which each find is embedded [32]. For reconstructing an approximation of the stratigraphic levels at Les Cottés, we could utilise the geological-level limits (see Table 1 and Table 2) associated with the horizontal topographic boundaries to build parallelepipeds that represent the partial volume of every extracted stratigraphic level at a specific moment of the excavation process. The MR application could render such plasters visible on-demand.
5. Conclusions
Supplementary Materials
Author Contributions
Funding
Acknowledgments
Conflicts of Interest
References
- Wursthorn, S.; Coelho, A.H.; Staub, G. Applications for mixed reality. In Proceedings of the XXth ISPRS Congress International Society for Photogrammetry and Remote Sensing, Istanbul, Turkey, 12–23 July 2004; pp. 12–23. [Google Scholar]
- Speicher, M.; Hall, B.; Nebeling, M. What is Mixed Reality? In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems (CHI’19), Glasgow, Scotland, UK, 4–9 May 2019; Paper 537, pp. 1–15. [Google Scholar] [CrossRef]
- Bekele, M.K.; Pierdicca, R.; Frontoni, E.; Malinverni, E.S.; Gain, J. A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage. J. Comput. Cult. Herit. 2018, 11, 1–36. [Google Scholar] [CrossRef]
- Bacca, J.; Baldiris, S.; Fabregat, R.; Graf, S. Augmented reality trends in education: A systematic review of research and applications. J. Educ. Technol. Soc. 2014, 17, 1–133. [Google Scholar]
- ChandiniPendit, U.; Zaibon, S.B.; Abubakar, J.A. Mobile Augmented Reality for Enjoyable Informal Learning in Cultural Heritage Site. Int. J. Comput. Appl. 2014, 92, 19–26. [Google Scholar] [CrossRef]
- Choi, H.-S. The Conjugation Method of Augmented Reality in Museum Exhibition. Int. J. Smart Home 2014, 8, 217–228. [Google Scholar] [CrossRef] [Green Version]
- Liestøl, G. Along the Appian Way. Storytelling and memory across time and space in mobile augmented reality. In Proceedings of the Euro- Mediterranean Conference, Limassol, Cyprus, 3–8 November 2014; Springer: Berlin/Heidelberg, Germany, 2014; pp. 248–257. [Google Scholar] [CrossRef]
- Hughes, C.; Smith, E.; Stapleton, C.; Hughes, D. Augmenting Museum Experiences with Mixed Reality; School of Computer Science University of Central Florida: Orlando, FL, USA, 2019; pp. 1–7. [Google Scholar]
- Lercari, N.; Shiferaw, E.; Forte, M.; Kopper, R. Immersive Visualization and Curation of Archaeological Heritage Data: Çatalhöyük and the Dig@IT App. J. Archaeol. Method Theory 2017, 25, 368–392. [Google Scholar] [CrossRef] [Green Version]
- Barbier, J.; Kenny, P.; Young, J.; Normand, J.; Keane, M. MAAP Annotate: When Archaeology meets Augmented Reality for Annotation of Megalithic Art. In Proceedings of the VSMM 2017—23rd International Conference on Virtual Systems and Multimedia, Dublin, Ireland, 31 October–4 November 2017; pp. 1–8. [Google Scholar] [CrossRef] [Green Version]
- Sato, Y.; Fukuda, T.; Yabuki, N.; Michikawa, T.; Motamedi, A. A Marker-less Augmented Reality system using im-age processing techniques for architecture and urban environment. In Proceedings of the Conference: The 21st In-ternational Conference on Computer-Aided Architectural Design Research in Asia (CAADRIA 2016), Melbourne, Australia, 30 March–2 April 2016; pp. 713–722. [Google Scholar]
- Wiley, B.; Schulze, J. archAR: An archaeological augmented reality experience. In SPIE/IS&T Electronic imAging; International Society for Optics and Photonics: San Francisco, CA, USA, 2015; p. 939203. [Google Scholar] [CrossRef]
- Unger, J.; Kvetina, P. An On-Site Presentation of Invisible Prehistoric Landscapes. Internet Archaeol. 2017, 43, 1–12. [Google Scholar] [CrossRef]
- Gleue, T.; Dähne, P. Design and implementation of a mobile device for outdoor augmented reality in the archeoguide project. Proceedings of Virtual Reality, Archeology, and Cultural Heritage (VAST) Conference, Glyfada, Greece, 28–30 November 2001; pp. 161–168. [Google Scholar] [CrossRef]
- Vlahakis, V.; Ioannidis, M.; Karigiannis, J.; Tsotros, M.; Gounaris, M.; Stricker, D.; Gleue, T.; Daehne, P.; Almeida, L. Archeoguide: An augmented reality guide for archaeological sites. IEEE Eng. Med. Boil. Mag. 2002, 22, 52–60. [Google Scholar] [CrossRef]
- Benko, H.; Ishak, E.; Feiner, S. Collaborative Visualization of an Archaeological Excavation. In Proceedings of the NSF Lake Tahoe Workshop on Collaborative Virtual Reality and Visualization (CVRV 2003), Lake Tahoe, CA, USA, 26–28 October 2003; pp. 1–7. [Google Scholar]
- Etxeberria, A.I.; Asensio, M.; Vicent, N.; Cuenca, J.M. Mobile devices: A tool for tourism and learning at archaeological sites. Int. J. Web Based Communities 2012, 8, 57–72. [Google Scholar] [CrossRef]
- Deliyiannis, I.; Papaioannou, G. Augmented reality for archaeological environments on mobile devices: A novel open framework. Mediterr. Archaeol. Archaeom. 2014, 14, 1–10. [Google Scholar]
- Pierdicca, R.; Frontoni, E.; Zingaretti, P.; Malinverni, E.S.; Colosi, F.; Orazi, R. Making Visible the Invisible. Augmented Reality Visualization for 3D Reconstructions of Archaeological Sites. Algorithmic Decision Theory 2015, 9254, 25–37. [Google Scholar] [CrossRef]
- Quattrini, R.; Pierdicca, R.; Frontoni, E.; Barcaglioni, R. VIRTUAL RECONSTRUCTION OF LOST ARCHITECTURES: FROM THE TLS SURVEY TO AR VISUALIZATION. ISPRS-Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci 2016, 383–390. [Google Scholar] [CrossRef]
- Wolfenstetter, T. Applications of Augmented Reality technology for archaeological purposes. In Proceedings of the 2012 20th Telecommunications Forum (TELFOR), Belgrade, Serbia, 20–22 November 2012; pp. 1–21. [Google Scholar] [CrossRef]
- Stone, R.; Ojika, T. Virtual heritage: What next? Multimed. IEEE 2000, 7, 73–74. [Google Scholar] [CrossRef]
- Billinghurst, M.; Hirokazu, K. Collaborative Mixed Reality. In Proceedings of the First International Symposium on Mixed Reality (ISMR ’99). Mixed Reality. Communications of the ACM, Yokohama, Japan, 9–11 March 1999; Volume 45, pp. 261–284. [Google Scholar]
- Soressi, M.; Roussel, M.; Rendu, W.; Liard, M.; Renou, S. Les Cottés Saint-Pierre-de-Maillé (Vienne). Rapport de fouille programmée 2018 Triennale III année 3/3. Serv. Régional de l’Archéologie de Poitou-Charentes 2018, 3, 1–146. [Google Scholar]
- Hockett, P.; Ingleby, T. Augmented Reality with Hololens: Experiential Architectures Embedded. In the Real World. arXiv 2016, arXiv:1610.04281. [Google Scholar]
- Jacobs, Z.; Li, B.; Jankowski, N.R.; Soressi, M.A. Testing of a single grain OSL chronology across the Middle to Upper Palaeolithic transition at Les Cottés (France). J. Archaeol. Sci. 2015, 54, 110–122. [Google Scholar] [CrossRef] [Green Version]
- Available online: https://skfb.ly/KPNI (accessed on 30 September 2020).
- Amin, D.; Govilkar, S. Comparative Study of Augmented Reality Sdk’s. Int. J. Comput. Sci. Appl. 2015, 5, 11–26. [Google Scholar] [CrossRef]
- Available online: http://www.ecma-international.org/publications/standards/Ecma-363.htm (accessed on 30 September 2020).
- Aranguren, B.; Revedin, A.; Amico, N.; Cavulli, F.; Giachi, G.; Grimaldi, S.; Macchioni, N.; Santaniello, F. Wooden tools and fire technology in the early Neanderthal site of Poggetti Vecchi (Italy). Proc. Natl. Acad. Sci. USA 2018, 115, 2054–2059. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Aubry, T.; Dimuccio, L.; Almeida, M.; Buylaert, J.-P.; Fontana, L.; Higham, T.; Liard, M.; Murray, A.; Neves, M.; Peyrouse, J.-B. Stratigraphic and technological evidence from the Middle Palaeolithic- Châtelperronian-Aurignacian record at the Bordes-Fitte rockshelter (Roches d’Abilly site, Central France). J. Hum. Evol. 2011, 62, 1–22. [Google Scholar] [CrossRef] [PubMed]
- Galeazzi, F.; Callieri, M.; Dellepiane, M.; Charno, M.; Richards, J.D.; Scopigno, R. Web-based visualization for 3D data in archaeology: The ADS 3D viewer. J. Archaeol. Sci. Rep. 2016, 9, 1–11. [Google Scholar] [CrossRef] [Green Version]
Typology | 3D Shape |
---|---|
Punctual lithic (PL) | Cube (1 point) |
Elongated lithic (EL) | Entire spherical pipe (2 points) |
Punctual rocks (PR) | Pyramid (1 point) |
Dimensional rocks (DR) | Six-point connected pipe |
Punctual bones (PB) | Sphere (1 point) |
Elongated bones (EB) | Half spherical pipe (2 points) |
Geological/dating sample (GS/DS) | Bell shape (1 point) |
Geological-level limits (GL) | Multiconnected pipe (several points) |
Stratigraphic Unit | Colour |
---|---|
US01 | Light green |
US02 | Yellow |
US03 | Orange |
US04 Upper | Red |
US04 Lower | Brown |
US05 | Violet |
US06 | Blue |
US07 | Cerulean |
US08 | Green |
Dating sample | Cyan |
Geological sample | Beige |
Geological-level limits | White |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Dilena, M.A.; Soressi, M. Reconstructive Archaeology: In Situ Visualisation of Previously Excavated Finds and Features through an Ongoing Mixed Reality Process. Appl. Sci. 2020, 10, 7803. https://doi.org/10.3390/app10217803
Dilena MA, Soressi M. Reconstructive Archaeology: In Situ Visualisation of Previously Excavated Finds and Features through an Ongoing Mixed Reality Process. Applied Sciences. 2020; 10(21):7803. https://doi.org/10.3390/app10217803
Chicago/Turabian StyleDilena, Miguel Angel, and Marie Soressi. 2020. "Reconstructive Archaeology: In Situ Visualisation of Previously Excavated Finds and Features through an Ongoing Mixed Reality Process" Applied Sciences 10, no. 21: 7803. https://doi.org/10.3390/app10217803
APA StyleDilena, M. A., & Soressi, M. (2020). Reconstructive Archaeology: In Situ Visualisation of Previously Excavated Finds and Features through an Ongoing Mixed Reality Process. Applied Sciences, 10(21), 7803. https://doi.org/10.3390/app10217803