Next Article in Journal
Monocular Vision-Based Underwater Object Detection
Next Article in Special Issue
A Stereo Dual-Channel Dynamic Programming Algorithm for UAV Image Stitching
Previous Article in Journal
Investigation of Exhaled Breath Samples from Patients with Alzheimer’s Disease Using Gas Chromatography-Mass Spectrometry and an Exhaled Breath Sensor System
Previous Article in Special Issue
Olive Actual “on Year” Yield Forecast Tool Based on the Tree Canopy Geometry Using UAS Imagery
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Accuracy Analysis of a Dam Model from Drone Surveys

DICA Department of Civil and Environmental Engineering, University of Perugia, 06125 Perugia, Italy
*
Author to whom correspondence should be addressed.
Sensors 2017, 17(8), 1777; https://doi.org/10.3390/s17081777
Submission received: 1 June 2017 / Revised: 27 July 2017 / Accepted: 31 July 2017 / Published: 3 August 2017
(This article belongs to the Special Issue UAV or Drones for Remote Sensing Applications)

Abstract

:
This paper investigates the accuracy of models obtained by drone surveys. To this end, this work analyzes how the placement of ground control points (GCPs) used to georeference the dense point cloud of a dam affects the resulting three-dimensional (3D) model. Images of a double arch masonry dam upstream face are acquired from drone survey and used to build the 3D model of the dam for vulnerability analysis purposes. However, there still remained the issue of understanding the real impact of a correct GCPs location choice to properly georeference the images and thus, the model. To this end, a high number of GCPs configurations were investigated, building a series of dense point clouds. The accuracy of these resulting dense clouds was estimated comparing the coordinates of check points extracted from the model and their true coordinates measured via traditional topography. The paper aims at providing information about the optimal choice of GCPs placement not only for dams but also for all surveys of high-rise structures. The knowledge a priori of the effect of the GCPs number and location on the model accuracy can increase survey reliability and accuracy and speed up the survey set-up operations.

1. Introduction

In recent years, dam safety has acquired increasing attention because of the high number of accidents and failures that have occurred. For instance, in the United States from 2005 to 2013 the State Dam Safety Program reported 173 dam failures and 587 occurrences that, without intervention, would likely have resulted in dam failure [1]. The typical causes of failures are foundation deterioration, including uneven settlement and earthquakes [2]; overtopping as a result of inadequate spillway crests [3], debris blockage of spillways and settlement of the dam crest [4]; piping, including high pore pressure and embankment slips [5] and others, such as improper construction, defective materials and also acts of warfare [6]. The need for sharing experiences related to this issue led to the establishment of the International Commission on Large Dams (ICOLD) whose mission is the dissemination of information to increase designers’ and managers’ awareness of the events which can lead to a disaster [7,8].
In this framework, monitoring operations and vulnerability assessment of dams plays a crucial role in preventing catastrophes and thus safeguarding human lives. Because of the large dimensions and the low accessibility of dams, a unique opportunity for monitoring is offered by Unmanned Aerial Vehicle (UAV) systems. Indeed, UAVs are extremely advantageous for visual investigation of large-scale structures such as dams and retention walls [9]. The use of UAVs has acquired a key role because of their fast and low cost operations and of the possibility of reaching places that are otherwise difficult or impossible to access directly [10,11,12]. UAV surveys find applications in several fields, for instance UAVs are used for vegetation monitoring [13], precision agriculture enhancement [14], and information acquisition concerning damages caused by natural disasters such as earthquakes [15,16]. In hydrology, drones are used to measure open channel surface velocities [17,18].
As structures are subject to deterioration due to increasing loads, weather conditions and ageing processes, drones offer a unique opportunity. As a matter of fact, conventional inspections are based on visual investigations which are time consuming, require technical experts and are therefore expensive. In this framework, drones provide an important contribution to strategies for monitoring of structures. For instance, Hallermann et al. [19] presented a methodology for inspecting ageing structures combining conventional inspection measurements with modern photogrammetric computer vision methods for geo-referenced structures, 3D-modeling and automatic post-flight damage detection. Achille et al. [20] made use of drones to survey vertical structures after an earthquake occurred in Mantua (IT). Grenzdörffer et al. [21] coupled terrestrial laser scanner (TLS) measurements with drone photogrammetry to detail a cultural monument in Germany. Hallermann and Morgenthal [22] and Hallermann et al. [23] used a drone to inspect bridges and viaducts.
In this framework, the use of the UAV technique for inspection and geometry recreation of dams is highly appropriate [24] and it can substantially improve monitoring and survey operations. Data acquired during the survey can be reliably considered as the basis for the construction of a 3D model for vulnerability studies. Indeed, a dam is a multi-hazard vulnerable structure that can be severely affected by earthquakes, flooding and terrain stability-related issues. The 3D model of the dam can be utilized to build a finite element (FE) model and perform static and dynamic analyses of the structure. Moreover, many authors have dealt with the simulation of dam breaks in a 3D hydraulic framework to better represent the vertical acceleration influencing the flow [25,26,27,28,29,30]. Thus, the availability of a 3D model of the dam is of great interest for providing a proper representation of the breaking event. Among the other applications of a 3D dam model, we can also list the 3D model of spillways to investigate the dynamics of the flow that spills over [31,32].
The 3D model of an object is built up from the images acquired during the UAV survey. Indeed, thanks to the Structure from Motion (SfM) technique, it is possible to build a dense point cloud (i.e., a 3D model) of an object from the 2D images acquired during a drone survey [33].
The SfM technique revolutionized three-dimensional topographic surveys in many fields, such as physical geography, by opening data collection and processing to a wider public [34]. Indeed, the SfM is a cheap technique that does not need specialized supervision. These two characteristics played the main role in the dissemination of SfM as highlighted by Micheletti et al. [35] who illustrated the potential of SfM applications in geomorphological research. Micheletti et al. [36] investigated the potential of freely available SfM tools to process high-resolution topographic and terrain data acquired through a smartphone. Among the other applications, SfM is used to investigate wave run-up [37], to determine soil erosion [38,39], to map landslides and to assess glacier movement [40,41]. Many authors have coupled the SfM technique with drones for surveying and modeling structures. Indeed, thanks to drones it is possible to acquire images of entire buildings including the roof and other parts inaccessible to the scanner [42]. For instance, Bolognesi et al. [43] detailed the “Delizia del Verginese” Castle in central Italy; Koutsoudis et al. [44] reconstructed an Ottoman monument located in Greece, estimating the accuracy of the data produced by a multi-image 3D reconstruction technique in terms of surface deviation and distance measurement accuracy. Among the other benefits, 3D modeling of cultural heritage sites has led to scientific and cost-effective improvements in documenting and archiving operations [45]. Westoby et al. [46] applied the SfM technique to a breached moraine-dam; Hallermann et al. [19] obtained a high-resolution orthophoto of a dam located in Germany to inspect its surface and to identify damages. Reagan et al. [47] combined autonomous flight with 3D digital image correlation to inspect bridges.
To georeference the dense point cloud and thus obtain an in-scale model of a specific object, the coordinates of a specific number of points (i.e., ground control points; GCPs) deployed on the object are used. The coordinates of GCPs are estimated by traditional survey techniques acquiring the coordinates of objects named markers. Markers are usually square shaped objects deployed on the dam surface before the survey. Subsequently, to determine the accuracy of the 3D model, it is necessary to compare the coordinates of check points (i.e., CPs) lying on the dense point cloud with their actual coordinates, acquired by traditional topographic methods. Therefore, the accuracy of the 3D model is strongly influenced by the location and number of GCPs used to georeference the model itself.
In literature, some authors have dealt with the effects of several features on the dense point cloud accuracy, such as the flight altitude, the inclination of the camera’s optimal axis, the image network geometry, image matching performance, surface texture and lighting conditions, GCPs number, positioning and accuracy [48]. For instance, Bolognesi et al. [43] investigated the accuracy of the dense point cloud of a historic castle by varying the flight altitude, the camera optical axis inclination and the number and location of GCPs. Barry and Coakley [49] estimated the accuracy achievable using a UAV on a 2-hectar site varying the number of GCPs. Tahar [50] evaluated the effect of different number of GCPs on the photogrammetric survey on a hilly area in Malaysia, while Tahar et al. [51] assessed the effect of position and number of GCPs on DEM generation. Mesas-Carrascosa et al. [52,53] analyzed the effect of three flight altitudes, flight modes (stop and cruising modes) and ground control point settings on ortho-mosaicked images. According to literature guidelines, GCPs should be widely distributed across the target area [54] and at the edge or outside [55] to enclose the area of interest [56,57,58,59]. According to Harwin and Lucieer [60], GCPs distribution needs to be adapted to the surveyed object and to the distance of the UAV. GCPs should be placed between 1/5 and 1/10 of the distance from the UAV to the surveyed object. Work investigating the effect of marker configurations on the dense point cloud of a high-rise building and, more specifically, of a dam is still to be done.
The placement of control points, especially in giant structures such as dams, is a time and money-consuming task. Moreover, some dam portions can be reached during specific seasons only because of the variable hydrostatic level in the reservoir. In this framework, the knowledge a priori of the effect of GCPs location choice on the accuracy of the dense cloud is relevant information that could not only increase the 3D model reliability but also speed up the experimental set up and thus, the dam survey itself.
This work focuses on the specific issue of marker deployment, while the other features are kept constant. This allows us to investigate this issue in detail. Given that no study on the effects of GCPs deployment on a masonry dam yet exists, the original contribution of this paper is the investigation of the accuracy affecting the 3D model of a dam obtained by a drone survey exploring different GCPs layouts. Results obtained by this study can find application for the improvement of large building surveys.
As the connection between the dam and the terrain plays a key role in ensuring the stability of the dam itself, the survey needs to be as accurate as possible to correctly represent and monitor the interconnection between dam and terrain. Thus, a second original contribution is represented by the investigation of the GCPs location effect on the dam’s boundaries (i.e., the abutments). Moreover, the 3D model accuracy is highly affected by the presence of singularities, such as the spillways. Indeed, a proper location of GCPs needs to take into account the presence of openings in order to obtain an accurate dense point cloud.
This paper investigates the case study of the Ridracoli dam (IT); an arch dam located in central Italy constructed principally for drinkable water supply purposes. An accurate assessment of the vulnerability of this structure is of utmost importance to ensure the continuous availability of the water resource from its multipurpose retention basin [61]. It is a masonry arch-shaped dam with a height of 103.5 m and crowning length equal to 32 m. The dam widths at the foundations and at the crowning are equal to 30 m and 7 m, respectively. For this type of structure, the mean vertical error can be assumed acceptable if equal to or lower than the 0.1% of the dam height. In fact, this value is consistent with finite element analysis [62] and hydraulic modeling [63]. The analysis is performed on the upstream face of the dam generating a unique dense point cloud of this portion. The upstream face was chosen for three reasons: (1) markers have a higher concentration and are more uniformly spaced on the upstream face than on the rest of the structure; (2) it offers the possibility of better investigating the spillway openings and the interconnection terrain-structure; (3) it highlights the similarity between the upstream face and other high-rise buildings. In fact, this paper aims to provide useful guidelines on marker location that could be valid also for other high-rise constructions. It is worth underlining that the downstream face of the dam is inaccessible, therefore it was not possible to deploy markers on it.
The paper is organized as follows: first, the case study area is presented and details about the experimental set up are provided. Several configurations of markers are presented and the survey technique to estimate marker coordinates is presented. Then, the drone survey is reported. Secondly, we detail the dense point cloud construction by varying GCPs layout. The errors between CPs coordinates on the dam model and on the actual dam are estimated and analyzed for each layout. In the results and discussion section we summarize our findings, focusing on the effects of error on dam boundaries.

2. Case Study and Experimental Set-Up Description

The markers layout assessment is performed using the Ridracoli dam as a case study. The dam was named after the homonymous lake and it was built on the Bidente River in the province of Forlì –Cesena (central Italy), generating a basin of about 33 million m3 of water (Figure 1). The dam supplies water to 48 municipalities in provinces throughout central Italy and, since 1989, to the Republic of San Marino [64]. The Ridracoli dam has a double-curvature arch-gravity structure with a maximum height of 103.5 m and a crest length of 432 m at 561 m a.s.l. The structure is divided into 27 independent parts called ashlars that avoid cracks that can result from hydrostatic and thermal loads. Vertical contraction joints ensure the continuity of the structure. Eight free spillway gates, located in the centre of the dam crown, allow the overflow of the dam (Figure 2).
In the following sub-sections the drone survey and the topographical technique to acquire marker coordinates will be detailed. The materialization of targets to be used either as Ground Control Points (GCPs) for georeferencing or as independent Check Points (CPs) during tests is presented.

Experimental Set-Up

The aerial platform is a HighOne 4HSE Pro quadrotor (Italdrone, Ravenna, Italy) mounting a gimbal system and an Alpha 7R, 36.4 Mpix Full frame camera (Sony) oriented with its axis along the perpendicular (Figure 2). The gimbal compensates drone vibrations due to the wind and to the flight operations. The lens is a 35 mm f/9 and the Sony Alpha 7 camera has the AF—Autofocus—Lock feature that manages the framing dimensions in relation to the subject characteristics and also allows an auto-focus procedure. The camera focus, after being tested on a portion of the structure, was set to infinity during the survey. The dam, the ancillary structures and the surrounding land were inspected by drone. Around 200 images of the upstream face were shot. To georeference the frames, before the drone survey, a set of markers were deployed on the dam structure to be used as Ground Control Points. Each marker has a squared shape and is 0.40 m high (Figure 3).
In two different moments of the year, sixty regularly-spaced markers were placed on three rows on the upstream face (Figure 3). In August 2015, two rows of markers were applied on the crest railing and on the upstream surface at the hydrostatic level of the time (i.e., 543.28 m a.s.l.) using a boat. While in October 2015 a third row of markers was deployed at the new hydrostatic level (i.e., 533.65 m a.s.l.). The UAV survey of the upstream face was performed after this last marker deployment to ensure uniform shooting conditions of the frames [65]. The image size is 7360 × 4912 pixels with a resolution of 350 dpi. The images were shot at a distance of about 15 m from the dam; the Ground Sample Distance (GSD) equals 2.1 mm. The images are shot every 1.87 s and the images overlap by more than 70%. An example is provided in Figure 4.
The camera positions are represented in Figure 5; because of the great extent of the structure an enlargement of the two boundaries is provided.
We recall that this paper aims at evaluating the influence of both GCPs layout and number on the accuracy of a 3D dense point cloud of the structure. Moreover, we want to determine which is the effect of the GCPs location choice on the dense point cloud at the boundaries of the structures, i.e., at both the right and the left abutments. To this end, a high number of markers (i.e., 60) were placed on the dam upstream face. To analyze the effects of marker location, 25 different GCPs layouts were chosen. In each layout, markers are used either as GCPs to georeference the frames or as CPs to test the resulting model accuracy. The former are represented as black circles, the latter as empty circles (Table 1). Marker configurations are grouped according to the GPCs density on a 9 × 9 square marker formation. This representation is useful for analyzing the effects of GCPs location, the density being equal. For instance, to evaluate the effects of different marker configurations, the pattern being equal, the following three groups are investigated: b, g and j; a, d and r; f, n and y. To evaluate the effect of deploying GCPs along one row at different elevations, the layouts a, d, e, l, f, p, r and y are analyzed. For instance, in layouts a, d and r, GCPs are placed only on the dam crest (i.e., the first row) with consistently different spacing. In a similar way, in layouts f and y GCPs are placed on the upper and lower rows with variable density.
To evaluate how the GPCs location effects the dense point clouds at the boundaries, we chose configurations that are similar but with different GCPs numbers and positions at the abutments. This is the case of the two groups of configurations c and e and i and n. Each couple has the same GCPs density, however, only one of the two supplies markers at the dam boundaries. It is worth underlining that also configurations with a very low number of GCPs were chosen to investigate the widest range possible of GCPs configurations.
The coordinates of the markers were acquired through a traditional survey technique using a Total Station TS30 (Leica-Geosystems). To this end, a pre-existing geodetic network was used for monitoring purposes. The existing network consists of four vertices materialized by little pillars (i.e., BS, SS, DS and BD, Figure 6). Besides the existing network, a new one was setup with 7 vertices materialized by topographic nails fixed on the ground (Figure 6). The new network was connected to the first one through topographic triangulation measurements.
To improve the accuracy of the measured coordinates, a hyper-deterministic scheme was adopted and the acquired observations were treated rigorously, executing least-squares compensation of topographic measurements. The standard deviation of each point is lower than 1 cm along the three directions. The mean value of all standard deviations equals 1.0 cm, 1.0 cm and 0.8 cm along the three directions, respectively. Due to the low error values, the points are suitable for either georeferencing the images or for validating the model. For more details about the traditional topographic survey, the reader can refer to the work of Buffi et al. [65].

3. Image Error Analysis

The frames acquired by UAV are used to build a 3D dense point cloud model of the upstream face through the Structure from Motion (SfM) technique (Figure 7). The SfM technique allows the construction of a three-dimensional dense point cloud model of an object starting from the automatic collimation of frames [33]. At first, the procedure consists in performing a feature point detection and matching, using automatic algorithms. Then, incrementally, this procedure adds images, triangulates matching features and refines the scene using bundle adjustment, allowing for the construction of the 3D point cloud. The Agisoft Photoscan® (vers. 1.2.4) software was employed to build the 3D dense point cloud. To derive the dense point cloud, the procedure is presented in the study by Jaud et al. [66].
First, the frames are uploaded. On photographs, common tie points are found and matched. The external camera orientation parameters are detected for each image. The Brown’s distortion model is used to simulate the lens distortion, and camera calibration parameters are found. This model allows for correcting both radial and tangential distortion. The coordinates of the markers used as GCPs are associated to the corresponding marker centre. This procedure has the purpose of georeferencing the frames on which the markers are used to build the most accurate possible dense point cloud. Secondly, the dense point cloud is built using the camera positions and the images and the CPs coordinates are extracted from the dense point cloud. The camera model has been optimized after the photos aligning. The parameters of the camera model are shown in Table 2.
The model is built using the Photoscan setting values reported in Table 3. Concerning image coordinates accuracy, the tie point accuracy equals 1 pixel, marker accuracy equals 0.1 pixel. Agisoft Photoscan® (ver. 1.2.4) provides an average RMS error for tie points equal to 0.798 pixel and an RMS average projection error equal to 1.216 pixel (Table 3).
It is possible to assess the errors between the coordinates of the CPs on the dense point cloud and compare their actual coordinates measured by total station. The accuracy of the dense point cloud model depends on the number and configuration of the set of GCPs used to georeference the frames. The CPs coordinates extracted from the dense point cloud are hereafter referred to as ‘extracted coordinates’. The accuracy analysis is performed in accordance with geospatial positioning accuracy standards [67]. For each layout, the errors along the elevation (i.e., εz), the North and East directions (i.e., εY and εX respectively) are evaluated for each CP, comparing measured and extracted coordinate values:
ε z = Z o b s Z e s t i m a t e d
ε Y = Y o b s Y e s t i m a t e d
ε X = X o b s X e s t i m a t e d
Moreover, the error vector lying on the North-East plane (i.e., εXY) is evaluated for each CP:
ε X Y = ε X 2 + ε Y 2
To estimate the overall quality of each GCPs layout, the Mean Absolute Error (MAE) is evaluated as follows:
M A E j = 1 N i = 1 N | ε j , i |
where εj,i is the error along the j-th direction (i.e., North, East, elevation and on the North-East plane, therefore j = 1, …, 4) of the i-th check point measured by the topographic survey and M is the number of check points for each specific layout. The Mean Absolute Error measures the overall match between observed and simulated coordinate values. A perfect GCPs layout would result in an MAE equal to zero. This metric estimation does not provide any information about under- or over-estimation, but it determines all deviations from the observed values regardless of the sign.

4. Results and Discussion

To analyze the effect of GCPs layout on the dense point cloud accuracy, the errors between measured and extracted coordinates of CPs are estimated for each layout. As expected, both in the altitude direction and on the North-East plane the MAE value decreases when the number of GCPs increases (Figure 8).
However, it is possible to observe that configurations with the same number of GCPs can have a consistently different MAE value. For instance, this is the case of the configurations q, s and t. They are all characterized by 31 GCPs, but at the same time by a consistently different MAE in the altitude direction and on the North-East plane, as also shown in Table 4. It is interesting to note that they have the same number of GCPs but different density as their pattern is different. Configurations j, l and r consist of 21 GCPs, but are characterized by different error values in all directions. Layouts with a similar pattern (e.g., configurations f and y) can be characterized by different error values along the elevation. This is due to the fact that it is the combination of both GCPs density and pattern that defines the accuracy of the dense point cloud. Both density and layout are useful as they can consistently speed up the operations for the experimental setting.
The boxplots of errors in the three directions North, East and Elevation and on the North-East plane are reported in Figure 9. The boxplots visually represent the median, the second and third quartiles of errors for each GCPs combination. Moreover, the boxplots highlight the presence of outliers, which are those CPs with higher error value than any other CPs. Along the elevation, the marker layout with the smallest MAE is the z, followed by y as also shown in Table 4. The former layout is characterized by the highest number of GCPs (i.e., 51), and GCPs are deployed in a way that ensures the almost complete coverage of the dam upstream face. Indeed, in all rows except in the intermediate one, the GCPs are placed in every position.
It is worth underlining that the configuration y has the second lowest MAE value, even though the second row in not secured with any GCP. This is due to the fact that the first and the lowest rows are responsible for the accuracy of the model if not provided by markers as they are the most difficult to capture during the UAV survey, for two different reasons. Indeed, the last row is close to the lake level, therefore, the UAV cannot move close to the markers and cannot shoot images from every angle, while the low accuracy of the first row is due to the fact that the first row of markers is applied to the balustrade on the dam crest. The frames shot of the balustrade capture the empty spaces in between the balustrade sticks. It results in overexposed frames because of the automatic brightness adjustment of the camera shutter and are then characterized by a low quality. The RMS error of the images that constitute the dense point cloud close to the spillway and to the dam crowning is higher than the other images because it includes the sky and/or water. An example is provided by Figure 10. The images show the same part of the dam. From left to right, the greater the quantity of water in the images, the higher the RMS error of the image. In fact, the RMS errors are, respectively, 0.975, 1.011 and 1.368 pixel. To improve the accuracy of the georeferenced dense point cloud, it is important to deploy a high number of equally-spaced GCPs on the first row. Configurations with a low number of GCPs on the balustrade (i.e., the first row on the upstream face) have high error values.
The error values along the altitude prove the influence of GCPs pattern (Figure 11). If the GCPs are deployed on the crest, as in combinations d and r, the crest is characterized by the lowest error values, while the highest error values are concentrated on the lowest row, at the bottom of the upstream face. Markers on the lowest row are difficult to survey because of the proximity to the water. In this case, the MAE value is more conditioned by the GCPs pattern than by their number. A similar behavior can be observed in combinations l and p, where the GCPs are deployed either on the middle row or on the lowest row, respectively.
In both cases, the highest error values are concentrated on the first row as the balustrade effects the frames quality, as mentioned before. It is interesting to note that when the markers are placed on both the upper and lower rows, the errors decrease consistently, as for combinations s, j, t. The combination pattern and number of GCPs defines the accuracy of the resulting 3D model. As a matter of fact, configurations r, l and j are characterized by the same number of GCPs (i.e., 21), however, their different layouts result in very different error values. It is worth noting that the error along the elevation in percentage is very small when compared to the dam height. The minimum error value is 0.015% of the dam height (i.e., 103.5 m). Indeed, the error along the elevation of configuration z is 1.5 cm. Configurations z, y, i, v, f, n and j are all characterized by an MAEz (see Table 4) equal to 0.015 m, 0.021 m, 0.062 m, 0.062 m, 0.065 m, 0.065 m and 0.066 m, respectively, and thus lower than or equal to 0.067% of the dam height. Thus, these 3D models seem to be characterized by error values that are compatible with a Finite Element analysis. Indeed, for a FE analysis, an error of 0.1% of the dam height is acceptable, in this case equal to 0.1 m [62]. It is important to point out that the model of the spillways must be accurate. Indeed, an inaccurate representation of the spillway geometry can cause an inaccurate representation of the overflowing water. Taking into account an error on the evaluation of the overflow equal to the aforementioned 0.067% of the dam height, the consequent error on the peak discharge would be around 4.5% of the design peak. This error is compatible with the uncertainties in the flood peak estimation [63].
The MAE values on the North-East plane lead to the same conclusions (Figure 9, lower left panel). Indeed, the configuration z has the lowest value in this direction, as it does along the elevation. It is followed by the configuration t, in which the GCPs are placed on the three rows in every other position, ensuring a good coverage of all the upstream face.
It is interesting to highlight that the best performing configurations are in agreement with the recommendations of literature. Indeed, GCPs are widely distributed across the target area [54] and at the edge of the upstream face [55]. Results suggest that GCPs distribution needs to be adapted to the object surveyed and to the distance of the UAV from the observed object, as in Harwin and Lucieer [60]. In our work, we found that the “threshold distance” between the GCPs (distance beyond which results do not improve) is 13 m. This distance is greater than that recommended by Harwin and Lucieer [60]. A minimum spacing of 13 m has shown a good performance both for a drone survey and for a classic laser scanning survey, as confirmed by Buffi et al. [68].

The Dense Point Cloud Accuracy at the Dam Boundaries

The boundaries of the dam are among the most important parts of the dam since they define the connections between the structure and the surrounding terrain. However, because of the shape of both right and left abutments, dam boundaries are not easily accessible by drone survey (Figure 12a,b).
Thus, images shot of the boundaries are characterized by perspective distortion. Moreover, the presence of the stairways on the right side made it difficult to survey that portion of the dam. To increase the accuracy of the resulting dense point cloud it was necessary to place markers in the proximity of the rocks and under the stairways on the right side of the structure. The high number of frames and the presence of GCPs made it possible to increase the accuracy of the dense point cloud as is evident from the performance of configuration z. To deeply investigate the effects of the GCPs pattern at the boundaries, the two configuration couples c, e and i, n are analyzed. Configurations c and e both have the same GCPs density and the same pattern. However, GCPs are placed in the proximity of the boundaries only in configuration c. This results in high error values at the boundaries, as testified by the number of outliers along the north direction (Figure 9). Layout c leads to high error values at the left and right boundaries because of the absence of the GCPs (Figure 13). The error is higher at the right side where the presence of the stairways makes it difficult to capture the dam face. Layout e differs from c as markers are placed at both sides of the upstream face. However, both configurations are characterized by high error values on the dam crest. It is worth noting that the spillway gates are characterized by a high error value as the openings imply an uncertain dense point cloud when no markers are placed in the proximity. Similarly, configuration b is effected by the absence of GCPs in the proximity of the right abutment where the presence of a stairway and of rocks makes it difficult to capture the dam surface on the North-East plane (Figure 13). The effect on the boundaries is more evident comparing layout i with layouts n and b (Figure 13). GCPs are placed at both sides of the upstream face only in configuration i. This leads to a high error value at the boundaries for configuration n and b, while the error is lower for configuration i at the same location.
Moreover, it is worth noting that all configurations except b in Figure 13 present a systematic error in areas characterized by a low GCPs density. A more uniform distribution of the GCPs across the dam upstream face would substantially mitigate the systematic errors. This finding is in accordance with James et al. [69] who noticed this behavior while estimating the accuracy of DEMs georeferenced with different sets of GCPs.

5. Conclusions

This work explores the effects of ground control point position and number on the accuracy of a dam dense point cloud, obtained by a drone survey. As GCP deployment is a time and money-consuming task, especially on large structures, this paper aims to provide principles for supporting the GCP deployment on high-rise buildings in order to speed up operations on site.
As expected, the results show that the model performs better when the density of markers is high. However, it is the combination of both GCP pattern and GCP density that determines the gain in accuracy. Results highlight that the error values show a higher variability along the elevation than along any other direction because of the high-rise characteristics of the dam. Therefore, GCPs should be placed at different elevations to increase the accuracy of the resulting dense point cloud. Moreover, where the structure is characterized by discontinuities such as spillway gates, it is necessary to place GCPs in the proximity of the openings to gain in accuracy. In addition, the presence of a balustrade, water, sky and uniform texture increases the RMS error of the images. In order to increase the accuracy of the georeferenced model special attention should be paid to the marker placement, in particular near the spillways, balustrade and hydrostatic level.
This paper also draws attention to the dam boundaries, where the presence of rocks reduces the accessibility to the dam and reduces the image quality. Since modeling the connection between the structure and the surrounding terrain is a relevant issue, it is necessary to deploy GCPs in the proximity of the abutments, avoiding patterns without GCPs at the boundaries. Moreover, we noticed that it is important to shoot a high number of images from either side of a singularity. For instance, this is the case of the right abutment, which was captured by a high number of shots from left to right and by a small number from right to left. In this case, the accuracy can be substantially lower, especially if a small number of markers are placed at the boundary.
These findings can be extended to other high-rise structures. For instance, if the façade of a structure is characterized by openings, as in the case of the spillways, it is necessary to deploy GCPs in the direct proximity of these openings to increase the accuracy of the photogrammetric survey.
In accordance with literature guidelines, GCPs should be widely distributed across the target area and at the edge of the upstream face. To reduce the occurrence of systematic errors, GCPs should be better distributed across the dam upstream face. Future developments could include an analysis of any changes in the accuracy of the model obtained by varying the overlapping of the frames or removing poor quality images.

Acknowledgments

The main author is supported by the Cassa di Risparmio di Perugia Foundation which is gratefully acknowledged. Giulia Buffi’s participation in this work is supported by Romagna Acque Società delle Fonti S.p.A. This work was supported by the Italian Ministry of Education, University and Research under PRIN grant No. 20154EHYW9 “Combined numerical and experimental methodology for fluid structure interaction in free surface flows under impulsive loading”. The authors would like to express their gratitude to Romagna Acque Società delle Fonti S.p.A. CEO Eng. Andrea Gambi, to the chief engineers Eng. Giuseppe Montanari and Eng. Franco Farina, to the technical manager Fabrizio Cortezzi for the availability of the Ridracoli dam. The authors are also grateful to Eng. Barberini and Italdrone, who supported the acquisition of the drone images. Moreover, the authors acknowledge Eng. Silvia Grassi, who directed the acquisition of the topographic data. Three anonymous reviewers are acknowledged for their insightful comments and suggestions that consistently improved the work.

Author Contributions

Elena Ridolfi, Giulia Buffi, Sara Venturi and Piergiorgio Manciola conceived and designed the analysis; Elena Ridolfi, Giulia Buffi and Sara Venturi built the model and made the experiments with different configurations of markers; Elena Ridolfi, Giulia Buffi, Sara Venturi and Piergiorgio Manciola analyzed results; Elena Ridolfi, Giulia Buffi and Sara Venturi wrote the paper.”

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Association of State Dam Safety Officials. Available online: http://www.damsafety.org/news/?p=412f29c8-3fd8-4529-b5c9-8d47364c1f3e (accessed on 27 March 2016).
  2. Xu, F.; Yang, X.; Zhou, J. Dam-break flood risk assessment and mitigation measures for the Hongshiyan landslide-dammed lake triggered by the 2014 Ludian earthquake. Geomat. Nat. Hazards Risk 2016, 1–19. [Google Scholar] [CrossRef]
  3. Biscarini, C.; di Francesco, S.; Ridolfi, E.; Manciola, P. On the simulation of floods in a narrow bending valley: The malpasset dam break case study. Water 2016, 8, 545. [Google Scholar] [CrossRef]
  4. Kuo, J.; Yen, B.; Hsu, Y.; Lin, H. Risk Analysis for Dam Overtopping—Feitsui Reservoir as a Case Study. J. Hydraul. Eng. 2007, 133, 955–963. [Google Scholar] [CrossRef]
  5. Zhang, L.M.; Xu, Y.; Jia, J.S. Analysis of Earth Dam Failures: A Database Approach. Georisk Assess. Manag. Risk Eng. Syst. Geohazards 2009, 3, 184–189. [Google Scholar] [CrossRef]
  6. Costa, J.E. Floods from Dam Failures; United States Geological Survey: Denver, CO, USA, 1985; pp. 1–59. [Google Scholar]
  7. International Commission on Large Dams (ICOLD). Lessons from Dam Incidents; ICOLD: Paris, France, 1974. [Google Scholar]
  8. International Commission on Large Dams (ICOLD). Dam Failures Statistical Analysis, Bulletin 99; ICOLD: Paris, France, 1995. [Google Scholar]
  9. Hallermann, N.; Morgenthal, G.; Rodehorst, V. Vision-based deformation monitoring of large scale structures using Unmanned Aerial Systems. IABSE Symp. Rep. 2014, 102, 2852–2859. [Google Scholar] [CrossRef]
  10. Silvagni, M.; Tonoli, A.; Zenerino, E.; Chiaberge, M. Multipurpose UAV for search and rescue operations in mountain avalanche events. Geomat. Nat. Hazards Risk 2016, 1–16. [Google Scholar] [CrossRef]
  11. Trasviña-Moreno, C.; Blasco, R.; Marco, Á.; Casas, R.; Trasviña-Castro, A. Unmanned Aerial Vehicle Based Wireless Sensor Network for Marine-Coastal Environment Monitoring. Sensors 2017, 17, 460. [Google Scholar] [CrossRef] [PubMed]
  12. Rashed, S.; Soyturk, M. Analyzing the Effects of UAV Mobility Patterns on Data Collection in Wireless Sensor Networks. Sensors 2017, 17, 413. [Google Scholar] [CrossRef] [PubMed]
  13. Venturi, S.; di Francesco, S.; Materazzi, F.; Manciola, P. Unmanned aerial vehicles and Geographical Information System integrated analysis of vegetation in Trasimeno Lake, Italy. Lakes Reserv. Res. Manag. 2016, 21, 5–19. [Google Scholar] [CrossRef]
  14. Honkavaara, E.; Saari, H.; Kaivosoja, J.; Pölönen, I.; Hakala, T.; Litkey, P.; Mäkynen, J.; Pesonen, L. Processing and Assessment of Spectrometric, Stereoscopic Imagery Collected Using a Lightweight UAV Spectral Camera for Precision Agriculture. Remote Sens. 2013, 5, 5006–5039. [Google Scholar] [CrossRef] [Green Version]
  15. Cao, C.; Liu, D.; Singh, R.P.; Zheng, S.; Tian, R.; Tian, H. Integrated detection and analysis of earthquake disaster information using airborne data. Geomat. Nat. Hazards Risk 2016, 7, 1099–1128. [Google Scholar] [CrossRef]
  16. Dominici, D.; Alicandro, M.; Massimi, V. UAV photogrammetry in the post-earthquake scenario: Case studies in L’Aquila. Geomat. Nat. Hazards Risk 2016, 1–17. [Google Scholar] [CrossRef]
  17. Bolognesi, M.; Farina, G.; Alvisi, S.; Franchini, M.; Pellegrinelli, A.; Russo, P. Measurement of surface velocity in open channels using a lightweight remotely piloted aircraft system. Geomat. Nat. Hazards Risk 2016, 1–14. [Google Scholar] [CrossRef]
  18. Tauro, F.; Porfiri, M.; Grimaldi, S. Surface flow measurements from drones. J. Hydrol. 2016, 540, 240–245. [Google Scholar] [CrossRef]
  19. Hallermann, N.; Morgenthal, G.; Rodehorst, V. Unmanned Aerial Systems (UAS)—Case Studies of Vision Based Monitoring of Ageing Structures. In Proceedings of the International Symposium Non-Destructive Testing In Civil Engineering, Berlin, Germany, 15–17 September 2015. [Google Scholar]
  20. Achille, C.; Adami, A.; Chiarini, S.; Cremonesi, S.; Fassi, F.; Fregonese, L.; Taffurelli, L. UAV-based photogrammetry and integrated technologies for architectural applications—Methodological strategies for the after-quake survey of vertical structures in Mantua (Italy). Sensors 2015, 15, 15520–15539. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  21. Grenzdörffer, G.J.; Naumann, M.; Niemeyer, F.; Frank, A. Symbiosis of UAS photogrammetry and TLS for surveying and 3D modeling of cultural heritage monuments-a case study about the cathedral of St. Nicholas in the city of Greifswald. In Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences International Conference on Unmanned Aerial Vehicles in Geomatics, Toronto, ON, Canada, 30 August–2 September 2015; Volume 40, pp. 91–96. [Google Scholar]
  22. Hallermann, N.; Morgenthal, G. Visual inspection strategies for large bridges using Unmanned Aerial Vehicles (UAV). In Proceedings of the 7th International Conference on Bridge Maintenance, Safety, Management and Life Extension, Shanghai, China, 7–11 July 2014; pp. 661–667. [Google Scholar]
  23. Hallermann, N.; Morgenthal, G.; Rodehorst, V. Unmanned Aerial Systems (UAS)—Survey and Monitoring Based on High-Quality Airborne; International Association for Bridge and Structural Engineering: Geneva, Switzerland, 2015; pp. 1–8. [Google Scholar] [CrossRef]
  24. Federal Energy Regulatory Commission Division of Dam Safety and Inspections; Arch Dams: Washington, DC, USA, 1999.
  25. Zech, Y.; Soares-Frazão, S. Dam-break flow experiments and real-case data. A database from the European IMPACT research. J. Hydraul. Res. 2007, 45, 5–7. [Google Scholar] [CrossRef]
  26. Soares-Frazão, S. Experiments of dam-break wave over a triangular bottom sill. J. Hydraul. Res. 2007, 45, 19–26. [Google Scholar] [CrossRef]
  27. Biscarini, C.; di Francesco, S.; Manciola, P. CFD modeling approach for dam break flow studies. Hydrol. Earth Syst. Sci. 2010, 14, 705–718. [Google Scholar] [CrossRef]
  28. Di Francesco, S.; Biscarini, C.; Manciola, P. Numerical simulation of water free-surface flows through a front-tracking lattice Boltzmann approach. J. Hydroinform. 2015, 17, 1–6. [Google Scholar] [CrossRef]
  29. Di Francesco, S.; Falcucci, G.; Biscarini, C.; Manciola, P. LBM method for roughness effect in open channel flows. AIP Conf. Proc. 2012, 1947, 1777–1779. [Google Scholar] [CrossRef]
  30. Di Francesco, S.; Zarghami, A.; Biscarini, C.; Manciola, P. Wall roughness effect in the lattice Boltzmann method. AIP Conf. Proc. 2013, 1558, 1677–1680. [Google Scholar]
  31. Dargahi, B. Experimental Study and 3D Numerical Simulations for a Free-Overflow Spillway. J. Hydraul. Eng. 2006, 132, 899–907. [Google Scholar] [CrossRef]
  32. Tabbara, M.; Chatila, J.; Awwad, R. Computational simulation of flow over stepped spillways. Comput. Struct. 2005, 83, 2215–2224. [Google Scholar] [CrossRef]
  33. Ullman, S. The Interpretation of Structure from Motion. Proc. R. Soc. Lond. Ser. B Biol. Sci. 1979, 203, 405–426. [Google Scholar] [CrossRef]
  34. Smith, M.W.; Carrivick, J.L.; Quincey, D.J. Structure from motion photogrammetry in physical geography. Prog. Phys. Geogr. 2016, 40, 247–275. [Google Scholar] [CrossRef]
  35. Micheletti, N.; Chandler, J.H.; Lane, S.N. Structure from Motion (SFM) Photogrammetry; Clarke, L.E., Nield, J.M., Eds.; British Society for Geomorphology: London, UK, 2015. [Google Scholar]
  36. Micheletti, N.; Chandler, J.H.; Lane, S.N. Investigating the geomorphological potential of freely available and accessible structure-from-motion photogrammetry using a smartphone. Earth Surf. Process. Landf. 2015, 40, 473–486. [Google Scholar] [CrossRef] [Green Version]
  37. Casella, E.; Rovere, A.; Pedroncini, A.; Mucerino, L.; Casella, M.; Cusati, L.; Vacchi, M.; Ferrari, M.; Firpo, M. Study of wave runup using numerical models and low-altitude aerial photogrammetry: A tool for coastal management. Estuar. Coast. Shelf Sci. 2014, 149, 160–167. [Google Scholar] [CrossRef]
  38. Castillo, C.; Pérez, R.; James, M.; Quinton, N.; Taguas, E.; Gómez, J. Comparing the accuracy of several field methods for measuring gully erosion. Soil Sci. Soc. Am. J. 2012, 76, 1319–1332. [Google Scholar] [CrossRef] [Green Version]
  39. Gomez-Gutierrez, A.; Schnabel, S.; Berenguer-Sempere, F.; Contador, F.L.; Rubio-Delgado, J. Using 3D photo-reconstruction methods to estimate gully headcut erosion. Catena 2014, 120, 91–101. [Google Scholar] [CrossRef]
  40. Lucieer, A.; de Jong, S.; Turner, D. Mapping landslide displace ments using Structure from Motion (SfM) and image correlation of multi-temporal UAV photography. Prog. Phys. Geogr. 2014, 38, 97–116. [Google Scholar] [CrossRef]
  41. Ryan, J.; Hubbard, A.; Box, J.; Todd, J.; Christoffersen, P.; Carr, J.; Holt, T.; Snooke, N. UAV photogrammetry and structure from motion to assess calving dynamics at Store Glacier, a large outlet draining the Greenland ice sheet. Cryosphere 2015, 9, 1–11. [Google Scholar] [CrossRef]
  42. Hashim, K.A.; Ahmad, A.; Samad, A.M.; Tahar, K.N.; Udin, W.S. Integration of low altitude aerial &terrestrial photogrammetry data in 3D heritage building modeling. In Proceedings of the 2012 IEEE Control and System Graduate Research Colloquium (ICSGRC), Shah Alam, Malaysia, 16–17 July 2012; pp. 225–230. [Google Scholar]
  43. Bolognesi, M.; Furini, A.; Russo, V.; Pellegrinelli, A.; Russo, P. Accuracy of cultural heritage 3D models by RPAS and terrestrial photogrammetry. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2014, 40, 113–119. [Google Scholar] [CrossRef]
  44. Koutsoudis, A.; Vidmar, B.; Ioannakis, G.; Arnaoutoglou, F.; Pavlidis, G.; Chamzas, C. Multi-image 3D reconstruction data evaluation. J. Cult. Herit. 2014, 15, 73–79. [Google Scholar] [CrossRef]
  45. De Reu, J.; Plets, G.; Verhoeven, G.; de Smedt, P.; Bats, M.; Cherretté, B.; de Maeyer, W.; Deconynck, J.; Herremans, D.; Laloo, P.; et al. Towards a three-dimensional cost-effective registration of the archaeological heritage. J. Archaeol. Sci. 2013, 40, 1108–1121. [Google Scholar] [CrossRef]
  46. Westoby, M.J.; Brasington, J.; Glasser, N.F.; Hambrey, M.J.; Reynolds, J.M. “Structure-from-Motion” photogrammetry: A low-cost, effective tool for geoscience applications. Geomorphology 2012, 179, 300–314. [Google Scholar] [CrossRef] [Green Version]
  47. Reagan, D.; Sabato, A.; Niezrecki, C. Unmanned Aerial Vehicle Acquisition of Three—Dimensional Digital Image Correlation Measurements for Structural Health Monitoring of Bridges. In SPIE Smart Structures and Materials+ Nondestructive Evaluation and Health Monitoring; International Society for Optics and Photonics: Portland, OR, USA, 2017; p. 1016909. [Google Scholar] [CrossRef]
  48. Eltner, A.; Kaiser, A.; Castillo, C.; Rock, G.; Neugirg, F.; Abellán, A. Image-based surface reconstruction in geomorphometry-merits, limits and developments. Earth Surf. Dyn. 2016, 4, 359–389. [Google Scholar] [CrossRef]
  49. Barry, P.; Coakley, R. Field Accuracy Test of RPAS Photogrammetry. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2013, 40, 27–31. [Google Scholar] [CrossRef]
  50. Tahar, K.N. An evaluation on different number of ground control points in unmanned aerial vehicle photogrammetric block. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci 2013, XL-2/W2, 93–98. [Google Scholar]
  51. Tahar, K.N.; Ahmad, A.; Abdul, W.; Wan, A.; Akib, M.; Mohd, W.; Wan, N. Assessment on Ground Control Points in Unmanned Aerial System Image Processing for Slope Mapping Studies. Int. J. Sci. Eng. Res. 2012, 3, 1–10. [Google Scholar]
  52. Mesas-Carrascosa, F.-J.; Torres-Sánchez, J.; Clavero-Rumbao, I.; García-Ferrer, A.; Peña, J.-M.; Borra-Serrano, I.; López-Granados, F. Assessing Optimal Flight Parameters for Generating Accurate Multispectral Orthomosaicks by UAV to Support Site-Specific Crop Management. Remote Sens. 2015, 7, 12793–12814. [Google Scholar] [CrossRef]
  53. Mesas-Carrascosa, F.-J.; García, M.N.; de Larriva, J.M.; García-Ferrer, A. An Analysis of the Influence of Flight Parameters in the Generation of Unmanned Aerial Vehicle (UAV) Orthomosaicks to Survey Archaeological Areas. Sensors 2016, 16, 1838. [Google Scholar] [CrossRef] [PubMed]
  54. Smith, M.W.; Vericat, D. From experimental plots to experimental landscapes: Topography, erosion and deposition in sub-humid badlands from Structure-from-Motion photogrammetry. Earth Surf. Process. Landf. 2015, 40, 1656–1671. [Google Scholar] [CrossRef]
  55. James, M.R.; Robson, S. Straightforward reconstruction of 3D surfaces and topography with a camera: Accuracy and geoscience application. J. Geophys. Res. Earth Surf. 2012, 117, F03017. [Google Scholar] [CrossRef]
  56. Smith, M.W.; Carrivick, J.L.; Hooke, J.; Kirkby, M.J. Reconstructing flash flood magnitudes using “Structure-from-Motion”: A rapid assessment tool. J. Hydrol. 2014, 519, 1914–1927. [Google Scholar] [CrossRef]
  57. Javernick, L.; Brasington, J.; Caruso, B. Modeling the topography of shallow braided rivers using Structure-from-Motion photogrammetry. Geomorphology 2014, 213, 166–182. [Google Scholar] [CrossRef]
  58. Rippin, D.M.; Pomfret, A.; King, N. High resolution mapping of supra-glacial drainage pathways reveals link between micro-channel drainage density, surface roughness and surface reflectance. Earth Surf. Process. Landf. 2015, 40, 1279–1290. [Google Scholar] [CrossRef]
  59. James, M.R.; Robson, S.; Smith, M.W. 3-D uncertainty-based topographic change detection with structure-from-motion photogrammetry: Precision maps for ground control and directly georeferenced surveys. Earth Surf. Process. Landf. 2017, 19. [Google Scholar] [CrossRef]
  60. Harwin, S.; Lucieer, A. Assessing the Accuracy of Georeferenced Point Clouds Produced via Multi-View Stereopsis from Unmanned Aerial Vehicle (UAV) Imagery. Remote Sens. 2012, 4, 1573–1599. [Google Scholar] [CrossRef]
  61. Pierleoni, A.; Bellezza, M.; Casadei, S.; Manciola, P. Multipurpose water use in a system of reservoirs. IAHS-AISH Publ. 2007, 315, 107–116. [Google Scholar]
  62. Buffi, G.; Manciola, P.; de Lorenzis, L.; Cavalagli, N.; Comodini, F.; Gambi, A.; Gusella, V.; Mezzi, M.; Niemeier, W.; Tamagnini, C. Calibration of finite element models of concrete arch-gravity dams using dynamical measures: The case of Ridracoli. In Proceedings of the X International Conference on Structural Dynamics, EURODYN 2017, Rome, Italy, 10–13 September 2017. [Google Scholar]
  63. Manciola, P.; Di Francesco, S.; Biscarini, C. Flood protection and risk management: The case of Tescio River basin. In Proceedings of the Role of Hydrology inWater Resources Management, Capri, Italy, 13–16 October 2008. [Google Scholar]
  64. Ravenna, Alpina S.p.A. and Consorzio Acque Forlì, Diga di Ridracoli. 1985. Available online: http://www.alpina-spa.it/resources/pdf/pubblicazioni/985-06-aavv-diga-di-ridracoli-alpina-06-1985.pdf (accessed on 2 August 2017).
  65. Buffi, G.; Manciola, P.; Grassi, S.; Gambi, A.; Barberini, M. Survey of the Ridracoli Dam: UAV-Based Photogrammetry and Traditional Topographic Techniques in the inspection of Vertical Structures. Geomat. Nat. Hazards Risk 2017. [Google Scholar] [CrossRef]
  66. Jaud, M.; Passot, S.; le Bivic, C.; Delacourt, R.; Grandjean, N.; le Dantec, P. Assessing the Accuracy of High Resolution Digital Surface Models Computed by PhotoScan® and MicMac® in Sub-Optimal Survey Conditions. Remote Sens. 2016, 8, 465. [Google Scholar] [CrossRef]
  67. U.S. Geological Survey. Geospatial Positioning Accuracy Standards, Part 3: National Standard for Spatial Data Accuracy; Federal Geographic Data Committee: Reston, VA, USA, 1998.
  68. Buffi, G.; Niemeier, W.; Manciola, P.; Grassi, S. Comparison of 3D Model Derived from UAV and TLS—The Experience at Ridracoli Dam, Italy. In Proceedings of the 154th DVW-Seminar, Fulda, Germany, 28–29 November 2016. [Google Scholar]
  69. James, M.R.; Robson, S.; D’Oleire-Oltmanns, S.; Niethammer, U. Optimising UAV topographic surveys processed with structure-from-motion: Ground control quality, quantity and bundle adjustment. Geomorphology 2017, 280, 51–66. [Google Scholar] [CrossRef]
Figure 1. DTM of Italy (left panel), the red circle indicates the case study area, while the dam case study i.e., the Ridracoli dam and the Ridracoli lake are on the right panel.
Figure 1. DTM of Italy (left panel), the red circle indicates the case study area, while the dam case study i.e., the Ridracoli dam and the Ridracoli lake are on the right panel.
Sensors 17 01777 g001
Figure 2. Ridracoli dam while overflowing. Small panel: HIGHONE 4HSEPRO quadrotor mounting a gimbal system and a SONY Alpha 7R while at rest.
Figure 2. Ridracoli dam while overflowing. Small panel: HIGHONE 4HSEPRO quadrotor mounting a gimbal system and a SONY Alpha 7R while at rest.
Sensors 17 01777 g002
Figure 3. Upstream face of the Ridracoli dam. The red circles indicate marker positions. The small panel shows a marker applied on the structure.
Figure 3. Upstream face of the Ridracoli dam. The red circles indicate marker positions. The small panel shows a marker applied on the structure.
Sensors 17 01777 g003
Figure 4. Images overlap by more than 70%.
Figure 4. Images overlap by more than 70%.
Sensors 17 01777 g004
Figure 5. Camera positions (upper panel) and two enlargements for the left and right abutments (lower left and right panels, respectively).
Figure 5. Camera positions (upper panel) and two enlargements for the left and right abutments (lower left and right panels, respectively).
Sensors 17 01777 g005
Figure 6. Orthophoto of the dam and the materialization vertices of the two geodetic networks used for the topographic survey. The vertices of the existing network materialized by little pillars are red, the vertices of a new network materialized by topographic nails fixed on the ground are yellow.
Figure 6. Orthophoto of the dam and the materialization vertices of the two geodetic networks used for the topographic survey. The vertices of the existing network materialized by little pillars are red, the vertices of a new network materialized by topographic nails fixed on the ground are yellow.
Sensors 17 01777 g006
Figure 7. UAV dense 3D point cloud of a portion of the upstream face of the Ridracoli dam.
Figure 7. UAV dense 3D point cloud of a portion of the upstream face of the Ridracoli dam.
Sensors 17 01777 g007
Figure 8. Mean Absolute Error (MAE) on the North-East plane and along the elevation (i.e., z direction) against the number of Ground Control Points (GCPs).
Figure 8. Mean Absolute Error (MAE) on the North-East plane and along the elevation (i.e., z direction) against the number of Ground Control Points (GCPs).
Sensors 17 01777 g008
Figure 9. Boxplots of errors (ε) along North, East, elevation (y, x and z) directions and on the North-East plane for each GCPs layout. The background colour groups layout with the same density as in Table 1.
Figure 9. Boxplots of errors (ε) along North, East, elevation (y, x and z) directions and on the North-East plane for each GCPs layout. The background colour groups layout with the same density as in Table 1.
Sensors 17 01777 g009
Figure 10. An example of the influence of the percentage of water on the RMS image value: from left to right, the RMS error of the image increases with the percentage of water. In the images, the green flags represent the markers.
Figure 10. An example of the influence of the percentage of water on the RMS image value: from left to right, the RMS error of the image increases with the percentage of water. In the images, the green flags represent the markers.
Sensors 17 01777 g010
Figure 11. Magnitude of error along the elevation (εz) for each marker, considering seven different marker configurations.
Figure 11. Magnitude of error along the elevation (εz) for each marker, considering seven different marker configurations.
Sensors 17 01777 g011
Figure 12. (a) Left rock abutment and (b) right rock abutment and the stairway element on the upstream face.
Figure 12. (a) Left rock abutment and (b) right rock abutment and the stairway element on the upstream face.
Sensors 17 01777 g012
Figure 13. Error along the North-East plane (εXY) for each CP for GCPs configurations c, e, i, n, b. The placement of the arrows (indicating the error magnitude and direction) and of the grey circle is in accordance with the location of the GCPs—positioned at different levels on the dam upstream face—to facilitate the reading of the data. In particular, the figure on the top shows the altitude (meters above sea level) of the location of the GCPs.
Figure 13. Error along the North-East plane (εXY) for each CP for GCPs configurations c, e, i, n, b. The placement of the arrows (indicating the error magnitude and direction) and of the grey circle is in accordance with the location of the GCPs—positioned at different levels on the dam upstream face—to facilitate the reading of the data. In particular, the figure on the top shows the altitude (meters above sea level) of the location of the GCPs.
Sensors 17 01777 g013
Table 1. Marker layouts with IDs ranging from a to z. The black circles are the markers used as GCPs, the real coordinates of which are used to georeference the dense point cloud, while the empty circles are the markers used as control points (CPs). The coordinates of CPs are extracted from the model and compared with their actual coordinates to evaluate the accuracy of the model.
Table 1. Marker layouts with IDs ranging from a to z. The black circles are the markers used as GCPs, the real coordinates of which are used to georeference the dense point cloud, while the empty circles are the markers used as control points (CPs). The coordinates of CPs are extracted from the model and compared with their actual coordinates to evaluate the accuracy of the model.
DensityLayout
1/9a Sensors 17 01777 i001b Sensors 17 01777 i002
1/6c Sensors 17 01777 i003d Sensors 17 01777 i004e Sensors 17 01777 i005
2/9f Sensors 17 01777 i006g Sensors 17 01777 i007
1/3h Sensors 17 01777 i008i Sensors 17 01777 i009j Sensors 17 01777 i010
l Sensors 17 01777 i011m Sensors 17 01777 i012n Sensors 17 01777 i013
o Sensors 17 01777 i014p Sensors 17 01777 i015
q Sensors 17 01777 i016r Sensors 17 01777 i017
1/2s Sensors 17 01777 i018t Sensors 17 01777 i019u Sensors 17 01777 i020
5/9v Sensors 17 01777 i021
2/3w Sensors 17 01777 i022x Sensors 17 01777 i023y Sensors 17 01777 i024
5/6z Sensors 17 01777 i025
Table 2. Parameters of the camera model.
Table 2. Parameters of the camera model.
Focal lenght (pix)fx7424.32
fy7428.37
Principal point offset (pix)cx3654.48
cy2434.65
Skew coefficient (pix)skew−5.89
Radial distortion coefficientk10.05
k2−0.25
k30.04
Tangential distortion coefficentp10.00
p20.00
Table 3. Workflow and parameters used as Photoscan® input to build the dense point cloud.
Table 3. Workflow and parameters used as Photoscan® input to build the dense point cloud.
Workflow
Align Photo
AccuracyMedium
Pair pre-selectionDisabled
Point Limit40,000
Build Preliminary Mesh
Surface typeArbitrary
Source dataSparse
InterpolationEnabled
Polygon countCustom
Point classesAll
Import GCPs (GCPs Settings)
Camera accuracy (m)10
Marker accuracy (m)0.005
Tie point accuracy (pix)1
Build Dense Cloud
QualityMedium
Depth filteringAggressive
Table 4. Ground Control Points (GCPs) ID for each layout grouped by density, corresponding number of GCPs for each layout, Mean Absolute Error values (MAE) for the North, East, elevation (z) directions and the MAE evaluated on the North-East plane for each marker layout.
Table 4. Ground Control Points (GCPs) ID for each layout grouped by density, corresponding number of GCPs for each layout, Mean Absolute Error values (MAE) for the North, East, elevation (z) directions and the MAE evaluated on the North-East plane for each marker layout.
DensityCombination IDNumber of GCPMAE_xMAE_yMAE_xyMAE_z
-mmmm
1/9a70.0580.0320.0700.121
b70.0590.0320.0730.074
1/6c90.0530.0330.0670.087
d110.0540.0310.0660.135
e90.0520.0310.0640.087
2/9f140.0610.0300.0720.065
g110.0560.0320.0690.074
1/3h200.0530.0300.0650.077
i220.0530.0290.0630.062
j210.0540.0290.0660.066
l210.0530.0370.0680.155
m200.0550.0320.0690.083
n200.0560.0300.0690.065
o150.0510.0290.0620.076
p180.0520.0330.0650.105
q310.0490.0270.0590.073
r210.0560.0300.0670.170
1/2s310.0540.0310.0660.075
t310.0490.0270.0590.073
u290.0550.0300.0680.076
5/9v330.0530.0310.0660.062
2/3w400.0480.0290.0590.102
x270.0540.0290.0650.086
y420.0550.0270.0650.021
5/6z510.0500.0230.0570.015

Share and Cite

MDPI and ACS Style

Ridolfi, E.; Buffi, G.; Venturi, S.; Manciola, P. Accuracy Analysis of a Dam Model from Drone Surveys. Sensors 2017, 17, 1777. https://doi.org/10.3390/s17081777

AMA Style

Ridolfi E, Buffi G, Venturi S, Manciola P. Accuracy Analysis of a Dam Model from Drone Surveys. Sensors. 2017; 17(8):1777. https://doi.org/10.3390/s17081777

Chicago/Turabian Style

Ridolfi, Elena, Giulia Buffi, Sara Venturi, and Piergiorgio Manciola. 2017. "Accuracy Analysis of a Dam Model from Drone Surveys" Sensors 17, no. 8: 1777. https://doi.org/10.3390/s17081777

APA Style

Ridolfi, E., Buffi, G., Venturi, S., & Manciola, P. (2017). Accuracy Analysis of a Dam Model from Drone Surveys. Sensors, 17(8), 1777. https://doi.org/10.3390/s17081777

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop