Next Article in Journal
A Teleophthalmology Support System Based on the Visibility of Retinal Elements Using the CNNs
Next Article in Special Issue
A New Approach to Explore the Surface Profile of Clay Soil Using White Light Interferometry
Previous Article in Journal
Realization of Hollow-Core Photonic-Crystal Fiber Optic Gyro Based on Low-Noise Multi-Frequency Lasers with Intermediate-Frequency Difference
Previous Article in Special Issue
Field Test of Excess Pore Water Pressure at Pile–Soil Interface Caused by PHC Pipe Pile Penetration Based on Silicon Piezoresistive Sensor
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Application and Algorithm of Ground-Penetrating Radar for Plant Root Detection: A Review

1
School of Technology, Beijing Forestry University, Beijing 100083, China
2
Beijing Laboratory of Urban and Rural Ecological Environment, Beijing 100083, China
3
Research Center for Intelligent Forestry, Beijing 10083, China
4
Key Lab of State Forestry Administration for Forestry Equipment and Automation, Beijing 10083, China
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(10), 2836; https://doi.org/10.3390/s20102836
Submission received: 16 April 2020 / Revised: 3 May 2020 / Accepted: 10 May 2020 / Published: 16 May 2020
(This article belongs to the Special Issue Sensors for Nondestructive Testing and Evaluation)

Abstract

:
Attention to the natural environment is equivalent to observing the space in which we live. Plant roots, which are important organs of plants, require our close attention. The method of detecting root system without damaging plants has gradually become mainstream. At the same time, machine learning has been achieving good results in recent years; it has helped develop many tools to help us detect the underground environment of plants. Therefore, this article will introduce some existing content related to root detection technology and machine detection algorithms for root detection, proving that machine learning root detection technology has good recognition capabilities.

1. Introduction

Trees are a precious resource—as important as glaciers and oceans—and are the wealth of a country and society; thus, they are earth resources we must treasure. Trees play a very important role in maintaining natural ecosystems and regulating the climate and environment. However, due to development reasons, most countries have different levels of excessive deforestation, and it is urgent to protect forests and their ecological diversity. Of all the organs of a plant, the root is a vital organ. It is responsible for fixing plants, obtaining nutrients in the soil and improving soil composition. Therefore, it is very important to detect and evaluate the root system of existing plants in forests and other regions, and it has great development significance.
The roots are underground, but they account for 10–60% of the plant’s biomass. This feature limits our analysis and research on plant root systems. Destructive research methods are harmful to plants, which may cause them to fail to grow properly and even die. Therefore, non-destructive research methods have been generally accepted in recent years. The root system is analyzed and researched based on not destroying the original structure and ecological environment of the tree. Ground-penetrating radar (GPR) is a recognized research tool for protecting the ecology and can be used to locate buried objects, such as rocks, artifacts, public facilities and objects, as well as groundwater levels. In recent years, GPR has been used to detect and map plant root systems to determine root biomass and diameter. The reliability and practicability of the results of using GPR are widely accepted, and showing great potential. However, some research results have reached the opposite conclusion, which may present great difficulty for people when estimating the soil (a non-uniform medium). Therefore, a deeper understanding of the root system may improve the development and understanding of GPR in this field.
This article will introduce the basic GPR detection technology, as well as related technologies and machine learning supplements for further improvement and development of related technologies in the field. In recent years, the development of machine learning has shown an exponential trend. Among them, it has shown good results in the field of image processing and recognition segmentation. Based on previous research, we can apply these technologies to plant root recognition to find ways to improve performance. This article will analyze the basic technology of a back propagation neural network, as well as introduce the main achievements and shortcomings of various root detection technologies and image processing technologies, and hope to help the development of machine learning in the field of GPR in the future. In summary, the following will give an overview of GPR and deep learning applications in the following order:
  • The GPR working principle and root detection processing technology.
  • Important factors for estimating root biomass.
  • Algorithms and machine learning achievements in the field of GPR.
  • Prospects.

2. Ground-Penetrating Radar Principle and Detection Technology

As a non-destructive testing method, GPR is often used for non-destructive testing of shallow underground objects [1]. The working principle of GPR is based on electromagnetic field theory (EM), which is based on Maxwell’s equations. The validity of the measurement also depends on the reflection of the radar wave by the object, which is determined by the constitutive equation. Besides, the EM theory and the degree of physical properties of the material of the object are very important for analyzing the signal. To simplify the description, ground-penetrating radar is abbreviated as GPR in this paper.

2.1. GPR Theoretical Background

The standard GPR system consists of the following parts: a control unit (pulse generator, computer and related software), antenna (transmitting antenna and receiving antenna) and display unit, as shown in Figure 1 [2,3]. During use, the GPR scanner sends transmitting EM energy pulses. These pulses are transmitted to the detection object in the form of waves. When these waves touch targets with different electromagnetic characteristics, they will be reflected. The reflected wave has then reflected the surface and is received by the receiving device. The remaining electromagnetic waves will continue to propagate through the medium until the energy drop to zero. The control unit receives the reflected electromagnetic waves and records, samples and filters the signals. Finally, it combines the signals onto a reflection trace (A-scan), records the time from the transmitted signal to the reflected signal perpendicular to the transmitting position and receives the amplitude of the signal. A-scan can provide real-time information below the target object.
The depth of the target object can be obtained by the propagation speed of the electromagnetic wave, as shown in Equation (1) below:
D = V × t 2 ,
where D, t is the two-way propagation time. Similarly, we can also calculate the wave velocity:
V = 1 ϵ μ 2 ( 1 + ( σ ϵ ω 2 ) + 1 ,
where μ is the magnetic permeability; σ is the electrical conductivity; ϵ is the dielectric constant; and ω is the angular frequency (ω = 2πf, where f is the frequency). Besides, [4] estimated the propagation rate of low conductivity and non-magnetic materials.
During the detection of an underground object, ground-penetrating radar moves along the detection line and generates EM pulses at manually specified intervals. After recording the reflected signal, the reflected EM trace can be integrated into the radar map to form a b-scan image to generate an underground 2D image (Figure 2). By using GPRMAX, you can simulate the establishment of B-scan images to simulate plants [5]. The introduction to GPRMAX will be presented later.
The ground-penetrating radar emits electromagnetic waves that penetrate the ground in an ellipse. As the propagation depth increases, the radar wave will gradually expand, and the area scanned by the antenna wave will gradually increase (Figure 3). The coverage area can be expressed as follows:
R = α 4 + D ε + 1 ,
R is the major axis radius in the radar wave scan, α is the center frequency wavelength of the radar energy; D is the depth from the ground to the reflecting surface; and ε is the average relative permittivity of the scanning material from the ground to the mirror depth (D).
Based on the reflection characteristics of the electromagnetic waves, radar energy will be reflected before and after the antenna is placed over a buried object. When the transmitting antenna moves closer to the target, the propagation time recorded at the receiving end decreases, and when the antenna moves away from the target, the same phenomenon repeats, resulting in a hyperbola of reflection, whose apex indicates the exact location of the buried object (Figure 4).
GPR resolution and its ability to distinguish between two closely spaced targets and the smallest detectable size are negatively correlated with the coverage area. The GPR detection resolution depends on the antenna frequency, the EM characteristics of the medium, and the penetration depth [6]. Therefore, in the use of GPR, the frequency, the type of antenna and its polarization depend on many factors, such as the size and shape of the target and the transmission characteristics of the medium under investigation, as well as the surface features [7]. The resolution of the GPR in detecting adjacent targets and detecting the smallest object size is inversely proportional to the coverage area. The detection resolution of a GPR depends on the antenna frequency, the EM characteristics of the propagation medium and the penetration depth [8]. Therefore, using ground-penetrating radar for detecting objects will depend on the shape and size of the detection surface features and the characteristics of the transmission medium to select a different model GPR, such as the type of signal frequency and antenna.
Over time, the long and short axes of the ellipse generated by the electromagnetic wave will continue to increase.
With the development of GPR data processing technology and visualization technology, it is already possible to build underground 3D images (also known as C-scan). C-scan can provide radar wave amplitude maps at specific times or depths. On this basis, the requirements for signal processing technology will increase, and better processing technology is needed to provide researchers with more intuitive underground 3D reconstruction graphics [6].

2.2. Root Detection Technology of Ground-Penetrating Radar

Ten years ago, GPR was widely used in cities [9], archeology [10] and other aspects, and the root system of plants is generally considered as an impact object that interferes with research. But in the past decade, GPR has gradually been adopted by scholars to draw plant root images, because it is protective and can be repeatedly measured. The first application of ground-penetrating radar to the detection of plant roots can be traced back to 1999. In this study twenty years ago, a GPR system with a center frequency of 450 MHz was used to draw a 50-year-old rough root map of an oak tree, as well as measured them in two directions of 0.25 m, in a 6 m × 6 m square × 0.25 m contour grid with an interval of 0.05 m. After data processing, the depth correlation of the GPR was applied to analyze the root system of the big oak tree in detail to make a three-dimensional underground image. After the research, the root system was dug and photographed, and the length and diameter of the roots were measured to verify the radar data. Researchers have confirmed that the resolution of the GPR system is sufficient to distinguish roots with a diameter of 3 to 4 cm. Compared with the measured diameter of the excavated root, the diameter of the root detected by the GPR system has an error of 1–2 cm. GPR determines the length of a single root, from the stem to the smallest detectable width, with an error range of about 0.2 to 0.3 dm. Applying higher frequencies and shorter measurement intervals, this method improves resolution and accuracy to less than 1 cm. In summary, this study demonstrates that GPR has been successfully tested in relatively homogeneous forest and woodland environments. A few years later, the study’s conclusions were criticized because the 3D view of the study was drawn manually from the GPR radar chart, but did not provide specific information on how it was done. If the map is redrawn based on researcher experience, the accuracy of the technology can be misjudged.
From this point of view, the three-dimensional reconstruction of plant roots has been researched [11,12]; however, the results are not satisfactory, which shows that there is still a wide space for development. The biggest difficulty in using GPR to map plant root systems is the resolution of the GPR. When the radar scan is in an area with dense root systems, a single root cannot be identified because there is only one huge parabola. In this light, some research is aimed at limiting the detection of tree roots and the determination of root diameters by ground-penetrating radar under optimal conditions. The minimum resolution of GPR is still evolving. Tests so far under controlled conditions have confirmed that fine roots with a diameter of 0.5 cm or less can be detected [13].

3. Important Factors for Root Detection

3.1. Relative Angle

In the process of using radar forward modeling tools to simulate the generation of a large amount of GPR signal data, the parameters of various biomass in the root system, including direction, dielectric constant, etc., need to be relatively correct. Several studies have shown that the relative angle between the scanning direction of the GPR and the root direction affects the amplitude of the reflected waveform, and then affects the judgment of the root diameter [5,14,15]. As shown in Figure 5, when viewed from the plan view, the GPR scanning direction (blue line) is at the intersection (red point), intersecting the root branch (brown curve). The tangent direction at this intersection is defined as the root direction and is represented by a dashed line. The horizontal crossing angle between the measurement line and the root direction indicates the relative position between the root and the measurement line. Because of the direction of the root changes along the curved root branch, the crossing angles formed at different intersections change. The experimental data show that when the scanning direction is perpendicular to the rhizome direction, the result of forwarding modeling is very close to the actual value. However, when the intersection angles are (45°, 60°), (60°, 75°), (105°, 120°) and (120°, 135°), the estimated result is not accurate enough.

3.2. Dielectric Constant of Soil

In soil exploration, the dielectric constant determines the main characteristics of the soil and it is a very important factor in ground-penetrating radar detection. Studies have shown that the factors that affect the dielectric constant of unsaturated soils are salt, moisture, organic salts and compaction [16]. Common dielectric constant measurement methods include the transmission line impedance conversion method, reflected light polarization method and four-terminal measurement method, which is not repeated here. Besides, we can also establish the corresponding dielectric constant model based on the obtained relevant data. Reference [17] gives the common formula of the soil dielectric constant:
ε s = 3.03 + 9.3 θ v + 146.0 θ v 2 76.7 θ v 3 ,
where ε s is the soil dielectric constant, and θ v is the soil moisture content.

3.3. Electrical Conductivity of Soil

The main factors affecting soil electrical conductivity are the soluble salt, clay content and water content, and the effect of water content is the most significant [17,18]. Under normal circumstances, the effect of the soluble salt and clay content is negligible, so the soil conductivity can be approximated by the following formula [19,20]:
σ = 4.504 e 8.2635 θ ,
where σ is the electrical conductivity of the soil, and θ is the volumetric water content.

3.4. Dielectric Constant of Plant Roots

There are three commonly used root dielectric constant models: the Power Law Model, MG Model and PS Model. These models are based on the assumption of the mixed theory that fixed-shaped fillers are dispersed in an environmental state, namely the body and the matrix. In wood biomass, the air is the main body, while a solid solution and water are the filler or matrix [17]. Ana Paz et al. proposed a formula that can calculate the dielectric constant of the root system based on the model designed by their predecessors:
ε m β = θ f w × ε f w β + θ a × ε a β + θ s × ε s β ,
where θ represents the volume of the corresponding plant root system; m represents the mixture; fw represents free water; a represents air; and s represents a solid solution.

3.5. Electrical Conductivity of Plant Roots

For the root conductivity with water content below the fiber saturation point (FSP), Straube established a numerical relationship in 2002 and proposed an approximate calculation formula:
L o g 10 W C = 2.99 2.113 ( l o g 10 l o g 10 1 E C ) ,
where, among them, WC and EC are the water content and conductivity in wood materials.

4. Application of Machine Learning in GPR

4.1. BP Neural Network

The BP neural network is widely used in various root recognition technologies [21], such as the Hough transform [22] and C3 algorithm (Column Connection Clustering) [23]. The back-propagation learning algorithm can help us identify hyperbolic features and classify them. To better understand how neural networks help us identify the characteristics of GPR signals, neural networks will be introduced in detail.
Neural networks are widely parallel interconnected networks of adaptively simple units whose organization is capable of simulating the interactive response of biological nervous systems to real-world objects [24]. To better fit the input data, the BP neural network will automatically reduce the deviation continuously [25]. The following Figure 6 is a simple neuron model [26]:
In Figure 6, a, b ... n, m represents the input of the neuron, and A, B ... N, M represents the weight of each input in the previous layer. X represents the threshold of neurons in this layer, and Y is the output of the neurons. Let a, b ... n, m represent x1, x2xm, A, B ... N, M represent ω 1 , ω 2 ω n , and the formula for calculating Y is
Y = f ( i = 1 m x i ω i θ ) .
Each neuron is connected through a weighted input. The sum of the input weights inside the neuron is compared with the neuron threshold. Finally, it is output through the activation function to enter the next neuron as the next input.

4.1.1. Activation Function of the Neural Network

Two commonly used activation functions are the sigmod and relu functions. The function formula is as follows:
s i g m o d ( z ) = 1 1 + e z ,
r e l u ( z ) = { z , z > 0 0 , z 0 } .
The significance of introducing the activation function is to solve the linear inseparable problem. Neural networks without activation functions are purely linear networks. Adding various forms of activation functions is equivalent to introducing non-linearity. To speed up the calculation and reduce the trend of gradient descent, a relu function is generally introduced in the middle of the neural network.

4.1.2. Neural Networks and Cost Functions

In a simple three-layer neural network, let us suppose one layer is the input layer, the second layer is the hidden layer and the third layer is the output layer. Let ω j k l represent the weight matrix of the kth neuron in the (l-1) layer pointing to the jth neuron in the lth layer; b j l represent the offset of the jth neuron in the lth layer; z j l represent the output of the jth neuron in the first layer; and a j l represent the output of the jth neuron in the lth layer after the activation function. Then, the expression of the forward propagation matrix for m sample inputs is
a ( l ) = σ ( ω ( l ) a ( l 1 ) + b ( l ) ) ,
where a ( l 1 ) represents an n * m matrix, n is the number of neurons in layer l-1 and m is the number of input samples.
As for the cost function of the neural network, the main idea is to make the difference between the actual value and the fitted nonlinear function to get the difference between the fitted function and the actual data. In order not to be affected by individual extreme data, half of the variance is generally adopted to reduce the impact of individual data. The following formula gives only one kind of cost function expression; in addition, there are multiple cost function expressions, such as the logarithm, which will not be repeated here. h θ ( x ) represents the linear output through the activation function.
J ( θ 0 , θ 1 ) = 1 2 m i = 1 m ( h θ ( x ( i ) ) y ( i ) ) 2 .

4.1.3. Backpropagation Algorithm

The core idea of the BP backpropagation algorithm is to reduce the error between the output layer and the expectation by adjusting the network parameters. The core of the backpropagation algorithm follows the following four formulas:
Output layer error expression, where δ j ( L ) is the error generated by the jth neuron output in the Lth layer; the right side of the equation shows the partial derivative of the output layer loss function for the jth neuron in the L layer, and the derivative of activation function of j neurons linear output.
δ j ( L ) = L a j ( l ) σ ( z j ( l ) ) .
Hidden layer error expression, where w k j ( l + 1 ) presents the weight of the jth neuron in the lth layer to the kth neuron in the l + 1th layer.
δ j ( L ) = k w k j ( l + 1 ) δ k ( l + 1 ) σ ( z j ( l ) ) .
The above formula is the gradient of parameter change and parameter update expressions; the expression indicates that the loss function modifies the gradient of weights and offsets through varying errors. Besides, according to the minimum gradient method, the parameter should change in the direction that the derivative becomes smaller, so it takes a negative sign here. According to the minimum gradient method, the parameter should also change in the direction that the derivative becomes smaller, so it should take a negative sign here. In the research process of improving the BP algorithm, some scholars proposed to increase the momentum direction, adjust the adaptive rate, RMS and other techniques to eliminate the shortcomings of the BP algorithm, such as the inability to obtain the optimal solution, too many iterations and forgetting the old samples. By using the improved algorithm, we think it allows us to better use the BP algorithm for the root recognition image recognition process.
L b j ( l ) = δ j ( l ) ,
L ω j k ( l ) = a k ( l 1 ) δ j ( l ) ,
b j ( l ) = b j ( l ) α L b j ( l ) ,
ω j k ( l ) = ω j k ( l ) α L ω j k ( l ) .

4.2. Root Detection Algorithm

4.2.1. Genetic Algorithm (GA)

The genetic algorithm is well known in optimization algorithms for its stability and efficiency. In each iteration of the algorithm, the genetic algorithm retains many candidate solutions. In addition, gradient descent is not used, but direct optimization based on the objective function. Genetic algorithms have been widely used successfully, including, for example, biology, chemistry, control systems, electromagnetics and image processing [27,28].
GA uses the “chromosome” as a model to search for the optimal solution by simulating the natural evolution process. From one generation to the next, the algorithm is improved through a genetic mechanism, by using deterministic and non-deterministic genetic operators. The most common form of GA consists of the following steps. First, an initial chromosome population is randomly generated. The optimality of each chromosome is then evaluated according to a predetermined fitting function, representing the objective function under consideration. This adaptive assessment step will maintain the best chromosomes and eliminate the worst chromosomes by using appropriate selection rules based on the principle of higher fitness and a higher chance of being selected. Once the selection process is complete, the next step is to breed the population. This is done by genetic operators, such as crossover and mutation. The crossover algorithm is a deterministic operator similar to biological exchange, and its purpose is to combine two chromosomes (parents) selected according to the roulette rotation method to generate new chromosomes (offspring). The basic idea of this algorithm is to produce offspring. If offspring inherit the best genes of their parents, they may perform better than their parents. The mutation is a random operation, similar to a biological mutation, which randomly changes one or more genes of the chromosome in question. This operator can be used to prevent the population from falling into a local optimum. Iterate the entire process until a user-defined convergence criterion or a maximum number of iterations is reached. Through the genetic algorithm, the B-scan hyperbola can be successfully identified, and the types of underground buried substances can be further identified through processing, such as windowing, energy matching and normalization [29].
Through the description of the genetic algorithm, it has the following advantages: it can find the global optimal solution of the optimization problem, the optimization result has nothing to do with the initial conditions and it is widely used. But at the same time, it also has the disadvantages of a slow convergence, more control variables and a poor local search ability. In view of the characteristics of the genetic algorithm, it is widely used in combinatorial optimization problems. Therefore, we think the algorithm can be used in the automatic control of ground-penetrating radar.

4.2.2. Expectation Maximum Algorithm

In statistical calculations, the expectation maximum algorithm is an algorithm that looks for the maximum likelihood estimation or the maximum posterior estimation of parameters in a probabilistic model, where the probability model depends on an unobservable hidden variable (latent variable). The biggest expectations are often used in the field of data clustering for machine learning and computer vision. The expectation maximum algorithm is calculated alternately through two steps. The first step is to calculate the expectation (E) and use the existing estimated value of the hidden variable to calculate its maximum likelihood estimate. The second step is to maximize (M); the maximum likelihood value obtained in step E is calculated to calculate the value of the parameter. The parameter estimates found at step M are used in the next step E calculations, and the process continues alternately.
When determining the hyperbolic model, we need to determine the number of the hyperbola. The number of a hyperbola can be well determined through the Bayesian information criterion, and the position and shape of the hyperbola can be determined by using the expectation maximum algorithm. This type of method is very effective for multi-channel GPR systems and can generate a large amount of data on various tests. Therefore, research in this area will also likely play an important role in GPR and related industries (such as utility inspection, infrastructure and transportation industries) [29]. Expectation maximum algorithms are often used in the field of data clustering in machine learning and computer vision. It is not suitable for large-scale data sets and high-dimensional data, but the calculation structure is stable and accurate. The EM algorithm can iterate according to the existing data to make it converge to the optimal solution. Therefore, it can be used in the image recognition process of root detection [30,31].

4.2.3. C3 Column Link Clustering Algorithm

The column link clustering algorithm is a root detection and recognition method based on neural networks. The C3 technology used in this method is based on the connection relationship between the pixels in the image. Not only can the branches of the cross hyperbola be separated and identified, but also the input is small, and it can achieve good results with fewer data training. In the artificially synthesized B-scan image, there is a full recognition accuracy for 52 sets of data, and few hyperbola intersections are misrecognized. In the real scan processing results, the number of hyperbola identified will increase compared to the noise of the synthesized data.
In the column link clustering algorithm, the pre-processed image is subjected to a column scan and clustered according to the vertical link between the pixels to divide into multiple column clusters. Then, each column cluster is identified according to the radar scanning direction, and the parts connected to the column cluster are integrated into a cluster. The three situations generated at this time are shown in Figure 7.
First, we define a cluster of pixels with more than four nodes. In the first cluster of column C1, since there are four connection points with C2, they are a cluster. In the second cluster of column C1, because there are only two pixels, it is excluded. In the third cluster of C1, because there are discontinuities between the eight pixels connected to C2, the third cluster of C1 and the second cluster of C2 are merged into the a1 cluster, and the third cluster of C1 and the third cluster of C2 are merged into the b1 cluster. In the fourth cluster of C1 and the fourth cluster of C2, since they are not connected, they are regarded as a single cluster. The rest of the image works on the same principle; this way it links the entire image. If the situation shown in Figure 7 occurs, the derivative of the intersection p is judged. If it is a hyperbola with a downward opening, the first derivative of p should be 0 and the second derivative is negative. After the method is run, the image is automatically recognized by combining it with the neural network [23]. Finally, the detection rate between several methods is obtained, as shown in Table 1. Through the introduction of the C3 algorithm, we can try to improve the number of clusters in the future to adapt to different pictures to achieve the optimal solution, so as to better perform root recognition. The comparison in the table fully demonstrates its high level of accuracy in GPR identification and is one of the effective tools that can continue to provide assistance for root detection in the future.

4.2.4. Faster R-CNN

Faster R-CNN is mainly composed of four parts: Conv layers, Region Proposal Networks, Roi Pooling and Classification. As a ground-penetrating radar simulation software, GPRMAX can well fit the construction of various underground environments, providing us with the possibility of obtaining a large amount of forwarding data. As shown in Figure 8, it can be seen that the Region Proposal Network is actually divided into two lines. The upper one uses the softmax classification anchors to obtain the positive and negative classifications. The next one is used to calculate the bounding box regression offset for the anchors to obtain accurate proposals. The final Proposal layer is responsible for synthesizing positive anchors and corresponding bounding box regression offsets to obtain proposals, while excluding proposals that are too small and beyond the boundary. In fact, when the entire network reaches the Proposal layer, it has completed the function equivalent to target positioning. The RoI Pooling layer is responsible for collecting proposals and calculating the proposal feature maps, which are then sent to the subsequent network. The Classification part uses the already obtained proposal feature maps, calculates the specific category of each proposal through the full connect layer and softmax, and outputs the cls prob probability vector; at the same time, it again uses the bounding box regression to obtain the position offset of each proposal for regression; a more accurate target detection frame. In [32], the location and detection of mines were realized by using Faster R-CNN, and some scholars used this method to realize the classification function of underground targets [33]. The relationship between the depth and the image pixels, as well as the width of the antenna beam, is crucial for the implementation of this approach.
Compared to RCNN, Faster-RCNN no longer separately extracts features, which improves speed. However, it takes a long time to extract candidate frames using selective search. Although Faster-Rcnn still cannot achieve the real-time detection target, its detection accuracy and speed are very high, which is very suitable for the research and analysis process of plant roots rather than commercial use.

4.3. Application Status

Through the introduction of the neural network, we can input the GPR image information into the neural network, extract the feature values in the image to achieve the goal of identifying hyperbola and further features. Because machine learning involves a large amount of data analysis, the field generally cannot obtain a large amount of image information. As a ground-penetrating radar simulation software, GPRMAX can well fit the construction of various underground environments, providing us with the possibility of obtaining a large amount of forwarding data.

4.3.1. Forward Simulation Software GPRMAX

GprMaxV2.0 was originally from the doctoral dissertation of Dr. Antonis Giannopoulosd of the University of Edinburgh, as open-source software, and is constantly updated and developed. The finite-difference time-domain method (FDTD) is the basic theoretical basis of the GprMax simulation, and it is a commonly used method in the field of electromagnetic field calculation. The finite-difference time-domain method divides the research space into a certain grid form and then uses the finite-difference equations to approximate the Maxwell equations in the time domain. As an open-source ground-penetrating radar simulation software, the main functions of GprMax includes a simple command interface, modeling of simple media models, modeling of complex shape targets and simulation of unbounded space using absorbing boundary conditions. GprMax3D can simulate GPR antennas and even introduce its feed transmission lines into the model. GprMax2D is mainly used for GPR “signature” simulation, while GprMax3D is used for more detailed and realistic simulation, especially when compared with real GPR data. Both GprMax2D and 3D programs use simple ASCII (text) files to define the parameters of the model. The software has a very detailed user manual in which you can find detailed information on the functions of the program. For the processing of root scanning, we use GprMax3D for modeling and simulation, so as to obtain a large number of approximate real data to approximate the scanned image generated by GPR in the actual measurement. The simplest medium is a homogeneous, linear and isotropic medium, and its constitutive relationship is j = δ E , D = ε E and B = μ H . In the formula, δ is the electrical conductivity, ε is the dielectric constant, μ is the magnetic permeability and all are scalar constants, as well as parameters of the electrical properties of the reaction medium; J is the current density, D is the electric displacement vector, B is the magnetic induction strength, E is the electric field strength, and H is the magnetic field strength. GprMax software is used for forward modeling of ground-penetrating radar data, which has been widely used at home and abroad [34].

4.3.2. Application Section

As shown in Figure 9, the continuous scanning of hyperbolic images is discretized by deep learning. A general backpropagation algorithm is used. The partial set of pixels is used as the input of the next hidden layer, which reduces the amount of computer processing and increases sensitivity to hyperbola. At the same time, the hyperbola is also split into two parts. Due to its symmetrical structure, the analysis side can increase the calculation speed by almost half [35].
Due to the complexity of some terrains, for many types of underground environments, such as cables, the obtained B-scan will recognize many similar hyperbolas. At this time, it is difficult to determine the recognition accuracy and the exclusion of environmental influence factors. Decreasing the recognition accuracy may cause the plant part to fail to recognize, and the high accuracy may cause the recognition to be inaccurate. In addition, the images obtained through forward modeling are still different from the actual environment, and the results obtained will also be partially biased. In [33], the training set used consists of nearly 1000 half trapezoids taken from over 100 radargrams. Approximately 40% of them contain hyperbolas from a large variety of objects in different soils and depths; the other 60% are a collection of background examples, non-hyperbolic reflections of any kind and geological structures. Due to the system’s sensitivity, it can cope very well with interfering or incomplete hyperbolas, which was one of the main goals of this work. Figure 10 shows two examples of such situations.
Figure 11 is a flow chart of curve recognition using the genetic algorithm. After several cycles, a large number of major hyperbola will be identified, and the last recognition is less than the threshold, which proves that there is no data to be identified in the image, and the remaining is noise and unwanted data. Then, the hyperbola obtained from the recognition is transformed into corresponding geographic horizontal and vertical coordinates, and the function of root detection can be realized. Reference [27] uses three materials (quartz stone, metal and air) and three different shapes (a circular section, square section and uniform layer) to evaluate the sensitivity to multi-object interference. In other words, the article verifies whether the classification accuracy depends on the distance between adjacent buried objects. They change the parameter d according to four different values: λ 0 , λ 0 / 2 , λ 0 / 4 and λ 0 / 8 . The orientation angle of the two objects is randomly selected at intervals of (-π/2, π/2), and get the best performance when there is only one object on the ground. In addition, the closer the adjacent objects, the lower the object discrimination ability. But even if the objects are very close to each other (≥0.125λ0, i.e., about 9 cm), the classification accuracy is still satisfactory. The test results are shown in Table 2. From the 40 GPR scenarios, 25 (62%) were correctly processed in terms of detection, i.e., all the buried objects present in the corresponding image were correctly detected.
In addition, there is a technique for preprocessing the B-scan using convolutional neural networks. After reducing the size of the picture to 49 * 49, learning the classification algorithm has also achieved good results [36], and a comparison of detection accuracy of several machine learning methods was obtained (Figure 12). Besides, there are new methods that developed a novel near-real-time, forward modeling approach for GPR that is based on a machine learning (ML) architecture. The ML framework uses an innovative training method that combines a predictive principal component analysis technique, a detailed model of the GPR transducer and a large data set of modeled GPR responses from our FDTD simulation software, and the accuracy of the ML-based forward model is a significant step toward commercially viable applications of FWI of GPR [37,38,39].

5. Summary and Outlook

This article introduces GPR (this article provides some information about GPR), including the working principle and calculation formula. Then, we briefly commented on some algorithms, and introduced several commonly used algorithms in root detection, combined with the neural network introduced later to achieve better results. Based on the various algorithms and data results introduced above, the technology of automatically identifying underground buried objects through machine learning has proved to be feasible and of great significance. After nearly two decades of development, GPR has made great progress in algorithms and optimization, but still faces difficulties. Through the genetic algorithm, backpropagation neural network and EM clustering algorithm introduced in this article, the continuous improvement by scholars in recent years shows that there is still much room for improvement in optimization. The optimization of machine learning algorithms is constantly evolving, and we can use the results of recent algorithm research for this research. Despite its good image processing and recognition technology, machine learning is rarely used in GPR. By using GPRMAX simulation software to generate a large amount of data, importing machine learning data sets for training can realize the recognition function of underground objects. The combination of machine learning and ground-penetrating radar can be used not only for root cause detection, but also for detecting any objects in the ground without having to model the objects separately. According to the working principle of GPR, we can also add machine learning technology in all aspects of scanning, recognition and display in the future. Finally, this article aims to focus on the application of machine learning. Many of the same excellent processing techniques are not repeated here, but this does not mean that they are not important.
In summary, we think machine learning methods can be used in the following aspects of ground-penetrating radar:
(A)
Root detection and identification. After obtaining the B-scan map obtained by scanning the ground system of the ground-penetrating radar, accurate identification methods (such as Faster-RCNN) are used to conduct research for scientific personnel, and rapid identification methods can also be used to provide potential possibilities for commercialization.
(B)
Commercial use. In view of the fact that some of the algorithms mentioned above have the characteristics of rapid convergence recognition (such as the C3 algorithm), they can be used for real-time measurement to achieve commercial use.
(C)
Use machine learning techniques to improve GPR functions. Due to the limitations of the GPR output image, we can improve the picture quality from the source, so as to better carry out the subsequent research on the data.
Since 1999, the inversion of the underground environment is moving in different directions and using different methods. With the development of the times, we believe that machine learning can help better in the future.

Author Contributions

For this review, H.L. and J.L. conceived and designed the research; L.X. and H.L. collected the references; H.L. and L.X. analyzed the data and results of the references; H.L. and L.X. wrote the paper. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Special Fund for Beijing Common Construction Project.

Acknowledgments

The authors give special thanks Yandong Zhao for numerous discussions and help given throughout the course of this work.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Daniels, D.J. Surface-penetrating radar. Electron. Commun. Eng. J. 1996, 8, 165–182. [Google Scholar] [CrossRef]
  2. Guo, L.; Lin, H.; Fan, B.; Cui, X.; Chen, J. Forward simulation of root’s ground penetrating radar signal: Simulator development and validation. Plant Soil 2013, 372, 487–505. [Google Scholar] [CrossRef]
  3. Ruchita, S.; Ajinkya, R.; Yashwant, A. Use of Ground-Penetrating Radar (GPR) as an Effective Tool in Assessing Pavements—A Review. Geotech. Transp. Infrastruct. 2019, 29, 85–95. [Google Scholar]
  4. Kadioğlu, S.; Daniels, J.J. 3D visualization of integrated ground penetrating radar data and EM-61 data to determine buried objects and their characteristics. J. Geophys. Eng. 2008, 5, 448. [Google Scholar] [CrossRef]
  5. Wang, M.K.; Wen, J.; Li, W.B. Qualitative Research: The Impact of Root Orientation on Coarse Roots Detection Using Ground-Penetrating Radar (GPR). BioResources 2020, 15, 2237–2257. [Google Scholar]
  6. Alani, A.M.; Ciampoli, L.B.; Tosti, F.; Brancadoro, M.G.; Pirrone, D.; Benedetto, A. Health Monitoring of a Matured Tree Using Ground Penetrating Radar–Investigation of the Tree Root System and Soil Interaction. In EGU General Assembly Conference Abstracts; IMEKO: Budapest, Hungary, 2017; p. 17210. [Google Scholar]
  7. Ciampoli, L.B.; Tosti, F.; Economou, N. Signal Processing of GPR Data for Road Surveys. Geosciences 2019, 9, 96. [Google Scholar] [CrossRef] [Green Version]
  8. Schoor, M.; Colvin, C. Tree root mapping with ground penetrating radar. In Proceedings of the 11th SAGA Biennial Technical Meeting and Exhibition, Swaziland, South Africa, 16–18 September 2009. [Google Scholar]
  9. Leucci, G.; Giorgi, L.D.; Ditaranto, I.; Giuri, F.; Ferrari, I.; Scardozzi, G. New Data on the Messapian Necropolis of Monte D’Elia in Alezio (Apulia, Italy) from Topographical and Geophysical Surveys. Sensors 2019, 19, 3494. [Google Scholar] [CrossRef] [Green Version]
  10. Porcelli, F.; Sambuelli, L.; Comina, C.; Spanò, A.; Lingua, A.; Calantropio, A.; Catanzariti, G.; Chiabrando, F.; Fischanger, F.; Maschio, P.; et al. Integrated Geophysics and Geomatics Surveys in the Valley of the Kings. Sensors 2020, 20, 1552. [Google Scholar] [CrossRef] [Green Version]
  11. Gribbe, S.; Blume-Werry, G.; Couwenberg, J. Digital, Three-Dimensional Visualization of Root Systems in Peat. Soil Syst. 2020, 4, 13. [Google Scholar] [CrossRef] [Green Version]
  12. Wielopolski, L.; Hendrey, G.; Daniels, J. Imaging tree root systems in situ. Proc. SPIE Int. Soc. Opt. Eng. 2000, 4084, 642–646. [Google Scholar]
  13. Butnor, J.R.; Doolittle, J.A.; Kress, L. Use of ground-penetrating radar to study tree roots in the southeastern United States. Tree Physiol. 2001, 21, 1269–1278. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Tanikawa, T.; Hirano, Y.; Dannoura, M. Root orientation can affect detection accuracy of ground-penetrating radar. Plant Soil 2013, 373, 317–327. [Google Scholar] [CrossRef]
  15. Straube, J.; Onysko, D.; Schumacher, C. Methodology and Design of Field Experiments for Monitoring the Hygrothermal Performance of Wood Frame Enclosures. J. Build. Phys. 2002, 26, 123–151. [Google Scholar] [CrossRef]
  16. Fu, Y.W.; Lu, Y.L.; Ren, T. Root-induced changes in soil thermal and dielectric properties should not be ignored. Geoderma 2020, 370, 114352. [Google Scholar] [CrossRef]
  17. Paz, A.; Thorin, E.; Topp, C. Dielectric mixing models for water content determination in woody biomass. Wood Sci. Technol. 2011, 45, 249–259. [Google Scholar] [CrossRef]
  18. Deng, X.; Gu, H.N.; Yang, L.; Lyu, H.; Cheng, Y.; Pan, L.; Fu, Z.; Cui, L.; Zhang, L. A method of electrical conductivity compensation in a low-cost soil moisture sensing measurement based on capacitance. Measurement 2020, 150, 107052. [Google Scholar] [CrossRef]
  19. Sun, Y.; Ma, J.; Peng, J.; Huang, S.; Yang, K.; Zhu, P.; Zhu, H. Preliminary Applicability Analysis of Soil Dielectric Constant Model of the Different Soil Texture Condition. In Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan, 28 July–2 August 2019; pp. 7148–7151. [Google Scholar]
  20. Mccutcheon, M.C.; Farahani, H.J.; Stednick, J.D. Effect of soil water on apparent soil electrical conductivity and texture relationships in a dryland field. Biosyst. Eng. 2006, 94, 19–32. [Google Scholar] [CrossRef]
  21. Asadi, P.; Gindy, M.; Alvarez, M. A Machine Learning Based Approach for Automatic Rebar Detection and Quantification of Deterioration in Concrete Bridge Deck Ground Penetrating Radar B-scan Images. KSCE J. Civ. Eng. 2019, 23, 2618–2627. [Google Scholar] [CrossRef]
  22. Windsor, C.G.; Capineri, L.; Falorni, P. A Data Pair-Labeled Generalized Hough Transform for Radar Location of Buried Objects. IEEE Geosci. Remote Sens. Lett. 2014, 11, 124–127. [Google Scholar] [CrossRef]
  23. Dou, Q.; Wei, L.; Magee, D.R. Real-Time Hyperbola Recognition and Fitting in GPR Data. IEEE Trans. Geosci. Remote Sens. 2017, 55, 51–62. [Google Scholar] [CrossRef] [Green Version]
  24. Kohonen, T. An introduction to neural computing. Neural Netw. 1988, 1, 3–6. [Google Scholar] [CrossRef]
  25. Jin, W.; Li, Z.J. The improvements of BP neural network learning algorithm. In Proceedings of the 16th World Computer Congress 2000, Beijing, China, 21–25 August 2000; pp. 1647–1649. [Google Scholar]
  26. Ding, S.; Su, C.; Yu, J. An optimizing BP neural network algorithm based on genetic algorithm. Artif. Intell. Rev. 2011, 36, 153–162. [Google Scholar] [CrossRef]
  27. Yao, M.; Meng, H.Y. An Application of Genetic Algorithm in GPR Data Analysis for Buried Tomb Relics. J. East China Norm. Univ. 2003, 2003, 48. [Google Scholar]
  28. Wang, Y.P.; Li, S.; Wei, Q. Biology Inspired Robot Behavior Selection Mechanism: Using Genetic Algorithm; Springer: Berlin/Heidelberg, Germany, 2007; Volume 4688, pp. 777–786. [Google Scholar]
  29. Pasolli, E.; Melgani, F.; Donelli, M. Automatic Analysis of GPR Images: A Pattern-Recognition Approach. IEEE Trans. Geosci. Remote Sens. 2009, 47, 2206–2217. [Google Scholar] [CrossRef]
  30. Chen, H.; Cohn, A.G. Probabilistic robust hyperbola mixture model for interpreting ground penetrating radar data. In Proceedings of the 2010 International Joint Conference on Neural Networks (IJCNN), Barcelona, Spain, 18–23 July 2010. [Google Scholar]
  31. Maas, C.; Schmalzl, J. Using Pattern Recognition to Automatically Localize Reflection Hyperbolas in Data from Ground Penetrating Radar. Comput. Geosci. 2013, 58, 116–125. [Google Scholar] [CrossRef]
  32. Pham, M.; Lefèvre, S. Buried object detection from B-scan ground penetrating radar data using Faster-RCNN. arXiv 2018, arXiv:1803.08414. [Google Scholar]
  33. Kafedziski, V.; Pecov, S.; Tanevski, D. Detection and Classification of Land Mines from Ground Penetrating Radar Data Using Faster R-CNN. In Proceedings of the 26th Telecommunications Forum (TELFOR), Belgrade, Serbia, 20–21 November 2018; pp. 1–4. [Google Scholar]
  34. Guo, L.; Chen, J.; Cui, X. Application of ground penetrating radar for coarse root detection and quantification: A review. Plant Soil 2013, 362, 1–23. [Google Scholar] [CrossRef] [Green Version]
  35. Birkenfeld, S. Automatic detection of reflexion hyperbolas in GPR data with neural networks. In Proceedings of the 2010 World Automation Congress, Kobe, Japan, 19–23 September 2010; pp. 1–6. [Google Scholar]
  36. Besaw, L.E.; Stimac, P.J. Deep convolutional neural networks for classifying GPR B-Scans. In Proceedings of SPIE the International Society for Optical Engineering; SPIE: Bellingham, WA, USA, 2015; Volume 9454. [Google Scholar]
  37. Giannakis, I.; Giannopoulos, A.; Warren, C. A Machine Learning-Based Fast-Forward Solver for Ground Penetrating Radar with Application to Full-Waveform Inversion. IEEE Trans. Geosci. Remote Sens. 2019, 57, 4417–4426. [Google Scholar] [CrossRef] [Green Version]
  38. Giannakis, I.; Giannopoulos, A.; Warren, C. A Machine Learning Scheme for Estimating the Diameter of Reinforcing Bars Using Ground Penetrating Radar. IEEE Geosci. Remote Sens. Lett. 2020, 1–5. [Google Scholar] [CrossRef] [Green Version]
  39. Ando, J. Attempt to apply the machine learning for GPR data. In The 13th SEGJ International Symposium Tokyo, Japan, 12–14 November 2018; Society of Exploration Geophysicists: Tulsa, OK, USA, 2019. [Google Scholar]
Figure 1. Work process of ground-penetrating radar (GPR).
Figure 1. Work process of ground-penetrating radar (GPR).
Sensors 20 02836 g001
Figure 2. B-scan hyperbola image.
Figure 2. B-scan hyperbola image.
Sensors 20 02836 g002
Figure 3. The electromagnetic wave waveform generated by the emission source.
Figure 3. The electromagnetic wave waveform generated by the emission source.
Sensors 20 02836 g003
Figure 4. Schematic diagram of GPR reflection hyperbola generation.
Figure 4. Schematic diagram of GPR reflection hyperbola generation.
Sensors 20 02836 g004
Figure 5. Definition of the included angle.
Figure 5. Definition of the included angle.
Sensors 20 02836 g005
Figure 6. Single neuron model.
Figure 6. Single neuron model.
Sensors 20 02836 g006
Figure 7. Three situations generated during scanning.
Figure 7. Three situations generated during scanning.
Sensors 20 02836 g007
Figure 8. The Region Proposal Network.
Figure 8. The Region Proposal Network.
Sensors 20 02836 g008
Figure 9. The feature extraction process of a neural network.
Figure 9. The feature extraction process of a neural network.
Sensors 20 02836 g009
Figure 10. Reliable classification results in case of interfering hyperbolas.
Figure 10. Reliable classification results in case of interfering hyperbolas.
Sensors 20 02836 g010
Figure 11. The root detection process of the genetic algorithm.
Figure 11. The root detection process of the genetic algorithm.
Sensors 20 02836 g011
Figure 12. ROC curves summarizing the performance of our anomaly detection and discrimination algorithms.
Figure 12. ROC curves summarizing the performance of our anomaly detection and discrimination algorithms.
Sensors 20 02836 g012
Table 1. Comparison of the average detection rates and fitting rates among different methods.
Table 1. Comparison of the average detection rates and fitting rates among different methods.
MethodRecallPrecisionF-Measure
Detection rates of [29]0.7240.3470.474
Fitting rates of [29]0.4180.0910.149
Fitting rates of improve C3 algorithm0.7040.7080.702
Table 2. Genetic algorithm performances at the scenarios level.
Table 2. Genetic algorithm performances at the scenarios level.
Simulated ScenariosCorrectly Detected ScenariosCorrectly Detected and Recognized Scenarios
4025 (62%)18 (45%)

Share and Cite

MDPI and ACS Style

Liang, H.; Xing, L.; Lin, J. Application and Algorithm of Ground-Penetrating Radar for Plant Root Detection: A Review. Sensors 2020, 20, 2836. https://doi.org/10.3390/s20102836

AMA Style

Liang H, Xing L, Lin J. Application and Algorithm of Ground-Penetrating Radar for Plant Root Detection: A Review. Sensors. 2020; 20(10):2836. https://doi.org/10.3390/s20102836

Chicago/Turabian Style

Liang, Hao, Linyin Xing, and Jianhui Lin. 2020. "Application and Algorithm of Ground-Penetrating Radar for Plant Root Detection: A Review" Sensors 20, no. 10: 2836. https://doi.org/10.3390/s20102836

APA Style

Liang, H., Xing, L., & Lin, J. (2020). Application and Algorithm of Ground-Penetrating Radar for Plant Root Detection: A Review. Sensors, 20(10), 2836. https://doi.org/10.3390/s20102836

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop