1. Introduction
In the past few decades, a great number of automated techniques for point measurement of soil water content have been developed and tested because of the important role soil water content plays in guiding the management of irrigation and drainage [
1-
3]. Generally, those techniques can be classified into the following categories: (i) tensiometers, typically, a plastic tube with a porous ceramic cup attached at one end and a vacuum gauge or a pressure transducer on the other end, measuring the soil water tension or suction in units of kPa [
4]; (ii) resistance blocks, two electrodes imbedded in a porous material such as gypsum, or a sand-ceramic mixture, determining soil water according to electrical resistance measured with an alternating current bridge [
4,
5]; (iii) heat dissipation type that derives soil water by measuring how much heat is dissipated in a ceramic medium buried in a soil [
4,
5]; (iv) dielectric sensors that obtain soil water by measuring the apparent dielectric constant of a soil [
5]; (v) connector type sensors which are also based on dielectric properties of a soil, including: (a) Time Domain Reflectometry (TDR), measuring soil water content through measuring the travel time of an electromagnetic pulse along the metal rods of the waveguide, the time is determined by the soil bulk electrical permittivity which is strongly influenced by soil water, and (b) frequency domain reflectometers (FDR), similar to TDR but relying on reflected pulse reaching a set voltage rather than waveform analysis in TDR [
5]; (vi) neutron method, consisting of a radioactive fast neutron source probe and a helium-3 detector, estimating soil water by the recorded count of thermal neutrons which are thermalized by the hydrogen present in the soil [
3].
Although a certain amount of testing is normally conducted during the development of each sensor or some lab calibration is done by end users, due to the differences in design and functionality, each sensor may perform differently when used in real measurement operations in a specific region. The reliability of those tests is consequently limited by specific lab configurations and soil types [
5-
7] during test when applied beyond the test configurations.
Walker
et al. [
2] conducted in Australia an
in situ comparison of several soil moisture sensors, including Environmental sensor Virrib (Environmental sensor Inc., San Diego, CA, USA; dielectric type), Campbell Scientific Inc. (CSI, USA, hereafter) CS615 reflectometer, and Soil Water Equipment Corporation Trase buriable- and connector-type TDR soil water sensors and found that among the tested sensors, the connector-type TDR performed the best against thermogravimetric measurements. The CS615 reflectometer yielded physically impossible soil water measurements during a period of soil water saturation. Leib
et al. [
8] did a similar field comparison of several soil moisture sensors including Irrometer Watermarks (The Irrometer Co., Riverside, CA, USA), EnviroScan (Sentek Environmental Technologies, Stepney, Australia), Troxler Sentry 200 (Troxler Electronics Laboratories Inc. NC, USA), AquaTel (Automata Inc., Grass Valley, CA, USA), AquaFlex (Streat Instruments, Christchurch, New Zealand), TRIME (MESA systems Co. Medfield, MA, USA), AquaPro (Aquapro-Sensors, Reno, NV, USA), and GroPoint (Environmental sensor Inc., San Diego, CA, USA; dielectric type), against soil water measurements obtained by a neutron probe calibrated for a Warden silt loam soil (coarse-silty, mixed, mesic, Xerollic Camborthids) under a crop of alfalfa. Their research concluded that connector-type TDR sensors produced soil water measurements within the ±2.5% (v/v) accuracy specified by the manufacturer when using the manufacturer's calibration relationship. Very recently, Zhao
et al. [
9] compared TDR, FDR, and a new type of soil water sensor based on standing wave ratio (SWR) in sandy loam and loam, loess, and peaty soils from Germany and concluded that SWR-based sensors performed better than both the TDR and FDR soil moisture sensors, regardless of soil type. In Hanson and Peters's research [
10], the Trase (TDR instrument) and ThetaProbe (Delta-T, UK) were found to be reasonably accurate over a range of soil textures while the EnviroScan (Sentek Ltd., Australia) was inaccurate in silt loam and silty clay soils. These comparisons strongly suggest a performance variation of soil moisture sensors over different soil conditions tested.
Plauborg
et al. [
11] studied the impacts of both installation configurations (vertical and horizontal) and soil types on the performance of sensors such as the CSI Sensor CS616 (a later version of CS615), and Streat Instrument Aquaflex against TDR in different soil types. Their results demonstrated that the standard calibration from the factory needed to be corrected for sandy soils and that the CS616 sensor performed better with factory calibration in loam and clay soils. Although it is possible that using TDR as a reference may introduce some uncertainty because TDR may have measurement bias, their research demonstrated the variability of accuracy of each sensor when applied over different soils and with different installation configurations. Because of vertical variations of soil texture and water conditions, it is possible that the soil water sensors may perform differently in different soil layers from the top layer to the bottom layer down a soil profile although there is a lack of such information from the literature review.
Given the wide range of sensors and soil types covered in the above-mentioned inter-comparisons, it is safe to conclude that soil moisture sensors performed differently with soil types, different soil depths and different parts of a field [
5,
10]. Climate and soil physical conditions may be additional factors which directly or indirectly influence the sensitivity of sensors. For example, soil temperature is closely related to the conductivity and movement of soil water [
12], which can significantly influence soil water measurements [
3,
5], in particular, measured by resistance sensors [
13-
15].
Obviously, a soil-specific calibration of each sensor under prevailing climatic conditions is a necessary prerequisite for a sensor to achieve its highest degree of absolute accuracy in soil water content measurements although not the only requirement [
5,
8,
16,
17]. However, the calibration conditions may not always be available. An inter-comparison of different sensors with factory calibration or minimum calibration would be very useful for the successful applications of sensors. On the other hand, as technology advances, improvements have been continuously brought to the soil water sensor market, making it relevant from time to time to investigate new or improved methods for
in situ testing to obtain more knowledge than is available from the manufacturer's technical specifications [
3]. Therefore, a carefully designed,
in situ test and a field-based inter-comparison of sensors could provide valuable information for a wise application of soil moisture sensors. The Maritime Region of Canada has a very unique pattern of soil water distribution because of greatly variable weather conditions. An
in situ evaluation of soil moisture sensors would assist in the application of soil water sensors for directing water management in this region.
The objectives of this study were to: (i) test the performance of several soil moisture sensors with factory calibration or minimum calibration in terms of different soil texture and soil water regimes; and (ii) provide experimentally-based suggestions on the application strategies of the sensors for obtaining acceptable measurements in the east coast Maritime Region of Canada.
2. Material and Methods
2.1. Methods to measure soil water contents
2.1.1. Gravimetric method (GM)
Reference soil water content was determined by the gravimetric method and is expressed by volume as the ratio of the volume of water to the total volume of the soil sample. To determine the ratio for a particular soil sample, the water mass is determined by drying the sampled soil in an oven at a temperature of 100–110 °C (typically at 105 °C) to a constant weight and measuring the soil mass before and after drying. The water mass contained in the soil sample is the difference between the masses of the wet and oven-dry sample. The conversion of soil water content from a mass basis to a volume basis has applied knowledge of the bulk density of the soil and density of the water.
2.1.2. Instrumental methods
Several types of soil water content instruments were installed in this exercise: (1) dielectric type, including Trase (6050X1; Soil Moisture Equipment Corp., Santa Barbara, CA, USA) and Moisture Point 917 (MP917; Environmental Sensors Inc., BC, Canada); Quasi-TDR based TRIME-FM (IMKO Micromodultechnik GmbH, Ettlingen, Germany); CS615 (Frequency domain reflectometer based, North Logan, UT, USA); (2) capacitance type Gopher (Soil Moisture Technology Pty Ltd., QLD, Australia), and Netafim (Netafim, Fresno, CA, USA); (3) Resistance type WaterMark (Irrometer Company, Inc., Riverside, CA, USA) and Gypsum blocks (Soil moisture technology Pty Ltd., QLD, Australia); and (4) Neutron type (Troxler 2651, Troxler Electronic Laboratories Inc., NC, USA). Without specific notes, the operation of each sensor strictly followed the instructions given by the instrument manual dispatched with the sensor.
For resistance type, the measured energy status of soil water was afterward converted into water contents by volume using the localized retention curve in
Figure 1. The retention curve was determined as follows. Three relatively undisturbed soil cores (7.6 cm diameter × 7.6 cm high) were collected from depth intervals of 8.7–16.3, 23.7–31.3, 38.7–46.3, 53.7–61.3, and 68.7–76.3 cm with a double-cylinder, hammer-driven core sampler. The bulk densities were determined to be 1.19, 1.38, 1.41, 1.45, and 1.48 g/cm
3, respectively. Prior to bulk density determination, the cores were used for partial water retention characteristic determinations. For tension ≤10 kPa (
i.e., 0.2, 2.0, 5.0, and 10 kPa) soil water contents were determined by a tension plate apparatus similar to that of Topp and Zebchuk [
18]. A tension plate designed to handle individual cores was used to eliminate disturbance resulting from removing and weighing the core at the end of each tension setting. With this arrangement, water content of the soil at each tension setting was back calculated from the collected outflow. Water content at tension >10 kPa was determined by a pressure plate apparatus at 33 and 100 kPa settings using the same cores.
Figure 1 was generated from these data. Bulk density was computed by dividing the oven-dry mass of the soil in the core by its volume.
2.2. Study site
The study site (45°55′13.2″ N, 66°36′33.7″ W) was located on the Agriculture and Agri-Food Canada Potato Research Centre in the Lower Saint John River Valley of New Brunswick. The soil was Orthic Humo-Ferric Podzol [
19] developed on a coarse loamy ancient alluvium (fluvial) over coarse loamy morainal lodgement till [
20], 30–100 cm of friable to very friable, yellowish brown (10 YR), acidic, sandy loam with 10–25% angular cobbles and gravels over a firm, dark brown (7.5 YR), acidic sandy loam with 10–20% angular gravels and some cobbles. It was characterized by 65 to 100 cm of friable topsoil over dense compact subsoil. The surface Ap horizon was a sandy loam with approximately 53% sand, 39% silt, and 8% clay by mass and relatively free of coarse fragments. Soil organic carbon content varied from 2.5% at the surface to less than 1% in the C horizon. Soil water content varied from 0.13 to 0.42 cm
3 cm
−3 and soil temperature from 15 °C to 27 °C at a depth of 30–35 cm during the testing period. The soil water condition and rainfall during the test period are shown in
Figure 2.
2.3. Experimental design and sensor installation
Mass-based gravimetric soil water determinations (GM) were used as reference values for the other sensors in this research. Although the soil in the research site was a uniform sandy loam, to minimize the measurement error caused by variations in soil texture and bulky density between the GM site and other sensor sites, soil samples were collected from the soil nearby the instrumented location (within 5 m). Sensors for non-disturbed moisture determination were installed in an area of approximately 2 m in diameter. To reduce mass flow of soil water to the GM sampling holes, the holes were immediately refilled with soil from similar profiles taken from a site 10 m away. The GM sample sites were marked with flags so that no repeatedly soil-sampling at the same spot. Soil samples were taken with a MODEL L soil sampler which is a 91.44 cm one-piece welded unit with a replaceable screw-on tip on a 30.48 cm long sampling barrel, manufactured by Oakfield Apparatus Inc. (USA).
Corresponding to the depths of the installed sensors, duplicate sets of soil samples at depths of 5–20, 20–35, 35–50, 50–65, and 65–80 cm from the soil surface were taken on each measurement day. After obtaining the wet mass, the samples were oven dried at 105 °C for 24 hrs. Soil water contents by mass were calculated by dividing the difference between the wet and dry masses by the corresponding masses of dry samples. Water content by volume was then obtained by multiplying the water content by mass with the bulk density of the corresponding layer and then dividing it by the density of water.
In this research, CS615, WaterMark, and Gypsum probes were installed in a profile fashion with five layers at the above-mentioned depths. Two soil pits (approximately 1 meter in diameter and 100 cm in depth) were dug for ease of installing two sets of CS615 and Trase sensors. The length of the waveguide used in the CS615 and Trase were 30 and 20 cm, respectively and therefore, they were installed from the beginning of each depth interval at 30° and 50° angles, respectively to achieve the 15 cm resolution in depth. WaterMark and Gypsum were installed in duplicates at the mid-point of each depth interval by auguring a hole to the depth and placing the sensors. To ensure hydraulic continuity between the sensors and the surrounding soil, the sensors were pre-saturated by soaking in water and a small amount of slurry, a mixture of the soil surrounding the sensors and water, was then poured into the hole, around the sensor. MoisturePoint® (MP917) profiling probes (TypeH) capable of measuring soil moisture contents in 5 segments of 15 cm soil depths were inserted vertically from the soil surface to coincide with the depth intervals of other sensors.
For other profiling systems, thin wall access tubes made of either fiber-glass (Gopher and TRIME-FM) or aluminum (Troxler neutron) were inserted into the soil where the measurements were taken. The sensors were then manually lowered down to these access tubes and soil water contents were determined at the depths corresponding to the gravimetric and other sensor installation depths.
The CS615, Watermark, and Gypsum sensors were connected to a CR10X datalogger through a multiplexer for automated recording of either raw or processed data. The sensors recorded a 60-minute average of the measurements with a scanning interval of 10 minutes. There were no data gaps for those continuously operated sensors. After converting to soil water contents, an average of the measurements of the two replicates was calculated and used in further analysis. With exceptions of the CS615, Watermark, and Gypsum, other sensors were measured manually according to their operating instructions. These manual measurements were taken whenever gravimetric soil moisture samples were collected.
All sensors had two replications for each measurement depth except for TRIME which had four repetitions for each depth. Sensor orientation followed the standard rules described in the sensor manual. CS615, Trase, MP917, and TRIME-FM used a factory calibration, while other sensors were calibrated locally.
2.4. Statistical analysis
Following Leib
et al. [
8], three statistical parameters were adopted to assess the performance of each sensor against GM. The mean difference (MD), suggested by Addicott and Whitmore [
21] to describe the average difference between sensor measurements and the corresponding GM measurements, is expressed as:
where
Msi is the
ith measurement obtained by a sensor,
Mgi is the
ith measurement obtained with GM, and n is the number of samples.
The relative root mean square error (RRMSE), proposed by Loague and Green [
22] and calculated as the total difference between the sensor and the GM measurements of soil water content as a percentage of the mean GM measurement value, is given as:
where
Mg is the corresponding mean of gravimetric measurement, calculated as:
The coefficient of determination (
r2), described in previous research [
23,
24], was used to display the degree of similarity between sensor measurements and GM measurements using the slope and intercept of the linear regression between the sensor measurements and the GM measurements. If the sensors performed well, the value of the MD and RRMSE should be close to zero, with a significant linear regression indicated by an intercept of zero, slope of 1, and
r2 of 1. Other statistical analysis methods such as descriptive statistics and t-test were also used to examine the differences between sensor measurements and the GM measurements.
4. Discussion
Several reasons could be responsible for the underperformance of the resistance type sensors in this test, including: (i) the resistance type had a calibration drift issue which is related to the configuration of the sensor [
4], in particular, with continuous measuring (
i.e., in this research) and (ii) the resistance sensors were more temperature sensitive [
3,
4] and also were easily influenced by other factors beyond water content changes such as fertilizer scheme even with gypsum buffering [
4,
5].
Although the neutron method was found to perform better than the dielectric methods in previous research [
8] and was suggested that a local soil type-based calibration of the neutron method could make this approach appealing [
3], our research indicated that this method performed well but not as good as some of the dielectric methods such as CS615 and Trase. This finding is similar to the research finding by Hanson and Peters [
11] who found that Trase was generally more accurate than a neutron method in all kinds of soils in their tests. Further, when using the neutron method as a reference to check the performance of other sensors, Leib
et al. [
8] found that the measured values of soil water varied significantly between sensor measurements and the calibrated neutron probe measurements. The conflicting results may be mainly caused by (i) soil types, (ii) local calibration for neutron, and (iii) soil water levels during the test period. Furthermore, the calibration requirement for neutron type sensor would involve additional work and sometimes is hard to carry out comparing with other water determination approaches in that calibration is not a requirement such as Trase, CS615 and TRIME-FM. The safety concern and required training with the neutron method also makes the method less favorable.
As indicated in
Figure 5a, most sensors performed reasonably well between 20 and 50 cm depths, which is probably the major targeted soil layer of sensor design. The poor performance of the tested sensors on the surface and deeper layers may be attributed to large variations of soil water content (top layer) and water saturation condition (deeper layers).
Trase generally displayed the best performance with the factory-defined calibration coefficient in this research. With local calibration, the method could be expected to achieve a better accuracy. However, the sensor is the most expensive one among all tested sensors and also not very convenient in field operation when profile measurements and multi-point measurements are required [
4,
25] because the sensor is hard to be installed in a fashion of multiple locations.
Although CS615 sensor performed slightly poorer than Trase, the sensor is simple, light, and easy to handle in field work. Being easily connected to a datalogger, the sensor can be applied to obtain temporal and spatial measurements of soil water contents at the landscape level.
Troxler showed very promising performance in this region (
Figure 3i) but poorer than the Trase and CS615. It overestimated soil water contents by 4%. Furthermore, it did not give consistently good performance at various depths (
Figure 4 and Table 3). Similar to Trase, the sensor is large-sized, heavy and lacks flexibility to be used in the field. The high cost and strict safety requirements of application due to radiation makes this sensor less favorable in this region [
4,
14,
25]. The calibration requirement makes this sensor inconvenient when the calibration conditions are unavailable. However, it is a good option to use this sensor as reference to either calibrate or check other sensors.
TRIME had a low relative bias of 1%, lowest MD, and a slight overestimation. However, the method displayed unstable performance, which may suggest necessity of local calibration.
MP demonstrated a below-average performance at varying depths. The method is hard to be automated.
Although the Gopher achieved the highest r2 and very high slope in regression analysis in this test, the scatter plot showed an unreasonably smaller range pattern which could significantly bias the method in terms of the time series, suggesting a calibration issue.
Netafim showed obvious estimation bias when water contents were higher than 0.3. Also the method performed poorly in regression analysis. The sensor performed better when the soil water content was lower than 0.3 but displayed a larger variation when the water content was above 0.4 although this problem seems to be common for the test sensors.
Despite Watermark and Gypsum following the major pattern of soil water content and being low cost to purchase they did not perform satisfactorily in this region. Increasing the number of duplications and careful and frequent calibration could possibly make these methods more acceptable [
4,
5] if continuous measurements must be made.
5. Conclusions
Among the tested sensors and regardless of installation depth and soil water regime, CS615, Trase, and Troxler performed the best with the factory calibration, with a relative root mean square error (RRMSE) of 15.78, 16.93, and 17.65%, and a r2 of 0.75, 0.77, and 0.65, respectively. These sensors can relatively consistently capture the variations of soil water content with the soil depths.
TRIME, Moisture Point (MP917), and Gopher performed slightly worse with the factory calibration with a RRMSE of 19.78, 26.57, and 20.41%, and a r2 value of 0.65, 0.72, and 0.78, respectively, while the Gypsum, WaterMark, and Netafim showed a need for careful calibration before application in this region, in particular, for making continuous measurements. Although Trase and Troxler demonstrated similar good performance as CS615 mostly, the higher cost and heavy package may constrain the application of these sensors.